2023-11-18T20:21:37.946 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-18T20:21:37.946 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682 -- /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/orig.config.yaml 2023-11-18T20:21:37.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-18T20:21:38.063 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682 branch: main description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: yweinste@redhat.com first_in_suite: false job_id: '7461682' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1491 sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGHNCsE/hMP4Z1e5fz/OFpk7lD0+VWm60K6F7YxqW1PD4pPALKB7KefvLQraYkThox8QYUuy8BLa5Hp7SagY90= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEr+o5/Q+SkrhSr4srh7gdRmgus5bo0IggXPhv9qxBtdqH62nOZQauKLok2v2nowcpVx/mjawE98Ujj6qlYG29M= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-18_13:51:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-18T20:21:38.063 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa; will attempt to use it 2023-11-18T20:21:38.064 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks 2023-11-18T20:21:38.064 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-18T20:21:38.065 INFO:teuthology.task.internal:Checking packages... 2023-11-18T20:21:38.086 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe' 2023-11-18T20:21:38.087 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-18T20:21:38.087 INFO:teuthology.packaging:ref: None 2023-11-18T20:21:38.087 INFO:teuthology.packaging:tag: None 2023-11-18T20:21:38.087 INFO:teuthology.packaging:branch: main 2023-11-18T20:21:38.087 INFO:teuthology.packaging:sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:21:38.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-18T20:21:38.341 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7424.g6adc03ac 2023-11-18T20:21:38.341 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-18T20:21:38.349 INFO:teuthology.task.internal:no buildpackages task found 2023-11-18T20:21:38.350 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-18T20:21:38.365 INFO:teuthology.task.internal:Saving configuration 2023-11-18T20:21:38.379 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-18T20:21:38.385 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T20:21:38.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 20:16:33.337977', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGHNCsE/hMP4Z1e5fz/OFpk7lD0+VWm60K6F7YxqW1PD4pPALKB7KefvLQraYkThox8QYUuy8BLa5Hp7SagY90='} 2023-11-18T20:21:38.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 20:16:33.336279', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEr+o5/Q+SkrhSr4srh7gdRmgus5bo0IggXPhv9qxBtdqH62nOZQauKLok2v2nowcpVx/mjawE98Ujj6qlYG29M='} 2023-11-18T20:21:38.431 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-18T20:21:38.437 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-18T20:21:38.437 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-11-18T20:21:38.437 INFO:teuthology.run_tasks:Running task console_log... 2023-11-18T20:21:38.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5cb4187040>, signals=[15]) 2023-11-18T20:21:38.508 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-18T20:21:38.513 INFO:teuthology.task.internal:Opening connections... 2023-11-18T20:21:38.514 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:21:38.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:21:38.601 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:21:38.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:21:38.684 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-18T20:21:38.695 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-11-18T20:21:38.713 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-11-18T20:21:38.713 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-11-18T20:21:38.770 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-11-18T20:21:38.771 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-18T20:21:38.771 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-11-18T20:21:38.771 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-18T20:21:38.771 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-18T20:21:38.771 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-18T20:21:38.771 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-11-18T20:21:38.789 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-11-18T20:21:38.807 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-11-18T20:21:38.807 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-11-18T20:21:38.863 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-11-18T20:21:38.863 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2023-11-18T20:21:38.863 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-11-18T20:21:38.863 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-11-18T20:21:38.863 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2023-11-18T20:21:38.863 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2023-11-18T20:21:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-18T20:21:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-11-18T20:21:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2023-11-18T20:21:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-18T20:21:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-11-18T20:21:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-18T20:21:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-18T20:21:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-18T20:21:38.864 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-11-18T20:21:38.889 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-18T20:21:38.898 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-18T20:21:38.906 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-18T20:21:38.906 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2023-11-18T20:21:38.909 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2023-11-18T20:21:38.924 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-18T20:21:38.929 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-18T20:21:38.930 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2023-11-18T20:21:38.965 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2023-11-18T20:21:38.992 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-18T20:21:39.045 INFO:teuthology.run_tasks:Running task kernel... 2023-11-18T20:21:39.059 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-11-18T20:21:39.059 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-11-18T20:21:39.059 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-18T20:21:39.059 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-18T20:21:39.060 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-18T20:21:39.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:21:39.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-18T20:21:39.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:21:39.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-18T20:21:39.236 DEBUG:teuthology.task.kernel:sha1 for client.1 is ab677fe869e84af753f648236d6083528a81a405 2023-11-18T20:21:39.236 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "ab677fe869e84af753f648236d6083528a81a405"... 2023-11-18T20:21:39.236 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-11-18T20:21:39.253 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-361.el9.x86_64 2023-11-18T20:21:39.253 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs ab677fe869e84af753f648236d6083528a81a405 2023-11-18T20:21:39.254 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-18T20:21:39.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum upgrade -y linux-firmware 2023-11-18T20:21:39.325 DEBUG:teuthology.task.kernel:sha1 for client.0 is ab677fe869e84af753f648236d6083528a81a405 2023-11-18T20:21:39.325 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "ab677fe869e84af753f648236d6083528a81a405"... 2023-11-18T20:21:39.326 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-11-18T20:21:39.343 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-361.el9.x86_64 2023-11-18T20:21:39.343 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs ab677fe869e84af753f648236d6083528a81a405 2023-11-18T20:21:39.343 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-18T20:21:39.343 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum upgrade -y linux-firmware 2023-11-18T20:21:41.327 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-11-18T20:21:41.338 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-11-18T20:21:42.705 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-11-18T20:21:42.944 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2023-11-18T20:21:43.810 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-11-18T20:21:45.038 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 7.9 MB 00:02 2023-11-18T20:21:47.917 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-11-18T20:21:48.727 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 18 MB 00:03 2023-11-18T20:21:53.786 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 5.8 MB 00:01 2023-11-18T20:21:54.419 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 5.8 MB 00:02 2023-11-18T20:21:55.295 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 15 kB 00:00 2023-11-18T20:21:55.425 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 15 kB 00:00 2023-11-18T20:21:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:00 2023-11-18T20:21:56.800 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2023-11-18T20:22:01.146 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-11-18T20:22:01.558 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-11-18T20:22:03.665 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-11-18T20:22:03.677 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-11-18T20:22:03.677 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-11-18T20:22:03.678 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-11-18T20:22:03.678 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-11-18T20:22:03.678 INFO:teuthology.orchestra.run.smithi161.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-18T20:22:03.678 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:22:03.678 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-11-18T20:22:03.678 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-11-18T20:22:03.678 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 1 Package 2023-11-18T20:22:03.678 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:22:03.679 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 328 M 2023-11-18T20:22:03.679 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-11-18T20:22:03.988 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-11-18T20:22:04.002 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-11-18T20:22:04.002 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2023-11-18T20:22:04.002 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-11-18T20:22:04.002 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2023-11-18T20:22:04.002 INFO:teuthology.orchestra.run.smithi132.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-18T20:22:04.002 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:22:04.003 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-11-18T20:22:04.003 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-11-18T20:22:04.003 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 1 Package 2023-11-18T20:22:04.003 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:22:04.003 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 328 M 2023-11-18T20:22:04.003 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-11-18T20:22:07.772 INFO:teuthology.orchestra.run.smithi161.stdout:linux-firmware-20231030-141.el9.noarch.rpm 80 MB/s | 328 MB 00:04 2023-11-18T20:22:07.773 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-11-18T20:22:07.773 INFO:teuthology.orchestra.run.smithi161.stdout:Total 80 MB/s | 328 MB 00:04 2023-11-18T20:22:07.774 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-11-18T20:22:07.847 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-11-18T20:22:07.847 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-11-18T20:22:08.068 INFO:teuthology.orchestra.run.smithi132.stdout:linux-firmware-20231030-141.el9.noarch.rpm 81 MB/s | 328 MB 00:04 2023-11-18T20:22:08.069 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-11-18T20:22:08.069 INFO:teuthology.orchestra.run.smithi132.stdout:Total 81 MB/s | 328 MB 00:04 2023-11-18T20:22:08.069 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-11-18T20:22:08.152 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-11-18T20:22:08.152 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-11-18T20:22:10.058 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-11-18T20:22:10.058 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-11-18T20:22:10.503 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-11-18T20:22:10.503 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-11-18T20:22:16.057 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-11-18T20:22:16.337 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-11-18T20:22:16.427 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-18T20:22:16.511 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T20:22:16.625 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-18T20:22:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T20:22:17.548 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T20:22:17.548 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-18T20:22:17.760 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T20:22:17.761 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-18T20:22:17.955 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T20:22:17.955 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:22:17.955 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-11-18T20:22:17.955 INFO:teuthology.orchestra.run.smithi161.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-18T20:22:17.955 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:22:17.955 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-11-18T20:22:18.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T20:22:18.167 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:22:18.167 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2023-11-18T20:22:18.167 INFO:teuthology.orchestra.run.smithi132.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-18T20:22:18.167 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:22:18.167 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-11-18T20:22:18.215 INFO:teuthology.task.kernel:Downloading kernel ab677fe869e84af753f648236d6083528a81a405 on client.1... 2023-11-18T20:22:18.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ab677fe869e84af753f648236d6083528a81a405 2023-11-18T20:22:18.435 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/ 2023-11-18T20:22:18.435 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gab677fe869e8-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-18T20:22:18.437 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi161.front.sepia.ceph.com to complete... 2023-11-18T20:22:18.455 INFO:teuthology.task.kernel:Downloading kernel ab677fe869e84af753f648236d6083528a81a405 on client.0... 2023-11-18T20:22:18.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ab677fe869e84af753f648236d6083528a81a405 2023-11-18T20:22:18.596 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/ 2023-11-18T20:22:18.596 DEBUG:teuthology.orchestra.run.smithi132:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gab677fe869e8-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-18T20:22:18.599 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi132.front.sepia.ceph.com to complete... 2023-11-18T20:22:38.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18 20:22:38 URL:https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/kernel-6.6.0_gab677fe869e8-1.x86_64.rpm [320491466/320491466] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-18T20:22:38.452 INFO:teuthology.orchestra.run.smithi161.stderr:FINISHED --2023-11-18 20:22:38-- 2023-11-18T20:22:38.452 INFO:teuthology.orchestra.run.smithi161.stderr:Total wall clock time: 20s 2023-11-18T20:22:38.453 INFO:teuthology.orchestra.run.smithi161.stderr:Downloaded: 1 files, 306M in 20s (15.5 MB/s) 2023-11-18T20:22:38.453 INFO:teuthology.task.kernel:Installing kernel ab677fe869e84af753f648236d6083528a81a405 on client.1... 2023-11-18T20:22:38.454 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-18T20:22:39.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18 20:22:39 URL:https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/kernel-6.6.0_gab677fe869e8-1.x86_64.rpm [320491466/320491466] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-18T20:22:39.855 INFO:teuthology.orchestra.run.smithi132.stderr:FINISHED --2023-11-18 20:22:39-- 2023-11-18T20:22:39.855 INFO:teuthology.orchestra.run.smithi132.stderr:Total wall clock time: 21s 2023-11-18T20:22:39.855 INFO:teuthology.orchestra.run.smithi132.stderr:Downloaded: 1 files, 306M in 21s (14.6 MB/s) 2023-11-18T20:22:39.856 INFO:teuthology.task.kernel:Installing kernel ab677fe869e84af753f648236d6083528a81a405 on client.0... 2023-11-18T20:22:39.856 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-18T20:22:40.296 INFO:teuthology.orchestra.run.smithi161.stdout:Verifying... ######################################## 2023-11-18T20:22:40.354 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing... ######################################## 2023-11-18T20:22:40.433 INFO:teuthology.orchestra.run.smithi161.stdout:Updating / installing... 2023-11-18T20:22:41.697 INFO:teuthology.orchestra.run.smithi132.stdout:Verifying... ######################################## 2023-11-18T20:22:41.772 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing... ######################################## 2023-11-18T20:22:41.851 INFO:teuthology.orchestra.run.smithi132.stdout:Updating / installing... 2023-11-18T20:22:47.435 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-6.6.0_gab677fe869e8-1 ######################################## 2023-11-18T20:22:48.868 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-6.6.0_gab677fe869e8-1 ######################################## 2023-11-18T20:23:02.244 INFO:teuthology.orchestra.run.smithi161.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-18T20:23:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-18T20:23:23.425 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-18T20:23:23.426 DEBUG:teuthology.orchestra.run.smithi161:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-18T20:23:23.491 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/System.map-6.6.0-gab677fe869e8 2023-11-18T20:23:23.491 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/config-6.6.0-gab677fe869e8 2023-11-18T20:23:23.491 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/vmlinuz-6.6.0-gab677fe869e8 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-18T20:23:23.492 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-18T20:23:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-18T20:23:23.494 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-18T20:23:23.494 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-18T20:23:23.494 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-18T20:23:23.494 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-18T20:23:23.494 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel 2023-11-18T20:23:23.494 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu 2023-11-18T20:23:23.494 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu/mce 2023-11-18T20:23:23.494 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm.ko 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/ansi_cprng.ko 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/anubis.ko 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/arc4.ko 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx 2023-11-18T20:23:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_memcpy.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_pq.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_tx.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_xor.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/raid6test.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/authenc.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/authencesn.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blake2b_generic.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blowfish_common.ko 2023-11-18T20:23:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blowfish_generic.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/camellia_generic.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast5_generic.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast6_generic.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast_common.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/ccm.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cmac.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crc32_generic.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crypto_engine.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crypto_user.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cts.ko 2023-11-18T20:23:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/des_generic.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/dh_generic.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/echainiv.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/essiv.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/fcrypt.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/khazad.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/lz4.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/lz4hc.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/md4.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/michael_mic.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/pcbc.ko 2023-11-18T20:23:23.498 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/pcrypt.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/rmd160.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/seed.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/serpent_generic.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/tcrypt.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/tea.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/twofish_common.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/twofish_generic.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/vmac.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/wp512.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xcbc.ko 2023-11-18T20:23:23.499 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xor.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xxhash_generic.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/acpi_pad.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/custom_method.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/ec_sys.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/platform_profile.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/sbs.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/sbshc.ko 2023-11-18T20:23:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/video.ko 2023-11-18T20:23:23.501 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata 2023-11-18T20:23:23.501 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/acard-ahci.ko 2023-11-18T20:23:23.501 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/ahci_platform.ko 2023-11-18T20:23:23.501 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/ata_generic.ko 2023-11-18T20:23:23.501 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/libahci_platform.ko 2023-11-18T20:23:23.501 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_acpi.ko 2023-11-18T20:23:23.501 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ali.ko 2023-11-18T20:23:23.501 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_amd.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_artop.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_atiixp.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_atp867x.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cmd640.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cmd64x.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cypress.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_efar.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt366.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt37x.ko 2023-11-18T20:23:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_it8213.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_it821x.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_jmicron.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_marvell.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_mpiix.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_netcell.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ninja32.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ns87410.ko 2023-11-18T20:23:23.503 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ns87415.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_oldpiix.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_opti.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_optidma.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pcmcia.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_piccolo.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_rdc.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sch.ko 2023-11-18T20:23:23.504 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_serverworks.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sil680.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sis.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sl82c105.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_triflex.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_via.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pdc_adma.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_inic162x.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_mv.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_nv.ko 2023-11-18T20:23:23.505 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_promise.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_qstor.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sil.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sil24.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sis.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_svw.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sx4.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_uli.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_via.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_vsc.ko 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/auxdisplay 2023-11-18T20:23:23.506 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/auxdisplay/ks0108.ko 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/bcma 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/bcma/bcma.ko 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/aoe 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/aoe/aoe.ko 2023-11-18T20:23:23.507 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/brd.ko 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/drbd 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/drbd/drbd.ko 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/floppy.ko 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/loop.ko 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/mtip32xx 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/nbd.ko 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/null_blk 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/null_blk/null_blk.ko 2023-11-18T20:23:23.508 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/pktcdvd.ko 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/rbd.ko 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/virtio_blk.ko 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkback 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkfront.ko 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/zram 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/zram/zram.ko 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hangcheck-timer.ko 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random 2023-11-18T20:23:23.509 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/via-rng.ko 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-18T20:23:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/lp.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/mwave 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/mwave/mwave.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ppdev.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tlclk.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-18T20:23:23.511 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/uv_mmtimer.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/virtio_console.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-18T20:23:23.512 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp/ccp.ko 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_common 2023-11-18T20:23:23.513 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/padlock-aes.ko 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/padlock-sha.ko 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/virtio 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dca 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dca/dca.ko 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/devfreq 2023-11-18T20:23:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/dw 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/ioat 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/amd64_edac.ko 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/e752x_edac.ko 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/edac_mce_amd.ko 2023-11-18T20:23:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i3000_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i3200_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i5100_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i5400_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i7300_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i7core_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i82975x_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/ie31200_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/sb_edac.ko 2023-11-18T20:23:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/x38_edac.ko 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware/edd.ko 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio/gpio-ich.ko 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-appleir.ko 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-aureal.ko 2023-11-18T20:23:23.517 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-axff.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-dr.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-elecom.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-elo.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-emsff.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gaff.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gt683r.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gyration.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-18T20:23:23.518 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtekff.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-hyperv.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-icade.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-keytouch.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-kye.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-lcpower.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-led.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-lenovo.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-multitouch.ko 2023-11-18T20:23:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-ortek.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-penmount.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-petalynx.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-picolcd.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-pl.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-plantronics.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-primax.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-rmi.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-common.ko 2023-11-18T20:23:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-saitek.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-samsung.ko 2023-11-18T20:23:23.521 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sjoy.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sony.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-speedlink.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-steelseries.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sunplus.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-tivo.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-tmff.ko 2023-11-18T20:23:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-topseed.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-twinhan.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-uclogic.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-waltop.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-wiimote.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-xinmo.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-zpff.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-zydacron.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/uhid.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/wacom.ko 2023-11-18T20:23:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_balloon.ko 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_utils.ko 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_vmbus.ko 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/abituguru.ko 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/abituguru3.ko 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ad7414.ko 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ad7418.ko 2023-11-18T20:23:23.524 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adc128d818.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1025.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1026.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1029.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1031.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm9240.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ads7828.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7410.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7411.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7462.ko 2023-11-18T20:23:23.525 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7470.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7475.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7x10.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/amc6821.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/applesmc.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asb100.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asc7621.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/atxp1.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/coretemp.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-18T20:23:23.526 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/dme1737.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ds1621.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ds620.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/emc1403.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/emc6w201.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f71805f.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f71882fg.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f75375s.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/fam15h_power.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/fschmd.ko 2023-11-18T20:23:23.527 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/g760a.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/g762.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/gl518sm.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/gl520sm.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/i5500_temp.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/i5k_amb.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ibmaem.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ibmpex.ko 2023-11-18T20:23:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ina209.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ina2xx.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/it87.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/k10temp.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/k8temp.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lineage-pem.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm63.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm73.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm75.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm77.ko 2023-11-18T20:23:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm78.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm80.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm83.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm85.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm87.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm90.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm92.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm93.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95234.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95241.ko 2023-11-18T20:23:23.530 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95245.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc2945.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4151.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4215.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4222.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4245.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4260.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4261.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max16065.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max1619.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max1668.ko 2023-11-18T20:23:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max197.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6639.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6650.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6697.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/mcp3021.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6683.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6775-core.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6775.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct7802.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pc87360.ko 2023-11-18T20:23:23.532 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pc87427.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pcf8591.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-18T20:23:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/powr1220.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch5627.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch5636.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sht15.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sht21.ko 2023-11-18T20:23:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/shtc1.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sis5595.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47b397.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47m1.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47m192.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/thmc50.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp102.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp103.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp401.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp421.ko 2023-11-18T20:23:23.535 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/via-cputemp.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/via686a.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/vt1211.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/vt8231.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83627ehf.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83627hf.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83781d.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83791d.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83792d.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83793.ko 2023-11-18T20:23:23.536 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83795.ko 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83l785ts.ko 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83l786ng.ko 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-18T20:23:23.537 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-18T20:23:23.538 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-18T20:23:23.539 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-dev.ko 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-mux.ko 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-smbus.ko 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-stub.ko 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-18T20:23:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_core.ko 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/cxgb4 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx4 2023-11-18T20:23:23.541 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx5 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mthca 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/ipoib 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/iser 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-18T20:23:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/isert 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srp 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srpt 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-18T20:23:23.543 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/gameport.ko 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/joydev.ko 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/keyboard 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/appletouch.ko 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/bcm5974.ko 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/cyapatp.ko 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/sermouse.ko 2023-11-18T20:23:23.544 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/rmi4 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/altera_ps2.ko 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/arc_ps2.ko 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/serio_raw.ko 2023-11-18T20:23:23.545 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/sparse-keymap.ko 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu/amd 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-blinkm.ko 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-lm3530.ko 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-lp3944.ko 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-ss4200.ko 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-18T20:23:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/bcache 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/bcache/bcache.ko 2023-11-18T20:23:23.547 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-bio-prison.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-cache-smq.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-cache.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-crypt.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-delay.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-flakey.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-log-userspace.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-multipath.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-queue-length.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-raid.ko 2023-11-18T20:23:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-round-robin.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-service-time.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-switch.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-thin-pool.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-verity.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/faulty.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/linear.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/multipath.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/persistent-data 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid0.ko 2023-11-18T20:23:23.549 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid1.ko 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid10.ko 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid456.ko 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptbase.ko 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptctl.ko 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptfc.ko 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptlan.ko 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptsas.ko 2023-11-18T20:23:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptscsih.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptspi.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/lpc_ich.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/lpc_sch.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/mfd-core.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/sm501.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/viperboard.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/vx855.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/wl1273-core.ko 2023-11-18T20:23:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/altera-stapl 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/apds9802als.ko 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/apds990x.ko 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/bh1770glc.ko 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/cb710 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/cb710/cb710.ko 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/at24.ko 2023-11-18T20:23:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/max6875.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/enclosure.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/hpilo.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/isl29003.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/isl29020.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei 2023-11-18T20:23:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei-me.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei-txe.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-gru 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tifm_7xx1.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tifm_core.ko 2023-11-18T20:23:23.554 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tsl2550.ko 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_balloon.ko 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_vmci 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/bonding 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/bonding/bonding.ko 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/b53 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-18T20:23:23.555 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6xxx 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dummy.ko 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/eql.ko 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390 2023-11-18T20:23:23.556 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/adaptec 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/agere 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/alteon 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/altera 2023-11-18T20:23:23.557 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/alx 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-18T20:23:23.558 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/genet 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-18T20:23:23.559 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade/bna 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-18T20:23:23.560 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco/enic 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-18T20:23:23.561 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dnet.ko 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex/benet 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-18T20:23:23.562 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ethoc.ko 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/fealnx.ko 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000e 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/fm10k 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/i40e 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-18T20:23:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/iavf 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igb 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igbvf 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-18T20:23:23.564 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/jme.ko 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-18T20:23:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/micrel 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-18T20:23:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/neterion 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/nvidia 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-18T20:23:23.567 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rdc 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-18T20:23:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rocker 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sfc 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/silan 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc 2023-11-18T20:23:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-18T20:23:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/tehuti 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ti 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet 2023-11-18T20:23:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/xircom 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/geneve.ko 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/hyperv 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ieee802154 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ifb.ko 2023-11-18T20:23:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ipvlan 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/macvlan.ko 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/macvtap.ko 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio.ko 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-18T20:23:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mii.ko 2023-11-18T20:23:23.574 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/net_failover.ko 2023-11-18T20:23:23.574 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/netconsole.ko 2023-11-18T20:23:23.574 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/nlmon.ko 2023-11-18T20:23:23.574 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs 2023-11-18T20:23:23.574 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-18T20:23:23.574 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-18T20:23:23.574 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy 2023-11-18T20:23:23.574 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/amd.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm87xx.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/broadcom.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/cicada.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/davicom.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/dp83640.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/et1011c.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/icplus.ko 2023-11-18T20:23:23.575 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/lxt.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/marvell.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/micrel.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/national.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/phylink.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/qsemi.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/realtek.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/smsc.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/ste10Xp.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/vitesse.ko 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp 2023-11-18T20:23:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_async.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pppoe.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pppox.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pptp.ko 2023-11-18T20:23:23.577 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip/slhc.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip/slip.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/sungem_phy.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/tap.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_random.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-18T20:23:23.578 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/tun.ko 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/veth.ko 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/virtio_net.ko 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vmxnet3 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vxlan 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vxlan/vxlan.ko 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netback 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netfront.ko 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ntb 2023-11-18T20:23:23.579 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ntb/ntb.ko 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host/nvme-core.ko 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host/nvme.ko 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport.ko 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_cs.ko 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_pc.ko 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_serial.ko 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/hotplug 2023-11-18T20:23:23.580 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/pcie 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/xen-pcifront.ko 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/i82092.ko 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/pd6729.ko 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl/intel 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-18T20:23:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/acerhdf.ko 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-18T20:23:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/hdaps.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel_ips.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-18T20:23:23.583 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/wmi.ko 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients 2023-11-18T20:23:23.584 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps_parport.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/pps_core.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp/ptp.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp/ptp_kvm.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-18T20:23:23.585 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-em3027.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-18T20:23:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-max6900.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-18T20:23:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-x1205.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-9xxx.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-sas.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-xxxx.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/BusLogic.ko 2023-11-18T20:23:23.588 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/a100u2w.ko 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aacraid 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/advansys.ko 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/am53c974.ko 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/arcmsr 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-18T20:23:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/atp870u.ko 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/be2iscsi 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bfa 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bfa/bfa.ko 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2fc 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2i 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-18T20:23:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ch.ko 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/csiostor 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/dc395x.ko 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler 2023-11-18T20:23:23.591 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/dmx3191d.ko 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esas2r 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esp_scsi.ko 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-18T20:23:23.592 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fnic 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fnic/fnic.ko 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hpsa.ko 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hptiop.ko 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hv_storvsc.ko 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/initio.ko 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ipr.ko 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ips.ko 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/isci 2023-11-18T20:23:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/isci/isci.ko 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libfc 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libfc/libfc.ko 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libiscsi.ko 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libsas 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libsas/libsas.ko 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/lpfc 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-18T20:23:23.594 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid.ko 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mpt3sas 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvsas 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-18T20:23:23.595 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvumi.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pm8001 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pmcraid.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla1280.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla4xxx 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/raid_class.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_debug.ko 2023-11-18T20:23:23.596 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ses.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/st.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/stex.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/sym53c8xx_2 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/virtio_scsi.ko 2023-11-18T20:23:23.597 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-18T20:23:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/wd719x.ko 2023-11-18T20:23:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ssb 2023-11-18T20:23:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ssb/ssb.ko 2023-11-18T20:23:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target 2023-11-18T20:23:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/iscsi 2023-11-18T20:23:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-18T20:23:23.598 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/loopback 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_file.ko 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_iblock.ko 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_mod.ko 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_pscsi.ko 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_user.ko 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/tcm_fc 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal 2023-11-18T20:23:23.599 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-18T20:23:23.600 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-18T20:23:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-18T20:23:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-18T20:23:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-18T20:23:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-18T20:23:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-18T20:23:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty 2023-11-18T20:23:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/ipwireless 2023-11-18T20:23:23.602 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-18T20:23:23.602 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/n_gsm.ko 2023-11-18T20:23:23.602 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/n_hdlc.ko 2023-11-18T20:23:23.602 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/nozomi.ko 2023-11-18T20:23:23.602 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial 2023-11-18T20:23:23.602 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/8250 2023-11-18T20:23:23.602 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-18T20:23:23.602 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/arc_uart.ko 2023-11-18T20:23:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/jsm 2023-11-18T20:23:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-18T20:23:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs 2023-11-18T20:23:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/core 2023-11-18T20:23:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-18T20:23:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/host 2023-11-18T20:23:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-18T20:23:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio.ko 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_aec.ko 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_cif.ko 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_pci_generic.ko 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_sercos3.ko 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/cdc-acm.ko 2023-11-18T20:23:23.604 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/usblp.ko 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/usbtmc.ko 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/host 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image/mdc800.ko 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image/microtek.ko 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc 2023-11-18T20:23:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/adutux.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/appledisplay.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/emi26.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/emi62.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/ezusb.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/idmouse.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/iowarrior.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/ldusb.ko 2023-11-18T20:23:23.606 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/legousbtower.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/sisusbvga 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usb3503.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usblcd.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/uss720.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/yurex.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/phy 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/phy/phy-generic.ko 2023-11-18T20:23:23.607 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/aircable.ko 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ark3116.ko 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ch341.ko 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cp210x.ko 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cyberjack.ko 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-18T20:23:23.608 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/empeg.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/io_ti.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ipaq.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ipw.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ir-usb.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/keyspan.ko 2023-11-18T20:23:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mct_u232.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mos7720.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mos7840.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/navman.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/omninet.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/opticon.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/option.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/oti6858.ko 2023-11-18T20:23:23.610 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/pl2303.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/qcaux.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/qcserial.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/quatech2.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/safe_serial.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/sierra.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ssu100.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/symbolserial.ko 2023-11-18T20:23:23.611 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb_debug.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/visor.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/whiteheat.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/uas.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-18T20:23:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-karma.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-18T20:23:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/usb-storage.ko 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio 2023-11-18T20:23:23.614 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/vfio.ko 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost.ko 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_net.ko 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_scsi.ko 2023-11-18T20:23:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/apple_bl.ko 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/lcd.ko 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio.ko 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_balloon.ko 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_mmio.ko 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci.ko 2023-11-18T20:23:23.616 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_ring.ko 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters/ds2482.ko 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters/ds2490.ko 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-18T20:23:23.617 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-18T20:23:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/wire.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/hpwdt.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/i6300esb.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ib700wdt.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ibmasr.ko 2023-11-18T20:23:23.619 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/it87_wdt.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/machzwd.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/nv_tco.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/softdog.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-18T20:23:23.620 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/via_wdt.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/wdt_pci.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/xen_wdt.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-evtchn.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-gntalloc.ko 2023-11-18T20:23:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-gntdev.ko 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-pciback 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-privcmd.ko 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xenfs 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/9p 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/9p/9p.ko 2023-11-18T20:23:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/affs 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/affs/affs.ko 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/befs 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/befs/befs.ko 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/binfmt_misc.ko 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/btrfs 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/btrfs/btrfs.ko 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cachefiles 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cachefiles/cachefiles.ko 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ceph 2023-11-18T20:23:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ceph/ceph.ko 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/coda 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/coda/coda.ko 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cramfs 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cramfs/cramfs.ko 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/dlm 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/dlm/dlm.ko 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ecryptfs 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/f2fs 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/f2fs/f2fs.ko 2023-11-18T20:23:23.624 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/fat.ko 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/msdos.ko 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/vfat.ko 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fscache 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fscache/fscache.ko 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse/cuse.ko 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse/fuse.ko 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/gfs2 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/gfs2/gfs2.ko 2023-11-18T20:23:23.625 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfs 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfs/hfs.ko 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfsplus 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfsplus/hfsplus.ko 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/isofs 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/isofs/isofs.ko 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/jfs 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/jfs/jfs.ko 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/lockd 2023-11-18T20:23:23.626 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/lockd/lockd.ko 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/minix 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/minix/minix.ko 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/netfs 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/netfs/netfs.ko 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/blocklayout 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/filelayout 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/flexfilelayout 2023-11-18T20:23:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfs.ko 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfsv3.ko 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfsv4.ko 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common/grace.ko 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common/nfs_acl.ko 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfsd 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfsd/nfsd.ko 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nilfs2 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nilfs2/nilfs2.ko 2023-11-18T20:23:23.628 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-celtic.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-centeuro.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-croatian.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-cyrillic.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-gaelic.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-greek.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-iceland.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-inuit.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-roman.ko 2023-11-18T20:23:23.629 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-romanian.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-turkish.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1250.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1251.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1255.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp737.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp775.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp850.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp852.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp855.ko 2023-11-18T20:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp857.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp860.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp861.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp862.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp863.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp864.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp865.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp866.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp869.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp874.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp932.ko 2023-11-18T20:23:23.631 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp936.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp949.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp950.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_euc-jp.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-1.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-13.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-14.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-15.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-2.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-3.ko 2023-11-18T20:23:23.632 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-4.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-5.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-6.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-7.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-9.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-r.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-ru.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-u.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_utf8.ko 2023-11-18T20:23:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/cluster 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlm 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlmfs 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2.ko 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-18T20:23:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/overlayfs 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/overlayfs/overlay.ko 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/pstore 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/pstore/ramoops.ko 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/reiserfs 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/reiserfs/reiserfs.ko 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/romfs 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/romfs/romfs.ko 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/client 2023-11-18T20:23:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/client/cifs.ko 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common/cifs_arc4.ko 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common/cifs_md4.ko 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/squashfs 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/squashfs/squashfs.ko 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/sysv 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/sysv/sysv.ko 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/udf 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/udf/udf.ko 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ufs 2023-11-18T20:23:23.636 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ufs/ufs.ko 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/xfs 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/xfs/xfs.ko 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/rcu 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/rcu/rcutorture.ko 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/torture.ko 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/trace 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/asn1_encoder.ko 2023-11-18T20:23:23.637 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crc-itu-t.ko 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crc8.ko 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto/libarc4.ko 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto/libdes.ko 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/libcrc32c.ko 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lru_cache.ko 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4/lz4_compress.ko 2023-11-18T20:23:23.638 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4/lz4hc_compress.ko 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/math 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/math/cordic.ko 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/raid6 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/raid6/raid6_pq.ko 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/reed_solomon 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_bm.ko 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_fsm.ko 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_kmp.ko 2023-11-18T20:23:23.639 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/zstd 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/zstd/zstd_compress.ko 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/mm 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/mm/hwpoison-inject.ko 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/6lowpan.ko 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_dest.ko 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_fragment.ko 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_hop.ko 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-18T20:23:23.640 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_mobility.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_routing.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_udp.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/garp.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/mrp.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/p8022.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/psnap.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/stp.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/8021q 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/8021q/8021q.ko 2023-11-18T20:23:23.641 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet.ko 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_fd.ko 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_rdma.ko 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_virtio.ko 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/batman-adv 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/batman-adv/batman-adv.ko 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/br_netfilter.ko 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/bridge.ko 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter 2023-11-18T20:23:23.642 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-18T20:23:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-18T20:23:23.644 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtables.ko 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ceph 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ceph/libceph.ko 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core/failover.ko 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core/pktgen.ko 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp.ko 2023-11-18T20:23:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_diag.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_ipv4.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_ipv6.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dns_resolver 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dns_resolver/dns_resolver.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/dsa_core.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_brcm.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_dsa.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_none.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_trailer.ko 2023-11-18T20:23:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/6lowpan 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/ieee802154.ko 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ah4.ko 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/esp4.ko 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/fou.ko 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/gre.ko 2023-11-18T20:23:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/inet_diag.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_gre.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_tunnel.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_vti.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ipcomp.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ipip.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-18T20:23:23.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-18T20:23:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_bic.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_dctcp.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_diag.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_highspeed.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_htcp.ko 2023-11-18T20:23:23.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_hybla.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_illinois.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_lp.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_scalable.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_vegas.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_veno.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_westwood.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_yeah.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tunnel4.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/udp_diag.ko 2023-11-18T20:23:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/udp_tunnel.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ah6.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/esp6.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/fou6.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_tunnel.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_vti.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ipcomp6.ko 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter 2023-11-18T20:23:23.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-18T20:23:23.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-18T20:23:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/sit.ko 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/tunnel6.ko 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/key 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/key/af_key.ko 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp 2023-11-18T20:23:23.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_core.ko 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_eth.ko 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ip.ko 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ip6.ko 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_netlink.ko 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ppp.ko 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/llc 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/llc/llc.ko 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mac802154 2023-11-18T20:23:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mac802154/mac802154.ko 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mpls 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mpls/mpls_gso.ko 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set.ko 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-18T20:23:23.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-18T20:23:23.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-18T20:23:23.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conncount.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-18T20:23:23.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_flow_table.ko 2023-11-18T20:23:23.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_log_syslog.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_irc.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_sip.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_tables.ko 2023-11-18T20:23:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_log.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_chain_nat.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_compat.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_ct.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_fib.ko 2023-11-18T20:23:23.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_hash.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_limit.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_log.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_masq.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_nat.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_numgen.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_queue.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_quota.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_redir.ko 2023-11-18T20:23:23.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_reject.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_reject_inet.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_socket.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_tunnel.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_AUDIT.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CT.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_DSCP.ko 2023-11-18T20:23:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_HL.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_HMARK.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_LED.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_LOG.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NETMAP.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NFLOG.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_RATEEST.ko 2023-11-18T20:23:23.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_SECMARK.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TEE.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TPROXY.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TRACE.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_addrtype.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_bpf.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cgroup.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cluster.ko 2023-11-18T20:23:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_comment.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connbytes.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connlabel.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connlimit.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connmark.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_conntrack.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cpu.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_dccp.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_devgroup.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_dscp.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ecn.ko 2023-11-18T20:23:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_esp.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_hashlimit.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_helper.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_hl.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ipcomp.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_iprange.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ipvs.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_l2tp.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_length.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_limit.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_mac.ko 2023-11-18T20:23:23.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_mark.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_multiport.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_nat.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_nfacct.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_osf.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_owner.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_physdev.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_pkttype.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_policy.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_quota.ko 2023-11-18T20:23:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_rateest.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_realm.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_recent.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_sctp.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_set.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_socket.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_state.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_statistic.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_string.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_tcpmss.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_time.ko 2023-11-18T20:23:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_u32.ko 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netlink 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netlink/netlink_diag.ko 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/nsh 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/nsh/nsh.ko 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/openvswitch.ko 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-geneve.ko 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-gre.ko 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-vxlan.ko 2023-11-18T20:23:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/packet 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/packet/af_packet_diag.ko 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds.ko 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds_rdma.ko 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds_tcp.ko 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_csum.ko 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_gact.ko 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_ipt.ko 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_mirred.ko 2023-11-18T20:23:23.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_nat.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_pedit.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_police.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_simple.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_skbedit.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_vlan.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_basic.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_bpf.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_flow.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_fw.ko 2023-11-18T20:23:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_route.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_u32.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_cmp.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_ipset.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_meta.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_nbyte.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_text.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_u32.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_choke.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_codel.ko 2023-11-18T20:23:23.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_drr.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_fq.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_gred.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_hfsc.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_hhf.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_htb.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_ingress.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_mqprio.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_mqprio_lib.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_multiq.ko 2023-11-18T20:23:23.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_netem.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_pie.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_plug.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_prio.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_qfq.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_red.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_sfb.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_sfq.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_tbf.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_teql.ko 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp 2023-11-18T20:23:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp/sctp.ko 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp/sctp_diag.ko 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/sunrpc.ko 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/xprtrdma 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-18T20:23:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc/diag.ko 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc/tipc.ko 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/unix 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/unix/unix_diag.ko 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock.ko 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-18T20:23:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/xfrm 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/encrypted-keys 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/trusted-keys 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/trusted-keys/trusted.ko 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt/lib 2023-11-18T20:23:23.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt/lib/irqbypass.ko 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.alias 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.alias.bin 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.alias.bin 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.bin 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.modinfo 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.dep 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.dep.bin 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.devname 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.order 2023-11-18T20:23:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.softdep 2023-11-18T20:23:23.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.symbols 2023-11-18T20:23:23.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.symbols.bin 2023-11-18T20:23:23.682 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gab677fe869e8 2023-11-18T20:23:23.682 DEBUG:teuthology.orchestra.run.smithi161:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-18T20:23:23.704 INFO:teuthology.orchestra.run.smithi161.stdout:postinstall scriptlet (using /bin/sh): 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gab677fe869e8 -a -r /boot/System.map-6.6.0-gab677fe869e8 ]; then 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:cp /boot/vmlinuz-6.6.0-gab677fe869e8 /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:cp /boot/System.map-6.6.0-gab677fe869e8 /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:rm -f /boot/vmlinuz-6.6.0-gab677fe869e8 /boot/System.map-6.6.0-gab677fe869e8 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:/sbin/installkernel 6.6.0-gab677fe869e8 /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:rm -f /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-18T20:23:23.705 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-18T20:23:23.706 INFO:teuthology.orchestra.run.smithi161.stdout:new-kernel-pkg --remove 6.6.0-gab677fe869e8 --rminitrd --initrdfile=/boot/initramfs-6.6.0-gab677fe869e8.img 2023-11-18T20:23:23.706 INFO:teuthology.orchestra.run.smithi161.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-18T20:23:23.706 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-install remove 6.6.0-gab677fe869e8 2023-11-18T20:23:23.706 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-11-18T20:23:23.706 INFO:teuthology.orchestra.run.smithi161.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-18T20:23:23.706 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-18T20:23:23.706 INFO:teuthology.orchestra.run.smithi161.stdout:/sbin/update-bootloader --remove 6.6.0-gab677fe869e8 2023-11-18T20:23:23.706 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-11-18T20:23:23.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2023-11-18T20:23:23.783 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2023-11-18T20:23:23.783 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2023-11-18T20:23:23.783 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.06 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 68.el9 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:Group : Unspecified 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 8264254 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-18T20:23:23.784 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : builder@centos.org 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-18T20:23:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-18T20:23:23.786 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2023-11-18T20:23:23.786 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:23:23.786 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2023-11-18T20:23:23.787 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-18T20:23:23.787 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 6.6.0-gab677fe869e8 2023-11-18T20:23:23.787 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-18T20:23:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2023-11-18T20:23:25.441 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-18T20:23:25.442 DEBUG:teuthology.orchestra.run.smithi132:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-18T20:23:25.518 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/System.map-6.6.0-gab677fe869e8 2023-11-18T20:23:25.518 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/config-6.6.0-gab677fe869e8 2023-11-18T20:23:25.518 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/vmlinuz-6.6.0-gab677fe869e8 2023-11-18T20:23:25.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8 2023-11-18T20:23:25.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel 2023-11-18T20:23:25.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch 2023-11-18T20:23:25.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86 2023-11-18T20:23:25.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto 2023-11-18T20:23:25.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-18T20:23:25.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-18T20:23:25.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-18T20:23:25.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-18T20:23:25.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-18T20:23:25.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-18T20:23:25.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-18T20:23:25.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-18T20:23:25.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-18T20:23:25.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-18T20:23:25.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-18T20:23:25.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-18T20:23:25.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-18T20:23:25.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-18T20:23:25.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-18T20:23:25.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-18T20:23:25.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-18T20:23:25.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-18T20:23:25.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-18T20:23:25.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-18T20:23:25.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel 2023-11-18T20:23:25.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu 2023-11-18T20:23:25.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu/mce 2023-11-18T20:23:25.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-18T20:23:25.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm 2023-11-18T20:23:25.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-18T20:23:25.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-18T20:23:25.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm.ko 2023-11-18T20:23:25.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto 2023-11-18T20:23:25.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/ansi_cprng.ko 2023-11-18T20:23:25.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/anubis.ko 2023-11-18T20:23:25.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/arc4.ko 2023-11-18T20:23:25.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx 2023-11-18T20:23:25.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_memcpy.ko 2023-11-18T20:23:25.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_pq.ko 2023-11-18T20:23:25.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-18T20:23:25.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_tx.ko 2023-11-18T20:23:25.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_xor.ko 2023-11-18T20:23:25.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/raid6test.ko 2023-11-18T20:23:25.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/authenc.ko 2023-11-18T20:23:25.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/authencesn.ko 2023-11-18T20:23:25.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blake2b_generic.ko 2023-11-18T20:23:25.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blowfish_common.ko 2023-11-18T20:23:25.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blowfish_generic.ko 2023-11-18T20:23:25.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/camellia_generic.ko 2023-11-18T20:23:25.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast5_generic.ko 2023-11-18T20:23:25.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast6_generic.ko 2023-11-18T20:23:25.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast_common.ko 2023-11-18T20:23:25.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/ccm.ko 2023-11-18T20:23:25.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cmac.ko 2023-11-18T20:23:25.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crc32_generic.ko 2023-11-18T20:23:25.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crypto_engine.ko 2023-11-18T20:23:25.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crypto_user.ko 2023-11-18T20:23:25.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cts.ko 2023-11-18T20:23:25.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/des_generic.ko 2023-11-18T20:23:25.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/dh_generic.ko 2023-11-18T20:23:25.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/echainiv.ko 2023-11-18T20:23:25.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/essiv.ko 2023-11-18T20:23:25.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/fcrypt.ko 2023-11-18T20:23:25.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/khazad.ko 2023-11-18T20:23:25.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/lz4.ko 2023-11-18T20:23:25.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/lz4hc.ko 2023-11-18T20:23:25.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/md4.ko 2023-11-18T20:23:25.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/michael_mic.ko 2023-11-18T20:23:25.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/pcbc.ko 2023-11-18T20:23:25.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/pcrypt.ko 2023-11-18T20:23:25.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/rmd160.ko 2023-11-18T20:23:25.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/seed.ko 2023-11-18T20:23:25.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/serpent_generic.ko 2023-11-18T20:23:25.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/tcrypt.ko 2023-11-18T20:23:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/tea.ko 2023-11-18T20:23:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/twofish_common.ko 2023-11-18T20:23:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/twofish_generic.ko 2023-11-18T20:23:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/vmac.ko 2023-11-18T20:23:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/wp512.ko 2023-11-18T20:23:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xcbc.ko 2023-11-18T20:23:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xor.ko 2023-11-18T20:23:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xxhash_generic.ko 2023-11-18T20:23:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers 2023-11-18T20:23:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi 2023-11-18T20:23:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-18T20:23:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/acpi_pad.ko 2023-11-18T20:23:25.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/custom_method.ko 2023-11-18T20:23:25.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/ec_sys.ko 2023-11-18T20:23:25.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/platform_profile.ko 2023-11-18T20:23:25.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/sbs.ko 2023-11-18T20:23:25.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/sbshc.ko 2023-11-18T20:23:25.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/video.ko 2023-11-18T20:23:25.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata 2023-11-18T20:23:25.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/acard-ahci.ko 2023-11-18T20:23:25.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/ahci_platform.ko 2023-11-18T20:23:25.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/ata_generic.ko 2023-11-18T20:23:25.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/libahci_platform.ko 2023-11-18T20:23:25.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_acpi.ko 2023-11-18T20:23:25.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ali.ko 2023-11-18T20:23:25.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_amd.ko 2023-11-18T20:23:25.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_artop.ko 2023-11-18T20:23:25.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_atiixp.ko 2023-11-18T20:23:25.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_atp867x.ko 2023-11-18T20:23:25.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cmd640.ko 2023-11-18T20:23:25.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cmd64x.ko 2023-11-18T20:23:25.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cypress.ko 2023-11-18T20:23:25.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_efar.ko 2023-11-18T20:23:25.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt366.ko 2023-11-18T20:23:25.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt37x.ko 2023-11-18T20:23:25.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-18T20:23:25.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-18T20:23:25.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_it8213.ko 2023-11-18T20:23:25.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_it821x.ko 2023-11-18T20:23:25.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_jmicron.ko 2023-11-18T20:23:25.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_marvell.ko 2023-11-18T20:23:25.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_mpiix.ko 2023-11-18T20:23:25.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_netcell.ko 2023-11-18T20:23:25.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ninja32.ko 2023-11-18T20:23:25.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ns87410.ko 2023-11-18T20:23:25.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ns87415.ko 2023-11-18T20:23:25.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_oldpiix.ko 2023-11-18T20:23:25.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_opti.ko 2023-11-18T20:23:25.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_optidma.ko 2023-11-18T20:23:25.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pcmcia.ko 2023-11-18T20:23:25.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-18T20:23:25.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-18T20:23:25.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_piccolo.ko 2023-11-18T20:23:25.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_rdc.ko 2023-11-18T20:23:25.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sch.ko 2023-11-18T20:23:25.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_serverworks.ko 2023-11-18T20:23:25.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sil680.ko 2023-11-18T20:23:25.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sis.ko 2023-11-18T20:23:25.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sl82c105.ko 2023-11-18T20:23:25.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_triflex.ko 2023-11-18T20:23:25.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_via.ko 2023-11-18T20:23:25.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pdc_adma.ko 2023-11-18T20:23:25.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_inic162x.ko 2023-11-18T20:23:25.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_mv.ko 2023-11-18T20:23:25.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_nv.ko 2023-11-18T20:23:25.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_promise.ko 2023-11-18T20:23:25.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_qstor.ko 2023-11-18T20:23:25.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sil.ko 2023-11-18T20:23:25.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sil24.ko 2023-11-18T20:23:25.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sis.ko 2023-11-18T20:23:25.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_svw.ko 2023-11-18T20:23:25.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sx4.ko 2023-11-18T20:23:25.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_uli.ko 2023-11-18T20:23:25.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_via.ko 2023-11-18T20:23:25.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_vsc.ko 2023-11-18T20:23:25.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/auxdisplay 2023-11-18T20:23:25.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/auxdisplay/ks0108.ko 2023-11-18T20:23:25.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base 2023-11-18T20:23:25.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap 2023-11-18T20:23:25.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-18T20:23:25.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-18T20:23:25.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/bcma 2023-11-18T20:23:25.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/bcma/bcma.ko 2023-11-18T20:23:25.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block 2023-11-18T20:23:25.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/aoe 2023-11-18T20:23:25.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/aoe/aoe.ko 2023-11-18T20:23:25.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/brd.ko 2023-11-18T20:23:25.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/drbd 2023-11-18T20:23:25.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/drbd/drbd.ko 2023-11-18T20:23:25.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/floppy.ko 2023-11-18T20:23:25.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/loop.ko 2023-11-18T20:23:25.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/mtip32xx 2023-11-18T20:23:25.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-18T20:23:25.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/nbd.ko 2023-11-18T20:23:25.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/null_blk 2023-11-18T20:23:25.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/null_blk/null_blk.ko 2023-11-18T20:23:25.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/pktcdvd.ko 2023-11-18T20:23:25.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/rbd.ko 2023-11-18T20:23:25.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/virtio_blk.ko 2023-11-18T20:23:25.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkback 2023-11-18T20:23:25.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-18T20:23:25.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkfront.ko 2023-11-18T20:23:25.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/zram 2023-11-18T20:23:25.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/zram/zram.ko 2023-11-18T20:23:25.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char 2023-11-18T20:23:25.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hangcheck-timer.ko 2023-11-18T20:23:25.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random 2023-11-18T20:23:25.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-18T20:23:25.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-18T20:23:25.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-18T20:23:25.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/via-rng.ko 2023-11-18T20:23:25.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-18T20:23:25.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi 2023-11-18T20:23:25.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-18T20:23:25.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-18T20:23:25.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-18T20:23:25.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-18T20:23:25.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-18T20:23:25.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-18T20:23:25.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/lp.ko 2023-11-18T20:23:25.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/mwave 2023-11-18T20:23:25.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/mwave/mwave.ko 2023-11-18T20:23:25.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ppdev.ko 2023-11-18T20:23:25.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tlclk.ko 2023-11-18T20:23:25.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm 2023-11-18T20:23:25.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm.ko 2023-11-18T20:23:25.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-18T20:23:25.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-18T20:23:25.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-18T20:23:25.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-18T20:23:25.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-18T20:23:25.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/uv_mmtimer.ko 2023-11-18T20:23:25.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/virtio_console.ko 2023-11-18T20:23:25.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq 2023-11-18T20:23:25.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-18T20:23:25.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-18T20:23:25.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-18T20:23:25.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-18T20:23:25.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-18T20:23:25.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-18T20:23:25.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto 2023-11-18T20:23:25.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp 2023-11-18T20:23:25.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-18T20:23:25.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp/ccp.ko 2023-11-18T20:23:25.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel 2023-11-18T20:23:25.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat 2023-11-18T20:23:25.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_common 2023-11-18T20:23:25.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-18T20:23:25.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-18T20:23:25.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-18T20:23:25.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/padlock-aes.ko 2023-11-18T20:23:25.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/padlock-sha.ko 2023-11-18T20:23:25.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/virtio 2023-11-18T20:23:25.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-18T20:23:25.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dca 2023-11-18T20:23:25.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dca/dca.ko 2023-11-18T20:23:25.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/devfreq 2023-11-18T20:23:25.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-18T20:23:25.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma 2023-11-18T20:23:25.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/dw 2023-11-18T20:23:25.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-18T20:23:25.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/ioat 2023-11-18T20:23:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-18T20:23:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac 2023-11-18T20:23:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/amd64_edac.ko 2023-11-18T20:23:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/e752x_edac.ko 2023-11-18T20:23:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/edac_mce_amd.ko 2023-11-18T20:23:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i3000_edac.ko 2023-11-18T20:23:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i3200_edac.ko 2023-11-18T20:23:25.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i5100_edac.ko 2023-11-18T20:23:25.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i5400_edac.ko 2023-11-18T20:23:25.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i7300_edac.ko 2023-11-18T20:23:25.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i7core_edac.ko 2023-11-18T20:23:25.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i82975x_edac.ko 2023-11-18T20:23:25.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/ie31200_edac.ko 2023-11-18T20:23:25.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/sb_edac.ko 2023-11-18T20:23:25.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/x38_edac.ko 2023-11-18T20:23:25.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware 2023-11-18T20:23:25.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware/edd.ko 2023-11-18T20:23:25.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-18T20:23:25.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio 2023-11-18T20:23:25.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio/gpio-ich.ko 2023-11-18T20:23:25.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-18T20:23:25.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid 2023-11-18T20:23:25.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-appleir.ko 2023-11-18T20:23:25.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-aureal.ko 2023-11-18T20:23:25.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-axff.ko 2023-11-18T20:23:25.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-dr.ko 2023-11-18T20:23:25.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-elecom.ko 2023-11-18T20:23:25.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-elo.ko 2023-11-18T20:23:25.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-emsff.ko 2023-11-18T20:23:25.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gaff.ko 2023-11-18T20:23:25.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gt683r.ko 2023-11-18T20:23:25.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gyration.ko 2023-11-18T20:23:25.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-18T20:23:25.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-18T20:23:25.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtekff.ko 2023-11-18T20:23:25.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-hyperv.ko 2023-11-18T20:23:25.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-icade.ko 2023-11-18T20:23:25.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-keytouch.ko 2023-11-18T20:23:25.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-kye.ko 2023-11-18T20:23:25.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-lcpower.ko 2023-11-18T20:23:25.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-led.ko 2023-11-18T20:23:25.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-lenovo.ko 2023-11-18T20:23:25.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-18T20:23:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-18T20:23:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-multitouch.ko 2023-11-18T20:23:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-ortek.ko 2023-11-18T20:23:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-penmount.ko 2023-11-18T20:23:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-petalynx.ko 2023-11-18T20:23:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-picolcd.ko 2023-11-18T20:23:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-pl.ko 2023-11-18T20:23:25.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-plantronics.ko 2023-11-18T20:23:25.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-primax.ko 2023-11-18T20:23:25.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-rmi.ko 2023-11-18T20:23:25.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-18T20:23:25.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-common.ko 2023-11-18T20:23:25.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-18T20:23:25.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-18T20:23:25.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-18T20:23:25.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-18T20:23:25.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-18T20:23:25.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-18T20:23:25.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-18T20:23:25.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-18T20:23:25.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-18T20:23:25.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat.ko 2023-11-18T20:23:25.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-saitek.ko 2023-11-18T20:23:25.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-samsung.ko 2023-11-18T20:23:25.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-18T20:23:25.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sjoy.ko 2023-11-18T20:23:25.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sony.ko 2023-11-18T20:23:25.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-speedlink.ko 2023-11-18T20:23:25.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-steelseries.ko 2023-11-18T20:23:25.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sunplus.ko 2023-11-18T20:23:25.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-18T20:23:25.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-tivo.ko 2023-11-18T20:23:25.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-tmff.ko 2023-11-18T20:23:25.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-topseed.ko 2023-11-18T20:23:25.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-twinhan.ko 2023-11-18T20:23:25.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-uclogic.ko 2023-11-18T20:23:25.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-waltop.ko 2023-11-18T20:23:25.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-wiimote.ko 2023-11-18T20:23:25.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-xinmo.ko 2023-11-18T20:23:25.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-zpff.ko 2023-11-18T20:23:25.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-zydacron.ko 2023-11-18T20:23:25.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/uhid.ko 2023-11-18T20:23:25.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/wacom.ko 2023-11-18T20:23:25.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv 2023-11-18T20:23:25.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_balloon.ko 2023-11-18T20:23:25.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_utils.ko 2023-11-18T20:23:25.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_vmbus.ko 2023-11-18T20:23:25.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon 2023-11-18T20:23:25.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/abituguru.ko 2023-11-18T20:23:25.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/abituguru3.ko 2023-11-18T20:23:25.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-18T20:23:25.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ad7414.ko 2023-11-18T20:23:25.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ad7418.ko 2023-11-18T20:23:25.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adc128d818.ko 2023-11-18T20:23:25.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1025.ko 2023-11-18T20:23:25.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1026.ko 2023-11-18T20:23:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1029.ko 2023-11-18T20:23:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1031.ko 2023-11-18T20:23:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm9240.ko 2023-11-18T20:23:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ads7828.ko 2023-11-18T20:23:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7410.ko 2023-11-18T20:23:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7411.ko 2023-11-18T20:23:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7462.ko 2023-11-18T20:23:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7470.ko 2023-11-18T20:23:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7475.ko 2023-11-18T20:23:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7x10.ko 2023-11-18T20:23:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/amc6821.ko 2023-11-18T20:23:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/applesmc.ko 2023-11-18T20:23:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asb100.ko 2023-11-18T20:23:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asc7621.ko 2023-11-18T20:23:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-18T20:23:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/atxp1.ko 2023-11-18T20:23:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/coretemp.ko 2023-11-18T20:23:25.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-18T20:23:25.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/dme1737.ko 2023-11-18T20:23:25.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ds1621.ko 2023-11-18T20:23:25.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ds620.ko 2023-11-18T20:23:25.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/emc1403.ko 2023-11-18T20:23:25.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/emc6w201.ko 2023-11-18T20:23:25.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f71805f.ko 2023-11-18T20:23:25.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f71882fg.ko 2023-11-18T20:23:25.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f75375s.ko 2023-11-18T20:23:25.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/fam15h_power.ko 2023-11-18T20:23:25.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/fschmd.ko 2023-11-18T20:23:25.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/g760a.ko 2023-11-18T20:23:25.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/g762.ko 2023-11-18T20:23:25.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/gl518sm.ko 2023-11-18T20:23:25.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/gl520sm.ko 2023-11-18T20:23:25.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-18T20:23:25.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/i5500_temp.ko 2023-11-18T20:23:25.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/i5k_amb.ko 2023-11-18T20:23:25.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ibmaem.ko 2023-11-18T20:23:25.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ibmpex.ko 2023-11-18T20:23:25.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ina209.ko 2023-11-18T20:23:25.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ina2xx.ko 2023-11-18T20:23:25.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/it87.ko 2023-11-18T20:23:25.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/k10temp.ko 2023-11-18T20:23:25.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/k8temp.ko 2023-11-18T20:23:25.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lineage-pem.ko 2023-11-18T20:23:25.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm63.ko 2023-11-18T20:23:25.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm73.ko 2023-11-18T20:23:25.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm75.ko 2023-11-18T20:23:25.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm77.ko 2023-11-18T20:23:25.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm78.ko 2023-11-18T20:23:25.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm80.ko 2023-11-18T20:23:25.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm83.ko 2023-11-18T20:23:25.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm85.ko 2023-11-18T20:23:25.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm87.ko 2023-11-18T20:23:25.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm90.ko 2023-11-18T20:23:25.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm92.ko 2023-11-18T20:23:25.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm93.ko 2023-11-18T20:23:25.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95234.ko 2023-11-18T20:23:25.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95241.ko 2023-11-18T20:23:25.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95245.ko 2023-11-18T20:23:25.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc2945.ko 2023-11-18T20:23:25.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4151.ko 2023-11-18T20:23:25.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4215.ko 2023-11-18T20:23:25.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4222.ko 2023-11-18T20:23:25.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4245.ko 2023-11-18T20:23:25.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4260.ko 2023-11-18T20:23:25.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4261.ko 2023-11-18T20:23:25.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max16065.ko 2023-11-18T20:23:25.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max1619.ko 2023-11-18T20:23:25.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max1668.ko 2023-11-18T20:23:25.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max197.ko 2023-11-18T20:23:25.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6639.ko 2023-11-18T20:23:25.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6650.ko 2023-11-18T20:23:25.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6697.ko 2023-11-18T20:23:25.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/mcp3021.ko 2023-11-18T20:23:25.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6683.ko 2023-11-18T20:23:25.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6775-core.ko 2023-11-18T20:23:25.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6775.ko 2023-11-18T20:23:25.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct7802.ko 2023-11-18T20:23:25.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pc87360.ko 2023-11-18T20:23:25.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pc87427.ko 2023-11-18T20:23:25.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pcf8591.ko 2023-11-18T20:23:25.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus 2023-11-18T20:23:25.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-18T20:23:25.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-18T20:23:25.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-18T20:23:25.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-18T20:23:25.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-18T20:23:25.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-18T20:23:25.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-18T20:23:25.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-18T20:23:25.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-18T20:23:25.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-18T20:23:25.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-18T20:23:25.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-18T20:23:25.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/powr1220.ko 2023-11-18T20:23:25.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch5627.ko 2023-11-18T20:23:25.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch5636.ko 2023-11-18T20:23:25.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-18T20:23:25.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sht15.ko 2023-11-18T20:23:25.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sht21.ko 2023-11-18T20:23:25.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/shtc1.ko 2023-11-18T20:23:25.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sis5595.ko 2023-11-18T20:23:25.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47b397.ko 2023-11-18T20:23:25.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47m1.ko 2023-11-18T20:23:25.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47m192.ko 2023-11-18T20:23:25.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/thmc50.ko 2023-11-18T20:23:25.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp102.ko 2023-11-18T20:23:25.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp103.ko 2023-11-18T20:23:25.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp401.ko 2023-11-18T20:23:25.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp421.ko 2023-11-18T20:23:25.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/via-cputemp.ko 2023-11-18T20:23:25.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/via686a.ko 2023-11-18T20:23:25.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/vt1211.ko 2023-11-18T20:23:25.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/vt8231.ko 2023-11-18T20:23:25.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83627ehf.ko 2023-11-18T20:23:25.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83627hf.ko 2023-11-18T20:23:25.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83781d.ko 2023-11-18T20:23:25.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83791d.ko 2023-11-18T20:23:25.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83792d.ko 2023-11-18T20:23:25.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83793.ko 2023-11-18T20:23:25.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83795.ko 2023-11-18T20:23:25.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83l785ts.ko 2023-11-18T20:23:25.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83l786ng.ko 2023-11-18T20:23:25.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c 2023-11-18T20:23:25.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos 2023-11-18T20:23:25.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-18T20:23:25.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-18T20:23:25.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses 2023-11-18T20:23:25.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-18T20:23:25.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-18T20:23:25.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-18T20:23:25.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-18T20:23:25.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-18T20:23:25.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-18T20:23:25.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-18T20:23:25.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-18T20:23:25.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-18T20:23:25.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-18T20:23:25.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-18T20:23:25.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-18T20:23:25.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-18T20:23:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-18T20:23:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-18T20:23:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-18T20:23:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-18T20:23:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-18T20:23:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-18T20:23:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-18T20:23:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-18T20:23:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-18T20:23:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-18T20:23:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-dev.ko 2023-11-18T20:23:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-mux.ko 2023-11-18T20:23:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-18T20:23:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-smbus.ko 2023-11-18T20:23:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-stub.ko 2023-11-18T20:23:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband 2023-11-18T20:23:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core 2023-11-18T20:23:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-18T20:23:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_core.ko 2023-11-18T20:23:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-18T20:23:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-18T20:23:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-18T20:23:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-18T20:23:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-18T20:23:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw 2023-11-18T20:23:25.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/cxgb4 2023-11-18T20:23:25.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-18T20:23:25.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx4 2023-11-18T20:23:25.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-18T20:23:25.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx5 2023-11-18T20:23:25.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-18T20:23:25.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mthca 2023-11-18T20:23:25.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-18T20:23:25.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp 2023-11-18T20:23:25.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/ipoib 2023-11-18T20:23:25.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-18T20:23:25.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/iser 2023-11-18T20:23:25.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-18T20:23:25.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/isert 2023-11-18T20:23:25.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-18T20:23:25.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srp 2023-11-18T20:23:25.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-18T20:23:25.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srpt 2023-11-18T20:23:25.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-18T20:23:25.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input 2023-11-18T20:23:25.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport 2023-11-18T20:23:25.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-18T20:23:25.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-18T20:23:25.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/gameport.ko 2023-11-18T20:23:25.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/joydev.ko 2023-11-18T20:23:25.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/keyboard 2023-11-18T20:23:25.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-18T20:23:25.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse 2023-11-18T20:23:25.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/appletouch.ko 2023-11-18T20:23:25.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/bcm5974.ko 2023-11-18T20:23:25.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/cyapatp.ko 2023-11-18T20:23:25.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-18T20:23:25.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/sermouse.ko 2023-11-18T20:23:25.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-18T20:23:25.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-18T20:23:25.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-18T20:23:25.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/rmi4 2023-11-18T20:23:25.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-18T20:23:25.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio 2023-11-18T20:23:25.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/altera_ps2.ko 2023-11-18T20:23:25.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/arc_ps2.ko 2023-11-18T20:23:25.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-18T20:23:25.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/serio_raw.ko 2023-11-18T20:23:25.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/sparse-keymap.ko 2023-11-18T20:23:25.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu 2023-11-18T20:23:25.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu/amd 2023-11-18T20:23:25.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-18T20:23:25.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds 2023-11-18T20:23:25.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-blinkm.ko 2023-11-18T20:23:25.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-lm3530.ko 2023-11-18T20:23:25.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-lp3944.ko 2023-11-18T20:23:25.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-ss4200.ko 2023-11-18T20:23:25.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger 2023-11-18T20:23:25.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-18T20:23:25.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-18T20:23:25.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-18T20:23:25.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-18T20:23:25.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-18T20:23:25.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-18T20:23:25.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-18T20:23:25.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-18T20:23:25.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md 2023-11-18T20:23:25.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/bcache 2023-11-18T20:23:25.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/bcache/bcache.ko 2023-11-18T20:23:25.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-bio-prison.ko 2023-11-18T20:23:25.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-cache-smq.ko 2023-11-18T20:23:25.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-cache.ko 2023-11-18T20:23:25.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-crypt.ko 2023-11-18T20:23:25.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-delay.ko 2023-11-18T20:23:25.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-flakey.ko 2023-11-18T20:23:25.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-log-userspace.ko 2023-11-18T20:23:25.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-multipath.ko 2023-11-18T20:23:25.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-queue-length.ko 2023-11-18T20:23:25.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-raid.ko 2023-11-18T20:23:25.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-round-robin.ko 2023-11-18T20:23:25.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-service-time.ko 2023-11-18T20:23:25.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-switch.ko 2023-11-18T20:23:25.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-thin-pool.ko 2023-11-18T20:23:25.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-verity.ko 2023-11-18T20:23:25.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/faulty.ko 2023-11-18T20:23:25.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/linear.ko 2023-11-18T20:23:25.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/multipath.ko 2023-11-18T20:23:25.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/persistent-data 2023-11-18T20:23:25.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-18T20:23:25.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid0.ko 2023-11-18T20:23:25.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid1.ko 2023-11-18T20:23:25.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid10.ko 2023-11-18T20:23:25.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid456.ko 2023-11-18T20:23:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message 2023-11-18T20:23:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion 2023-11-18T20:23:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptbase.ko 2023-11-18T20:23:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptctl.ko 2023-11-18T20:23:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptfc.ko 2023-11-18T20:23:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptlan.ko 2023-11-18T20:23:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptsas.ko 2023-11-18T20:23:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptscsih.ko 2023-11-18T20:23:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptspi.ko 2023-11-18T20:23:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd 2023-11-18T20:23:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/lpc_ich.ko 2023-11-18T20:23:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/lpc_sch.ko 2023-11-18T20:23:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/mfd-core.ko 2023-11-18T20:23:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/sm501.ko 2023-11-18T20:23:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/viperboard.ko 2023-11-18T20:23:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/vx855.ko 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/wl1273-core.ko 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/altera-stapl 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/apds9802als.ko 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/apds990x.ko 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/bh1770glc.ko 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/cb710 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/cb710/cb710.ko 2023-11-18T20:23:25.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/at24.ko 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/max6875.ko 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/enclosure.ko 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/hpilo.ko 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/isl29003.ko 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/isl29020.ko 2023-11-18T20:23:25.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei-me.ko 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei-txe.ko 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei.ko 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-gru 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp 2023-11-18T20:23:25.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tifm_7xx1.ko 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tifm_core.ko 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tsl2550.ko 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_balloon.ko 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_vmci 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/bonding 2023-11-18T20:23:25.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/bonding/bonding.ko 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/b53 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6xxx 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dummy.ko 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/eql.ko 2023-11-18T20:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-18T20:23:25.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/adaptec 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/agere 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/alteon 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/altera 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd 2023-11-18T20:23:25.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/alx 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx 2023-11-18T20:23:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/genet 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-18T20:23:25.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade/bna 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-18T20:23:25.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco/enic 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip 2023-11-18T20:23:25.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dnet.ko 2023-11-18T20:23:25.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex/benet 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ethoc.ko 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/fealnx.ko 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000e 2023-11-18T20:23:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/fm10k 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/i40e 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/iavf 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igb 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igbvf 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-18T20:23:25.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/jme.ko 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox 2023-11-18T20:23:25.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/micrel 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-18T20:23:25.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/neterion 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/nvidia 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-18T20:23:25.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rdc 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-18T20:23:25.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rocker 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sfc 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/silan 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-18T20:23:25.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-18T20:23:25.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/tehuti 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ti 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-18T20:23:25.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/xircom 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/geneve.ko 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/hyperv 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ieee802154 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-18T20:23:25.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ifb.ko 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ipvlan 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/macvlan.ko 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/macvtap.ko 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio.ko 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-18T20:23:25.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mii.ko 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/net_failover.ko 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/netconsole.ko 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/nlmon.ko 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/amd.ko 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-18T20:23:25.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm87xx.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/broadcom.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/cicada.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/davicom.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/dp83640.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/et1011c.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/icplus.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/lxt.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/marvell.ko 2023-11-18T20:23:25.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/micrel.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/national.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/phylink.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/qsemi.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/realtek.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/smsc.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/ste10Xp.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/vitesse.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_async.ko 2023-11-18T20:23:25.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pppoe.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pppox.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pptp.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip/slhc.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip/slip.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/sungem_phy.ko 2023-11-18T20:23:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/tap.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_random.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/tun.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/veth.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/virtio_net.ko 2023-11-18T20:23:25.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vmxnet3 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vxlan 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vxlan/vxlan.ko 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netback 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netfront.ko 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ntb 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ntb/ntb.ko 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host/nvme-core.ko 2023-11-18T20:23:25.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host/nvme.ko 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport.ko 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_cs.ko 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_pc.ko 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_serial.ko 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/hotplug 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/pcie 2023-11-18T20:23:25.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/xen-pcifront.ko 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/i82092.ko 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/pd6729.ko 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl/intel 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform 2023-11-18T20:23:25.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/acerhdf.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-18T20:23:25.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/hdaps.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel_ips.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-18T20:23:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/wmi.ko 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients 2023-11-18T20:23:25.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps_parport.ko 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/pps_core.ko 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp/ptp.ko 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp/ptp_kvm.ko 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-18T20:23:25.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-em3027.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-18T20:23:25.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-max6900.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-18T20:23:25.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-x1205.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-9xxx.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-sas.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-xxxx.ko 2023-11-18T20:23:25.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/BusLogic.ko 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/a100u2w.ko 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aacraid 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/advansys.ko 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/am53c974.ko 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/arcmsr 2023-11-18T20:23:25.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/atp870u.ko 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/be2iscsi 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bfa 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bfa/bfa.ko 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2fc 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2i 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-18T20:23:25.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ch.ko 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/csiostor 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/dc395x.ko 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler 2023-11-18T20:23:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/dmx3191d.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esas2r 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esp_scsi.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-18T20:23:25.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fnic 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fnic/fnic.ko 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hpsa.ko 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hptiop.ko 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hv_storvsc.ko 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/initio.ko 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ipr.ko 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ips.ko 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/isci 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/isci/isci.ko 2023-11-18T20:23:25.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libfc 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libfc/libfc.ko 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libiscsi.ko 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libsas 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libsas/libsas.ko 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/lpfc 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-18T20:23:25.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid.ko 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mpt3sas 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvsas 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvumi.ko 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pm8001 2023-11-18T20:23:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pmcraid.ko 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla1280.ko 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla4xxx 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/raid_class.ko 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_debug.ko 2023-11-18T20:23:25.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ses.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/st.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/stex.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/sym53c8xx_2 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/virtio_scsi.ko 2023-11-18T20:23:25.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/wd719x.ko 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ssb 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ssb/ssb.ko 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/iscsi 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/loopback 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_file.ko 2023-11-18T20:23:25.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_iblock.ko 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_mod.ko 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_pscsi.ko 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_user.ko 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/tcm_fc 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-18T20:23:25.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-18T20:23:25.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/ipwireless 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/n_gsm.ko 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/n_hdlc.ko 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/nozomi.ko 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial 2023-11-18T20:23:25.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/8250 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/arc_uart.ko 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/jsm 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/core 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/host 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio 2023-11-18T20:23:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_aec.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_cif.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_pci_generic.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_sercos3.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/cdc-acm.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/usblp.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/usbtmc.ko 2023-11-18T20:23:25.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/host 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image/mdc800.ko 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image/microtek.ko 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/adutux.ko 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/appledisplay.ko 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/emi26.ko 2023-11-18T20:23:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/emi62.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/ezusb.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/idmouse.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/iowarrior.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/ldusb.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/legousbtower.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/sisusbvga 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-18T20:23:25.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usb3503.ko 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usblcd.ko 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/uss720.ko 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/yurex.ko 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/phy 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/phy/phy-generic.ko 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/aircable.ko 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ark3116.ko 2023-11-18T20:23:25.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ch341.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cp210x.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cyberjack.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/empeg.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-18T20:23:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/io_ti.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ipaq.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ipw.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ir-usb.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/keyspan.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mct_u232.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mos7720.ko 2023-11-18T20:23:25.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mos7840.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/navman.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/omninet.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/opticon.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/option.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/oti6858.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/pl2303.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/qcaux.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/qcserial.ko 2023-11-18T20:23:25.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/quatech2.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/safe_serial.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/sierra.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ssu100.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/symbolserial.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb_debug.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/visor.ko 2023-11-18T20:23:25.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/whiteheat.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/uas.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-18T20:23:25.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-karma.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/usb-storage.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-18T20:23:25.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/vfio.ko 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost.ko 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-18T20:23:25.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_net.ko 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_scsi.ko 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/apple_bl.ko 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/lcd.ko 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio.ko 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_balloon.ko 2023-11-18T20:23:25.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_mmio.ko 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci.ko 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_ring.ko 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters/ds2482.ko 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters/ds2490.ko 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves 2023-11-18T20:23:25.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-18T20:23:25.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/wire.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/hpwdt.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/i6300esb.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ib700wdt.ko 2023-11-18T20:23:25.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ibmasr.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/it87_wdt.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/machzwd.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/nv_tco.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-18T20:23:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/softdog.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/via_wdt.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/wdt_pci.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/xen_wdt.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-evtchn.ko 2023-11-18T20:23:25.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-gntalloc.ko 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-gntdev.ko 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-pciback 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-privcmd.ko 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xenfs 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/9p 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/9p/9p.ko 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/affs 2023-11-18T20:23:25.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/affs/affs.ko 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/befs 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/befs/befs.ko 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/binfmt_misc.ko 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/btrfs 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/btrfs/btrfs.ko 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cachefiles 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cachefiles/cachefiles.ko 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ceph 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ceph/ceph.ko 2023-11-18T20:23:25.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/coda 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/coda/coda.ko 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cramfs 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cramfs/cramfs.ko 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/dlm 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/dlm/dlm.ko 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ecryptfs 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/f2fs 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/f2fs/f2fs.ko 2023-11-18T20:23:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/fat.ko 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/msdos.ko 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/vfat.ko 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fscache 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fscache/fscache.ko 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse/cuse.ko 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse/fuse.ko 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/gfs2 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/gfs2/gfs2.ko 2023-11-18T20:23:25.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfs 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfs/hfs.ko 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfsplus 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfsplus/hfsplus.ko 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/isofs 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/isofs/isofs.ko 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/jfs 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/jfs/jfs.ko 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/lockd 2023-11-18T20:23:25.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/lockd/lockd.ko 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/minix 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/minix/minix.ko 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/netfs 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/netfs/netfs.ko 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/blocklayout 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/filelayout 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/flexfilelayout 2023-11-18T20:23:25.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfs.ko 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfsv3.ko 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfsv4.ko 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common/grace.ko 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common/nfs_acl.ko 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfsd 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfsd/nfsd.ko 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nilfs2 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nilfs2/nilfs2.ko 2023-11-18T20:23:25.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-celtic.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-centeuro.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-croatian.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-cyrillic.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-gaelic.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-greek.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-iceland.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-inuit.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-roman.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-romanian.ko 2023-11-18T20:23:25.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-turkish.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1250.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1251.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1255.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp737.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp775.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp850.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp852.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp855.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp857.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp860.ko 2023-11-18T20:23:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp861.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp862.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp863.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp864.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp865.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp866.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp869.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp874.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp932.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp936.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp949.ko 2023-11-18T20:23:25.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp950.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_euc-jp.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-1.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-13.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-14.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-15.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-2.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-3.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-4.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-5.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-6.ko 2023-11-18T20:23:25.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-7.ko 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-9.ko 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-r.ko 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-ru.ko 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-u.ko 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_utf8.ko 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/cluster 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlm 2023-11-18T20:23:25.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlmfs 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2.ko 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/overlayfs 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/overlayfs/overlay.ko 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/pstore 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/pstore/ramoops.ko 2023-11-18T20:23:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/reiserfs 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/reiserfs/reiserfs.ko 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/romfs 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/romfs/romfs.ko 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/client 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/client/cifs.ko 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common/cifs_arc4.ko 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common/cifs_md4.ko 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/squashfs 2023-11-18T20:23:25.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/squashfs/squashfs.ko 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/sysv 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/sysv/sysv.ko 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/udf 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/udf/udf.ko 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ufs 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ufs/ufs.ko 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/xfs 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/xfs/xfs.ko 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel 2023-11-18T20:23:25.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/rcu 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/rcu/rcutorture.ko 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/torture.ko 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/trace 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/asn1_encoder.ko 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crc-itu-t.ko 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crc8.ko 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto/libarc4.ko 2023-11-18T20:23:25.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto/libdes.ko 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/libcrc32c.ko 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lru_cache.ko 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4/lz4_compress.ko 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4/lz4hc_compress.ko 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/math 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/math/cordic.ko 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/raid6 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/raid6/raid6_pq.ko 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/reed_solomon 2023-11-18T20:23:25.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_bm.ko 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_fsm.ko 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_kmp.ko 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/zstd 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/zstd/zstd_compress.ko 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/mm 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/mm/hwpoison-inject.ko 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan 2023-11-18T20:23:25.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/6lowpan.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_dest.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_fragment.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_hop.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_mobility.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_routing.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_udp.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/garp.ko 2023-11-18T20:23:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/mrp.ko 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/p8022.ko 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/psnap.ko 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/stp.ko 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/8021q 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/8021q/8021q.ko 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet.ko 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_fd.ko 2023-11-18T20:23:25.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_rdma.ko 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_virtio.ko 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/batman-adv 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/batman-adv/batman-adv.ko 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/br_netfilter.ko 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/bridge.ko 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-18T20:23:25.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-18T20:23:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtables.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-18T20:23:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ceph 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ceph/libceph.ko 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core/failover.ko 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core/pktgen.ko 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp.ko 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_diag.ko 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_ipv4.ko 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_ipv6.ko 2023-11-18T20:23:25.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dns_resolver 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dns_resolver/dns_resolver.ko 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/dsa_core.ko 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_brcm.ko 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_dsa.ko 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_none.ko 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_trailer.ko 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/6lowpan 2023-11-18T20:23:25.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/ieee802154.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ah4.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/esp4.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/fou.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/gre.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/inet_diag.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_gre.ko 2023-11-18T20:23:25.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_tunnel.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_vti.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ipcomp.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ipip.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-18T20:23:25.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-18T20:23:25.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_bic.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_dctcp.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_diag.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_highspeed.ko 2023-11-18T20:23:25.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_htcp.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_hybla.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_illinois.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_lp.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_scalable.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_vegas.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_veno.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_westwood.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_yeah.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tunnel4.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/udp_diag.ko 2023-11-18T20:23:25.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/udp_tunnel.ko 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ah6.ko 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/esp6.ko 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/fou6.ko 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_tunnel.ko 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_vti.ko 2023-11-18T20:23:25.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ipcomp6.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-18T20:23:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-18T20:23:25.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/sit.ko 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/tunnel6.ko 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/key 2023-11-18T20:23:25.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/key/af_key.ko 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_core.ko 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_eth.ko 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ip.ko 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ip6.ko 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_netlink.ko 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ppp.ko 2023-11-18T20:23:25.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/llc 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/llc/llc.ko 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mac802154 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mac802154/mac802154.ko 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mpls 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mpls/mpls_gso.ko 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set.ko 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-18T20:23:25.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-18T20:23:25.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-18T20:23:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conncount.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-18T20:23:25.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-18T20:23:25.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_flow_table.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_log_syslog.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_irc.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_sip.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-18T20:23:25.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_tables.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_log.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_chain_nat.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_compat.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_ct.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-18T20:23:25.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_fib.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_hash.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_limit.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_log.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_masq.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_nat.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_numgen.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_queue.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_quota.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_redir.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_reject.ko 2023-11-18T20:23:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_reject_inet.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_socket.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_tunnel.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_AUDIT.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CT.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_DSCP.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_HL.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_HMARK.ko 2023-11-18T20:23:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_LED.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_LOG.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NETMAP.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NFLOG.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_RATEEST.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_SECMARK.ko 2023-11-18T20:23:25.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TEE.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TPROXY.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TRACE.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_addrtype.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_bpf.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cgroup.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cluster.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_comment.ko 2023-11-18T20:23:25.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connbytes.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connlabel.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connlimit.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connmark.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_conntrack.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cpu.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_dccp.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_devgroup.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_dscp.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ecn.ko 2023-11-18T20:23:25.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_esp.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_hashlimit.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_helper.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_hl.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ipcomp.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_iprange.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ipvs.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_l2tp.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_length.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_limit.ko 2023-11-18T20:23:25.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_mac.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_mark.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_multiport.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_nat.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_nfacct.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_osf.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_owner.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_physdev.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_pkttype.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_policy.ko 2023-11-18T20:23:25.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_quota.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_rateest.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_realm.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_recent.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_sctp.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_set.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_socket.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_state.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_statistic.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_string.ko 2023-11-18T20:23:25.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_tcpmss.ko 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_time.ko 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_u32.ko 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netlink 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netlink/netlink_diag.ko 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/nsh 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/nsh/nsh.ko 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/openvswitch.ko 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-geneve.ko 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-gre.ko 2023-11-18T20:23:25.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-vxlan.ko 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/packet 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/packet/af_packet_diag.ko 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds.ko 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds_rdma.ko 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds_tcp.ko 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_csum.ko 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_gact.ko 2023-11-18T20:23:25.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_ipt.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_mirred.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_nat.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_pedit.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_police.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_simple.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_skbedit.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_vlan.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_basic.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_bpf.ko 2023-11-18T20:23:25.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_flow.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_fw.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_route.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_u32.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_cmp.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_ipset.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_meta.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_nbyte.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_text.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_u32.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_choke.ko 2023-11-18T20:23:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_codel.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_drr.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_fq.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_gred.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_hfsc.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_hhf.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_htb.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_ingress.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_mqprio.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_mqprio_lib.ko 2023-11-18T20:23:25.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_multiq.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_netem.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_pie.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_plug.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_prio.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_qfq.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_red.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_sfb.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_sfq.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_tbf.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_teql.ko 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp 2023-11-18T20:23:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp/sctp.ko 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp/sctp_diag.ko 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/sunrpc.ko 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/xprtrdma 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc/diag.ko 2023-11-18T20:23:25.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc/tipc.ko 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/unix 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/unix/unix_diag.ko 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock.ko 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-18T20:23:25.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/xfrm 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/encrypted-keys 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/trusted-keys 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/trusted-keys/trusted.ko 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt/lib 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt/lib/irqbypass.ko 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.alias 2023-11-18T20:23:25.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.alias.bin 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.alias.bin 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.bin 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.modinfo 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.dep 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.dep.bin 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.devname 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.order 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.softdep 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.symbols 2023-11-18T20:23:25.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.symbols.bin 2023-11-18T20:23:25.749 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gab677fe869e8 2023-11-18T20:23:25.749 DEBUG:teuthology.orchestra.run.smithi132:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-18T20:23:25.771 INFO:teuthology.orchestra.run.smithi132.stdout:postinstall scriptlet (using /bin/sh): 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gab677fe869e8 -a -r /boot/System.map-6.6.0-gab677fe869e8 ]; then 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:cp /boot/vmlinuz-6.6.0-gab677fe869e8 /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:cp /boot/System.map-6.6.0-gab677fe869e8 /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:rm -f /boot/vmlinuz-6.6.0-gab677fe869e8 /boot/System.map-6.6.0-gab677fe869e8 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:/sbin/installkernel 6.6.0-gab677fe869e8 /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:rm -f /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-18T20:23:25.772 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-18T20:23:25.773 INFO:teuthology.orchestra.run.smithi132.stdout:new-kernel-pkg --remove 6.6.0-gab677fe869e8 --rminitrd --initrdfile=/boot/initramfs-6.6.0-gab677fe869e8.img 2023-11-18T20:23:25.773 INFO:teuthology.orchestra.run.smithi132.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-18T20:23:25.773 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-install remove 6.6.0-gab677fe869e8 2023-11-18T20:23:25.773 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-11-18T20:23:25.773 INFO:teuthology.orchestra.run.smithi132.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-18T20:23:25.773 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-18T20:23:25.773 INFO:teuthology.orchestra.run.smithi132.stdout:/sbin/update-bootloader --remove 6.6.0-gab677fe869e8 2023-11-18T20:23:25.773 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-11-18T20:23:25.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2023-11-18T20:23:25.835 INFO:teuthology.orchestra.run.smithi161.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.06 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 68.el9 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Group : Unspecified 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 8264254 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2023-11-18T20:23:25.849 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : builder@centos.org 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2023-11-18T20:23:25.850 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:23:25.851 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-18T20:23:25.851 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-18T20:23:25.851 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-18T20:23:25.851 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2023-11-18T20:23:25.851 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:23:25.851 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2023-11-18T20:23:25.852 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-18T20:23:25.852 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 6.6.0-gab677fe869e8 2023-11-18T20:23:25.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-18T20:23:25.871 INFO:teuthology.orchestra.run.smithi161.stderr:done 2023-11-18T20:23:25.874 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-11-18T20:23:25.889 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.hIJMsjqLeu 2023-11-18T20:23:25.889 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hIJMsjqLeu 2023-11-18T20:23:25.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.hIJMsjqLeu 2023-11-18T20:23:26.098 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.hIJMsjqLeu is 6KB 2023-11-18T20:23:26.147 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.hIJMsjqLeu 2023-11-18T20:23:26.161 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2023-11-18T20:23:26.226 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-18T20:23:26.226 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-18T20:23:26.226 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-18T20:23:26.226 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gab677fe869e8.conf 2023-11-18T20:23:26.227 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gab677fe869e8 2023-11-18T20:23:26.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2023-11-18T20:23:26.559 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2023-11-18T20:23:27.951 INFO:teuthology.orchestra.run.smithi132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-18T20:23:27.970 INFO:teuthology.orchestra.run.smithi132.stderr:done 2023-11-18T20:23:27.972 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-18T20:23:27.987 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.UI6XQJYumF 2023-11-18T20:23:27.987 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UI6XQJYumF 2023-11-18T20:23:28.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.UI6XQJYumF 2023-11-18T20:23:28.201 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.UI6XQJYumF is 6KB 2023-11-18T20:23:28.251 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.UI6XQJYumF 2023-11-18T20:23:28.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2023-11-18T20:23:28.334 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-18T20:23:28.334 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-18T20:23:28.334 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-18T20:23:28.334 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gab677fe869e8.conf 2023-11-18T20:23:28.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gab677fe869e8 2023-11-18T20:23:28.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2023-11-18T20:23:56.394 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-18T20:23:56.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-18T20:23:56.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:23:58.522 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-18T20:23:58.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-18T20:23:58.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:24:31.074 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-18T20:24:40.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-18T20:24:40.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:24:58.468 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-18T20:24:58.527 DEBUG:teuthology.orchestra.remote:timed out 2023-11-18T20:25:07.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-18T20:25:07.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:25:10.440 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-11-18T20:25:10.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-18T20:25:10.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:25:10.892 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-11-18T20:25:11.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-18T20:25:11.058 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gab677fe869e8"... 2023-11-18T20:25:11.058 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-11-18T20:25:11.101 INFO:teuthology.orchestra.run.smithi132.stdout:6.6.0-gab677fe869e8 2023-11-18T20:25:11.102 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gab677fe869e8 vs 6.6.0-gab677fe869e8 2023-11-18T20:25:11.102 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-18T20:25:11.102 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-18T20:25:11.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-18T20:25:11.591 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gab677fe869e8"... 2023-11-18T20:25:11.591 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-11-18T20:25:11.631 INFO:teuthology.orchestra.run.smithi161.stdout:6.6.0-gab677fe869e8 2023-11-18T20:25:11.631 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gab677fe869e8 vs 6.6.0-gab677fe869e8 2023-11-18T20:25:11.631 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-18T20:25:11.631 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-18T20:25:12.103 DEBUG:teuthology.parallel:result is None 2023-11-18T20:25:12.633 DEBUG:teuthology.parallel:result is None 2023-11-18T20:25:12.633 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-18T20:25:12.639 INFO:teuthology.task.internal:Creating test directory... 2023-11-18T20:25:12.640 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-18T20:25:12.645 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-18T20:25:12.700 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-18T20:25:12.706 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-18T20:25:12.713 INFO:teuthology.task.internal:Creating archive directory... 2023-11-18T20:25:12.713 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-18T20:25:12.733 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-18T20:25:12.781 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-18T20:25:12.788 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-18T20:25:12.788 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-18T20:25:12.794 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-18T20:25:12.962 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T20:25:12.979 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T20:25:13.019 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T20:25:13.031 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T20:25:13.034 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-18T20:25:13.042 INFO:teuthology.task.internal:Configuring sudo... 2023-11-18T20:25:13.042 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-18T20:25:13.047 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-18T20:25:13.124 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-18T20:25:13.134 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-18T20:25:13.135 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-18T20:25:13.143 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-18T20:25:13.193 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T20:25:13.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T20:25:13.376 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T20:25:13.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T20:25:13.535 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:25:13.535 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-18T20:25:13.610 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T20:25:13.691 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T20:25:13.767 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T20:25:13.840 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T20:25:13.920 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:25:13.920 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-18T20:25:13.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2023-11-18T20:25:14.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2023-11-18T20:25:14.138 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T20:25:14.146 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T20:25:14.386 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-18T20:25:14.394 INFO:teuthology.task.internal:Starting timer... 2023-11-18T20:25:14.395 INFO:teuthology.run_tasks:Running task pcp... 2023-11-18T20:25:14.407 INFO:teuthology.run_tasks:Running task selinux... 2023-11-18T20:25:14.417 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2023-11-18T20:25:14.529 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2023-11-18T20:25:14.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2023-11-18T20:25:14.660 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2023-11-18T20:25:14.664 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-18T20:25:14.665 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2023-11-18T20:25:14.722 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2023-11-18T20:25:14.722 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2023-11-18T20:25:14.785 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2023-11-18T20:25:14.786 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2023-11-18T20:25:14.786 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T20:25:14.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:25:14.876 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T20:25:14.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:25:14.957 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-18T20:25:14.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2023-11-18T20:25:15.053 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2023-11-18T20:25:15.138 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-18T20:25:15.148 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-18T20:25:15.148 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-18T20:25:15.166 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-18T20:25:15.167 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-18T20:34:55.806 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2023-11-18T20:34:55.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-18T20:34:55.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:34:55.940 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-11-18T20:34:56.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-18T20:34:56.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-18T20:34:56.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:34:56.227 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-11-18T20:34:56.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-18T20:34:56.378 INFO:teuthology.run_tasks:Running task clock... 2023-11-18T20:34:56.389 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-18T20:34:56.389 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-18T20:34:56.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T20:34:56.399 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-18T20:34:56.399 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T20:34:56.498 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-18T20:34:56.506 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-18T20:34:56.550 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-18T20:34:56.558 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-18T20:34:56.636 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2023-11-18T20:34:56.644 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2023-11-18T20:34:56.679 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2023-11-18T20:34:56.686 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2023-11-18T20:34:56.732 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-18T20:34:56.739 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-18T20:34:56.785 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-18T20:34:56.790 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-18T20:34:56.907 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2023-11-18T20:34:56.915 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T20:34:56.916 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2023-11-18T20:34:56.916 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:34:56.916 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:34:56.916 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:34:56.916 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:34:56.921 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2023-11-18T20:34:56.932 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T20:34:56.932 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-11-18T20:34:56.932 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:34:56.932 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:34:56.932 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:34:56.932 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:34:56.934 INFO:teuthology.run_tasks:Running task install... 2023-11-18T20:34:56.943 DEBUG:teuthology.task.install:project ceph 2023-11-18T20:34:56.943 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}} 2023-11-18T20:34:56.943 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'} 2023-11-18T20:34:56.944 INFO:teuthology.task.install:Using flavor: default 2023-11-18T20:34:56.949 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-18T20:34:56.949 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-18T20:34:56.950 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-18T20:34:56.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:34:56.952 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-18T20:34:56.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:34:57.094 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-18T20:34:57.094 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-18T20:34:57.098 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-18T20:34:57.099 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-18T20:34:57.219 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-18T20:34:57.220 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:34:57.220 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-18T20:34:57.263 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-18T20:34:57.263 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:34:57.263 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-18T20:34:57.326 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-18T20:34:57.326 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-18T20:34:57.365 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-18T20:34:57.365 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-18T20:34:57.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-18T20:34:57.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-18T20:34:57.612 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-18T20:34:57.635 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-18T20:34:57.706 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2023-11-18T20:34:57.710 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2023-11-18T20:34:57.725 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2023-11-18T20:34:57.729 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2023-11-18T20:34:58.061 INFO:teuthology.orchestra.run.smithi161.stdout:72 files removed 2023-11-18T20:34:58.075 INFO:teuthology.orchestra.run.smithi132.stdout:72 files removed 2023-11-18T20:34:58.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-18T20:34:58.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-18T20:34:59.033 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 190 kB/s | 78 kB 00:00 2023-11-18T20:34:59.147 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 143 kB/s | 78 kB 00:00 2023-11-18T20:34:59.534 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-11-18T20:34:59.664 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 22 kB/s | 9.5 kB 00:00 2023-11-18T20:35:00.051 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2023-11-18T20:35:00.114 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-11-18T20:35:00.605 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-11-18T20:35:00.902 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - AppStream 8.9 MB/s | 6.4 MB 00:00 2023-11-18T20:35:02.155 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2023-11-18T20:35:02.474 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2023-11-18T20:35:03.726 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 7.9 MB 00:01 2023-11-18T20:35:04.370 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 7.9 MB 00:01 2023-11-18T20:35:06.427 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 13 MB/s | 18 MB 00:01 2023-11-18T20:35:11.078 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 5.8 MB 00:00 2023-11-18T20:35:12.670 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 15 kB 00:00 2023-11-18T20:35:14.875 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 20 MB 00:01 2023-11-18T20:35:18.863 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 18 MB 00:13 2023-11-18T20:35:20.436 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-11-18T20:35:23.280 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T20:35:23.281 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T20:35:23.295 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-18T20:35:23.296 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-18T20:35:23.298 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-18T20:35:23.299 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-18T20:35:23.301 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-18T20:35:23.304 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-18T20:35:23.306 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-18T20:35:23.382 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-11-18T20:35:23.397 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2023-11-18T20:35:23.397 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2023-11-18T20:35:23.397 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2023-11-18T20:35:23.397 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-18T20:35:23.398 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 217 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 18 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-18T20:35:23.399 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-18T20:35:23.400 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-18T20:35:23.401 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-18T20:35:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-18T20:35:23.403 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-18T20:35:23.404 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-18T20:35:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-18T20:35:23.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-18T20:35:23.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-18T20:35:23.408 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2023-11-18T20:35:23.409 INFO:teuthology.orchestra.run.smithi132.stdout:Install 132 Packages 2023-11-18T20:35:23.410 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 13 Packages 2023-11-18T20:35:23.410 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:35:23.410 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 200 M 2023-11-18T20:35:23.410 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-11-18T20:35:23.756 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 5.8 MB 00:01 2023-11-18T20:35:24.279 INFO:teuthology.orchestra.run.smithi132.stdout:(1/145): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 21 kB/s | 6.5 kB 00:00 2023-11-18T20:35:24.655 INFO:teuthology.orchestra.run.smithi132.stdout:(2/145): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 2.2 MB/s | 860 kB 00:00 2023-11-18T20:35:24.730 INFO:teuthology.orchestra.run.smithi132.stdout:(3/145): ceph-immutable-object-cache-18.0.0-741 1.9 MB/s | 141 kB 00:00 2023-11-18T20:35:25.138 INFO:teuthology.orchestra.run.smithi132.stdout:(4/145): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 5.1 MB/s | 2.1 MB 00:00 2023-11-18T20:35:25.238 INFO:teuthology.orchestra.run.smithi132.stdout:(5/145): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 4.1 MB/s | 5.2 MB 00:01 2023-11-18T20:35:25.239 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 15 kB 00:00 2023-11-18T20:35:25.439 INFO:teuthology.orchestra.run.smithi132.stdout:(6/145): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 4.9 MB/s | 1.5 MB 00:00 2023-11-18T20:35:25.756 INFO:teuthology.orchestra.run.smithi132.stdout:(7/145): ceph-mon-18.0.0-7418.gb0f45a51.el9.x86 8.5 MB/s | 4.4 MB 00:00 2023-11-18T20:35:26.483 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-11-18T20:35:26.639 INFO:teuthology.orchestra.run.smithi132.stdout:(8/145): ceph-common-18.0.0-7418.gb0f45a51.el9. 7.1 MB/s | 19 MB 00:02 2023-11-18T20:35:26.698 INFO:teuthology.orchestra.run.smithi132.stdout:(9/145): ceph-selinux-18.0.0-7418.gb0f45a51.el9 420 kB/s | 24 kB 00:00 2023-11-18T20:35:26.865 INFO:teuthology.orchestra.run.smithi132.stdout:(10/145): ceph-radosgw-18.0.0-7418.gb0f45a51.el 7.8 MB/s | 8.6 MB 00:01 2023-11-18T20:35:26.965 INFO:teuthology.orchestra.run.smithi132.stdout:(11/145): cephfs-mirror-18.0.0-7418.gb0f45a51.e 2.1 MB/s | 217 kB 00:00 2023-11-18T20:35:27.049 INFO:teuthology.orchestra.run.smithi132.stdout:(12/145): libcephfs-devel-18.0.0-7418.gb0f45a51 376 kB/s | 31 kB 00:00 2023-11-18T20:35:27.474 INFO:teuthology.orchestra.run.smithi132.stdout:(13/145): ceph-osd-18.0.0-7418.gb0f45a51.el9.x8 8.7 MB/s | 18 MB 00:02 2023-11-18T20:35:27.524 INFO:teuthology.orchestra.run.smithi132.stdout:(14/145): libcephfs2-18.0.0-7418.gb0f45a51.el9. 1.5 MB/s | 718 kB 00:00 2023-11-18T20:35:27.558 INFO:teuthology.orchestra.run.smithi132.stdout:(15/145): libcephsqlite-18.0.0-7418.gb0f45a51.e 1.9 MB/s | 163 kB 00:00 2023-11-18T20:35:27.591 INFO:teuthology.orchestra.run.smithi132.stdout:(16/145): librados-devel-18.0.0-7418.gb0f45a51. 1.9 MB/s | 127 kB 00:00 2023-11-18T20:35:27.642 INFO:teuthology.orchestra.run.smithi132.stdout:(17/145): libradosstriper1-18.0.0-7418.gb0f45a5 5.6 MB/s | 475 kB 00:00 2023-11-18T20:35:27.708 INFO:teuthology.orchestra.run.smithi132.stdout:(18/145): python3-ceph-argparse-18.0.0-7418.gb0 688 kB/s | 45 kB 00:00 2023-11-18T20:35:27.801 INFO:teuthology.orchestra.run.smithi132.stdout:(19/145): python3-ceph-common-18.0.0-7418.gb0f4 1.4 MB/s | 129 kB 00:00 2023-11-18T20:35:27.909 INFO:teuthology.orchestra.run.smithi132.stdout:(20/145): python3-cephfs-18.0.0-7418.gb0f45a51. 1.5 MB/s | 162 kB 00:00 2023-11-18T20:35:28.034 INFO:teuthology.orchestra.run.smithi132.stdout:(21/145): python3-rados-18.0.0-7418.gb0f45a51.e 2.5 MB/s | 321 kB 00:00 2023-11-18T20:35:28.151 INFO:teuthology.orchestra.run.smithi132.stdout:(22/145): python3-rbd-18.0.0-7418.gb0f45a51.el9 2.5 MB/s | 299 kB 00:00 2023-11-18T20:35:28.310 INFO:teuthology.orchestra.run.smithi132.stdout:(23/145): librgw2-18.0.0-7418.gb0f45a51.el9.x86 6.7 MB/s | 4.8 MB 00:00 2023-11-18T20:35:28.335 INFO:teuthology.orchestra.run.smithi132.stdout:(24/145): python3-rgw-18.0.0-7418.gb0f45a51.el9 544 kB/s | 99 kB 00:00 2023-11-18T20:35:28.377 INFO:teuthology.orchestra.run.smithi132.stdout:(25/145): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.3 MB/s | 85 kB 00:00 2023-11-18T20:35:28.469 INFO:teuthology.orchestra.run.smithi132.stdout:(26/145): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 1.8 MB/s | 170 kB 00:00 2023-11-18T20:35:28.603 INFO:teuthology.orchestra.run.smithi132.stdout:(27/145): ceph-grafana-dashboards-18.0.0-7418.g 176 kB/s | 23 kB 00:00 2023-11-18T20:35:28.711 INFO:teuthology.orchestra.run.smithi132.stdout:(28/145): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 8.0 MB/s | 3.0 MB 00:00 2023-11-18T20:35:28.745 INFO:teuthology.orchestra.run.smithi132.stdout:(29/145): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 942 kB/s | 133 kB 00:00 2023-11-18T20:35:29.129 INFO:teuthology.orchestra.run.smithi132.stdout:(30/145): ceph-mgr-dashboard-18.0.0-7418.gb0f45 4.2 MB/s | 1.8 MB 00:00 2023-11-18T20:35:29.254 INFO:teuthology.orchestra.run.smithi132.stdout:(31/145): ceph-mgr-modules-core-18.0.0-7418.gb0 1.9 MB/s | 243 kB 00:00 2023-11-18T20:35:29.721 INFO:teuthology.orchestra.run.smithi132.stdout:(32/145): ceph-test-18.0.0-7418.gb0f45a51.el9.x 14 MB/s | 41 MB 00:03 2023-11-18T20:35:29.771 INFO:teuthology.orchestra.run.smithi132.stdout:(33/145): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 97 kB/s | 50 kB 00:00 2023-11-18T20:35:29.822 INFO:teuthology.orchestra.run.smithi132.stdout:(34/145): ceph-prometheus-alerts-18.0.0-7418.gb 152 kB/s | 15 kB 00:00 2023-11-18T20:35:29.872 INFO:teuthology.orchestra.run.smithi132.stdout:(35/145): ceph-volume-18.0.0-7418.gb0f45a51.el9 2.6 MB/s | 262 kB 00:00 2023-11-18T20:35:30.014 INFO:teuthology.orchestra.run.smithi132.stdout:(36/145): ceph-mgr-diskprediction-local-18.0.0- 5.8 MB/s | 7.4 MB 00:01 2023-11-18T20:35:30.056 INFO:teuthology.orchestra.run.smithi132.stdout:(37/145): cephadm-18.0.0-7418.gb0f45a51.el9.noa 3.2 MB/s | 774 kB 00:00 2023-11-18T20:35:30.098 INFO:teuthology.orchestra.run.smithi132.stdout:(38/145): cephfs-top-18.0.0-7418.gb0f45a51.el9. 81 kB/s | 18 kB 00:00 2023-11-18T20:35:30.341 INFO:teuthology.orchestra.run.smithi132.stdout:(39/145): boost-program-options-1.75.0-8.el9.x8 854 kB/s | 106 kB 00:00 2023-11-18T20:35:30.383 INFO:teuthology.orchestra.run.smithi132.stdout:(40/145): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2023-11-18T20:35:30.442 INFO:teuthology.orchestra.run.smithi132.stdout:(41/145): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 920 kB 00:00 2023-11-18T20:35:30.467 INFO:teuthology.orchestra.run.smithi132.stdout:(42/145): elfutils-libelf-devel-0.190-1.el9.x86 178 kB/s | 21 kB 00:00 2023-11-18T20:35:30.500 INFO:teuthology.orchestra.run.smithi132.stdout:(43/145): flex-2.6.4-9.el9.x86_64.rpm 2.7 MB/s | 307 kB 00:00 2023-11-18T20:35:30.534 INFO:teuthology.orchestra.run.smithi132.stdout:(44/145): flexiblas-3.0.4-8.el9.x86_64.rpm 499 kB/s | 32 kB 00:00 2023-11-18T20:35:30.584 INFO:teuthology.orchestra.run.smithi132.stdout:(45/145): flexiblas-openblas-openmp-3.0.4-8.el9 208 kB/s | 17 kB 00:00 2023-11-18T20:35:30.693 INFO:teuthology.orchestra.run.smithi132.stdout:(46/145): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2023-11-18T20:35:30.726 INFO:teuthology.orchestra.run.smithi132.stdout:(47/145): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 186 kB 00:00 2023-11-18T20:35:30.752 INFO:teuthology.orchestra.run.smithi132.stdout:(48/145): libaio-devel-0.3.111-13.el9.x86_64.rp 63 kB/s | 10 kB 00:00 2023-11-18T20:35:30.785 INFO:teuthology.orchestra.run.smithi132.stdout:(49/145): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 159 kB 00:00 2023-11-18T20:35:30.827 INFO:teuthology.orchestra.run.smithi132.stdout:(50/145): librdkafka-1.6.1-102.el9.x86_64.rpm 8.9 MB/s | 661 kB 00:00 2023-11-18T20:35:30.861 INFO:teuthology.orchestra.run.smithi132.stdout:(51/145): librabbitmq-0.11.0-7.el9.x86_64.rpm 414 kB/s | 44 kB 00:00 2023-11-18T20:35:30.903 INFO:teuthology.orchestra.run.smithi132.stdout:(52/145): libtool-2.4.6-45.el9.x86_64.rpm 5.0 MB/s | 578 kB 00:00 2023-11-18T20:35:30.928 INFO:teuthology.orchestra.run.smithi132.stdout:(53/145): libuuid-devel-2.37.4-15.el9.x86_64.rp 258 kB/s | 24 kB 00:00 2023-11-18T20:35:30.953 INFO:teuthology.orchestra.run.smithi132.stdout:(54/145): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 46 kB 00:00 2023-11-18T20:35:30.978 INFO:teuthology.orchestra.run.smithi132.stdout:(55/145): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-11-18T20:35:31.012 INFO:teuthology.orchestra.run.smithi132.stdout:(56/145): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2023-11-18T20:35:31.045 INFO:teuthology.orchestra.run.smithi132.stdout:(57/145): openblas-0.3.21-2.el9.x86_64.rpm 533 kB/s | 34 kB 00:00 2023-11-18T20:35:31.204 INFO:teuthology.orchestra.run.smithi132.stdout:(58/145): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2023-11-18T20:35:31.305 INFO:teuthology.orchestra.run.smithi132.stdout:(59/145): openssl-devel-3.0.7-24.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2023-11-18T20:35:31.363 INFO:teuthology.orchestra.run.smithi132.stdout:(60/145): postgresql-13.11-1.el9.x86_64.rpm 5.0 MB/s | 1.5 MB 00:00 2023-11-18T20:35:31.396 INFO:teuthology.orchestra.run.smithi132.stdout:(61/145): postgresql-contrib-13.11-1.el9.x86_64 4.5 MB/s | 811 kB 00:00 2023-11-18T20:35:31.424 INFO:teuthology.orchestra.run.smithi132.stdout:(62/145): postgresql-private-libs-13.11-1.el9.x 1.2 MB/s | 134 kB 00:00 2023-11-18T20:35:31.549 INFO:teuthology.orchestra.run.smithi132.stdout:(63/145): python3-jinja2-2.11.3-4.el9.noarch.rp 1.8 MB/s | 228 kB 00:00 2023-11-18T20:35:31.683 INFO:teuthology.orchestra.run.smithi132.stdout:(64/145): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-11-18T20:35:31.800 INFO:teuthology.orchestra.run.smithi132.stdout:(65/145): postgresql-server-13.11-1.el9.x86_64. 14 MB/s | 5.7 MB 00:00 2023-11-18T20:35:31.816 INFO:teuthology.orchestra.run.smithi132.stdout:(66/145): python3-jsonpatch-1.21-16.el9.noarch. 92 kB/s | 24 kB 00:00 2023-11-18T20:35:31.833 INFO:teuthology.orchestra.run.smithi132.stdout:(67/145): python3-jsonpointer-2.0-4.el9.noarch. 125 kB/s | 18 kB 00:00 2023-11-18T20:35:31.850 INFO:teuthology.orchestra.run.smithi132.stdout:(68/145): python3-mako-1.1.4-6.el9.noarch.rpm 4.4 MB/s | 144 kB 00:00 2023-11-18T20:35:31.867 INFO:teuthology.orchestra.run.smithi132.stdout:(69/145): python3-markupsafe-1.1.1-12.el9.x86_6 646 kB/s | 32 kB 00:00 2023-11-18T20:35:31.993 INFO:teuthology.orchestra.run.smithi132.stdout:(70/145): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-11-18T20:35:32.018 INFO:teuthology.orchestra.run.smithi132.stdout:(71/145): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-11-18T20:35:32.051 INFO:teuthology.orchestra.run.smithi132.stdout:(72/145): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-11-18T20:35:32.068 INFO:teuthology.orchestra.run.smithi132.stdout:(73/145): python3-prettytable-0.7.2-27.el9.noar 563 kB/s | 41 kB 00:00 2023-11-18T20:35:32.093 INFO:teuthology.orchestra.run.smithi132.stdout:(74/145): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 132 kB 00:00 2023-11-18T20:35:32.099 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-18T20:35:32.119 INFO:teuthology.orchestra.run.smithi132.stdout:(75/145): python3-pytz-2021.1-5.el9.noarch.rpm 987 kB/s | 47 kB 00:00 2023-11-18T20:35:32.153 INFO:teuthology.orchestra.run.smithi132.stdout:(76/145): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-11-18T20:35:32.177 INFO:teuthology.orchestra.run.smithi132.stdout:(77/145): python3-requests-oauthlib-1.3.0-12.el 516 kB/s | 43 kB 00:00 2023-11-18T20:35:32.461 INFO:teuthology.orchestra.run.smithi132.stdout:(78/145): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2023-11-18T20:35:32.486 INFO:teuthology.orchestra.run.smithi132.stdout:(79/145): python3-toml-0.10.2-6.el9.noarch.rpm 131 kB/s | 39 kB 00:00 2023-11-18T20:35:32.511 INFO:teuthology.orchestra.run.smithi132.stdout:(80/145): socat-1.7.4.1-5.el9.x86_64.rpm 941 kB/s | 300 kB 00:00 2023-11-18T20:35:32.545 INFO:teuthology.orchestra.run.smithi132.stdout:(81/145): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2023-11-18T20:35:32.570 INFO:teuthology.orchestra.run.smithi132.stdout:(82/145): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.5 MB/s | 85 kB 00:00 2023-11-18T20:35:32.596 INFO:teuthology.orchestra.run.smithi132.stdout:(83/145): xmlstarlet-1.6.1-20.el9.x86_64.rpm 764 kB/s | 63 kB 00:00 2023-11-18T20:35:32.621 INFO:teuthology.orchestra.run.smithi132.stdout:(84/145): zlib-devel-1.2.11-40.el9.x86_64.rpm 597 kB/s | 44 kB 00:00 2023-11-18T20:35:32.654 INFO:teuthology.orchestra.run.smithi132.stdout:(85/145): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-11-18T20:35:32.689 INFO:teuthology.orchestra.run.smithi132.stdout:(86/145): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.7 MB/s | 803 kB 00:00 2023-11-18T20:35:32.722 INFO:teuthology.orchestra.run.smithi132.stdout:(87/145): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2023-11-18T20:35:32.764 INFO:teuthology.orchestra.run.smithi132.stdout:(88/145): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2023-11-18T20:35:32.814 INFO:teuthology.orchestra.run.smithi132.stdout:(89/145): python3-cryptography-36.0.1-4.el9.x86 9.3 MB/s | 1.1 MB 00:00 2023-11-18T20:35:32.864 INFO:teuthology.orchestra.run.smithi132.stdout:(90/145): python3-ply-3.11-14.el9.noarch.rpm 730 kB/s | 103 kB 00:00 2023-11-18T20:35:32.906 INFO:teuthology.orchestra.run.smithi132.stdout:(91/145): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2023-11-18T20:35:32.931 INFO:teuthology.orchestra.run.smithi132.stdout:(92/145): python3-requests-2.25.1-7.el9.noarch. 1.7 MB/s | 113 kB 00:00 2023-11-18T20:35:32.964 INFO:teuthology.orchestra.run.smithi132.stdout:(93/145): python3-urllib3-1.26.5-4.el9.noarch.r 1.9 MB/s | 187 kB 00:00 2023-11-18T20:35:33.140 INFO:teuthology.orchestra.run.smithi132.stdout:(94/145): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2023-11-18T20:35:33.290 INFO:teuthology.orchestra.run.smithi132.stdout:(95/145): gperftools-libs-2.9.1-2.el9.x86_64.rp 954 kB/s | 309 kB 00:00 2023-11-18T20:35:33.317 INFO:teuthology.orchestra.run.smithi132.stdout:(96/145): libarrow-doc-9.0.0-9.el9.noarch.rpm 139 kB/s | 24 kB 00:00 2023-11-18T20:35:33.358 INFO:teuthology.orchestra.run.smithi132.stdout:(97/145): liboath-2.6.7-2.el9.x86_64.rpm 733 kB/s | 49 kB 00:00 2023-11-18T20:35:33.450 INFO:teuthology.orchestra.run.smithi132.stdout:(98/145): libunwind-1.6.2-1.el9.x86_64.rpm 507 kB/s | 67 kB 00:00 2023-11-18T20:35:33.656 INFO:teuthology.orchestra.run.smithi132.stdout:(99/145): libarrow-9.0.0-9.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2023-11-18T20:35:33.700 INFO:teuthology.orchestra.run.smithi132.stdout:(100/145): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.4 MB/s | 837 kB 00:00 2023-11-18T20:35:33.726 INFO:teuthology.orchestra.run.smithi132.stdout:(101/145): python3-bcrypt-3.2.2-1.el9.x86_64.rp 633 kB/s | 43 kB 00:00 2023-11-18T20:35:33.768 INFO:teuthology.orchestra.run.smithi132.stdout:(102/145): python3-cachetools-4.2.4-1.el9.noarc 487 kB/s | 32 kB 00:00 2023-11-18T20:35:33.793 INFO:teuthology.orchestra.run.smithi132.stdout:(103/145): python3-certifi-2021.10.8-2.el9.noar 226 kB/s | 15 kB 00:00 2023-11-18T20:35:33.843 INFO:teuthology.orchestra.run.smithi132.stdout:(104/145): python3-asyncssh-2.13.2-3.el9.noarch 1.4 MB/s | 548 kB 00:00 2023-11-18T20:35:33.877 INFO:teuthology.orchestra.run.smithi132.stdout:(105/145): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2023-11-18T20:35:33.919 INFO:teuthology.orchestra.run.smithi132.stdout:(106/145): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-11-18T20:35:33.944 INFO:teuthology.orchestra.run.smithi132.stdout:(107/145): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2023-11-18T20:35:33.986 INFO:teuthology.orchestra.run.smithi132.stdout:(108/145): python3-google-auth-2.23.4-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-11-18T20:35:34.011 INFO:teuthology.orchestra.run.smithi132.stdout:(109/145): python3-jaraco-classes-3.2.1-5.el9.n 193 kB/s | 18 kB 00:00 2023-11-18T20:35:34.036 INFO:teuthology.orchestra.run.smithi132.stdout:(110/145): python3-jaraco-collections-3.0.0-8.e 253 kB/s | 23 kB 00:00 2023-11-18T20:35:34.087 INFO:teuthology.orchestra.run.smithi132.stdout:(111/145): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2023-11-18T20:35:34.112 INFO:teuthology.orchestra.run.smithi132.stdout:(112/145): python3-jwt+crypto-2.4.0-1.el9.noarc 122 kB/s | 9.0 kB 00:00 2023-11-18T20:35:34.137 INFO:teuthology.orchestra.run.smithi132.stdout:(113/145): python3-jaraco-text-3.2.0-6.el9.noar 198 kB/s | 20 kB 00:00 2023-11-18T20:35:34.162 INFO:teuthology.orchestra.run.smithi132.stdout:(114/145): python3-jwt-2.4.0-1.el9.noarch.rpm 549 kB/s | 41 kB 00:00 2023-11-18T20:35:34.205 INFO:teuthology.orchestra.run.smithi132.stdout:(115/145): python3-logutils-0.3.5-21.el9.noarch 699 kB/s | 46 kB 00:00 2023-11-18T20:35:34.230 INFO:teuthology.orchestra.run.smithi132.stdout:(116/145): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2023-11-18T20:35:34.288 INFO:teuthology.orchestra.run.smithi132.stdout:(117/145): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-11-18T20:35:34.314 INFO:teuthology.orchestra.run.smithi132.stdout:(118/145): python3-natsort-7.1.1-5.el9.noarch.r 534 kB/s | 58 kB 00:00 2023-11-18T20:35:34.347 INFO:teuthology.orchestra.run.smithi132.stdout:(119/145): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2023-11-18T20:35:34.373 INFO:teuthology.orchestra.run.smithi132.stdout:(120/145): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2023-11-18T20:35:34.398 INFO:teuthology.orchestra.run.smithi132.stdout:(121/145): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2023-11-18T20:35:34.423 INFO:teuthology.orchestra.run.smithi132.stdout:(122/145): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2023-11-18T20:35:34.457 INFO:teuthology.orchestra.run.smithi132.stdout:(123/145): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-11-18T20:35:34.491 INFO:teuthology.orchestra.run.smithi132.stdout:(124/145): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2023-11-18T20:35:34.516 INFO:teuthology.orchestra.run.smithi132.stdout:(125/145): python3-tempora-5.0.0-2.el9.noarch.r 390 kB/s | 36 kB 00:00 2023-11-18T20:35:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:(126/145): python3-typing-extensions-4.4.0-2.el 613 kB/s | 51 kB 00:00 2023-11-18T20:35:34.575 INFO:teuthology.orchestra.run.smithi132.stdout:(127/145): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-11-18T20:35:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:(128/145): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2023-11-18T20:35:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:(129/145): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2023-11-18T20:35:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:(130/145): python3-zc-lockfile-2.0-10.el9.noarc 267 kB/s | 20 kB 00:00 2023-11-18T20:35:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:(131/145): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2023-11-18T20:35:34.768 INFO:teuthology.orchestra.run.smithi132.stdout:(132/145): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2023-11-18T20:35:34.802 INFO:teuthology.orchestra.run.smithi132.stdout:(133/145): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-18T20:35:34.885 INFO:teuthology.orchestra.run.smithi132.stdout:(134/145): NetworkManager-1.45.6-1.el9.x86_64.r 27 MB/s | 2.2 MB 00:00 2023-11-18T20:35:34.967 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T20:35:34.969 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T20:35:34.969 INFO:teuthology.orchestra.run.smithi132.stdout:(135/145): NetworkManager-libnm-1.45.6-1.el9.x8 21 MB/s | 1.8 MB 00:00 2023-11-18T20:35:34.989 INFO:teuthology.orchestra.run.smithi161.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-18T20:35:34.990 INFO:teuthology.orchestra.run.smithi161.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-18T20:35:34.992 INFO:teuthology.orchestra.run.smithi161.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-18T20:35:34.993 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-18T20:35:34.996 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-18T20:35:35.000 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-18T20:35:35.001 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-18T20:35:35.002 INFO:teuthology.orchestra.run.smithi132.stdout:(136/145): NetworkManager-team-1.45.6-1.el9.x86 1.3 MB/s | 42 kB 00:00 2023-11-18T20:35:35.044 INFO:teuthology.orchestra.run.smithi132.stdout:(137/145): NetworkManager-tui-1.45.6-1.el9.x86_ 5.9 MB/s | 245 kB 00:00 2023-11-18T20:35:35.078 INFO:teuthology.orchestra.run.smithi132.stdout:(138/145): acl-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2023-11-18T20:35:35.078 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-11-18T20:35:35.095 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-18T20:35:35.096 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 217 k 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 18 k 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-18T20:35:35.097 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-18T20:35:35.098 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-18T20:35:35.099 INFO:teuthology.orchestra.run.smithi161.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-18T20:35:35.100 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-18T20:35:35.101 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-18T20:35:35.102 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-18T20:35:35.103 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-18T20:35:35.104 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-18T20:35:35.105 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-18T20:35:35.106 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-18T20:35:35.107 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:35:35.108 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-11-18T20:35:35.109 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2023-11-18T20:35:35.109 INFO:teuthology.orchestra.run.smithi161.stdout:Install 132 Packages 2023-11-18T20:35:35.109 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 13 Packages 2023-11-18T20:35:35.109 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:35:35.109 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 200 M 2023-11-18T20:35:35.109 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-11-18T20:35:35.111 INFO:teuthology.orchestra.run.smithi132.stdout:(139/145): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-11-18T20:35:35.154 INFO:teuthology.orchestra.run.smithi132.stdout:(140/145): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-11-18T20:35:35.204 INFO:teuthology.orchestra.run.smithi132.stdout:(141/145): elfutils-libs-0.190-1.el9.x86_64.rpm 5.1 MB/s | 255 kB 00:00 2023-11-18T20:35:35.238 INFO:teuthology.orchestra.run.smithi132.stdout:(142/145): libacl-2.3.1-4.el9.x86_64.rpm 677 kB/s | 22 kB 00:00 2023-11-18T20:35:35.321 INFO:teuthology.orchestra.run.smithi132.stdout:(143/145): librbd1-18.0.0-7418.gb0f45a51.el9.x8 4.7 MB/s | 3.0 MB 00:00 2023-11-18T20:35:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:(144/145): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 321 kB 00:00 2023-11-18T20:35:35.430 INFO:teuthology.orchestra.run.smithi132.stdout:(145/145): librados2-18.0.0-7418.gb0f45a51.el9. 4.3 MB/s | 3.3 MB 00:00 2023-11-18T20:35:35.434 INFO:teuthology.orchestra.run.smithi161.stdout:(1/145): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 31 kB/s | 6.5 kB 00:00 2023-11-18T20:35:35.439 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-11-18T20:35:35.440 INFO:teuthology.orchestra.run.smithi132.stdout:Total 17 MB/s | 200 MB 00:12 2023-11-18T20:35:35.500 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-11-18T20:35:35.676 INFO:teuthology.orchestra.run.smithi161.stdout:(2/145): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 3.5 MB/s | 860 kB 00:00 2023-11-18T20:35:35.726 INFO:teuthology.orchestra.run.smithi161.stdout:(3/145): ceph-immutable-object-cache-18.0.0-741 2.8 MB/s | 141 kB 00:00 2023-11-18T20:35:35.757 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-11-18T20:35:35.757 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-11-18T20:35:36.027 INFO:teuthology.orchestra.run.smithi161.stdout:(4/145): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 7.0 MB/s | 2.1 MB 00:00 2023-11-18T20:35:36.210 INFO:teuthology.orchestra.run.smithi161.stdout:(5/145): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 8.0 MB/s | 1.5 MB 00:00 2023-11-18T20:35:36.436 INFO:teuthology.orchestra.run.smithi161.stdout:(6/145): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 4.3 MB/s | 5.2 MB 00:01 2023-11-18T20:35:36.686 INFO:teuthology.orchestra.run.smithi161.stdout:(7/145): ceph-mon-18.0.0-7418.gb0f45a51.el9.x86 9.3 MB/s | 4.4 MB 00:00 2023-11-18T20:35:37.570 INFO:teuthology.orchestra.run.smithi161.stdout:(8/145): ceph-radosgw-18.0.0-7418.gb0f45a51.el9 9.8 MB/s | 8.6 MB 00:00 2023-11-18T20:35:37.645 INFO:teuthology.orchestra.run.smithi161.stdout:(9/145): ceph-selinux-18.0.0-7418.gb0f45a51.el9 326 kB/s | 24 kB 00:00 2023-11-18T20:35:37.857 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-11-18T20:35:37.858 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-11-18T20:35:38.178 INFO:teuthology.orchestra.run.smithi161.stdout:(10/145): ceph-common-18.0.0-7418.gb0f45a51.el9 6.4 MB/s | 19 MB 00:02 2023-11-18T20:35:38.454 INFO:teuthology.orchestra.run.smithi161.stdout:(11/145): ceph-osd-18.0.0-7418.gb0f45a51.el9.x8 8.8 MB/s | 18 MB 00:02 2023-11-18T20:35:38.487 INFO:teuthology.orchestra.run.smithi161.stdout:(12/145): cephfs-mirror-18.0.0-7418.gb0f45a51.e 706 kB/s | 217 kB 00:00 2023-11-18T20:35:38.521 INFO:teuthology.orchestra.run.smithi161.stdout:(13/145): libcephfs-devel-18.0.0-7418.gb0f45a51 474 kB/s | 31 kB 00:00 2023-11-18T20:35:38.606 INFO:teuthology.orchestra.run.smithi161.stdout:(14/145): libcephsqlite-18.0.0-7418.gb0f45a51.e 1.9 MB/s | 163 kB 00:00 2023-11-18T20:35:38.655 INFO:teuthology.orchestra.run.smithi161.stdout:(15/145): libcephfs2-18.0.0-7418.gb0f45a51.el9. 4.2 MB/s | 718 kB 00:00 2023-11-18T20:35:38.688 INFO:teuthology.orchestra.run.smithi161.stdout:(16/145): librados-devel-18.0.0-7418.gb0f45a51. 1.5 MB/s | 127 kB 00:00 2023-11-18T20:35:38.739 INFO:teuthology.orchestra.run.smithi161.stdout:(17/145): libradosstriper1-18.0.0-7418.gb0f45a5 5.6 MB/s | 475 kB 00:00 2023-11-18T20:35:38.830 INFO:teuthology.orchestra.run.smithi161.stdout:(18/145): python3-ceph-argparse-18.0.0-7418.gb0 498 kB/s | 45 kB 00:00 2023-11-18T20:35:38.943 INFO:teuthology.orchestra.run.smithi161.stdout:(19/145): python3-ceph-common-18.0.0-7418.gb0f4 1.1 MB/s | 129 kB 00:00 2023-11-18T20:35:39.064 INFO:teuthology.orchestra.run.smithi161.stdout:(20/145): librgw2-18.0.0-7418.gb0f45a51.el9.x86 13 MB/s | 4.8 MB 00:00 2023-11-18T20:35:39.098 INFO:teuthology.orchestra.run.smithi161.stdout:(21/145): python3-cephfs-18.0.0-7418.gb0f45a51. 1.0 MB/s | 162 kB 00:00 2023-11-18T20:35:39.140 INFO:teuthology.orchestra.run.smithi161.stdout:(22/145): python3-rados-18.0.0-7418.gb0f45a51.e 4.2 MB/s | 321 kB 00:00 2023-11-18T20:35:39.173 INFO:teuthology.orchestra.run.smithi161.stdout:(23/145): python3-rbd-18.0.0-7418.gb0f45a51.el9 3.9 MB/s | 299 kB 00:00 2023-11-18T20:35:39.199 INFO:teuthology.orchestra.run.smithi161.stdout:(24/145): python3-rgw-18.0.0-7418.gb0f45a51.el9 1.7 MB/s | 99 kB 00:00 2023-11-18T20:35:39.272 INFO:teuthology.orchestra.run.smithi161.stdout:(25/145): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 868 kB/s | 85 kB 00:00 2023-11-18T20:35:39.373 INFO:teuthology.orchestra.run.smithi161.stdout:(26/145): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 1.7 MB/s | 170 kB 00:00 2023-11-18T20:35:39.457 INFO:teuthology.orchestra.run.smithi161.stdout:(27/145): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 12 MB/s | 3.0 MB 00:00 2023-11-18T20:35:39.482 INFO:teuthology.orchestra.run.smithi161.stdout:(28/145): ceph-grafana-dashboards-18.0.0-7418.g 217 kB/s | 23 kB 00:00 2023-11-18T20:35:39.524 INFO:teuthology.orchestra.run.smithi161.stdout:(29/145): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 2.0 MB/s | 133 kB 00:00 2023-11-18T20:35:39.775 INFO:teuthology.orchestra.run.smithi161.stdout:(30/145): ceph-mgr-dashboard-18.0.0-7418.gb0f45 6.0 MB/s | 1.8 MB 00:00 2023-11-18T20:35:39.892 INFO:teuthology.orchestra.run.smithi161.stdout:(31/145): ceph-mgr-modules-core-18.0.0-7418.gb0 2.0 MB/s | 243 kB 00:00 2023-11-18T20:35:40.034 INFO:teuthology.orchestra.run.smithi161.stdout:(32/145): ceph-mgr-diskprediction-local-18.0.0- 15 MB/s | 7.4 MB 00:00 2023-11-18T20:35:40.059 INFO:teuthology.orchestra.run.smithi161.stdout:(33/145): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 302 kB/s | 50 kB 00:00 2023-11-18T20:35:40.101 INFO:teuthology.orchestra.run.smithi161.stdout:(34/145): ceph-prometheus-alerts-18.0.0-7418.gb 229 kB/s | 15 kB 00:00 2023-11-18T20:35:40.134 INFO:teuthology.orchestra.run.smithi161.stdout:(35/145): ceph-volume-18.0.0-7418.gb0f45a51.el9 3.4 MB/s | 262 kB 00:00 2023-11-18T20:35:40.210 INFO:teuthology.orchestra.run.smithi161.stdout:(36/145): cephadm-18.0.0-7418.gb0f45a51.el9.noa 7.0 MB/s | 774 kB 00:00 2023-11-18T20:35:40.256 INFO:teuthology.orchestra.run.smithi161.stdout:(37/145): cephfs-top-18.0.0-7418.gb0f45a51.el9. 152 kB/s | 18 kB 00:00 2023-11-18T20:35:40.469 INFO:teuthology.orchestra.run.smithi161.stdout:(38/145): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 662 kB 00:00 2023-11-18T20:35:40.511 INFO:teuthology.orchestra.run.smithi161.stdout:(39/145): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 920 kB 00:00 2023-11-18T20:35:40.536 INFO:teuthology.orchestra.run.smithi161.stdout:(40/145): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-11-18T20:35:40.553 INFO:teuthology.orchestra.run.smithi161.stdout:(41/145): elfutils-libelf-devel-0.190-1.el9.x86 530 kB/s | 21 kB 00:00 2023-11-18T20:35:40.620 INFO:teuthology.orchestra.run.smithi161.stdout:(42/145): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2023-11-18T20:35:40.637 INFO:teuthology.orchestra.run.smithi161.stdout:(43/145): flexiblas-3.0.4-8.el9.x86_64.rpm 395 kB/s | 32 kB 00:00 2023-11-18T20:35:40.729 INFO:teuthology.orchestra.run.smithi161.stdout:(44/145): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-11-18T20:35:40.754 INFO:teuthology.orchestra.run.smithi161.stdout:(45/145): flexiblas-openblas-openmp-3.0.4-8.el9 169 kB/s | 17 kB 00:00 2023-11-18T20:35:40.788 INFO:teuthology.orchestra.run.smithi161.stdout:(46/145): libaio-devel-0.3.111-13.el9.x86_64.rp 315 kB/s | 10 kB 00:00 2023-11-18T20:35:40.821 INFO:teuthology.orchestra.run.smithi161.stdout:(47/145): jq-1.6-16.el9.x86_64.rpm 2.8 MB/s | 186 kB 00:00 2023-11-18T20:35:40.847 INFO:teuthology.orchestra.run.smithi161.stdout:(48/145): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.8 MB/s | 159 kB 00:00 2023-11-18T20:35:40.872 INFO:teuthology.orchestra.run.smithi161.stdout:(49/145): librabbitmq-0.11.0-7.el9.x86_64.rpm 921 kB/s | 44 kB 00:00 2023-11-18T20:35:40.947 INFO:teuthology.orchestra.run.smithi161.stdout:(50/145): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 661 kB 00:00 2023-11-18T20:35:40.989 INFO:teuthology.orchestra.run.smithi161.stdout:(51/145): libtool-2.4.6-45.el9.x86_64.rpm 5.1 MB/s | 578 kB 00:00 2023-11-18T20:35:41.014 INFO:teuthology.orchestra.run.smithi161.stdout:(52/145): libuuid-devel-2.37.4-15.el9.x86_64.rp 401 kB/s | 24 kB 00:00 2023-11-18T20:35:41.039 INFO:teuthology.orchestra.run.smithi161.stdout:(53/145): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 46 kB 00:00 2023-11-18T20:35:41.073 INFO:teuthology.orchestra.run.smithi161.stdout:(54/145): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-11-18T20:35:41.107 INFO:teuthology.orchestra.run.smithi161.stdout:(55/145): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-11-18T20:35:41.132 INFO:teuthology.orchestra.run.smithi161.stdout:(56/145): openblas-0.3.21-2.el9.x86_64.rpm 612 kB/s | 34 kB 00:00 2023-11-18T20:35:41.282 INFO:teuthology.orchestra.run.smithi161.stdout:(57/145): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-11-18T20:35:41.374 INFO:teuthology.orchestra.run.smithi161.stdout:(58/145): openssl-devel-3.0.7-24.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-11-18T20:35:41.433 INFO:teuthology.orchestra.run.smithi161.stdout:(59/145): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2023-11-18T20:35:41.483 INFO:teuthology.orchestra.run.smithi161.stdout:(60/145): postgresql-contrib-13.11-1.el9.x86_64 8.3 MB/s | 811 kB 00:00 2023-11-18T20:35:41.517 INFO:teuthology.orchestra.run.smithi161.stdout:(61/145): postgresql-private-libs-13.11-1.el9.x 1.7 MB/s | 134 kB 00:00 2023-11-18T20:35:41.659 INFO:teuthology.orchestra.run.smithi161.stdout:(62/145): postgresql-server-13.11-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2023-11-18T20:35:41.784 INFO:teuthology.orchestra.run.smithi161.stdout:(63/145): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-11-18T20:35:41.809 INFO:teuthology.orchestra.run.smithi161.stdout:(64/145): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-11-18T20:35:41.843 INFO:teuthology.orchestra.run.smithi161.stdout:(65/145): python3-jsonpatch-1.21-16.el9.noarch. 753 kB/s | 24 kB 00:00 2023-11-18T20:35:41.868 INFO:teuthology.orchestra.run.smithi161.stdout:(66/145): python3-jsonpointer-2.0-4.el9.noarch. 315 kB/s | 18 kB 00:00 2023-11-18T20:35:41.927 INFO:teuthology.orchestra.run.smithi161.stdout:(67/145): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2023-11-18T20:35:41.952 INFO:teuthology.orchestra.run.smithi161.stdout:(68/145): python3-markupsafe-1.1.1-12.el9.x86_6 384 kB/s | 32 kB 00:00 2023-11-18T20:35:41.994 INFO:teuthology.orchestra.run.smithi161.stdout:(69/145): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.3 MB/s | 217 kB 00:00 2023-11-18T20:35:42.111 INFO:teuthology.orchestra.run.smithi161.stdout:(70/145): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-11-18T20:35:42.138 INFO:teuthology.orchestra.run.smithi161.stdout:(71/145): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-11-18T20:35:42.163 INFO:teuthology.orchestra.run.smithi161.stdout:(72/145): python3-prettytable-0.7.2-27.el9.noar 1.7 MB/s | 41 kB 00:00 2023-11-18T20:35:42.189 INFO:teuthology.orchestra.run.smithi161.stdout:(73/145): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 132 kB 00:00 2023-11-18T20:35:42.247 INFO:teuthology.orchestra.run.smithi161.stdout:(74/145): python3-pytz-2021.1-5.el9.noarch.rpm 831 kB/s | 47 kB 00:00 2023-11-18T20:35:42.280 INFO:teuthology.orchestra.run.smithi161.stdout:(75/145): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-11-18T20:35:42.306 INFO:teuthology.orchestra.run.smithi161.stdout:(76/145): python3-requests-oauthlib-1.3.0-12.el 762 kB/s | 43 kB 00:00 2023-11-18T20:35:42.598 INFO:teuthology.orchestra.run.smithi161.stdout:(77/145): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2023-11-18T20:35:42.623 INFO:teuthology.orchestra.run.smithi161.stdout:(78/145): python3-toml-0.10.2-6.el9.noarch.rpm 128 kB/s | 39 kB 00:00 2023-11-18T20:35:42.657 INFO:teuthology.orchestra.run.smithi161.stdout:(79/145): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2023-11-18T20:35:42.699 INFO:teuthology.orchestra.run.smithi161.stdout:(80/145): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2023-11-18T20:35:42.724 INFO:teuthology.orchestra.run.smithi161.stdout:(81/145): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-11-18T20:35:42.749 INFO:teuthology.orchestra.run.smithi161.stdout:(82/145): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-11-18T20:35:42.775 INFO:teuthology.orchestra.run.smithi161.stdout:(83/145): zlib-devel-1.2.11-40.el9.x86_64.rpm 902 kB/s | 44 kB 00:00 2023-11-18T20:35:42.800 INFO:teuthology.orchestra.run.smithi161.stdout:(84/145): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-18T20:35:42.842 INFO:teuthology.orchestra.run.smithi161.stdout:(85/145): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-18T20:35:42.894 INFO:teuthology.orchestra.run.smithi161.stdout:(86/145): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.2 MB/s | 195 kB 00:00 2023-11-18T20:35:42.934 INFO:teuthology.orchestra.run.smithi161.stdout:(87/145): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-11-18T20:35:42.993 INFO:teuthology.orchestra.run.smithi161.stdout:(88/145): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2023-11-18T20:35:43.018 INFO:teuthology.orchestra.run.smithi161.stdout:(89/145): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-11-18T20:35:43.043 INFO:teuthology.orchestra.run.smithi161.stdout:(90/145): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-18T20:35:43.068 INFO:teuthology.orchestra.run.smithi161.stdout:(91/145): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-11-18T20:35:43.102 INFO:teuthology.orchestra.run.smithi161.stdout:(92/145): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-18T20:35:43.278 INFO:teuthology.orchestra.run.smithi161.stdout:(93/145): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-11-18T20:35:43.753 INFO:teuthology.orchestra.run.smithi161.stdout:(94/145): gperftools-libs-2.9.1-2.el9.x86_64.rp 476 kB/s | 309 kB 00:00 2023-11-18T20:35:43.853 INFO:teuthology.orchestra.run.smithi161.stdout:(95/145): libarrow-doc-9.0.0-9.el9.noarch.rpm 245 kB/s | 24 kB 00:00 2023-11-18T20:35:43.921 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-11-18T20:35:43.961 INFO:teuthology.orchestra.run.smithi161.stdout:(96/145): liboath-2.6.7-2.el9.x86_64.rpm 452 kB/s | 49 kB 00:00 2023-11-18T20:35:43.994 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/158 2023-11-18T20:35:44.026 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/158 2023-11-18T20:35:44.070 INFO:teuthology.orchestra.run.smithi161.stdout:(97/145): libunwind-1.6.2-1.el9.x86_64.rpm 627 kB/s | 67 kB 00:00 2023-11-18T20:35:44.091 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/158 2023-11-18T20:35:44.187 INFO:teuthology.orchestra.run.smithi161.stdout:(98/145): libarrow-9.0.0-9.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2023-11-18T20:35:44.466 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/158 2023-11-18T20:35:44.526 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T20:35:44.679 INFO:teuthology.orchestra.run.smithi161.stdout:(99/145): ceph-test-18.0.0-7418.gb0f45a51.el9.x 5.9 MB/s | 41 MB 00:07 2023-11-18T20:35:44.716 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T20:35:44.721 INFO:teuthology.orchestra.run.smithi161.stdout:(100/145): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.3 MB/s | 837 kB 00:00 2023-11-18T20:35:44.743 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T20:35:44.755 INFO:teuthology.orchestra.run.smithi161.stdout:(101/145): python3-asyncssh-2.13.2-3.el9.noarch 967 kB/s | 548 kB 00:00 2023-11-18T20:35:44.822 INFO:teuthology.orchestra.run.smithi161.stdout:(102/145): python3-cachetools-4.2.4-1.el9.noarc 323 kB/s | 32 kB 00:00 2023-11-18T20:35:44.855 INFO:teuthology.orchestra.run.smithi161.stdout:(103/145): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2023-11-18T20:35:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T20:35:44.949 INFO:teuthology.orchestra.run.smithi161.stdout:(104/145): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-11-18T20:35:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T20:35:44.989 INFO:teuthology.orchestra.run.smithi161.stdout:(105/145): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-11-18T20:35:45.014 INFO:teuthology.orchestra.run.smithi161.stdout:(106/145): python3-bcrypt-3.2.2-1.el9.x86_64.rp 130 kB/s | 43 kB 00:00 2023-11-18T20:35:45.042 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/158 2023-11-18T20:35:45.065 INFO:teuthology.orchestra.run.smithi161.stdout:(107/145): python3-google-auth-2.23.4-1.el9.noa 1.7 MB/s | 197 kB 00:00 2023-11-18T20:35:45.090 INFO:teuthology.orchestra.run.smithi161.stdout:(108/145): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-11-18T20:35:45.121 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/158 2023-11-18T20:35:45.132 INFO:teuthology.orchestra.run.smithi161.stdout:(109/145): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2023-11-18T20:35:45.165 INFO:teuthology.orchestra.run.smithi161.stdout:(110/145): python3-jaraco-collections-3.0.0-8.e 232 kB/s | 23 kB 00:00 2023-11-18T20:35:45.190 INFO:teuthology.orchestra.run.smithi161.stdout:(111/145): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2023-11-18T20:35:45.198 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/158 2023-11-18T20:35:45.274 INFO:teuthology.orchestra.run.smithi161.stdout:(112/145): python3-jaraco-text-3.2.0-6.el9.noar 139 kB/s | 20 kB 00:00 2023-11-18T20:35:45.299 INFO:teuthology.orchestra.run.smithi161.stdout:(113/145): python3-jwt+crypto-2.4.0-1.el9.noarc 68 kB/s | 9.0 kB 00:00 2023-11-18T20:35:45.325 INFO:teuthology.orchestra.run.smithi161.stdout:(114/145): python3-jwt-2.4.0-1.el9.noarch.rpm 307 kB/s | 41 kB 00:00 2023-11-18T20:35:45.425 INFO:teuthology.orchestra.run.smithi161.stdout:(115/145): python3-more-itertools-8.12.0-2.el9. 793 kB/s | 79 kB 00:00 2023-11-18T20:35:45.459 INFO:teuthology.orchestra.run.smithi161.stdout:(116/145): python3-logutils-0.3.5-21.el9.noarch 293 kB/s | 46 kB 00:00 2023-11-18T20:35:45.477 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/158 2023-11-18T20:35:45.509 INFO:teuthology.orchestra.run.smithi161.stdout:(117/145): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2023-11-18T20:35:45.534 INFO:teuthology.orchestra.run.smithi161.stdout:(118/145): python3-natsort-7.1.1-5.el9.noarch.r 535 kB/s | 58 kB 00:00 2023-11-18T20:35:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/158 2023-11-18T20:35:45.575 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T20:35:45.618 INFO:teuthology.orchestra.run.smithi161.stdout:(119/145): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2023-11-18T20:35:45.643 INFO:teuthology.orchestra.run.smithi161.stdout:(120/145): python3-pyOpenSSL-21.0.0-1.el9.noarc 834 kB/s | 90 kB 00:00 2023-11-18T20:35:45.719 INFO:teuthology.orchestra.run.smithi161.stdout:(121/145): python3-repoze-lru-0.7-16.el9.noarch 309 kB/s | 31 kB 00:00 2023-11-18T20:35:45.752 INFO:teuthology.orchestra.run.smithi161.stdout:(122/145): python3-pecan-1.4.2-3.el9.noarch.rpm 932 kB/s | 272 kB 00:00 2023-11-18T20:35:45.756 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T20:35:45.777 INFO:teuthology.orchestra.run.smithi161.stdout:(123/145): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2023-11-18T20:35:45.792 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T20:35:45.819 INFO:teuthology.orchestra.run.smithi161.stdout:(124/145): python3-rsa-4.9-2.el9.noarch.rpm 594 kB/s | 59 kB 00:00 2023-11-18T20:35:45.853 INFO:teuthology.orchestra.run.smithi161.stdout:(125/145): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2023-11-18T20:35:45.906 INFO:teuthology.orchestra.run.smithi161.stdout:(126/145): python3-typing-extensions-4.4.0-2.el 398 kB/s | 51 kB 00:00 2023-11-18T20:35:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T20:35:45.945 INFO:teuthology.orchestra.run.smithi161.stdout:(127/145): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-11-18T20:35:45.970 INFO:teuthology.orchestra.run.smithi161.stdout:(128/145): python3-websocket-client-1.2.3-2.el9 770 kB/s | 90 kB 00:00 2023-11-18T20:35:46.045 INFO:teuthology.orchestra.run.smithi161.stdout:(129/145): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2023-11-18T20:35:46.079 INFO:teuthology.orchestra.run.smithi161.stdout:(130/145): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-11-18T20:35:46.113 INFO:teuthology.orchestra.run.smithi161.stdout:(131/145): python3-werkzeug-2.0.3-3.el9.1.noarc 2.0 MB/s | 427 kB 00:00 2023-11-18T20:35:46.245 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/158 2023-11-18T20:35:46.272 INFO:teuthology.orchestra.run.smithi161.stdout:(132/145): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2023-11-18T20:35:46.305 INFO:teuthology.orchestra.run.smithi161.stdout:(133/145): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-18T20:35:46.397 INFO:teuthology.orchestra.run.smithi161.stdout:(134/145): NetworkManager-1.45.6-1.el9.x86_64.r 25 MB/s | 2.2 MB 00:00 2023-11-18T20:35:46.423 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T20:35:46.481 INFO:teuthology.orchestra.run.smithi161.stdout:(135/145): NetworkManager-libnm-1.45.6-1.el9.x8 21 MB/s | 1.8 MB 00:00 2023-11-18T20:35:46.514 INFO:teuthology.orchestra.run.smithi161.stdout:(136/145): NetworkManager-team-1.45.6-1.el9.x86 1.3 MB/s | 42 kB 00:00 2023-11-18T20:35:46.544 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T20:35:46.581 INFO:teuthology.orchestra.run.smithi161.stdout:(137/145): NetworkManager-tui-1.45.6-1.el9.x86_ 3.8 MB/s | 245 kB 00:00 2023-11-18T20:35:46.623 INFO:teuthology.orchestra.run.smithi161.stdout:(138/145): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-11-18T20:35:46.707 INFO:teuthology.orchestra.run.smithi161.stdout:(139/145): librados2-18.0.0-7418.gb0f45a51.el9. 5.3 MB/s | 3.3 MB 00:00 2023-11-18T20:35:46.732 INFO:teuthology.orchestra.run.smithi161.stdout:(140/145): elfutils-debuginfod-client-0.190-1.e 339 kB/s | 36 kB 00:00 2023-11-18T20:35:46.752 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T20:35:46.774 INFO:teuthology.orchestra.run.smithi161.stdout:(141/145): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-11-18T20:35:46.799 INFO:teuthology.orchestra.run.smithi161.stdout:(142/145): elfutils-libs-0.190-1.el9.x86_64.rpm 3.8 MB/s | 255 kB 00:00 2023-11-18T20:35:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T20:35:46.833 INFO:teuthology.orchestra.run.smithi161.stdout:(143/145): libacl-2.3.1-4.el9.x86_64.rpm 682 kB/s | 22 kB 00:00 2023-11-18T20:35:46.866 INFO:teuthology.orchestra.run.smithi161.stdout:(144/145): xfsdump-3.1.12-4.el9.x86_64.rpm 4.8 MB/s | 321 kB 00:00 2023-11-18T20:35:46.950 INFO:teuthology.orchestra.run.smithi161.stdout:(145/145): librbd1-18.0.0-7418.gb0f45a51.el9.x8 3.6 MB/s | 3.0 MB 00:00 2023-11-18T20:35:46.960 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-11-18T20:35:46.960 INFO:teuthology.orchestra.run.smithi161.stdout:Total 17 MB/s | 200 MB 00:11 2023-11-18T20:35:47.019 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-11-18T20:35:47.264 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T20:35:47.276 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-11-18T20:35:47.276 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-11-18T20:35:47.307 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/158 2023-11-18T20:35:47.418 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/158 2023-11-18T20:35:47.509 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/158 2023-11-18T20:35:47.553 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/158 2023-11-18T20:35:47.610 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/158 2023-11-18T20:35:47.664 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/158 2023-11-18T20:35:47.766 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/158 2023-11-18T20:35:47.814 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/158 2023-11-18T20:35:47.855 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/158 2023-11-18T20:35:47.966 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/158 2023-11-18T20:35:48.009 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 28/158 2023-11-18T20:35:48.060 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 29/158 2023-11-18T20:35:48.163 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 30/158 2023-11-18T20:35:48.338 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/158 2023-11-18T20:35:48.402 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/158 2023-11-18T20:35:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/158 2023-11-18T20:35:49.210 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/158 2023-11-18T20:35:49.255 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/158 2023-11-18T20:35:49.307 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 36/158 2023-11-18T20:35:49.349 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 37/158 2023-11-18T20:35:49.384 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-11-18T20:35:49.384 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-11-18T20:35:49.386 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 38/158 2023-11-18T20:35:49.552 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 39/158 2023-11-18T20:35:49.596 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 40/158 2023-11-18T20:35:49.685 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/158 2023-11-18T20:35:49.788 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/158 2023-11-18T20:35:49.838 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/158 2023-11-18T20:35:49.903 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 44/158 2023-11-18T20:35:50.187 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/158 2023-11-18T20:35:50.253 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/158 2023-11-18T20:35:50.315 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/158 2023-11-18T20:35:50.510 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/158 2023-11-18T20:35:50.562 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/158 2023-11-18T20:35:50.609 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 50/158 2023-11-18T20:35:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/158 2023-11-18T20:35:50.778 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 52/158 2023-11-18T20:35:50.835 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/158 2023-11-18T20:35:50.868 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/158 2023-11-18T20:35:51.028 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 55/158 2023-11-18T20:35:51.081 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 56/158 2023-11-18T20:35:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/158 2023-11-18T20:35:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/158 2023-11-18T20:35:51.496 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/158 2023-11-18T20:35:51.553 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/158 2023-11-18T20:35:51.731 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/158 2023-11-18T20:35:51.784 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/158 2023-11-18T20:35:51.815 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/158 2023-11-18T20:35:51.855 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/158 2023-11-18T20:35:51.899 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/158 2023-11-18T20:35:51.934 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/158 2023-11-18T20:35:51.978 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 67/158 2023-11-18T20:35:52.040 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/158 2023-11-18T20:35:52.122 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/158 2023-11-18T20:35:52.185 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/158 2023-11-18T20:35:52.243 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/158 2023-11-18T20:35:52.373 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/158 2023-11-18T20:35:52.414 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/158 2023-11-18T20:35:52.449 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/158 2023-11-18T20:35:52.502 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/158 2023-11-18T20:35:52.552 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/158 2023-11-18T20:35:52.694 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/158 2023-11-18T20:35:52.742 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/158 2023-11-18T20:35:52.896 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/158 2023-11-18T20:35:52.975 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/158 2023-11-18T20:35:53.985 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/158 2023-11-18T20:35:54.040 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/158 2023-11-18T20:35:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/158 2023-11-18T20:35:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/158 2023-11-18T20:35:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/158 2023-11-18T20:35:54.386 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/158 2023-11-18T20:35:54.486 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/158 2023-11-18T20:35:55.327 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/158 2023-11-18T20:35:55.614 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-11-18T20:35:55.672 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/158 2023-11-18T20:35:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/158 2023-11-18T20:35:55.703 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/158 2023-11-18T20:35:55.800 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/158 2023-11-18T20:35:56.232 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/158 2023-11-18T20:35:56.445 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T20:35:56.619 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T20:35:56.646 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T20:35:56.771 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T20:35:56.864 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T20:35:56.904 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/158 2023-11-18T20:35:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/158 2023-11-18T20:35:57.052 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/158 2023-11-18T20:35:57.293 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/158 2023-11-18T20:35:57.322 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/158 2023-11-18T20:35:57.386 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/158 2023-11-18T20:35:57.399 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/158 2023-11-18T20:35:57.410 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T20:35:57.437 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/158 2023-11-18T20:35:57.468 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.6-16.el9.x86_64 93/158 2023-11-18T20:35:57.512 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/158 2023-11-18T20:35:57.554 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 95/158 2023-11-18T20:35:57.579 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T20:35:57.612 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T20:35:57.695 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T20:35:57.921 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/158 2023-11-18T20:35:57.949 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T20:35:57.971 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/158 2023-11-18T20:35:58.102 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T20:35:58.138 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/158 2023-11-18T20:35:58.167 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T20:35:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/158 2023-11-18T20:35:58.237 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T20:35:58.431 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T20:35:58.512 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T20:35:58.686 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T20:35:58.710 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T20:35:58.802 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T20:35:58.837 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/158 2023-11-18T20:35:58.911 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T20:35:58.958 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/158 2023-11-18T20:35:59.059 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/158 2023-11-18T20:35:59.122 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/158 2023-11-18T20:35:59.181 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/158 2023-11-18T20:35:59.243 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/158 2023-11-18T20:35:59.292 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/158 2023-11-18T20:35:59.406 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/158 2023-11-18T20:35:59.455 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/158 2023-11-18T20:35:59.508 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/158 2023-11-18T20:35:59.624 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/158 2023-11-18T20:35:59.669 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 28/158 2023-11-18T20:35:59.720 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 29/158 2023-11-18T20:35:59.829 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 30/158 2023-11-18T20:36:00.020 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/158 2023-11-18T20:36:00.090 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/158 2023-11-18T20:36:00.803 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/158 2023-11-18T20:36:00.911 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/158 2023-11-18T20:36:00.968 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/158 2023-11-18T20:36:01.027 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 36/158 2023-11-18T20:36:01.077 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 37/158 2023-11-18T20:36:01.122 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 38/158 2023-11-18T20:36:01.324 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : re2-1:20211101-3.el9.x86_64 39/158 2023-11-18T20:36:01.400 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T20:36:01.434 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T20:36:01.526 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 40/158 2023-11-18T20:36:01.616 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/158 2023-11-18T20:36:01.727 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/158 2023-11-18T20:36:01.771 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/158 2023-11-18T20:36:01.812 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 44/158 2023-11-18T20:36:01.916 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/158 2023-11-18T20:36:01.979 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/158 2023-11-18T20:36:02.039 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/158 2023-11-18T20:36:02.064 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T20:36:02.121 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T20:36:02.229 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/158 2023-11-18T20:36:02.286 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/158 2023-11-18T20:36:02.331 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 50/158 2023-11-18T20:36:02.334 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T20:36:02.334 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-18T20:36:02.334 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-18T20:36:02.334 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T20:36:02.459 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/158 2023-11-18T20:36:02.553 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 52/158 2023-11-18T20:36:02.611 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/158 2023-11-18T20:36:02.636 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/158 2023-11-18T20:36:02.795 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 55/158 2023-11-18T20:36:02.863 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 56/158 2023-11-18T20:36:02.932 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/158 2023-11-18T20:36:03.014 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/158 2023-11-18T20:36:03.290 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/158 2023-11-18T20:36:03.359 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/158 2023-11-18T20:36:03.532 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/158 2023-11-18T20:36:03.586 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/158 2023-11-18T20:36:03.611 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/158 2023-11-18T20:36:03.649 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/158 2023-11-18T20:36:03.693 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/158 2023-11-18T20:36:03.729 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/158 2023-11-18T20:36:03.772 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 67/158 2023-11-18T20:36:03.854 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/158 2023-11-18T20:36:03.939 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/158 2023-11-18T20:36:03.998 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/158 2023-11-18T20:36:04.039 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/158 2023-11-18T20:36:04.165 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/158 2023-11-18T20:36:04.209 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/158 2023-11-18T20:36:04.245 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/158 2023-11-18T20:36:04.297 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/158 2023-11-18T20:36:04.339 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/158 2023-11-18T20:36:04.483 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/158 2023-11-18T20:36:04.529 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/158 2023-11-18T20:36:04.672 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/158 2023-11-18T20:36:04.737 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/158 2023-11-18T20:36:05.661 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/158 2023-11-18T20:36:06.350 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/158 2023-11-18T20:36:06.350 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/158 2023-11-18T20:36:06.350 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/158 2023-11-18T20:36:06.350 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/158 2023-11-18T20:36:06.350 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/158 2023-11-18T20:36:06.350 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/158 2023-11-18T20:36:07.056 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/158 2023-11-18T20:36:07.220 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/158 2023-11-18T20:36:08.821 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/158 2023-11-18T20:36:08.910 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/158 2023-11-18T20:36:08.947 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/158 2023-11-18T20:36:08.978 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : jq-1.6-16.el9.x86_64 93/158 2023-11-18T20:36:09.021 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/158 2023-11-18T20:36:09.064 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 95/158 2023-11-18T20:36:09.466 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/158 2023-11-18T20:36:09.500 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T20:36:09.609 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T20:36:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/158 2023-11-18T20:36:09.685 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/158 2023-11-18T20:36:10.196 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T20:36:10.227 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T20:36:10.312 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T20:36:10.338 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/158 2023-11-18T20:36:12.902 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T20:36:12.951 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T20:36:13.593 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T20:36:13.646 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T20:36:13.849 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T20:36:13.849 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-18T20:36:13.849 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-18T20:36:13.849 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:13.888 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T20:36:15.085 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T20:36:15.085 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2023-11-18T20:36:15.085 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2023-11-18T20:36:15.085 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2023-11-18T20:36:15.085 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2023-11-18T20:36:15.085 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2023-11-18T20:36:15.085 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2023-11-18T20:36:15.085 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2023-11-18T20:36:15.086 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:15.309 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T20:36:15.368 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T20:36:15.368 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:15.369 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-18T20:36:15.369 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:17.130 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T20:36:17.214 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T20:36:17.214 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:17.214 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-18T20:36:17.215 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T20:36:17.215 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T20:36:17.215 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:17.455 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T20:36:17.535 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T20:36:17.536 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:17.536 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-18T20:36:17.536 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T20:36:17.536 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T20:36:17.536 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:18.022 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T20:36:18.119 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T20:36:18.120 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:18.120 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-18T20:36:18.120 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T20:36:18.120 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T20:36:18.120 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:18.249 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.2-8.el9.noarch 110/158 2023-11-18T20:36:19.055 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T20:36:19.092 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T20:36:19.143 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 112/158 2023-11-18T20:36:19.243 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 113/158 2023-11-18T20:36:19.271 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T20:36:19.592 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T20:36:19.638 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T20:36:20.772 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T20:36:20.805 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T20:36:20.947 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T20:36:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 117/158 2023-11-18T20:36:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T20:36:21.309 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T20:36:21.309 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:21.309 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-18T20:36:21.309 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T20:36:21.309 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T20:36:21.309 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:21.367 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T20:36:21.410 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T20:36:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/158 2023-11-18T20:36:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-45.el9.x86_64 121/158 2023-11-18T20:36:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T20:36:22.521 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T20:36:22.521 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:22.521 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-18T20:36:22.521 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T20:36:22.521 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T20:36:22.521 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:22.578 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T20:36:22.659 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T20:36:22.659 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:22.659 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-18T20:36:22.659 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T20:36:22.847 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T20:36:22.847 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:22.847 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-18T20:36:22.848 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T20:36:22.848 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T20:36:22.848 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:23.237 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T20:36:23.311 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T20:36:23.311 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:23.311 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-18T20:36:23.311 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T20:36:23.312 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T20:36:23.312 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:26.577 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T20:36:26.578 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2023-11-18T20:36:26.578 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2023-11-18T20:36:26.578 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2023-11-18T20:36:26.578 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2023-11-18T20:36:26.578 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2023-11-18T20:36:26.578 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /root 2023-11-18T20:36:26.578 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2023-11-18T20:36:26.578 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:26.790 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T20:36:26.840 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T20:36:26.840 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:26.840 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-18T20:36:26.840 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:27.488 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/158 2023-11-18T20:36:27.546 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 127/158 2023-11-18T20:36:27.608 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/158 2023-11-18T20:36:27.644 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 129/158 2023-11-18T20:36:27.910 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 130/158 2023-11-18T20:36:28.036 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 131/158 2023-11-18T20:36:28.065 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 132/158 2023-11-18T20:36:28.098 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 133/158 2023-11-18T20:36:28.130 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 134/158 2023-11-18T20:36:28.174 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 135/158 2023-11-18T20:36:28.297 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 136/158 2023-11-18T20:36:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T20:36:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/158 2023-11-18T20:36:28.577 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T20:36:28.668 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T20:36:28.668 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:28.669 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-18T20:36:28.669 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T20:36:28.669 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T20:36:28.669 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:28.910 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T20:36:28.987 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T20:36:28.987 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:28.987 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-18T20:36:28.988 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T20:36:28.988 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T20:36:28.988 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:29.536 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T20:36:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T20:36:29.611 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T20:36:29.611 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:29.611 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-18T20:36:29.611 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T20:36:29.612 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T20:36:29.612 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T20:36:29.694 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T20:36:29.738 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : automake-1.16.2-8.el9.noarch 110/158 2023-11-18T20:36:29.759 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 140/158 2023-11-18T20:36:30.443 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T20:36:30.509 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T20:36:30.558 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 112/158 2023-11-18T20:36:30.660 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 113/158 2023-11-18T20:36:30.693 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T20:36:31.020 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T20:36:31.052 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T20:36:31.133 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 141/158 2023-11-18T20:36:31.222 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 142/158 2023-11-18T20:36:31.270 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 143/158 2023-11-18T20:36:31.405 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.4-9.el9.x86_64 144/158 2023-11-18T20:36:31.449 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.7.4-5.el9.x86_64 145/158 2023-11-18T20:36:31.499 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T20:36:31.534 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 147/158 2023-11-18T20:36:31.576 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 148/158 2023-11-18T20:36:31.576 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T20:36:31.741 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T20:36:31.781 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 150/158 2023-11-18T20:36:31.812 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 151/158 2023-11-18T20:36:31.879 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 152/158 2023-11-18T20:36:31.919 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T20:36:31.920 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T20:36:32.158 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T20:36:32.194 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T20:36:32.254 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T20:36:32.254 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T20:36:32.339 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T20:36:32.392 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T20:36:32.432 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 155/158 2023-11-18T20:36:32.432 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T20:36:32.510 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 117/158 2023-11-18T20:36:32.546 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T20:36:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T20:36:32.629 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T20:36:32.629 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:32.629 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-18T20:36:32.629 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T20:36:32.630 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T20:36:32.630 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 157/158 2023-11-18T20:36:32.697 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T20:36:32.738 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T20:36:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T20:36:32.867 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/158 2023-11-18T20:36:33.074 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T20:36:33.074 INFO:teuthology.orchestra.run.smithi132.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-18T20:36:33.075 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:33.792 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libtool-2.4.6-45.el9.x86_64 121/158 2023-11-18T20:36:33.823 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T20:36:33.899 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T20:36:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-18T20:36:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T20:36:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T20:36:33.899 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:33.949 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T20:36:34.024 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T20:36:34.024 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:34.024 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-18T20:36:34.025 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:34.113 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T20:36:34.193 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T20:36:34.193 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:34.193 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-18T20:36:34.193 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T20:36:34.193 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T20:36:34.193 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:34.584 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T20:36:34.662 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T20:36:34.663 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T20:36:34.663 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-18T20:36:34.663 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T20:36:34.663 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T20:36:34.663 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T20:36:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 14/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 16/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 17/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 18/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 19/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 20/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 21/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 22/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/158 2023-11-18T20:36:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/158 2023-11-18T20:36:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/158 2023-11-18T20:36:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 28/158 2023-11-18T20:36:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 29/158 2023-11-18T20:36:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 30/158 2023-11-18T20:36:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 31/158 2023-11-18T20:36:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 32/158 2023-11-18T20:36:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 33/158 2023-11-18T20:36:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 34/158 2023-11-18T20:36:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 35/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 36/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 37/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 38/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/158 2023-11-18T20:36:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.6-16.el9.x86_64 47/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/158 2023-11-18T20:36:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/158 2023-11-18T20:36:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/158 2023-11-18T20:36:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/158 2023-11-18T20:36:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/158 2023-11-18T20:36:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/158 2023-11-18T20:36:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/158 2023-11-18T20:36:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/158 2023-11-18T20:36:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/158 2023-11-18T20:36:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/158 2023-11-18T20:36:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/158 2023-11-18T20:36:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/158 2023-11-18T20:36:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/158 2023-11-18T20:36:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/158 2023-11-18T20:36:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/158 2023-11-18T20:36:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/158 2023-11-18T20:36:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/158 2023-11-18T20:36:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/158 2023-11-18T20:36:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/158 2023-11-18T20:36:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/158 2023-11-18T20:36:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/158 2023-11-18T20:36:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/158 2023-11-18T20:36:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/158 2023-11-18T20:36:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/158 2023-11-18T20:36:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/158 2023-11-18T20:36:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/158 2023-11-18T20:36:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/158 2023-11-18T20:36:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/158 2023-11-18T20:36:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 133/158 2023-11-18T20:36:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/158 2023-11-18T20:36:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 135/158 2023-11-18T20:36:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/158 2023-11-18T20:36:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T20:36:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/158 2023-11-18T20:36:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/158 2023-11-18T20:36:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/158 2023-11-18T20:36:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/158 2023-11-18T20:36:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/158 2023-11-18T20:36:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/158 2023-11-18T20:36:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/158 2023-11-18T20:36:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/158 2023-11-18T20:36:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T20:36:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/158 2023-11-18T20:36:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/158 2023-11-18T20:36:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/158 2023-11-18T20:36:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/158 2023-11-18T20:36:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/158 2023-11-18T20:36:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/158 2023-11-18T20:36:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/158 2023-11-18T20:36:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/158 2023-11-18T20:36:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/158 2023-11-18T20:36:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/158 2023-11-18T20:36:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/158 2023-11-18T20:36:38.842 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/158 2023-11-18T20:36:38.907 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 127/158 2023-11-18T20:36:38.970 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/158 2023-11-18T20:36:39.006 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 129/158 2023-11-18T20:36:39.316 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 130/158 2023-11-18T20:36:39.480 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 131/158 2023-11-18T20:36:39.517 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 132/158 2023-11-18T20:36:39.560 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 133/158 2023-11-18T20:36:39.600 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 134/158 2023-11-18T20:36:39.639 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 135/158 2023-11-18T20:36:39.784 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 136/158 2023-11-18T20:36:39.846 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T20:36:39.863 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T20:36:39.863 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:39.863 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2023-11-18T20:36:39.863 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-18T20:36:39.863 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: acl-2.3.1-4.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-18T20:36:39.864 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.2-8.el9.noarch 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.7.4-5.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.865 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.866 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.4-9.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.6-16.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-18T20:36:39.867 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-18T20:36:39.868 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-18T20:36:39.869 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-13.11-1.el9.x86_64 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.870 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-18T20:36:39.871 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-18T20:36:39.872 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.873 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-18T20:36:39.874 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-18T20:36:39.875 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-18T20:36:39.876 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-18T20:36:39.876 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:39.876 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-11-18T20:36:39.887 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/158 2023-11-18T20:36:40.465 DEBUG:teuthology.parallel:result is None 2023-11-18T20:36:40.911 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T20:36:40.960 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T20:36:41.016 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T20:36:41.087 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 140/158 2023-11-18T20:36:42.458 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 141/158 2023-11-18T20:36:42.541 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 142/158 2023-11-18T20:36:42.594 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 143/158 2023-11-18T20:36:42.737 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flex-2.6.4-9.el9.x86_64 144/158 2023-11-18T20:36:42.777 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : bison-3.7.4-5.el9.x86_64 145/158 2023-11-18T20:36:42.810 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T20:36:42.844 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 147/158 2023-11-18T20:36:42.885 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 148/158 2023-11-18T20:36:42.885 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T20:36:43.052 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T20:36:43.096 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 150/158 2023-11-18T20:36:43.131 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 151/158 2023-11-18T20:36:43.164 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 152/158 2023-11-18T20:36:43.206 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T20:36:43.206 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T20:36:43.539 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T20:36:43.539 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T20:36:43.695 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T20:36:43.725 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 155/158 2023-11-18T20:36:43.726 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T20:36:43.889 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T20:36:43.928 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 157/158 2023-11-18T20:36:44.088 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T20:36:44.360 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T20:36:44.360 INFO:teuthology.orchestra.run.smithi161.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-18T20:36:44.360 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:48.820 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/158 2023-11-18T20:36:48.820 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T20:36:48.821 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 14/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 16/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 17/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 18/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 19/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 20/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 21/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 22/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/158 2023-11-18T20:36:48.822 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 28/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 29/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 30/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 31/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 32/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 33/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 34/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 35/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 36/158 2023-11-18T20:36:48.823 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 37/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 38/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : jq-1.6-16.el9.x86_64 47/158 2023-11-18T20:36:48.824 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/158 2023-11-18T20:36:48.825 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/158 2023-11-18T20:36:48.826 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/158 2023-11-18T20:36:48.827 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/158 2023-11-18T20:36:48.828 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/158 2023-11-18T20:36:48.829 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/158 2023-11-18T20:36:48.830 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/158 2023-11-18T20:36:48.831 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 133/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 135/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/158 2023-11-18T20:36:48.832 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/158 2023-11-18T20:36:48.833 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/158 2023-11-18T20:36:48.834 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/158 2023-11-18T20:36:48.834 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/158 2023-11-18T20:36:48.834 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/158 2023-11-18T20:36:48.834 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/158 2023-11-18T20:36:48.834 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/158 2023-11-18T20:36:51.058 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T20:36:51.058 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:51.058 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-11-18T20:36:51.058 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-18T20:36:51.058 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-18T20:36:51.058 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: acl-2.3.1-4.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-11-18T20:36:51.059 INFO:teuthology.orchestra.run.smithi161.stdout: automake-1.16.2-8.el9.noarch 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: bison-3.7.4-5.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.060 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.061 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: flex-2.6.4-9.el9.x86_64 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-18T20:36:51.062 INFO:teuthology.orchestra.run.smithi161.stdout: jq-1.6-16.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-18T20:36:51.063 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-18T20:36:51.064 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-13.11-1.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.065 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-18T20:36:51.066 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-18T20:36:51.067 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply-3.11-14.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-18T20:36:51.068 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-18T20:36:51.069 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: re2-1:20211101-3.el9.x86_64 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-18T20:36:51.070 INFO:teuthology.orchestra.run.smithi161.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-18T20:36:51.071 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-18T20:36:51.071 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-18T20:36:51.071 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-18T20:36:51.071 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:51.071 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-11-18T20:36:51.630 DEBUG:teuthology.parallel:result is None 2023-11-18T20:36:51.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:36:51.846 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-18T20:36:51.922 INFO:teuthology.orchestra.run.smithi132.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-18T20:36:51.923 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-18T20:36:51.923 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-18T20:36:51.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:36:52.064 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-18T20:36:52.122 INFO:teuthology.orchestra.run.smithi161.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-18T20:36:52.122 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-18T20:36:52.123 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-18T20:36:52.123 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-18T20:36:52.123 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:52.123 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-18T20:36:52.229 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:36:52.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-18T20:36:52.306 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-18T20:36:52.306 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:52.306 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2023-11-18T20:36:52.407 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-18T20:36:52.549 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:36:52.549 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2023-11-18T20:36:52.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-18T20:36:52.755 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-18T20:36:52.756 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:52.756 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-18T20:36:52.859 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-18T20:36:53.001 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:36:53.001 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-18T20:36:53.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-18T20:36:53.202 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-18T20:36:53.202 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:53.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2023-11-18T20:36:53.304 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-18T20:36:53.399 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:36:53.400 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2023-11-18T20:36:53.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-18T20:36:53.596 INFO:teuthology.run_tasks:Running task ceph... 2023-11-18T20:36:53.660 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-18T20:36:53.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2023-11-18T20:36:53.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2023-11-18T20:36:53.759 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-18T20:36:53.759 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-18T20:36:53.767 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-18T20:36:53.853 INFO:tasks.ceph:Creating extra log directories... 2023-11-18T20:36:53.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-18T20:36:53.859 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-18T20:36:53.953 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-18T20:36:53.953 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-18T20:36:53.953 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-18T20:36:53.953 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:53.953 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-18T20:36:54.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-18T20:36:54.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-18T20:36:54.383 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:36:54.383 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-18T20:36:54.428 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-18T20:36:54.692 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-18T20:36:54.798 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-18T20:36:54.798 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-18T20:36:54.798 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682', 'branch': 'main', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7461682', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1491, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGHNCsE/hMP4Z1e5fz/OFpk7lD0+VWm60K6F7YxqW1PD4pPALKB7KefvLQraYkThox8QYUuy8BLa5Hp7SagY90=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEr+o5/Q+SkrhSr4srh7gdRmgus5bo0IggXPhv9qxBtdqH62nOZQauKLok2v2nowcpVx/mjawE98Ujj6qlYG29M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-18_13:51:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-18T20:36:54.799 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-18T20:36:54.808 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-18T20:36:54.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2023-11-18T20:36:54.866 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2023-11-18T20:36:54.971 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:54.971 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2023-11-18T20:36:55.024 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-18T20:36:55.024 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2023-11-18T20:36:55.074 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-18T20:36:55.074 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:36:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-11-18T20:36:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:36:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T20:36:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-11-18 20:36:33.538172425 +0000 2023-11-18T20:36:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-11-18 20:34:13.094484723 +0000 2023-11-18T20:36:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-11-18 20:34:13.094484723 +0000 2023-11-18T20:36:55.075 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-11-18 20:34:13.094484723 +0000 2023-11-18T20:36:55.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-18T20:36:55.164 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-11-18T20:36:55.164 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-11-18T20:36:55.164 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000302384 s, 1.7 MB/s 2023-11-18T20:36:55.168 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-18T20:36:55.223 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2023-11-18T20:36:55.272 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-18T20:36:55.272 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:36:55.273 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-11-18T20:36:55.273 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:36:55.273 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T20:36:55.273 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-11-18 20:36:33.539172400 +0000 2023-11-18T20:36:55.273 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-11-18 20:34:14.054460077 +0000 2023-11-18T20:36:55.273 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-11-18 20:34:14.054460077 +0000 2023-11-18T20:36:55.274 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-11-18 20:34:14.054460077 +0000 2023-11-18T20:36:55.274 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-18T20:36:55.363 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-11-18T20:36:55.364 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-11-18T20:36:55.364 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000305665 s, 1.7 MB/s 2023-11-18T20:36:55.367 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-18T20:36:55.426 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2023-11-18T20:36:55.478 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-18T20:36:55.478 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:36:55.478 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-11-18T20:36:55.478 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:36:55.479 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T20:36:55.479 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-11-18 20:36:33.540172374 +0000 2023-11-18T20:36:55.479 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-11-18 20:34:15.034434917 +0000 2023-11-18T20:36:55.479 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-11-18 20:34:15.034434917 +0000 2023-11-18T20:36:55.479 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-11-18 20:34:15.034434917 +0000 2023-11-18T20:36:55.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-18T20:36:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-11-18T20:36:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-11-18T20:36:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000333959 s, 1.5 MB/s 2023-11-18T20:36:55.570 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-18T20:36:55.629 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2023-11-18T20:36:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-18T20:36:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:36:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-11-18T20:36:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:36:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T20:36:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-11-18 20:36:33.540172374 +0000 2023-11-18T20:36:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-11-18 20:34:16.055408706 +0000 2023-11-18T20:36:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-11-18 20:34:16.055408706 +0000 2023-11-18T20:36:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-11-18 20:34:16.055408706 +0000 2023-11-18T20:36:55.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-18T20:36:55.758 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-11-18T20:36:55.758 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-11-18T20:36:55.759 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000323285 s, 1.6 MB/s 2023-11-18T20:36:55.761 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-18T20:36:55.813 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:36:55.813 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:36:55.813 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2023-11-18T20:36:55.875 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-18T20:36:55.875 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2023-11-18T20:36:55.928 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-18T20:36:55.928 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:36:55.929 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-11-18T20:36:55.929 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:36:55.929 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T20:36:55.929 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-11-18 20:36:44.837473868 +0000 2023-11-18T20:36:55.929 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-11-18 20:34:13.111572382 +0000 2023-11-18T20:36:55.929 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-11-18 20:34:13.112572378 +0000 2023-11-18T20:36:55.929 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-11-18 20:34:13.111572382 +0000 2023-11-18T20:36:55.929 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-18T20:36:56.019 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-11-18T20:36:56.019 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-11-18T20:36:56.019 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000423003 s, 1.2 MB/s 2023-11-18T20:36:56.022 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-18T20:36:56.079 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2023-11-18T20:36:56.130 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-18T20:36:56.130 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:36:56.130 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-11-18T20:36:56.130 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:36:56.130 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T20:36:56.130 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-11-18 20:36:44.838473863 +0000 2023-11-18T20:36:56.131 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-11-18 20:34:14.091567784 +0000 2023-11-18T20:36:56.131 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-11-18 20:34:14.091567784 +0000 2023-11-18T20:36:56.131 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-11-18 20:34:14.091567784 +0000 2023-11-18T20:36:56.131 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-18T20:36:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-11-18T20:36:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-11-18T20:36:56.215 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000533951 s, 959 kB/s 2023-11-18T20:36:56.218 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-18T20:36:56.273 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2023-11-18T20:36:56.323 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-18T20:36:56.323 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:36:56.323 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-11-18T20:36:56.323 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:36:56.323 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T20:36:56.324 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-11-18 20:36:44.838473863 +0000 2023-11-18T20:36:56.324 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-11-18 20:34:15.123562943 +0000 2023-11-18T20:36:56.324 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-11-18 20:34:15.123562943 +0000 2023-11-18T20:36:56.324 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-11-18 20:34:15.123562943 +0000 2023-11-18T20:36:56.324 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-18T20:36:56.402 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-11-18T20:36:56.403 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-11-18T20:36:56.403 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000757522 s, 676 kB/s 2023-11-18T20:36:56.405 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-18T20:36:56.451 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2023-11-18T20:36:56.544 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-18T20:36:56.544 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:36:56.544 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-11-18T20:36:56.544 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:36:56.544 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T20:36:56.544 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-11-18 20:36:44.839473859 +0000 2023-11-18T20:36:56.544 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-11-18 20:34:16.113558299 +0000 2023-11-18T20:36:56.544 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-11-18 20:34:16.113558299 +0000 2023-11-18T20:36:56.545 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-11-18 20:34:16.113558299 +0000 2023-11-18T20:36:56.545 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-18T20:36:56.624 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-11-18T20:36:56.624 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-11-18T20:36:56.624 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000287455 s, 1.8 MB/s 2023-11-18T20:36:56.627 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-18T20:36:56.672 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:36:56.672 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-18T20:36:56.672 INFO:tasks.ceph:Generating config... 2023-11-18T20:36:56.673 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-18T20:36:56.673 INFO:tasks.ceph:[client] debug client = 20 2023-11-18T20:36:56.673 INFO:tasks.ceph:[client] debug ms = 1 2023-11-18T20:36:56.674 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-18T20:36:56.674 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-18T20:36:56.674 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-18T20:36:56.674 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-18T20:36:56.675 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-18T20:36:56.675 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-18T20:36:56.675 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-18T20:36:56.675 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-18T20:36:56.675 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-18T20:36:56.675 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-18T20:36:56.675 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-18T20:36:56.675 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-18T20:36:56.675 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-18T20:36:56.675 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-18T20:36:56.675 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-18T20:36:56.675 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-18T20:36:56.675 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-18T20:36:56.676 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-18T20:36:56.676 INFO:tasks.ceph:Setting up mon.a... 2023-11-18T20:36:56.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-18T20:36:56.834 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.keyring 2023-11-18T20:36:56.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-18T20:36:56.972 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T20:36:57.066 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.132'), ('mon.b', '172.21.15.161'), ('mon.c', '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]')] 2023-11-18T20:36:57.067 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.132,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-18T20:36:57.068 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:57.068 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-18T20:36:57.119 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.132 --add b 172.21.15.161 --addv c '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: generated fsid 95273225-bfbe-4b9a-893d-dfaf6292d673 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:setting min_mon_release = pacific 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:epoch 0 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:fsid 95273225-bfbe-4b9a-893d-dfaf6292d673 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:last_changed 2023-11-18T20:36:57.273793+0000 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:created 2023-11-18T20:36:57.273793+0000 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:min_mon_release 16 (pacific) 2023-11-18T20:36:57.274 INFO:teuthology.orchestra.run.smithi132.stdout:election_strategy: 1 2023-11-18T20:36:57.275 INFO:teuthology.orchestra.run.smithi132.stdout:0: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.a 2023-11-18T20:36:57.275 INFO:teuthology.orchestra.run.smithi132.stdout:1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2023-11-18T20:36:57.275 INFO:teuthology.orchestra.run.smithi132.stdout:2: [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] mon.c 2023-11-18T20:36:57.275 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-18T20:36:57.277 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-18T20:36:57.328 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 95273225-bfbe-4b9a-893d-dfaf6292d673... 2023-11-18T20:36:57.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-18T20:36:57.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-18T20:36:57.498 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2023-11-18T20:36:57.499 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2023-11-18T20:36:57.499 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-18T20:36:57.499 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2023-11-18T20:36:57.499 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.499 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2023-11-18T20:36:57.499 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.500 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2023-11-18T20:36:57.500 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.500 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2023-11-18T20:36:57.500 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2023-11-18T20:36:57.500 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.500 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2023-11-18T20:36:57.501 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2023-11-18T20:36:57.501 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.501 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-18T20:36:57.501 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2023-11-18T20:36:57.501 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.501 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2023-11-18T20:36:57.501 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-18T20:36:57.502 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.502 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2023-11-18T20:36:57.502 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.502 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2023-11-18T20:36:57.502 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2023-11-18T20:36:57.502 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2023-11-18T20:36:57.503 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2023-11-18T20:36:57.503 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2023-11-18T20:36:57.503 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2023-11-18T20:36:57.503 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2023-11-18T20:36:57.503 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-18T20:36:57.503 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-18T20:36:57.503 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2023-11-18T20:36:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-18T20:36:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2023-11-18T20:36:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2023-11-18T20:36:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2023-11-18T20:36:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2023-11-18T20:36:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2023-11-18T20:36:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.132,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-11-18T20:36:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on skipped message = False 2023-11-18T20:36:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 95273225-bfbe-4b9a-893d-dfaf6292d673 2023-11-18T20:36:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.505 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2023-11-18T20:36:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2023-11-18T20:36:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2023-11-18T20:36:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2023-11-18T20:36:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2023-11-18T20:36:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2023-11-18T20:36:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2023-11-18T20:36:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2023-11-18T20:36:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2023-11-18T20:36:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2023-11-18T20:36:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug trim objects = true 2023-11-18T20:36:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2023-11-18T20:36:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2023-11-18T20:36:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2023-11-18T20:36:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2023-11-18T20:36:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2023-11-18T20:36:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2023-11-18T20:36:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2023-11-18T20:36:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2023-11-18T20:36:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2023-11-18T20:36:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2023-11-18T20:36:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2023-11-18T20:36:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-18T20:36:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2023-11-18T20:36:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2023-11-18T20:36:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2023-11-18T20:36:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2023-11-18T20:36:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2023-11-18T20:36:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2023-11-18T20:36:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2023-11-18T20:36:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-11-18T20:36:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.512 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2023-11-18T20:36:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-18T20:36:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2023-11-18T20:36:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-11-18T20:36:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-11-18T20:36:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-11-18T20:36:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-11-18T20:36:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2023-11-18T20:36:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.513 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2023-11-18T20:36:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-18T20:36:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-11-18T20:36:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2023-11-18T20:36:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-11-18T20:36:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2023-11-18T20:36:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2023-11-18T20:36:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-11-18T20:36:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2023-11-18T20:36:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2023-11-18T20:36:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-11-18T20:36:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-18T20:36:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2023-11-18T20:36:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2023-11-18T20:36:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2023-11-18T20:36:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-18T20:36:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-18T20:36:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2023-11-18T20:36:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2023-11-18T20:36:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2023-11-18T20:36:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2023-11-18T20:36:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-18T20:36:57.517 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2023-11-18T20:36:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2023-11-18T20:36:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2023-11-18T20:36:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2023-11-18T20:36:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-18T20:36:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-18T20:36:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2023-11-18T20:36:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2023-11-18T20:36:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-18T20:36:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-11-18T20:36:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-11-18T20:36:57.519 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2023-11-18T20:36:57.519 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2023-11-18T20:36:57.519 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2023-11-18T20:36:57.519 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-11-18T20:36:57.519 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-11-18T20:36:57.519 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-11-18T20:36:57.519 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-11-18T20:36:57.520 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2023-11-18T20:36:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2023-11-18T20:36:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2023-11-18T20:36:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-18T20:36:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2023-11-18T20:36:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2023-11-18T20:36:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2023-11-18T20:36:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2023-11-18T20:36:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-11-18T20:36:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-11-18T20:36:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-11-18T20:36:57.521 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2023-11-18T20:36:57.522 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2023-11-18T20:36:57.522 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-18T20:36:57.522 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2023-11-18T20:36:57.522 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.522 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2023-11-18T20:36:57.522 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.523 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2023-11-18T20:36:57.524 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2023-11-18T20:36:57.525 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.132,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on skipped message = False 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 95273225-bfbe-4b9a-893d-dfaf6292d673 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.526 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.527 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2023-11-18T20:36:57.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2023-11-18T20:36:57.529 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-11-18T20:36:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2023-11-18T20:36:57.531 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-18T20:36:57.532 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-18T20:36:57.533 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-11-18T20:36:57.534 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-11-18T20:36:57.535 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-11-18T20:36:57.551 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-18T20:36:57.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-18T20:36:57.691 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-18T20:36:57.692 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:57.692 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-18T20:36:57.746 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:57.746 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-18T20:36:57.798 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:36:57.798 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:57.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-18T20:36:57.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T20:36:57.947 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:36:57.947 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:36:58.048 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:36:58.048 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:36:58.048 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-18T20:36:58.048 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T20:36:58.205 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:36:58.205 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:36:58.303 INFO:tasks.ceph:Setting up mon nodes... 2023-11-18T20:36:58.303 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-18T20:36:58.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-18T20:36:58.496 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-18T20:36:58.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-18T20:36:58.710 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-18T20:36:58.721 INFO:tasks.ceph:Setting up mds nodes... 2023-11-18T20:36:58.721 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-18T20:36:58.908 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-18T20:36:58.918 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-18T20:36:59.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-18T20:36:59.178 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-18T20:36:59.187 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-18T20:36:59.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-18T20:36:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-18T20:36:59.482 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-18T20:36:59.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-18T20:36:59.754 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-18T20:36:59.764 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-18T20:36:59.860 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-18T20:36:59.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-18T20:36:59.995 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-18T20:37:00.053 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-18T20:37:00.187 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-18T20:37:00.245 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-18T20:37:00.245 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-18T20:37:00.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-18T20:37:00.347 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:37:00.347 INFO:tasks.ceph:role: osd.0 2023-11-18T20:37:00.347 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:37:00.347 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-18T20:37:00.449 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:37:00.449 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:37:00.449 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:37:00.449 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T20:37:00.450 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:37:00.450 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:37:00.450 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:37:00.450 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T20:37:00.450 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:37:00.451 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:37:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-11-18T20:37:00.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-11-18T20:37:00.976 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-18T20:37:01.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-18T20:37:01.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-18T20:37:01.344 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:37:01.344 INFO:tasks.ceph:role: osd.1 2023-11-18T20:37:01.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:37:01.344 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-18T20:37:01.440 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:37:01.440 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:37:01.440 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:37:01.440 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T20:37:01.440 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:37:01.440 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:37:01.440 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:37:01.440 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T20:37:01.441 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:37:01.441 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:37:01.905 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-11-18T20:37:01.910 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-11-18T20:37:01.910 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-18T20:37:02.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-18T20:37:02.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-18T20:37:02.207 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:37:02.207 INFO:tasks.ceph:role: osd.2 2023-11-18T20:37:02.207 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:37:02.208 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-18T20:37:02.289 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:37:02.290 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:37:02.799 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-11-18T20:37:02.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-11-18T20:37:02.805 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-18T20:37:02.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-18T20:37:03.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-18T20:37:03.138 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:37:03.139 INFO:tasks.ceph:role: osd.3 2023-11-18T20:37:03.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:37:03.139 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-18T20:37:03.237 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:37:03.237 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:37:03.237 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:37:03.237 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T20:37:03.237 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:37:03.238 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:37:03.238 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:37:03.238 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T20:37:03.238 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:37:03.238 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:37:03.693 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-11-18T20:37:03.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-11-18T20:37:03.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-18T20:37:03.823 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-18T20:37:03.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:04.048+0000 7f6f7da0e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-18T20:37:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:04.049+0000 7f6f7da0e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-18T20:37:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:04.049+0000 7f6f7da0e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T20:37:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:04.049+0000 7f6f7da0e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T20:37:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:04.049+0000 7f6f7da0e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T20:37:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:04.052+0000 7f6f7da0e500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-18T20:37:07.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-18T20:37:07.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:07.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:07.242+0000 7fc836a05500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-18T20:37:07.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:07.242+0000 7fc836a05500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-18T20:37:07.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:07.242+0000 7fc836a05500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T20:37:07.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:07.242+0000 7fc836a05500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T20:37:07.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:07.242+0000 7fc836a05500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T20:37:07.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:07.244+0000 7fc836a05500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-18T20:37:10.403 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-18T20:37:10.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:10.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:10.642+0000 7fc9b6d37500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-18T20:37:10.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:10.643+0000 7fc9b6d37500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-18T20:37:10.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:10.643+0000 7fc9b6d37500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T20:37:10.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:10.643+0000 7fc9b6d37500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T20:37:10.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:10.643+0000 7fc9b6d37500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T20:37:10.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:10.645+0000 7fc9b6d37500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-18T20:37:13.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-18T20:37:13.687 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:13.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:13.827+0000 7fe718418500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-18T20:37:13.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:13.827+0000 7fe718418500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-18T20:37:13.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:13.827+0000 7fe718418500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T20:37:13.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:13.827+0000 7fe718418500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T20:37:13.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:13.827+0000 7fe718418500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T20:37:13.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:13.829+0000 7fe718418500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-18T20:37:16.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-18T20:37:16.838 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-18T20:37:16.942 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:37:16.943 INFO:tasks.ceph:role: osd.4 2023-11-18T20:37:16.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:37:16.943 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:37:17.043 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:37:17.559 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-11-18T20:37:17.566 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-11-18T20:37:17.566 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-18T20:37:17.756 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-18T20:37:17.852 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-18T20:37:17.943 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:37:17.943 INFO:tasks.ceph:role: osd.5 2023-11-18T20:37:17.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:37:17.943 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-18T20:37:18.045 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:37:18.046 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:37:18.523 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-11-18T20:37:18.529 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-11-18T20:37:18.529 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-18T20:37:18.667 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-18T20:37:18.764 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-18T20:37:18.853 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:37:18.853 INFO:tasks.ceph:role: osd.6 2023-11-18T20:37:18.853 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:37:18.854 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-18T20:37:18.946 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:37:18.946 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:37:18.946 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:37:18.946 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T20:37:18.946 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:37:18.946 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:37:18.946 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:37:18.947 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T20:37:18.947 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:37:18.947 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:37:19.463 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-11-18T20:37:19.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-11-18T20:37:19.470 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-18T20:37:19.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-18T20:37:19.776 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-18T20:37:19.862 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:37:19.862 INFO:tasks.ceph:role: osd.7 2023-11-18T20:37:19.863 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:37:19.863 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-18T20:37:19.960 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:37:19.961 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:37:20.421 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-11-18T20:37:20.426 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-11-18T20:37:20.427 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-18T20:37:20.568 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-18T20:37:20.660 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:20.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:20.810+0000 7f349c374500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-18T20:37:20.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:20.811+0000 7f349c374500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-18T20:37:20.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:20.811+0000 7f349c374500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T20:37:20.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:20.811+0000 7f349c374500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T20:37:20.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:20.811+0000 7f349c374500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T20:37:20.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:20.815+0000 7f349c374500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-18T20:37:24.012 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-18T20:37:24.112 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:24.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:24.251+0000 7fd50ac12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-18T20:37:24.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:24.252+0000 7fd50ac12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-18T20:37:24.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:24.252+0000 7fd50ac12500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T20:37:24.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:24.252+0000 7fd50ac12500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T20:37:24.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:24.252+0000 7fd50ac12500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T20:37:24.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:24.254+0000 7fd50ac12500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-18T20:37:24.800 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:37:24.809 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:37:27.189 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-18T20:37:27.291 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:27.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:27.434+0000 7f3fcdc12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-18T20:37:27.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:27.435+0000 7f3fcdc12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-18T20:37:27.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:27.435+0000 7f3fcdc12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T20:37:27.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:27.435+0000 7f3fcdc12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T20:37:27.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:27.435+0000 7f3fcdc12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T20:37:27.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:27.437+0000 7f3fcdc12500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-18T20:37:30.608 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-18T20:37:30.703 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:30.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:30.837+0000 7fcd54825500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-18T20:37:30.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:30.838+0000 7fcd54825500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-18T20:37:30.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:30.838+0000 7fcd54825500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T20:37:30.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:30.838+0000 7fcd54825500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T20:37:30.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:30.838+0000 7fcd54825500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T20:37:30.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:30.840+0000 7fcd54825500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-18T20:37:33.774 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-18T20:37:33.874 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-18T20:37:33.874 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:33.874 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-18T20:37:33.977 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:33.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-18T20:37:34.073 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:34.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-18T20:37:34.162 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:34.162 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-18T20:37:34.252 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:34.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-18T20:37:34.393 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:34.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-18T20:37:34.493 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:34.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-18T20:37:34.586 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:34.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-18T20:37:34.691 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:34.691 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-18T20:37:34.787 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:34.787 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-18T20:37:34.885 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:34.885 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-18T20:37:34.969 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:34.969 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-18T20:37:35.112 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:35.112 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-18T20:37:35.209 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:35.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-18T20:37:35.307 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:35.308 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-18T20:37:35.365 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:35.366 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-18T20:37:35.425 INFO:tasks.ceph:Adding keys to all mons... 2023-11-18T20:37:35.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-18T20:37:35.434 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBqIFllBY6bHRAApFJ5PvprGpoejUSSP7+hHw== 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBqIFll67UuNhAAzMjJzHfHuMEnOrySo5rWkg== 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBrIFllLcurChAAvi5HiMzmlupLAkYw675TeQ== 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBwIFlloVfzAhAAR8uyp9rDYiQV+BhFjIuJvA== 2023-11-18T20:37:35.523 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBzIFlloNl8DhAAkyClLe7G9fDXgg+zgwNkWw== 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB2IFllDcRbJhAA6+fYI8hcxWhHNSpkw9vg0g== 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB5IFllOnBaMRAAvOwUIZn1Jt2tAoDiRC6Gqw== 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBqIFllWW9dKhAAdaq1Wp1/FeVlv9IGXn6EhQ== 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBrIFllppoxHBAAFb6gynzzJK+cDc3jFhAACg== 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-11-18T20:37:35.524 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBrIFllGen8LBAAHV9S4/oQnKEkxUg+grOguA== 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCAIFll5itZMBAASs5GAbUqVH0Xlrlqktz9xw== 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCEIFll5uYKDxAANaYuUAsrCvw1xO9CoKqd/A== 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCHIFllEZPyGRAASXuTF7aswO1KQfUH3BStpw== 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCKIFllDT/tMRAAh3c/95I9x0FMZGXZ//TuWw== 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBrIFllsbdTOxAAP60vfd0AqFNopXTOFb78Tw== 2023-11-18T20:37:35.525 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-11-18T20:37:35.526 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBsIFllrycwCxAAI7OVXj40YLGlQ4/hWY+mTA== 2023-11-18T20:37:35.528 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2023-11-18T20:37:35.528 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBqIFllBY6bHRAApFJ5PvprGpoejUSSP7+hHw== 2023-11-18T20:37:35.528 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-11-18T20:37:35.528 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBqIFll67UuNhAAzMjJzHfHuMEnOrySo5rWkg== 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBrIFllLcurChAAvi5HiMzmlupLAkYw675TeQ== 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBwIFlloVfzAhAAR8uyp9rDYiQV+BhFjIuJvA== 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBzIFlloNl8DhAAkyClLe7G9fDXgg+zgwNkWw== 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQB2IFllDcRbJhAA6+fYI8hcxWhHNSpkw9vg0g== 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQB5IFllOnBaMRAAvOwUIZn1Jt2tAoDiRC6Gqw== 2023-11-18T20:37:35.529 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBqIFllWW9dKhAAdaq1Wp1/FeVlv9IGXn6EhQ== 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBrIFllppoxHBAAFb6gynzzJK+cDc3jFhAACg== 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBrIFllGen8LBAAHV9S4/oQnKEkxUg+grOguA== 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCAIFll5itZMBAASs5GAbUqVH0Xlrlqktz9xw== 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCEIFll5uYKDxAANaYuUAsrCvw1xO9CoKqd/A== 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2023-11-18T20:37:35.530 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCHIFllEZPyGRAASXuTF7aswO1KQfUH3BStpw== 2023-11-18T20:37:35.531 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2023-11-18T20:37:35.531 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCKIFllDT/tMRAAh3c/95I9x0FMZGXZ//TuWw== 2023-11-18T20:37:35.531 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-11-18T20:37:35.531 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBrIFllsbdTOxAAP60vfd0AqFNopXTOFb78Tw== 2023-11-18T20:37:35.531 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2023-11-18T20:37:35.531 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBsIFllrycwCxAAI7OVXj40YLGlQ4/hWY+mTA== 2023-11-18T20:37:35.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T20:37:35.576 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T20:37:35.723 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:37:35.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:37:35.873 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:37:35.879 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:37:36.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:36.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:36.168 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:36.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:36.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:36.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:36.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:36.487 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:36.628 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T20:37:36.636 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T20:37:36.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:37:36.781 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:37:36.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:37:36.930 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:37:37.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:37.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:37.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:37.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:37.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:37.383 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:37.527 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:37.536 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:37:37.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T20:37:37.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T20:37:37.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T20:37:37.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T20:37:37.976 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-18T20:37:37.976 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-18T20:37:38.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T20:37:38.220 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-18T20:37:38.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-18T20:37:38.418 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T20:37:38.578 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-18T20:37:38.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-18T20:37:38.745 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T20:37:38.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-18T20:37:38.993 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:39.002 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:37:39.054 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-18T20:37:39.055 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-18T20:37:39.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-18T20:37:39.061 INFO:tasks.ceph.mon.a:Started 2023-11-18T20:37:39.061 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-18T20:37:39.061 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-18T20:37:39.066 INFO:tasks.ceph.mon.b:Started 2023-11-18T20:37:39.066 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-18T20:37:39.066 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-18T20:37:39.074 INFO:tasks.ceph.mon.c:Started 2023-11-18T20:37:39.074 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-18T20:37:39.074 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-18T20:37:39.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-18T20:37:39.080 INFO:tasks.ceph.mgr.y:Started 2023-11-18T20:37:39.080 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-18T20:37:39.080 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-18T20:37:39.085 INFO:tasks.ceph.mgr.x:Started 2023-11-18T20:37:39.086 INFO:tasks.ceph:Setting crush tunables to default 2023-11-18T20:37:39.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd crush tunables default 2023-11-18T20:37:39.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.262+0000 7f45c2eaf640 1 Processor -- start 2023-11-18T20:37:39.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.262+0000 7f45c2eaf640 1 -- start start 2023-11-18T20:37:39.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.263+0000 7f45c2eaf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45bc155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:39.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.263+0000 7f45c2eaf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc1556d0 con 0x7f45bc151cc0 2023-11-18T20:37:39.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45c2eaf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc154740 con 0x7f45bc0c4940 2023-11-18T20:37:39.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45c2eaf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc06c760 con 0x7f45bc0c7ec0 2023-11-18T20:37:39.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45c144c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f45bc0c4940 0x7f45bc15f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:39884/0 (socket says 172.21.15.132:39884) 2023-11-18T20:37:39.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45c0c4b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f45bc151cc0 0x7f45bc157d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33756/0 (socket says 172.21.15.132:33756) 2023-11-18T20:37:39.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45c144c640 1 -- 172.21.15.132:0/1593869948 learned_addr learned my addr 172.21.15.132:0/1593869948 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:37:39.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45bbfff640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45bc155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:39.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45bbfff640 1 -- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 msgr2=0x7f45bc155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:37:39.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45bbfff640 1 -- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 msgr2=0x7f45bc155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:37:39.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45bbfff640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45bc155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:37:39.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.264+0000 7f45bbfff640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45bc155190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:37:39.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.465+0000 7f45bbfff640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45bc155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:39.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.466+0000 7f45bbfff640 1 -- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 msgr2=0x7f45bc155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:37:39.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.466+0000 7f45bbfff640 1 -- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 msgr2=0x7f45bc155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:37:39.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.466+0000 7f45bbfff640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45bc155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:37:39.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.466+0000 7f45bbfff640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45bc155190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:37:39.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.520+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169368799 0 0) 0x7f45b0001040 con 0x7f45bc151cc0 2023-11-18T20:37:39.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.520+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45ac003520 con 0x7f45bc151cc0 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781063565 0 0) 0x7f45bc154740 con 0x7f45bc0c4940 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b0001040 con 0x7f45bc0c4940 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595726981 0 0) 0x7f45ac003520 con 0x7f45bc151cc0 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 msgr2=0x7f45bc155190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45bc155190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 >> v1:172.21.15.161:6789/0 conn(0x7f45bc0c4940 legacy=0x7f45bc15f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0c8470 con 0x7f45bc151cc0 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f45b0001730 con 0x7f45bc151cc0 2023-11-18T20:37:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.522+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 >> v1:172.21.15.132:6789/0 conn(0x7f45bc151cc0 legacy=0x7f45bc157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.523+0000 7f45bb7fe640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45ac003b80 0x7f45ac003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.523+0000 7f45bb7fe640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45ac0047c0 0x7f45ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.523+0000 7f45bb7fe640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45ac005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.523+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc06c760 con 0x7f45ac003b80 2023-11-18T20:37:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.523+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac00bb40 con 0x7f45ac0047c0 2023-11-18T20:37:39.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.523+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac00bd00 con 0x7f45bc0c7ec0 2023-11-18T20:37:39.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.524+0000 7f45c0c4b640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45ac003b80 0x7f45ac003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:39.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.525+0000 7f45c144c640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45ac005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:39.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.525+0000 7f45bbfff640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45ac0047c0 0x7f45ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:39.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.525+0000 7f45c0c4b640 1 -- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 msgr2=0x7f45ac005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:39.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.525+0000 7f45c0c4b640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45bc0c7ec0 0x7f45ac005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.525+0000 7f45c0c4b640 1 -- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45ac0047c0 msgr2=0x7f45ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:39.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.525+0000 7f45c0c4b640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45ac0047c0 0x7f45ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.525+0000 7f45c0c4b640 1 -- 172.21.15.132:0/1593869948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac003520 con 0x7f45ac003b80 2023-11-18T20:37:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.529+0000 7f45c0c4b640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45ac003b80 0x7f45ac003f80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45b0007df0 tx=0x7f45ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cca9fc40253d9d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:39.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.529+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0007270 con 0x7f45ac003b80 2023-11-18T20:37:39.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.529+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b00073f0 con 0x7f45ac003b80 2023-11-18T20:37:39.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.529+0000 7f45bb7fe640 1 -- 172.21.15.132:0/1593869948 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0005810 con 0x7f45ac003b80 2023-11-18T20:37:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.531+0000 7f45c2eaf640 1 -- 172.21.15.132:0/1593869948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45ac003b80 msgr2=0x7f45ac003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.531+0000 7f45c2eaf640 1 --2- 172.21.15.132:0/1593869948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45ac003b80 0x7f45ac003f80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45b0007df0 tx=0x7f45ac0057f0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.531+0000 7f45c144c640 1 -- 172.21.15.132:0/1593869948 reap_dead start 2023-11-18T20:37:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.531+0000 7f45c2eaf640 1 -- 172.21.15.132:0/1593869948 shutdown_connections 2023-11-18T20:37:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.531+0000 7f45c2eaf640 1 -- 172.21.15.132:0/1593869948 >> 172.21.15.132:0/1593869948 conn(0x7f45bc071e10 msgr2=0x7f45bc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.531+0000 7f45c2eaf640 1 -- 172.21.15.132:0/1593869948 shutdown_connections 2023-11-18T20:37:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.532+0000 7f45c2eaf640 1 -- 172.21.15.132:0/1593869948 wait complete. 2023-11-18T20:37:39.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.536+0000 7f45c2eaf640 1 Processor -- start 2023-11-18T20:37:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.537+0000 7f45c2eaf640 1 -- start start 2023-11-18T20:37:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.539+0000 7f45c2eaf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac003b80 0x7f45bc0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c2eaf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45bc153a20 0x7f45bc0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c2eaf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45bc153ea0 0x7f45bc0aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c2eaf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc1ee310 con 0x7f45bc153ea0 2023-11-18T20:37:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c0c4b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac003b80 0x7f45bc0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c2eaf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0aef40 con 0x7f45bc153a20 2023-11-18T20:37:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c2eaf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c9a20 con 0x7f45ac003b80 2023-11-18T20:37:39.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c0c4b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac003b80 0x7f45bc0aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:58836/0 (socket says 172.21.15.132:58836) 2023-11-18T20:37:39.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c0c4b640 1 -- 172.21.15.132:0/657739033 learned_addr learned my addr 172.21.15.132:0/657739033 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:39.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45bbfff640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45bc153a20 0x7f45bc0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45c0c4b640 1 -- 172.21.15.132:0/657739033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45bc153a20 msgr2=0x7f45bc0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45c0c4b640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45bc153a20 0x7f45bc0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.540+0000 7f45c144c640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45bc153ea0 0x7f45bc0aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45c0c4b640 1 -- 172.21.15.132:0/657739033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45bc153ea0 msgr2=0x7f45bc0aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45c0c4b640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45bc153ea0 0x7f45bc0aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45c0c4b640 1 -- 172.21.15.132:0/657739033 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc1ed9b0 con 0x7f45ac003b80 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45c144c640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45bc153ea0 0x7f45bc0aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45c0c4b640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac003b80 0x7f45bc0aac80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f45b0007df0 tx=0x7f45b00019f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45b97fa640 1 -- 172.21.15.132:0/657739033 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0039070 con 0x7f45ac003b80 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45b97fa640 1 -- 172.21.15.132:0/657739033 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0007270 con 0x7f45ac003b80 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.541+0000 7f45b97fa640 1 -- 172.21.15.132:0/657739033 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b003c040 con 0x7f45ac003b80 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.542+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc1edc50 con 0x7f45ac003b80 2023-11-18T20:37:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.542+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc154320 con 0x7f45ac003b80 2023-11-18T20:37:39.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.542+0000 7f45b97fa640 1 -- 172.21.15.132:0/657739033 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f45b0032070 con 0x7f45ac003b80 2023-11-18T20:37:39.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.542+0000 7f45b97fa640 1 -- 172.21.15.132:0/657739033 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f45b002cd70 con 0x7f45ac003b80 2023-11-18T20:37:39.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.543+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc068350 con 0x7f45ac003b80 2023-11-18T20:37:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.547+0000 7f45b97fa640 1 -- 172.21.15.132:0/657739033 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f45bc1556d0 con 0x7f45ac003b80 2023-11-18T20:37:39.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.621+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f45bc068350 con 0x7f45ac003b80 2023-11-18T20:37:39.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.632+0000 7f45b97fa640 1 -- 172.21.15.132:0/657739033 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f45b0035470 con 0x7f45ac003b80 2023-11-18T20:37:39.633 INFO:teuthology.orchestra.run.smithi132.stderr:adjusted tunables profile to default 2023-11-18T20:37:39.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.633+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac003b80 msgr2=0x7f45bc0aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:39.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.633+0000 7f45c2eaf640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac003b80 0x7f45bc0aac80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f45b0007df0 tx=0x7f45b00019f0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.633+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 shutdown_connections 2023-11-18T20:37:39.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.633+0000 7f45c2eaf640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45bc153ea0 0x7f45bc0aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.633+0000 7f45c2eaf640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45bc153a20 0x7f45bc0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.633+0000 7f45c2eaf640 1 --2- 172.21.15.132:0/657739033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac003b80 0x7f45bc0aac80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:39.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.633+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 >> 172.21.15.132:0/657739033 conn(0x7f45bc071e10 msgr2=0x7f45bc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:39.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.633+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 shutdown_connections 2023-11-18T20:37:39.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:39.634+0000 7f45c2eaf640 1 -- 172.21.15.132:0/657739033 wait complete. 2023-11-18T20:37:39.653 INFO:tasks.ceph:check_enable_crimson: False 2023-11-18T20:37:39.653 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-18T20:37:39.653 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:39.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-18T20:37:39.743 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:39.743 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-18T20:37:39.872 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:39.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-18T20:37:39.947 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:37:39.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-18T20:37:40.071 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:40.071 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-18T20:37:40.099 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:40.098+0000 7f892ff7a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-18T20:37:40.161 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:40.161+0000 7f892ff7a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-18T20:37:40.163 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:40.163 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-18T20:37:40.294 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:40.294 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-18T20:37:40.374 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:37:40.374 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-18T20:37:40.393 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:40.392+0000 7fdb82e2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-18T20:37:40.453 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:40.451+0000 7fdb82e2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-18T20:37:40.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 05d22da2-1667-4cfd-bb83-e5b4e665c99e 0 2023-11-18T20:37:40.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.704+0000 7fa4f759e640 1 Processor -- start 2023-11-18T20:37:40.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.705+0000 7fa4f759e640 1 -- start start 2023-11-18T20:37:40.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.706+0000 7fa4f759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa4f8155260 0x7fa4f8072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:40.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.706+0000 7fa4f759e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f80c2800 con 0x7fa4f8071240 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.706+0000 7fa4f759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f8158570 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.706+0000 7fa4f759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f80c6980 con 0x7fa4f8155260 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.706+0000 7fa4f659c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa4f8155260 0x7fa4f8072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.706+0000 7fa4f6d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa4f80c1cb0 0x7fa4f80c20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38794/0 (socket says 172.21.15.161:38794) 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.706+0000 7fa4f6d9d640 1 -- 172.21.15.161:0/1509544483 learned_addr learned my addr 172.21.15.161:0/1509544483 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.707+0000 7fa4f659c640 1 -- 172.21.15.161:0/1509544483 >> v1:172.21.15.161:6789/0 conn(0x7fa4f80c1cb0 legacy=0x7fa4f80c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.707+0000 7fa4f5d9b640 1 -- 172.21.15.161:0/1509544483 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993280104 0 0) 0x7fa4f8158570 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.707+0000 7fa4f659c640 1 -- 172.21.15.161:0/1509544483 >> v1:172.21.15.132:6789/0 conn(0x7fa4f8071240 legacy=0x7fa4f8071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:40.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.707+0000 7fa4f659c640 1 -- 172.21.15.161:0/1509544483 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8072760 con 0x7fa4f8155260 2023-11-18T20:37:40.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.708+0000 7fa4f659c640 1 --2- 172.21.15.161:0/1509544483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f8155260 0x7fa4f8072220 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80097a0 tx=0x7fa4e802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec7e84259a35280f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.708+0000 7fa4f5d9b640 1 -- 172.21.15.161:0/1509544483 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8031830 con 0x7fa4f8155260 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.708+0000 7fa4f5d9b640 1 -- 172.21.15.161:0/1509544483 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8031990 con 0x7fa4f8155260 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.708+0000 7fa4f5d9b640 1 -- 172.21.15.161:0/1509544483 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8031d20 con 0x7fa4f8155260 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.709+0000 7fa4f759e640 1 -- 172.21.15.161:0/1509544483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f8155260 msgr2=0x7fa4f8072220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.709+0000 7fa4f759e640 1 --2- 172.21.15.161:0/1509544483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f8155260 0x7fa4f8072220 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80097a0 tx=0x7fa4e802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.709+0000 7fa4f759e640 1 -- 172.21.15.161:0/1509544483 shutdown_connections 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.709+0000 7fa4f759e640 1 --2- 172.21.15.161:0/1509544483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f8155260 0x7fa4f8072220 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.709+0000 7fa4f759e640 1 -- 172.21.15.161:0/1509544483 >> 172.21.15.161:0/1509544483 conn(0x7fa4f80a8870 msgr2=0x7fa4f80a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.709+0000 7fa4f759e640 1 -- 172.21.15.161:0/1509544483 shutdown_connections 2023-11-18T20:37:40.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.709+0000 7fa4f759e640 1 -- 172.21.15.161:0/1509544483 wait complete. 2023-11-18T20:37:40.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.711+0000 7fa4f759e640 1 Processor -- start 2023-11-18T20:37:40.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.711+0000 7fa4f759e640 1 -- start start 2023-11-18T20:37:40.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4f759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4f8071240 0x7fa4f80ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:40.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4f759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f80c1cb0 0x7fa4f814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:40.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4f759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4f8155260 0x7fa4f81ea250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:40.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4f759e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80729e0 con 0x7fa4f8071240 2023-11-18T20:37:40.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4f759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80c6160 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4f759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80ac090 con 0x7fa4f8155260 2023-11-18T20:37:40.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4effff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f80c1cb0 0x7fa4f814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:40.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4f6d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4f8155260 0x7fa4f81ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4effff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f80c1cb0 0x7fa4f814b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46740/0 (socket says 172.21.15.161:46740) 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4effff640 1 -- 172.21.15.161:0/2530023268 learned_addr learned my addr 172.21.15.161:0/2530023268 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4f659c640 1 --2- 172.21.15.161:0/2530023268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4f8071240 0x7fa4f80ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4effff640 1 -- 172.21.15.161:0/2530023268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4f8155260 msgr2=0x7fa4f81ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4effff640 1 --2- 172.21.15.161:0/2530023268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4f8155260 0x7fa4f81ea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4effff640 1 -- 172.21.15.161:0/2530023268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4f8071240 msgr2=0x7fa4f80ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4effff640 1 --2- 172.21.15.161:0/2530023268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4f8071240 0x7fa4f80ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.712+0000 7fa4effff640 1 -- 172.21.15.161:0/2530023268 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8009400 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.713+0000 7fa4effff640 1 --2- 172.21.15.161:0/2530023268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f80c1cb0 0x7fa4f814b1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c3c0 tx=0x7fa4e000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.713+0000 7fa4eeffd640 1 -- 172.21.15.161:0/2530023268 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00052d0 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.713+0000 7fa4eeffd640 1 -- 172.21.15.161:0/2530023268 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e0005450 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.713+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f806cda0 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.713+0000 7fa4eeffd640 1 -- 172.21.15.161:0/2530023268 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0007260 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.713+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f814b700 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.713+0000 7fa4eeffd640 1 -- 172.21.15.161:0/2530023268 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa4e00067d0 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.713+0000 7fa4eeffd640 1 -- 172.21.15.161:0/2530023268 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa4e0003b60 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.714+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f81589e0 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.717+0000 7fa4eeffd640 1 -- 172.21.15.161:0/2530023268 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa4f81589e0 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.795 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:40.794+0000 7f892ff7a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-18T20:37:40.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.797+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05d22da2-1667-4cfd-bb83-e5b4e665c99e", "id": 0} v 0) v1 -- 0x7fa4f804e840 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.807+0000 7fa4eeffd640 1 -- 172.21.15.161:0/2530023268 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05d22da2-1667-4cfd-bb83-e5b4e665c99e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa4e0020060 con 0x7fa4f80c1cb0 2023-11-18T20:37:40.808 INFO:teuthology.orchestra.run.smithi161.stdout:0 2023-11-18T20:37:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f80c1cb0 msgr2=0x7fa4f814b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 --2- 172.21.15.161:0/2530023268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f80c1cb0 0x7fa4f814b1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c3c0 tx=0x7fa4e000c880 comp rx=0 tx=0).stop 2023-11-18T20:37:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 shutdown_connections 2023-11-18T20:37:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 --2- 172.21.15.161:0/2530023268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4f8155260 0x7fa4f81ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 --2- 172.21.15.161:0/2530023268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4f80c1cb0 0x7fa4f814b1c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 --2- 172.21.15.161:0/2530023268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4f8071240 0x7fa4f80ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 >> 172.21.15.161:0/2530023268 conn(0x7fa4f80a8870 msgr2=0x7fa4f8152730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:40.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 shutdown_connections 2023-11-18T20:37:40.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:40.808+0000 7fa4f759e640 1 -- 172.21.15.161:0/2530023268 wait complete. 2023-11-18T20:37:40.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 949e7095-6bb3-4448-a000-ab93187d72cf 1 2023-11-18T20:37:40.861 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:40.861+0000 7f892ff7a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-18T20:37:40.916 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:40.915+0000 7f892ff7a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-18T20:37:40.980 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:40.979+0000 7f892ff7a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-18T20:37:41.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.020+0000 7f01ab59e640 1 Processor -- start 2023-11-18T20:37:41.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.020+0000 7f01ab59e640 1 -- start start 2023-11-18T20:37:41.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.021+0000 7f01ab59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.021+0000 7f01ab59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac1554a0 con 0x7f01ac14ae70 2023-11-18T20:37:41.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.021+0000 7f01ab59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac0c6840 con 0x7f01ac06b890 2023-11-18T20:37:41.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.021+0000 7f01ab59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac06b120 con 0x7f01ac0bd530 2023-11-18T20:37:41.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.021+0000 7f01a3fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.021+0000 7f01aad9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f01ac06b890 0x7f01ac06bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38800/0 (socket says 172.21.15.161:38800) 2023-11-18T20:37:41.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.021+0000 7f01aad9d640 1 -- 172.21.15.161:0/1334354103 learned_addr learned my addr 172.21.15.161:0/1334354103 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-18T20:37:41.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.022+0000 7f01a3fff640 1 -- 172.21.15.161:0/1334354103 >> v1:172.21.15.161:6789/0 conn(0x7f01ac06b890 legacy=0x7f01ac06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.022+0000 7f01a3fff640 1 -- 172.21.15.161:0/1334354103 >> v1:172.21.15.132:6789/0 conn(0x7f01ac14ae70 legacy=0x7f01ac0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:41.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.022+0000 7f01a3fff640 1 -- 172.21.15.161:0/1334354103 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0c6a90 con 0x7f01ac0bd530 2023-11-18T20:37:41.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.022+0000 7f01a9d9b640 1 -- 172.21.15.161:0/1334354103 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942380490 0 0) 0x7f01ac0c6840 con 0x7f01ac06b890 2023-11-18T20:37:41.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.023+0000 7f01a3fff640 1 --2- 172.21.15.161:0/1334354103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac154f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01940097d0 tx=0x7f019402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91178f0cff056121 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.023+0000 7f01a9d9b640 1 -- 172.21.15.161:0/1334354103 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194031770 con 0x7f01ac0bd530 2023-11-18T20:37:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.023+0000 7f01a9d9b640 1 -- 172.21.15.161:0/1334354103 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01940318d0 con 0x7f01ac0bd530 2023-11-18T20:37:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.023+0000 7f01a9d9b640 1 -- 172.21.15.161:0/1334354103 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194031c60 con 0x7f01ac0bd530 2023-11-18T20:37:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.024+0000 7f01ab59e640 1 -- 172.21.15.161:0/1334354103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 msgr2=0x7f01ac154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.024+0000 7f01ab59e640 1 --2- 172.21.15.161:0/1334354103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac154f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01940097d0 tx=0x7f019402b810 comp rx=0 tx=0).stop 2023-11-18T20:37:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.024+0000 7f01ab59e640 1 -- 172.21.15.161:0/1334354103 shutdown_connections 2023-11-18T20:37:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.024+0000 7f01ab59e640 1 --2- 172.21.15.161:0/1334354103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac154f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.024+0000 7f01ab59e640 1 -- 172.21.15.161:0/1334354103 >> 172.21.15.161:0/1334354103 conn(0x7f01ac0ab9e0 msgr2=0x7f01ac0abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:41.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.024+0000 7f01ab59e640 1 -- 172.21.15.161:0/1334354103 shutdown_connections 2023-11-18T20:37:41.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.024+0000 7f01ab59e640 1 -- 172.21.15.161:0/1334354103 wait complete. 2023-11-18T20:37:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.026+0000 7f01ab59e640 1 Processor -- start 2023-11-18T20:37:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.026+0000 7f01ab59e640 1 -- start start 2023-11-18T20:37:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01ab59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac06b890 0x7f01ac148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01ab59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac1eb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01ab59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac14ae70 0x7f01ac1eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01ab59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0ae490 con 0x7f01ac06b890 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01ab59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0af750 con 0x7f01ac14ae70 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01ab59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac1499f0 con 0x7f01ac0bd530 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01a3fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac1eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01aad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac14ae70 0x7f01ac1eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01a3fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac1eb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:56842/0 (socket says 172.21.15.161:56842) 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01a3fff640 1 -- 172.21.15.161:0/3024449215 learned_addr learned my addr 172.21.15.161:0/3024449215 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01aa59c640 1 --2- 172.21.15.161:0/3024449215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac06b890 0x7f01ac148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01a3fff640 1 -- 172.21.15.161:0/3024449215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac14ae70 msgr2=0x7f01ac1eb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.027+0000 7f01a3fff640 1 --2- 172.21.15.161:0/3024449215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac14ae70 0x7f01ac1eb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01a3fff640 1 -- 172.21.15.161:0/3024449215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac06b890 msgr2=0x7f01ac148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01a3fff640 1 --2- 172.21.15.161:0/3024449215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac06b890 0x7f01ac148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01a3fff640 1 -- 172.21.15.161:0/3024449215 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194009400 con 0x7f01ac0bd530 2023-11-18T20:37:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01a3fff640 1 --2- 172.21.15.161:0/3024449215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac1eb060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01940097d0 tx=0x7f01940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3024449215 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194032810 con 0x7f01ac0bd530 2023-11-18T20:37:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3024449215 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194032970 con 0x7f01ac0bd530 2023-11-18T20:37:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac0ae6e0 con 0x7f01ac0bd530 2023-11-18T20:37:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3024449215 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194032d20 con 0x7f01ac0bd530 2023-11-18T20:37:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.028+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac0af3e0 con 0x7f01ac0bd530 2023-11-18T20:37:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.029+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3024449215 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0194005c90 con 0x7f01ac0bd530 2023-11-18T20:37:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.029+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3024449215 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f019404e800 con 0x7f01ac0bd530 2023-11-18T20:37:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.029+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac04e840 con 0x7f01ac0bd530 2023-11-18T20:37:41.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.032+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3024449215 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f01ac1554a0 con 0x7f01ac0bd530 2023-11-18T20:37:41.035 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:41.032+0000 7f892ff7a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-18T20:37:41.057 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.055+0000 7fdb82e2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-18T20:37:41.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.109+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "949e7095-6bb3-4448-a000-ab93187d72cf", "id": 1} v 0) v1 -- 0x7f01ac0af890 con 0x7f01ac0bd530 2023-11-18T20:37:41.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.116+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3024449215 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "949e7095-6bb3-4448-a000-ab93187d72cf", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0194006840 con 0x7f01ac0bd530 2023-11-18T20:37:41.117 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 msgr2=0x7f01ac1eb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 --2- 172.21.15.161:0/3024449215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac1eb060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01940097d0 tx=0x7f01940046c0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 shutdown_connections 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 --2- 172.21.15.161:0/3024449215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac14ae70 0x7f01ac1eb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 --2- 172.21.15.161:0/3024449215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01ac0bd530 0x7f01ac1eb060 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 --2- 172.21.15.161:0/3024449215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac06b890 0x7f01ac148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 >> 172.21.15.161:0/3024449215 conn(0x7f01ac0ab9e0 msgr2=0x7f01ac153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 shutdown_connections 2023-11-18T20:37:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.118+0000 7f01ab59e640 1 -- 172.21.15.161:0/3024449215 wait complete. 2023-11-18T20:37:41.120 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.118+0000 7fdb82e2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-18T20:37:41.135 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc 2 2023-11-18T20:37:41.153 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:41.153+0000 7f892ff7a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-18T20:37:41.170 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.169+0000 7fdb82e2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-18T20:37:41.231 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.230+0000 7fdb82e2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-18T20:37:41.241 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:41.241+0000 7f892ff7a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-18T20:37:41.280 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.279+0000 7fdb82e2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-18T20:37:41.297 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:41.296+0000 7f892ff7a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-18T20:37:41.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.344+0000 7f0d1e059640 1 Processor -- start 2023-11-18T20:37:41.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.344+0000 7f0d1e059640 1 -- start start 2023-11-18T20:37:41.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.345+0000 7f0d1e059640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d180bd530 0x7f0d18154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.345+0000 7f0d1e059640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d181554a0 con 0x7f0d1814ae70 2023-11-18T20:37:41.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.345+0000 7f0d1e059640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d180c6840 con 0x7f0d1806b890 2023-11-18T20:37:41.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.346+0000 7f0d1e059640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1806b120 con 0x7f0d180bd530 2023-11-18T20:37:41.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.346+0000 7f0d1d858640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0d1806b890 0x7f0d1806bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38802/0 (socket says 172.21.15.161:38802) 2023-11-18T20:37:41.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.346+0000 7f0d1d858640 1 -- 172.21.15.161:0/4163973785 learned_addr learned my addr 172.21.15.161:0/4163973785 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.346+0000 7f0d1c856640 1 --2- 172.21.15.161:0/4163973785 >> v2:172.21.15.132:3300/0 conn(0x7f0d180bd530 0x7f0d18154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.346+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582012835 0 0) 0x7f0d180c6840 con 0x7f0d1806b890 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.346+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d04003520 con 0x7f0d1806b890 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404935859 0 0) 0x7f0d04003520 con 0x7f0d1806b890 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 >> v2:172.21.15.132:3300/0 conn(0x7f0d180bd530 msgr2=0x7f0d18154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 --2- 172.21.15.161:0/4163973785 >> v2:172.21.15.132:3300/0 conn(0x7f0d180bd530 0x7f0d18154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 >> v1:172.21.15.132:6789/0 conn(0x7f0d1814ae70 legacy=0x7f0d180c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d180c6a90 con 0x7f0d1806b890 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f0d100019f0 con 0x7f0d1806b890 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 >> v1:172.21.15.161:6789/0 conn(0x7f0d1806b890 legacy=0x7f0d1806bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d04003970 0x7f0d04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d040047c0 0x7f0d04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04005180 0x7f0d0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1806b120 con 0x7f0d04005180 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0400c120 con 0x7f0d04003970 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0400c2e0 con 0x7f0d040047c0 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d1d057640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d04003970 0x7f0d04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d1c856640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d040047c0 0x7f0d04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.347+0000 7f0d1d858640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04005180 0x7f0d0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.348+0000 7f0d1d057640 1 -- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d040047c0 msgr2=0x7f0d04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.348+0000 7f0d1d057640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d040047c0 0x7f0d04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.348+0000 7f0d1d057640 1 -- 172.21.15.161:0/4163973785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04005180 msgr2=0x7f0d0400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.348+0000 7f0d1d057640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04005180 0x7f0d0400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.348+0000 7f0d1d057640 1 -- 172.21.15.161:0/4163973785 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d04003520 con 0x7f0d04003970 2023-11-18T20:37:41.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.348+0000 7f0d1d858640 1 -- 172.21.15.161:0/4163973785 reap_dead start 2023-11-18T20:37:41.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.348+0000 7f0d1c856640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d040047c0 0x7f0d04004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:37:41.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.349+0000 7f0d1d057640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d04003970 0x7f0d04003d90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d140015b0 tx=0x7f0d040057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e23a6b6549eeb01 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:41.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.349+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d140052d0 con 0x7f0d04003970 2023-11-18T20:37:41.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.349+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1402e050 con 0x7f0d04003970 2023-11-18T20:37:41.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.349+0000 7f0d0ffff640 1 -- 172.21.15.161:0/4163973785 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14003830 con 0x7f0d04003970 2023-11-18T20:37:41.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.350+0000 7f0d1e059640 1 -- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d04003970 msgr2=0x7f0d04003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.350+0000 7f0d1e059640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d04003970 0x7f0d04003d90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d140015b0 tx=0x7f0d040057f0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.350+0000 7f0d1e059640 1 -- 172.21.15.161:0/4163973785 shutdown_connections 2023-11-18T20:37:41.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.350+0000 7f0d1e059640 1 --2- 172.21.15.161:0/4163973785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d04003970 0x7f0d04003d90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.350+0000 7f0d1e059640 1 -- 172.21.15.161:0/4163973785 >> 172.21.15.161:0/4163973785 conn(0x7f0d180ab9e0 msgr2=0x7f0d180abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:41.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.350+0000 7f0d1e059640 1 -- 172.21.15.161:0/4163973785 shutdown_connections 2023-11-18T20:37:41.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.350+0000 7f0d1e059640 1 -- 172.21.15.161:0/4163973785 wait complete. 2023-11-18T20:37:41.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.352+0000 7f0d1e059640 1 Processor -- start 2023-11-18T20:37:41.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.352+0000 7f0d1e059640 1 -- start start 2023-11-18T20:37:41.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.352+0000 7f0d1e059640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04003970 0x7f0d181eb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.352+0000 7f0d1e059640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d180c2590 0x7f0d181ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1e059640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d181edcb0 0x7f0d18141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1e059640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181ee490 con 0x7f0d04003970 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1e059640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180c2100 con 0x7f0d180c2590 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1e059640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181ee220 con 0x7f0d181edcb0 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1c856640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d180c2590 0x7f0d181ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1d858640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d181edcb0 0x7f0d18141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1c856640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d180c2590 0x7f0d181ed770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46774/0 (socket says 172.21.15.161:46774) 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1c856640 1 -- 172.21.15.161:0/4065111573 learned_addr learned my addr 172.21.15.161:0/4065111573 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1d057640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04003970 0x7f0d181eb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1c856640 1 -- 172.21.15.161:0/4065111573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d181edcb0 msgr2=0x7f0d18141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1c856640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d181edcb0 0x7f0d18141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1c856640 1 -- 172.21.15.161:0/4065111573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04003970 msgr2=0x7f0d181eb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1c856640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04003970 0x7f0d181eb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1c856640 1 -- 172.21.15.161:0/4065111573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d181ebe70 con 0x7f0d180c2590 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.353+0000 7f0d1d858640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d181edcb0 0x7f0d18141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.354+0000 7f0d1c856640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d180c2590 0x7f0d181ed770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0d080119d0 tx=0x7f0d08011dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.354+0000 7f0d0dffb640 1 -- 172.21.15.161:0/4065111573 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800faf0 con 0x7f0d180c2590 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.354+0000 7f0d0dffb640 1 -- 172.21.15.161:0/4065111573 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0800fc50 con 0x7f0d180c2590 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.354+0000 7f0d0dffb640 1 -- 172.21.15.161:0/4065111573 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08014440 con 0x7f0d180c2590 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.354+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d181ebbb0 con 0x7f0d180c2590 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.354+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d180c1d90 con 0x7f0d180c2590 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.354+0000 7f0d0dffb640 1 -- 172.21.15.161:0/4065111573 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d080148a0 con 0x7f0d180c2590 2023-11-18T20:37:41.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.354+0000 7f0d0dffb640 1 -- 172.21.15.161:0/4065111573 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0d0801d720 con 0x7f0d180c2590 2023-11-18T20:37:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.355+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1804e840 con 0x7f0d180c2590 2023-11-18T20:37:41.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.357+0000 7f0d0dffb640 1 -- 172.21.15.161:0/4065111573 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0d08022020 con 0x7f0d180c2590 2023-11-18T20:37:41.362 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:41.361+0000 7f892ff7a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-18T20:37:41.393 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.392+0000 7fdb82e2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-18T20:37:41.417 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:41.417+0000 7f892ff7a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-18T20:37:41.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.436+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc", "id": 2} v 0) v1 -- 0x7f0d1806c720 con 0x7f0d180c2590 2023-11-18T20:37:41.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.444+0000 7f0d0dffb640 1 -- 172.21.15.161:0/4065111573 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d08009690 con 0x7f0d180c2590 2023-11-18T20:37:41.445 INFO:teuthology.orchestra.run.smithi161.stdout:2 2023-11-18T20:37:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.445+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d180c2590 msgr2=0x7f0d181ed770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.445+0000 7f0d1e059640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d180c2590 0x7f0d181ed770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0d080119d0 tx=0x7f0d08011dd0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.445+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 shutdown_connections 2023-11-18T20:37:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.445+0000 7f0d1e059640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d181edcb0 0x7f0d18141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.445+0000 7f0d1e059640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d180c2590 0x7f0d181ed770 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.445+0000 7f0d1e059640 1 --2- 172.21.15.161:0/4065111573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d04003970 0x7f0d181eb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.445+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 >> 172.21.15.161:0/4065111573 conn(0x7f0d180ab9e0 msgr2=0x7f0d180c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:41.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.445+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 shutdown_connections 2023-11-18T20:37:41.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.446+0000 7f0d1e059640 1 -- 172.21.15.161:0/4065111573 wait complete. 2023-11-18T20:37:41.463 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 107b4d49-4d7a-46ec-bb10-d802101aa711 3 2023-11-18T20:37:41.474 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.473+0000 7fdb82e2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-18T20:37:41.528 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.527+0000 7fdb82e2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-18T20:37:41.588 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.587+0000 7fdb82e2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-18T20:37:41.642 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:41.641+0000 7fdb82e2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-18T20:37:41.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.654+0000 7fcb149ef640 1 Processor -- start 2023-11-18T20:37:41.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.655+0000 7fcb149ef640 1 -- start start 2023-11-18T20:37:41.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb149ef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb10154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb149ef640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb100bd530 0x7fcb100c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb149ef640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb101554a0 con 0x7fcb100c4cf0 2023-11-18T20:37:41.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb149ef640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb100c6840 con 0x7fcb100bd530 2023-11-18T20:37:41.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb149ef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1006b120 con 0x7fcb1014ae70 2023-11-18T20:37:41.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb0e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb100bd530 0x7fcb100c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb0ed9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb10154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb0e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb100bd530 0x7fcb100c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46788/0 (socket says 172.21.15.161:46788) 2023-11-18T20:37:41.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.656+0000 7fcb0e59c640 1 -- 172.21.15.161:0/2016318121 learned_addr learned my addr 172.21.15.161:0/2016318121 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:41.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.657+0000 7fcb0ed9d640 1 -- 172.21.15.161:0/2016318121 >> v2:172.21.15.161:3300/0 conn(0x7fcb100bd530 msgr2=0x7fcb100c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:41.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.657+0000 7fcb0ed9d640 1 --2- 172.21.15.161:0/2016318121 >> v2:172.21.15.161:3300/0 conn(0x7fcb100bd530 0x7fcb100c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.657+0000 7fcb0ed9d640 1 -- 172.21.15.161:0/2016318121 >> v1:172.21.15.161:6789/0 conn(0x7fcb100c4cf0 legacy=0x7fcb1006b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.657+0000 7fcb0ed9d640 1 -- 172.21.15.161:0/2016318121 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb100c6a90 con 0x7fcb1014ae70 2023-11-18T20:37:41.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.657+0000 7fcb0dd9b640 1 -- 172.21.15.161:0/2016318121 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493594855 0 0) 0x7fcb08001490 con 0x7fcb100c4cf0 2023-11-18T20:37:41.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.657+0000 7fcb0e59c640 1 --2- 172.21.15.161:0/2016318121 >> v2:172.21.15.161:3300/0 conn(0x7fcb100bd530 0x7fcb100c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:37:41.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.658+0000 7fcb0ed9d640 1 --2- 172.21.15.161:0/2016318121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb10154f60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb000097a0 tx=0x7fcb0002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=747494bf51d2bd8e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:41.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.658+0000 7fcb0dd9b640 1 -- 172.21.15.161:0/2016318121 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00031780 con 0x7fcb1014ae70 2023-11-18T20:37:41.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.658+0000 7fcb0dd9b640 1 -- 172.21.15.161:0/2016318121 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb000318e0 con 0x7fcb1014ae70 2023-11-18T20:37:41.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.658+0000 7fcb0dd9b640 1 -- 172.21.15.161:0/2016318121 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00031c70 con 0x7fcb1014ae70 2023-11-18T20:37:41.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.659+0000 7fcb149ef640 1 -- 172.21.15.161:0/2016318121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 msgr2=0x7fcb10154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.659+0000 7fcb149ef640 1 --2- 172.21.15.161:0/2016318121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb10154f60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb000097a0 tx=0x7fcb0002b820 comp rx=0 tx=0).stop 2023-11-18T20:37:41.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.659+0000 7fcb149ef640 1 -- 172.21.15.161:0/2016318121 shutdown_connections 2023-11-18T20:37:41.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.659+0000 7fcb149ef640 1 --2- 172.21.15.161:0/2016318121 >> v2:172.21.15.161:3300/0 conn(0x7fcb100bd530 0x7fcb100c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.659+0000 7fcb149ef640 1 --2- 172.21.15.161:0/2016318121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb10154f60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.659+0000 7fcb149ef640 1 -- 172.21.15.161:0/2016318121 >> 172.21.15.161:0/2016318121 conn(0x7fcb100ab9e0 msgr2=0x7fcb100abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:41.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.659+0000 7fcb149ef640 1 -- 172.21.15.161:0/2016318121 shutdown_connections 2023-11-18T20:37:41.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.659+0000 7fcb149ef640 1 -- 172.21.15.161:0/2016318121 wait complete. 2023-11-18T20:37:41.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.661+0000 7fcb149ef640 1 Processor -- start 2023-11-18T20:37:41.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.661+0000 7fcb149ef640 1 -- start start 2023-11-18T20:37:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb149ef640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb100bd530 0x7fcb101ea170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb149ef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100c4cf0 0x7fcb10158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb149ef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb100be610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb149ef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101576c0 con 0x7fcb100c4cf0 2023-11-18T20:37:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb149ef640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10157f00 con 0x7fcb100bd530 2023-11-18T20:37:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb149ef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101ea6b0 con 0x7fcb1014ae70 2023-11-18T20:37:41.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb100bd530 0x7fcb101ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb100bd530 0x7fcb101ea170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46802/0 (socket says 172.21.15.161:46802) 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0ed9d640 1 -- 172.21.15.161:0/1905708088 learned_addr learned my addr 172.21.15.161:0/1905708088 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0f59e640 1 --2- 172.21.15.161:0/1905708088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb100be610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0ed9d640 1 -- 172.21.15.161:0/1905708088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 msgr2=0x7fcb100be610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0ed9d640 1 --2- 172.21.15.161:0/1905708088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb100be610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0ed9d640 1 -- 172.21.15.161:0/1905708088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100c4cf0 msgr2=0x7fcb10158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0ed9d640 1 --2- 172.21.15.161:0/1905708088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100c4cf0 0x7fcb10158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.662+0000 7fcb0ed9d640 1 -- 172.21.15.161:0/1905708088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040094d0 con 0x7fcb100bd530 2023-11-18T20:37:41.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.663+0000 7fcb0ed9d640 1 --2- 172.21.15.161:0/1905708088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb100bd530 0x7fcb101ea170 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcb00034040 tx=0x7fcb000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.663+0000 7fcaf77fe640 1 -- 172.21.15.161:0/1905708088 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00032620 con 0x7fcb100bd530 2023-11-18T20:37:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.663+0000 7fcaf77fe640 1 -- 172.21.15.161:0/1905708088 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb000327a0 con 0x7fcb100bd530 2023-11-18T20:37:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.663+0000 7fcaf77fe640 1 -- 172.21.15.161:0/1905708088 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00032b50 con 0x7fcb100bd530 2023-11-18T20:37:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.663+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb00009400 con 0x7fcb100bd530 2023-11-18T20:37:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.663+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb101588d0 con 0x7fcb100bd530 2023-11-18T20:37:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.663+0000 7fcaf77fe640 1 -- 172.21.15.161:0/1905708088 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcb00032cb0 con 0x7fcb100bd530 2023-11-18T20:37:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.664+0000 7fcaf77fe640 1 -- 172.21.15.161:0/1905708088 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcb00044be0 con 0x7fcb100bd530 2023-11-18T20:37:41.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.665+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1004e840 con 0x7fcb100bd530 2023-11-18T20:37:41.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.667+0000 7fcaf77fe640 1 -- 172.21.15.161:0/1905708088 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcb00049070 con 0x7fcb100bd530 2023-11-18T20:37:41.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.770+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "107b4d49-4d7a-46ec-bb10-d802101aa711", "id": 3} v 0) v1 -- 0x7fcb100ac2e0 con 0x7fcb100bd530 2023-11-18T20:37:41.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.777+0000 7fcaf77fe640 1 -- 172.21.15.161:0/1905708088 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "107b4d49-4d7a-46ec-bb10-d802101aa711", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcb00044410 con 0x7fcb100bd530 2023-11-18T20:37:41.778 INFO:teuthology.orchestra.run.smithi161.stdout:3 2023-11-18T20:37:41.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb100bd530 msgr2=0x7fcb101ea170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 --2- 172.21.15.161:0/1905708088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb100bd530 0x7fcb101ea170 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcb00034040 tx=0x7fcb000046c0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 shutdown_connections 2023-11-18T20:37:41.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 --2- 172.21.15.161:0/1905708088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb1014ae70 0x7fcb100be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 --2- 172.21.15.161:0/1905708088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100c4cf0 0x7fcb10158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 --2- 172.21.15.161:0/1905708088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb100bd530 0x7fcb101ea170 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 >> 172.21.15.161:0/1905708088 conn(0x7fcb100ab9e0 msgr2=0x7fcb100c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:41.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 shutdown_connections 2023-11-18T20:37:41.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.778+0000 7fcb149ef640 1 -- 172.21.15.161:0/1905708088 wait complete. 2023-11-18T20:37:41.795 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new d78c72c3-0687-4fa0-b0e3-2b624196b986 4 2023-11-18T20:37:41.929 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:41.928+0000 7f892ff7a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-18T20:37:41.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.980+0000 7f24ce81f640 1 Processor -- start 2023-11-18T20:37:41.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.980+0000 7f24ce81f640 1 -- start start 2023-11-18T20:37:41.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.981+0000 7f24ce81f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24c806b1d0 0x7f24c80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.981+0000 7f24ce81f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f24c8152170 0x7f24c80c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.981+0000 7f24ce81f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c8155730 con 0x7f24c8155230 2023-11-18T20:37:41.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.981+0000 7f24ce81f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c806c9f0 con 0x7f24c806b1d0 2023-11-18T20:37:41.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.981+0000 7f24ce81f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c80c5650 con 0x7f24c8152170 2023-11-18T20:37:41.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24c77fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f24c8155230 0x7f24c8151a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38810/0 (socket says 172.21.15.161:38810) 2023-11-18T20:37:41.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24c77fe640 1 -- 172.21.15.161:0/1736743118 learned_addr learned my addr 172.21.15.161:0/1736743118 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-18T20:37:41.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24ccdbc640 1 --2- 172.21.15.161:0/1736743118 >> v2:172.21.15.161:3300/0 conn(0x7f24c8152170 0x7f24c80c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24c7fff640 1 --2- 172.21.15.161:0/1736743118 >> v2:172.21.15.132:3300/0 conn(0x7f24c806b1d0 0x7f24c80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24c6ffd640 1 -- 172.21.15.161:0/1736743118 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153043888 0 0) 0x7f24c8155730 con 0x7f24c8155230 2023-11-18T20:37:41.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24c6ffd640 1 -- 172.21.15.161:0/1736743118 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b0003520 con 0x7f24c8155230 2023-11-18T20:37:41.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24ccdbc640 1 -- 172.21.15.161:0/1736743118 >> v2:172.21.15.132:3300/0 conn(0x7f24c806b1d0 msgr2=0x7f24c80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:41.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24ccdbc640 1 --2- 172.21.15.161:0/1736743118 >> v2:172.21.15.132:3300/0 conn(0x7f24c806b1d0 0x7f24c80c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24ccdbc640 1 -- 172.21.15.161:0/1736743118 >> v1:172.21.15.161:6789/0 conn(0x7f24c8155230 legacy=0x7f24c8151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.982+0000 7f24ccdbc640 1 -- 172.21.15.161:0/1736743118 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c80c9c70 con 0x7f24c8152170 2023-11-18T20:37:41.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.984+0000 7f24ccdbc640 1 --2- 172.21.15.161:0/1736743118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c8360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f24c808b920 tx=0x7f24c002bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f90fcc2514306f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:41.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.984+0000 7f24c6ffd640 1 -- 172.21.15.161:0/1736743118 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c002cb50 con 0x7f24c8152170 2023-11-18T20:37:41.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.984+0000 7f24c6ffd640 1 -- 172.21.15.161:0/1736743118 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c002ccb0 con 0x7f24c8152170 2023-11-18T20:37:41.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.984+0000 7f24c6ffd640 1 -- 172.21.15.161:0/1736743118 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0034660 con 0x7f24c8152170 2023-11-18T20:37:41.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.985+0000 7f24ce81f640 1 -- 172.21.15.161:0/1736743118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 msgr2=0x7f24c80c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.985+0000 7f24ce81f640 1 --2- 172.21.15.161:0/1736743118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c8360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f24c808b920 tx=0x7f24c002bda0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.985+0000 7f24ce81f640 1 -- 172.21.15.161:0/1736743118 shutdown_connections 2023-11-18T20:37:41.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.985+0000 7f24ce81f640 1 --2- 172.21.15.161:0/1736743118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c8360 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.985+0000 7f24ce81f640 1 --2- 172.21.15.161:0/1736743118 >> v2:172.21.15.132:3300/0 conn(0x7f24c806b1d0 0x7f24c80c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.985+0000 7f24ce81f640 1 -- 172.21.15.161:0/1736743118 >> 172.21.15.161:0/1736743118 conn(0x7f24c80ca100 msgr2=0x7f24c80ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:41.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.985+0000 7f24ce81f640 1 -- 172.21.15.161:0/1736743118 shutdown_connections 2023-11-18T20:37:41.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.985+0000 7f24ce81f640 1 -- 172.21.15.161:0/1736743118 wait complete. 2023-11-18T20:37:41.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.987+0000 7f24ce81f640 1 Processor -- start 2023-11-18T20:37:41.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.987+0000 7f24ce81f640 1 -- start start 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24ce81f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24c806b1d0 0x7f24c814f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24ce81f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24ce81f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24c8155230 0x7f24c80c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24ce81f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8155e90 con 0x7f24c8155230 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24ce81f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80afce0 con 0x7f24c8152170 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24ce81f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80ab620 con 0x7f24c806b1d0 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c77fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24c806b1d0 0x7f24c814f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c77fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46818/0 (socket says 172.21.15.161:46818) 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c77fe640 1 -- 172.21.15.161:0/3581835439 learned_addr learned my addr 172.21.15.161:0/3581835439 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24ccdbc640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24c8155230 0x7f24c80c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c77fe640 1 -- 172.21.15.161:0/3581835439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24c806b1d0 msgr2=0x7f24c814f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c77fe640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24c806b1d0 0x7f24c814f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c77fe640 1 -- 172.21.15.161:0/3581835439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24c8155230 msgr2=0x7f24c80c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c77fe640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24c8155230 0x7f24c80c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c77fe640 1 -- 172.21.15.161:0/3581835439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0009a70 con 0x7f24c8152170 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.988+0000 7f24c7fff640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24c806b1d0 0x7f24c814f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.989+0000 7f24c77fe640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c2970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c410 tx=0x7f24bc00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.989+0000 7f24c4ff9640 1 -- 172.21.15.161:0/3581835439 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc005ce0 con 0x7f24c8152170 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.989+0000 7f24c4ff9640 1 -- 172.21.15.161:0/3581835439 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc005e40 con 0x7f24c8152170 2023-11-18T20:37:41.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.989+0000 7f24c4ff9640 1 -- 172.21.15.161:0/3581835439 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0072f0 con 0x7f24c8152170 2023-11-18T20:37:41.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.989+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c814c420 con 0x7f24c8152170 2023-11-18T20:37:41.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.989+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c80c33f0 con 0x7f24c8152170 2023-11-18T20:37:41.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.989+0000 7f24c4ff9640 1 -- 172.21.15.161:0/3581835439 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f24bc01c440 con 0x7f24c8152170 2023-11-18T20:37:41.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.989+0000 7f24c4ff9640 1 -- 172.21.15.161:0/3581835439 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f24bc012a00 con 0x7f24c8152170 2023-11-18T20:37:41.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.990+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c804e840 con 0x7f24c8152170 2023-11-18T20:37:41.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:41.994+0000 7f24c4ff9640 1 -- 172.21.15.161:0/3581835439 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f24c814c420 con 0x7f24c8152170 2023-11-18T20:37:42.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.069+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d78c72c3-0687-4fa0-b0e3-2b624196b986", "id": 4} v 0) v1 -- 0x7f24c80afe20 con 0x7f24c8152170 2023-11-18T20:37:42.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.077+0000 7f24c4ff9640 1 -- 172.21.15.161:0/3581835439 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d78c72c3-0687-4fa0-b0e3-2b624196b986", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24c80afe20 con 0x7f24c8152170 2023-11-18T20:37:42.078 INFO:teuthology.orchestra.run.smithi161.stdout:4 2023-11-18T20:37:42.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.078+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 msgr2=0x7f24c80c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.078+0000 7f24ce81f640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c2970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c410 tx=0x7f24bc00c8d0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.078+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 shutdown_connections 2023-11-18T20:37:42.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.078+0000 7f24ce81f640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24c8155230 0x7f24c80c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.078+0000 7f24ce81f640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c8152170 0x7f24c80c2970 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.078+0000 7f24ce81f640 1 --2- 172.21.15.161:0/3581835439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24c806b1d0 0x7f24c814f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.078+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 >> 172.21.15.161:0/3581835439 conn(0x7f24c80ca100 msgr2=0x7f24c80ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:42.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.078+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 shutdown_connections 2023-11-18T20:37:42.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.079+0000 7f24ce81f640 1 -- 172.21.15.161:0/3581835439 wait complete. 2023-11-18T20:37:42.095 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 1957a46f-b8e0-4321-b498-a5bc21d501b7 5 2023-11-18T20:37:42.098 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:42.097+0000 7fdb82e2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-18T20:37:42.107 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:42.106+0000 7f892ff7a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-18T20:37:42.257 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:42.256+0000 7fdb82e2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-18T20:37:42.261 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:42.260+0000 7f892ff7a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-18T20:37:42.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.283+0000 7f81067e9640 1 Processor -- start 2023-11-18T20:37:42.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.283+0000 7f81067e9640 1 -- start start 2023-11-18T20:37:42.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.284+0000 7f81067e9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f810014ae70 0x7f8100154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.284+0000 7f81067e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000bd530 0x7f81000c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81067e9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81001554a0 con 0x7f81000c4cf0 2023-11-18T20:37:42.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81067e9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81000c6840 con 0x7f810014ae70 2023-11-18T20:37:42.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81067e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810006b120 con 0x7f81000bd530 2023-11-18T20:37:42.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81057e7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f810014ae70 0x7f8100154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81057e7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f810014ae70 0x7f8100154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46830/0 (socket says 172.21.15.161:46830) 2023-11-18T20:37:42.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f8104fe6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000bd530 0x7f81000c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81057e7640 1 -- 172.21.15.161:0/1570919431 learned_addr learned my addr 172.21.15.161:0/1570919431 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:42.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81057e7640 1 -- 172.21.15.161:0/1570919431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000bd530 msgr2=0x7f81000c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:42.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81057e7640 1 --2- 172.21.15.161:0/1570919431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000bd530 0x7f81000c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81057e7640 1 -- 172.21.15.161:0/1570919431 >> v1:172.21.15.161:6789/0 conn(0x7f81000c4cf0 legacy=0x7f810006b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f81057e7640 1 -- 172.21.15.161:0/1570919431 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000c6a90 con 0x7f810014ae70 2023-11-18T20:37:42.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.285+0000 7f8104fe6640 1 --2- 172.21.15.161:0/1570919431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000bd530 0x7f81000c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:37:42.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.286+0000 7f81057e7640 1 --2- 172.21.15.161:0/1570919431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810014ae70 0x7f8100154f60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ddad9369e6b55c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:42.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f80f7fff640 1 -- 172.21.15.161:0/1570919431 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc031640 con 0x7f810014ae70 2023-11-18T20:37:42.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f80f7fff640 1 -- 172.21.15.161:0/1570919431 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc0317a0 con 0x7f810014ae70 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f80f7fff640 1 -- 172.21.15.161:0/1570919431 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc031b30 con 0x7f810014ae70 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f81067e9640 1 -- 172.21.15.161:0/1570919431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810014ae70 msgr2=0x7f8100154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f81067e9640 1 --2- 172.21.15.161:0/1570919431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810014ae70 0x7f8100154f60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc02b8f0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f81067e9640 1 -- 172.21.15.161:0/1570919431 shutdown_connections 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f81067e9640 1 --2- 172.21.15.161:0/1570919431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000bd530 0x7f81000c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f81067e9640 1 --2- 172.21.15.161:0/1570919431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810014ae70 0x7f8100154f60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.287+0000 7f81067e9640 1 -- 172.21.15.161:0/1570919431 >> 172.21.15.161:0/1570919431 conn(0x7f81000ab9e0 msgr2=0x7f81000abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.288+0000 7f81067e9640 1 -- 172.21.15.161:0/1570919431 shutdown_connections 2023-11-18T20:37:42.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.288+0000 7f81067e9640 1 -- 172.21.15.161:0/1570919431 wait complete. 2023-11-18T20:37:42.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.289+0000 7f81067e9640 1 Processor -- start 2023-11-18T20:37:42.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.289+0000 7f81067e9640 1 -- start start 2023-11-18T20:37:42.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81067e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81000bd530 0x7f81000be210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81067e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000c4cf0 0x7f81001e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81067e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f810014ae70 0x7f81000c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81067e9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81000c0f00 con 0x7f810014ae70 2023-11-18T20:37:42.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81067e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81000c3b10 con 0x7f81000bd530 2023-11-18T20:37:42.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81067e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81001ea360 con 0x7f81000c4cf0 2023-11-18T20:37:42.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81057e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81000bd530 0x7f81000be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f8104fe6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000c4cf0 0x7f81001e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81057e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81000bd530 0x7f81000be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46846/0 (socket says 172.21.15.161:46846) 2023-11-18T20:37:42.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.290+0000 7f81057e7640 1 -- 172.21.15.161:0/1168728937 learned_addr learned my addr 172.21.15.161:0/1168728937 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:42.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f81057e7640 1 -- 172.21.15.161:0/1168728937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000c4cf0 msgr2=0x7f81001e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f81057e7640 1 --2- 172.21.15.161:0/1168728937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000c4cf0 0x7f81001e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f81057e7640 1 -- 172.21.15.161:0/1168728937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f810014ae70 msgr2=0x7f81000c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f8105fe8640 1 --2- 172.21.15.161:0/1168728937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f810014ae70 0x7f81000c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f81057e7640 1 --2- 172.21.15.161:0/1168728937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f810014ae70 0x7f81000c2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f81057e7640 1 -- 172.21.15.161:0/1168728937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0009400 con 0x7f81000bd530 2023-11-18T20:37:42.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f81057e7640 1 --2- 172.21.15.161:0/1168728937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81000bd530 0x7f81000be210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:42.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f80f5ffb640 1 -- 172.21.15.161:0/1168728937 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc03a930 con 0x7f81000bd530 2023-11-18T20:37:42.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f80f5ffb640 1 -- 172.21.15.161:0/1168728937 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc03aa90 con 0x7f81000bd530 2023-11-18T20:37:42.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc0094d0 con 0x7f81000bd530 2023-11-18T20:37:42.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.291+0000 7f80f5ffb640 1 -- 172.21.15.161:0/1168728937 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc03ae40 con 0x7f81000bd530 2023-11-18T20:37:42.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.292+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81000c1150 con 0x7f81000bd530 2023-11-18T20:37:42.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.292+0000 7f80f5ffb640 1 -- 172.21.15.161:0/1168728937 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f80fc02f050 con 0x7f81000bd530 2023-11-18T20:37:42.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.292+0000 7f80f5ffb640 1 -- 172.21.15.161:0/1168728937 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f80fc044ab0 con 0x7f81000bd530 2023-11-18T20:37:42.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.293+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810004e840 con 0x7f81000bd530 2023-11-18T20:37:42.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.295+0000 7f80f5ffb640 1 -- 172.21.15.161:0/1168728937 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f80fc035020 con 0x7f81000bd530 2023-11-18T20:37:42.318 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:42.317+0000 7f892ff7a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-18T20:37:42.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.372+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1957a46f-b8e0-4321-b498-a5bc21d501b7", "id": 5} v 0) v1 -- 0x7f810006c720 con 0x7f81000bd530 2023-11-18T20:37:42.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.380+0000 7f80f5ffb640 1 -- 172.21.15.161:0/1168728937 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1957a46f-b8e0-4321-b498-a5bc21d501b7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f80fc052070 con 0x7f81000bd530 2023-11-18T20:37:42.380 INFO:teuthology.orchestra.run.smithi161.stdout:5 2023-11-18T20:37:42.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81000bd530 msgr2=0x7f81000be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 --2- 172.21.15.161:0/1168728937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81000bd530 0x7f81000be210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc0046c0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 shutdown_connections 2023-11-18T20:37:42.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 --2- 172.21.15.161:0/1168728937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f810014ae70 0x7f81000c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 --2- 172.21.15.161:0/1168728937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81000c4cf0 0x7f81001e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 --2- 172.21.15.161:0/1168728937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81000bd530 0x7f81000be210 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 >> 172.21.15.161:0/1168728937 conn(0x7f81000ab9e0 msgr2=0x7f810006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:42.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 shutdown_connections 2023-11-18T20:37:42.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.381+0000 7f81067e9640 1 -- 172.21.15.161:0/1168728937 wait complete. 2023-11-18T20:37:42.396 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:42.395+0000 7fdb82e2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-18T20:37:42.397 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 959fb956-8654-4358-964a-457b1cec19ae 6 2023-11-18T20:37:42.433 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:42.432+0000 7f892ff7a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-18T20:37:42.448 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:42.447+0000 7fdb82e2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-18T20:37:42.554 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:42.553+0000 7f892ff7a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-18T20:37:42.559 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:42.558+0000 7fdb82e2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-18T20:37:42.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.627+0000 7f496936c640 1 Processor -- start 2023-11-18T20:37:42.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.627+0000 7f496936c640 1 -- start start 2023-11-18T20:37:42.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f496936c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f496414ae70 0x7f4964154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f496936c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f496406b890 0x7f496406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f496936c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49641554a0 con 0x7f49640bd530 2023-11-18T20:37:42.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f496936c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49640c6840 con 0x7f496406b890 2023-11-18T20:37:42.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f496936c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496406b120 con 0x7f496414ae70 2023-11-18T20:37:42.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f4963fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f496414ae70 0x7f4964154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f4963fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f496414ae70 0x7f4964154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:56914/0 (socket says 172.21.15.161:56914) 2023-11-18T20:37:42.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f4963fff640 1 -- 172.21.15.161:0/504230965 learned_addr learned my addr 172.21.15.161:0/504230965 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:42.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f4963fff640 1 -- 172.21.15.161:0/504230965 >> v2:172.21.15.132:3300/0 conn(0x7f496406b890 msgr2=0x7f496406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:42.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f4963fff640 1 --2- 172.21.15.161:0/504230965 >> v2:172.21.15.132:3300/0 conn(0x7f496406b890 0x7f496406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f4963fff640 1 -- 172.21.15.161:0/504230965 >> v1:172.21.15.132:6789/0 conn(0x7f49640bd530 legacy=0x7f49640c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:42.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.629+0000 7f4963fff640 1 -- 172.21.15.161:0/504230965 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496406c260 con 0x7f496414ae70 2023-11-18T20:37:42.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.630+0000 7f4963fff640 1 --2- 172.21.15.161:0/504230965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f496414ae70 0x7f4964154f60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4954009870 tx=0x7f495402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4aeb0c8fef9b1cf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:42.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.631+0000 7f49637fe640 1 -- 172.21.15.161:0/504230965 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540317c0 con 0x7f496414ae70 2023-11-18T20:37:42.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.631+0000 7f49637fe640 1 -- 172.21.15.161:0/504230965 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4954031920 con 0x7f496414ae70 2023-11-18T20:37:42.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.631+0000 7f49637fe640 1 -- 172.21.15.161:0/504230965 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954031cb0 con 0x7f496414ae70 2023-11-18T20:37:42.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.632+0000 7f496936c640 1 -- 172.21.15.161:0/504230965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f496414ae70 msgr2=0x7f4964154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.632+0000 7f496936c640 1 --2- 172.21.15.161:0/504230965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f496414ae70 0x7f4964154f60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4954009870 tx=0x7f495402b860 comp rx=0 tx=0).stop 2023-11-18T20:37:42.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.632+0000 7f496936c640 1 -- 172.21.15.161:0/504230965 shutdown_connections 2023-11-18T20:37:42.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.632+0000 7f496936c640 1 --2- 172.21.15.161:0/504230965 >> v2:172.21.15.132:3300/0 conn(0x7f496406b890 0x7f496406bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.632+0000 7f496936c640 1 --2- 172.21.15.161:0/504230965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f496414ae70 0x7f4964154f60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.632+0000 7f496936c640 1 -- 172.21.15.161:0/504230965 >> 172.21.15.161:0/504230965 conn(0x7f49640ab9e0 msgr2=0x7f49640abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:42.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.632+0000 7f496936c640 1 -- 172.21.15.161:0/504230965 shutdown_connections 2023-11-18T20:37:42.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.632+0000 7f496936c640 1 -- 172.21.15.161:0/504230965 wait complete. 2023-11-18T20:37:42.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.634+0000 7f496936c640 1 Processor -- start 2023-11-18T20:37:42.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.634+0000 7f496936c640 1 -- start start 2023-11-18T20:37:42.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f496936c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f496406b890 0x7f496414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f496936c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49640bd530 0x7f4964149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f496936c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f496414ae70 0x7f496414a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f496936c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964152e70 con 0x7f496406b890 2023-11-18T20:37:42.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f496936c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964151e10 con 0x7f496414ae70 2023-11-18T20:37:42.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f496936c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496414f000 con 0x7f49640bd530 2023-11-18T20:37:42.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4968b6b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f496414ae70 0x7f496414a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f495bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49640bd530 0x7f4964149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4968b6b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f496414ae70 0x7f496414a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46852/0 (socket says 172.21.15.161:46852) 2023-11-18T20:37:42.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4968b6b640 1 -- 172.21.15.161:0/410304694 learned_addr learned my addr 172.21.15.161:0/410304694 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:42.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f495bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49640bd530 0x7f4964149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:56930/0 (socket says 172.21.15.161:56930) 2023-11-18T20:37:42.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4963fff640 1 --2- 172.21.15.161:0/410304694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f496406b890 0x7f496414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4968b6b640 1 -- 172.21.15.161:0/410304694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49640bd530 msgr2=0x7f4964149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4968b6b640 1 --2- 172.21.15.161:0/410304694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49640bd530 0x7f4964149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4968b6b640 1 -- 172.21.15.161:0/410304694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f496406b890 msgr2=0x7f496414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4968b6b640 1 --2- 172.21.15.161:0/410304694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f496406b890 0x7f496414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.635+0000 7f4968b6b640 1 -- 172.21.15.161:0/410304694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49540094d0 con 0x7f496414ae70 2023-11-18T20:37:42.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.636+0000 7f4968b6b640 1 --2- 172.21.15.161:0/410304694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f496414ae70 0x7f496414a460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f495c00b970 tx=0x7f495c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:42.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.636+0000 7f49617fa640 1 -- 172.21.15.161:0/410304694 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00cb40 con 0x7f496414ae70 2023-11-18T20:37:42.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.636+0000 7f49617fa640 1 -- 172.21.15.161:0/410304694 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00ccc0 con 0x7f496414ae70 2023-11-18T20:37:42.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.636+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4964151750 con 0x7f496414ae70 2023-11-18T20:37:42.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.636+0000 7f49617fa640 1 -- 172.21.15.161:0/410304694 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c014680 con 0x7f496414ae70 2023-11-18T20:37:42.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.636+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49641500b0 con 0x7f496414ae70 2023-11-18T20:37:42.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.636+0000 7f49617fa640 1 -- 172.21.15.161:0/410304694 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f495c014ae0 con 0x7f496414ae70 2023-11-18T20:37:42.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.636+0000 7f49617fa640 1 -- 172.21.15.161:0/410304694 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f495c00ce30 con 0x7f496414ae70 2023-11-18T20:37:42.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.637+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496404e840 con 0x7f496414ae70 2023-11-18T20:37:42.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.639+0000 7f49617fa640 1 -- 172.21.15.161:0/410304694 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f495c019070 con 0x7f496414ae70 2023-11-18T20:37:42.670 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:42.669+0000 7fdb82e2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-18T20:37:42.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.717+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "959fb956-8654-4358-964a-457b1cec19ae", "id": 6} v 0) v1 -- 0x7f496406c720 con 0x7f496414ae70 2023-11-18T20:37:42.720 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:42.720+0000 7f892ff7a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-18T20:37:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.725+0000 7f49617fa640 1 -- 172.21.15.161:0/410304694 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "959fb956-8654-4358-964a-457b1cec19ae", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f495c01e440 con 0x7f496414ae70 2023-11-18T20:37:42.726 INFO:teuthology.orchestra.run.smithi161.stdout:6 2023-11-18T20:37:42.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f496414ae70 msgr2=0x7f496414a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 --2- 172.21.15.161:0/410304694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f496414ae70 0x7f496414a460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f495c00b970 tx=0x7f495c00be30 comp rx=0 tx=0).stop 2023-11-18T20:37:42.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 shutdown_connections 2023-11-18T20:37:42.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 --2- 172.21.15.161:0/410304694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f496414ae70 0x7f496414a460 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 --2- 172.21.15.161:0/410304694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49640bd530 0x7f4964149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 --2- 172.21.15.161:0/410304694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f496406b890 0x7f496414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 >> 172.21.15.161:0/410304694 conn(0x7f49640ab9e0 msgr2=0x7f49640abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:42.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 shutdown_connections 2023-11-18T20:37:42.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.727+0000 7f496936c640 1 -- 172.21.15.161:0/410304694 wait complete. 2023-11-18T20:37:42.744 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 5b1772e2-ce9f-4d33-8db0-59141959db75 7 2023-11-18T20:37:42.774 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:42.773+0000 7f892ff7a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-18T20:37:42.828 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:42.827+0000 7fdb82e2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-18T20:37:42.877 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:42.876+0000 7fdb82e2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-18T20:37:42.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.933+0000 7f6616844640 1 Processor -- start 2023-11-18T20:37:42.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.934+0000 7f6616844640 1 -- start start 2023-11-18T20:37:42.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f6616844640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6610151cc0 0x7f6610155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f6616844640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f66100c7ec0 0x7f6610157d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f6616844640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66101556d0 con 0x7f66100c4940 2023-11-18T20:37:42.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f6616844640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6610154740 con 0x7f66100c7ec0 2023-11-18T20:37:42.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f6616844640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661006c760 con 0x7f6610151cc0 2023-11-18T20:37:42.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f660f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f66100c7ec0 0x7f6610157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f660ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6610151cc0 0x7f6610155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f660f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f66100c7ec0 0x7f6610157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46868/0 (socket says 172.21.15.161:46868) 2023-11-18T20:37:42.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f6614de1640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f66100c4940 0x7f66100c69d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38832/0 (socket says 172.21.15.161:38832) 2023-11-18T20:37:42.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f6614de1640 1 -- 172.21.15.161:0/404501384 learned_addr learned my addr 172.21.15.161:0/404501384 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-18T20:37:42.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.935+0000 7f660ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6610151cc0 0x7f6610155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:56944/0 (socket says 172.21.15.161:56944) 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.936+0000 7f660f7fe640 1 -- 172.21.15.161:0/404501384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6610151cc0 msgr2=0x7f6610155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.936+0000 7f660f7fe640 1 --2- 172.21.15.161:0/404501384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6610151cc0 0x7f6610155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.936+0000 7f660f7fe640 1 -- 172.21.15.161:0/404501384 >> v1:172.21.15.161:6789/0 conn(0x7f66100c4940 legacy=0x7f66100c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.936+0000 7f660f7fe640 1 -- 172.21.15.161:0/404501384 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100c8470 con 0x7f66100c7ec0 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.936+0000 7f660ffff640 1 --2- 172.21.15.161:0/404501384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6610151cc0 0x7f6610155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.937+0000 7f660f7fe640 1 --2- 172.21.15.161:0/404501384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100c7ec0 0x7f6610157d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66040097a0 tx=0x7f660402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3cce3a471ba5462 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.937+0000 7f660effd640 1 -- 172.21.15.161:0/404501384 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660402d040 con 0x7f66100c7ec0 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.937+0000 7f660effd640 1 -- 172.21.15.161:0/404501384 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6604031810 con 0x7f66100c7ec0 2023-11-18T20:37:42.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.937+0000 7f660effd640 1 -- 172.21.15.161:0/404501384 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604031ba0 con 0x7f66100c7ec0 2023-11-18T20:37:42.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.938+0000 7f6616844640 1 -- 172.21.15.161:0/404501384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100c7ec0 msgr2=0x7f6610157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.938+0000 7f6616844640 1 --2- 172.21.15.161:0/404501384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100c7ec0 0x7f6610157d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66040097a0 tx=0x7f660402b8b0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.938+0000 7f6616844640 1 -- 172.21.15.161:0/404501384 shutdown_connections 2023-11-18T20:37:42.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.938+0000 7f6616844640 1 --2- 172.21.15.161:0/404501384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66100c7ec0 0x7f6610157d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.938+0000 7f6616844640 1 --2- 172.21.15.161:0/404501384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6610151cc0 0x7f6610155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.938+0000 7f6616844640 1 -- 172.21.15.161:0/404501384 >> 172.21.15.161:0/404501384 conn(0x7f6610071e10 msgr2=0x7f6610072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:42.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.938+0000 7f6616844640 1 -- 172.21.15.161:0/404501384 shutdown_connections 2023-11-18T20:37:42.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.938+0000 7f6616844640 1 -- 172.21.15.161:0/404501384 wait complete. 2023-11-18T20:37:42.940 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:42.939+0000 7f892ff7a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-18T20:37:42.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.940+0000 7f6616844640 1 Processor -- start 2023-11-18T20:37:42.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.940+0000 7f6616844640 1 -- start start 2023-11-18T20:37:42.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f6616844640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66100c4940 0x7f6610153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f6616844640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66100c7ec0 0x7f66101ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f6616844640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6610151cc0 0x7f66100aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f6616844640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6610150480 con 0x7f66100c7ec0 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f6616844640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66101eab40 con 0x7f6610151cc0 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f6616844640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66101ed0f0 con 0x7f66100c4940 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66100c4940 0x7f6610153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f6614de1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6610151cc0 0x7f66100aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66100c4940 0x7f6610153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:56958/0 (socket says 172.21.15.161:56958) 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660ffff640 1 -- 172.21.15.161:0/2307355681 learned_addr learned my addr 172.21.15.161:0/2307355681 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f6614de1640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6610151cc0 0x7f66100aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46878/0 (socket says 172.21.15.161:46878) 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660f7fe640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66100c7ec0 0x7f66101ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:42.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660ffff640 1 -- 172.21.15.161:0/2307355681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6610151cc0 msgr2=0x7f66100aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660ffff640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6610151cc0 0x7f66100aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660ffff640 1 -- 172.21.15.161:0/2307355681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66100c7ec0 msgr2=0x7f66101ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660ffff640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66100c7ec0 0x7f66101ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660ffff640 1 -- 172.21.15.161:0/2307355681 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600009400 con 0x7f66100c4940 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.941+0000 7f660f7fe640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66100c7ec0 0x7f66101ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.942+0000 7f660ffff640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66100c4940 0x7f6610153eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f660000ebe0 tx=0x7f660000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.942+0000 7f660cff9640 1 -- 172.21.15.161:0/2307355681 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600009760 con 0x7f66100c4940 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.942+0000 7f660cff9640 1 -- 172.21.15.161:0/2307355681 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660000cc30 con 0x7f66100c4940 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.942+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6604009400 con 0x7f66100c4940 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.942+0000 7f660cff9640 1 -- 172.21.15.161:0/2307355681 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660000eee0 con 0x7f66100c4940 2023-11-18T20:37:42.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.942+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66101ed3d0 con 0x7f66100c4940 2023-11-18T20:37:42.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.942+0000 7f660cff9640 1 -- 172.21.15.161:0/2307355681 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6600005c90 con 0x7f66100c4940 2023-11-18T20:37:42.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.942+0000 7f660cff9640 1 -- 172.21.15.161:0/2307355681 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6600013ba0 con 0x7f66100c4940 2023-11-18T20:37:42.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.943+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6610068350 con 0x7f66100c4940 2023-11-18T20:37:42.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:42.946+0000 7f660cff9640 1 -- 172.21.15.161:0/2307355681 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6600021060 con 0x7f66100c4940 2023-11-18T20:37:43.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.021+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5b1772e2-ce9f-4d33-8db0-59141959db75", "id": 7} v 0) v1 -- 0x7f661006c9c0 con 0x7f66100c4940 2023-11-18T20:37:43.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.029+0000 7f660cff9640 1 -- 172.21.15.161:0/2307355681 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b1772e2-ce9f-4d33-8db0-59141959db75", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6600017070 con 0x7f66100c4940 2023-11-18T20:37:43.030 INFO:teuthology.orchestra.run.smithi161.stdout:7 2023-11-18T20:37:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.030+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66100c4940 msgr2=0x7f6610153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.030+0000 7f6616844640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66100c4940 0x7f6610153eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f660000ebe0 tx=0x7f660000c520 comp rx=0 tx=0).stop 2023-11-18T20:37:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.031+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 shutdown_connections 2023-11-18T20:37:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.031+0000 7f6616844640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6610151cc0 0x7f66100aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.031+0000 7f6616844640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66100c7ec0 0x7f66101ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.031+0000 7f6616844640 1 --2- 172.21.15.161:0/2307355681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66100c4940 0x7f6610153eb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.031+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 >> 172.21.15.161:0/2307355681 conn(0x7f6610071e10 msgr2=0x7f6610158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.031+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 shutdown_connections 2023-11-18T20:37:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-18T20:37:43.031+0000 7f6616844640 1 -- 172.21.15.161:0/2307355681 wait complete. 2023-11-18T20:37:43.034 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:43.033+0000 7fdb82e2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-18T20:37:43.047 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-18T20:37:43.047 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-18T20:37:43.055 INFO:tasks.ceph.osd.0:Started 2023-11-18T20:37:43.056 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-18T20:37:43.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-18T20:37:43.063 INFO:tasks.ceph.osd.1:Started 2023-11-18T20:37:43.063 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-18T20:37:43.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-18T20:37:43.070 INFO:tasks.ceph.osd.2:Started 2023-11-18T20:37:43.070 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-18T20:37:43.070 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-18T20:37:43.076 INFO:tasks.ceph.osd.3:Started 2023-11-18T20:37:43.076 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-18T20:37:43.076 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-18T20:37:43.095 INFO:tasks.ceph.osd.4:Started 2023-11-18T20:37:43.096 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-18T20:37:43.096 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-18T20:37:43.103 INFO:tasks.ceph.osd.5:Started 2023-11-18T20:37:43.104 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-18T20:37:43.104 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-18T20:37:43.109 INFO:tasks.ceph.osd.6:Started 2023-11-18T20:37:43.110 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-18T20:37:43.110 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-18T20:37:43.115 INFO:tasks.ceph.osd.7:Started 2023-11-18T20:37:43.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:37:43.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.342+0000 7fc7bf24b640 1 Processor -- start 2023-11-18T20:37:43.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.342+0000 7fc7bf24b640 1 -- start start 2023-11-18T20:37:43.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.343+0000 7fc7bf24b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7b806d0a0 0x7fc7b8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:43.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.343+0000 7fc7bf24b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7b80c3ea0 0x7fc7b80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:43.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.343+0000 7fc7bf24b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b80c64a0 con 0x7fc7b814fd30 2023-11-18T20:37:43.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.343+0000 7fc7bf24b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b80c5c00 con 0x7fc7b806d0a0 2023-11-18T20:37:43.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.343+0000 7fc7bf24b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b80c5ee0 con 0x7fc7b80c3ea0 2023-11-18T20:37:43.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.343+0000 7fc7b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7b806d0a0 0x7fc7b8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:43.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.344+0000 7fc7b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7b806d0a0 0x7fc7b8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54274/0 (socket says 172.21.15.132:54274) 2023-11-18T20:37:43.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.344+0000 7fc7b7fff640 1 -- 172.21.15.132:0/3236486689 learned_addr learned my addr 172.21.15.132:0/3236486689 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:43.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.344+0000 7fc7bd7e8640 1 --2- 172.21.15.132:0/3236486689 >> v2:172.21.15.161:3300/0 conn(0x7fc7b80c3ea0 0x7fc7b80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:43.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.344+0000 7fc7b7fff640 1 -- 172.21.15.132:0/3236486689 >> v2:172.21.15.161:3300/0 conn(0x7fc7b80c3ea0 msgr2=0x7fc7b80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:43.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.344+0000 7fc7b7fff640 1 --2- 172.21.15.132:0/3236486689 >> v2:172.21.15.161:3300/0 conn(0x7fc7b80c3ea0 0x7fc7b80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.344+0000 7fc7b7fff640 1 -- 172.21.15.132:0/3236486689 >> v1:172.21.15.132:6789/0 conn(0x7fc7b814fd30 legacy=0x7fc7b80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:43.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.344+0000 7fc7b7fff640 1 -- 172.21.15.132:0/3236486689 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b80c61c0 con 0x7fc7b806d0a0 2023-11-18T20:37:43.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.345+0000 7fc7b7fff640 1 --2- 172.21.15.132:0/3236486689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b806d0a0 0x7fc7b8152f20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc7b806e430 tx=0x7fc7a802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb0bc05594deeb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:43.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.345+0000 7fc7b77fe640 1 -- 172.21.15.132:0/3236486689 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8030860 con 0x7fc7b806d0a0 2023-11-18T20:37:43.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.345+0000 7fc7b77fe640 1 -- 172.21.15.132:0/3236486689 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a80309c0 con 0x7fc7b806d0a0 2023-11-18T20:37:43.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.345+0000 7fc7b77fe640 1 -- 172.21.15.132:0/3236486689 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8030d50 con 0x7fc7b806d0a0 2023-11-18T20:37:43.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.346+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3236486689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b806d0a0 msgr2=0x7fc7b8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:43.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.346+0000 7fc7bf24b640 1 --2- 172.21.15.132:0/3236486689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b806d0a0 0x7fc7b8152f20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc7b806e430 tx=0x7fc7a802b9a0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.346+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3236486689 shutdown_connections 2023-11-18T20:37:43.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.346+0000 7fc7bf24b640 1 --2- 172.21.15.132:0/3236486689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b806d0a0 0x7fc7b8152f20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.346+0000 7fc7bf24b640 1 --2- 172.21.15.132:0/3236486689 >> v2:172.21.15.161:3300/0 conn(0x7fc7b80c3ea0 0x7fc7b80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.346+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3236486689 >> 172.21.15.132:0/3236486689 conn(0x7fc7b806a500 msgr2=0x7fc7b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:43.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.346+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3236486689 shutdown_connections 2023-11-18T20:37:43.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.346+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3236486689 wait complete. 2023-11-18T20:37:43.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.348+0000 7fc7bf24b640 1 Processor -- start 2023-11-18T20:37:43.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.348+0000 7fc7bf24b640 1 -- start start 2023-11-18T20:37:43.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bf24b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b806d0a0 0x7fc7b81ea550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:43.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bf24b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80c3ea0 0x7fc7b80bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bf24b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b814fd30 0x7fc7b80a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bf24b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81513e0 con 0x7fc7b814fd30 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bf24b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81507d0 con 0x7fc7b80c3ea0 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bf24b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8150ab0 con 0x7fc7b806d0a0 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bd7e8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b814fd30 0x7fc7b80a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bcfe7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b806d0a0 0x7fc7b81ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bd7e8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b814fd30 0x7fc7b80a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54282/0 (socket says 172.21.15.132:54282) 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bcfe7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b806d0a0 0x7fc7b81ea550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:58858/0 (socket says 172.21.15.132:58858) 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bd7e8640 1 -- 172.21.15.132:0/3005102758 learned_addr learned my addr 172.21.15.132:0/3005102758 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:43.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7b7fff640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80c3ea0 0x7fc7b80bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:43.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bcfe7640 1 -- 172.21.15.132:0/3005102758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80c3ea0 msgr2=0x7fc7b80bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:43.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bcfe7640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80c3ea0 0x7fc7b80bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bcfe7640 1 -- 172.21.15.132:0/3005102758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b814fd30 msgr2=0x7fc7b80a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:43.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bcfe7640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b814fd30 0x7fc7b80a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bcfe7640 1 -- 172.21.15.132:0/3005102758 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a80094d0 con 0x7fc7b806d0a0 2023-11-18T20:37:43.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.349+0000 7fc7bd7e8640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b814fd30 0x7fc7b80a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:37:43.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.350+0000 7fc7bcfe7640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b806d0a0 0x7fc7b81ea550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00c390 tx=0x7fc7ac00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:43.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.350+0000 7fc7b57fa640 1 -- 172.21.15.132:0/3005102758 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0052d0 con 0x7fc7b806d0a0 2023-11-18T20:37:43.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.350+0000 7fc7b57fa640 1 -- 172.21.15.132:0/3005102758 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac005430 con 0x7fc7b806d0a0 2023-11-18T20:37:43.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.350+0000 7fc7b57fa640 1 -- 172.21.15.132:0/3005102758 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac003830 con 0x7fc7b806d0a0 2023-11-18T20:37:43.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.350+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b8150d90 con 0x7fc7b806d0a0 2023-11-18T20:37:43.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.350+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b80bf8a0 con 0x7fc7b806d0a0 2023-11-18T20:37:43.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.350+0000 7fc7b57fa640 1 -- 172.21.15.132:0/3005102758 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc7ac003c90 con 0x7fc7b806d0a0 2023-11-18T20:37:43.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.350+0000 7fc7b57fa640 1 -- 172.21.15.132:0/3005102758 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc7ac012420 con 0x7fc7b806d0a0 2023-11-18T20:37:43.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.351+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b80a8900 con 0x7fc7b806d0a0 2023-11-18T20:37:43.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.354+0000 7fc7b57fa640 1 -- 172.21.15.132:0/3005102758 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc7ac017070 con 0x7fc7b806d0a0 2023-11-18T20:37:43.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.417+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b8068350 con 0x7fc7b806d0a0 2023-11-18T20:37:43.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.419+0000 7fc7b57fa640 1 -- 172.21.15.132:0/3005102758 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc7ac011590 con 0x7fc7b806d0a0 2023-11-18T20:37:43.421 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:37:43.421 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":10,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:37:43.023466+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:37:43.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b806d0a0 msgr2=0x7fc7b81ea550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:43.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b806d0a0 0x7fc7b81ea550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00c390 tx=0x7fc7ac00c850 comp rx=0 tx=0).stop 2023-11-18T20:37:43.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 shutdown_connections 2023-11-18T20:37:43.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b814fd30 0x7fc7b80a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80c3ea0 0x7fc7b80bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 --2- 172.21.15.132:0/3005102758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b806d0a0 0x7fc7b81ea550 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:43.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 >> 172.21.15.132:0/3005102758 conn(0x7fc7b806a500 msgr2=0x7fc7b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:43.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 shutdown_connections 2023-11-18T20:37:43.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:43.421+0000 7fc7bf24b640 1 -- 172.21.15.132:0/3005102758 wait complete. 2023-11-18T20:37:43.437 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-18T20:37:43.437 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-18T20:37:43.759 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-11-18T20:37:43.758+0000 7f135411a500 -1 Falling back to public interface 2023-11-18T20:37:43.788 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-11-18T20:37:43.788+0000 7f2c4fe14500 -1 Falling back to public interface 2023-11-18T20:37:43.789 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-11-18T20:37:43.788+0000 7fb31360c500 -1 Falling back to public interface 2023-11-18T20:37:43.794 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-11-18T20:37:43.793+0000 7f4064b4a500 -1 Falling back to public interface 2023-11-18T20:37:43.797 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-11-18T20:37:43.796+0000 7fa5aca1f500 -1 Falling back to public interface 2023-11-18T20:37:43.799 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-11-18T20:37:43.798+0000 7f5fe3748500 -1 Falling back to public interface 2023-11-18T20:37:43.814 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-11-18T20:37:43.814+0000 7fcaadd9f500 -1 Falling back to public interface 2023-11-18T20:37:43.837 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-11-18T20:37:43.836+0000 7f374d265500 -1 Falling back to public interface 2023-11-18T20:37:44.083 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:44.083+0000 7f892ff7a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-18T20:37:44.120 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:44.119+0000 7fdb82e2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-18T20:37:44.243 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T20:37:44.399 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.398+0000 7fe32f11d640 1 Processor -- start 2023-11-18T20:37:44.399 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.398+0000 7fe32f11d640 1 -- start start 2023-11-18T20:37:44.400 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.399+0000 7fe32f11d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32814fac0 0x7fe32806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:44.400 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.399+0000 7fe32f11d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3280c52b0 0x7fe3280a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:44.401 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.399+0000 7fe32f11d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3280c5a20 con 0x7fe32806bd30 2023-11-18T20:37:44.401 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.399+0000 7fe32f11d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32814fea0 con 0x7fe3280c52b0 2023-11-18T20:37:44.401 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.399+0000 7fe32f11d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280c5740 con 0x7fe32814fac0 2023-11-18T20:37:44.401 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.399+0000 7fe327fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3280c52b0 0x7fe3280a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:44.401 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.400+0000 7fe32ceb9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32814fac0 0x7fe32806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:44.401 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.400+0000 7fe327fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3280c52b0 0x7fe3280a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:35930/0 (socket says 172.21.15.132:35930) 2023-11-18T20:37:44.401 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.400+0000 7fe327fff640 1 -- 172.21.15.132:0/358955974 learned_addr learned my addr 172.21.15.132:0/358955974 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:44.401 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.400+0000 7fe327fff640 1 -- 172.21.15.132:0/358955974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32814fac0 msgr2=0x7fe32806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:44.402 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.400+0000 7fe327fff640 1 --2- 172.21.15.132:0/358955974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32814fac0 0x7fe32806e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:44.402 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.400+0000 7fe327fff640 1 -- 172.21.15.132:0/358955974 >> v1:172.21.15.161:6789/0 conn(0x7fe32806bd30 legacy=0x7fe3280c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:44.402 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.400+0000 7fe327fff640 1 -- 172.21.15.132:0/358955974 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328152620 con 0x7fe3280c52b0 2023-11-18T20:37:44.402 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.401+0000 7fe327fff640 1 --2- 172.21.15.132:0/358955974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280c52b0 0x7fe3280a4d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe314009870 tx=0x7fe31402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b5125820ba70d4f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:44.403 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.401+0000 7fe3277fe640 1 -- 172.21.15.132:0/358955974 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140317c0 con 0x7fe3280c52b0 2023-11-18T20:37:44.403 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe3277fe640 1 -- 172.21.15.132:0/358955974 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe314031920 con 0x7fe3280c52b0 2023-11-18T20:37:44.403 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe3277fe640 1 -- 172.21.15.132:0/358955974 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314031cb0 con 0x7fe3280c52b0 2023-11-18T20:37:44.403 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe32f11d640 1 -- 172.21.15.132:0/358955974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280c52b0 msgr2=0x7fe3280a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:44.404 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe32f11d640 1 --2- 172.21.15.132:0/358955974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280c52b0 0x7fe3280a4d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe314009870 tx=0x7fe31402b860 comp rx=0 tx=0).stop 2023-11-18T20:37:44.404 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe32f11d640 1 -- 172.21.15.132:0/358955974 shutdown_connections 2023-11-18T20:37:44.404 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe32f11d640 1 --2- 172.21.15.132:0/358955974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280c52b0 0x7fe3280a4d20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:44.404 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe32f11d640 1 --2- 172.21.15.132:0/358955974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32814fac0 0x7fe32806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:44.404 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe32f11d640 1 -- 172.21.15.132:0/358955974 >> 172.21.15.132:0/358955974 conn(0x7fe3280c5cc0 msgr2=0x7fe3280c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:44.404 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe32f11d640 1 -- 172.21.15.132:0/358955974 shutdown_connections 2023-11-18T20:37:44.404 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.402+0000 7fe32f11d640 1 -- 172.21.15.132:0/358955974 wait complete. 2023-11-18T20:37:44.405 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.404+0000 7fe32f11d640 1 Processor -- start 2023-11-18T20:37:44.405 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.404+0000 7fe32f11d640 1 -- start start 2023-11-18T20:37:44.406 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32f11d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32806bd30 0x7fe328071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32f11d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe32814fac0 0x7fe328070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32f11d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280702c0 0x7fe3281ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32f11d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe328071e60 con 0x7fe32814fac0 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32f11d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281dc1f0 con 0x7fe3280702c0 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32f11d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281eaad0 con 0x7fe32806bd30 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32d6ba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280702c0 0x7fe3281ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe327fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe32814fac0 0x7fe328070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32d6ba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280702c0 0x7fe3281ddce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:35942/0 (socket says 172.21.15.132:35942) 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32d6ba640 1 -- 172.21.15.132:0/3361311817 learned_addr learned my addr 172.21.15.132:0/3361311817 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.405+0000 7fe32ceb9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32806bd30 0x7fe328071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:44.407 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe32d6ba640 1 -- 172.21.15.132:0/3361311817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32806bd30 msgr2=0x7fe328071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:44.408 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe32d6ba640 1 --2- 172.21.15.132:0/3361311817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32806bd30 0x7fe328071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:44.408 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe32d6ba640 1 -- 172.21.15.132:0/3361311817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe32814fac0 msgr2=0x7fe328070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:44.408 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe32d6ba640 1 --2- 172.21.15.132:0/3361311817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe32814fac0 0x7fe328070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:44.408 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe32d6ba640 1 -- 172.21.15.132:0/3361311817 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140094d0 con 0x7fe3280702c0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe32d6ba640 1 --2- 172.21.15.132:0/3361311817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280702c0 0x7fe3281ddce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe32000c760 tx=0x7fe32000cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe3257fa640 1 -- 172.21.15.132:0/3361311817 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320003b70 con 0x7fe3280702c0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe3257fa640 1 -- 172.21.15.132:0/3361311817 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320003cd0 con 0x7fe3280702c0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe3257fa640 1 -- 172.21.15.132:0/3361311817 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000aa90 con 0x7fe3280702c0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3280c2950 con 0x7fe3280702c0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.406+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3281dc440 con 0x7fe3280702c0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.407+0000 7fe3257fa640 1 -- 172.21.15.132:0/3361311817 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe3200050d0 con 0x7fe3280702c0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.407+0000 7fe3257fa640 1 -- 172.21.15.132:0/3361311817 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe320012af0 con 0x7fe3280702c0 2023-11-18T20:37:44.409 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.407+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32806ffe0 con 0x7fe3280702c0 2023-11-18T20:37:44.411 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.410+0000 7fe3257fa640 1 -- 172.21.15.132:0/3361311817 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe32806ffe0 con 0x7fe3280702c0 2023-11-18T20:37:44.419 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:44.419+0000 7f892ff7a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-18T20:37:44.434 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:44.433+0000 7fdb82e2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-18T20:37:44.477 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.476+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3280682f0 con 0x7fe3280702c0 2023-11-18T20:37:44.479 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.478+0000 7fe3257fa640 1 -- 172.21.15.132:0/3361311817 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe320012dd0 con 0x7fe3280702c0 2023-11-18T20:37:44.479 INFO:teuthology.misc.health.smithi132.stdout: 2023-11-18T20:37:44.479 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":10,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:37:43.023466+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:37:44.480 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.479+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280702c0 msgr2=0x7fe3281ddce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:44.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.479+0000 7fe32f11d640 1 --2- 172.21.15.132:0/3361311817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280702c0 0x7fe3281ddce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe32000c760 tx=0x7fe32000cc20 comp rx=0 tx=0).stop 2023-11-18T20:37:44.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.479+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 shutdown_connections 2023-11-18T20:37:44.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.479+0000 7fe32f11d640 1 --2- 172.21.15.132:0/3361311817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3280702c0 0x7fe3281ddce0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:44.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.479+0000 7fe32f11d640 1 --2- 172.21.15.132:0/3361311817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe32814fac0 0x7fe328070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:44.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.479+0000 7fe32f11d640 1 --2- 172.21.15.132:0/3361311817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32806bd30 0x7fe328071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:44.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.479+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 >> 172.21.15.132:0/3361311817 conn(0x7fe3280c5cc0 msgr2=0x7fe32814de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:44.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.480+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 shutdown_connections 2023-11-18T20:37:44.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:44.480+0000 7fe32f11d640 1 -- 172.21.15.132:0/3361311817 wait complete. 2023-11-18T20:37:44.485 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:44.484+0000 7f892ff7a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-18T20:37:44.493 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-18T20:37:44.496 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:44.496+0000 7fdb82e2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-18T20:37:44.598 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:44.597+0000 7f892ff7a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-18T20:37:44.611 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-11-18T20:37:44.610+0000 7fdb82e2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-18T20:37:45.649 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:45.648+0000 7f88d005a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-18T20:37:45.649 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-11-18T20:37:45.649+0000 7f88d005a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-18T20:37:47.356 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-11-18T20:37:47.355+0000 7f2c4fe14500 -1 osd.4 0 log_to_monitors true 2023-11-18T20:37:47.362 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-11-18T20:37:47.362+0000 7f4064b4a500 -1 osd.2 0 log_to_monitors true 2023-11-18T20:37:47.395 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-11-18T20:37:47.394+0000 7fb31360c500 -1 osd.1 0 log_to_monitors true 2023-11-18T20:37:47.409 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-11-18T20:37:47.408+0000 7fcaadd9f500 -1 osd.5 0 log_to_monitors true 2023-11-18T20:37:47.544 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-11-18T20:37:47.544+0000 7f135411a500 -1 osd.0 0 log_to_monitors true 2023-11-18T20:37:47.624 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-11-18T20:37:47.623+0000 7f5fe3748500 -1 osd.7 0 log_to_monitors true 2023-11-18T20:37:47.630 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-11-18T20:37:47.629+0000 7fa5aca1f500 -1 osd.3 0 log_to_monitors true 2023-11-18T20:37:47.674 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-11-18T20:37:47.673+0000 7f374d265500 -1 osd.6 0 log_to_monitors true 2023-11-18T20:37:50.666 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-11-18T20:37:50.665+0000 7f13510bd640 -1 osd.0 0 waiting for initial osdmap 2023-11-18T20:37:50.676 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-11-18T20:37:50.675+0000 7f1347ebe640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:37:50.717 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-11-18T20:37:50.717+0000 7f5fdeeb3640 -1 osd.7 0 waiting for initial osdmap 2023-11-18T20:37:50.723 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-11-18T20:37:50.722+0000 7f5fd74ec640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:37:50.751 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-11-18T20:37:50.751+0000 7f40602b7640 -1 osd.2 0 waiting for initial osdmap 2023-11-18T20:37:50.753 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-11-18T20:37:50.752+0000 7fb30e6a9640 -1 osd.1 0 waiting for initial osdmap 2023-11-18T20:37:50.761 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-11-18T20:37:50.760+0000 7f40588f0640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:37:50.773 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-11-18T20:37:50.773+0000 7fcaa950c640 -1 osd.5 0 waiting for initial osdmap 2023-11-18T20:37:50.775 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-11-18T20:37:50.774+0000 7fb306ce2640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:37:50.784 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-11-18T20:37:50.783+0000 7f2c4c78c640 -1 osd.4 0 waiting for initial osdmap 2023-11-18T20:37:50.785 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-11-18T20:37:50.783+0000 7fcaa1b45640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:37:50.791 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-11-18T20:37:50.790+0000 7f2c4358d640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:37:51.062 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-11-18T20:37:51.061+0000 7fa5a7b3e640 -1 osd.3 0 waiting for initial osdmap 2023-11-18T20:37:51.080 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-11-18T20:37:51.079+0000 7fa5a0177640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:37:51.130 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-11-18T20:37:51.129+0000 7f374a208640 -1 osd.6 0 waiting for initial osdmap 2023-11-18T20:37:51.140 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-11-18T20:37:51.140+0000 7f3741009640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:37:51.299 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T20:37:51.479 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.478+0000 7f8e27cda640 1 Processor -- start 2023-11-18T20:37:51.479 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.478+0000 7f8e27cda640 1 -- start start 2023-11-18T20:37:51.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.479+0000 7f8e27cda640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8e200aa9c0 0x7f8e200a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e27cda640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e200a8d70 0x7f8e200aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e27cda640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e200c3e30 con 0x7f8e20071f40 2023-11-18T20:37:51.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e27cda640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e200c1dc0 con 0x7f8e200aa9c0 2023-11-18T20:37:51.481 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e27cda640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200c4e50 con 0x7f8e200a8d70 2023-11-18T20:37:51.482 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e26277640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8e20071f40 0x7f8e200c4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37168/0 (socket says 172.21.15.132:37168) 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e26277640 1 -- 172.21.15.132:0/2508349823 learned_addr learned my addr 172.21.15.132:0/2508349823 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e25a76640 1 --2- 172.21.15.132:0/2508349823 >> v2:172.21.15.161:3300/0 conn(0x7f8e200aa9c0 0x7f8e200a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e25275640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e200a8d70 0x7f8e200aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.480+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981650389 0 0) 0x7f8e18001490 con 0x7f8e20071f40 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0c003520 con 0x7f8e20071f40 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 989280801 0 0) 0x7f8e0c003520 con 0x7f8e20071f40 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e200a8d70 msgr2=0x7f8e200aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e200a8d70 0x7f8e200aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 >> v2:172.21.15.161:3300/0 conn(0x7f8e200aa9c0 msgr2=0x7f8e200a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 --2- 172.21.15.132:0/2508349823 >> v2:172.21.15.161:3300/0 conn(0x7f8e200aa9c0 0x7f8e200a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.483 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200c10d0 con 0x7f8e20071f40 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f8e18001b80 con 0x7f8e20071f40 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 >> v1:172.21.15.132:6789/0 conn(0x7f8e20071f40 legacy=0x7f8e200c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e200a8d70 0x7f8e0c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e0c003f20 0x7f8e0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c004d00 0x7f8e0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200c4e50 con 0x7f8e0c003f20 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c00b980 con 0x7f8e0c004d00 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c00bb40 con 0x7f8e200a8d70 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.481+0000 7f8e25275640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e0c003f20 0x7f8e0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.482+0000 7f8e26277640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c004d00 0x7f8e0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.482+0000 7f8e25a76640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e200a8d70 0x7f8e0c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.484 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.482+0000 7f8e25275640 1 -- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e200a8d70 msgr2=0x7f8e0c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:51.485 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.482+0000 7f8e25275640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e200a8d70 0x7f8e0c0039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.485 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.482+0000 7f8e25275640 1 -- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c004d00 msgr2=0x7f8e0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:51.485 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.482+0000 7f8e25275640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c004d00 0x7f8e0c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.485 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.482+0000 7f8e25275640 1 -- 172.21.15.132:0/2508349823 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c003520 con 0x7f8e0c003f20 2023-11-18T20:37:51.486 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e25275640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e0c003f20 0x7f8e0c0047c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009ac0 tx=0x7f8e0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e141e8dfd73b684c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:51.486 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1002c6b0 con 0x7f8e0c003f20 2023-11-18T20:37:51.486 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1002c810 con 0x7f8e0c003f20 2023-11-18T20:37:51.486 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e24a74640 1 -- 172.21.15.132:0/2508349823 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1002cba0 con 0x7f8e0c003f20 2023-11-18T20:37:51.486 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e27cda640 1 -- 172.21.15.132:0/2508349823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e0c003f20 msgr2=0x7f8e0c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.486 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e27cda640 1 --2- 172.21.15.132:0/2508349823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e0c003f20 0x7f8e0c0047c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009ac0 tx=0x7f8e0c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.487 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e26277640 1 -- 172.21.15.132:0/2508349823 reap_dead start 2023-11-18T20:37:51.487 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e27cda640 1 -- 172.21.15.132:0/2508349823 shutdown_connections 2023-11-18T20:37:51.487 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.483+0000 7f8e27cda640 1 -- 172.21.15.132:0/2508349823 >> 172.21.15.132:0/2508349823 conn(0x7f8e200c5cc0 msgr2=0x7f8e200c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:51.487 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.484+0000 7f8e27cda640 1 -- 172.21.15.132:0/2508349823 shutdown_connections 2023-11-18T20:37:51.487 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.484+0000 7f8e27cda640 1 -- 172.21.15.132:0/2508349823 wait complete. 2023-11-18T20:37:51.487 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.485+0000 7f8e27cda640 1 Processor -- start 2023-11-18T20:37:51.487 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.485+0000 7f8e27cda640 1 -- start start 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.486+0000 7f8e27cda640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c003f20 0x7f8e201da920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.486+0000 7f8e27cda640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e201d4360 0x7f8e201ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.486+0000 7f8e27cda640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e201d6df0 0x7f8e201d7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.486+0000 7f8e27cda640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201dbea0 con 0x7f8e201d6df0 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.486+0000 7f8e27cda640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201daf00 con 0x7f8e0c003f20 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.486+0000 7f8e27cda640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2006ffc0 con 0x7f8e201d4360 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.486+0000 7f8e26277640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e201d6df0 0x7f8e201d7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e26277640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e201d6df0 0x7f8e201d7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55632/0 (socket says 172.21.15.132:55632) 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e26277640 1 -- 172.21.15.132:0/3596087917 learned_addr learned my addr 172.21.15.132:0/3596087917 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:51.489 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e25a76640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c003f20 0x7f8e201da920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e25275640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e201d4360 0x7f8e201ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e26277640 1 -- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e201d4360 msgr2=0x7f8e201ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e26277640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e201d4360 0x7f8e201ee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e26277640 1 -- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c003f20 msgr2=0x7f8e201da920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e26277640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c003f20 0x7f8e201da920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e26277640 1 -- 172.21.15.132:0/3596087917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e201eec40 con 0x7f8e201d6df0 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e25a76640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c003f20 0x7f8e201da920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e26277640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e201d6df0 0x7f8e201d7270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e180012e0 tx=0x7f8e1800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e167fc640 1 -- 172.21.15.132:0/3596087917 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18001b60 con 0x7f8e201d6df0 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e167fc640 1 -- 172.21.15.132:0/3596087917 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1800bb80 con 0x7f8e201d6df0 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e201d47e0 con 0x7f8e201d6df0 2023-11-18T20:37:51.490 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.487+0000 7f8e167fc640 1 -- 172.21.15.132:0/3596087917 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18007110 con 0x7f8e201d6df0 2023-11-18T20:37:51.491 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.488+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e201dbbc0 con 0x7f8e201d6df0 2023-11-18T20:37:51.491 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.489+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2006fe20 con 0x7f8e201d6df0 2023-11-18T20:37:51.491 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.489+0000 7f8e167fc640 1 -- 172.21.15.132:0/3596087917 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f8e18007270 con 0x7f8e201d6df0 2023-11-18T20:37:51.491 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.490+0000 7f8e167fc640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e0406adb0 0x7f8e0406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.491 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.490+0000 7f8e167fc640 1 -- 172.21.15.132:0/3596087917 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f8e18088820 con 0x7f8e201d6df0 2023-11-18T20:37:51.492 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.491+0000 7f8e25a76640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e0406adb0 0x7f8e0406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.492 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.492+0000 7f8e25a76640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e0406adb0 0x7f8e0406d270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009a60 tx=0x7f8e1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:51.496 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.495+0000 7f8e167fc640 1 -- 172.21.15.132:0/3596087917 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e2006fe20 con 0x7f8e201d6df0 2023-11-18T20:37:51.677 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.676+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e201dd540 con 0x7f8e201d6df0 2023-11-18T20:37:51.682 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.681+0000 7f8e167fc640 1 -- 172.21.15.132:0/3596087917 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10944 (secure 0 0 0) 0x7f8e201dd540 con 0x7f8e201d6df0 2023-11-18T20:37:51.682 INFO:teuthology.misc.health.smithi132.stdout: 2023-11-18T20:37:51.683 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":14,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:37:51.669660+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:37:51.685 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e0406adb0 msgr2=0x7f8e0406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.685 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e0406adb0 0x7f8e0406d270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009a60 tx=0x7f8e1c008040 comp rx=0 tx=0).stop 2023-11-18T20:37:51.685 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e201d6df0 msgr2=0x7f8e201d7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.685 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e201d6df0 0x7f8e201d7270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e180012e0 tx=0x7f8e1800b4a0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.686 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 shutdown_connections 2023-11-18T20:37:51.686 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e0406adb0 0x7f8e0406d270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.686 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e201d6df0 0x7f8e201d7270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.686 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e201d4360 0x7f8e201ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.686 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 --2- 172.21.15.132:0/3596087917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e0c003f20 0x7f8e201da920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.686 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 >> 172.21.15.132:0/3596087917 conn(0x7f8e200c5cc0 msgr2=0x7f8e200717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:51.686 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.684+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 shutdown_connections 2023-11-18T20:37:51.686 INFO:teuthology.misc.health.smithi132.stderr:2023-11-18T20:37:51.685+0000 7f8e27cda640 1 -- 172.21.15.132:0/3596087917 wait complete. 2023-11-18T20:37:51.704 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-18T20:37:51.704 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-18T20:37:51.704 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-18T20:37:51.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-18T20:37:51.709 INFO:tasks.ceph.mds.a:Started 2023-11-18T20:37:51.709 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-18T20:37:51.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-18T20:37:51.713 INFO:tasks.ceph.mds.c:Started 2023-11-18T20:37:51.714 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-18T20:37:51.714 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-18T20:37:51.719 INFO:tasks.ceph.mds.b:Started 2023-11-18T20:37:51.719 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-18T20:37:51.719 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-18T20:37:51.724 INFO:tasks.ceph.mds.d:Started 2023-11-18T20:37:51.725 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-18T20:37:51.725 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:37:51.853 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-11-18T20:37:51.856 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-11-18T20:37:51.871 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-11-18T20:37:51.876 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-11-18T20:37:51.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.899+0000 7fcfe27a9640 1 Processor -- start 2023-11-18T20:37:51.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.899+0000 7fcfe27a9640 1 -- start start 2023-11-18T20:37:51.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.900+0000 7fcfe27a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcfdc155190 0x7fcfdc1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.900+0000 7fcfe27a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc154740 con 0x7fcfdc151cc0 2023-11-18T20:37:51.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.900+0000 7fcfe27a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc06c760 con 0x7fcfdc0c7ec0 2023-11-18T20:37:51.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.900+0000 7fcfe27a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfdc0c8470 con 0x7fcfdc155190 2023-11-18T20:37:51.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.900+0000 7fcfdbfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcfdc151cc0 0x7fcfdc157d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37186/0 (socket says 172.21.15.132:37186) 2023-11-18T20:37:51.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.900+0000 7fcfdbfff640 1 -- 172.21.15.132:0/3152139837 learned_addr learned my addr 172.21.15.132:0/3152139837 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:37:51.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfe0d46640 1 --2- 172.21.15.132:0/3152139837 >> v2:172.21.15.132:3300/0 conn(0x7fcfdc155190 0x7fcfdc1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfdaffd640 1 -- 172.21.15.132:0/3152139837 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864051035 0 0) 0x7fcfdc154740 con 0x7fcfdc151cc0 2023-11-18T20:37:51.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfdaffd640 1 -- 172.21.15.132:0/3152139837 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc4003520 con 0x7fcfdc151cc0 2023-11-18T20:37:51.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfdaffd640 1 -- 172.21.15.132:0/3152139837 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993515085 0 0) 0x7fcfdc06c760 con 0x7fcfdc0c7ec0 2023-11-18T20:37:51.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfdaffd640 1 -- 172.21.15.132:0/3152139837 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfdc154740 con 0x7fcfdc0c7ec0 2023-11-18T20:37:51.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfe0d46640 1 -- 172.21.15.132:0/3152139837 >> v1:172.21.15.161:6789/0 conn(0x7fcfdc0c7ec0 legacy=0x7fcfdc0c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfe0d46640 1 -- 172.21.15.132:0/3152139837 >> v1:172.21.15.132:6789/0 conn(0x7fcfdc151cc0 legacy=0x7fcfdc157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfdaffd640 1 -- 172.21.15.132:0/3152139837 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142615252 0 0) 0x7fcfc4003520 con 0x7fcfdc151cc0 2023-11-18T20:37:51.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.901+0000 7fcfe0d46640 1 -- 172.21.15.132:0/3152139837 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0c8750 con 0x7fcfdc155190 2023-11-18T20:37:51.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.902+0000 7fcfe0d46640 1 --2- 172.21.15.132:0/3152139837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1600d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009d90 tx=0x7fcfd402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f944f32bd661a08b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:51.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.902+0000 7fcfdaffd640 1 -- 172.21.15.132:0/3152139837 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc001670 con 0x7fcfdc155190 2023-11-18T20:37:51.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.902+0000 7fcfdaffd640 1 -- 172.21.15.132:0/3152139837 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd402c940 con 0x7fcfdc155190 2023-11-18T20:37:51.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.902+0000 7fcfdaffd640 1 -- 172.21.15.132:0/3152139837 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd402ccd0 con 0x7fcfdc155190 2023-11-18T20:37:51.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.903+0000 7fcfe27a9640 1 -- 172.21.15.132:0/3152139837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 msgr2=0x7fcfdc1600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.903+0000 7fcfe27a9640 1 --2- 172.21.15.132:0/3152139837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1600d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009d90 tx=0x7fcfd402be10 comp rx=0 tx=0).stop 2023-11-18T20:37:51.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.903+0000 7fcfe27a9640 1 -- 172.21.15.132:0/3152139837 shutdown_connections 2023-11-18T20:37:51.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.903+0000 7fcfe27a9640 1 --2- 172.21.15.132:0/3152139837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1600d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.903+0000 7fcfe27a9640 1 -- 172.21.15.132:0/3152139837 >> 172.21.15.132:0/3152139837 conn(0x7fcfdc071e10 msgr2=0x7fcfdc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:51.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.903+0000 7fcfe27a9640 1 -- 172.21.15.132:0/3152139837 shutdown_connections 2023-11-18T20:37:51.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.903+0000 7fcfe27a9640 1 -- 172.21.15.132:0/3152139837 wait complete. 2023-11-18T20:37:51.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.905+0000 7fcfe27a9640 1 Processor -- start 2023-11-18T20:37:51.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.905+0000 7fcfe27a9640 1 -- start start 2023-11-18T20:37:51.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.905+0000 7fcfe27a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0c7ec0 0x7fcfdc1505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.905+0000 7fcfe27a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc151cc0 0x7fcfdc1481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.905+0000 7fcfe27a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.905+0000 7fcfe27a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0c1090 con 0x7fcfdc155190 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.905+0000 7fcfe27a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc148c30 con 0x7fcfdc0c7ec0 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.905+0000 7fcfe27a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0c3c20 con 0x7fcfdc151cc0 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55690/0 (socket says 172.21.15.132:55690) 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 -- 172.21.15.132:0/2944328063 learned_addr learned my addr 172.21.15.132:0/2944328063 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfdbfff640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0c7ec0 0x7fcfdc1505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 -- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc151cc0 msgr2=0x7fcfdc1481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc151cc0 0x7fcfdc1481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 -- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0c7ec0 msgr2=0x7fcfdc1505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:51.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0c7ec0 0x7fcfdc1505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:51.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 -- 172.21.15.132:0/2944328063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4009a70 con 0x7fcfdc155190 2023-11-18T20:37:51.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.906+0000 7fcfe0d46640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1486f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009d90 tx=0x7fcfd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:51.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.907+0000 7fcfd8ff9640 1 -- 172.21.15.132:0/2944328063 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4034e50 con 0x7fcfdc155190 2023-11-18T20:37:51.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.907+0000 7fcfd8ff9640 1 -- 172.21.15.132:0/2944328063 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd4009450 con 0x7fcfdc155190 2023-11-18T20:37:51.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.907+0000 7fcfd8ff9640 1 -- 172.21.15.132:0/2944328063 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4003bd0 con 0x7fcfdc155190 2023-11-18T20:37:51.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.907+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc0aac70 con 0x7fcfdc155190 2023-11-18T20:37:51.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.907+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc0ab230 con 0x7fcfdc155190 2023-11-18T20:37:51.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.908+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc0c1200 con 0x7fcfdc155190 2023-11-18T20:37:51.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.909+0000 7fcfd8ff9640 1 -- 172.21.15.132:0/2944328063 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fcfd403b050 con 0x7fcfdc155190 2023-11-18T20:37:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.910+0000 7fcfd8ff9640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfc806ade0 0x7fcfc806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.910+0000 7fcfd8ff9640 1 -- 172.21.15.132:0/2944328063 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fcfd40ab400 con 0x7fcfdc155190 2023-11-18T20:37:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.910+0000 7fcfdbfff640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfc806ade0 0x7fcfc806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:51.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.911+0000 7fcfdbfff640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfc806ade0 0x7fcfc806d2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000f60 tx=0x7fcfcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:51.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:51.914+0000 7fcfd8ff9640 1 -- 172.21.15.132:0/2944328063 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfdc0c1200 con 0x7fcfdc155190 2023-11-18T20:37:52.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.091+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfdc0c1200 con 0x7fcfdc155190 2023-11-18T20:37:52.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.093+0000 7fcfd8ff9640 1 -- 172.21.15.132:0/2944328063 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10944 (secure 0 0 0) 0x7fcfdc0c1200 con 0x7fcfdc155190 2023-11-18T20:37:52.094 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:37:52.094 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":14,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:37:51.669660+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:37:52.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfc806ade0 msgr2=0x7fcfc806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:52.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfc806ade0 0x7fcfc806d2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000f60 tx=0x7fcfcc009040 comp rx=0 tx=0).stop 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 msgr2=0x7fcfdc1486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1486f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009d90 tx=0x7fcfd4004a40 comp rx=0 tx=0).stop 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 shutdown_connections 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfc806ade0 0x7fcfc806d2a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfdc155190 0x7fcfdc1486f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc151cc0 0x7fcfdc1481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 --2- 172.21.15.132:0/2944328063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0c7ec0 0x7fcfdc1505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 >> 172.21.15.132:0/2944328063 conn(0x7fcfdc071e10 msgr2=0x7fcfdc06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 shutdown_connections 2023-11-18T20:37:52.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.095+0000 7fcfe27a9640 1 -- 172.21.15.132:0/2944328063 wait complete. 2023-11-18T20:37:52.113 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-18T20:37:52.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:37:52.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.316+0000 7f80a02f2640 1 Processor -- start 2023-11-18T20:37:52.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.316+0000 7f80a02f2640 1 -- start start 2023-11-18T20:37:52.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.318+0000 7f80a02f2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980c6680 0x7f80980c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:52.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.318+0000 7f80a02f2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f80980c7950 0x7f80980c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:52.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.318+0000 7f80a02f2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80980c4220 con 0x7f80980a6bc0 2023-11-18T20:37:52.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.318+0000 7f80a02f2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80980c2e80 con 0x7f80980c7950 2023-11-18T20:37:52.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.318+0000 7f80a02f2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80980c2ba0 con 0x7f80980c6680 2023-11-18T20:37:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.318+0000 7f809e08e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980c6680 0x7f80980c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809e08e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980c6680 0x7f80980c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:52202/0 (socket says 172.21.15.132:52202) 2023-11-18T20:37:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809e08e640 1 -- 172.21.15.132:0/252785085 learned_addr learned my addr 172.21.15.132:0/252785085 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809d88d640 1 --1- 172.21.15.132:0/252785085 >> v1:172.21.15.161:6789/0 conn(0x7f80980a6bc0 0x7f80980c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:49356/0 (socket says 172.21.15.132:49356) 2023-11-18T20:37:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809e88f640 1 --2- 172.21.15.132:0/252785085 >> v2:172.21.15.161:3300/0 conn(0x7f80980c7950 0x7f80980c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809d08c640 1 -- 172.21.15.132:0/252785085 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863603836 0 0) 0x7f8094001110 con 0x7f80980a6bc0 2023-11-18T20:37:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809d08c640 1 -- 172.21.15.132:0/252785085 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8080003520 con 0x7f80980a6bc0 2023-11-18T20:37:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809e08e640 1 -- 172.21.15.132:0/252785085 >> v2:172.21.15.161:3300/0 conn(0x7f80980c7950 msgr2=0x7f80980c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809e08e640 1 --2- 172.21.15.132:0/252785085 >> v2:172.21.15.161:3300/0 conn(0x7f80980c7950 0x7f80980c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809e08e640 1 -- 172.21.15.132:0/252785085 >> v1:172.21.15.161:6789/0 conn(0x7f80980a6bc0 legacy=0x7f80980c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.319+0000 7f809e08e640 1 -- 172.21.15.132:0/252785085 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80980c32e0 con 0x7f80980c6680 2023-11-18T20:37:52.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.320+0000 7f809e08e640 1 --2- 172.21.15.132:0/252785085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980c6680 0x7f80980c6a60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8088009870 tx=0x7f808802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6226b3662d2fb55 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:52.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.321+0000 7f809d08c640 1 -- 172.21.15.132:0/252785085 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880317c0 con 0x7f80980c6680 2023-11-18T20:37:52.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.321+0000 7f809d08c640 1 -- 172.21.15.132:0/252785085 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8088031920 con 0x7f80980c6680 2023-11-18T20:37:52.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.321+0000 7f809d08c640 1 -- 172.21.15.132:0/252785085 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088031c90 con 0x7f80980c6680 2023-11-18T20:37:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.321+0000 7f80a02f2640 1 -- 172.21.15.132:0/252785085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980c6680 msgr2=0x7f80980c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.321+0000 7f80a02f2640 1 --2- 172.21.15.132:0/252785085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980c6680 0x7f80980c6a60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8088009870 tx=0x7f808802b860 comp rx=0 tx=0).stop 2023-11-18T20:37:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.322+0000 7f80a02f2640 1 -- 172.21.15.132:0/252785085 shutdown_connections 2023-11-18T20:37:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.322+0000 7f80a02f2640 1 --2- 172.21.15.132:0/252785085 >> v2:172.21.15.161:3300/0 conn(0x7f80980c7950 0x7f80980c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.322+0000 7f80a02f2640 1 --2- 172.21.15.132:0/252785085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980c6680 0x7f80980c6a60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.322+0000 7f80a02f2640 1 -- 172.21.15.132:0/252785085 >> 172.21.15.132:0/252785085 conn(0x7f80980c7e30 msgr2=0x7f80980c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.322+0000 7f80a02f2640 1 -- 172.21.15.132:0/252785085 shutdown_connections 2023-11-18T20:37:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.322+0000 7f80a02f2640 1 -- 172.21.15.132:0/252785085 wait complete. 2023-11-18T20:37:52.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.323+0000 7f80a02f2640 1 Processor -- start 2023-11-18T20:37:52.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.323+0000 7f80a02f2640 1 -- start start 2023-11-18T20:37:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f80a02f2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980a6bc0 0x7f8098156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f80a02f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80980c6680 0x7f809814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f80a02f2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80980c7950 0x7f80980aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f80a02f2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80981e1aa0 con 0x7f80980c6680 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f80a02f2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80980a88f0 con 0x7f80980c7950 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f80a02f2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80980a8610 con 0x7f80980a6bc0 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f809d88d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80980c6680 0x7f809814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f809d88d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80980c6680 0x7f809814ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55700/0 (socket says 172.21.15.132:55700) 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.324+0000 7f809d88d640 1 -- 172.21.15.132:0/2284690531 learned_addr learned my addr 172.21.15.132:0/2284690531 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f809e08e640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980a6bc0 0x7f8098156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f809e88f640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80980c7950 0x7f80980aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f809d88d640 1 -- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980a6bc0 msgr2=0x7f8098156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f809d88d640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980a6bc0 0x7f8098156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f809d88d640 1 -- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80980c7950 msgr2=0x7f80980aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f809d88d640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80980c7950 0x7f80980aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f809d88d640 1 -- 172.21.15.132:0/2284690531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80880094d0 con 0x7f80980c6680 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f809d88d640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80980c6680 0x7f809814ec00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f809400c420 tx=0x7f809400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f808effd640 1 -- 172.21.15.132:0/2284690531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80940074e0 con 0x7f80980c6680 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f808effd640 1 -- 172.21.15.132:0/2284690531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8094007640 con 0x7f80980c6680 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80980a95d0 con 0x7f80980c6680 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f808effd640 1 -- 172.21.15.132:0/2284690531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094004a20 con 0x7f80980c6680 2023-11-18T20:37:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.325+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80980a9b90 con 0x7f80980c6680 2023-11-18T20:37:52.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.327+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80980c21d0 con 0x7f80980c6680 2023-11-18T20:37:52.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.327+0000 7f808effd640 1 -- 172.21.15.132:0/2284690531 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f8094004b80 con 0x7f80980c6680 2023-11-18T20:37:52.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.329+0000 7f808effd640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f808406ade0 0x7f808406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:52.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.329+0000 7f808effd640 1 -- 172.21.15.132:0/2284690531 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f80940889d0 con 0x7f80980c6680 2023-11-18T20:37:52.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.329+0000 7f809e08e640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f808406ade0 0x7f808406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:52.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.331+0000 7f809e08e640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f808406ade0 0x7f808406d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8088036000 tx=0x7f808803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:52.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.334+0000 7f808effd640 1 -- 172.21.15.132:0/2284690531 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8094053f90 con 0x7f80980c6680 2023-11-18T20:37:52.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.545+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80980c4220 con 0x7f80980c6680 2023-11-18T20:37:52.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.546+0000 7f808effd640 1 -- 172.21.15.132:0/2284690531 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f80980c4220 con 0x7f80980c6680 2023-11-18T20:37:52.547 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:37:52.547 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-18T20:37:52.548 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 2 2023-11-18T20:37:52.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.548+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f808406ade0 msgr2=0x7f808406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:52.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.548+0000 7f80a02f2640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f808406ade0 0x7f808406d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8088036000 tx=0x7f808803d040 comp rx=0 tx=0).stop 2023-11-18T20:37:52.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.548+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80980c6680 msgr2=0x7f809814ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:52.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.548+0000 7f80a02f2640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80980c6680 0x7f809814ec00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f809400c420 tx=0x7f809400c8e0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.549+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 shutdown_connections 2023-11-18T20:37:52.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.549+0000 7f80a02f2640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f808406ade0 0x7f808406d2a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.549+0000 7f80a02f2640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80980c7950 0x7f80980aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.549+0000 7f80a02f2640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80980c6680 0x7f809814ec00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.549+0000 7f80a02f2640 1 --2- 172.21.15.132:0/2284690531 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80980a6bc0 0x7f8098156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:52.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.549+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 >> 172.21.15.132:0/2284690531 conn(0x7f80980c7e30 msgr2=0x7f80980c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:52.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.549+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 shutdown_connections 2023-11-18T20:37:52.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:52.549+0000 7f80a02f2640 1 -- 172.21.15.132:0/2284690531 wait complete. 2023-11-18T20:37:54.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:37:54.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.769+0000 7f8f85365640 1 Processor -- start 2023-11-18T20:37:54.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.769+0000 7f8f85365640 1 -- start start 2023-11-18T20:37:54.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.770+0000 7f8f85365640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8f8014e810 0x7f8f801550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:54.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.770+0000 7f8f85365640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c7e90 0x7f8f800c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:54.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.770+0000 7f8f85365640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8f800c4e50 0x7f8f8006b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:54.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.770+0000 7f8f85365640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f800bd8d0 con 0x7f8f8014e810 2023-11-18T20:37:54.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.770+0000 7f8f85365640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f800c6e60 con 0x7f8f800c4e50 2023-11-18T20:37:54.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.770+0000 7f8f85365640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f80155600 con 0x7f8f800c7e90 2023-11-18T20:37:54.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8f8014e810 0x7f8f801550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8f8014e810 0x7f8f801550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55716/0 (socket says 172.21.15.132:55716) 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7effd640 1 -- 172.21.15.132:0/2505085184 learned_addr learned my addr 172.21.15.132:0/2505085184 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7f7fe640 1 --2- 172.21.15.132:0/2505085184 >> v2:172.21.15.161:3300/0 conn(0x7f8f800c4e50 0x7f8f8006b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7e7fc640 1 --2- 172.21.15.132:0/2505085184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c7e90 0x7f8f800c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7effd640 1 -- 172.21.15.132:0/2505085184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c7e90 msgr2=0x7f8f800c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7effd640 1 --2- 172.21.15.132:0/2505085184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c7e90 0x7f8f800c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7effd640 1 -- 172.21.15.132:0/2505085184 >> v2:172.21.15.161:3300/0 conn(0x7f8f800c4e50 msgr2=0x7f8f8006b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7effd640 1 --2- 172.21.15.132:0/2505085184 >> v2:172.21.15.161:3300/0 conn(0x7f8f800c4e50 0x7f8f8006b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.771+0000 7f8f7effd640 1 -- 172.21.15.132:0/2505085184 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f800c70d0 con 0x7f8f8014e810 2023-11-18T20:37:54.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.773+0000 7f8f7effd640 1 --2- 172.21.15.132:0/2505085184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f801550c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f8008c180 tx=0x7f8f7002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b87d0a4d534f34 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:54.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.773+0000 7f8f7dffb640 1 -- 172.21.15.132:0/2505085184 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700317d0 con 0x7f8f8014e810 2023-11-18T20:37:54.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.773+0000 7f8f7dffb640 1 -- 172.21.15.132:0/2505085184 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f70031930 con 0x7f8f8014e810 2023-11-18T20:37:54.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.773+0000 7f8f7dffb640 1 -- 172.21.15.132:0/2505085184 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70031cc0 con 0x7f8f8014e810 2023-11-18T20:37:54.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.773+0000 7f8f85365640 1 -- 172.21.15.132:0/2505085184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 msgr2=0x7f8f801550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.774+0000 7f8f85365640 1 --2- 172.21.15.132:0/2505085184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f801550c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f8008c180 tx=0x7f8f7002b870 comp rx=0 tx=0).stop 2023-11-18T20:37:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.774+0000 7f8f85365640 1 -- 172.21.15.132:0/2505085184 shutdown_connections 2023-11-18T20:37:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.774+0000 7f8f85365640 1 --2- 172.21.15.132:0/2505085184 >> v2:172.21.15.161:3300/0 conn(0x7f8f800c4e50 0x7f8f8006b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.774+0000 7f8f85365640 1 --2- 172.21.15.132:0/2505085184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c7e90 0x7f8f800c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.774+0000 7f8f85365640 1 --2- 172.21.15.132:0/2505085184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f801550c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.774+0000 7f8f85365640 1 -- 172.21.15.132:0/2505085184 >> 172.21.15.132:0/2505085184 conn(0x7f8f800ca170 msgr2=0x7f8f800ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.774+0000 7f8f85365640 1 -- 172.21.15.132:0/2505085184 shutdown_connections 2023-11-18T20:37:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.774+0000 7f8f85365640 1 -- 172.21.15.132:0/2505085184 wait complete. 2023-11-18T20:37:54.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.775+0000 7f8f85365640 1 Processor -- start 2023-11-18T20:37:54.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.776+0000 7f8f85365640 1 -- start start 2023-11-18T20:37:54.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.776+0000 7f8f85365640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c4e50 0x7f8f80154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:54.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.776+0000 7f8f85365640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f800c7e90 0x7f8f80146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:54.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f85365640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f80147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f85365640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f801518e0 con 0x7f8f8014e810 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f85365640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f800c32e0 con 0x7f8f800c7e90 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f85365640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f801edc30 con 0x7f8f800c4e50 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f80147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f80147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55722/0 (socket says 172.21.15.132:55722) 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7f7fe640 1 -- 172.21.15.132:0/2680584145 learned_addr learned my addr 172.21.15.132:0/2680584145 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7effd640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c4e50 0x7f8f80154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7e7fc640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f800c7e90 0x7f8f80146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7f7fe640 1 -- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c4e50 msgr2=0x7f8f80154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7f7fe640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c4e50 0x7f8f80154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7f7fe640 1 -- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f800c7e90 msgr2=0x7f8f80146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:54.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7f7fe640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f800c7e90 0x7f8f80146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:54.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.777+0000 7f8f7f7fe640 1 -- 172.21.15.132:0/2680584145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700094d0 con 0x7f8f8014e810 2023-11-18T20:37:54.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.778+0000 7f8f7f7fe640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f80147260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8f78007e60 tx=0x7f8f7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:54.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.778+0000 7f8f677fe640 1 -- 172.21.15.132:0/2680584145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78014620 con 0x7f8f8014e810 2023-11-18T20:37:54.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.778+0000 7f8f677fe640 1 -- 172.21.15.132:0/2680584145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7800ee90 con 0x7f8f8014e810 2023-11-18T20:37:54.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.778+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f801ee160 con 0x7f8f8014e810 2023-11-18T20:37:54.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.778+0000 7f8f677fe640 1 -- 172.21.15.132:0/2680584145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780149e0 con 0x7f8f8014e810 2023-11-18T20:37:54.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.778+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f800bfd00 con 0x7f8f8014e810 2023-11-18T20:37:54.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.779+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f80068350 con 0x7f8f8014e810 2023-11-18T20:37:54.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.780+0000 7f8f677fe640 1 -- 172.21.15.132:0/2680584145 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f8f78014b40 con 0x7f8f8014e810 2023-11-18T20:37:54.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.782+0000 7f8f677fe640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8f6c06adb0 0x7f8f6c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:54.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.782+0000 7f8f677fe640 1 -- 172.21.15.132:0/2680584145 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8f78089a80 con 0x7f8f8014e810 2023-11-18T20:37:54.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.782+0000 7f8f7effd640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8f6c06adb0 0x7f8f6c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:54.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.783+0000 7f8f7effd640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8f6c06adb0 0x7f8f6c06d270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f70036000 tx=0x7f8f7003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:54.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:54.787+0000 7f8f677fe640 1 -- 172.21.15.132:0/2680584145 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f7808be60 con 0x7f8f8014e810 2023-11-18T20:37:55.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.025+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f8006ca30 con 0x7f8f8014e810 2023-11-18T20:37:55.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.025+0000 7f8f677fe640 1 -- 172.21.15.132:0/2680584145 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7f8f78054ff0 con 0x7f8f8014e810 2023-11-18T20:37:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:37:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-18T20:37:55.027 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 3 2023-11-18T20:37:55.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8f6c06adb0 msgr2=0x7f8f6c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8f6c06adb0 0x7f8f6c06d270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f70036000 tx=0x7f8f7003d040 comp rx=0 tx=0).stop 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 msgr2=0x7f8f80147260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f80147260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8f78007e60 tx=0x7f8f7800e4b0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 shutdown_connections 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8f6c06adb0 0x7f8f6c06d270 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f8014e810 0x7f8f80147260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f800c7e90 0x7f8f80146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 --2- 172.21.15.132:0/2680584145 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f800c4e50 0x7f8f80154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 >> 172.21.15.132:0/2680584145 conn(0x7f8f800ca170 msgr2=0x7f8f801520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:55.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 shutdown_connections 2023-11-18T20:37:55.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.028+0000 7f8f85365640 1 -- 172.21.15.132:0/2680584145 wait complete. 2023-11-18T20:37:55.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:37:55.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:37:55.155 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:37:55.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.241+0000 7f585a333640 1 Processor -- start 2023-11-18T20:37:55.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.241+0000 7f585a333640 1 -- start start 2023-11-18T20:37:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.242+0000 7f585a333640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5854151cc0 0x7f5854155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.242+0000 7f585a333640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58541556d0 con 0x7f58540c4940 2023-11-18T20:37:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.242+0000 7f585a333640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5854154740 con 0x7f58540c7ec0 2023-11-18T20:37:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.242+0000 7f585a333640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585406c760 con 0x7f5854151cc0 2023-11-18T20:37:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.242+0000 7f58588d0640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f58540c4940 0x7f585415f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37192/0 (socket says 172.21.15.132:37192) 2023-11-18T20:37:55.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.242+0000 7f58588d0640 1 -- 172.21.15.132:0/4011548833 learned_addr learned my addr 172.21.15.132:0/4011548833 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5853fff640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5854151cc0 0x7f5854155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404546123 0 0) 0x7f584c001490 con 0x7f58540c4940 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f583c003520 con 0x7f58540c4940 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155437309 0 0) 0x7f5854154740 con 0x7f58540c7ec0 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f584c001490 con 0x7f58540c7ec0 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1718408006 0 0) 0x7f583c003520 con 0x7f58540c4940 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5854151cc0 msgr2=0x7f5854155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5854151cc0 0x7f5854155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 >> v1:172.21.15.161:6789/0 conn(0x7f58540c7ec0 legacy=0x7f5854157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540c8470 con 0x7f58540c4940 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f584c001b80 con 0x7f58540c4940 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 >> v1:172.21.15.132:6789/0 conn(0x7f58540c4940 legacy=0x7f585415f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c003b30 0x7f583c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5854151cc0 0x7f583c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f583c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585406c760 con 0x7f583c004d00 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c00ba30 con 0x7f583c003b30 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.243+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c00bba0 con 0x7f5854151cc0 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.244+0000 7f58588d0640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f583c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.244+0000 7f5853fff640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c003b30 0x7f583c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.244+0000 7f58588d0640 1 -- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5854151cc0 msgr2=0x7f583c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.244+0000 7f58588d0640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5854151cc0 0x7f583c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.244+0000 7f58588d0640 1 -- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c003b30 msgr2=0x7f583c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.244+0000 7f58588d0640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c003b30 0x7f583c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.244+0000 7f58588d0640 1 -- 172.21.15.132:0/4011548833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c003520 con 0x7f583c004d00 2023-11-18T20:37:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.244+0000 7f5853fff640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c003b30 0x7f583c003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:37:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.246+0000 7f58588d0640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f583c005180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f584c00a7b0 tx=0x7f583c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0332bd67e775dd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.246+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c034630 con 0x7f583c004d00 2023-11-18T20:37:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.246+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c02f070 con 0x7f583c004d00 2023-11-18T20:37:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.246+0000 7f5852ffd640 1 -- 172.21.15.132:0/4011548833 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c0349f0 con 0x7f583c004d00 2023-11-18T20:37:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.247+0000 7f585a333640 1 -- 172.21.15.132:0/4011548833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 msgr2=0x7f583c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.247+0000 7f585a333640 1 --2- 172.21.15.132:0/4011548833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f583c005180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f584c00a7b0 tx=0x7f583c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.247+0000 7f58588d0640 1 -- 172.21.15.132:0/4011548833 reap_dead start 2023-11-18T20:37:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.247+0000 7f585a333640 1 -- 172.21.15.132:0/4011548833 shutdown_connections 2023-11-18T20:37:55.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.247+0000 7f585a333640 1 -- 172.21.15.132:0/4011548833 >> 172.21.15.132:0/4011548833 conn(0x7f5854071e10 msgr2=0x7f5854072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:55.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.247+0000 7f585a333640 1 -- 172.21.15.132:0/4011548833 shutdown_connections 2023-11-18T20:37:55.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.247+0000 7f585a333640 1 -- 172.21.15.132:0/4011548833 wait complete. 2023-11-18T20:37:55.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.248+0000 7f585a333640 1 Processor -- start 2023-11-18T20:37:55.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.249+0000 7f585a333640 1 -- start start 2023-11-18T20:37:55.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.249+0000 7f585a333640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f58541ead40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.249+0000 7f585a333640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5854141fe0 0x7f58540aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f585a333640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58540c2600 0x7f58540c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f585a333640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58540c2fc0 con 0x7f583c004d00 2023-11-18T20:37:55.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f585a333640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585414c160 con 0x7f5854141fe0 2023-11-18T20:37:55.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f585a333640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58541eb280 con 0x7f58540c2600 2023-11-18T20:37:55.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f5853fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f58541ead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f5853fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f58541ead40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55732/0 (socket says 172.21.15.132:55732) 2023-11-18T20:37:55.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f5853fff640 1 -- 172.21.15.132:0/4086918370 learned_addr learned my addr 172.21.15.132:0/4086918370 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:55.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f58537fe640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5854141fe0 0x7f58540aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f58588d0640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58540c2600 0x7f58540c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f5853fff640 1 -- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58540c2600 msgr2=0x7f58540c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f5853fff640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58540c2600 0x7f58540c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f5853fff640 1 -- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5854141fe0 msgr2=0x7f58540aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f5853fff640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5854141fe0 0x7f58540aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.250+0000 7f5853fff640 1 -- 172.21.15.132:0/4086918370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585414fef0 con 0x7f583c004d00 2023-11-18T20:37:55.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.251+0000 7f5853fff640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f58541ead40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5844011630 tx=0x7f5844011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:55.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.251+0000 7f5850ff9640 1 -- 172.21.15.132:0/4086918370 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400f920 con 0x7f583c004d00 2023-11-18T20:37:55.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.251+0000 7f5850ff9640 1 -- 172.21.15.132:0/4086918370 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584400fa80 con 0x7f583c004d00 2023-11-18T20:37:55.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.251+0000 7f5850ff9640 1 -- 172.21.15.132:0/4086918370 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400fdf0 con 0x7f583c004d00 2023-11-18T20:37:55.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.251+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585414f2e0 con 0x7f583c004d00 2023-11-18T20:37:55.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.251+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585414f8a0 con 0x7f583c004d00 2023-11-18T20:37:55.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.252+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585406c270 con 0x7f583c004d00 2023-11-18T20:37:55.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.253+0000 7f5850ff9640 1 -- 172.21.15.132:0/4086918370 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f5844015460 con 0x7f583c004d00 2023-11-18T20:37:55.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.254+0000 7f5850ff9640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f584006ade0 0x7f584006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.254+0000 7f5850ff9640 1 -- 172.21.15.132:0/4086918370 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f58440899e0 con 0x7f583c004d00 2023-11-18T20:37:55.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.255+0000 7f58537fe640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f584006ade0 0x7f584006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.255+0000 7f58537fe640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f584006ade0 0x7f584006d2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5848000f60 tx=0x7f5848009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:55.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.258+0000 7f5850ff9640 1 -- 172.21.15.132:0/4086918370 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5844054f30 con 0x7f583c004d00 2023-11-18T20:37:55.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.279+0000 7f5850ff9640 1 -- 172.21.15.132:0/4086918370 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5844055300 con 0x7f583c004d00 2023-11-18T20:37:55.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.454+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5854067430 con 0x7f583c004d00 2023-11-18T20:37:55.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.455+0000 7f5850ff9640 1 -- 172.21.15.132:0/4086918370 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f5844084d20 con 0x7f583c004d00 2023-11-18T20:37:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:37:55.456 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":17,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:37:55.265553+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:37:55.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.457+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f584006ade0 msgr2=0x7f584006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.457+0000 7f585a333640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f584006ade0 0x7f584006d2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5848000f60 tx=0x7f5848009040 comp rx=0 tx=0).stop 2023-11-18T20:37:55.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.457+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 msgr2=0x7f58541ead40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.457+0000 7f585a333640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f58541ead40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5844011630 tx=0x7f5844011af0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.458+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 shutdown_connections 2023-11-18T20:37:55.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.458+0000 7f585a333640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f584006ade0 0x7f584006d2a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.458+0000 7f585a333640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58540c2600 0x7f58540c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.458+0000 7f585a333640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5854141fe0 0x7f58540aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.458+0000 7f585a333640 1 --2- 172.21.15.132:0/4086918370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f583c004d00 0x7f58541ead40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.458+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 >> 172.21.15.132:0/4086918370 conn(0x7f5854071e10 msgr2=0x7f58540c08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:55.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.458+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 shutdown_connections 2023-11-18T20:37:55.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.458+0000 7f585a333640 1 -- 172.21.15.132:0/4086918370 wait complete. 2023-11-18T20:37:55.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:37:55.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:37:55.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.730+0000 7f0498600640 1 Processor -- start 2023-11-18T20:37:55.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.730+0000 7f0498600640 1 -- start start 2023-11-18T20:37:55.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.731+0000 7f0498600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f049014fd30 0x7f0490152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.731+0000 7f0498600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f049006d0a0 0x7f04900a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.731+0000 7f0498600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f04900a5260 0x7f04900c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.731+0000 7f0498600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04900c64a0 con 0x7f049006d0a0 2023-11-18T20:37:55.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.731+0000 7f0498600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04900c5c00 con 0x7f04900a5260 2023-11-18T20:37:55.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.731+0000 7f0498600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c5ee0 con 0x7f049014fd30 2023-11-18T20:37:55.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0495b9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f049006d0a0 0x7f04900a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f049639c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f049014fd30 0x7f0490152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0495b9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f049006d0a0 0x7f04900a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55744/0 (socket says 172.21.15.132:55744) 2023-11-18T20:37:55.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0495b9b640 1 -- 172.21.15.132:0/353685574 learned_addr learned my addr 172.21.15.132:0/353685574 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:55.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0496b9d640 1 --2- 172.21.15.132:0/353685574 >> v2:172.21.15.161:3300/0 conn(0x7f04900a5260 0x7f04900c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0495b9b640 1 -- 172.21.15.132:0/353685574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f049014fd30 msgr2=0x7f0490152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0495b9b640 1 --2- 172.21.15.132:0/353685574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f049014fd30 0x7f0490152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0495b9b640 1 -- 172.21.15.132:0/353685574 >> v2:172.21.15.161:3300/0 conn(0x7f04900a5260 msgr2=0x7f04900c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0495b9b640 1 --2- 172.21.15.132:0/353685574 >> v2:172.21.15.161:3300/0 conn(0x7f04900a5260 0x7f04900c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f0495b9b640 1 -- 172.21.15.132:0/353685574 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900c61c0 con 0x7f049006d0a0 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.732+0000 7f049639c640 1 --2- 172.21.15.132:0/353685574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f049014fd30 0x7f0490152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.734+0000 7f0495b9b640 1 --2- 172.21.15.132:0/353685574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f04900a4d20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f049006d990 tx=0x7f048002fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e632aab67a38a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.734+0000 7f049539a640 1 -- 172.21.15.132:0/353685574 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480030ad0 con 0x7f049006d0a0 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.734+0000 7f049539a640 1 -- 172.21.15.132:0/353685574 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480030c30 con 0x7f049006d0a0 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.734+0000 7f049539a640 1 -- 172.21.15.132:0/353685574 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480038440 con 0x7f049006d0a0 2023-11-18T20:37:55.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.734+0000 7f0498600640 1 -- 172.21.15.132:0/353685574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 msgr2=0x7f04900a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.734+0000 7f0498600640 1 --2- 172.21.15.132:0/353685574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f04900a4d20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f049006d990 tx=0x7f048002fd20 comp rx=0 tx=0).stop 2023-11-18T20:37:55.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.735+0000 7f0498600640 1 -- 172.21.15.132:0/353685574 shutdown_connections 2023-11-18T20:37:55.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.735+0000 7f0498600640 1 --2- 172.21.15.132:0/353685574 >> v2:172.21.15.161:3300/0 conn(0x7f04900a5260 0x7f04900c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.735+0000 7f0498600640 1 --2- 172.21.15.132:0/353685574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f04900a4d20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.735+0000 7f0498600640 1 --2- 172.21.15.132:0/353685574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f049014fd30 0x7f0490152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.735+0000 7f0498600640 1 -- 172.21.15.132:0/353685574 >> 172.21.15.132:0/353685574 conn(0x7f049006a500 msgr2=0x7f049006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:55.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.735+0000 7f0498600640 1 -- 172.21.15.132:0/353685574 shutdown_connections 2023-11-18T20:37:55.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.735+0000 7f0498600640 1 -- 172.21.15.132:0/353685574 wait complete. 2023-11-18T20:37:55.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.736+0000 7f0498600640 1 Processor -- start 2023-11-18T20:37:55.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.737+0000 7f0498600640 1 -- start start 2023-11-18T20:37:55.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.737+0000 7f0498600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f049014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.737+0000 7f0498600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04900a5260 0x7f04901519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.737+0000 7f0498600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f049014fd30 0x7f0490151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.737+0000 7f0498600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04901566b0 con 0x7f049006d0a0 2023-11-18T20:37:55.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.737+0000 7f0498600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0490151520 con 0x7f049014fd30 2023-11-18T20:37:55.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.737+0000 7f0498600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04901511f0 con 0x7f04900a5260 2023-11-18T20:37:55.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f049014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f049014c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55752/0 (socket says 172.21.15.132:55752) 2023-11-18T20:37:55.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 -- 172.21.15.132:0/1092384480 learned_addr learned my addr 172.21.15.132:0/1092384480 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:55.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f0496b9d640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f049014fd30 0x7f0490151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f0495b9b640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04900a5260 0x7f04901519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 -- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04900a5260 msgr2=0x7f04901519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04900a5260 0x7f04901519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 -- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f049014fd30 msgr2=0x7f0490151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f049014fd30 0x7f0490151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 -- 172.21.15.132:0/1092384480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c009400 con 0x7f049006d0a0 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.738+0000 7f049639c640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f049014c910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f048c00e960 tx=0x7f048c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.739+0000 7f0486ffd640 1 -- 172.21.15.132:0/1092384480 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c00ca00 con 0x7f049006d0a0 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.739+0000 7f0486ffd640 1 -- 172.21.15.132:0/1092384480 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c00cb60 con 0x7f049006d0a0 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.739+0000 7f0486ffd640 1 -- 172.21.15.132:0/1092384480 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c013470 con 0x7f049006d0a0 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.739+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04800094d0 con 0x7f049006d0a0 2023-11-18T20:37:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.739+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04901e9db0 con 0x7f049006d0a0 2023-11-18T20:37:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.740+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0490068350 con 0x7f049006d0a0 2023-11-18T20:37:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.741+0000 7f0486ffd640 1 -- 172.21.15.132:0/1092384480 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f048c0135d0 con 0x7f049006d0a0 2023-11-18T20:37:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.741+0000 7f0486ffd640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f047406ae40 0x7f047406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.742+0000 7f0486ffd640 1 -- 172.21.15.132:0/1092384480 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f048c089560 con 0x7f049006d0a0 2023-11-18T20:37:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.742+0000 7f0495b9b640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f047406ae40 0x7f047406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:55.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.743+0000 7f0495b9b640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f047406ae40 0x7f047406d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f048003a000 tx=0x7f0480034000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:55.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.746+0000 7f0486ffd640 1 -- 172.21.15.132:0/1092384480 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f048c054960 con 0x7f049006d0a0 2023-11-18T20:37:55.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.936+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f049006d540 con 0x7f049006d0a0 2023-11-18T20:37:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.937+0000 7f0486ffd640 1 -- 172.21.15.132:0/1092384480 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f048c057f80 con 0x7f049006d0a0 2023-11-18T20:37:55.938 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:37:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f047406ae40 msgr2=0x7f047406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f047406ae40 0x7f047406d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f048003a000 tx=0x7f0480034000 comp rx=0 tx=0).stop 2023-11-18T20:37:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 msgr2=0x7f049014c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f049014c910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f048c00e960 tx=0x7f048c00ee20 comp rx=0 tx=0).stop 2023-11-18T20:37:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 shutdown_connections 2023-11-18T20:37:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f047406ae40 0x7f047406d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f049014fd30 0x7f0490151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04900a5260 0x7f04901519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 --2- 172.21.15.132:0/1092384480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049006d0a0 0x7f049014c910 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.939+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 >> 172.21.15.132:0/1092384480 conn(0x7f049006a500 msgr2=0x7f0490071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.940+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 shutdown_connections 2023-11-18T20:37:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:55.940+0000 7f0498600640 1 -- 172.21.15.132:0/1092384480 wait complete. 2023-11-18T20:37:55.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T20:37:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.161+0000 7f4e9f348640 1 Processor -- start 2023-11-18T20:37:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.161+0000 7f4e9f348640 1 -- start start 2023-11-18T20:37:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.162+0000 7f4e9f348640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e980c5ec0 0x7f4e980c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e9f348640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980721a0 0x7f4e980c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e9f348640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980bfdc0 con 0x7f4e980c45d0 2023-11-18T20:37:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e9f348640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9806e390 con 0x7f4e980c5ec0 2023-11-18T20:37:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e9f348640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9806ddd0 con 0x7f4e980721a0 2023-11-18T20:37:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e9c8e3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4e980c45d0 0x7f4e98155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37206/0 (socket says 172.21.15.132:37206) 2023-11-18T20:37:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e9c8e3640 1 -- 172.21.15.132:0/887937856 learned_addr learned my addr 172.21.15.132:0/887937856 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:37:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e9d8e5640 1 --2- 172.21.15.132:0/887937856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980721a0 0x7f4e980c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e9d0e4640 1 --2- 172.21.15.132:0/887937856 >> v2:172.21.15.161:3300/0 conn(0x7f4e980c5ec0 0x7f4e980c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e8ffff640 1 -- 172.21.15.132:0/887937856 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956910200 0 0) 0x7f4e980bfdc0 con 0x7f4e980c45d0 2023-11-18T20:37:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.163+0000 7f4e8ffff640 1 -- 172.21.15.132:0/887937856 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e84003520 con 0x7f4e980c45d0 2023-11-18T20:37:56.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.164+0000 7f4e9d8e5640 1 -- 172.21.15.132:0/887937856 >> v2:172.21.15.161:3300/0 conn(0x7f4e980c5ec0 msgr2=0x7f4e980c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:56.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.164+0000 7f4e9d8e5640 1 --2- 172.21.15.132:0/887937856 >> v2:172.21.15.161:3300/0 conn(0x7f4e980c5ec0 0x7f4e980c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.164+0000 7f4e9d8e5640 1 -- 172.21.15.132:0/887937856 >> v1:172.21.15.132:6789/0 conn(0x7f4e980c45d0 legacy=0x7f4e98155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.164+0000 7f4e9d8e5640 1 -- 172.21.15.132:0/887937856 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9806e0b0 con 0x7f4e980721a0 2023-11-18T20:37:56.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.165+0000 7f4e9d8e5640 1 --2- 172.21.15.132:0/887937856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980721a0 0x7f4e980c3170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009dc0 tx=0x7f4e9002bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ebe0e4e847a031 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:56.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.165+0000 7f4e8ffff640 1 -- 172.21.15.132:0/887937856 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9002cb20 con 0x7f4e980721a0 2023-11-18T20:37:56.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.165+0000 7f4e8ffff640 1 -- 172.21.15.132:0/887937856 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9002cc80 con 0x7f4e980721a0 2023-11-18T20:37:56.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.165+0000 7f4e8ffff640 1 -- 172.21.15.132:0/887937856 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90034440 con 0x7f4e980721a0 2023-11-18T20:37:56.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.166+0000 7f4e9f348640 1 -- 172.21.15.132:0/887937856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980721a0 msgr2=0x7f4e980c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.166+0000 7f4e9f348640 1 --2- 172.21.15.132:0/887937856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980721a0 0x7f4e980c3170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009dc0 tx=0x7f4e9002bd70 comp rx=0 tx=0).stop 2023-11-18T20:37:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.166+0000 7f4e9f348640 1 -- 172.21.15.132:0/887937856 shutdown_connections 2023-11-18T20:37:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.166+0000 7f4e9f348640 1 --2- 172.21.15.132:0/887937856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980721a0 0x7f4e980c3170 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.166+0000 7f4e9f348640 1 --2- 172.21.15.132:0/887937856 >> v2:172.21.15.161:3300/0 conn(0x7f4e980c5ec0 0x7f4e980c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.166+0000 7f4e9f348640 1 -- 172.21.15.132:0/887937856 >> 172.21.15.132:0/887937856 conn(0x7f4e9806a500 msgr2=0x7f4e9806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:56.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.166+0000 7f4e9f348640 1 -- 172.21.15.132:0/887937856 shutdown_connections 2023-11-18T20:37:56.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.166+0000 7f4e9f348640 1 -- 172.21.15.132:0/887937856 wait complete. 2023-11-18T20:37:56.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.168+0000 7f4e9f348640 1 Processor -- start 2023-11-18T20:37:56.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.168+0000 7f4e9f348640 1 -- start start 2023-11-18T20:37:56.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9f348640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e980721a0 0x7f4e981eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9f348640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e980c45d0 0x7f4e981576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9f348640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980c5ec0 0x7f4e98151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9f348640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e981eb0c0 con 0x7f4e980721a0 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9f348640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9809b160 con 0x7f4e980c45d0 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9f348640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98099f00 con 0x7f4e980c5ec0 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9d0e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e980721a0 0x7f4e981eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9d0e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e980721a0 0x7f4e981eab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55756/0 (socket says 172.21.15.132:55756) 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9d0e4640 1 -- 172.21.15.132:0/463843150 learned_addr learned my addr 172.21.15.132:0/463843150 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.169+0000 7f4e9d8e5640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980c5ec0 0x7f4e98151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9d0e4640 1 -- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980c5ec0 msgr2=0x7f4e98151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9d0e4640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980c5ec0 0x7f4e98151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9d0e4640 1 -- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e980c45d0 msgr2=0x7f4e981576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9c8e3640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e980c45d0 0x7f4e981576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9d0e4640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e980c45d0 0x7f4e981576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9d0e4640 1 -- 172.21.15.132:0/463843150 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90009a70 con 0x7f4e980721a0 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9d8e5640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980c5ec0 0x7f4e98151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9c8e3640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e980c45d0 0x7f4e981576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9d0e4640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e980721a0 0x7f4e981eab80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400e8a0 tx=0x7f4e9400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e8dffb640 1 -- 172.21.15.132:0/463843150 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940094f0 con 0x7f4e980721a0 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e8dffb640 1 -- 172.21.15.132:0/463843150 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9400c940 con 0x7f4e980721a0 2023-11-18T20:37:56.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e8dffb640 1 -- 172.21.15.132:0/463843150 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9400ccf0 con 0x7f4e980721a0 2023-11-18T20:37:56.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.170+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e980a8960 con 0x7f4e980721a0 2023-11-18T20:37:56.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.171+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9809a1c0 con 0x7f4e980721a0 2023-11-18T20:37:56.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.172+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e980c3590 con 0x7f4e980721a0 2023-11-18T20:37:56.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.173+0000 7f4e8dffb640 1 -- 172.21.15.132:0/463843150 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e94013470 con 0x7f4e980721a0 2023-11-18T20:37:56.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.173+0000 7f4e8dffb640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e7c06ae40 0x7f4e7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.174+0000 7f4e8dffb640 1 -- 172.21.15.132:0/463843150 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e94089360 con 0x7f4e980721a0 2023-11-18T20:37:56.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.174+0000 7f4e9c8e3640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e7c06ae40 0x7f4e7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.175+0000 7f4e9c8e3640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e7c06ae40 0x7f4e7c06d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e980c4d30 tx=0x7f4e88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:56.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.178+0000 7f4e8dffb640 1 -- 172.21.15.132:0/463843150 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e94054760 con 0x7f4e980721a0 2023-11-18T20:37:56.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.371+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4e98068350 con 0x7f4e980721a0 2023-11-18T20:37:56.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.372+0000 7f4e8dffb640 1 -- 172.21.15.132:0/463843150 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4e94057d80 con 0x7f4e980721a0 2023-11-18T20:37:56.374 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:37:56.374 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-11-18T20:37:56.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:37:56.374 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-11-18T20:37:56.374 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-11-18T20:37:56.374 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:37:56.374 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-11-18T20:37:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e7c06ae40 msgr2=0x7f4e7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e7c06ae40 0x7f4e7c06d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e980c4d30 tx=0x7f4e88009040 comp rx=0 tx=0).stop 2023-11-18T20:37:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e980721a0 msgr2=0x7f4e981eab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e980721a0 0x7f4e981eab80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400e8a0 tx=0x7f4e9400ed60 comp rx=0 tx=0).stop 2023-11-18T20:37:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 shutdown_connections 2023-11-18T20:37:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e7c06ae40 0x7f4e7c06d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e980c5ec0 0x7f4e98151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e980c45d0 0x7f4e981576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 --2- 172.21.15.132:0/463843150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e980721a0 0x7f4e981eab80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 >> 172.21.15.132:0/463843150 conn(0x7f4e9806a500 msgr2=0x7f4e98070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 shutdown_connections 2023-11-18T20:37:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.375+0000 7f4e9f348640 1 -- 172.21.15.132:0/463843150 wait complete. 2023-11-18T20:37:56.393 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-18T20:37:56.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-18T20:37:56.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.607+0000 7f24bd2da640 1 Processor -- start 2023-11-18T20:37:56.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.607+0000 7f24bd2da640 1 -- start start 2023-11-18T20:37:56.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24bd2da640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24b8151e20 0x7f24b80abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24bd2da640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f24b80c80b0 0x7f24b80c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24bd2da640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b806c7c0 con 0x7f24b8157e80 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24bd2da640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b80c57b0 con 0x7f24b8151e20 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24bd2da640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b81589a0 con 0x7f24b80c80b0 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24b6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24b8151e20 0x7f24b80abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24b6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24b8151e20 0x7f24b80abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55760/0 (socket says 172.21.15.132:55760) 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24b6ffd640 1 -- 172.21.15.132:0/3391003551 learned_addr learned my addr 172.21.15.132:0/3391003551 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24b6ffd640 1 -- 172.21.15.132:0/3391003551 >> v2:172.21.15.161:3300/0 conn(0x7f24b80c80b0 msgr2=0x7f24b80c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24b6ffd640 1 --2- 172.21.15.132:0/3391003551 >> v2:172.21.15.161:3300/0 conn(0x7f24b80c80b0 0x7f24b80c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24b6ffd640 1 -- 172.21.15.132:0/3391003551 >> v1:172.21.15.161:6789/0 conn(0x7f24b8157e80 legacy=0x7f24b8158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:56.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.609+0000 7f24b6ffd640 1 -- 172.21.15.132:0/3391003551 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80ac860 con 0x7f24b8151e20 2023-11-18T20:37:56.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.610+0000 7f24b6ffd640 1 --2- 172.21.15.132:0/3391003551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b8151e20 0x7f24b80abef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24b808c1d0 tx=0x7f24a802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc79b610435be0ca server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24b5ffb640 1 -- 172.21.15.132:0/3391003551 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8031750 con 0x7f24b8151e20 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24b5ffb640 1 -- 172.21.15.132:0/3391003551 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a80318b0 con 0x7f24b8151e20 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24b5ffb640 1 -- 172.21.15.132:0/3391003551 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8031c40 con 0x7f24b8151e20 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24bd2da640 1 -- 172.21.15.132:0/3391003551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b8151e20 msgr2=0x7f24b80abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3391003551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b8151e20 0x7f24b80abef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24b808c1d0 tx=0x7f24a802b7f0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24bd2da640 1 -- 172.21.15.132:0/3391003551 shutdown_connections 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3391003551 >> v2:172.21.15.161:3300/0 conn(0x7f24b80c80b0 0x7f24b80c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3391003551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b8151e20 0x7f24b80abef0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.611+0000 7f24bd2da640 1 -- 172.21.15.132:0/3391003551 >> 172.21.15.132:0/3391003551 conn(0x7f24b8071e10 msgr2=0x7f24b8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.612+0000 7f24bd2da640 1 -- 172.21.15.132:0/3391003551 shutdown_connections 2023-11-18T20:37:56.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.612+0000 7f24bd2da640 1 -- 172.21.15.132:0/3391003551 wait complete. 2023-11-18T20:37:56.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.613+0000 7f24bd2da640 1 Processor -- start 2023-11-18T20:37:56.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.613+0000 7f24bd2da640 1 -- start start 2023-11-18T20:37:56.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.614+0000 7f24bd2da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b80c80b0 0x7f24b8156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.614+0000 7f24bd2da640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24b8151e20 0x7f24b80c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.614+0000 7f24bd2da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b8157e80 0x7f24b814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.614+0000 7f24bd2da640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80c3990 con 0x7f24b80c80b0 2023-11-18T20:37:56.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.614+0000 7f24bd2da640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80c3380 con 0x7f24b8157e80 2023-11-18T20:37:56.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.614+0000 7f24bd2da640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80c1960 con 0x7f24b8151e20 2023-11-18T20:37:56.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.614+0000 7f24b6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b80c80b0 0x7f24b8156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b80c80b0 0x7f24b8156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55770/0 (socket says 172.21.15.132:55770) 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b6ffd640 1 -- 172.21.15.132:0/3496471962 learned_addr learned my addr 172.21.15.132:0/3496471962 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b67fc640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24b8151e20 0x7f24b80c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b77fe640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b8157e80 0x7f24b814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b6ffd640 1 -- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24b8151e20 msgr2=0x7f24b80c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b6ffd640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24b8151e20 0x7f24b80c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b6ffd640 1 -- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b8157e80 msgr2=0x7f24b814f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b6ffd640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b8157e80 0x7f24b814f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b6ffd640 1 -- 172.21.15.132:0/3496471962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80094d0 con 0x7f24b80c80b0 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b67fc640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24b8151e20 0x7f24b80c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b77fe640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b8157e80 0x7f24b814f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f24b6ffd640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b80c80b0 0x7f24b8156920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000c00 tx=0x7f24a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:56.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.615+0000 7f249f7fe640 1 -- 172.21.15.132:0/3496471962 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8033c80 con 0x7f24b80c80b0 2023-11-18T20:37:56.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.616+0000 7f249f7fe640 1 -- 172.21.15.132:0/3496471962 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a8033de0 con 0x7f24b80c80b0 2023-11-18T20:37:56.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.616+0000 7f249f7fe640 1 -- 172.21.15.132:0/3496471962 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a803d690 con 0x7f24b80c80b0 2023-11-18T20:37:56.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.616+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b80c3620 con 0x7f24b80c80b0 2023-11-18T20:37:56.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.616+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b80c1c40 con 0x7f24b80c80b0 2023-11-18T20:37:56.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.617+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b8068350 con 0x7f24b80c80b0 2023-11-18T20:37:56.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.618+0000 7f249f7fe640 1 -- 172.21.15.132:0/3496471962 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24a803a040 con 0x7f24b80c80b0 2023-11-18T20:37:56.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.618+0000 7f249f7fe640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f24a406ae40 0x7f24a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:56.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.619+0000 7f249f7fe640 1 -- 172.21.15.132:0/3496471962 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f24a80ab5a0 con 0x7f24b80c80b0 2023-11-18T20:37:56.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.619+0000 7f24b67fc640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f24a406ae40 0x7f24a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:56.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.620+0000 7f24b67fc640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f24a406ae40 0x7f24a406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24ac006fd0 tx=0x7f24ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:56.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.623+0000 7f249f7fe640 1 -- 172.21.15.132:0/3496471962 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24a8076900 con 0x7f24b80c80b0 2023-11-18T20:37:56.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:56.813+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f24b806c9b0 con 0x7f24b80c80b0 2023-11-18T20:37:57.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.115+0000 7f249f7fe640 1 -- 172.21.15.132:0/3496471962 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f24a8079f20 con 0x7f24b80c80b0 2023-11-18T20:37:57.117 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-11-18T20:37:57.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f24a406ae40 msgr2=0x7f24a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:57.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f24a406ae40 0x7f24a406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24ac006fd0 tx=0x7f24ac008040 comp rx=0 tx=0).stop 2023-11-18T20:37:57.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b80c80b0 msgr2=0x7f24b8156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:57.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b80c80b0 0x7f24b8156920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000c00 tx=0x7f24a80046c0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 shutdown_connections 2023-11-18T20:37:57.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f24a406ae40 0x7f24a406d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b8157e80 0x7f24b814f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24b8151e20 0x7f24b80c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 --2- 172.21.15.132:0/3496471962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b80c80b0 0x7f24b8156920 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.119+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 >> 172.21.15.132:0/3496471962 conn(0x7f24b8071e10 msgr2=0x7f24b80c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:57.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.121+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 shutdown_connections 2023-11-18T20:37:57.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.121+0000 7f24bd2da640 1 -- 172.21.15.132:0/3496471962 wait complete. 2023-11-18T20:37:57.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T20:37:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.342+0000 7f42e5ad7640 1 Processor -- start 2023-11-18T20:37:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.342+0000 7f42e5ad7640 1 -- start start 2023-11-18T20:37:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.343+0000 7f42e5ad7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f42e006d0a0 0x7f42e0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:57.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.343+0000 7f42e5ad7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e00c64a0 con 0x7f42e00c3ea0 2023-11-18T20:37:57.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.343+0000 7f42e5ad7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e00c5c00 con 0x7f42e014fd30 2023-11-18T20:37:57.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.343+0000 7f42e5ad7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e00c5ee0 con 0x7f42e006d0a0 2023-11-18T20:37:57.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42dffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f42e00c3ea0 0x7f42e00c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37214/0 (socket says 172.21.15.132:37214) 2023-11-18T20:37:57.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42dffff640 1 -- 172.21.15.132:0/1069557386 learned_addr learned my addr 172.21.15.132:0/1069557386 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:37:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56685312 0 0) 0x7f42e00c64a0 con 0x7f42e00c3ea0 2023-11-18T20:37:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c8003520 con 0x7f42e00c3ea0 2023-11-18T20:37:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3723995257 0 0) 0x7f42c8003520 con 0x7f42e00c3ea0 2023-11-18T20:37:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 >> v2:172.21.15.161:3300/0 conn(0x7f42e006d0a0 msgr2=0x7f42e0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 --2- 172.21.15.132:0/1069557386 >> v2:172.21.15.161:3300/0 conn(0x7f42e006d0a0 0x7f42e0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 >> v1:172.21.15.161:6789/0 conn(0x7f42e014fd30 legacy=0x7f42e00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e00c61c0 con 0x7f42e00c3ea0 2023-11-18T20:37:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f42d8001670 con 0x7f42e00c3ea0 2023-11-18T20:37:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 >> v1:172.21.15.132:6789/0 conn(0x7f42e00c3ea0 legacy=0x7f42e00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42c8003970 0x7f42c8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c80047c0 0x7f42c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80052a0 0x7f42c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00c5ee0 con 0x7f42c80047c0 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c800c1a0 con 0x7f42c80052a0 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.344+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c800c360 con 0x7f42c8003970 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42deffd640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c80047c0 0x7f42c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42dffff640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80052a0 0x7f42c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42deffd640 1 -- 172.21.15.132:0/1069557386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42c8003970 msgr2=0x7f42c8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42deffd640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42c8003970 0x7f42c8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42deffd640 1 -- 172.21.15.132:0/1069557386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80052a0 msgr2=0x7f42c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42deffd640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80052a0 0x7f42c800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42deffd640 1 -- 172.21.15.132:0/1069557386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8003520 con 0x7f42c80047c0 2023-11-18T20:37:57.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42dffff640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80052a0 0x7f42c800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:37:57.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.345+0000 7f42dffff640 1 -- 172.21.15.132:0/1069557386 reap_dead start 2023-11-18T20:37:57.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.346+0000 7f42deffd640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c80047c0 0x7f42c8004c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42d4006fd0 tx=0x7f42c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702ddd4f658362cb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:57.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.346+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4032600 con 0x7f42c80047c0 2023-11-18T20:37:57.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.346+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d402e050 con 0x7f42c80047c0 2023-11-18T20:37:57.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.346+0000 7f42de7fc640 1 -- 172.21.15.132:0/1069557386 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40329c0 con 0x7f42c80047c0 2023-11-18T20:37:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.347+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1069557386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c80047c0 msgr2=0x7f42c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.347+0000 7f42e5ad7640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c80047c0 0x7f42c8004c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42d4006fd0 tx=0x7f42c80057f0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.347+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1069557386 shutdown_connections 2023-11-18T20:37:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.347+0000 7f42e5ad7640 1 --2- 172.21.15.132:0/1069557386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c80047c0 0x7f42c8004c40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.347+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1069557386 >> 172.21.15.132:0/1069557386 conn(0x7f42e006a500 msgr2=0x7f42e006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.347+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1069557386 shutdown_connections 2023-11-18T20:37:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.347+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1069557386 wait complete. 2023-11-18T20:37:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.349+0000 7f42e5ad7640 1 Processor -- start 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.349+0000 7f42e5ad7640 1 -- start start 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42e5ad7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80047c0 0x7f42e01ee600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42e5ad7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e01dc450 0x7f42e00a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42e5ad7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e01dd430 0x7f42e00a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42e5ad7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01ea9d0 con 0x7f42e01dc450 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42e5ad7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01ea680 con 0x7f42c80047c0 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42e5ad7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00aaa20 con 0x7f42e01dd430 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42deffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e01dc450 0x7f42e00a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42deffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e01dc450 0x7f42e00a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55792/0 (socket says 172.21.15.132:55792) 2023-11-18T20:37:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42deffd640 1 -- 172.21.15.132:0/1721192162 learned_addr learned my addr 172.21.15.132:0/1721192162 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.350+0000 7f42df7fe640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80047c0 0x7f42e01ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42deffd640 1 -- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e01dd430 msgr2=0x7f42e00a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42deffd640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e01dd430 0x7f42e00a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42deffd640 1 -- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80047c0 msgr2=0x7f42e01ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42deffd640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80047c0 0x7f42e01ee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42deffd640 1 -- 172.21.15.132:0/1721192162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e00aad00 con 0x7f42e01dc450 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42deffd640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e01dc450 0x7f42e00a8e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42d4035040 tx=0x7f42d40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42c7fff640 1 -- 172.21.15.132:0/1721192162 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d403c880 con 0x7f42e01dc450 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42c7fff640 1 -- 172.21.15.132:0/1721192162 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d403c9e0 con 0x7f42e01dc450 2023-11-18T20:37:57.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42c7fff640 1 -- 172.21.15.132:0/1721192162 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d403cd50 con 0x7f42e01dc450 2023-11-18T20:37:57.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e00a7130 con 0x7f42e01dc450 2023-11-18T20:37:57.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.351+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e01eb040 con 0x7f42e01dc450 2023-11-18T20:37:57.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.352+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e00aae90 con 0x7f42e01dc450 2023-11-18T20:37:57.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.354+0000 7f42c7fff640 1 -- 172.21.15.132:0/1721192162 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42d4039040 con 0x7f42e01dc450 2023-11-18T20:37:57.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.354+0000 7f42c7fff640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42cc06ae70 0x7f42cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:57.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.355+0000 7f42c7fff640 1 -- 172.21.15.132:0/1721192162 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f42d40aaa70 con 0x7f42e01dc450 2023-11-18T20:37:57.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.355+0000 7f42df7fe640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42cc06ae70 0x7f42cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:57.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.356+0000 7f42df7fe640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42cc06ae70 0x7f42cc06d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42d0007fd0 tx=0x7f42d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:57.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.359+0000 7f42c7fff640 1 -- 172.21.15.132:0/1721192162 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42d4075e40 con 0x7f42e01dc450 2023-11-18T20:37:57.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:57.550+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f42e0068350 con 0x7f42e01dc450 2023-11-18T20:37:58.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.126+0000 7f42c7fff640 1 -- 172.21.15.132:0/1721192162 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f42d40370d0 con 0x7f42e01dc450 2023-11-18T20:37:58.128 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-11-18T20:37:58.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.130+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42cc06ae70 msgr2=0x7f42cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:58.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.130+0000 7f42e5ad7640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42cc06ae70 0x7f42cc06d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42d0007fd0 tx=0x7f42d0009040 comp rx=0 tx=0).stop 2023-11-18T20:37:58.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.130+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e01dc450 msgr2=0x7f42e00a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:58.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.130+0000 7f42e5ad7640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e01dc450 0x7f42e00a8e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42d4035040 tx=0x7f42d40047d0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.131+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 shutdown_connections 2023-11-18T20:37:58.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.131+0000 7f42e5ad7640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42cc06ae70 0x7f42cc06d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.131+0000 7f42e5ad7640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e01dd430 0x7f42e00a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.131+0000 7f42e5ad7640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e01dc450 0x7f42e00a8e70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.131+0000 7f42e5ad7640 1 --2- 172.21.15.132:0/1721192162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42c80047c0 0x7f42e01ee600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.131+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 >> 172.21.15.132:0/1721192162 conn(0x7f42e006a500 msgr2=0x7f42e0152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:58.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.132+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 shutdown_connections 2023-11-18T20:37:58.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.132+0000 7f42e5ad7640 1 -- 172.21.15.132:0/1721192162 wait complete. 2023-11-18T20:37:58.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-18T20:37:58.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.353+0000 7fd829602640 1 Processor -- start 2023-11-18T20:37:58.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.353+0000 7fd829602640 1 -- start start 2023-11-18T20:37:58.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd829602640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8240c5ec0 0x7fd8240c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:58.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd829602640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8240721a0 0x7fd8240c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:58.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd829602640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8240bfdc0 con 0x7fd8240c45d0 2023-11-18T20:37:58.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd829602640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82406e390 con 0x7fd8240c5ec0 2023-11-18T20:37:58.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd829602640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82406ddd0 con 0x7fd8240721a0 2023-11-18T20:37:58.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd822ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8240c5ec0 0x7fd8240c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:58.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd81a7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd8240c45d0 0x7fd824155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37222/0 (socket says 172.21.15.132:37222) 2023-11-18T20:37:58.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd81a7fc640 1 -- 172.21.15.132:0/2384745806 learned_addr learned my addr 172.21.15.132:0/2384745806 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:37:58.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd822ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8240c5ec0 0x7fd8240c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55804/0 (socket says 172.21.15.132:55804) 2023-11-18T20:37:58.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd822ffd640 1 -- 172.21.15.132:0/2384745806 >> v2:172.21.15.161:3300/0 conn(0x7fd8240721a0 msgr2=0x7fd8240c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:58.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd822ffd640 1 --2- 172.21.15.132:0/2384745806 >> v2:172.21.15.161:3300/0 conn(0x7fd8240721a0 0x7fd8240c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd822ffd640 1 -- 172.21.15.132:0/2384745806 >> v1:172.21.15.132:6789/0 conn(0x7fd8240c45d0 legacy=0x7fd824155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:58.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.355+0000 7fd822ffd640 1 -- 172.21.15.132:0/2384745806 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82406e0b0 con 0x7fd8240c5ec0 2023-11-18T20:37:58.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.357+0000 7fd822ffd640 1 --2- 172.21.15.132:0/2384745806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240c5ec0 0x7fd8240c2c30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd8140097a0 tx=0x7fd81402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f416ef1a4b05a14 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:58.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.357+0000 7fd8227fc640 1 -- 172.21.15.132:0/2384745806 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814031520 con 0x7fd8240c5ec0 2023-11-18T20:37:58.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.357+0000 7fd8227fc640 1 -- 172.21.15.132:0/2384745806 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd814031680 con 0x7fd8240c5ec0 2023-11-18T20:37:58.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.357+0000 7fd8227fc640 1 -- 172.21.15.132:0/2384745806 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814031a10 con 0x7fd8240c5ec0 2023-11-18T20:37:58.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.357+0000 7fd829602640 1 -- 172.21.15.132:0/2384745806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240c5ec0 msgr2=0x7fd8240c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:58.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.357+0000 7fd829602640 1 --2- 172.21.15.132:0/2384745806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240c5ec0 0x7fd8240c2c30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd8140097a0 tx=0x7fd81402b7c0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.358+0000 7fd829602640 1 -- 172.21.15.132:0/2384745806 shutdown_connections 2023-11-18T20:37:58.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.358+0000 7fd829602640 1 --2- 172.21.15.132:0/2384745806 >> v2:172.21.15.161:3300/0 conn(0x7fd8240721a0 0x7fd8240c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.358+0000 7fd829602640 1 --2- 172.21.15.132:0/2384745806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240c5ec0 0x7fd8240c2c30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.358+0000 7fd829602640 1 -- 172.21.15.132:0/2384745806 >> 172.21.15.132:0/2384745806 conn(0x7fd82406a500 msgr2=0x7fd82406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:58.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.358+0000 7fd829602640 1 -- 172.21.15.132:0/2384745806 shutdown_connections 2023-11-18T20:37:58.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.358+0000 7fd829602640 1 -- 172.21.15.132:0/2384745806 wait complete. 2023-11-18T20:37:58.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.360+0000 7fd829602640 1 Processor -- start 2023-11-18T20:37:58.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.360+0000 7fd829602640 1 -- start start 2023-11-18T20:37:58.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd829602640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240721a0 0x7fd82414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:58.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd829602640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8240c45d0 0x7fd8240a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:58.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd829602640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8240c5ec0 0x7fd8241559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:58.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd829602640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8240a59e0 con 0x7fd8240721a0 2023-11-18T20:37:58.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd829602640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8241e9df0 con 0x7fd8240c45d0 2023-11-18T20:37:58.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd829602640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82414eaf0 con 0x7fd8240c5ec0 2023-11-18T20:37:58.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd822ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240721a0 0x7fd82414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:58.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd822ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240721a0 0x7fd82414e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55818/0 (socket says 172.21.15.132:55818) 2023-11-18T20:37:58.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd822ffd640 1 -- 172.21.15.132:0/3354911213 learned_addr learned my addr 172.21.15.132:0/3354911213 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:58.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd822ffd640 1 -- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8240c5ec0 msgr2=0x7fd8241559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:58.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd822ffd640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8240c5ec0 0x7fd8241559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd822ffd640 1 -- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8240c45d0 msgr2=0x7fd8240a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:58.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd822ffd640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8240c45d0 0x7fd8240a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:58.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.361+0000 7fd822ffd640 1 -- 172.21.15.132:0/3354911213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd814009400 con 0x7fd8240721a0 2023-11-18T20:37:58.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.362+0000 7fd822ffd640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240721a0 0x7fd82414e5b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd814000c00 tx=0x7fd8140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:58.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.362+0000 7fd81bfff640 1 -- 172.21.15.132:0/3354911213 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814033c50 con 0x7fd8240721a0 2023-11-18T20:37:58.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.362+0000 7fd81bfff640 1 -- 172.21.15.132:0/3354911213 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd814033db0 con 0x7fd8240721a0 2023-11-18T20:37:58.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.362+0000 7fd81bfff640 1 -- 172.21.15.132:0/3354911213 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81403d6b0 con 0x7fd8240721a0 2023-11-18T20:37:58.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.362+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8241e9fe0 con 0x7fd8240721a0 2023-11-18T20:37:58.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.362+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8241ea5a0 con 0x7fd8240721a0 2023-11-18T20:37:58.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.364+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd824068350 con 0x7fd8240721a0 2023-11-18T20:37:58.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.365+0000 7fd81bfff640 1 -- 172.21.15.132:0/3354911213 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd81403a040 con 0x7fd8240721a0 2023-11-18T20:37:58.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.365+0000 7fd81bfff640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd80406ae40 0x7fd80406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:58.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.366+0000 7fd81bfff640 1 -- 172.21.15.132:0/3354911213 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd8140ab1f0 con 0x7fd8240721a0 2023-11-18T20:37:58.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.366+0000 7fd81a7fc640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd80406ae40 0x7fd80406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:58.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.367+0000 7fd81a7fc640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd80406ae40 0x7fd80406d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8240a89e0 tx=0x7fd80c007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:58.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.371+0000 7fd81bfff640 1 -- 172.21.15.132:0/3354911213 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8140764b0 con 0x7fd8240721a0 2023-11-18T20:37:58.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:58.596+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd8240bfa00 con 0x7fd8240721a0 2023-11-18T20:37:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.158+0000 7fd81bfff640 1 -- 172.21.15.132:0/3354911213 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd814006e10 con 0x7fd8240721a0 2023-11-18T20:37:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 2 and data pool 3 2023-11-18T20:37:59.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd80406ae40 msgr2=0x7fd80406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd80406ae40 0x7fd80406d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8240a89e0 tx=0x7fd80c007a40 comp rx=0 tx=0).stop 2023-11-18T20:37:59.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240721a0 msgr2=0x7fd82414e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240721a0 0x7fd82414e5b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd814000c00 tx=0x7fd8140046c0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 shutdown_connections 2023-11-18T20:37:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd80406ae40 0x7fd80406d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8240c5ec0 0x7fd8241559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8240c45d0 0x7fd8240a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 --2- 172.21.15.132:0/3354911213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8240721a0 0x7fd82414e5b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 >> 172.21.15.132:0/3354911213 conn(0x7fd82406a500 msgr2=0x7fd8240c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 shutdown_connections 2023-11-18T20:37:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.168+0000 7fd829602640 1 -- 172.21.15.132:0/3354911213 wait complete. 2023-11-18T20:37:59.199 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:37:59.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.376+0000 7fa982439640 1 Processor -- start 2023-11-18T20:37:59.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.377+0000 7fa982439640 1 -- start start 2023-11-18T20:37:59.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.378+0000 7fa982439640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 0x7fa97c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.378+0000 7fa982439640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97c0c64a0 con 0x7fa97c0c3ea0 2023-11-18T20:37:59.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.378+0000 7fa982439640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97c0c5c00 con 0x7fa97c06d0a0 2023-11-18T20:37:59.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.378+0000 7fa982439640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c0c5ee0 con 0x7fa97c14fd30 2023-11-18T20:37:59.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.378+0000 7fa9809d6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa97c0c3ea0 0x7fa97c0c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50088/0 (socket says 172.21.15.132:50088) 2023-11-18T20:37:59.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.378+0000 7fa9809d6640 1 -- 172.21.15.132:0/846591751 learned_addr learned my addr 172.21.15.132:0/846591751 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:37:59.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.378+0000 7fa97bfff640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 0x7fa97c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942226821 0 0) 0x7fa97c0c64a0 con 0x7fa97c0c3ea0 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa968003520 con 0x7fa97c0c3ea0 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2989620643 0 0) 0x7fa968003520 con 0x7fa97c0c3ea0 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 msgr2=0x7fa97c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 0x7fa97c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 >> v1:172.21.15.161:6789/0 conn(0x7fa97c06d0a0 legacy=0x7fa97c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c0c61c0 con 0x7fa97c0c3ea0 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fa974001670 con 0x7fa97c0c3ea0 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 >> v1:172.21.15.132:6789/0 conn(0x7fa97c0c3ea0 legacy=0x7fa97c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9680039a0 0x7fa968003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 0x7fa9680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968004d00 0x7fa968005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c0c5ee0 con 0x7fa968004d00 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96800ba30 con 0x7fa9680039a0 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96800bbf0 con 0x7fa97c14fd30 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.379+0000 7fa9809d6640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968004d00 0x7fa968005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.380+0000 7fa97bfff640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9680039a0 0x7fa968003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.380+0000 7fa97b7fe640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 0x7fa9680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.380+0000 7fa9809d6640 1 -- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 msgr2=0x7fa9680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.380+0000 7fa9809d6640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 0x7fa9680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.380+0000 7fa9809d6640 1 -- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9680039a0 msgr2=0x7fa968003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.380+0000 7fa9809d6640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9680039a0 0x7fa968003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.380+0000 7fa9809d6640 1 -- 172.21.15.132:0/846591751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968003520 con 0x7fa968004d00 2023-11-18T20:37:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.380+0000 7fa97b7fe640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c14fd30 0x7fa9680047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:37:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.381+0000 7fa9809d6640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968004d00 0x7fa968005180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa97400c210 tx=0x7fa9680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c4d4df85d53231 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.381+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974005ad0 con 0x7fa968004d00 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.381+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa974005c30 con 0x7fa968004d00 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.381+0000 7fa97affd640 1 -- 172.21.15.132:0/846591751 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97402c890 con 0x7fa968004d00 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.382+0000 7fa982439640 1 -- 172.21.15.132:0/846591751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968004d00 msgr2=0x7fa968005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.382+0000 7fa982439640 1 --2- 172.21.15.132:0/846591751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968004d00 0x7fa968005180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa97400c210 tx=0x7fa9680057f0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.382+0000 7fa9809d6640 1 -- 172.21.15.132:0/846591751 reap_dead start 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.382+0000 7fa982439640 1 -- 172.21.15.132:0/846591751 shutdown_connections 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.382+0000 7fa982439640 1 -- 172.21.15.132:0/846591751 >> 172.21.15.132:0/846591751 conn(0x7fa97c06a500 msgr2=0x7fa97c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:59.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.382+0000 7fa982439640 1 -- 172.21.15.132:0/846591751 shutdown_connections 2023-11-18T20:37:59.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.382+0000 7fa982439640 1 -- 172.21.15.132:0/846591751 wait complete. 2023-11-18T20:37:59.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.383+0000 7fa982439640 1 Processor -- start 2023-11-18T20:37:59.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.384+0000 7fa982439640 1 -- start start 2023-11-18T20:37:59.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.384+0000 7fa982439640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa968004d00 0x7fa97c1de330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.384+0000 7fa982439640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c0aa970 0x7fa97c1dd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.384+0000 7fa982439640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa97c14b060 0x7fa97c14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.384+0000 7fa982439640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c14ba20 con 0x7fa97c14b060 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa982439640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c1dcc50 con 0x7fa97c0aa970 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa982439640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c1dc0d0 con 0x7fa968004d00 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa9809d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa97c14b060 0x7fa97c14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa9809d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa97c14b060 0x7fa97c14b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60898/0 (socket says 172.21.15.132:60898) 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa9809d6640 1 -- 172.21.15.132:0/2632727167 learned_addr learned my addr 172.21.15.132:0/2632727167 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa97b7fe640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c0aa970 0x7fa97c1dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa97bfff640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa968004d00 0x7fa97c1de330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa9809d6640 1 -- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa968004d00 msgr2=0x7fa97c1de330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa9809d6640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa968004d00 0x7fa97c1de330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa9809d6640 1 -- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c0aa970 msgr2=0x7fa97c1dd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa9809d6640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c0aa970 0x7fa97c1dd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa9809d6640 1 -- 172.21.15.132:0/2632727167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c1dc3b0 con 0x7fa97c14b060 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.385+0000 7fa97b7fe640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c0aa970 0x7fa97c1dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.386+0000 7fa9809d6640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa97c14b060 0x7fa97c14b4e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa97402c500 tx=0x7fa97402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.386+0000 7fa978ff9640 1 -- 172.21.15.132:0/2632727167 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97403c040 con 0x7fa97c14b060 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.386+0000 7fa978ff9640 1 -- 172.21.15.132:0/2632727167 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97402cca0 con 0x7fa97c14b060 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.386+0000 7fa978ff9640 1 -- 172.21.15.132:0/2632727167 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974007270 con 0x7fa97c14b060 2023-11-18T20:37:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.386+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97c1dc690 con 0x7fa97c14b060 2023-11-18T20:37:59.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.386+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97c1dd6b0 con 0x7fa97c14b060 2023-11-18T20:37:59.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.387+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97c0a8f00 con 0x7fa97c14b060 2023-11-18T20:37:59.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.388+0000 7fa978ff9640 1 -- 172.21.15.132:0/2632727167 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa974032070 con 0x7fa97c14b060 2023-11-18T20:37:59.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.389+0000 7fa978ff9640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95c06ae70 0x7fa95c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.389+0000 7fa978ff9640 1 -- 172.21.15.132:0/2632727167 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9740aa0d0 con 0x7fa97c14b060 2023-11-18T20:37:59.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.389+0000 7fa97bfff640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95c06ae70 0x7fa95c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.390+0000 7fa97bfff640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95c06ae70 0x7fa95c06d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa96c007520 tx=0x7fa96c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.393+0000 7fa978ff9640 1 -- 172.21.15.132:0/2632727167 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa97c0a8f00 con 0x7fa97c14b060 2023-11-18T20:37:59.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.583+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa97c0a8f00 con 0x7fa97c14b060 2023-11-18T20:37:59.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.586+0000 7fa978ff9640 1 -- 172.21.15.132:0/2632727167 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16558 (secure 0 0 0) 0x7fa97c0a8f00 con 0x7fa97c14b060 2023-11-18T20:37:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:37:59.588 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:37:58.598644+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:37:59.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95c06ae70 msgr2=0x7fa95c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95c06ae70 0x7fa95c06d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa96c007520 tx=0x7fa96c00b040 comp rx=0 tx=0).stop 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa97c14b060 msgr2=0x7fa97c14b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa97c14b060 0x7fa97c14b4e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa97402c500 tx=0x7fa97402e070 comp rx=0 tx=0).stop 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 shutdown_connections 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95c06ae70 0x7fa95c06d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa97c14b060 0x7fa97c14b4e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c0aa970 0x7fa97c1dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 --2- 172.21.15.132:0/2632727167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa968004d00 0x7fa97c1de330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.588+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 >> 172.21.15.132:0/2632727167 conn(0x7fa97c06a500 msgr2=0x7fa97c1deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.589+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 shutdown_connections 2023-11-18T20:37:59.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.589+0000 7fa982439640 1 -- 172.21.15.132:0/2632727167 wait complete. 2023-11-18T20:37:59.609 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:37:59.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.819+0000 7f6384256640 1 Processor -- start 2023-11-18T20:37:59.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.819+0000 7f6384256640 1 -- start start 2023-11-18T20:37:59.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f6384256640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f637c14fd30 0x7f637c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f6384256640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c06d0a0 0x7f637c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f6384256640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f637c0a5260 0x7f637c0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f6384256640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0c64a0 con 0x7f637c0a5260 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f6384256640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0c5c00 con 0x7f637c14fd30 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f6384256640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0c5ee0 con 0x7f637c06d0a0 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f63827f3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f637c0a5260 0x7f637c0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f63827f3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f637c0a5260 0x7f637c0c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60904/0 (socket says 172.21.15.132:60904) 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f63827f3640 1 -- 172.21.15.132:0/3387307591 learned_addr learned my addr 172.21.15.132:0/3387307591 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f6381ff2640 1 --2- 172.21.15.132:0/3387307591 >> v2:172.21.15.161:3300/0 conn(0x7f637c14fd30 0x7f637c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.821+0000 7f63817f1640 1 --2- 172.21.15.132:0/3387307591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c06d0a0 0x7f637c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.822+0000 7f63827f3640 1 -- 172.21.15.132:0/3387307591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c06d0a0 msgr2=0x7f637c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.822+0000 7f63827f3640 1 --2- 172.21.15.132:0/3387307591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c06d0a0 0x7f637c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.822+0000 7f63827f3640 1 -- 172.21.15.132:0/3387307591 >> v2:172.21.15.161:3300/0 conn(0x7f637c14fd30 msgr2=0x7f637c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:37:59.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.822+0000 7f63827f3640 1 --2- 172.21.15.132:0/3387307591 >> v2:172.21.15.161:3300/0 conn(0x7f637c14fd30 0x7f637c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.822+0000 7f63827f3640 1 -- 172.21.15.132:0/3387307591 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0c61c0 con 0x7f637c0a5260 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.823+0000 7f63827f3640 1 --2- 172.21.15.132:0/3387307591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c0a5260 0x7f637c0c3ea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f637c06b200 tx=0x7f637402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41585f231c6e793 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.823+0000 7f6380ff0640 1 -- 172.21.15.132:0/3387307591 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637402ca70 con 0x7f637c0a5260 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.823+0000 7f6380ff0640 1 -- 172.21.15.132:0/3387307591 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637402cbd0 con 0x7f637c0a5260 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.823+0000 7f6380ff0640 1 -- 172.21.15.132:0/3387307591 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740343f0 con 0x7f637c0a5260 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 -- 172.21.15.132:0/3387307591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c0a5260 msgr2=0x7f637c0c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 --2- 172.21.15.132:0/3387307591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c0a5260 0x7f637c0c3ea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f637c06b200 tx=0x7f637402bed0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 -- 172.21.15.132:0/3387307591 shutdown_connections 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 --2- 172.21.15.132:0/3387307591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c0a5260 0x7f637c0c3ea0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 --2- 172.21.15.132:0/3387307591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c06d0a0 0x7f637c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 --2- 172.21.15.132:0/3387307591 >> v2:172.21.15.161:3300/0 conn(0x7f637c14fd30 0x7f637c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 -- 172.21.15.132:0/3387307591 >> 172.21.15.132:0/3387307591 conn(0x7f637c06a500 msgr2=0x7f637c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:37:59.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 -- 172.21.15.132:0/3387307591 shutdown_connections 2023-11-18T20:37:59.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.824+0000 7f6384256640 1 -- 172.21.15.132:0/3387307591 wait complete. 2023-11-18T20:37:59.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.825+0000 7f6384256640 1 Processor -- start 2023-11-18T20:37:59.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.826+0000 7f6384256640 1 -- start start 2023-11-18T20:37:59.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.826+0000 7f6384256640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c06d0a0 0x7f637c1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.826+0000 7f6384256640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c0a5260 0x7f637c1e81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.826+0000 7f6384256640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f637c14fd30 0x7f637c1e8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.826+0000 7f6384256640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1dd4e0 con 0x7f637c06d0a0 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.826+0000 7f6384256640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1ebe00 con 0x7f637c14fd30 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.826+0000 7f6384256640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1ec0e0 con 0x7f637c0a5260 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c06d0a0 0x7f637c1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c06d0a0 0x7f637c1551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60906/0 (socket says 172.21.15.132:60906) 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 -- 172.21.15.132:0/3492655075 learned_addr learned my addr 172.21.15.132:0/3492655075 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f63827f3640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f637c14fd30 0x7f637c1e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f63817f1640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c0a5260 0x7f637c1e81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 -- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c0a5260 msgr2=0x7f637c1e81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c0a5260 0x7f637c1e81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 -- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f637c14fd30 msgr2=0x7f637c1e8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f637c14fd30 0x7f637c1e8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 -- 172.21.15.132:0/3492655075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6374009b30 con 0x7f637c06d0a0 2023-11-18T20:37:59.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.827+0000 7f6381ff2640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c06d0a0 0x7f637c1551c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f637800e870 tx=0x7f637800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:59.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.828+0000 7f63727fc640 1 -- 172.21.15.132:0/3492655075 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780094f0 con 0x7f637c06d0a0 2023-11-18T20:37:59.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.828+0000 7f63727fc640 1 -- 172.21.15.132:0/3492655075 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637800c940 con 0x7f637c06d0a0 2023-11-18T20:37:59.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.828+0000 7f63727fc640 1 -- 172.21.15.132:0/3492655075 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800ccf0 con 0x7f637c06d0a0 2023-11-18T20:37:59.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.828+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c1dce90 con 0x7f637c06d0a0 2023-11-18T20:37:59.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.828+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c155700 con 0x7f637c06d0a0 2023-11-18T20:37:59.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.829+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c0c5110 con 0x7f637c06d0a0 2023-11-18T20:37:59.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.830+0000 7f63727fc640 1 -- 172.21.15.132:0/3492655075 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6378013470 con 0x7f637c06d0a0 2023-11-18T20:37:59.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.831+0000 7f63727fc640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f636006ae70 0x7f636006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:37:59.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.831+0000 7f63727fc640 1 -- 172.21.15.132:0/3492655075 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6378089630 con 0x7f637c06d0a0 2023-11-18T20:37:59.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.831+0000 7f63817f1640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f636006ae70 0x7f636006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:37:59.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.832+0000 7f63817f1640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f636006ae70 0x7f636006d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f637c0c13a0 tx=0x7f636c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:37:59.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:37:59.836+0000 7f63727fc640 1 -- 172.21.15.132:0/3492655075 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6378054770 con 0x7f637c06d0a0 2023-11-18T20:38:00.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.025+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f637c0c04a0 con 0x7f637c06d0a0 2023-11-18T20:38:00.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.027+0000 7f63727fc640 1 -- 172.21.15.132:0/3492655075 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f6378057d90 con 0x7f637c06d0a0 2023-11-18T20:38:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:00.030 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:37:58.598644+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:00.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f636006ae70 msgr2=0x7f636006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:00.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f636006ae70 0x7f636006d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f637c0c13a0 tx=0x7f636c008040 comp rx=0 tx=0).stop 2023-11-18T20:38:00.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c06d0a0 msgr2=0x7f637c1551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c06d0a0 0x7f637c1551c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f637800e870 tx=0x7f637800ed30 comp rx=0 tx=0).stop 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 shutdown_connections 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f636006ae70 0x7f636006d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f637c14fd30 0x7f637c1e8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f637c0a5260 0x7f637c1e81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 --2- 172.21.15.132:0/3492655075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f637c06d0a0 0x7f637c1551c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 >> 172.21.15.132:0/3492655075 conn(0x7f637c06a500 msgr2=0x7f637c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 shutdown_connections 2023-11-18T20:38:00.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.030+0000 7f6384256640 1 -- 172.21.15.132:0/3492655075 wait complete. 2023-11-18T20:38:00.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-18T20:38:00.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.242+0000 7f9293135640 1 Processor -- start 2023-11-18T20:38:00.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.242+0000 7f9293135640 1 -- start start 2023-11-18T20:38:00.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.243+0000 7f9293135640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c14e7f0 0x7f928c0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.243+0000 7f9293135640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f928c06cd20 0x7f928c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9293135640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c0a8380 con 0x7f928c0c52e0 2023-11-18T20:38:00.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9293135640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c1510b0 con 0x7f928c06cd20 2023-11-18T20:38:00.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9293135640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06bf60 con 0x7f928c14e7f0 2023-11-18T20:38:00.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9291932640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f928c0c52e0 0x7f928c06d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50102/0 (socket says 172.21.15.132:50102) 2023-11-18T20:38:00.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9291932640 1 -- 172.21.15.132:0/1199012820 learned_addr learned my addr 172.21.15.132:0/1199012820 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:00.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9292934640 1 --2- 172.21.15.132:0/1199012820 >> v2:172.21.15.161:3300/0 conn(0x7f928c06cd20 0x7f928c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:00.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232071046 0 0) 0x7f928c0a8380 con 0x7f928c0c52e0 2023-11-18T20:38:00.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9292133640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c14e7f0 0x7f928c0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:00.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.244+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9278003520 con 0x7f928c0c52e0 2023-11-18T20:38:00.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1528767552 0 0) 0x7f9278003520 con 0x7f928c0c52e0 2023-11-18T20:38:00.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c14e7f0 msgr2=0x7f928c0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:00.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c14e7f0 0x7f928c0c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 >> v2:172.21.15.161:3300/0 conn(0x7f928c06cd20 msgr2=0x7f928c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 --2- 172.21.15.132:0/1199012820 >> v2:172.21.15.161:3300/0 conn(0x7f928c06cd20 0x7f928c15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c06c240 con 0x7f928c0c52e0 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f927c001670 con 0x7f928c0c52e0 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 >> v1:172.21.15.132:6789/0 conn(0x7f928c0c52e0 legacy=0x7f928c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9278003970 0x7f9278003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92780047c0 0x7f9278004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9278005180 0x7f927800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c1510b0 con 0x7f92780047c0 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06bf60 con 0x7f9278003970 2023-11-18T20:38:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927800bfa0 con 0x7f9278005180 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9292133640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c14e7f0 0x7f928c0c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.245+0000 7f9291932640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92780047c0 0x7f9278004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.246+0000 7f9291932640 1 -- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9278005180 msgr2=0x7f927800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.246+0000 7f9291932640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9278005180 0x7f927800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.246+0000 7f9292133640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9278003970 0x7f9278003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.246+0000 7f9291932640 1 -- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9278003970 msgr2=0x7f9278003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.246+0000 7f9291932640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9278003970 0x7f9278003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.246+0000 7f9291932640 1 -- 172.21.15.132:0/1199012820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278003520 con 0x7f92780047c0 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.247+0000 7f9291932640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92780047c0 0x7f9278004c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c210 tx=0x7f92780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297193ca1975c433 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.247+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c02cae0 con 0x7f92780047c0 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.247+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c02cc40 con 0x7f92780047c0 2023-11-18T20:38:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.247+0000 7f9291131640 1 -- 172.21.15.132:0/1199012820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c0058d0 con 0x7f92780047c0 2023-11-18T20:38:00.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.247+0000 7f9293135640 1 -- 172.21.15.132:0/1199012820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92780047c0 msgr2=0x7f9278004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.247+0000 7f9293135640 1 --2- 172.21.15.132:0/1199012820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92780047c0 0x7f9278004c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c210 tx=0x7f92780057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.247+0000 7f9292934640 1 -- 172.21.15.132:0/1199012820 reap_dead start 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.248+0000 7f9293135640 1 -- 172.21.15.132:0/1199012820 shutdown_connections 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.248+0000 7f9293135640 1 -- 172.21.15.132:0/1199012820 >> 172.21.15.132:0/1199012820 conn(0x7f928c0a77f0 msgr2=0x7f928c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.248+0000 7f9293135640 1 -- 172.21.15.132:0/1199012820 shutdown_connections 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.248+0000 7f9293135640 1 -- 172.21.15.132:0/1199012820 wait complete. 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.249+0000 7f9293135640 1 Processor -- start 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.249+0000 7f9293135640 1 -- start start 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.250+0000 7f9293135640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92780047c0 0x7f928c1dacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.250+0000 7f9293135640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928c14cb70 0x7f928c0bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.250+0000 7f9293135640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c1dc6b0 0x7f928c1440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.250+0000 7f9293135640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14e310 con 0x7f928c14cb70 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.250+0000 7f9293135640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14da00 con 0x7f92780047c0 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.250+0000 7f9293135640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14dd50 con 0x7f928c1dc6b0 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928c14cb70 0x7f928c0bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928c14cb70 0x7f928c0bf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60930/0 (socket says 172.21.15.132:60930) 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 -- 172.21.15.132:0/3470381160 learned_addr learned my addr 172.21.15.132:0/3470381160 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9292133640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92780047c0 0x7f928c1dacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9292934640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c1dc6b0 0x7f928c1440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 -- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c1dc6b0 msgr2=0x7f928c1440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c1dc6b0 0x7f928c1440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 -- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92780047c0 msgr2=0x7f928c1dacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92780047c0 0x7f928c1dacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 -- 172.21.15.132:0/3470381160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c14e030 con 0x7f928c14cb70 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9292133640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92780047c0 0x7f928c1dacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.251+0000 7f9291932640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928c14cb70 0x7f928c0bf0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c210 tx=0x7f928c0a8510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.252+0000 7f9282ffd640 1 -- 172.21.15.132:0/3470381160 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c039070 con 0x7f928c14cb70 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.252+0000 7f9282ffd640 1 -- 172.21.15.132:0/3470381160 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c001630 con 0x7f928c14cb70 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.252+0000 7f9282ffd640 1 -- 172.21.15.132:0/3470381160 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c03c040 con 0x7f928c14cb70 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.252+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c1da7b0 con 0x7f928c14cb70 2023-11-18T20:38:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.252+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c14d640 con 0x7f928c14cb70 2023-11-18T20:38:00.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.253+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c0a75a0 con 0x7f928c14cb70 2023-11-18T20:38:00.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.254+0000 7f9282ffd640 1 -- 172.21.15.132:0/3470381160 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f927c032070 con 0x7f928c14cb70 2023-11-18T20:38:00.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.255+0000 7f9282ffd640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f927006ae70 0x7f927006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:00.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.255+0000 7f9282ffd640 1 -- 172.21.15.132:0/3470381160 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f927c0aac90 con 0x7f928c14cb70 2023-11-18T20:38:00.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.256+0000 7f9292133640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f927006ae70 0x7f927006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:00.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.257+0000 7f9292133640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f927006ae70 0x7f927006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f928c14cb20 tx=0x7f9288008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:00.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.260+0000 7f9282ffd640 1 -- 172.21.15.132:0/3470381160 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f927c075e70 con 0x7f928c14cb70 2023-11-18T20:38:00.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:00.472+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f928c04e840 con 0x7f928c14cb70 2023-11-18T20:38:01.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.179+0000 7f9282ffd640 1 -- 172.21.15.132:0/3470381160 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f927c046070 con 0x7f928c14cb70 2023-11-18T20:38:01.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.182+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f927006ae70 msgr2=0x7f927006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:01.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.182+0000 7f9293135640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f927006ae70 0x7f927006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f928c14cb20 tx=0x7f9288008040 comp rx=0 tx=0).stop 2023-11-18T20:38:01.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.182+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928c14cb70 msgr2=0x7f928c0bf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:01.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.182+0000 7f9293135640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928c14cb70 0x7f928c0bf0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c210 tx=0x7f928c0a8510 comp rx=0 tx=0).stop 2023-11-18T20:38:01.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.183+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 shutdown_connections 2023-11-18T20:38:01.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.183+0000 7f9293135640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f927006ae70 0x7f927006d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.183+0000 7f9293135640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928c1dc6b0 0x7f928c1440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.183+0000 7f9293135640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928c14cb70 0x7f928c0bf0e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.183+0000 7f9293135640 1 --2- 172.21.15.132:0/3470381160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92780047c0 0x7f928c1dacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.183+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 >> 172.21.15.132:0/3470381160 conn(0x7f928c0a77f0 msgr2=0x7f928c0c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:01.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.183+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 shutdown_connections 2023-11-18T20:38:01.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.183+0000 7f9293135640 1 -- 172.21.15.132:0/3470381160 wait complete. 2023-11-18T20:38:01.205 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T20:38:01.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-18T20:38:01.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.418+0000 7febe0d8a640 1 Processor -- start 2023-11-18T20:38:01.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.418+0000 7febe0d8a640 1 -- start start 2023-11-18T20:38:01.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.419+0000 7febe0d8a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7febdc0a9b40 0x7febdc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:01.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.419+0000 7febe0d8a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:01.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.419+0000 7febe0d8a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc0c06c0 con 0x7febdc155490 2023-11-18T20:38:01.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.419+0000 7febe0d8a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc0a5820 con 0x7febdc0a9b40 2023-11-18T20:38:01.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.419+0000 7febe0d8a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0c1020 con 0x7febdc0c1500 2023-11-18T20:38:01.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.420+0000 7febdad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:01.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.420+0000 7febdad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc0c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:34922/0 (socket says 172.21.15.132:34922) 2023-11-18T20:38:01.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.420+0000 7febdad9d640 1 -- 172.21.15.132:0/1731182610 learned_addr learned my addr 172.21.15.132:0/1731182610 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:01.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.420+0000 7febd3fff640 1 --2- 172.21.15.132:0/1731182610 >> v2:172.21.15.161:3300/0 conn(0x7febdc0a9b40 0x7febdc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:01.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.421+0000 7febdad9d640 1 -- 172.21.15.132:0/1731182610 >> v2:172.21.15.161:3300/0 conn(0x7febdc0a9b40 msgr2=0x7febdc0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:01.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.421+0000 7febdad9d640 1 --2- 172.21.15.132:0/1731182610 >> v2:172.21.15.161:3300/0 conn(0x7febdc0a9b40 0x7febdc0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.421+0000 7febdad9d640 1 -- 172.21.15.132:0/1731182610 >> v1:172.21.15.161:6789/0 conn(0x7febdc155490 legacy=0x7febdc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:01.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.421+0000 7febdad9d640 1 -- 172.21.15.132:0/1731182610 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0c0910 con 0x7febdc0c1500 2023-11-18T20:38:01.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.422+0000 7febdad9d640 1 --2- 172.21.15.132:0/1731182610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc0c24d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7febd4009e50 tx=0x7febd402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b35db9984f1374c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:01.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febd9d9b640 1 -- 172.21.15.132:0/1731182610 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd402cb00 con 0x7febdc0c1500 2023-11-18T20:38:01.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febd9d9b640 1 -- 172.21.15.132:0/1731182610 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd402cc60 con 0x7febdc0c1500 2023-11-18T20:38:01.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febd9d9b640 1 -- 172.21.15.132:0/1731182610 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40343f0 con 0x7febdc0c1500 2023-11-18T20:38:01.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febe0d8a640 1 -- 172.21.15.132:0/1731182610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 msgr2=0x7febdc0c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:01.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febe0d8a640 1 --2- 172.21.15.132:0/1731182610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc0c24d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7febd4009e50 tx=0x7febd402bf60 comp rx=0 tx=0).stop 2023-11-18T20:38:01.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febe0d8a640 1 -- 172.21.15.132:0/1731182610 shutdown_connections 2023-11-18T20:38:01.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febe0d8a640 1 --2- 172.21.15.132:0/1731182610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc0c24d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febe0d8a640 1 --2- 172.21.15.132:0/1731182610 >> v2:172.21.15.161:3300/0 conn(0x7febdc0a9b40 0x7febdc0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febe0d8a640 1 -- 172.21.15.132:0/1731182610 >> 172.21.15.132:0/1731182610 conn(0x7febdc06a500 msgr2=0x7febdc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:01.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febe0d8a640 1 -- 172.21.15.132:0/1731182610 shutdown_connections 2023-11-18T20:38:01.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.423+0000 7febe0d8a640 1 -- 172.21.15.132:0/1731182610 wait complete. 2023-11-18T20:38:01.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.425+0000 7febe0d8a640 1 Processor -- start 2023-11-18T20:38:01.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.425+0000 7febe0d8a640 1 -- start start 2023-11-18T20:38:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febe0d8a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc1dee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febe0d8a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc155490 0x7febdc14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febe0d8a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febdc1df390 0x7febdc14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febe0d8a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc14f950 con 0x7febdc1df390 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febe0d8a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc1eac10 con 0x7febdc155490 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febe0d8a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc06ff20 con 0x7febdc0c1500 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febdad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febdc1df390 0x7febdc14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febdad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febdc1df390 0x7febdc14eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60946/0 (socket says 172.21.15.132:60946) 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.426+0000 7febdad9d640 1 -- 172.21.15.132:0/588102614 learned_addr learned my addr 172.21.15.132:0/588102614 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febd3fff640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc155490 0x7febdc14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febda59c640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc1dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febdad9d640 1 -- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 msgr2=0x7febdc1dee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febdad9d640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc1dee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febdad9d640 1 -- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc155490 msgr2=0x7febdc14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febdad9d640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc155490 0x7febdc14eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febdad9d640 1 -- 172.21.15.132:0/588102614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009b30 con 0x7febdc1df390 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febda59c640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc1dee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febdad9d640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febdc1df390 0x7febdc14eff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7febd4009e50 tx=0x7febd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febd2ffd640 1 -- 172.21.15.132:0/588102614 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4009510 con 0x7febdc1df390 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febd2ffd640 1 -- 172.21.15.132:0/588102614 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd403e450 con 0x7febdc1df390 2023-11-18T20:38:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febd2ffd640 1 -- 172.21.15.132:0/588102614 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd403e800 con 0x7febdc1df390 2023-11-18T20:38:01.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.427+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc070200 con 0x7febdc1df390 2023-11-18T20:38:01.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.428+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc14f530 con 0x7febdc1df390 2023-11-18T20:38:01.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.429+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc068350 con 0x7febdc1df390 2023-11-18T20:38:01.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.429+0000 7febd2ffd640 1 -- 172.21.15.132:0/588102614 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7febd403e960 con 0x7febdc1df390 2023-11-18T20:38:01.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.430+0000 7febd2ffd640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7febbc06ae40 0x7febbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:01.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.430+0000 7febd2ffd640 1 -- 172.21.15.132:0/588102614 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febd40ac3a0 con 0x7febdc1df390 2023-11-18T20:38:01.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.431+0000 7febda59c640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7febbc06ae40 0x7febbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.432+0000 7febda59c640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7febbc06ae40 0x7febbc06d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7febdc1df890 tx=0x7febcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.435+0000 7febd2ffd640 1 -- 172.21.15.132:0/588102614 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7febd4077440 con 0x7febdc1df390 2023-11-18T20:38:01.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:01.662+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7febdc0aa6d0 con 0x7febdc1df390 2023-11-18T20:38:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.183+0000 7febd2ffd640 1 -- 172.21.15.132:0/588102614 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7febd407aa60 con 0x7febdc1df390 2023-11-18T20:38:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.186+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7febbc06ae40 msgr2=0x7febbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.186+0000 7febe0d8a640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7febbc06ae40 0x7febbc06d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7febdc1df890 tx=0x7febcc009040 comp rx=0 tx=0).stop 2023-11-18T20:38:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febdc1df390 msgr2=0x7febdc14eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febdc1df390 0x7febdc14eff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7febd4009e50 tx=0x7febd4004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 shutdown_connections 2023-11-18T20:38:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7febbc06ae40 0x7febbc06d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febdc1df390 0x7febdc14eff0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc155490 0x7febdc14eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 --2- 172.21.15.132:0/588102614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febdc0c1500 0x7febdc1dee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 >> 172.21.15.132:0/588102614 conn(0x7febdc06a500 msgr2=0x7febdc0c2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 shutdown_connections 2023-11-18T20:38:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.187+0000 7febe0d8a640 1 -- 172.21.15.132:0/588102614 wait complete. 2023-11-18T20:38:02.209 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-18T20:38:02.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:38:02.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.417+0000 7ffbc2da5640 1 Processor -- start 2023-11-18T20:38:02.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.417+0000 7ffbc2da5640 1 -- start start 2023-11-18T20:38:02.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc2da5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc2da5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffbbc0c3ea0 0x7ffbbc0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc2da5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbbc0c64a0 con 0x7ffbbc06d0a0 2023-11-18T20:38:02.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc2da5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc0c5c00 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc2da5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc0c5ee0 con 0x7ffbbc14fd30 2023-11-18T20:38:02.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc1342640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffbbc0c3ea0 0x7ffbbc0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc1342640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffbbc0c3ea0 0x7ffbbc0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60956/0 (socket says 172.21.15.132:60956) 2023-11-18T20:38:02.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc1342640 1 -- 172.21.15.132:0/1592936848 learned_addr learned my addr 172.21.15.132:0/1592936848 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:02.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.419+0000 7ffbc0b41640 1 --2- 172.21.15.132:0/1592936848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.420+0000 7ffbc1342640 1 -- 172.21.15.132:0/1592936848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 msgr2=0x7ffbbc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:02.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.420+0000 7ffbc1342640 1 --2- 172.21.15.132:0/1592936848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.420+0000 7ffbc1342640 1 -- 172.21.15.132:0/1592936848 >> v1:172.21.15.161:6789/0 conn(0x7ffbbc06d0a0 legacy=0x7ffbbc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.420+0000 7ffbc1342640 1 -- 172.21.15.132:0/1592936848 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0c61c0 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.420+0000 7ffbc0b41640 1 --2- 172.21.15.132:0/1592936848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:02.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.421+0000 7ffbc1342640 1 --2- 172.21.15.132:0/1592936848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc0c4330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009e50 tx=0x7ffbb402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd734a45c25819c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:02.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.421+0000 7ffbbb7fe640 1 -- 172.21.15.132:0/1592936848 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb402cb00 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.421+0000 7ffbbb7fe640 1 -- 172.21.15.132:0/1592936848 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb402cc60 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.421+0000 7ffbbb7fe640 1 -- 172.21.15.132:0/1592936848 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40343f0 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.422+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1592936848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 msgr2=0x7ffbbc0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.422+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1592936848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc0c4330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009e50 tx=0x7ffbb402bf60 comp rx=0 tx=0).stop 2023-11-18T20:38:02.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.422+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1592936848 shutdown_connections 2023-11-18T20:38:02.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.422+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1592936848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc0c4330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.422+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1592936848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.422+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1592936848 >> 172.21.15.132:0/1592936848 conn(0x7ffbbc06a500 msgr2=0x7ffbbc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:02.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.422+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1592936848 shutdown_connections 2023-11-18T20:38:02.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.422+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1592936848 wait complete. 2023-11-18T20:38:02.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.424+0000 7ffbc2da5640 1 Processor -- start 2023-11-18T20:38:02.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.424+0000 7ffbc2da5640 1 -- start start 2023-11-18T20:38:02.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbc2da5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbbc06d0a0 0x7ffbbc1de990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbc2da5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbc2da5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc1e99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbc2da5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc1def80 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbc2da5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc1e9540 con 0x7ffbbc06d0a0 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbc2da5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc1519e0 con 0x7ffbbc14fd30 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbbbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbbbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc1514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60958/0 (socket says 172.21.15.132:60958) 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbbbfff640 1 -- 172.21.15.132:0/1007025470 learned_addr learned my addr 172.21.15.132:0/1007025470 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbc1342640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc1e99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.425+0000 7ffbc0b41640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbbc06d0a0 0x7ffbbc1de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbbbfff640 1 -- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 msgr2=0x7ffbbc1e99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbbbfff640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc1e99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbbbfff640 1 -- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbbc06d0a0 msgr2=0x7ffbbc1de990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbbbfff640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbbc06d0a0 0x7ffbbc1de990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbbbfff640 1 -- 172.21.15.132:0/1007025470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4009b30 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbbbfff640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc1514a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c3f0 tx=0x7ffba800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:02.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbb97fa640 1 -- 172.21.15.132:0/1007025470 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba80052d0 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbb97fa640 1 -- 172.21.15.132:0/1007025470 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba8005450 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc1dc5f0 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbb97fa640 1 -- 172.21.15.132:0/1007025470 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8003830 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.426+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc1e91d0 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.427+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbbc0c6910 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.429+0000 7ffbb97fa640 1 -- 172.21.15.132:0/1007025470 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffba8003990 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.429+0000 7ffbb97fa640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffba006ae70 0x7ffba006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.430+0000 7ffbb97fa640 1 -- 172.21.15.132:0/1007025470 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffba8088ae0 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.430+0000 7ffbc0b41640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffba006ae70 0x7ffba006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.431+0000 7ffbc0b41640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffba006ae70 0x7ffba006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006fd0 tx=0x7ffbb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.434+0000 7ffbb97fa640 1 -- 172.21.15.132:0/1007025470 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffba8053c20 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.663+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbbc068350 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.664+0000 7ffbb97fa640 1 -- 172.21.15.132:0/1007025470 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7ffba8017090 con 0x7ffbbc0c3ea0 2023-11-18T20:38:02.666 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:02.666 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:37:58.599151+0000","modified":"2023-11-18T20:38:01.664198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T20:38:02.666 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-11-18T20:38:02.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffba006ae70 msgr2=0x7ffba006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffba006ae70 0x7ffba006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006fd0 tx=0x7ffbb0008040 comp rx=0 tx=0).stop 2023-11-18T20:38:02.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 msgr2=0x7ffbbc1514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc1514a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c3f0 tx=0x7ffba800c8b0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 shutdown_connections 2023-11-18T20:38:02.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffba006ae70 0x7ffba006d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffbbc14fd30 0x7ffbbc1e99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbbc0c3ea0 0x7ffbbc1514a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 --2- 172.21.15.132:0/1007025470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbbc06d0a0 0x7ffbbc1de990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 >> 172.21.15.132:0/1007025470 conn(0x7ffbbc06a500 msgr2=0x7ffbbc152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:02.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 shutdown_connections 2023-11-18T20:38:02.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.667+0000 7ffbc2da5640 1 -- 172.21.15.132:0/1007025470 wait complete. 2023-11-18T20:38:02.688 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.891+0000 7f549988a640 1 Processor -- start 2023-11-18T20:38:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.891+0000 7f549988a640 1 -- start start 2023-11-18T20:38:02.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.892+0000 7f549988a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f549414e7f0 0x7f54940c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f549988a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549406cd20 0x7f549415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f549988a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940a8380 con 0x7f54940c52e0 2023-11-18T20:38:02.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f549988a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54941510b0 con 0x7f549414e7f0 2023-11-18T20:38:02.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f549988a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549406bf60 con 0x7f549406cd20 2023-11-18T20:38:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f5499089640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549406cd20 0x7f549415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f5499089640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549406cd20 0x7f549415ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:34936/0 (socket says 172.21.15.132:34936) 2023-11-18T20:38:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f5499089640 1 -- 172.21.15.132:0/2465661780 learned_addr learned my addr 172.21.15.132:0/2465661780 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f5493fff640 1 --1- 172.21.15.132:0/2465661780 >> v1:172.21.15.161:6789/0 conn(0x7f54940c52e0 0x7f549406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:60448/0 (socket says 172.21.15.132:60448) 2023-11-18T20:38:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.893+0000 7f5498888640 1 --2- 172.21.15.132:0/2465661780 >> v2:172.21.15.161:3300/0 conn(0x7f549414e7f0 0x7f54940c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.894+0000 7f5499089640 1 -- 172.21.15.132:0/2465661780 >> v2:172.21.15.161:3300/0 conn(0x7f549414e7f0 msgr2=0x7f54940c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.894+0000 7f5499089640 1 --2- 172.21.15.132:0/2465661780 >> v2:172.21.15.161:3300/0 conn(0x7f549414e7f0 0x7f54940c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.894+0000 7f5499089640 1 -- 172.21.15.132:0/2465661780 >> v1:172.21.15.161:6789/0 conn(0x7f54940c52e0 legacy=0x7f549406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.894+0000 7f5499089640 1 -- 172.21.15.132:0/2465661780 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549406c240 con 0x7f549406cd20 2023-11-18T20:38:02.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.895+0000 7f5499089640 1 --2- 172.21.15.132:0/2465661780 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549406cd20 0x7f549415ba30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f548c009e50 tx=0x7f548c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe1767e76cf4e02 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:02.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.896+0000 7f54937fe640 1 -- 172.21.15.132:0/2465661780 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c02ca80 con 0x7f549406cd20 2023-11-18T20:38:02.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.896+0000 7f54937fe640 1 -- 172.21.15.132:0/2465661780 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c02cbe0 con 0x7f549406cd20 2023-11-18T20:38:02.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.896+0000 7f54937fe640 1 -- 172.21.15.132:0/2465661780 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0343f0 con 0x7f549406cd20 2023-11-18T20:38:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.897+0000 7f549988a640 1 -- 172.21.15.132:0/2465661780 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549406cd20 msgr2=0x7f549415ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.897+0000 7f549988a640 1 --2- 172.21.15.132:0/2465661780 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549406cd20 0x7f549415ba30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f548c009e50 tx=0x7f548c02bee0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.897+0000 7f549988a640 1 -- 172.21.15.132:0/2465661780 shutdown_connections 2023-11-18T20:38:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.897+0000 7f549988a640 1 --2- 172.21.15.132:0/2465661780 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549406cd20 0x7f549415ba30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.897+0000 7f549988a640 1 --2- 172.21.15.132:0/2465661780 >> v2:172.21.15.161:3300/0 conn(0x7f549414e7f0 0x7f54940c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.897+0000 7f549988a640 1 -- 172.21.15.132:0/2465661780 >> 172.21.15.132:0/2465661780 conn(0x7f54940a77f0 msgr2=0x7f54940a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.897+0000 7f549988a640 1 -- 172.21.15.132:0/2465661780 shutdown_connections 2023-11-18T20:38:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.897+0000 7f549988a640 1 -- 172.21.15.132:0/2465661780 wait complete. 2023-11-18T20:38:02.899 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-11-18T20:38:02.898+0000 7f337ff55640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:38:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.898+0000 7f549988a640 1 Processor -- start 2023-11-18T20:38:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.899+0000 7f549988a640 1 -- start start 2023-11-18T20:38:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.899+0000 7f549988a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549406cd20 0x7f5494071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.899+0000 7f549988a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54940c52e0 0x7f54941ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.899+0000 7f549988a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f549414e7f0 0x7f54941eae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.899+0000 7f549988a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54941eb3c0 con 0x7f549414e7f0 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.899+0000 7f549988a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5494148640 con 0x7f549406cd20 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.899+0000 7f549988a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54941ee810 con 0x7f54940c52e0 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f549414e7f0 0x7f54941eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f549414e7f0 0x7f54941eae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60974/0 (socket says 172.21.15.132:60974) 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 -- 172.21.15.132:0/835844854 learned_addr learned my addr 172.21.15.132:0/835844854 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5493fff640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54940c52e0 0x7f54941ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5498888640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549406cd20 0x7f5494071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 -- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54940c52e0 msgr2=0x7f54941ea940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54940c52e0 0x7f54941ea940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 -- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549406cd20 msgr2=0x7f5494071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549406cd20 0x7f5494071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:02.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 -- 172.21.15.132:0/835844854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c009b30 con 0x7f549414e7f0 2023-11-18T20:38:02.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.900+0000 7f5499089640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f549414e7f0 0x7f54941eae80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f548c009e50 tx=0x7f548c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:02.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.901+0000 7f54917fa640 1 -- 172.21.15.132:0/835844854 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c009510 con 0x7f549414e7f0 2023-11-18T20:38:02.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.901+0000 7f54917fa640 1 -- 172.21.15.132:0/835844854 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c03e450 con 0x7f549414e7f0 2023-11-18T20:38:02.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.901+0000 7f54917fa640 1 -- 172.21.15.132:0/835844854 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c03e800 con 0x7f549414e7f0 2023-11-18T20:38:02.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.901+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54941ddcd0 con 0x7f549414e7f0 2023-11-18T20:38:02.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.901+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54941de290 con 0x7f549414e7f0 2023-11-18T20:38:02.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.902+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549404e840 con 0x7f549414e7f0 2023-11-18T20:38:02.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.903+0000 7f54917fa640 1 -- 172.21.15.132:0/835844854 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f548c02cd50 con 0x7f549414e7f0 2023-11-18T20:38:02.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.904+0000 7f54917fa640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f547806ae70 0x7f547806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:02.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.904+0000 7f54917fa640 1 -- 172.21.15.132:0/835844854 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f548c0ac060 con 0x7f549414e7f0 2023-11-18T20:38:02.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.904+0000 7f5498888640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f547806ae70 0x7f547806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:02.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.905+0000 7f5498888640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f547806ae70 0x7f547806d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5488009a30 tx=0x7f5488008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:02.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:02.908+0000 7f54917fa640 1 -- 172.21.15.132:0/835844854 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f548c0dee90 con 0x7f549414e7f0 2023-11-18T20:38:03.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.082+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54940c3c70 con 0x7f549414e7f0 2023-11-18T20:38:03.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.085+0000 7f54917fa640 1 -- 172.21.15.132:0/835844854 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f548c077100 con 0x7f549414e7f0 2023-11-18T20:38:03.087 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:03.087 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.087+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f547806ae70 msgr2=0x7f547806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.087+0000 7f549988a640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f547806ae70 0x7f547806d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5488009a30 tx=0x7f5488008040 comp rx=0 tx=0).stop 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.087+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f549414e7f0 msgr2=0x7f54941eae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f549414e7f0 0x7f54941eae80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f548c009e50 tx=0x7f548c004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 shutdown_connections 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f547806ae70 0x7f547806d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f549414e7f0 0x7f54941eae80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54940c52e0 0x7f54941ea940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 --2- 172.21.15.132:0/835844854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549406cd20 0x7f5494071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 >> 172.21.15.132:0/835844854 conn(0x7f54940a77f0 msgr2=0x7f549406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:03.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 shutdown_connections 2023-11-18T20:38:03.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.088+0000 7f549988a640 1 -- 172.21.15.132:0/835844854 wait complete. 2023-11-18T20:38:03.108 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T20:38:03.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:38:03.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.311+0000 7ffa69c21640 1 Processor -- start 2023-11-18T20:38:03.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.312+0000 7ffa69c21640 1 -- start start 2023-11-18T20:38:03.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa69c21640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffa6414fd30 0x7ffa64152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa69c21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa6406d0a0 0x7ffa640a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa69c21640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffa640a5260 0x7ffa640c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa69c21640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640c64a0 con 0x7ffa6414fd30 2023-11-18T20:38:03.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa69c21640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640c5c00 con 0x7ffa640a5260 2023-11-18T20:38:03.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa69c21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640c5ee0 con 0x7ffa6406d0a0 2023-11-18T20:38:03.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa637fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffa6414fd30 0x7ffa64152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa637fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffa6414fd30 0x7ffa64152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60976/0 (socket says 172.21.15.132:60976) 2023-11-18T20:38:03.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.313+0000 7ffa637fe640 1 -- 172.21.15.132:0/1063070863 learned_addr learned my addr 172.21.15.132:0/1063070863 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:03.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.314+0000 7ffa63fff640 1 --2- 172.21.15.132:0/1063070863 >> v2:172.21.15.161:3300/0 conn(0x7ffa640a5260 0x7ffa640c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.314+0000 7ffa5bfff640 1 --2- 172.21.15.132:0/1063070863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa6406d0a0 0x7ffa640a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.314+0000 7ffa637fe640 1 -- 172.21.15.132:0/1063070863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa6406d0a0 msgr2=0x7ffa640a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:03.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.314+0000 7ffa637fe640 1 --2- 172.21.15.132:0/1063070863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa6406d0a0 0x7ffa640a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.314+0000 7ffa637fe640 1 -- 172.21.15.132:0/1063070863 >> v2:172.21.15.161:3300/0 conn(0x7ffa640a5260 msgr2=0x7ffa640c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:03.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.314+0000 7ffa637fe640 1 --2- 172.21.15.132:0/1063070863 >> v2:172.21.15.161:3300/0 conn(0x7ffa640a5260 0x7ffa640c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.314+0000 7ffa637fe640 1 -- 172.21.15.132:0/1063070863 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640c61c0 con 0x7ffa6414fd30 2023-11-18T20:38:03.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.314+0000 7ffa5bfff640 1 --2- 172.21.15.132:0/1063070863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa6406d0a0 0x7ffa640a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:03.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.315+0000 7ffa637fe640 1 --2- 172.21.15.132:0/1063070863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa64152f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffa6406d990 tx=0x7ffa5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dde4b41c2f968f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:03.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.315+0000 7ffa62ffd640 1 -- 172.21.15.132:0/1063070863 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54031870 con 0x7ffa6414fd30 2023-11-18T20:38:03.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.315+0000 7ffa62ffd640 1 -- 172.21.15.132:0/1063070863 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa540319d0 con 0x7ffa6414fd30 2023-11-18T20:38:03.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.315+0000 7ffa62ffd640 1 -- 172.21.15.132:0/1063070863 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54031d60 con 0x7ffa6414fd30 2023-11-18T20:38:03.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 -- 172.21.15.132:0/1063070863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 msgr2=0x7ffa64152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 --2- 172.21.15.132:0/1063070863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa64152f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffa6406d990 tx=0x7ffa5402b910 comp rx=0 tx=0).stop 2023-11-18T20:38:03.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 -- 172.21.15.132:0/1063070863 shutdown_connections 2023-11-18T20:38:03.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 --2- 172.21.15.132:0/1063070863 >> v2:172.21.15.161:3300/0 conn(0x7ffa640a5260 0x7ffa640c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 --2- 172.21.15.132:0/1063070863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa6406d0a0 0x7ffa640a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 --2- 172.21.15.132:0/1063070863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa64152f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 -- 172.21.15.132:0/1063070863 >> 172.21.15.132:0/1063070863 conn(0x7ffa6406a500 msgr2=0x7ffa6406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:03.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 -- 172.21.15.132:0/1063070863 shutdown_connections 2023-11-18T20:38:03.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.316+0000 7ffa69c21640 1 -- 172.21.15.132:0/1063070863 wait complete. 2023-11-18T20:38:03.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.318+0000 7ffa69c21640 1 Processor -- start 2023-11-18T20:38:03.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.318+0000 7ffa69c21640 1 -- start start 2023-11-18T20:38:03.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa69c21640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa6406d0a0 0x7ffa6414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa69c21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa640a5260 0x7ffa64070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa69c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa6414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa69c21640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa641ddea0 con 0x7ffa6414fd30 2023-11-18T20:38:03.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa69c21640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6414f570 con 0x7ffa6406d0a0 2023-11-18T20:38:03.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa69c21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6414ed50 con 0x7ffa640a5260 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa63fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa6414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa63fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa6414e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60986/0 (socket says 172.21.15.132:60986) 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa63fff640 1 -- 172.21.15.132:0/280027228 learned_addr learned my addr 172.21.15.132:0/280027228 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa5bfff640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa640a5260 0x7ffa64070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.319+0000 7ffa63fff640 1 -- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa640a5260 msgr2=0x7ffa64070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa63fff640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa640a5260 0x7ffa64070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa637fe640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa6406d0a0 0x7ffa6414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa63fff640 1 -- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa6406d0a0 msgr2=0x7ffa6414f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa63fff640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa6406d0a0 0x7ffa6414f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa63fff640 1 -- 172.21.15.132:0/280027228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540094d0 con 0x7ffa6414fd30 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa5bfff640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa640a5260 0x7ffa64070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:03.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa63fff640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa6414e1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00cd70 tx=0x7ffa5c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:03.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa60ff9640 1 -- 172.21.15.132:0/280027228 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c003b90 con 0x7ffa6414fd30 2023-11-18T20:38:03.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa60ff9640 1 -- 172.21.15.132:0/280027228 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c003cf0 con 0x7ffa6414fd30 2023-11-18T20:38:03.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa60ff9640 1 -- 172.21.15.132:0/280027228 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c004240 con 0x7ffa6414fd30 2023-11-18T20:38:03.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa641ee030 con 0x7ffa6414fd30 2023-11-18T20:38:03.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.320+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa64070c70 con 0x7ffa6414fd30 2023-11-18T20:38:03.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.321+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa641ddbc0 con 0x7ffa6414fd30 2023-11-18T20:38:03.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.322+0000 7ffa60ff9640 1 -- 172.21.15.132:0/280027228 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa5c0043a0 con 0x7ffa6414fd30 2023-11-18T20:38:03.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.323+0000 7ffa60ff9640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffa4406ae40 0x7ffa4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.323+0000 7ffa60ff9640 1 -- 172.21.15.132:0/280027228 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa5c012070 con 0x7ffa6414fd30 2023-11-18T20:38:03.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.324+0000 7ffa637fe640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffa4406ae40 0x7ffa4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.325+0000 7ffa637fe640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffa4406ae40 0x7ffa4406d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa54036000 tx=0x7ffa5403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:03.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.327+0000 7ffa60ff9640 1 -- 172.21.15.132:0/280027228 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa641ddbc0 con 0x7ffa6414fd30 2023-11-18T20:38:03.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.512+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa640c43e0 con 0x7ffa4406ae40 2023-11-18T20:38:03.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.535+0000 7ffa60ff9640 1 -- 172.21.15.132:0/280027228 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252668 (secure 0 0 0) 0x7ffa5403a420 con 0x7ffa4406ae40 2023-11-18T20:38:03.539 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:38:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.539+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffa4406ae40 msgr2=0x7ffa4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.539+0000 7ffa69c21640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffa4406ae40 0x7ffa4406d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa54036000 tx=0x7ffa5403c040 comp rx=0 tx=0).stop 2023-11-18T20:38:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.539+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 msgr2=0x7ffa6414e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.539+0000 7ffa69c21640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa6414e1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00cd70 tx=0x7ffa5c00a660 comp rx=0 tx=0).stop 2023-11-18T20:38:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.539+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 shutdown_connections 2023-11-18T20:38:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.540+0000 7ffa69c21640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ffa4406ae40 0x7ffa4406d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.540+0000 7ffa69c21640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa6414fd30 0x7ffa6414e1b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.540+0000 7ffa69c21640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa640a5260 0x7ffa64070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.540+0000 7ffa69c21640 1 --2- 172.21.15.132:0/280027228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa6406d0a0 0x7ffa6414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.540+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 >> 172.21.15.132:0/280027228 conn(0x7ffa6406a500 msgr2=0x7ffa64150c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.540+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 shutdown_connections 2023-11-18T20:38:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.540+0000 7ffa69c21640 1 -- 172.21.15.132:0/280027228 wait complete. 2023-11-18T20:38:03.559 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-11-18T20:38:02.630940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":2536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":2596864,"data_stored":1618984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500135"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.129004+0000","last_change":"2023-11-18T20:37:57.129004+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.129004+0000","last_undegraded":"2023-11-18T20:37:57.129004+0000","last_fullsized":"2023-11-18T20:37:57.129004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128753+0000","last_change":"2023-11-18T20:37:57.128753+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128753+0000","last_undegraded":"2023-11-18T20:37:57.128753+0000","last_fullsized":"2023-11-18T20:37:57.128753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368166+0000","last_change":"2023-11-18T20:37:57.368166+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368166+0000","last_undegraded":"2023-11-18T20:37:57.368166+0000","last_fullsized":"2023-11-18T20:37:57.368166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.127577+0000","last_change":"2023-11-18T20:37:57.127577+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.127577+0000","last_undegraded":"2023-11-18T20:37:57.127577+0000","last_fullsized":"2023-11-18T20:37:57.127577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.123507+0000","last_change":"2023-11-18T20:37:57.123507+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.123507+0000","last_undegraded":"2023-11-18T20:37:57.123507+0000","last_fullsized":"2023-11-18T20:37:57.123507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.120901+0000","last_change":"2023-11-18T20:37:57.120901+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.120901+0000","last_undegraded":"2023-11-18T20:37:57.120901+0000","last_fullsized":"2023-11-18T20:37:57.120901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369148+0000","last_change":"2023-11-18T20:37:57.369148+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369148+0000","last_undegraded":"2023-11-18T20:37:57.369148+0000","last_fullsized":"2023-11-18T20:37:57.369148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121461+0000","last_change":"2023-11-18T20:37:57.121461+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121461+0000","last_undegraded":"2023-11-18T20:37:57.121461+0000","last_fullsized":"2023-11-18T20:37:57.121461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369496+0000","last_change":"2023-11-18T20:37:57.369496+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369496+0000","last_undegraded":"2023-11-18T20:37:57.369496+0000","last_fullsized":"2023-11-18T20:37:57.369496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128226+0000","last_change":"2023-11-18T20:37:57.128226+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128226+0000","last_undegraded":"2023-11-18T20:37:57.128226+0000","last_fullsized":"2023-11-18T20:37:57.128226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121610+0000","last_change":"2023-11-18T20:37:57.121610+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121610+0000","last_undegraded":"2023-11-18T20:37:57.121610+0000","last_fullsized":"2023-11-18T20:37:57.121610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133056+0000","last_change":"2023-11-18T20:37:57.133056+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133056+0000","last_undegraded":"2023-11-18T20:37:57.133056+0000","last_fullsized":"2023-11-18T20:37:57.133056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.120901+0000","last_change":"2023-11-18T20:37:57.120901+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.120901+0000","last_undegraded":"2023-11-18T20:37:57.120901+0000","last_fullsized":"2023-11-18T20:37:57.120901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.136645+0000","last_change":"2023-11-18T20:37:57.136645+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.136645+0000","last_undegraded":"2023-11-18T20:37:57.136645+0000","last_fullsized":"2023-11-18T20:37:57.136645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133508+0000","last_change":"2023-11-18T20:37:57.133508+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133508+0000","last_undegraded":"2023-11-18T20:37:57.133508+0000","last_fullsized":"2023-11-18T20:37:57.133508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368068+0000","last_change":"2023-11-18T20:37:57.368068+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368068+0000","last_undegraded":"2023-11-18T20:37:57.368068+0000","last_fullsized":"2023-11-18T20:37:57.368068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-18T20:37:57.657708+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:37:57.657708+0000","last_peered":"2023-11-18T20:37:57.657708+0000","last_clean":"2023-11-18T20:37:57.657708+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:37:57.657708+0000","last_undegraded":"2023-11-18T20:37:57.657708+0000","last_fullsized":"2023-11-18T20:37:57.657708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126127+0000","last_change":"2023-11-18T20:37:57.126127+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126127+0000","last_undegraded":"2023-11-18T20:37:57.126127+0000","last_fullsized":"2023-11-18T20:37:57.126127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126963+0000","last_change":"2023-11-18T20:37:57.126963+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126963+0000","last_undegraded":"2023-11-18T20:37:57.126963+0000","last_fullsized":"2023-11-18T20:37:57.126963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369193+0000","last_change":"2023-11-18T20:37:57.369193+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369193+0000","last_undegraded":"2023-11-18T20:37:57.369193+0000","last_fullsized":"2023-11-18T20:37:57.369193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126313+0000","last_change":"2023-11-18T20:37:57.126313+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126313+0000","last_undegraded":"2023-11-18T20:37:57.126313+0000","last_fullsized":"2023-11-18T20:37:57.126313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.131766+0000","last_change":"2023-11-18T20:37:57.131766+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.131766+0000","last_undegraded":"2023-11-18T20:37:57.131766+0000","last_fullsized":"2023-11-18T20:37:57.131766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126095+0000","last_change":"2023-11-18T20:37:57.126095+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126095+0000","last_undegraded":"2023-11-18T20:37:57.126095+0000","last_fullsized":"2023-11-18T20:37:57.126095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.132409+0000","last_change":"2023-11-18T20:37:57.132409+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.132409+0000","last_undegraded":"2023-11-18T20:37:57.132409+0000","last_fullsized":"2023-11-18T20:37:57.132409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126257+0000","last_change":"2023-11-18T20:37:57.126257+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126257+0000","last_undegraded":"2023-11-18T20:37:57.126257+0000","last_fullsized":"2023-11-18T20:37:57.126257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121685+0000","last_change":"2023-11-18T20:37:57.121685+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121685+0000","last_undegraded":"2023-11-18T20:37:57.121685+0000","last_fullsized":"2023-11-18T20:37:57.121685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.129743+0000","last_change":"2023-11-18T20:37:57.129743+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.129743+0000","last_undegraded":"2023-11-18T20:37:57.129743+0000","last_fullsized":"2023-11-18T20:37:57.129743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368424+0000","last_change":"2023-11-18T20:37:57.368424+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368424+0000","last_undegraded":"2023-11-18T20:37:57.368424+0000","last_fullsized":"2023-11-18T20:37:57.368424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126982+0000","last_change":"2023-11-18T20:37:57.126982+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126982+0000","last_undegraded":"2023-11-18T20:37:57.126982+0000","last_fullsized":"2023-11-18T20:37:57.126982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121361+0000","last_change":"2023-11-18T20:37:57.121361+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121361+0000","last_undegraded":"2023-11-18T20:37:57.121361+0000","last_fullsized":"2023-11-18T20:37:57.121361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.122223+0000","last_change":"2023-11-18T20:37:57.122223+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.122223+0000","last_undegraded":"2023-11-18T20:37:57.122223+0000","last_fullsized":"2023-11-18T20:37:57.122223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128918+0000","last_change":"2023-11-18T20:37:57.128918+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128918+0000","last_undegraded":"2023-11-18T20:37:57.128918+0000","last_fullsized":"2023-11-18T20:37:57.128918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133312+0000","last_change":"2023-11-18T20:37:57.133312+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133312+0000","last_undegraded":"2023-11-18T20:37:57.133312+0000","last_fullsized":"2023-11-18T20:37:57.133312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.601}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2290000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":770048,"data_stored":645149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.978}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1389999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0739999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.99}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":770048,"data_stored":645149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9870000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.927}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0790000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3450000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.399}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3090000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:38:03.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:38:03.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.816+0000 7f35bf59e640 1 Processor -- start 2023-11-18T20:38:03.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.817+0000 7f35bf59e640 1 -- start start 2023-11-18T20:38:03.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.818+0000 7f35bf59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35c00ca450 0x7f35c00ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.818+0000 7f35bf59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c0158a60 con 0x7f35c014e7c0 2023-11-18T20:38:03.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.818+0000 7f35bf59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c00c4dd0 con 0x7f35c0154580 2023-11-18T20:38:03.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.818+0000 7f35bf59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00c5b10 con 0x7f35c00ca450 2023-11-18T20:38:03.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.818+0000 7f35bdd9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35c00ca450 0x7f35c00ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.818+0000 7f35be59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f35c014e7c0 0x7f35c00c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50106/0 (socket says 172.21.15.132:50106) 2023-11-18T20:38:03.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.818+0000 7f35be59c640 1 -- 172.21.15.132:0/2257580905 learned_addr learned my addr 172.21.15.132:0/2257580905 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.819+0000 7f35bd59a640 1 -- 172.21.15.132:0/2257580905 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022722440 0 0) 0x7f35c0158a60 con 0x7f35c014e7c0 2023-11-18T20:38:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.819+0000 7f35bd59a640 1 -- 172.21.15.132:0/2257580905 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35ac003520 con 0x7f35c014e7c0 2023-11-18T20:38:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.819+0000 7f35bdd9b640 1 -- 172.21.15.132:0/2257580905 >> v1:172.21.15.161:6789/0 conn(0x7f35c0154580 legacy=0x7f35c01549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.819+0000 7f35bdd9b640 1 -- 172.21.15.132:0/2257580905 >> v1:172.21.15.132:6789/0 conn(0x7f35c014e7c0 legacy=0x7f35c00c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.819+0000 7f35bdd9b640 1 -- 172.21.15.132:0/2257580905 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0157ca0 con 0x7f35c00ca450 2023-11-18T20:38:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.820+0000 7f35bdd9b640 1 --2- 172.21.15.132:0/2257580905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c00ca8d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35a80097a0 tx=0x7f35a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b754475f23bbb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:03.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.820+0000 7f35bd59a640 1 -- 172.21.15.132:0/2257580905 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a802e070 con 0x7f35c00ca450 2023-11-18T20:38:03.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.820+0000 7f35bd59a640 1 -- 172.21.15.132:0/2257580905 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a80315a0 con 0x7f35c00ca450 2023-11-18T20:38:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.820+0000 7f35bd59a640 1 -- 172.21.15.132:0/2257580905 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8031930 con 0x7f35c00ca450 2023-11-18T20:38:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.821+0000 7f35bf59e640 1 -- 172.21.15.132:0/2257580905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 msgr2=0x7f35c00ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.821+0000 7f35bf59e640 1 --2- 172.21.15.132:0/2257580905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c00ca8d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35a80097a0 tx=0x7f35a802b840 comp rx=0 tx=0).stop 2023-11-18T20:38:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.821+0000 7f35bf59e640 1 -- 172.21.15.132:0/2257580905 shutdown_connections 2023-11-18T20:38:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.821+0000 7f35bf59e640 1 --2- 172.21.15.132:0/2257580905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c00ca8d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.821+0000 7f35bf59e640 1 -- 172.21.15.132:0/2257580905 >> 172.21.15.132:0/2257580905 conn(0x7f35c00abf00 msgr2=0x7f35c00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.821+0000 7f35bf59e640 1 -- 172.21.15.132:0/2257580905 shutdown_connections 2023-11-18T20:38:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.821+0000 7f35bf59e640 1 -- 172.21.15.132:0/2257580905 wait complete. 2023-11-18T20:38:03.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.822+0000 7f35bf59e640 1 Processor -- start 2023-11-18T20:38:03.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.823+0000 7f35bf59e640 1 -- start start 2023-11-18T20:38:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.823+0000 7f35bf59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c0153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.823+0000 7f35bf59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c014e7c0 0x7f35c00aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35bf59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35c0154580 0x7f35c0153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35bf59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0152ca0 con 0x7f35c00ca450 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35bf59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0154210 con 0x7f35c014e7c0 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35bf59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0156810 con 0x7f35c0154580 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35be59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c0153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35be59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c0153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32782/0 (socket says 172.21.15.132:32782) 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35be59c640 1 -- 172.21.15.132:0/1653132636 learned_addr learned my addr 172.21.15.132:0/1653132636 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35bed9d640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35c0154580 0x7f35c0153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35be59c640 1 -- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35c0154580 msgr2=0x7f35c0153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35be59c640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35c0154580 0x7f35c0153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35be59c640 1 -- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c014e7c0 msgr2=0x7f35c00aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35be59c640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c014e7c0 0x7f35c00aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35be59c640 1 -- 172.21.15.132:0/1653132636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8009400 con 0x7f35c00ca450 2023-11-18T20:38:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.824+0000 7f35bed9d640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35c0154580 0x7f35c0153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.825+0000 7f35be59c640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c0153bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f35b000cbc0 tx=0x7f35b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.825+0000 7f35b6ffd640 1 -- 172.21.15.132:0/1653132636 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000ad40 con 0x7f35c00ca450 2023-11-18T20:38:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.825+0000 7f35b6ffd640 1 -- 172.21.15.132:0/1653132636 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0012400 con 0x7f35c00ca450 2023-11-18T20:38:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.825+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c0156af0 con 0x7f35c00ca450 2023-11-18T20:38:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.825+0000 7f35b6ffd640 1 -- 172.21.15.132:0/1653132636 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000aea0 con 0x7f35c00ca450 2023-11-18T20:38:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.825+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c0148d30 con 0x7f35c00ca450 2023-11-18T20:38:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.826+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c0152e10 con 0x7f35c00ca450 2023-11-18T20:38:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.827+0000 7f35b6ffd640 1 -- 172.21.15.132:0/1653132636 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35b0007070 con 0x7f35c00ca450 2023-11-18T20:38:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.828+0000 7f35b6ffd640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35a006ae40 0x7f35a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.828+0000 7f35b6ffd640 1 -- 172.21.15.132:0/1653132636 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35b0089670 con 0x7f35c00ca450 2023-11-18T20:38:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.828+0000 7f35bdd9b640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35a006ae40 0x7f35a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:03.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.829+0000 7f35bdd9b640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35a006ae40 0x7f35a006d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35a8036000 tx=0x7f35a8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:03.832+0000 7f35b6ffd640 1 -- 172.21.15.132:0/1653132636 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35b0054710 con 0x7f35c00ca450 2023-11-18T20:38:04.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.005+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35c0158540 con 0x7f35a006ae40 2023-11-18T20:38:04.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.025+0000 7f35b6ffd640 1 -- 172.21.15.132:0/1653132636 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252668 (secure 0 0 0) 0x7f35a8031930 con 0x7f35a006ae40 2023-11-18T20:38:04.029 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:38:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35a006ae40 msgr2=0x7f35a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35a006ae40 0x7f35a006d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35a8036000 tx=0x7f35a8030000 comp rx=0 tx=0).stop 2023-11-18T20:38:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 msgr2=0x7f35c0153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c0153bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f35b000cbc0 tx=0x7f35b000a430 comp rx=0 tx=0).stop 2023-11-18T20:38:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 shutdown_connections 2023-11-18T20:38:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35a006ae40 0x7f35a006d300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35c0154580 0x7f35c0153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c014e7c0 0x7f35c00aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 --2- 172.21.15.132:0/1653132636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35c00ca450 0x7f35c0153bc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 >> 172.21.15.132:0/1653132636 conn(0x7f35c00abf00 msgr2=0x7f35c00c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 shutdown_connections 2023-11-18T20:38:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.030+0000 7f35bf59e640 1 -- 172.21.15.132:0/1653132636 wait complete. 2023-11-18T20:38:04.050 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-11-18T20:38:02.630940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":2536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":2596864,"data_stored":1618984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500135"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.129004+0000","last_change":"2023-11-18T20:37:57.129004+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.129004+0000","last_undegraded":"2023-11-18T20:37:57.129004+0000","last_fullsized":"2023-11-18T20:37:57.129004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128753+0000","last_change":"2023-11-18T20:37:57.128753+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128753+0000","last_undegraded":"2023-11-18T20:37:57.128753+0000","last_fullsized":"2023-11-18T20:37:57.128753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368166+0000","last_change":"2023-11-18T20:37:57.368166+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368166+0000","last_undegraded":"2023-11-18T20:37:57.368166+0000","last_fullsized":"2023-11-18T20:37:57.368166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.127577+0000","last_change":"2023-11-18T20:37:57.127577+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.127577+0000","last_undegraded":"2023-11-18T20:37:57.127577+0000","last_fullsized":"2023-11-18T20:37:57.127577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.123507+0000","last_change":"2023-11-18T20:37:57.123507+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.123507+0000","last_undegraded":"2023-11-18T20:37:57.123507+0000","last_fullsized":"2023-11-18T20:37:57.123507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.120901+0000","last_change":"2023-11-18T20:37:57.120901+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.120901+0000","last_undegraded":"2023-11-18T20:37:57.120901+0000","last_fullsized":"2023-11-18T20:37:57.120901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369148+0000","last_change":"2023-11-18T20:37:57.369148+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369148+0000","last_undegraded":"2023-11-18T20:37:57.369148+0000","last_fullsized":"2023-11-18T20:37:57.369148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121461+0000","last_change":"2023-11-18T20:37:57.121461+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121461+0000","last_undegraded":"2023-11-18T20:37:57.121461+0000","last_fullsized":"2023-11-18T20:37:57.121461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369496+0000","last_change":"2023-11-18T20:37:57.369496+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369496+0000","last_undegraded":"2023-11-18T20:37:57.369496+0000","last_fullsized":"2023-11-18T20:37:57.369496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128226+0000","last_change":"2023-11-18T20:37:57.128226+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128226+0000","last_undegraded":"2023-11-18T20:37:57.128226+0000","last_fullsized":"2023-11-18T20:37:57.128226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121610+0000","last_change":"2023-11-18T20:37:57.121610+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121610+0000","last_undegraded":"2023-11-18T20:37:57.121610+0000","last_fullsized":"2023-11-18T20:37:57.121610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133056+0000","last_change":"2023-11-18T20:37:57.133056+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133056+0000","last_undegraded":"2023-11-18T20:37:57.133056+0000","last_fullsized":"2023-11-18T20:37:57.133056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.120901+0000","last_change":"2023-11-18T20:37:57.120901+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.120901+0000","last_undegraded":"2023-11-18T20:37:57.120901+0000","last_fullsized":"2023-11-18T20:37:57.120901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.136645+0000","last_change":"2023-11-18T20:37:57.136645+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.136645+0000","last_undegraded":"2023-11-18T20:37:57.136645+0000","last_fullsized":"2023-11-18T20:37:57.136645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133508+0000","last_change":"2023-11-18T20:37:57.133508+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133508+0000","last_undegraded":"2023-11-18T20:37:57.133508+0000","last_fullsized":"2023-11-18T20:37:57.133508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368068+0000","last_change":"2023-11-18T20:37:57.368068+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368068+0000","last_undegraded":"2023-11-18T20:37:57.368068+0000","last_fullsized":"2023-11-18T20:37:57.368068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-18T20:37:57.657708+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:37:57.657708+0000","last_peered":"2023-11-18T20:37:57.657708+0000","last_clean":"2023-11-18T20:37:57.657708+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:37:57.657708+0000","last_undegraded":"2023-11-18T20:37:57.657708+0000","last_fullsized":"2023-11-18T20:37:57.657708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126127+0000","last_change":"2023-11-18T20:37:57.126127+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126127+0000","last_undegraded":"2023-11-18T20:37:57.126127+0000","last_fullsized":"2023-11-18T20:37:57.126127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126963+0000","last_change":"2023-11-18T20:37:57.126963+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126963+0000","last_undegraded":"2023-11-18T20:37:57.126963+0000","last_fullsized":"2023-11-18T20:37:57.126963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369193+0000","last_change":"2023-11-18T20:37:57.369193+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369193+0000","last_undegraded":"2023-11-18T20:37:57.369193+0000","last_fullsized":"2023-11-18T20:37:57.369193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126313+0000","last_change":"2023-11-18T20:37:57.126313+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126313+0000","last_undegraded":"2023-11-18T20:37:57.126313+0000","last_fullsized":"2023-11-18T20:37:57.126313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.131766+0000","last_change":"2023-11-18T20:37:57.131766+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.131766+0000","last_undegraded":"2023-11-18T20:37:57.131766+0000","last_fullsized":"2023-11-18T20:37:57.131766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126095+0000","last_change":"2023-11-18T20:37:57.126095+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126095+0000","last_undegraded":"2023-11-18T20:37:57.126095+0000","last_fullsized":"2023-11-18T20:37:57.126095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.132409+0000","last_change":"2023-11-18T20:37:57.132409+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.132409+0000","last_undegraded":"2023-11-18T20:37:57.132409+0000","last_fullsized":"2023-11-18T20:37:57.132409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126257+0000","last_change":"2023-11-18T20:37:57.126257+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126257+0000","last_undegraded":"2023-11-18T20:37:57.126257+0000","last_fullsized":"2023-11-18T20:37:57.126257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121685+0000","last_change":"2023-11-18T20:37:57.121685+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121685+0000","last_undegraded":"2023-11-18T20:37:57.121685+0000","last_fullsized":"2023-11-18T20:37:57.121685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.129743+0000","last_change":"2023-11-18T20:37:57.129743+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.129743+0000","last_undegraded":"2023-11-18T20:37:57.129743+0000","last_fullsized":"2023-11-18T20:37:57.129743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368424+0000","last_change":"2023-11-18T20:37:57.368424+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368424+0000","last_undegraded":"2023-11-18T20:37:57.368424+0000","last_fullsized":"2023-11-18T20:37:57.368424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126982+0000","last_change":"2023-11-18T20:37:57.126982+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126982+0000","last_undegraded":"2023-11-18T20:37:57.126982+0000","last_fullsized":"2023-11-18T20:37:57.126982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121361+0000","last_change":"2023-11-18T20:37:57.121361+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121361+0000","last_undegraded":"2023-11-18T20:37:57.121361+0000","last_fullsized":"2023-11-18T20:37:57.121361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.122223+0000","last_change":"2023-11-18T20:37:57.122223+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.122223+0000","last_undegraded":"2023-11-18T20:37:57.122223+0000","last_fullsized":"2023-11-18T20:37:57.122223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128918+0000","last_change":"2023-11-18T20:37:57.128918+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128918+0000","last_undegraded":"2023-11-18T20:37:57.128918+0000","last_fullsized":"2023-11-18T20:37:57.128918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133312+0000","last_change":"2023-11-18T20:37:57.133312+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133312+0000","last_undegraded":"2023-11-18T20:37:57.133312+0000","last_fullsized":"2023-11-18T20:37:57.133312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.601}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2290000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":770048,"data_stored":645149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.978}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1389999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0739999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.99}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":770048,"data_stored":645149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9870000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.927}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0790000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3450000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.399}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3090000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:38:04.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:38:04.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.308+0000 7f6fb1e90640 1 Processor -- start 2023-11-18T20:38:04.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.309+0000 7f6fb1e90640 1 -- start start 2023-11-18T20:38:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.310+0000 7f6fb1e90640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6fac155490 0x7f6fac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.310+0000 7f6fb1e90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0c1500 0x7f6fac0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.310+0000 7f6fb1e90640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac0c06c0 con 0x7f6fac0c4080 2023-11-18T20:38:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.310+0000 7f6fb1e90640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac0a5820 con 0x7f6fac155490 2023-11-18T20:38:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.310+0000 7f6fb1e90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0c1020 con 0x7f6fac0c1500 2023-11-18T20:38:04.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.310+0000 7f6fabfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6fac0c4080 0x7f6fac0c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50122/0 (socket says 172.21.15.132:50122) 2023-11-18T20:38:04.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.310+0000 7f6fabfff640 1 -- 172.21.15.132:0/1565115441 learned_addr learned my addr 172.21.15.132:0/1565115441 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:04.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6fa3fff640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0c1500 0x7f6fac0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6fab7fe640 1 --2- 172.21.15.132:0/1565115441 >> v2:172.21.15.161:3300/0 conn(0x7f6fac155490 0x7f6fac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226659750 0 0) 0x7f6fac0c06c0 con 0x7f6fac0c4080 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f98005730 con 0x7f6fac0c4080 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2012502814 0 0) 0x7f6f98005730 con 0x7f6fac0c4080 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0c1500 msgr2=0x7f6fac0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0c1500 0x7f6fac0a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 >> v2:172.21.15.161:3300/0 conn(0x7f6fac155490 msgr2=0x7f6fac0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 --2- 172.21.15.132:0/1565115441 >> v2:172.21.15.161:3300/0 conn(0x7f6fac155490 0x7f6fac0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac0c0910 con 0x7f6fac0c4080 2023-11-18T20:38:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f6fa40019f0 con 0x7f6fac0c4080 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 >> v1:172.21.15.132:6789/0 conn(0x7f6fac0c4080 legacy=0x7f6fac0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f98005b80 0x7f6f98005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6f98006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0c1500 0x7f6f98007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0c1020 con 0x7f6f980069d0 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9800db90 con 0x7f6f98005b80 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.311+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9800dcd0 con 0x7f6fac0c1500 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fa3fff640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6f98006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fa3fff640 1 -- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0c1500 msgr2=0x7f6f98007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fabfff640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0c1500 0x7f6f98007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fab7fe640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f98005b80 0x7f6f98005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fa3fff640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0c1500 0x7f6f98007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fa3fff640 1 -- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f98005b80 msgr2=0x7f6f98005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fa3fff640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f98005b80 0x7f6f98005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fa3fff640 1 -- 172.21.15.132:0/1565115441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98005730 con 0x7f6f980069d0 2023-11-18T20:38:04.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.312+0000 7f6fab7fe640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f98005b80 0x7f6f98005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.313+0000 7f6fa3fff640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6f98006e50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009af0 tx=0x7f6f98007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfe2f801dc99199 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.313+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9402c6b0 con 0x7f6f980069d0 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.313+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9402c810 con 0x7f6f980069d0 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.313+0000 7f6faaffd640 1 -- 172.21.15.132:0/1565115441 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9402cba0 con 0x7f6f980069d0 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.314+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1565115441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 msgr2=0x7f6f98006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.314+0000 7f6fb1e90640 1 --2- 172.21.15.132:0/1565115441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6f98006e50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009af0 tx=0x7f6f98007a00 comp rx=0 tx=0).stop 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.314+0000 7f6fabfff640 1 -- 172.21.15.132:0/1565115441 reap_dead start 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.314+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1565115441 shutdown_connections 2023-11-18T20:38:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.314+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1565115441 >> 172.21.15.132:0/1565115441 conn(0x7f6fac06a500 msgr2=0x7f6fac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.314+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1565115441 shutdown_connections 2023-11-18T20:38:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.314+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1565115441 wait complete. 2023-11-18T20:38:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.317+0000 7f6fb1e90640 1 Processor -- start 2023-11-18T20:38:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.317+0000 7f6fb1e90640 1 -- start start 2023-11-18T20:38:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.318+0000 7f6fb1e90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6fac1de540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.318+0000 7f6fb1e90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fac151a20 0x7f6fac1dea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.318+0000 7f6fb1e90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0a6d60 0x7f6fac0a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.318+0000 7f6fb1e90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac1dbb30 con 0x7f6f980069d0 2023-11-18T20:38:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.318+0000 7f6fb1e90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac1ea940 con 0x7f6fac151a20 2023-11-18T20:38:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.318+0000 7f6fb1e90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac1dbdd0 con 0x7f6fac0a6d60 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6fac1de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6fac1de540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32796/0 (socket says 172.21.15.132:32796) 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 -- 172.21.15.132:0/1053881924 learned_addr learned my addr 172.21.15.132:0/1053881924 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fabfff640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0a6d60 0x7f6fac0a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fa3fff640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fac151a20 0x7f6fac1dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 -- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0a6d60 msgr2=0x7f6fac0a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0a6d60 0x7f6fac0a71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 -- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fac151a20 msgr2=0x7f6fac1dea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fac151a20 0x7f6fac1dea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 -- 172.21.15.132:0/1053881924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac1dc0b0 con 0x7f6f980069d0 2023-11-18T20:38:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.319+0000 7f6fab7fe640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6fac1de540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0109d0 tx=0x7f6f9c010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.320+0000 7f6fa8ff9640 1 -- 172.21.15.132:0/1053881924 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00ec20 con 0x7f6f980069d0 2023-11-18T20:38:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.320+0000 7f6fa8ff9640 1 -- 172.21.15.132:0/1053881924 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00ed80 con 0x7f6f980069d0 2023-11-18T20:38:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.320+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fac1dd6b0 con 0x7f6f980069d0 2023-11-18T20:38:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.320+0000 7f6fa8ff9640 1 -- 172.21.15.132:0/1053881924 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c01c620 con 0x7f6f980069d0 2023-11-18T20:38:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.320+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac0a7720 con 0x7f6f980069d0 2023-11-18T20:38:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.321+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac1dc240 con 0x7f6f980069d0 2023-11-18T20:38:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.322+0000 7f6fa8ff9640 1 -- 172.21.15.132:0/1053881924 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f9c01c780 con 0x7f6f980069d0 2023-11-18T20:38:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.323+0000 7f6fa8ff9640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f8c06ae40 0x7f6f8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.323+0000 7f6fa8ff9640 1 -- 172.21.15.132:0/1053881924 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f9c089cc0 con 0x7f6f980069d0 2023-11-18T20:38:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.323+0000 7f6fa3fff640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f8c06ae40 0x7f6f8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.324+0000 7f6fa3fff640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f8c06ae40 0x7f6f8c06d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f94036000 tx=0x7f6f94030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:04.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.327+0000 7f6fa8ff9640 1 -- 172.21.15.132:0/1053881924 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f9c090080 con 0x7f6f980069d0 2023-11-18T20:38:04.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.514+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fac155870 con 0x7f6f8c06ae40 2023-11-18T20:38:04.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.533+0000 7f6fa8ff9640 1 -- 172.21.15.132:0/1053881924 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252668 (secure 0 0 0) 0x7f6f940040c0 con 0x7f6f8c06ae40 2023-11-18T20:38:04.538 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:04.539 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:38:04.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f8c06ae40 msgr2=0x7f6f8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f8c06ae40 0x7f6f8c06d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f94036000 tx=0x7f6f94030000 comp rx=0 tx=0).stop 2023-11-18T20:38:04.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 msgr2=0x7f6fac1de540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6fac1de540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0109d0 tx=0x7f6f9c010e90 comp rx=0 tx=0).stop 2023-11-18T20:38:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 shutdown_connections 2023-11-18T20:38:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f8c06ae40 0x7f6f8c06d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fac0a6d60 0x7f6fac0a71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fac151a20 0x7f6fac1dea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 --2- 172.21.15.132:0/1053881924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980069d0 0x7f6fac1de540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 >> 172.21.15.132:0/1053881924 conn(0x7f6fac06a500 msgr2=0x7f6fac0bff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 shutdown_connections 2023-11-18T20:38:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.539+0000 7f6fb1e90640 1 -- 172.21.15.132:0/1053881924 wait complete. 2023-11-18T20:38:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-11-18T20:38:02.630940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":2536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":2596864,"data_stored":1618984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500135"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.129004+0000","last_change":"2023-11-18T20:37:57.129004+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.129004+0000","last_undegraded":"2023-11-18T20:37:57.129004+0000","last_fullsized":"2023-11-18T20:37:57.129004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128753+0000","last_change":"2023-11-18T20:37:57.128753+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128753+0000","last_undegraded":"2023-11-18T20:37:57.128753+0000","last_fullsized":"2023-11-18T20:37:57.128753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368166+0000","last_change":"2023-11-18T20:37:57.368166+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368166+0000","last_undegraded":"2023-11-18T20:37:57.368166+0000","last_fullsized":"2023-11-18T20:37:57.368166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.127577+0000","last_change":"2023-11-18T20:37:57.127577+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.127577+0000","last_undegraded":"2023-11-18T20:37:57.127577+0000","last_fullsized":"2023-11-18T20:37:57.127577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.123507+0000","last_change":"2023-11-18T20:37:57.123507+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.123507+0000","last_undegraded":"2023-11-18T20:37:57.123507+0000","last_fullsized":"2023-11-18T20:37:57.123507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.120901+0000","last_change":"2023-11-18T20:37:57.120901+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.120901+0000","last_undegraded":"2023-11-18T20:37:57.120901+0000","last_fullsized":"2023-11-18T20:37:57.120901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369148+0000","last_change":"2023-11-18T20:37:57.369148+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369148+0000","last_undegraded":"2023-11-18T20:37:57.369148+0000","last_fullsized":"2023-11-18T20:37:57.369148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121461+0000","last_change":"2023-11-18T20:37:57.121461+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121461+0000","last_undegraded":"2023-11-18T20:37:57.121461+0000","last_fullsized":"2023-11-18T20:37:57.121461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369496+0000","last_change":"2023-11-18T20:37:57.369496+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369496+0000","last_undegraded":"2023-11-18T20:37:57.369496+0000","last_fullsized":"2023-11-18T20:37:57.369496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128226+0000","last_change":"2023-11-18T20:37:57.128226+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128226+0000","last_undegraded":"2023-11-18T20:37:57.128226+0000","last_fullsized":"2023-11-18T20:37:57.128226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121610+0000","last_change":"2023-11-18T20:37:57.121610+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121610+0000","last_undegraded":"2023-11-18T20:37:57.121610+0000","last_fullsized":"2023-11-18T20:37:57.121610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133056+0000","last_change":"2023-11-18T20:37:57.133056+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133056+0000","last_undegraded":"2023-11-18T20:37:57.133056+0000","last_fullsized":"2023-11-18T20:37:57.133056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.120901+0000","last_change":"2023-11-18T20:37:57.120901+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.120901+0000","last_undegraded":"2023-11-18T20:37:57.120901+0000","last_fullsized":"2023-11-18T20:37:57.120901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.136645+0000","last_change":"2023-11-18T20:37:57.136645+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.136645+0000","last_undegraded":"2023-11-18T20:37:57.136645+0000","last_fullsized":"2023-11-18T20:37:57.136645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133508+0000","last_change":"2023-11-18T20:37:57.133508+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133508+0000","last_undegraded":"2023-11-18T20:37:57.133508+0000","last_fullsized":"2023-11-18T20:37:57.133508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368068+0000","last_change":"2023-11-18T20:37:57.368068+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368068+0000","last_undegraded":"2023-11-18T20:37:57.368068+0000","last_fullsized":"2023-11-18T20:37:57.368068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-18T20:37:57.657708+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:37:57.657708+0000","last_peered":"2023-11-18T20:37:57.657708+0000","last_clean":"2023-11-18T20:37:57.657708+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:37:57.657708+0000","last_undegraded":"2023-11-18T20:37:57.657708+0000","last_fullsized":"2023-11-18T20:37:57.657708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126127+0000","last_change":"2023-11-18T20:37:57.126127+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126127+0000","last_undegraded":"2023-11-18T20:37:57.126127+0000","last_fullsized":"2023-11-18T20:37:57.126127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126963+0000","last_change":"2023-11-18T20:37:57.126963+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126963+0000","last_undegraded":"2023-11-18T20:37:57.126963+0000","last_fullsized":"2023-11-18T20:37:57.126963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.369193+0000","last_change":"2023-11-18T20:37:57.369193+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.369193+0000","last_undegraded":"2023-11-18T20:37:57.369193+0000","last_fullsized":"2023-11-18T20:37:57.369193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126313+0000","last_change":"2023-11-18T20:37:57.126313+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126313+0000","last_undegraded":"2023-11-18T20:37:57.126313+0000","last_fullsized":"2023-11-18T20:37:57.126313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.131766+0000","last_change":"2023-11-18T20:37:57.131766+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.131766+0000","last_undegraded":"2023-11-18T20:37:57.131766+0000","last_fullsized":"2023-11-18T20:37:57.131766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126095+0000","last_change":"2023-11-18T20:37:57.126095+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126095+0000","last_undegraded":"2023-11-18T20:37:57.126095+0000","last_fullsized":"2023-11-18T20:37:57.126095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.132409+0000","last_change":"2023-11-18T20:37:57.132409+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.132409+0000","last_undegraded":"2023-11-18T20:37:57.132409+0000","last_fullsized":"2023-11-18T20:37:57.132409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126257+0000","last_change":"2023-11-18T20:37:57.126257+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126257+0000","last_undegraded":"2023-11-18T20:37:57.126257+0000","last_fullsized":"2023-11-18T20:37:57.126257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121685+0000","last_change":"2023-11-18T20:37:57.121685+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121685+0000","last_undegraded":"2023-11-18T20:37:57.121685+0000","last_fullsized":"2023-11-18T20:37:57.121685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.129743+0000","last_change":"2023-11-18T20:37:57.129743+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.129743+0000","last_undegraded":"2023-11-18T20:37:57.129743+0000","last_fullsized":"2023-11-18T20:37:57.129743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.368424+0000","last_change":"2023-11-18T20:37:57.368424+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.368424+0000","last_undegraded":"2023-11-18T20:37:57.368424+0000","last_fullsized":"2023-11-18T20:37:57.368424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.126982+0000","last_change":"2023-11-18T20:37:57.126982+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.126982+0000","last_undegraded":"2023-11-18T20:37:57.126982+0000","last_fullsized":"2023-11-18T20:37:57.126982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.121361+0000","last_change":"2023-11-18T20:37:57.121361+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.121361+0000","last_undegraded":"2023-11-18T20:37:57.121361+0000","last_fullsized":"2023-11-18T20:37:57.121361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.122223+0000","last_change":"2023-11-18T20:37:57.122223+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.122223+0000","last_undegraded":"2023-11-18T20:37:57.122223+0000","last_fullsized":"2023-11-18T20:37:57.122223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.128918+0000","last_change":"2023-11-18T20:37:57.128918+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.128918+0000","last_undegraded":"2023-11-18T20:37:57.128918+0000","last_fullsized":"2023-11-18T20:37:57.128918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T20:37:58.122132+0000","last_change":"2023-11-18T20:37:58.122132+0000","last_active":"2023-11-18T20:37:58.122132+0000","last_peered":"2023-11-18T20:37:58.122132+0000","last_clean":"2023-11-18T20:37:58.122132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:58.122132+0000","last_undegraded":"2023-11-18T20:37:58.122132+0000","last_fullsized":"2023-11-18T20:37:58.122132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-11-18T20:37:57.133312+0000","last_change":"2023-11-18T20:37:57.133312+0000","last_active":"2023-11-18T20:37:57.106725+0000","last_peered":"2023-11-18T20:37:57.106725+0000","last_clean":"2023-11-18T20:37:57.106725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:37:57.133312+0000","last_undegraded":"2023-11-18T20:37:57.133312+0000","last_fullsized":"2023-11-18T20:37:57.133312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.601}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2290000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":770048,"data_stored":645149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.978}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1389999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0739999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.99}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":770048,"data_stored":645149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9870000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.927}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0790000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3450000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.399}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":54781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3090000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:38:04.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-11-18T20:38:04.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-11-18T20:38:04.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-11-18T20:38:04.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-11-18T20:38:04.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-11-18T20:38:04.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-11-18T20:38:04.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-11-18T20:38:04.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.129004+0000', 'last_change': '2023-11-18T20:37:57.129004+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.129004+0000', 'last_undegraded': '2023-11-18T20:37:57.129004+0000', 'last_fullsized': '2023-11-18T20:37:57.129004+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.128753+0000', 'last_change': '2023-11-18T20:37:57.128753+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.128753+0000', 'last_undegraded': '2023-11-18T20:37:57.128753+0000', 'last_fullsized': '2023-11-18T20:37:57.128753+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.368166+0000', 'last_change': '2023-11-18T20:37:57.368166+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.368166+0000', 'last_undegraded': '2023-11-18T20:37:57.368166+0000', 'last_fullsized': '2023-11-18T20:37:57.368166+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:38:04.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.127577+0000', 'last_change': '2023-11-18T20:37:57.127577+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.127577+0000', 'last_undegraded': '2023-11-18T20:37:57.127577+0000', 'last_fullsized': '2023-11-18T20:37:57.127577+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.123507+0000', 'last_change': '2023-11-18T20:37:57.123507+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.123507+0000', 'last_undegraded': '2023-11-18T20:37:57.123507+0000', 'last_fullsized': '2023-11-18T20:37:57.123507+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.120901+0000', 'last_change': '2023-11-18T20:37:57.120901+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.120901+0000', 'last_undegraded': '2023-11-18T20:37:57.120901+0000', 'last_fullsized': '2023-11-18T20:37:57.120901+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.369148+0000', 'last_change': '2023-11-18T20:37:57.369148+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.369148+0000', 'last_undegraded': '2023-11-18T20:37:57.369148+0000', 'last_fullsized': '2023-11-18T20:37:57.369148+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.121461+0000', 'last_change': '2023-11-18T20:37:57.121461+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.121461+0000', 'last_undegraded': '2023-11-18T20:37:57.121461+0000', 'last_fullsized': '2023-11-18T20:37:57.121461+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:38:04.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.369496+0000', 'last_change': '2023-11-18T20:37:57.369496+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.369496+0000', 'last_undegraded': '2023-11-18T20:37:57.369496+0000', 'last_fullsized': '2023-11-18T20:37:57.369496+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.128226+0000', 'last_change': '2023-11-18T20:37:57.128226+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.128226+0000', 'last_undegraded': '2023-11-18T20:37:57.128226+0000', 'last_fullsized': '2023-11-18T20:37:57.128226+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.121610+0000', 'last_change': '2023-11-18T20:37:57.121610+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.121610+0000', 'last_undegraded': '2023-11-18T20:37:57.121610+0000', 'last_fullsized': '2023-11-18T20:37:57.121610+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.133056+0000', 'last_change': '2023-11-18T20:37:57.133056+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.133056+0000', 'last_undegraded': '2023-11-18T20:37:57.133056+0000', 'last_fullsized': '2023-11-18T20:37:57.133056+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.120901+0000', 'last_change': '2023-11-18T20:37:57.120901+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.120901+0000', 'last_undegraded': '2023-11-18T20:37:57.120901+0000', 'last_fullsized': '2023-11-18T20:37:57.120901+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:38:04.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.136645+0000', 'last_change': '2023-11-18T20:37:57.136645+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.136645+0000', 'last_undegraded': '2023-11-18T20:37:57.136645+0000', 'last_fullsized': '2023-11-18T20:37:57.136645+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.133508+0000', 'last_change': '2023-11-18T20:37:57.133508+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.133508+0000', 'last_undegraded': '2023-11-18T20:37:57.133508+0000', 'last_fullsized': '2023-11-18T20:37:57.133508+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-11-18T20:38:04.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.368068+0000', 'last_change': '2023-11-18T20:37:57.368068+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.368068+0000', 'last_undegraded': '2023-11-18T20:37:57.368068+0000', 'last_fullsized': '2023-11-18T20:37:57.368068+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.126127+0000', 'last_change': '2023-11-18T20:37:57.126127+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.126127+0000', 'last_undegraded': '2023-11-18T20:37:57.126127+0000', 'last_fullsized': '2023-11-18T20:37:57.126127+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.126963+0000', 'last_change': '2023-11-18T20:37:57.126963+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.126963+0000', 'last_undegraded': '2023-11-18T20:37:57.126963+0000', 'last_fullsized': '2023-11-18T20:37:57.126963+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.369193+0000', 'last_change': '2023-11-18T20:37:57.369193+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.369193+0000', 'last_undegraded': '2023-11-18T20:37:57.369193+0000', 'last_fullsized': '2023-11-18T20:37:57.369193+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.126313+0000', 'last_change': '2023-11-18T20:37:57.126313+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.126313+0000', 'last_undegraded': '2023-11-18T20:37:57.126313+0000', 'last_fullsized': '2023-11-18T20:37:57.126313+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.131766+0000', 'last_change': '2023-11-18T20:37:57.131766+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.131766+0000', 'last_undegraded': '2023-11-18T20:37:57.131766+0000', 'last_fullsized': '2023-11-18T20:37:57.131766+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.126095+0000', 'last_change': '2023-11-18T20:37:57.126095+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.126095+0000', 'last_undegraded': '2023-11-18T20:37:57.126095+0000', 'last_fullsized': '2023-11-18T20:37:57.126095+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.132409+0000', 'last_change': '2023-11-18T20:37:57.132409+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.132409+0000', 'last_undegraded': '2023-11-18T20:37:57.132409+0000', 'last_fullsized': '2023-11-18T20:37:57.132409+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.126257+0000', 'last_change': '2023-11-18T20:37:57.126257+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.126257+0000', 'last_undegraded': '2023-11-18T20:37:57.126257+0000', 'last_fullsized': '2023-11-18T20:37:57.126257+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-11-18T20:38:04.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.121685+0000', 'last_change': '2023-11-18T20:37:57.121685+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.121685+0000', 'last_undegraded': '2023-11-18T20:37:57.121685+0000', 'last_fullsized': '2023-11-18T20:37:57.121685+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.129743+0000', 'last_change': '2023-11-18T20:37:57.129743+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.129743+0000', 'last_undegraded': '2023-11-18T20:37:57.129743+0000', 'last_fullsized': '2023-11-18T20:37:57.129743+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.368424+0000', 'last_change': '2023-11-18T20:37:57.368424+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.368424+0000', 'last_undegraded': '2023-11-18T20:37:57.368424+0000', 'last_fullsized': '2023-11-18T20:37:57.368424+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-11-18T20:38:04.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.126982+0000', 'last_change': '2023-11-18T20:37:57.126982+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.126982+0000', 'last_undegraded': '2023-11-18T20:37:57.126982+0000', 'last_fullsized': '2023-11-18T20:37:57.126982+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.121361+0000', 'last_change': '2023-11-18T20:37:57.121361+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.121361+0000', 'last_undegraded': '2023-11-18T20:37:57.121361+0000', 'last_fullsized': '2023-11-18T20:37:57.121361+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-11-18T20:38:04.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.122223+0000', 'last_change': '2023-11-18T20:37:57.122223+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.122223+0000', 'last_undegraded': '2023-11-18T20:37:57.122223+0000', 'last_fullsized': '2023-11-18T20:37:57.122223+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.128918+0000', 'last_change': '2023-11-18T20:37:57.128918+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.128918+0000', 'last_undegraded': '2023-11-18T20:37:57.128918+0000', 'last_fullsized': '2023-11-18T20:37:57.128918+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T20:37:58.122132+0000', 'last_change': '2023-11-18T20:37:58.122132+0000', 'last_active': '2023-11-18T20:37:58.122132+0000', 'last_peered': '2023-11-18T20:37:58.122132+0000', 'last_clean': '2023-11-18T20:37:58.122132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:58.122132+0000', 'last_undegraded': '2023-11-18T20:37:58.122132+0000', 'last_fullsized': '2023-11-18T20:37:58.122132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:58.122132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-11-18T20:38:04.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:37:57.133312+0000', 'last_change': '2023-11-18T20:37:57.133312+0000', 'last_active': '2023-11-18T20:37:57.106725+0000', 'last_peered': '2023-11-18T20:37:57.106725+0000', 'last_clean': '2023-11-18T20:37:57.106725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:37:57.133312+0000', 'last_undegraded': '2023-11-18T20:37:57.133312+0000', 'last_fullsized': '2023-11-18T20:37:57.133312+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'last_clean_scrub_stamp': '2023-11-18T20:37:57.106725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:38:04.581 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-18T20:38:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.804+0000 7f5093fff640 1 Processor -- start 2023-11-18T20:38:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.805+0000 7f5093fff640 1 -- start start 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f5093fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50940ca450 0x7f50940ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f5093fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5094154580 0x7f5094154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f5093fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5094158a60 con 0x7f509414e7c0 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f5093fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50940c5b10 con 0x7f5094154580 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f5093fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50940c4dd0 con 0x7f50940ca450 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f50937fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5094154580 0x7f5094154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f50937fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5094154580 0x7f5094154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32800/0 (socket says 172.21.15.132:32800) 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f50937fe640 1 -- 172.21.15.132:0/149483707 learned_addr learned my addr 172.21.15.132:0/149483707 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.806+0000 7f50927fc640 1 --2- 172.21.15.132:0/149483707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50940ca450 0x7f50940ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.807+0000 7f50937fe640 1 -- 172.21.15.132:0/149483707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50940ca450 msgr2=0x7f50940ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.807+0000 7f50937fe640 1 --2- 172.21.15.132:0/149483707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50940ca450 0x7f50940ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.807+0000 7f50937fe640 1 -- 172.21.15.132:0/149483707 >> v1:172.21.15.161:6789/0 conn(0x7f509414e7c0 legacy=0x7f50940c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:04.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.807+0000 7f50937fe640 1 -- 172.21.15.132:0/149483707 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094157ca0 con 0x7f5094154580 2023-11-18T20:38:04.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.807+0000 7f50927fc640 1 --2- 172.21.15.132:0/149483707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50940ca450 0x7f50940ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:04.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f50937fe640 1 --2- 172.21.15.132:0/149483707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5094154580 0x7f5094154a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f507c009870 tx=0x7f507c02b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5e3882c028d399 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:04.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5091ffb640 1 -- 172.21.15.132:0/149483707 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c033620 con 0x7f5094154580 2023-11-18T20:38:04.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5091ffb640 1 -- 172.21.15.132:0/149483707 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c033780 con 0x7f5094154580 2023-11-18T20:38:04.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5091ffb640 1 -- 172.21.15.132:0/149483707 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c033b10 con 0x7f5094154580 2023-11-18T20:38:04.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5093fff640 1 -- 172.21.15.132:0/149483707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5094154580 msgr2=0x7f5094154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5093fff640 1 --2- 172.21.15.132:0/149483707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5094154580 0x7f5094154a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f507c009870 tx=0x7f507c02b7d0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5093fff640 1 -- 172.21.15.132:0/149483707 shutdown_connections 2023-11-18T20:38:04.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5093fff640 1 --2- 172.21.15.132:0/149483707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5094154580 0x7f5094154a10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5093fff640 1 --2- 172.21.15.132:0/149483707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50940ca450 0x7f50940ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.808+0000 7f5093fff640 1 -- 172.21.15.132:0/149483707 >> 172.21.15.132:0/149483707 conn(0x7f50940abf00 msgr2=0x7f50940c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:04.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.809+0000 7f5093fff640 1 -- 172.21.15.132:0/149483707 shutdown_connections 2023-11-18T20:38:04.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.809+0000 7f5093fff640 1 -- 172.21.15.132:0/149483707 wait complete. 2023-11-18T20:38:04.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.810+0000 7f5093fff640 1 Processor -- start 2023-11-18T20:38:04.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.810+0000 7f5093fff640 1 -- start start 2023-11-18T20:38:04.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5093fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50940ca450 0x7f50941421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5093fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509414e7c0 0x7f50940aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5093fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094154580 0x7f5094151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5093fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5094142970 con 0x7f50940ca450 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5093fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50941ea100 con 0x7f5094154580 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5093fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50941ea3c0 con 0x7f509414e7c0 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5092ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50940ca450 0x7f50941421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5092ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50940ca450 0x7f50941421f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32814/0 (socket says 172.21.15.132:32814) 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.811+0000 7f5092ffd640 1 -- 172.21.15.132:0/2318063225 learned_addr learned my addr 172.21.15.132:0/2318063225 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f50927fc640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509414e7c0 0x7f50940aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f5092ffd640 1 -- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509414e7c0 msgr2=0x7f50940aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f5092ffd640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509414e7c0 0x7f50940aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f5092ffd640 1 -- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094154580 msgr2=0x7f5094151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f5092ffd640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094154580 0x7f5094151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f5092ffd640 1 -- 172.21.15.132:0/2318063225 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0094d0 con 0x7f50940ca450 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f5092ffd640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50940ca450 0x7f50941421f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f508c00ba50 tx=0x7f508c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f508b7fe640 1 -- 172.21.15.132:0/2318063225 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00cbe0 con 0x7f50940ca450 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f508b7fe640 1 -- 172.21.15.132:0/2318063225 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c00cd80 con 0x7f50940ca450 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50941ea6a0 con 0x7f50940ca450 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f508b7fe640 1 -- 172.21.15.132:0/2318063225 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c014680 con 0x7f50940ca450 2023-11-18T20:38:04.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.812+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50941eac60 con 0x7f50940ca450 2023-11-18T20:38:04.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.814+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509414bc20 con 0x7f50940ca450 2023-11-18T20:38:04.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.814+0000 7f508b7fe640 1 -- 172.21.15.132:0/2318063225 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f508c0147e0 con 0x7f50940ca450 2023-11-18T20:38:04.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.815+0000 7f508b7fe640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f507406ae40 0x7f507406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:04.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.815+0000 7f508b7fe640 1 -- 172.21.15.132:0/2318063225 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f508c089480 con 0x7f50940ca450 2023-11-18T20:38:04.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.816+0000 7f50927fc640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f507406ae40 0x7f507406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:04.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.817+0000 7f50927fc640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f507406ae40 0x7f507406d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50940c15c0 tx=0x7f5084008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:04.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:04.819+0000 7f508b7fe640 1 -- 172.21.15.132:0/2318063225 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f508c0545d0 con 0x7f50940ca450 2023-11-18T20:38:05.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.060+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f509404e840 con 0x7f50940ca450 2023-11-18T20:38:05.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.061+0000 7f508b7fe640 1 -- 172.21.15.132:0/2318063225 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1106 (secure 0 0 0) 0x7f508c057bf0 con 0x7f50940ca450 2023-11-18T20:38:05.062 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:05.063 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1700339871,"num_in_osds":8,"osd_in_since":1700339863,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224731136,"bytes_avail":772869382144,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4273}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-18T20:37:39.491975+0000","services":{}},"progress_events":{}} 2023-11-18T20:38:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f507406ae40 msgr2=0x7f507406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:05.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f507406ae40 0x7f507406d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50940c15c0 tx=0x7f5084008040 comp rx=0 tx=0).stop 2023-11-18T20:38:05.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50940ca450 msgr2=0x7f50941421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:05.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50940ca450 0x7f50941421f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f508c00ba50 tx=0x7f508c00bf10 comp rx=0 tx=0).stop 2023-11-18T20:38:05.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 shutdown_connections 2023-11-18T20:38:05.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f507406ae40 0x7f507406d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094154580 0x7f5094151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509414e7c0 0x7f50940aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 --2- 172.21.15.132:0/2318063225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50940ca450 0x7f50941421f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 >> 172.21.15.132:0/2318063225 conn(0x7f50940abf00 msgr2=0x7f50940c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:05.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.063+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 shutdown_connections 2023-11-18T20:38:05.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.064+0000 7f5093fff640 1 -- 172.21.15.132:0/2318063225 wait complete. 2023-11-18T20:38:05.082 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-18T20:38:05.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:38:05.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.286+0000 7fc337fff640 1 Processor -- start 2023-11-18T20:38:05.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.286+0000 7fc337fff640 1 -- start start 2023-11-18T20:38:05.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.287+0000 7fc337fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3380a4d20 0x7fc3380a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:05.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc337fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc338157ad0 con 0x7fc338154430 2023-11-18T20:38:05.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc337fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc338157db0 con 0x7fc3380c1450 2023-11-18T20:38:05.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc337fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc338154fd0 con 0x7fc3380a4d20 2023-11-18T20:38:05.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc336ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3380a4d20 0x7fc3380a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:05.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc3367fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc338154430 0x7fc3381548c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50130/0 (socket says 172.21.15.132:50130) 2023-11-18T20:38:05.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc3367fc640 1 -- 172.21.15.132:0/2847322483 learned_addr learned my addr 172.21.15.132:0/2847322483 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:05.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc336ffd640 1 -- 172.21.15.132:0/2847322483 >> v1:172.21.15.161:6789/0 conn(0x7fc3380c1450 legacy=0x7fc33815ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:05.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc336ffd640 1 -- 172.21.15.132:0/2847322483 >> v1:172.21.15.132:6789/0 conn(0x7fc338154430 legacy=0x7fc3381548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:05.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc335ffb640 1 -- 172.21.15.132:0/2847322483 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048100568 0 0) 0x7fc338157ad0 con 0x7fc338154430 2023-11-18T20:38:05.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.288+0000 7fc336ffd640 1 -- 172.21.15.132:0/2847322483 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338158090 con 0x7fc3380a4d20 2023-11-18T20:38:05.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.289+0000 7fc336ffd640 1 --2- 172.21.15.132:0/2847322483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380a4d20 0x7fc3380a5100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3280097a0 tx=0x7fc32802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fa1b1e5e2fd1fc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:05.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc335ffb640 1 -- 172.21.15.132:0/2847322483 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32802e070 con 0x7fc3380a4d20 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc335ffb640 1 -- 172.21.15.132:0/2847322483 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3280315a0 con 0x7fc3380a4d20 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc335ffb640 1 -- 172.21.15.132:0/2847322483 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328031930 con 0x7fc3380a4d20 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc337fff640 1 -- 172.21.15.132:0/2847322483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380a4d20 msgr2=0x7fc3380a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc337fff640 1 --2- 172.21.15.132:0/2847322483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380a4d20 0x7fc3380a5100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3280097a0 tx=0x7fc32802b840 comp rx=0 tx=0).stop 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc337fff640 1 -- 172.21.15.132:0/2847322483 shutdown_connections 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc337fff640 1 --2- 172.21.15.132:0/2847322483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380a4d20 0x7fc3380a5100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc337fff640 1 -- 172.21.15.132:0/2847322483 >> 172.21.15.132:0/2847322483 conn(0x7fc3380a77f0 msgr2=0x7fc3380a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc337fff640 1 -- 172.21.15.132:0/2847322483 shutdown_connections 2023-11-18T20:38:05.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.290+0000 7fc337fff640 1 -- 172.21.15.132:0/2847322483 wait complete. 2023-11-18T20:38:05.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.292+0000 7fc337fff640 1 Processor -- start 2023-11-18T20:38:05.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.292+0000 7fc337fff640 1 -- start start 2023-11-18T20:38:05.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.293+0000 7fc337fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3380a4d20 0x7fc338150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:05.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.293+0000 7fc337fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380c1450 0x7fc33814bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:05.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.293+0000 7fc337fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc338154430 0x7fc33814c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.293+0000 7fc337fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33814cef0 con 0x7fc3380c1450 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.293+0000 7fc337fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380ab200 con 0x7fc338154430 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.293+0000 7fc337fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380ab780 con 0x7fc3380a4d20 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.293+0000 7fc3367fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380c1450 0x7fc33814bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc3367fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380c1450 0x7fc33814bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32832/0 (socket says 172.21.15.132:32832) 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc3367fc640 1 -- 172.21.15.132:0/1774459697 learned_addr learned my addr 172.21.15.132:0/1774459697 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc336ffd640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3380a4d20 0x7fc338150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc3367fc640 1 -- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3380a4d20 msgr2=0x7fc338150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc3367fc640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3380a4d20 0x7fc338150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc3367fc640 1 -- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc338154430 msgr2=0x7fc33814c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:05.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc3367fc640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc338154430 0x7fc33814c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc3367fc640 1 -- 172.21.15.132:0/1774459697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009400 con 0x7fc3380c1450 2023-11-18T20:38:05.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc3367fc640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380c1450 0x7fc33814bac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00c430 tx=0x7fc32c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:05.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc31ffff640 1 -- 172.21.15.132:0/1774459697 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0074e0 con 0x7fc3380c1450 2023-11-18T20:38:05.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc31ffff640 1 -- 172.21.15.132:0/1774459697 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c007660 con 0x7fc3380c1450 2023-11-18T20:38:05.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc31ffff640 1 -- 172.21.15.132:0/1774459697 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c004a20 con 0x7fc3380c1450 2023-11-18T20:38:05.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.294+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33814c740 con 0x7fc3380c1450 2023-11-18T20:38:05.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.295+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc338150a50 con 0x7fc3380c1450 2023-11-18T20:38:05.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.296+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33804e840 con 0x7fc3380c1450 2023-11-18T20:38:05.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.297+0000 7fc31ffff640 1 -- 172.21.15.132:0/1774459697 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc32c004b80 con 0x7fc3380c1450 2023-11-18T20:38:05.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.297+0000 7fc31ffff640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc32406ae40 0x7fc32406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:05.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.298+0000 7fc31ffff640 1 -- 172.21.15.132:0/1774459697 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc32c089470 con 0x7fc3380c1450 2023-11-18T20:38:05.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.298+0000 7fc336ffd640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc32406ae40 0x7fc32406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:05.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.299+0000 7fc336ffd640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc32406ae40 0x7fc32406d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc328036000 tx=0x7fc32803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:05.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.302+0000 7fc31ffff640 1 -- 172.21.15.132:0/1774459697 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc32c054510 con 0x7fc3380c1450 2023-11-18T20:38:05.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.489+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3380c1df0 con 0x7fc32406ae40 2023-11-18T20:38:05.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.511+0000 7fc31ffff640 1 -- 172.21.15.132:0/1774459697 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264423 (secure 0 0 0) 0x7fc328031b30 con 0x7fc32406ae40 2023-11-18T20:38:05.517 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:05.519 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:38:05.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc32406ae40 msgr2=0x7fc32406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:05.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc32406ae40 0x7fc32406d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc328036000 tx=0x7fc32803d040 comp rx=0 tx=0).stop 2023-11-18T20:38:05.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380c1450 msgr2=0x7fc33814bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380c1450 0x7fc33814bac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00c430 tx=0x7fc32c00c8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 shutdown_connections 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc32406ae40 0x7fc32406d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc338154430 0x7fc33814c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3380c1450 0x7fc33814bac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 --2- 172.21.15.132:0/1774459697 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3380a4d20 0x7fc338150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 >> 172.21.15.132:0/1774459697 conn(0x7fc3380a77f0 msgr2=0x7fc3380c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.517+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 shutdown_connections 2023-11-18T20:38:05.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:05.518+0000 7fc337fff640 1 -- 172.21.15.132:0/1774459697 wait complete. 2023-11-18T20:38:05.538 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-18T20:38:04.631567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2957312,"data_stored":1778604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.500762"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866689+0000","last_change":"2023-11-18T20:37:59.173833+0000","last_active":"2023-11-18T20:38:00.866689+0000","last_peered":"2023-11-18T20:38:00.866689+0000","last_clean":"2023-11-18T20:38:00.866689+0000","last_became_active":"2023-11-18T20:37:59.170737+0000","last_became_peered":"2023-11-18T20:37:59.170737+0000","last_unstale":"2023-11-18T20:38:00.866689+0000","last_undegraded":"2023-11-18T20:38:00.866689+0000","last_fullsized":"2023-11-18T20:38:00.866689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:40.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871317+0000","last_change":"2023-11-18T20:37:59.178504+0000","last_active":"2023-11-18T20:38:01.871317+0000","last_peered":"2023-11-18T20:38:01.871317+0000","last_clean":"2023-11-18T20:38:01.871317+0000","last_became_active":"2023-11-18T20:37:59.178247+0000","last_became_peered":"2023-11-18T20:37:59.178247+0000","last_unstale":"2023-11-18T20:38:01.871317+0000","last_undegraded":"2023-11-18T20:38:01.871317+0000","last_fullsized":"2023-11-18T20:38:01.871317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:31.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870992+0000","last_change":"2023-11-18T20:37:59.181891+0000","last_active":"2023-11-18T20:38:01.870992+0000","last_peered":"2023-11-18T20:38:01.870992+0000","last_clean":"2023-11-18T20:38:01.870992+0000","last_became_active":"2023-11-18T20:37:59.180998+0000","last_became_peered":"2023-11-18T20:37:59.180998+0000","last_unstale":"2023-11-18T20:38:01.870992+0000","last_undegraded":"2023-11-18T20:38:01.870992+0000","last_fullsized":"2023-11-18T20:38:01.870992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:56:30.271654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374214+0000","last_change":"2023-11-18T20:37:59.159821+0000","last_active":"2023-11-18T20:38:01.374214+0000","last_peered":"2023-11-18T20:38:01.374214+0000","last_clean":"2023-11-18T20:38:01.374214+0000","last_became_active":"2023-11-18T20:37:59.159479+0000","last_became_peered":"2023-11-18T20:37:59.159479+0000","last_unstale":"2023-11-18T20:38:01.374214+0000","last_undegraded":"2023-11-18T20:38:01.374214+0000","last_fullsized":"2023-11-18T20:38:01.374214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866190+0000","last_change":"2023-11-18T20:37:59.181850+0000","last_active":"2023-11-18T20:38:00.866190+0000","last_peered":"2023-11-18T20:38:00.866190+0000","last_clean":"2023-11-18T20:38:00.866190+0000","last_became_active":"2023-11-18T20:37:59.181582+0000","last_became_peered":"2023-11-18T20:37:59.181582+0000","last_unstale":"2023-11-18T20:38:00.866190+0000","last_undegraded":"2023-11-18T20:38:00.866190+0000","last_fullsized":"2023-11-18T20:38:00.866190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:56:30.271654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.373610+0000","last_change":"2023-11-18T20:37:59.162681+0000","last_active":"2023-11-18T20:38:01.373610+0000","last_peered":"2023-11-18T20:38:01.373610+0000","last_clean":"2023-11-18T20:38:01.373610+0000","last_became_active":"2023-11-18T20:37:59.162312+0000","last_became_peered":"2023-11-18T20:37:59.162312+0000","last_unstale":"2023-11-18T20:38:01.373610+0000","last_undegraded":"2023-11-18T20:38:01.373610+0000","last_fullsized":"2023-11-18T20:38:01.373610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.865742+0000","last_change":"2023-11-18T20:37:59.164374+0000","last_active":"2023-11-18T20:38:00.865742+0000","last_peered":"2023-11-18T20:38:00.865742+0000","last_clean":"2023-11-18T20:38:00.865742+0000","last_became_active":"2023-11-18T20:37:59.163501+0000","last_became_peered":"2023-11-18T20:37:59.163501+0000","last_unstale":"2023-11-18T20:38:00.865742+0000","last_undegraded":"2023-11-18T20:38:00.865742+0000","last_fullsized":"2023-11-18T20:38:00.865742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:26.137811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870066+0000","last_change":"2023-11-18T20:37:59.176287+0000","last_active":"2023-11-18T20:38:01.870066+0000","last_peered":"2023-11-18T20:38:01.870066+0000","last_clean":"2023-11-18T20:38:01.870066+0000","last_became_active":"2023-11-18T20:37:59.175983+0000","last_became_peered":"2023-11-18T20:37:59.175983+0000","last_unstale":"2023-11-18T20:38:01.870066+0000","last_undegraded":"2023-11-18T20:38:01.870066+0000","last_fullsized":"2023-11-18T20:38:01.870066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:44.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870744+0000","last_change":"2023-11-18T20:37:59.167988+0000","last_active":"2023-11-18T20:38:01.870744+0000","last_peered":"2023-11-18T20:38:01.870744+0000","last_clean":"2023-11-18T20:38:01.870744+0000","last_became_active":"2023-11-18T20:37:59.167720+0000","last_became_peered":"2023-11-18T20:37:59.167720+0000","last_unstale":"2023-11-18T20:38:01.870744+0000","last_undegraded":"2023-11-18T20:38:01.870744+0000","last_fullsized":"2023-11-18T20:38:01.870744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:03.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866504+0000","last_change":"2023-11-18T20:37:59.179519+0000","last_active":"2023-11-18T20:38:00.866504+0000","last_peered":"2023-11-18T20:38:00.866504+0000","last_clean":"2023-11-18T20:38:00.866504+0000","last_became_active":"2023-11-18T20:37:59.178702+0000","last_became_peered":"2023-11-18T20:37:59.178702+0000","last_unstale":"2023-11-18T20:38:00.866504+0000","last_undegraded":"2023-11-18T20:38:00.866504+0000","last_fullsized":"2023-11-18T20:38:00.866504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:52.246806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866089+0000","last_change":"2023-11-18T20:37:59.177195+0000","last_active":"2023-11-18T20:38:00.866089+0000","last_peered":"2023-11-18T20:38:00.866089+0000","last_clean":"2023-11-18T20:38:00.866089+0000","last_became_active":"2023-11-18T20:37:59.176951+0000","last_became_peered":"2023-11-18T20:37:59.176951+0000","last_unstale":"2023-11-18T20:38:00.866089+0000","last_undegraded":"2023-11-18T20:38:00.866089+0000","last_fullsized":"2023-11-18T20:38:00.866089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:04:48.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866337+0000","last_change":"2023-11-18T20:37:59.172484+0000","last_active":"2023-11-18T20:38:00.866337+0000","last_peered":"2023-11-18T20:38:00.866337+0000","last_clean":"2023-11-18T20:38:00.866337+0000","last_became_active":"2023-11-18T20:37:59.172090+0000","last_became_peered":"2023-11-18T20:37:59.172090+0000","last_unstale":"2023-11-18T20:38:00.866337+0000","last_undegraded":"2023-11-18T20:38:00.866337+0000","last_fullsized":"2023-11-18T20:38:00.866337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:13.243273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178764+0000","last_change":"2023-11-18T20:37:59.178350+0000","last_active":"2023-11-18T20:38:00.178764+0000","last_peered":"2023-11-18T20:38:00.178764+0000","last_clean":"2023-11-18T20:38:00.178764+0000","last_became_active":"2023-11-18T20:37:59.176498+0000","last_became_peered":"2023-11-18T20:37:59.176498+0000","last_unstale":"2023-11-18T20:38:00.178764+0000","last_undegraded":"2023-11-18T20:38:00.178764+0000","last_fullsized":"2023-11-18T20:38:00.178764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:26:46.631259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178666+0000","last_change":"2023-11-18T20:37:59.162833+0000","last_active":"2023-11-18T20:38:00.178666+0000","last_peered":"2023-11-18T20:38:00.178666+0000","last_clean":"2023-11-18T20:38:00.178666+0000","last_became_active":"2023-11-18T20:37:59.162504+0000","last_became_peered":"2023-11-18T20:37:59.162504+0000","last_unstale":"2023-11-18T20:38:00.178666+0000","last_undegraded":"2023-11-18T20:38:00.178666+0000","last_fullsized":"2023-11-18T20:38:00.178666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:35.624119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870080+0000","last_change":"2023-11-18T20:37:59.176118+0000","last_active":"2023-11-18T20:38:01.870080+0000","last_peered":"2023-11-18T20:38:01.870080+0000","last_clean":"2023-11-18T20:38:01.870080+0000","last_became_active":"2023-11-18T20:37:59.175321+0000","last_became_peered":"2023-11-18T20:37:59.175321+0000","last_unstale":"2023-11-18T20:38:01.870080+0000","last_undegraded":"2023-11-18T20:38:01.870080+0000","last_fullsized":"2023-11-18T20:38:01.870080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:47.605864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177758+0000","last_change":"2023-11-18T20:37:59.177889+0000","last_active":"2023-11-18T20:38:00.177758+0000","last_peered":"2023-11-18T20:38:00.177758+0000","last_clean":"2023-11-18T20:38:00.177758+0000","last_became_active":"2023-11-18T20:37:59.176377+0000","last_became_peered":"2023-11-18T20:37:59.176377+0000","last_unstale":"2023-11-18T20:38:00.177758+0000","last_undegraded":"2023-11-18T20:38:00.177758+0000","last_fullsized":"2023-11-18T20:38:00.177758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:15.779817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178823+0000","last_change":"2023-11-18T20:37:59.183309+0000","last_active":"2023-11-18T20:38:00.178823+0000","last_peered":"2023-11-18T20:38:00.178823+0000","last_clean":"2023-11-18T20:38:00.178823+0000","last_became_active":"2023-11-18T20:37:59.182787+0000","last_became_peered":"2023-11-18T20:37:59.182787+0000","last_unstale":"2023-11-18T20:38:00.178823+0000","last_undegraded":"2023-11-18T20:38:00.178823+0000","last_fullsized":"2023-11-18T20:38:00.178823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:28.368691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.440348+0000","last_change":"2023-11-18T20:37:59.171247+0000","last_active":"2023-11-18T20:38:00.440348+0000","last_peered":"2023-11-18T20:38:00.440348+0000","last_clean":"2023-11-18T20:38:00.440348+0000","last_became_active":"2023-11-18T20:37:59.170983+0000","last_became_peered":"2023-11-18T20:37:59.170983+0000","last_unstale":"2023-11-18T20:38:00.440348+0000","last_undegraded":"2023-11-18T20:38:00.440348+0000","last_fullsized":"2023-11-18T20:38:00.440348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178586+0000","last_change":"2023-11-18T20:37:59.167413+0000","last_active":"2023-11-18T20:38:00.178586+0000","last_peered":"2023-11-18T20:38:00.178586+0000","last_clean":"2023-11-18T20:38:00.178586+0000","last_became_active":"2023-11-18T20:37:59.167085+0000","last_became_peered":"2023-11-18T20:37:59.167085+0000","last_unstale":"2023-11-18T20:38:00.178586+0000","last_undegraded":"2023-11-18T20:38:00.178586+0000","last_fullsized":"2023-11-18T20:38:00.178586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:41.166222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866787+0000","last_change":"2023-11-18T20:37:59.172328+0000","last_active":"2023-11-18T20:38:00.866787+0000","last_peered":"2023-11-18T20:38:00.866787+0000","last_clean":"2023-11-18T20:38:00.866787+0000","last_became_active":"2023-11-18T20:37:59.171693+0000","last_became_peered":"2023-11-18T20:37:59.171693+0000","last_unstale":"2023-11-18T20:38:00.866787+0000","last_undegraded":"2023-11-18T20:38:00.866787+0000","last_fullsized":"2023-11-18T20:38:00.866787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:03.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176269+0000","last_change":"2023-11-18T20:37:59.172679+0000","last_active":"2023-11-18T20:38:00.176269+0000","last_peered":"2023-11-18T20:38:00.176269+0000","last_clean":"2023-11-18T20:38:00.176269+0000","last_became_active":"2023-11-18T20:37:59.172347+0000","last_became_peered":"2023-11-18T20:37:59.172347+0000","last_unstale":"2023-11-18T20:38:00.176269+0000","last_undegraded":"2023-11-18T20:38:00.176269+0000","last_fullsized":"2023-11-18T20:38:00.176269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:51.840703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.869989+0000","last_change":"2023-11-18T20:37:59.172497+0000","last_active":"2023-11-18T20:38:01.869989+0000","last_peered":"2023-11-18T20:38:01.869989+0000","last_clean":"2023-11-18T20:38:01.869989+0000","last_became_active":"2023-11-18T20:37:59.172210+0000","last_became_peered":"2023-11-18T20:37:59.172210+0000","last_unstale":"2023-11-18T20:38:01.869989+0000","last_undegraded":"2023-11-18T20:38:01.869989+0000","last_fullsized":"2023-11-18T20:38:01.869989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870306+0000","last_change":"2023-11-18T20:37:59.175891+0000","last_active":"2023-11-18T20:38:01.870306+0000","last_peered":"2023-11-18T20:38:01.870306+0000","last_clean":"2023-11-18T20:38:01.870306+0000","last_became_active":"2023-11-18T20:37:59.174312+0000","last_became_peered":"2023-11-18T20:37:59.174312+0000","last_unstale":"2023-11-18T20:38:01.870306+0000","last_undegraded":"2023-11-18T20:38:01.870306+0000","last_fullsized":"2023-11-18T20:38:01.870306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:26:52.692005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177728+0000","last_change":"2023-11-18T20:37:59.179795+0000","last_active":"2023-11-18T20:38:00.177728+0000","last_peered":"2023-11-18T20:38:00.177728+0000","last_clean":"2023-11-18T20:38:00.177728+0000","last_became_active":"2023-11-18T20:37:59.179511+0000","last_became_peered":"2023-11-18T20:37:59.179511+0000","last_unstale":"2023-11-18T20:38:00.177728+0000","last_undegraded":"2023-11-18T20:38:00.177728+0000","last_fullsized":"2023-11-18T20:38:00.177728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:20.321237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871404+0000","last_change":"2023-11-18T20:37:59.177402+0000","last_active":"2023-11-18T20:38:01.871404+0000","last_peered":"2023-11-18T20:38:01.871404+0000","last_clean":"2023-11-18T20:38:01.871404+0000","last_became_active":"2023-11-18T20:37:59.172869+0000","last_became_peered":"2023-11-18T20:37:59.172869+0000","last_unstale":"2023-11-18T20:38:01.871404+0000","last_undegraded":"2023-11-18T20:38:01.871404+0000","last_fullsized":"2023-11-18T20:38:01.871404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:52.246806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374657+0000","last_change":"2023-11-18T20:37:59.162828+0000","last_active":"2023-11-18T20:38:01.374657+0000","last_peered":"2023-11-18T20:38:01.374657+0000","last_clean":"2023-11-18T20:38:01.374657+0000","last_became_active":"2023-11-18T20:37:59.162583+0000","last_became_peered":"2023-11-18T20:37:59.162583+0000","last_unstale":"2023-11-18T20:38:01.374657+0000","last_undegraded":"2023-11-18T20:38:01.374657+0000","last_fullsized":"2023-11-18T20:38:01.374657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179070+0000","last_change":"2023-11-18T20:37:59.169834+0000","last_active":"2023-11-18T20:38:00.179070+0000","last_peered":"2023-11-18T20:38:00.179070+0000","last_clean":"2023-11-18T20:38:00.179070+0000","last_became_active":"2023-11-18T20:37:59.169554+0000","last_became_peered":"2023-11-18T20:37:59.169554+0000","last_unstale":"2023-11-18T20:38:00.179070+0000","last_undegraded":"2023-11-18T20:38:00.179070+0000","last_fullsized":"2023-11-18T20:38:00.179070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:55:40.990469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179047+0000","last_change":"2023-11-18T20:37:59.177120+0000","last_active":"2023-11-18T20:38:00.179047+0000","last_peered":"2023-11-18T20:38:00.179047+0000","last_clean":"2023-11-18T20:38:00.179047+0000","last_became_active":"2023-11-18T20:37:59.176750+0000","last_became_peered":"2023-11-18T20:37:59.176750+0000","last_unstale":"2023-11-18T20:38:00.179047+0000","last_undegraded":"2023-11-18T20:38:00.179047+0000","last_fullsized":"2023-11-18T20:38:00.179047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:43:15.160907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870806+0000","last_change":"2023-11-18T20:37:59.180478+0000","last_active":"2023-11-18T20:38:01.870806+0000","last_peered":"2023-11-18T20:38:01.870806+0000","last_clean":"2023-11-18T20:38:01.870806+0000","last_became_active":"2023-11-18T20:37:59.178800+0000","last_became_peered":"2023-11-18T20:37:59.178800+0000","last_unstale":"2023-11-18T20:38:01.870806+0000","last_undegraded":"2023-11-18T20:38:01.870806+0000","last_fullsized":"2023-11-18T20:38:01.870806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:04:48.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177859+0000","last_change":"2023-11-18T20:37:59.171746+0000","last_active":"2023-11-18T20:38:00.177859+0000","last_peered":"2023-11-18T20:38:00.177859+0000","last_clean":"2023-11-18T20:38:00.177859+0000","last_became_active":"2023-11-18T20:37:59.171244+0000","last_became_peered":"2023-11-18T20:37:59.171244+0000","last_unstale":"2023-11-18T20:38:00.177859+0000","last_undegraded":"2023-11-18T20:38:00.177859+0000","last_fullsized":"2023-11-18T20:38:00.177859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:16:16.372839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.439791+0000","last_change":"2023-11-18T20:37:59.171816+0000","last_active":"2023-11-18T20:38:00.439791+0000","last_peered":"2023-11-18T20:38:00.439791+0000","last_clean":"2023-11-18T20:38:00.439791+0000","last_became_active":"2023-11-18T20:37:59.171323+0000","last_became_peered":"2023-11-18T20:37:59.171323+0000","last_unstale":"2023-11-18T20:38:00.439791+0000","last_undegraded":"2023-11-18T20:38:00.439791+0000","last_fullsized":"2023-11-18T20:38:00.439791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.373526+0000","last_change":"2023-11-18T20:37:59.156479+0000","last_active":"2023-11-18T20:38:01.373526+0000","last_peered":"2023-11-18T20:38:01.373526+0000","last_clean":"2023-11-18T20:38:01.373526+0000","last_became_active":"2023-11-18T20:37:59.156003+0000","last_became_peered":"2023-11-18T20:37:59.156003+0000","last_unstale":"2023-11-18T20:38:01.373526+0000","last_undegraded":"2023-11-18T20:38:01.373526+0000","last_fullsized":"2023-11-18T20:38:01.373526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870349+0000","last_change":"2023-11-18T20:37:59.182472+0000","last_active":"2023-11-18T20:38:01.870349+0000","last_peered":"2023-11-18T20:38:01.870349+0000","last_clean":"2023-11-18T20:38:01.870349+0000","last_became_active":"2023-11-18T20:37:59.182167+0000","last_became_peered":"2023-11-18T20:37:59.182167+0000","last_unstale":"2023-11-18T20:38:01.870349+0000","last_undegraded":"2023-11-18T20:38:01.870349+0000","last_fullsized":"2023-11-18T20:38:01.870349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189196+0000","last_change":"2023-11-18T20:37:58.158696+0000","last_active":"2023-11-18T20:37:59.189196+0000","last_peered":"2023-11-18T20:37:59.189196+0000","last_clean":"2023-11-18T20:37:59.189196+0000","last_became_active":"2023-11-18T20:37:58.158374+0000","last_became_peered":"2023-11-18T20:37:58.158374+0000","last_unstale":"2023-11-18T20:37:59.189196+0000","last_undegraded":"2023-11-18T20:37:59.189196+0000","last_fullsized":"2023-11-18T20:37:59.189196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:08.732817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176688+0000","last_change":"2023-11-18T20:37:59.171211+0000","last_active":"2023-11-18T20:38:00.176688+0000","last_peered":"2023-11-18T20:38:00.176688+0000","last_clean":"2023-11-18T20:38:00.176688+0000","last_became_active":"2023-11-18T20:37:59.170977+0000","last_became_peered":"2023-11-18T20:37:59.170977+0000","last_unstale":"2023-11-18T20:38:00.176688+0000","last_undegraded":"2023-11-18T20:38:00.176688+0000","last_fullsized":"2023-11-18T20:38:00.176688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:47.280214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190613+0000","last_change":"2023-11-18T20:37:58.170075+0000","last_active":"2023-11-18T20:37:59.190613+0000","last_peered":"2023-11-18T20:37:59.190613+0000","last_clean":"2023-11-18T20:37:59.190613+0000","last_became_active":"2023-11-18T20:37:58.169733+0000","last_became_peered":"2023-11-18T20:37:58.169733+0000","last_unstale":"2023-11-18T20:37:59.190613+0000","last_undegraded":"2023-11-18T20:37:59.190613+0000","last_fullsized":"2023-11-18T20:37:59.190613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:43:14.145500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.142761+0000","last_change":"2023-11-18T20:37:58.172306+0000","last_active":"2023-11-18T20:37:59.142761+0000","last_peered":"2023-11-18T20:37:59.142761+0000","last_clean":"2023-11-18T20:37:59.142761+0000","last_became_active":"2023-11-18T20:37:58.171954+0000","last_became_peered":"2023-11-18T20:37:58.171954+0000","last_unstale":"2023-11-18T20:37:59.142761+0000","last_undegraded":"2023-11-18T20:37:59.142761+0000","last_fullsized":"2023-11-18T20:37:59.142761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:30:15.515458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870314+0000","last_change":"2023-11-18T20:37:59.165306+0000","last_active":"2023-11-18T20:38:01.870314+0000","last_peered":"2023-11-18T20:38:01.870314+0000","last_clean":"2023-11-18T20:38:01.870314+0000","last_became_active":"2023-11-18T20:37:59.165035+0000","last_became_peered":"2023-11-18T20:37:59.165035+0000","last_unstale":"2023-11-18T20:38:01.870314+0000","last_undegraded":"2023-11-18T20:38:01.870314+0000","last_fullsized":"2023-11-18T20:38:01.870314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:26.137811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.149243+0000","last_change":"2023-11-18T20:37:58.164000+0000","last_active":"2023-11-18T20:37:59.149243+0000","last_peered":"2023-11-18T20:37:59.149243+0000","last_clean":"2023-11-18T20:37:59.149243+0000","last_became_active":"2023-11-18T20:37:58.163682+0000","last_became_peered":"2023-11-18T20:37:58.163682+0000","last_unstale":"2023-11-18T20:37:59.149243+0000","last_undegraded":"2023-11-18T20:37:59.149243+0000","last_fullsized":"2023-11-18T20:37:59.149243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:44.319234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176366+0000","last_change":"2023-11-18T20:37:59.168169+0000","last_active":"2023-11-18T20:38:00.176366+0000","last_peered":"2023-11-18T20:38:00.176366+0000","last_clean":"2023-11-18T20:38:00.176366+0000","last_became_active":"2023-11-18T20:37:59.167908+0000","last_became_peered":"2023-11-18T20:37:59.167908+0000","last_unstale":"2023-11-18T20:38:00.176366+0000","last_undegraded":"2023-11-18T20:38:00.176366+0000","last_fullsized":"2023-11-18T20:38:00.176366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:44.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.160095+0000","last_change":"2023-11-18T20:37:58.166557+0000","last_active":"2023-11-18T20:37:59.160095+0000","last_peered":"2023-11-18T20:37:59.160095+0000","last_clean":"2023-11-18T20:37:59.160095+0000","last_became_active":"2023-11-18T20:37:58.166295+0000","last_became_peered":"2023-11-18T20:37:58.166295+0000","last_unstale":"2023-11-18T20:37:59.160095+0000","last_undegraded":"2023-11-18T20:37:59.160095+0000","last_fullsized":"2023-11-18T20:37:59.160095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374829+0000","last_change":"2023-11-18T20:37:59.168548+0000","last_active":"2023-11-18T20:38:01.374829+0000","last_peered":"2023-11-18T20:38:01.374829+0000","last_clean":"2023-11-18T20:38:01.374829+0000","last_became_active":"2023-11-18T20:37:59.164088+0000","last_became_peered":"2023-11-18T20:37:59.164088+0000","last_unstale":"2023-11-18T20:38:01.374829+0000","last_undegraded":"2023-11-18T20:38:01.374829+0000","last_fullsized":"2023-11-18T20:38:01.374829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:04:39.108066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.161047+0000","last_change":"2023-11-18T20:37:58.157681+0000","last_active":"2023-11-18T20:37:59.161047+0000","last_peered":"2023-11-18T20:37:59.161047+0000","last_clean":"2023-11-18T20:37:59.161047+0000","last_became_active":"2023-11-18T20:37:58.157385+0000","last_became_peered":"2023-11-18T20:37:58.157385+0000","last_unstale":"2023-11-18T20:37:59.161047+0000","last_undegraded":"2023-11-18T20:37:59.161047+0000","last_fullsized":"2023-11-18T20:37:59.161047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:46.590457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871732+0000","last_change":"2023-11-18T20:37:59.173174+0000","last_active":"2023-11-18T20:38:01.871732+0000","last_peered":"2023-11-18T20:38:01.871732+0000","last_clean":"2023-11-18T20:38:01.871732+0000","last_became_active":"2023-11-18T20:37:59.172244+0000","last_became_peered":"2023-11-18T20:37:59.172244+0000","last_unstale":"2023-11-18T20:38:01.871732+0000","last_undegraded":"2023-11-18T20:38:01.871732+0000","last_fullsized":"2023-11-18T20:38:01.871732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:40.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.194185+0000","last_change":"2023-11-18T20:37:58.167812+0000","last_active":"2023-11-18T20:37:59.194185+0000","last_peered":"2023-11-18T20:37:59.194185+0000","last_clean":"2023-11-18T20:37:59.194185+0000","last_became_active":"2023-11-18T20:37:58.167312+0000","last_became_peered":"2023-11-18T20:37:58.167312+0000","last_unstale":"2023-11-18T20:37:59.194185+0000","last_undegraded":"2023-11-18T20:37:59.194185+0000","last_fullsized":"2023-11-18T20:37:59.194185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:28.447114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178044+0000","last_change":"2023-11-18T20:37:59.175489+0000","last_active":"2023-11-18T20:38:00.178044+0000","last_peered":"2023-11-18T20:38:00.178044+0000","last_clean":"2023-11-18T20:38:00.178044+0000","last_became_active":"2023-11-18T20:37:59.175234+0000","last_became_peered":"2023-11-18T20:37:59.175234+0000","last_unstale":"2023-11-18T20:38:00.178044+0000","last_undegraded":"2023-11-18T20:38:00.178044+0000","last_fullsized":"2023-11-18T20:38:00.178044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:19:55.270924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.196632+0000","last_change":"2023-11-18T20:37:58.169135+0000","last_active":"2023-11-18T20:37:59.196632+0000","last_peered":"2023-11-18T20:37:59.196632+0000","last_clean":"2023-11-18T20:37:59.196632+0000","last_became_active":"2023-11-18T20:37:58.168858+0000","last_became_peered":"2023-11-18T20:37:58.168858+0000","last_unstale":"2023-11-18T20:37:59.196632+0000","last_undegraded":"2023-11-18T20:37:59.196632+0000","last_fullsized":"2023-11-18T20:37:59.196632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:43.509370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866196+0000","last_change":"2023-11-18T20:37:59.166111+0000","last_active":"2023-11-18T20:38:00.866196+0000","last_peered":"2023-11-18T20:38:00.866196+0000","last_clean":"2023-11-18T20:38:00.866196+0000","last_became_active":"2023-11-18T20:37:59.165719+0000","last_became_peered":"2023-11-18T20:37:59.165719+0000","last_unstale":"2023-11-18T20:38:00.866196+0000","last_undegraded":"2023-11-18T20:38:00.866196+0000","last_fullsized":"2023-11-18T20:38:00.866196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:31.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.193497+0000","last_change":"2023-11-18T20:37:58.162763+0000","last_active":"2023-11-18T20:37:59.193497+0000","last_peered":"2023-11-18T20:37:59.193497+0000","last_clean":"2023-11-18T20:37:59.193497+0000","last_became_active":"2023-11-18T20:37:58.162392+0000","last_became_peered":"2023-11-18T20:37:58.162392+0000","last_unstale":"2023-11-18T20:37:59.193497+0000","last_undegraded":"2023-11-18T20:37:59.193497+0000","last_fullsized":"2023-11-18T20:37:59.193497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178818+0000","last_change":"2023-11-18T20:37:59.165551+0000","last_active":"2023-11-18T20:38:00.178818+0000","last_peered":"2023-11-18T20:38:00.178818+0000","last_clean":"2023-11-18T20:38:00.178818+0000","last_became_active":"2023-11-18T20:37:59.163366+0000","last_became_peered":"2023-11-18T20:37:59.163366+0000","last_unstale":"2023-11-18T20:38:00.178818+0000","last_undegraded":"2023-11-18T20:38:00.178818+0000","last_fullsized":"2023-11-18T20:38:00.178818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:01.609933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.151545+0000","last_change":"2023-11-18T20:37:58.170692+0000","last_active":"2023-11-18T20:37:59.151545+0000","last_peered":"2023-11-18T20:37:59.151545+0000","last_clean":"2023-11-18T20:37:59.151545+0000","last_became_active":"2023-11-18T20:37:58.170367+0000","last_became_peered":"2023-11-18T20:37:58.170367+0000","last_unstale":"2023-11-18T20:37:59.151545+0000","last_undegraded":"2023-11-18T20:37:59.151545+0000","last_fullsized":"2023-11-18T20:37:59.151545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:55:39.975062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177661+0000","last_change":"2023-11-18T20:37:59.183248+0000","last_active":"2023-11-18T20:38:00.177661+0000","last_peered":"2023-11-18T20:38:00.177661+0000","last_clean":"2023-11-18T20:38:00.177661+0000","last_became_active":"2023-11-18T20:37:59.182319+0000","last_became_peered":"2023-11-18T20:37:59.182319+0000","last_unstale":"2023-11-18T20:38:00.177661+0000","last_undegraded":"2023-11-18T20:38:00.177661+0000","last_fullsized":"2023-11-18T20:38:00.177661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:14.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.147170+0000","last_change":"2023-11-18T20:37:58.168153+0000","last_active":"2023-11-18T20:37:59.147170+0000","last_peered":"2023-11-18T20:37:59.147170+0000","last_clean":"2023-11-18T20:37:59.147170+0000","last_became_active":"2023-11-18T20:37:58.165711+0000","last_became_peered":"2023-11-18T20:37:58.165711+0000","last_unstale":"2023-11-18T20:37:59.147170+0000","last_undegraded":"2023-11-18T20:37:59.147170+0000","last_fullsized":"2023-11-18T20:37:59.147170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:52:59.215314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.869868+0000","last_change":"2023-11-18T20:37:59.180171+0000","last_active":"2023-11-18T20:38:01.869868+0000","last_peered":"2023-11-18T20:38:01.869868+0000","last_clean":"2023-11-18T20:38:01.869868+0000","last_became_active":"2023-11-18T20:37:59.179858+0000","last_became_peered":"2023-11-18T20:37:59.179858+0000","last_unstale":"2023-11-18T20:38:01.869868+0000","last_undegraded":"2023-11-18T20:38:01.869868+0000","last_fullsized":"2023-11-18T20:38:01.869868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:00.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.194143+0000","last_change":"2023-11-18T20:37:58.162399+0000","last_active":"2023-11-18T20:37:59.194143+0000","last_peered":"2023-11-18T20:37:59.194143+0000","last_clean":"2023-11-18T20:37:59.194143+0000","last_became_active":"2023-11-18T20:37:58.161728+0000","last_became_peered":"2023-11-18T20:37:58.161728+0000","last_unstale":"2023-11-18T20:37:59.194143+0000","last_undegraded":"2023-11-18T20:37:59.194143+0000","last_fullsized":"2023-11-18T20:37:59.194143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177729+0000","last_change":"2023-11-18T20:37:59.176781+0000","last_active":"2023-11-18T20:38:00.177729+0000","last_peered":"2023-11-18T20:38:00.177729+0000","last_clean":"2023-11-18T20:38:00.177729+0000","last_became_active":"2023-11-18T20:37:59.176177+0000","last_became_peered":"2023-11-18T20:37:59.176177+0000","last_unstale":"2023-11-18T20:38:00.177729+0000","last_undegraded":"2023-11-18T20:38:00.177729+0000","last_fullsized":"2023-11-18T20:38:00.177729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:40:24.771147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190289+0000","last_change":"2023-11-18T20:37:58.162267+0000","last_active":"2023-11-18T20:37:59.190289+0000","last_peered":"2023-11-18T20:37:59.190289+0000","last_clean":"2023-11-18T20:37:59.190289+0000","last_became_active":"2023-11-18T20:37:58.161948+0000","last_became_peered":"2023-11-18T20:37:58.161948+0000","last_unstale":"2023-11-18T20:37:59.190289+0000","last_undegraded":"2023-11-18T20:37:59.190289+0000","last_fullsized":"2023-11-18T20:37:59.190289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:08.418442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374826+0000","last_change":"2023-11-18T20:37:59.173619+0000","last_active":"2023-11-18T20:38:01.374826+0000","last_peered":"2023-11-18T20:38:01.374826+0000","last_clean":"2023-11-18T20:38:01.374826+0000","last_became_active":"2023-11-18T20:37:59.173303+0000","last_became_peered":"2023-11-18T20:37:59.173303+0000","last_unstale":"2023-11-18T20:38:01.374826+0000","last_undegraded":"2023-11-18T20:38:01.374826+0000","last_fullsized":"2023-11-18T20:38:01.374826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:00.673685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189711+0000","last_change":"2023-11-18T20:37:58.163432+0000","last_active":"2023-11-18T20:37:59.189711+0000","last_peered":"2023-11-18T20:37:59.189711+0000","last_clean":"2023-11-18T20:37:59.189711+0000","last_became_active":"2023-11-18T20:37:58.163136+0000","last_became_peered":"2023-11-18T20:37:58.163136+0000","last_unstale":"2023-11-18T20:37:59.189711+0000","last_undegraded":"2023-11-18T20:37:59.189711+0000","last_fullsized":"2023-11-18T20:37:59.189711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:02.758344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866722+0000","last_change":"2023-11-18T20:37:59.173529+0000","last_active":"2023-11-18T20:38:00.866722+0000","last_peered":"2023-11-18T20:38:00.866722+0000","last_clean":"2023-11-18T20:38:00.866722+0000","last_became_active":"2023-11-18T20:37:59.173236+0000","last_became_peered":"2023-11-18T20:37:59.173236+0000","last_unstale":"2023-11-18T20:38:00.866722+0000","last_undegraded":"2023-11-18T20:38:00.866722+0000","last_fullsized":"2023-11-18T20:38:00.866722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:56.471403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190765+0000","last_change":"2023-11-18T20:37:58.155736+0000","last_active":"2023-11-18T20:37:59.190765+0000","last_peered":"2023-11-18T20:37:59.190765+0000","last_clean":"2023-11-18T20:37:59.190765+0000","last_became_active":"2023-11-18T20:37:58.155358+0000","last_became_peered":"2023-11-18T20:37:58.155358+0000","last_unstale":"2023-11-18T20:37:59.190765+0000","last_undegraded":"2023-11-18T20:37:59.190765+0000","last_fullsized":"2023-11-18T20:37:59.190765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:08.418442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866947+0000","last_change":"2023-11-18T20:37:59.180009+0000","last_active":"2023-11-18T20:38:00.866947+0000","last_peered":"2023-11-18T20:38:00.866947+0000","last_clean":"2023-11-18T20:38:00.866947+0000","last_became_active":"2023-11-18T20:37:59.179749+0000","last_became_peered":"2023-11-18T20:37:59.179749+0000","last_unstale":"2023-11-18T20:38:00.866947+0000","last_undegraded":"2023-11-18T20:38:00.866947+0000","last_fullsized":"2023-11-18T20:38:00.866947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:32:26.758536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.147372+0000","last_change":"2023-11-18T20:37:58.172930+0000","last_active":"2023-11-18T20:37:59.147372+0000","last_peered":"2023-11-18T20:37:59.147372+0000","last_clean":"2023-11-18T20:37:59.147372+0000","last_became_active":"2023-11-18T20:37:58.172547+0000","last_became_peered":"2023-11-18T20:37:58.172547+0000","last_unstale":"2023-11-18T20:37:59.147372+0000","last_undegraded":"2023-11-18T20:37:59.147372+0000","last_fullsized":"2023-11-18T20:37:59.147372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:53.514145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178371+0000","last_change":"2023-11-18T20:37:59.170278+0000","last_active":"2023-11-18T20:38:00.178371+0000","last_peered":"2023-11-18T20:38:00.178371+0000","last_clean":"2023-11-18T20:38:00.178371+0000","last_became_active":"2023-11-18T20:37:59.169600+0000","last_became_peered":"2023-11-18T20:37:59.169600+0000","last_unstale":"2023-11-18T20:38:00.178371+0000","last_undegraded":"2023-11-18T20:38:00.178371+0000","last_fullsized":"2023-11-18T20:38:00.178371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:58.745666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.151129+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:37:59.151129+0000","last_peered":"2023-11-18T20:37:59.151129+0000","last_clean":"2023-11-18T20:37:59.151129+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:37:59.151129+0000","last_undegraded":"2023-11-18T20:37:59.151129+0000","last_fullsized":"2023-11-18T20:37:59.151129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.163203+0000","last_change":"2023-11-18T20:37:58.169197+0000","last_active":"2023-11-18T20:37:59.163203+0000","last_peered":"2023-11-18T20:37:59.163203+0000","last_clean":"2023-11-18T20:37:59.163203+0000","last_became_active":"2023-11-18T20:37:58.167753+0000","last_became_peered":"2023-11-18T20:37:58.167753+0000","last_unstale":"2023-11-18T20:37:59.163203+0000","last_undegraded":"2023-11-18T20:37:59.163203+0000","last_fullsized":"2023-11-18T20:37:59.163203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:53:19.905517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.175901+0000","last_change":"2023-11-18T20:37:59.161310+0000","last_active":"2023-11-18T20:38:00.175901+0000","last_peered":"2023-11-18T20:38:00.175901+0000","last_clean":"2023-11-18T20:38:00.175901+0000","last_became_active":"2023-11-18T20:37:59.160573+0000","last_became_peered":"2023-11-18T20:37:59.160573+0000","last_unstale":"2023-11-18T20:38:00.175901+0000","last_undegraded":"2023-11-18T20:38:00.175901+0000","last_fullsized":"2023-11-18T20:38:00.175901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.748224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.149589+0000","last_change":"2023-11-18T20:37:58.164074+0000","last_active":"2023-11-18T20:37:59.149589+0000","last_peered":"2023-11-18T20:37:59.149589+0000","last_clean":"2023-11-18T20:37:59.149589+0000","last_became_active":"2023-11-18T20:37:58.163736+0000","last_became_peered":"2023-11-18T20:37:58.163736+0000","last_unstale":"2023-11-18T20:37:59.149589+0000","last_undegraded":"2023-11-18T20:37:59.149589+0000","last_fullsized":"2023-11-18T20:37:59.149589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:34.608711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178613+0000","last_change":"2023-11-18T20:37:59.159340+0000","last_active":"2023-11-18T20:38:00.178613+0000","last_peered":"2023-11-18T20:38:00.178613+0000","last_clean":"2023-11-18T20:38:00.178613+0000","last_became_active":"2023-11-18T20:37:59.157840+0000","last_became_peered":"2023-11-18T20:37:59.157840+0000","last_unstale":"2023-11-18T20:38:00.178613+0000","last_undegraded":"2023-11-18T20:38:00.178613+0000","last_fullsized":"2023-11-18T20:38:00.178613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:45.334641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.154943+0000","last_change":"2023-11-18T20:37:58.162360+0000","last_active":"2023-11-18T20:37:59.154943+0000","last_peered":"2023-11-18T20:37:59.154943+0000","last_clean":"2023-11-18T20:37:59.154943+0000","last_became_active":"2023-11-18T20:37:58.161032+0000","last_became_peered":"2023-11-18T20:37:58.161032+0000","last_unstale":"2023-11-18T20:37:59.154943+0000","last_undegraded":"2023-11-18T20:37:59.154943+0000","last_fullsized":"2023-11-18T20:37:59.154943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:22.310204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870267+0000","last_change":"2023-11-18T20:37:59.184190+0000","last_active":"2023-11-18T20:38:01.870267+0000","last_peered":"2023-11-18T20:38:01.870267+0000","last_clean":"2023-11-18T20:38:01.870267+0000","last_became_active":"2023-11-18T20:37:59.183849+0000","last_became_peered":"2023-11-18T20:37:59.183849+0000","last_unstale":"2023-11-18T20:38:01.870267+0000","last_undegraded":"2023-11-18T20:38:01.870267+0000","last_fullsized":"2023-11-18T20:38:01.870267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:47.280214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.152253+0000","last_change":"2023-11-18T20:37:58.170185+0000","last_active":"2023-11-18T20:37:59.152253+0000","last_peered":"2023-11-18T20:37:59.152253+0000","last_clean":"2023-11-18T20:37:59.152253+0000","last_became_active":"2023-11-18T20:37:58.169816+0000","last_became_peered":"2023-11-18T20:37:58.169816+0000","last_unstale":"2023-11-18T20:37:59.152253+0000","last_undegraded":"2023-11-18T20:37:59.152253+0000","last_fullsized":"2023-11-18T20:37:59.152253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:08.127960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866620+0000","last_change":"2023-11-18T20:37:59.174808+0000","last_active":"2023-11-18T20:38:00.866620+0000","last_peered":"2023-11-18T20:38:00.866620+0000","last_clean":"2023-11-18T20:38:00.866620+0000","last_became_active":"2023-11-18T20:37:59.174514+0000","last_became_peered":"2023-11-18T20:37:59.174514+0000","last_unstale":"2023-11-18T20:38:00.866620+0000","last_undegraded":"2023-11-18T20:38:00.866620+0000","last_fullsized":"2023-11-18T20:38:00.866620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:38.185159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.169106+0000","last_change":"2023-11-18T20:37:58.166623+0000","last_active":"2023-11-18T20:37:59.169106+0000","last_peered":"2023-11-18T20:37:59.169106+0000","last_clean":"2023-11-18T20:37:59.169106+0000","last_became_active":"2023-11-18T20:37:58.166264+0000","last_became_peered":"2023-11-18T20:37:58.166264+0000","last_unstale":"2023-11-18T20:37:59.169106+0000","last_undegraded":"2023-11-18T20:37:59.169106+0000","last_fullsized":"2023-11-18T20:37:59.169106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:50.825296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374320+0000","last_change":"2023-11-18T20:37:59.155770+0000","last_active":"2023-11-18T20:38:01.374320+0000","last_peered":"2023-11-18T20:38:01.374320+0000","last_clean":"2023-11-18T20:38:01.374320+0000","last_became_active":"2023-11-18T20:37:59.153043+0000","last_became_peered":"2023-11-18T20:37:59.153043+0000","last_unstale":"2023-11-18T20:38:01.374320+0000","last_undegraded":"2023-11-18T20:38:01.374320+0000","last_fullsized":"2023-11-18T20:38:01.374320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:03.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.165053+0000","last_change":"2023-11-18T20:37:58.171460+0000","last_active":"2023-11-18T20:37:59.165053+0000","last_peered":"2023-11-18T20:37:59.165053+0000","last_clean":"2023-11-18T20:37:59.165053+0000","last_became_active":"2023-11-18T20:37:58.171098+0000","last_became_peered":"2023-11-18T20:37:58.171098+0000","last_unstale":"2023-11-18T20:37:59.165053+0000","last_undegraded":"2023-11-18T20:37:59.165053+0000","last_fullsized":"2023-11-18T20:37:59.165053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:03.237240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179244+0000","last_change":"2023-11-18T20:37:59.185324+0000","last_active":"2023-11-18T20:38:00.179244+0000","last_peered":"2023-11-18T20:38:00.179244+0000","last_clean":"2023-11-18T20:38:00.179244+0000","last_became_active":"2023-11-18T20:37:59.184874+0000","last_became_peered":"2023-11-18T20:37:59.184874+0000","last_unstale":"2023-11-18T20:38:00.179244+0000","last_undegraded":"2023-11-18T20:38:00.179244+0000","last_fullsized":"2023-11-18T20:38:00.179244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:09.143367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177185+0000","last_change":"2023-11-18T20:37:58.172192+0000","last_active":"2023-11-18T20:38:00.177185+0000","last_peered":"2023-11-18T20:38:00.177185+0000","last_clean":"2023-11-18T20:38:00.177185+0000","last_became_active":"2023-11-18T20:37:58.171909+0000","last_became_peered":"2023-11-18T20:37:58.171909+0000","last_unstale":"2023-11-18T20:38:00.177185+0000","last_undegraded":"2023-11-18T20:38:00.177185+0000","last_fullsized":"2023-11-18T20:38:00.177185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.052630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176507+0000","last_change":"2023-11-18T20:37:59.156794+0000","last_active":"2023-11-18T20:38:00.176507+0000","last_peered":"2023-11-18T20:38:00.176507+0000","last_clean":"2023-11-18T20:38:00.176507+0000","last_became_active":"2023-11-18T20:37:59.156240+0000","last_became_peered":"2023-11-18T20:37:59.156240+0000","last_unstale":"2023-11-18T20:38:00.176507+0000","last_undegraded":"2023-11-18T20:38:00.176507+0000","last_fullsized":"2023-11-18T20:38:00.176507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:47.605864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190149+0000","last_change":"2023-11-18T20:37:58.172619+0000","last_active":"2023-11-18T20:37:59.190149+0000","last_peered":"2023-11-18T20:37:59.190149+0000","last_clean":"2023-11-18T20:37:59.190149+0000","last_became_active":"2023-11-18T20:37:58.172348+0000","last_became_peered":"2023-11-18T20:37:58.172348+0000","last_unstale":"2023-11-18T20:37:59.190149+0000","last_undegraded":"2023-11-18T20:37:59.190149+0000","last_fullsized":"2023-11-18T20:37:59.190149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:50.652943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177039+0000","last_change":"2023-11-18T20:37:59.163153+0000","last_active":"2023-11-18T20:38:00.177039+0000","last_peered":"2023-11-18T20:38:00.177039+0000","last_clean":"2023-11-18T20:38:00.177039+0000","last_became_active":"2023-11-18T20:37:59.162808+0000","last_became_peered":"2023-11-18T20:37:59.162808+0000","last_unstale":"2023-11-18T20:38:00.177039+0000","last_undegraded":"2023-11-18T20:38:00.177039+0000","last_fullsized":"2023-11-18T20:38:00.177039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:26:52.692005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.146031+0000","last_change":"2023-11-18T20:37:58.159754+0000","last_active":"2023-11-18T20:37:59.146031+0000","last_peered":"2023-11-18T20:37:59.146031+0000","last_clean":"2023-11-18T20:37:59.146031+0000","last_became_active":"2023-11-18T20:37:58.159469+0000","last_became_peered":"2023-11-18T20:37:58.159469+0000","last_unstale":"2023-11-18T20:37:59.146031+0000","last_undegraded":"2023-11-18T20:37:59.146031+0000","last_fullsized":"2023-11-18T20:37:59.146031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177843+0000","last_change":"2023-11-18T20:37:59.167253+0000","last_active":"2023-11-18T20:38:00.177843+0000","last_peered":"2023-11-18T20:38:00.177843+0000","last_clean":"2023-11-18T20:38:00.177843+0000","last_became_active":"2023-11-18T20:37:59.166946+0000","last_became_peered":"2023-11-18T20:37:59.166946+0000","last_unstale":"2023-11-18T20:38:00.177843+0000","last_undegraded":"2023-11-18T20:38:00.177843+0000","last_fullsized":"2023-11-18T20:38:00.177843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:26:48.310102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.150750+0000","last_change":"2023-11-18T20:37:58.168664+0000","last_active":"2023-11-18T20:37:59.150750+0000","last_peered":"2023-11-18T20:37:59.150750+0000","last_clean":"2023-11-18T20:37:59.150750+0000","last_became_active":"2023-11-18T20:37:58.167672+0000","last_became_peered":"2023-11-18T20:37:58.167672+0000","last_unstale":"2023-11-18T20:37:59.150750+0000","last_undegraded":"2023-11-18T20:37:59.150750+0000","last_fullsized":"2023-11-18T20:37:59.150750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:04:38.092659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.175604+0000","last_change":"2023-11-18T20:37:59.167864+0000","last_active":"2023-11-18T20:38:00.175604+0000","last_peered":"2023-11-18T20:38:00.175604+0000","last_clean":"2023-11-18T20:38:00.175604+0000","last_became_active":"2023-11-18T20:37:59.167604+0000","last_became_peered":"2023-11-18T20:37:59.167604+0000","last_unstale":"2023-11-18T20:38:00.175604+0000","last_undegraded":"2023-11-18T20:38:00.175604+0000","last_fullsized":"2023-11-18T20:38:00.175604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:38.365782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.141993+0000","last_change":"2023-11-18T20:37:58.163771+0000","last_active":"2023-11-18T20:37:59.141993+0000","last_peered":"2023-11-18T20:37:59.141993+0000","last_clean":"2023-11-18T20:37:59.141993+0000","last_became_active":"2023-11-18T20:37:58.156832+0000","last_became_peered":"2023-11-18T20:37:58.156832+0000","last_unstale":"2023-11-18T20:37:59.141993+0000","last_undegraded":"2023-11-18T20:37:59.141993+0000","last_fullsized":"2023-11-18T20:37:59.141993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:50:00.581467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.440110+0000","last_change":"2023-11-18T20:37:59.168936+0000","last_active":"2023-11-18T20:38:00.440110+0000","last_peered":"2023-11-18T20:38:00.440110+0000","last_clean":"2023-11-18T20:38:00.440110+0000","last_became_active":"2023-11-18T20:37:59.168646+0000","last_became_peered":"2023-11-18T20:37:59.168646+0000","last_unstale":"2023-11-18T20:38:00.440110+0000","last_undegraded":"2023-11-18T20:38:00.440110+0000","last_fullsized":"2023-11-18T20:38:00.440110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190819+0000","last_change":"2023-11-18T20:37:58.167173+0000","last_active":"2023-11-18T20:37:59.190819+0000","last_peered":"2023-11-18T20:37:59.190819+0000","last_clean":"2023-11-18T20:37:59.190819+0000","last_became_active":"2023-11-18T20:37:58.166871+0000","last_became_peered":"2023-11-18T20:37:58.166871+0000","last_unstale":"2023-11-18T20:37:59.190819+0000","last_undegraded":"2023-11-18T20:37:59.190819+0000","last_fullsized":"2023-11-18T20:37:59.190819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:16:18.678055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178247+0000","last_change":"2023-11-18T20:37:59.174211+0000","last_active":"2023-11-18T20:38:00.178247+0000","last_peered":"2023-11-18T20:38:00.178247+0000","last_clean":"2023-11-18T20:38:00.178247+0000","last_became_active":"2023-11-18T20:37:59.173927+0000","last_became_peered":"2023-11-18T20:37:59.173927+0000","last_unstale":"2023-11-18T20:38:00.178247+0000","last_undegraded":"2023-11-18T20:38:00.178247+0000","last_fullsized":"2023-11-18T20:38:00.178247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:13.326666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178272+0000","last_change":"2023-11-18T20:37:59.178202+0000","last_active":"2023-11-18T20:38:00.178272+0000","last_peered":"2023-11-18T20:38:00.178272+0000","last_clean":"2023-11-18T20:38:00.178272+0000","last_became_active":"2023-11-18T20:37:59.177947+0000","last_became_peered":"2023-11-18T20:37:59.177947+0000","last_unstale":"2023-11-18T20:38:00.178272+0000","last_undegraded":"2023-11-18T20:38:00.178272+0000","last_fullsized":"2023-11-18T20:38:00.178272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:09.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.191381+0000","last_change":"2023-11-18T20:37:58.158604+0000","last_active":"2023-11-18T20:37:59.191381+0000","last_peered":"2023-11-18T20:37:59.191381+0000","last_clean":"2023-11-18T20:37:59.191381+0000","last_became_active":"2023-11-18T20:37:58.158146+0000","last_became_peered":"2023-11-18T20:37:58.158146+0000","last_unstale":"2023-11-18T20:37:59.191381+0000","last_undegraded":"2023-11-18T20:37:59.191381+0000","last_fullsized":"2023-11-18T20:37:59.191381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:46.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870315+0000","last_change":"2023-11-18T20:37:59.172487+0000","last_active":"2023-11-18T20:38:01.870315+0000","last_peered":"2023-11-18T20:38:01.870315+0000","last_clean":"2023-11-18T20:38:01.870315+0000","last_became_active":"2023-11-18T20:37:59.172038+0000","last_became_peered":"2023-11-18T20:37:59.172038+0000","last_unstale":"2023-11-18T20:38:01.870315+0000","last_undegraded":"2023-11-18T20:38:01.870315+0000","last_fullsized":"2023-11-18T20:38:01.870315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190640+0000","last_change":"2023-11-18T20:37:58.158747+0000","last_active":"2023-11-18T20:37:59.190640+0000","last_peered":"2023-11-18T20:37:59.190640+0000","last_clean":"2023-11-18T20:37:59.190640+0000","last_became_active":"2023-11-18T20:37:58.156086+0000","last_became_peered":"2023-11-18T20:37:58.156086+0000","last_unstale":"2023-11-18T20:37:59.190640+0000","last_undegraded":"2023-11-18T20:37:59.190640+0000","last_fullsized":"2023-11-18T20:37:59.190640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.052630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871489+0000","last_change":"2023-11-18T20:37:59.173339+0000","last_active":"2023-11-18T20:38:01.871489+0000","last_peered":"2023-11-18T20:38:01.871489+0000","last_clean":"2023-11-18T20:38:01.871489+0000","last_became_active":"2023-11-18T20:37:59.172593+0000","last_became_peered":"2023-11-18T20:37:59.172593+0000","last_unstale":"2023-11-18T20:38:01.871489+0000","last_undegraded":"2023-11-18T20:38:01.871489+0000","last_fullsized":"2023-11-18T20:38:01.871489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:38.185159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189386+0000","last_change":"2023-11-18T20:37:58.157777+0000","last_active":"2023-11-18T20:37:59.189386+0000","last_peered":"2023-11-18T20:37:59.189386+0000","last_clean":"2023-11-18T20:37:59.189386+0000","last_became_active":"2023-11-18T20:37:58.156090+0000","last_became_peered":"2023-11-18T20:37:58.156090+0000","last_unstale":"2023-11-18T20:37:59.189386+0000","last_undegraded":"2023-11-18T20:37:59.189386+0000","last_fullsized":"2023-11-18T20:37:59.189386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:37.350375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871355+0000","last_change":"2023-11-18T20:37:59.180531+0000","last_active":"2023-11-18T20:38:01.871355+0000","last_peered":"2023-11-18T20:38:01.871355+0000","last_clean":"2023-11-18T20:38:01.871355+0000","last_became_active":"2023-11-18T20:37:59.177897+0000","last_became_peered":"2023-11-18T20:37:59.177897+0000","last_unstale":"2023-11-18T20:38:01.871355+0000","last_undegraded":"2023-11-18T20:38:01.871355+0000","last_fullsized":"2023-11-18T20:38:01.871355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:13.243273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190088+0000","last_change":"2023-11-18T20:37:58.168566+0000","last_active":"2023-11-18T20:37:59.190088+0000","last_peered":"2023-11-18T20:37:59.190088+0000","last_clean":"2023-11-18T20:37:59.190088+0000","last_became_active":"2023-11-18T20:37:58.168250+0000","last_became_peered":"2023-11-18T20:37:58.168250+0000","last_unstale":"2023-11-18T20:37:59.190088+0000","last_undegraded":"2023-11-18T20:37:59.190088+0000","last_fullsized":"2023-11-18T20:37:59.190088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:21:59.658278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.873}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":74131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.24}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":664591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.833}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":74713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":664569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.857}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.988}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.028}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:38:08.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:38:08.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.766+0000 7f96d82da640 1 Processor -- start 2023-11-18T20:38:08.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.766+0000 7f96d82da640 1 -- start start 2023-11-18T20:38:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.767+0000 7f96d82da640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d0152f20 0x7f96d00c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.767+0000 7f96d82da640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d00c64a0 con 0x7f96d014fd30 2023-11-18T20:38:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.768+0000 7f96d82da640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d00c5c00 con 0x7f96d006d0a0 2023-11-18T20:38:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.768+0000 7f96d82da640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00c5ee0 con 0x7f96d0152f20 2023-11-18T20:38:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.768+0000 7f96d6076640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f96d014fd30 0x7f96d00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48606/0 (socket says 172.21.15.132:48606) 2023-11-18T20:38:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.768+0000 7f96d6076640 1 -- 172.21.15.132:0/1649877538 learned_addr learned my addr 172.21.15.132:0/1649877538 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:08.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.768+0000 7f96d6877640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d0152f20 0x7f96d00c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:08.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.768+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650027531 0 0) 0x7f96d00c64a0 con 0x7f96d014fd30 2023-11-18T20:38:08.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.768+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96bc003520 con 0x7f96d014fd30 2023-11-18T20:38:08.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.768+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830744461 0 0) 0x7f96bc003520 con 0x7f96d014fd30 2023-11-18T20:38:08.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d0152f20 msgr2=0x7f96d00c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:08.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d0152f20 0x7f96d00c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:08.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 >> v1:172.21.15.161:6789/0 conn(0x7f96d006d0a0 legacy=0x7f96d00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00c61c0 con 0x7f96d014fd30 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f96cc001670 con 0x7f96d014fd30 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 >> v1:172.21.15.132:6789/0 conn(0x7f96d014fd30 legacy=0x7f96d00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc0039a0 0x7f96bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d0152f20 0x7f96bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96bc004d00 0x7f96bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00c5ee0 con 0x7f96bc004d00 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc00ba60 con 0x7f96bc0039a0 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc00bc20 con 0x7f96d0152f20 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d6877640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96bc004d00 0x7f96bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d6076640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc0039a0 0x7f96bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:08.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d5875640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d0152f20 0x7f96bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d6877640 1 -- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d0152f20 msgr2=0x7f96bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d6877640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d0152f20 0x7f96bc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d6877640 1 -- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc0039a0 msgr2=0x7f96bc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d6877640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc0039a0 0x7f96bc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d6877640 1 -- 172.21.15.132:0/1649877538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc003520 con 0x7f96bc004d00 2023-11-18T20:38:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.769+0000 7f96d6076640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc0039a0 0x7f96bc003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:08.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d6877640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96bc004d00 0x7f96bc005180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009f90 tx=0x7f96bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f8b9700acca2d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:08.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c802cbd0 con 0x7f96bc004d00 2023-11-18T20:38:08.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c800f040 con 0x7f96bc004d00 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d5074640 1 -- 172.21.15.132:0/1649877538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8034440 con 0x7f96bc004d00 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d82da640 1 -- 172.21.15.132:0/1649877538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96bc004d00 msgr2=0x7f96bc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d82da640 1 --2- 172.21.15.132:0/1649877538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96bc004d00 0x7f96bc005180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009f90 tx=0x7f96bc0057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d6877640 1 -- 172.21.15.132:0/1649877538 reap_dead start 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d82da640 1 -- 172.21.15.132:0/1649877538 shutdown_connections 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d82da640 1 -- 172.21.15.132:0/1649877538 >> 172.21.15.132:0/1649877538 conn(0x7f96d006a500 msgr2=0x7f96d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.771+0000 7f96d82da640 1 -- 172.21.15.132:0/1649877538 shutdown_connections 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.772+0000 7f96d82da640 1 -- 172.21.15.132:0/1649877538 wait complete. 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.773+0000 7f96d82da640 1 Processor -- start 2023-11-18T20:38:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.773+0000 7f96d82da640 1 -- start start 2023-11-18T20:38:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.774+0000 7f96d82da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc004d00 0x7f96d0153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.774+0000 7f96d82da640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d01e7c40 0x7f96d00bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.774+0000 7f96d82da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d00bace0 0x7f96d00bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.774+0000 7f96d82da640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d01eb230 con 0x7f96d00bace0 2023-11-18T20:38:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.774+0000 7f96d82da640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0154ed0 con 0x7f96bc004d00 2023-11-18T20:38:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.774+0000 7f96d82da640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00bb510 con 0x7f96d01e7c40 2023-11-18T20:38:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d00bace0 0x7f96d00bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d00bace0 0x7f96d00bff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57582/0 (socket says 172.21.15.132:57582) 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 -- 172.21.15.132:0/368567332 learned_addr learned my addr 172.21.15.132:0/368567332 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d5875640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d01e7c40 0x7f96d00bfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 -- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d01e7c40 msgr2=0x7f96d00bfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d01e7c40 0x7f96d00bfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6076640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc004d00 0x7f96d0153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 -- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc004d00 msgr2=0x7f96d0153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc004d00 0x7f96d0153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 -- 172.21.15.132:0/368567332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d01e81b0 con 0x7f96d00bace0 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.775+0000 7f96d6877640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d00bace0 0x7f96d00bff50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009f90 tx=0x7f96c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.776+0000 7f96c6ffd640 1 -- 172.21.15.132:0/368567332 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8034d50 con 0x7f96d00bace0 2023-11-18T20:38:08.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.776+0000 7f96c6ffd640 1 -- 172.21.15.132:0/368567332 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c802de60 con 0x7f96d00bace0 2023-11-18T20:38:08.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.776+0000 7f96c6ffd640 1 -- 172.21.15.132:0/368567332 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8003bb0 con 0x7f96d00bace0 2023-11-18T20:38:08.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.776+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d01e8490 con 0x7f96d00bace0 2023-11-18T20:38:08.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.776+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d01e8a50 con 0x7f96d00bace0 2023-11-18T20:38:08.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.777+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d01e8c40 con 0x7f96d00bace0 2023-11-18T20:38:08.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.778+0000 7f96c6ffd640 1 -- 172.21.15.132:0/368567332 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96c8003d10 con 0x7f96d00bace0 2023-11-18T20:38:08.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.779+0000 7f96c6ffd640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f96b406ae40 0x7f96b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:08.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.780+0000 7f96c6ffd640 1 -- 172.21.15.132:0/368567332 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96c80ab070 con 0x7f96d00bace0 2023-11-18T20:38:08.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.780+0000 7f96d6076640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f96b406ae40 0x7f96b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:08.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.781+0000 7f96d6076640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f96b406ae40 0x7f96b406d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96cc001eb0 tx=0x7f96cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:08.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.784+0000 7f96c6ffd640 1 -- 172.21.15.132:0/368567332 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96c80dde90 con 0x7f96d00bace0 2023-11-18T20:38:08.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.972+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96d0072980 con 0x7f96b406ae40 2023-11-18T20:38:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.994+0000 7f96c6ffd640 1 -- 172.21.15.132:0/368567332 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264286 (secure 0 0 0) 0x7f96cc00d040 con 0x7f96b406ae40 2023-11-18T20:38:08.998 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f96b406ae40 msgr2=0x7f96b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f96b406ae40 0x7f96b406d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96cc001eb0 tx=0x7f96cc009040 comp rx=0 tx=0).stop 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d00bace0 msgr2=0x7f96d00bff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d00bace0 0x7f96d00bff50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009f90 tx=0x7f96c8009750 comp rx=0 tx=0).stop 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 shutdown_connections 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f96b406ae40 0x7f96b406d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d00bace0 0x7f96d00bff50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d01e7c40 0x7f96d00bfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 --2- 172.21.15.132:0/368567332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96bc004d00 0x7f96d0153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 >> 172.21.15.132:0/368567332 conn(0x7f96d006a500 msgr2=0x7f96d00c1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:09.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 shutdown_connections 2023-11-18T20:38:09.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:08.999+0000 7f96d82da640 1 -- 172.21.15.132:0/368567332 wait complete. 2023-11-18T20:38:09.019 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-18T20:38:08.633051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2957312,"data_stored":1778604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.498745"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866689+0000","last_change":"2023-11-18T20:37:59.173833+0000","last_active":"2023-11-18T20:38:00.866689+0000","last_peered":"2023-11-18T20:38:00.866689+0000","last_clean":"2023-11-18T20:38:00.866689+0000","last_became_active":"2023-11-18T20:37:59.170737+0000","last_became_peered":"2023-11-18T20:37:59.170737+0000","last_unstale":"2023-11-18T20:38:00.866689+0000","last_undegraded":"2023-11-18T20:38:00.866689+0000","last_fullsized":"2023-11-18T20:38:00.866689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:40.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871317+0000","last_change":"2023-11-18T20:37:59.178504+0000","last_active":"2023-11-18T20:38:01.871317+0000","last_peered":"2023-11-18T20:38:01.871317+0000","last_clean":"2023-11-18T20:38:01.871317+0000","last_became_active":"2023-11-18T20:37:59.178247+0000","last_became_peered":"2023-11-18T20:37:59.178247+0000","last_unstale":"2023-11-18T20:38:01.871317+0000","last_undegraded":"2023-11-18T20:38:01.871317+0000","last_fullsized":"2023-11-18T20:38:01.871317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:31.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870992+0000","last_change":"2023-11-18T20:37:59.181891+0000","last_active":"2023-11-18T20:38:01.870992+0000","last_peered":"2023-11-18T20:38:01.870992+0000","last_clean":"2023-11-18T20:38:01.870992+0000","last_became_active":"2023-11-18T20:37:59.180998+0000","last_became_peered":"2023-11-18T20:37:59.180998+0000","last_unstale":"2023-11-18T20:38:01.870992+0000","last_undegraded":"2023-11-18T20:38:01.870992+0000","last_fullsized":"2023-11-18T20:38:01.870992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:56:30.271654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374214+0000","last_change":"2023-11-18T20:37:59.159821+0000","last_active":"2023-11-18T20:38:01.374214+0000","last_peered":"2023-11-18T20:38:01.374214+0000","last_clean":"2023-11-18T20:38:01.374214+0000","last_became_active":"2023-11-18T20:37:59.159479+0000","last_became_peered":"2023-11-18T20:37:59.159479+0000","last_unstale":"2023-11-18T20:38:01.374214+0000","last_undegraded":"2023-11-18T20:38:01.374214+0000","last_fullsized":"2023-11-18T20:38:01.374214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866190+0000","last_change":"2023-11-18T20:37:59.181850+0000","last_active":"2023-11-18T20:38:00.866190+0000","last_peered":"2023-11-18T20:38:00.866190+0000","last_clean":"2023-11-18T20:38:00.866190+0000","last_became_active":"2023-11-18T20:37:59.181582+0000","last_became_peered":"2023-11-18T20:37:59.181582+0000","last_unstale":"2023-11-18T20:38:00.866190+0000","last_undegraded":"2023-11-18T20:38:00.866190+0000","last_fullsized":"2023-11-18T20:38:00.866190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:56:30.271654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.373610+0000","last_change":"2023-11-18T20:37:59.162681+0000","last_active":"2023-11-18T20:38:01.373610+0000","last_peered":"2023-11-18T20:38:01.373610+0000","last_clean":"2023-11-18T20:38:01.373610+0000","last_became_active":"2023-11-18T20:37:59.162312+0000","last_became_peered":"2023-11-18T20:37:59.162312+0000","last_unstale":"2023-11-18T20:38:01.373610+0000","last_undegraded":"2023-11-18T20:38:01.373610+0000","last_fullsized":"2023-11-18T20:38:01.373610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.865742+0000","last_change":"2023-11-18T20:37:59.164374+0000","last_active":"2023-11-18T20:38:00.865742+0000","last_peered":"2023-11-18T20:38:00.865742+0000","last_clean":"2023-11-18T20:38:00.865742+0000","last_became_active":"2023-11-18T20:37:59.163501+0000","last_became_peered":"2023-11-18T20:37:59.163501+0000","last_unstale":"2023-11-18T20:38:00.865742+0000","last_undegraded":"2023-11-18T20:38:00.865742+0000","last_fullsized":"2023-11-18T20:38:00.865742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:26.137811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870066+0000","last_change":"2023-11-18T20:37:59.176287+0000","last_active":"2023-11-18T20:38:01.870066+0000","last_peered":"2023-11-18T20:38:01.870066+0000","last_clean":"2023-11-18T20:38:01.870066+0000","last_became_active":"2023-11-18T20:37:59.175983+0000","last_became_peered":"2023-11-18T20:37:59.175983+0000","last_unstale":"2023-11-18T20:38:01.870066+0000","last_undegraded":"2023-11-18T20:38:01.870066+0000","last_fullsized":"2023-11-18T20:38:01.870066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:44.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870744+0000","last_change":"2023-11-18T20:37:59.167988+0000","last_active":"2023-11-18T20:38:01.870744+0000","last_peered":"2023-11-18T20:38:01.870744+0000","last_clean":"2023-11-18T20:38:01.870744+0000","last_became_active":"2023-11-18T20:37:59.167720+0000","last_became_peered":"2023-11-18T20:37:59.167720+0000","last_unstale":"2023-11-18T20:38:01.870744+0000","last_undegraded":"2023-11-18T20:38:01.870744+0000","last_fullsized":"2023-11-18T20:38:01.870744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:03.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866504+0000","last_change":"2023-11-18T20:37:59.179519+0000","last_active":"2023-11-18T20:38:00.866504+0000","last_peered":"2023-11-18T20:38:00.866504+0000","last_clean":"2023-11-18T20:38:00.866504+0000","last_became_active":"2023-11-18T20:37:59.178702+0000","last_became_peered":"2023-11-18T20:37:59.178702+0000","last_unstale":"2023-11-18T20:38:00.866504+0000","last_undegraded":"2023-11-18T20:38:00.866504+0000","last_fullsized":"2023-11-18T20:38:00.866504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:52.246806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866089+0000","last_change":"2023-11-18T20:37:59.177195+0000","last_active":"2023-11-18T20:38:00.866089+0000","last_peered":"2023-11-18T20:38:00.866089+0000","last_clean":"2023-11-18T20:38:00.866089+0000","last_became_active":"2023-11-18T20:37:59.176951+0000","last_became_peered":"2023-11-18T20:37:59.176951+0000","last_unstale":"2023-11-18T20:38:00.866089+0000","last_undegraded":"2023-11-18T20:38:00.866089+0000","last_fullsized":"2023-11-18T20:38:00.866089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:04:48.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866337+0000","last_change":"2023-11-18T20:37:59.172484+0000","last_active":"2023-11-18T20:38:00.866337+0000","last_peered":"2023-11-18T20:38:00.866337+0000","last_clean":"2023-11-18T20:38:00.866337+0000","last_became_active":"2023-11-18T20:37:59.172090+0000","last_became_peered":"2023-11-18T20:37:59.172090+0000","last_unstale":"2023-11-18T20:38:00.866337+0000","last_undegraded":"2023-11-18T20:38:00.866337+0000","last_fullsized":"2023-11-18T20:38:00.866337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:13.243273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178764+0000","last_change":"2023-11-18T20:37:59.178350+0000","last_active":"2023-11-18T20:38:00.178764+0000","last_peered":"2023-11-18T20:38:00.178764+0000","last_clean":"2023-11-18T20:38:00.178764+0000","last_became_active":"2023-11-18T20:37:59.176498+0000","last_became_peered":"2023-11-18T20:37:59.176498+0000","last_unstale":"2023-11-18T20:38:00.178764+0000","last_undegraded":"2023-11-18T20:38:00.178764+0000","last_fullsized":"2023-11-18T20:38:00.178764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:26:46.631259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178666+0000","last_change":"2023-11-18T20:37:59.162833+0000","last_active":"2023-11-18T20:38:00.178666+0000","last_peered":"2023-11-18T20:38:00.178666+0000","last_clean":"2023-11-18T20:38:00.178666+0000","last_became_active":"2023-11-18T20:37:59.162504+0000","last_became_peered":"2023-11-18T20:37:59.162504+0000","last_unstale":"2023-11-18T20:38:00.178666+0000","last_undegraded":"2023-11-18T20:38:00.178666+0000","last_fullsized":"2023-11-18T20:38:00.178666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:35.624119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870080+0000","last_change":"2023-11-18T20:37:59.176118+0000","last_active":"2023-11-18T20:38:01.870080+0000","last_peered":"2023-11-18T20:38:01.870080+0000","last_clean":"2023-11-18T20:38:01.870080+0000","last_became_active":"2023-11-18T20:37:59.175321+0000","last_became_peered":"2023-11-18T20:37:59.175321+0000","last_unstale":"2023-11-18T20:38:01.870080+0000","last_undegraded":"2023-11-18T20:38:01.870080+0000","last_fullsized":"2023-11-18T20:38:01.870080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:47.605864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177758+0000","last_change":"2023-11-18T20:37:59.177889+0000","last_active":"2023-11-18T20:38:00.177758+0000","last_peered":"2023-11-18T20:38:00.177758+0000","last_clean":"2023-11-18T20:38:00.177758+0000","last_became_active":"2023-11-18T20:37:59.176377+0000","last_became_peered":"2023-11-18T20:37:59.176377+0000","last_unstale":"2023-11-18T20:38:00.177758+0000","last_undegraded":"2023-11-18T20:38:00.177758+0000","last_fullsized":"2023-11-18T20:38:00.177758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:15.779817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178823+0000","last_change":"2023-11-18T20:37:59.183309+0000","last_active":"2023-11-18T20:38:00.178823+0000","last_peered":"2023-11-18T20:38:00.178823+0000","last_clean":"2023-11-18T20:38:00.178823+0000","last_became_active":"2023-11-18T20:37:59.182787+0000","last_became_peered":"2023-11-18T20:37:59.182787+0000","last_unstale":"2023-11-18T20:38:00.178823+0000","last_undegraded":"2023-11-18T20:38:00.178823+0000","last_fullsized":"2023-11-18T20:38:00.178823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:28.368691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.440348+0000","last_change":"2023-11-18T20:37:59.171247+0000","last_active":"2023-11-18T20:38:00.440348+0000","last_peered":"2023-11-18T20:38:00.440348+0000","last_clean":"2023-11-18T20:38:00.440348+0000","last_became_active":"2023-11-18T20:37:59.170983+0000","last_became_peered":"2023-11-18T20:37:59.170983+0000","last_unstale":"2023-11-18T20:38:00.440348+0000","last_undegraded":"2023-11-18T20:38:00.440348+0000","last_fullsized":"2023-11-18T20:38:00.440348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178586+0000","last_change":"2023-11-18T20:37:59.167413+0000","last_active":"2023-11-18T20:38:00.178586+0000","last_peered":"2023-11-18T20:38:00.178586+0000","last_clean":"2023-11-18T20:38:00.178586+0000","last_became_active":"2023-11-18T20:37:59.167085+0000","last_became_peered":"2023-11-18T20:37:59.167085+0000","last_unstale":"2023-11-18T20:38:00.178586+0000","last_undegraded":"2023-11-18T20:38:00.178586+0000","last_fullsized":"2023-11-18T20:38:00.178586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:41.166222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866787+0000","last_change":"2023-11-18T20:37:59.172328+0000","last_active":"2023-11-18T20:38:00.866787+0000","last_peered":"2023-11-18T20:38:00.866787+0000","last_clean":"2023-11-18T20:38:00.866787+0000","last_became_active":"2023-11-18T20:37:59.171693+0000","last_became_peered":"2023-11-18T20:37:59.171693+0000","last_unstale":"2023-11-18T20:38:00.866787+0000","last_undegraded":"2023-11-18T20:38:00.866787+0000","last_fullsized":"2023-11-18T20:38:00.866787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:03.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176269+0000","last_change":"2023-11-18T20:37:59.172679+0000","last_active":"2023-11-18T20:38:00.176269+0000","last_peered":"2023-11-18T20:38:00.176269+0000","last_clean":"2023-11-18T20:38:00.176269+0000","last_became_active":"2023-11-18T20:37:59.172347+0000","last_became_peered":"2023-11-18T20:37:59.172347+0000","last_unstale":"2023-11-18T20:38:00.176269+0000","last_undegraded":"2023-11-18T20:38:00.176269+0000","last_fullsized":"2023-11-18T20:38:00.176269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:51.840703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.869989+0000","last_change":"2023-11-18T20:37:59.172497+0000","last_active":"2023-11-18T20:38:01.869989+0000","last_peered":"2023-11-18T20:38:01.869989+0000","last_clean":"2023-11-18T20:38:01.869989+0000","last_became_active":"2023-11-18T20:37:59.172210+0000","last_became_peered":"2023-11-18T20:37:59.172210+0000","last_unstale":"2023-11-18T20:38:01.869989+0000","last_undegraded":"2023-11-18T20:38:01.869989+0000","last_fullsized":"2023-11-18T20:38:01.869989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870306+0000","last_change":"2023-11-18T20:37:59.175891+0000","last_active":"2023-11-18T20:38:01.870306+0000","last_peered":"2023-11-18T20:38:01.870306+0000","last_clean":"2023-11-18T20:38:01.870306+0000","last_became_active":"2023-11-18T20:37:59.174312+0000","last_became_peered":"2023-11-18T20:37:59.174312+0000","last_unstale":"2023-11-18T20:38:01.870306+0000","last_undegraded":"2023-11-18T20:38:01.870306+0000","last_fullsized":"2023-11-18T20:38:01.870306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:26:52.692005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177728+0000","last_change":"2023-11-18T20:37:59.179795+0000","last_active":"2023-11-18T20:38:00.177728+0000","last_peered":"2023-11-18T20:38:00.177728+0000","last_clean":"2023-11-18T20:38:00.177728+0000","last_became_active":"2023-11-18T20:37:59.179511+0000","last_became_peered":"2023-11-18T20:37:59.179511+0000","last_unstale":"2023-11-18T20:38:00.177728+0000","last_undegraded":"2023-11-18T20:38:00.177728+0000","last_fullsized":"2023-11-18T20:38:00.177728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:20.321237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871404+0000","last_change":"2023-11-18T20:37:59.177402+0000","last_active":"2023-11-18T20:38:01.871404+0000","last_peered":"2023-11-18T20:38:01.871404+0000","last_clean":"2023-11-18T20:38:01.871404+0000","last_became_active":"2023-11-18T20:37:59.172869+0000","last_became_peered":"2023-11-18T20:37:59.172869+0000","last_unstale":"2023-11-18T20:38:01.871404+0000","last_undegraded":"2023-11-18T20:38:01.871404+0000","last_fullsized":"2023-11-18T20:38:01.871404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:52.246806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374657+0000","last_change":"2023-11-18T20:37:59.162828+0000","last_active":"2023-11-18T20:38:01.374657+0000","last_peered":"2023-11-18T20:38:01.374657+0000","last_clean":"2023-11-18T20:38:01.374657+0000","last_became_active":"2023-11-18T20:37:59.162583+0000","last_became_peered":"2023-11-18T20:37:59.162583+0000","last_unstale":"2023-11-18T20:38:01.374657+0000","last_undegraded":"2023-11-18T20:38:01.374657+0000","last_fullsized":"2023-11-18T20:38:01.374657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179070+0000","last_change":"2023-11-18T20:37:59.169834+0000","last_active":"2023-11-18T20:38:00.179070+0000","last_peered":"2023-11-18T20:38:00.179070+0000","last_clean":"2023-11-18T20:38:00.179070+0000","last_became_active":"2023-11-18T20:37:59.169554+0000","last_became_peered":"2023-11-18T20:37:59.169554+0000","last_unstale":"2023-11-18T20:38:00.179070+0000","last_undegraded":"2023-11-18T20:38:00.179070+0000","last_fullsized":"2023-11-18T20:38:00.179070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:55:40.990469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179047+0000","last_change":"2023-11-18T20:37:59.177120+0000","last_active":"2023-11-18T20:38:00.179047+0000","last_peered":"2023-11-18T20:38:00.179047+0000","last_clean":"2023-11-18T20:38:00.179047+0000","last_became_active":"2023-11-18T20:37:59.176750+0000","last_became_peered":"2023-11-18T20:37:59.176750+0000","last_unstale":"2023-11-18T20:38:00.179047+0000","last_undegraded":"2023-11-18T20:38:00.179047+0000","last_fullsized":"2023-11-18T20:38:00.179047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:43:15.160907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870806+0000","last_change":"2023-11-18T20:37:59.180478+0000","last_active":"2023-11-18T20:38:01.870806+0000","last_peered":"2023-11-18T20:38:01.870806+0000","last_clean":"2023-11-18T20:38:01.870806+0000","last_became_active":"2023-11-18T20:37:59.178800+0000","last_became_peered":"2023-11-18T20:37:59.178800+0000","last_unstale":"2023-11-18T20:38:01.870806+0000","last_undegraded":"2023-11-18T20:38:01.870806+0000","last_fullsized":"2023-11-18T20:38:01.870806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:04:48.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177859+0000","last_change":"2023-11-18T20:37:59.171746+0000","last_active":"2023-11-18T20:38:00.177859+0000","last_peered":"2023-11-18T20:38:00.177859+0000","last_clean":"2023-11-18T20:38:00.177859+0000","last_became_active":"2023-11-18T20:37:59.171244+0000","last_became_peered":"2023-11-18T20:37:59.171244+0000","last_unstale":"2023-11-18T20:38:00.177859+0000","last_undegraded":"2023-11-18T20:38:00.177859+0000","last_fullsized":"2023-11-18T20:38:00.177859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:16:16.372839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.439791+0000","last_change":"2023-11-18T20:37:59.171816+0000","last_active":"2023-11-18T20:38:00.439791+0000","last_peered":"2023-11-18T20:38:00.439791+0000","last_clean":"2023-11-18T20:38:00.439791+0000","last_became_active":"2023-11-18T20:37:59.171323+0000","last_became_peered":"2023-11-18T20:37:59.171323+0000","last_unstale":"2023-11-18T20:38:00.439791+0000","last_undegraded":"2023-11-18T20:38:00.439791+0000","last_fullsized":"2023-11-18T20:38:00.439791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.373526+0000","last_change":"2023-11-18T20:37:59.156479+0000","last_active":"2023-11-18T20:38:01.373526+0000","last_peered":"2023-11-18T20:38:01.373526+0000","last_clean":"2023-11-18T20:38:01.373526+0000","last_became_active":"2023-11-18T20:37:59.156003+0000","last_became_peered":"2023-11-18T20:37:59.156003+0000","last_unstale":"2023-11-18T20:38:01.373526+0000","last_undegraded":"2023-11-18T20:38:01.373526+0000","last_fullsized":"2023-11-18T20:38:01.373526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870349+0000","last_change":"2023-11-18T20:37:59.182472+0000","last_active":"2023-11-18T20:38:01.870349+0000","last_peered":"2023-11-18T20:38:01.870349+0000","last_clean":"2023-11-18T20:38:01.870349+0000","last_became_active":"2023-11-18T20:37:59.182167+0000","last_became_peered":"2023-11-18T20:37:59.182167+0000","last_unstale":"2023-11-18T20:38:01.870349+0000","last_undegraded":"2023-11-18T20:38:01.870349+0000","last_fullsized":"2023-11-18T20:38:01.870349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189196+0000","last_change":"2023-11-18T20:37:58.158696+0000","last_active":"2023-11-18T20:37:59.189196+0000","last_peered":"2023-11-18T20:37:59.189196+0000","last_clean":"2023-11-18T20:37:59.189196+0000","last_became_active":"2023-11-18T20:37:58.158374+0000","last_became_peered":"2023-11-18T20:37:58.158374+0000","last_unstale":"2023-11-18T20:37:59.189196+0000","last_undegraded":"2023-11-18T20:37:59.189196+0000","last_fullsized":"2023-11-18T20:37:59.189196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:08.732817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176688+0000","last_change":"2023-11-18T20:37:59.171211+0000","last_active":"2023-11-18T20:38:00.176688+0000","last_peered":"2023-11-18T20:38:00.176688+0000","last_clean":"2023-11-18T20:38:00.176688+0000","last_became_active":"2023-11-18T20:37:59.170977+0000","last_became_peered":"2023-11-18T20:37:59.170977+0000","last_unstale":"2023-11-18T20:38:00.176688+0000","last_undegraded":"2023-11-18T20:38:00.176688+0000","last_fullsized":"2023-11-18T20:38:00.176688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:47.280214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190613+0000","last_change":"2023-11-18T20:37:58.170075+0000","last_active":"2023-11-18T20:37:59.190613+0000","last_peered":"2023-11-18T20:37:59.190613+0000","last_clean":"2023-11-18T20:37:59.190613+0000","last_became_active":"2023-11-18T20:37:58.169733+0000","last_became_peered":"2023-11-18T20:37:58.169733+0000","last_unstale":"2023-11-18T20:37:59.190613+0000","last_undegraded":"2023-11-18T20:37:59.190613+0000","last_fullsized":"2023-11-18T20:37:59.190613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:43:14.145500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.142761+0000","last_change":"2023-11-18T20:37:58.172306+0000","last_active":"2023-11-18T20:37:59.142761+0000","last_peered":"2023-11-18T20:37:59.142761+0000","last_clean":"2023-11-18T20:37:59.142761+0000","last_became_active":"2023-11-18T20:37:58.171954+0000","last_became_peered":"2023-11-18T20:37:58.171954+0000","last_unstale":"2023-11-18T20:37:59.142761+0000","last_undegraded":"2023-11-18T20:37:59.142761+0000","last_fullsized":"2023-11-18T20:37:59.142761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:30:15.515458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870314+0000","last_change":"2023-11-18T20:37:59.165306+0000","last_active":"2023-11-18T20:38:01.870314+0000","last_peered":"2023-11-18T20:38:01.870314+0000","last_clean":"2023-11-18T20:38:01.870314+0000","last_became_active":"2023-11-18T20:37:59.165035+0000","last_became_peered":"2023-11-18T20:37:59.165035+0000","last_unstale":"2023-11-18T20:38:01.870314+0000","last_undegraded":"2023-11-18T20:38:01.870314+0000","last_fullsized":"2023-11-18T20:38:01.870314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:26.137811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.149243+0000","last_change":"2023-11-18T20:37:58.164000+0000","last_active":"2023-11-18T20:37:59.149243+0000","last_peered":"2023-11-18T20:37:59.149243+0000","last_clean":"2023-11-18T20:37:59.149243+0000","last_became_active":"2023-11-18T20:37:58.163682+0000","last_became_peered":"2023-11-18T20:37:58.163682+0000","last_unstale":"2023-11-18T20:37:59.149243+0000","last_undegraded":"2023-11-18T20:37:59.149243+0000","last_fullsized":"2023-11-18T20:37:59.149243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:44.319234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176366+0000","last_change":"2023-11-18T20:37:59.168169+0000","last_active":"2023-11-18T20:38:00.176366+0000","last_peered":"2023-11-18T20:38:00.176366+0000","last_clean":"2023-11-18T20:38:00.176366+0000","last_became_active":"2023-11-18T20:37:59.167908+0000","last_became_peered":"2023-11-18T20:37:59.167908+0000","last_unstale":"2023-11-18T20:38:00.176366+0000","last_undegraded":"2023-11-18T20:38:00.176366+0000","last_fullsized":"2023-11-18T20:38:00.176366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:44.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.160095+0000","last_change":"2023-11-18T20:37:58.166557+0000","last_active":"2023-11-18T20:37:59.160095+0000","last_peered":"2023-11-18T20:37:59.160095+0000","last_clean":"2023-11-18T20:37:59.160095+0000","last_became_active":"2023-11-18T20:37:58.166295+0000","last_became_peered":"2023-11-18T20:37:58.166295+0000","last_unstale":"2023-11-18T20:37:59.160095+0000","last_undegraded":"2023-11-18T20:37:59.160095+0000","last_fullsized":"2023-11-18T20:37:59.160095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374829+0000","last_change":"2023-11-18T20:37:59.168548+0000","last_active":"2023-11-18T20:38:01.374829+0000","last_peered":"2023-11-18T20:38:01.374829+0000","last_clean":"2023-11-18T20:38:01.374829+0000","last_became_active":"2023-11-18T20:37:59.164088+0000","last_became_peered":"2023-11-18T20:37:59.164088+0000","last_unstale":"2023-11-18T20:38:01.374829+0000","last_undegraded":"2023-11-18T20:38:01.374829+0000","last_fullsized":"2023-11-18T20:38:01.374829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:04:39.108066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.161047+0000","last_change":"2023-11-18T20:37:58.157681+0000","last_active":"2023-11-18T20:37:59.161047+0000","last_peered":"2023-11-18T20:37:59.161047+0000","last_clean":"2023-11-18T20:37:59.161047+0000","last_became_active":"2023-11-18T20:37:58.157385+0000","last_became_peered":"2023-11-18T20:37:58.157385+0000","last_unstale":"2023-11-18T20:37:59.161047+0000","last_undegraded":"2023-11-18T20:37:59.161047+0000","last_fullsized":"2023-11-18T20:37:59.161047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:46.590457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871732+0000","last_change":"2023-11-18T20:37:59.173174+0000","last_active":"2023-11-18T20:38:01.871732+0000","last_peered":"2023-11-18T20:38:01.871732+0000","last_clean":"2023-11-18T20:38:01.871732+0000","last_became_active":"2023-11-18T20:37:59.172244+0000","last_became_peered":"2023-11-18T20:37:59.172244+0000","last_unstale":"2023-11-18T20:38:01.871732+0000","last_undegraded":"2023-11-18T20:38:01.871732+0000","last_fullsized":"2023-11-18T20:38:01.871732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:40.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.194185+0000","last_change":"2023-11-18T20:37:58.167812+0000","last_active":"2023-11-18T20:37:59.194185+0000","last_peered":"2023-11-18T20:37:59.194185+0000","last_clean":"2023-11-18T20:37:59.194185+0000","last_became_active":"2023-11-18T20:37:58.167312+0000","last_became_peered":"2023-11-18T20:37:58.167312+0000","last_unstale":"2023-11-18T20:37:59.194185+0000","last_undegraded":"2023-11-18T20:37:59.194185+0000","last_fullsized":"2023-11-18T20:37:59.194185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:28.447114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178044+0000","last_change":"2023-11-18T20:37:59.175489+0000","last_active":"2023-11-18T20:38:00.178044+0000","last_peered":"2023-11-18T20:38:00.178044+0000","last_clean":"2023-11-18T20:38:00.178044+0000","last_became_active":"2023-11-18T20:37:59.175234+0000","last_became_peered":"2023-11-18T20:37:59.175234+0000","last_unstale":"2023-11-18T20:38:00.178044+0000","last_undegraded":"2023-11-18T20:38:00.178044+0000","last_fullsized":"2023-11-18T20:38:00.178044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:19:55.270924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.196632+0000","last_change":"2023-11-18T20:37:58.169135+0000","last_active":"2023-11-18T20:37:59.196632+0000","last_peered":"2023-11-18T20:37:59.196632+0000","last_clean":"2023-11-18T20:37:59.196632+0000","last_became_active":"2023-11-18T20:37:58.168858+0000","last_became_peered":"2023-11-18T20:37:58.168858+0000","last_unstale":"2023-11-18T20:37:59.196632+0000","last_undegraded":"2023-11-18T20:37:59.196632+0000","last_fullsized":"2023-11-18T20:37:59.196632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:43.509370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866196+0000","last_change":"2023-11-18T20:37:59.166111+0000","last_active":"2023-11-18T20:38:00.866196+0000","last_peered":"2023-11-18T20:38:00.866196+0000","last_clean":"2023-11-18T20:38:00.866196+0000","last_became_active":"2023-11-18T20:37:59.165719+0000","last_became_peered":"2023-11-18T20:37:59.165719+0000","last_unstale":"2023-11-18T20:38:00.866196+0000","last_undegraded":"2023-11-18T20:38:00.866196+0000","last_fullsized":"2023-11-18T20:38:00.866196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:31.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.193497+0000","last_change":"2023-11-18T20:37:58.162763+0000","last_active":"2023-11-18T20:37:59.193497+0000","last_peered":"2023-11-18T20:37:59.193497+0000","last_clean":"2023-11-18T20:37:59.193497+0000","last_became_active":"2023-11-18T20:37:58.162392+0000","last_became_peered":"2023-11-18T20:37:58.162392+0000","last_unstale":"2023-11-18T20:37:59.193497+0000","last_undegraded":"2023-11-18T20:37:59.193497+0000","last_fullsized":"2023-11-18T20:37:59.193497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178818+0000","last_change":"2023-11-18T20:37:59.165551+0000","last_active":"2023-11-18T20:38:00.178818+0000","last_peered":"2023-11-18T20:38:00.178818+0000","last_clean":"2023-11-18T20:38:00.178818+0000","last_became_active":"2023-11-18T20:37:59.163366+0000","last_became_peered":"2023-11-18T20:37:59.163366+0000","last_unstale":"2023-11-18T20:38:00.178818+0000","last_undegraded":"2023-11-18T20:38:00.178818+0000","last_fullsized":"2023-11-18T20:38:00.178818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:01.609933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.151545+0000","last_change":"2023-11-18T20:37:58.170692+0000","last_active":"2023-11-18T20:37:59.151545+0000","last_peered":"2023-11-18T20:37:59.151545+0000","last_clean":"2023-11-18T20:37:59.151545+0000","last_became_active":"2023-11-18T20:37:58.170367+0000","last_became_peered":"2023-11-18T20:37:58.170367+0000","last_unstale":"2023-11-18T20:37:59.151545+0000","last_undegraded":"2023-11-18T20:37:59.151545+0000","last_fullsized":"2023-11-18T20:37:59.151545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:55:39.975062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177661+0000","last_change":"2023-11-18T20:37:59.183248+0000","last_active":"2023-11-18T20:38:00.177661+0000","last_peered":"2023-11-18T20:38:00.177661+0000","last_clean":"2023-11-18T20:38:00.177661+0000","last_became_active":"2023-11-18T20:37:59.182319+0000","last_became_peered":"2023-11-18T20:37:59.182319+0000","last_unstale":"2023-11-18T20:38:00.177661+0000","last_undegraded":"2023-11-18T20:38:00.177661+0000","last_fullsized":"2023-11-18T20:38:00.177661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:14.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.147170+0000","last_change":"2023-11-18T20:37:58.168153+0000","last_active":"2023-11-18T20:37:59.147170+0000","last_peered":"2023-11-18T20:37:59.147170+0000","last_clean":"2023-11-18T20:37:59.147170+0000","last_became_active":"2023-11-18T20:37:58.165711+0000","last_became_peered":"2023-11-18T20:37:58.165711+0000","last_unstale":"2023-11-18T20:37:59.147170+0000","last_undegraded":"2023-11-18T20:37:59.147170+0000","last_fullsized":"2023-11-18T20:37:59.147170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:52:59.215314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.869868+0000","last_change":"2023-11-18T20:37:59.180171+0000","last_active":"2023-11-18T20:38:01.869868+0000","last_peered":"2023-11-18T20:38:01.869868+0000","last_clean":"2023-11-18T20:38:01.869868+0000","last_became_active":"2023-11-18T20:37:59.179858+0000","last_became_peered":"2023-11-18T20:37:59.179858+0000","last_unstale":"2023-11-18T20:38:01.869868+0000","last_undegraded":"2023-11-18T20:38:01.869868+0000","last_fullsized":"2023-11-18T20:38:01.869868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:00.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.194143+0000","last_change":"2023-11-18T20:37:58.162399+0000","last_active":"2023-11-18T20:37:59.194143+0000","last_peered":"2023-11-18T20:37:59.194143+0000","last_clean":"2023-11-18T20:37:59.194143+0000","last_became_active":"2023-11-18T20:37:58.161728+0000","last_became_peered":"2023-11-18T20:37:58.161728+0000","last_unstale":"2023-11-18T20:37:59.194143+0000","last_undegraded":"2023-11-18T20:37:59.194143+0000","last_fullsized":"2023-11-18T20:37:59.194143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177729+0000","last_change":"2023-11-18T20:37:59.176781+0000","last_active":"2023-11-18T20:38:00.177729+0000","last_peered":"2023-11-18T20:38:00.177729+0000","last_clean":"2023-11-18T20:38:00.177729+0000","last_became_active":"2023-11-18T20:37:59.176177+0000","last_became_peered":"2023-11-18T20:37:59.176177+0000","last_unstale":"2023-11-18T20:38:00.177729+0000","last_undegraded":"2023-11-18T20:38:00.177729+0000","last_fullsized":"2023-11-18T20:38:00.177729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:40:24.771147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190289+0000","last_change":"2023-11-18T20:37:58.162267+0000","last_active":"2023-11-18T20:37:59.190289+0000","last_peered":"2023-11-18T20:37:59.190289+0000","last_clean":"2023-11-18T20:37:59.190289+0000","last_became_active":"2023-11-18T20:37:58.161948+0000","last_became_peered":"2023-11-18T20:37:58.161948+0000","last_unstale":"2023-11-18T20:37:59.190289+0000","last_undegraded":"2023-11-18T20:37:59.190289+0000","last_fullsized":"2023-11-18T20:37:59.190289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:08.418442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374826+0000","last_change":"2023-11-18T20:37:59.173619+0000","last_active":"2023-11-18T20:38:01.374826+0000","last_peered":"2023-11-18T20:38:01.374826+0000","last_clean":"2023-11-18T20:38:01.374826+0000","last_became_active":"2023-11-18T20:37:59.173303+0000","last_became_peered":"2023-11-18T20:37:59.173303+0000","last_unstale":"2023-11-18T20:38:01.374826+0000","last_undegraded":"2023-11-18T20:38:01.374826+0000","last_fullsized":"2023-11-18T20:38:01.374826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:00.673685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189711+0000","last_change":"2023-11-18T20:37:58.163432+0000","last_active":"2023-11-18T20:37:59.189711+0000","last_peered":"2023-11-18T20:37:59.189711+0000","last_clean":"2023-11-18T20:37:59.189711+0000","last_became_active":"2023-11-18T20:37:58.163136+0000","last_became_peered":"2023-11-18T20:37:58.163136+0000","last_unstale":"2023-11-18T20:37:59.189711+0000","last_undegraded":"2023-11-18T20:37:59.189711+0000","last_fullsized":"2023-11-18T20:37:59.189711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:02.758344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866722+0000","last_change":"2023-11-18T20:37:59.173529+0000","last_active":"2023-11-18T20:38:00.866722+0000","last_peered":"2023-11-18T20:38:00.866722+0000","last_clean":"2023-11-18T20:38:00.866722+0000","last_became_active":"2023-11-18T20:37:59.173236+0000","last_became_peered":"2023-11-18T20:37:59.173236+0000","last_unstale":"2023-11-18T20:38:00.866722+0000","last_undegraded":"2023-11-18T20:38:00.866722+0000","last_fullsized":"2023-11-18T20:38:00.866722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:56.471403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190765+0000","last_change":"2023-11-18T20:37:58.155736+0000","last_active":"2023-11-18T20:37:59.190765+0000","last_peered":"2023-11-18T20:37:59.190765+0000","last_clean":"2023-11-18T20:37:59.190765+0000","last_became_active":"2023-11-18T20:37:58.155358+0000","last_became_peered":"2023-11-18T20:37:58.155358+0000","last_unstale":"2023-11-18T20:37:59.190765+0000","last_undegraded":"2023-11-18T20:37:59.190765+0000","last_fullsized":"2023-11-18T20:37:59.190765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:08.418442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866947+0000","last_change":"2023-11-18T20:37:59.180009+0000","last_active":"2023-11-18T20:38:00.866947+0000","last_peered":"2023-11-18T20:38:00.866947+0000","last_clean":"2023-11-18T20:38:00.866947+0000","last_became_active":"2023-11-18T20:37:59.179749+0000","last_became_peered":"2023-11-18T20:37:59.179749+0000","last_unstale":"2023-11-18T20:38:00.866947+0000","last_undegraded":"2023-11-18T20:38:00.866947+0000","last_fullsized":"2023-11-18T20:38:00.866947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:32:26.758536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.147372+0000","last_change":"2023-11-18T20:37:58.172930+0000","last_active":"2023-11-18T20:37:59.147372+0000","last_peered":"2023-11-18T20:37:59.147372+0000","last_clean":"2023-11-18T20:37:59.147372+0000","last_became_active":"2023-11-18T20:37:58.172547+0000","last_became_peered":"2023-11-18T20:37:58.172547+0000","last_unstale":"2023-11-18T20:37:59.147372+0000","last_undegraded":"2023-11-18T20:37:59.147372+0000","last_fullsized":"2023-11-18T20:37:59.147372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:53.514145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178371+0000","last_change":"2023-11-18T20:37:59.170278+0000","last_active":"2023-11-18T20:38:00.178371+0000","last_peered":"2023-11-18T20:38:00.178371+0000","last_clean":"2023-11-18T20:38:00.178371+0000","last_became_active":"2023-11-18T20:37:59.169600+0000","last_became_peered":"2023-11-18T20:37:59.169600+0000","last_unstale":"2023-11-18T20:38:00.178371+0000","last_undegraded":"2023-11-18T20:38:00.178371+0000","last_fullsized":"2023-11-18T20:38:00.178371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:58.745666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.151129+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:37:59.151129+0000","last_peered":"2023-11-18T20:37:59.151129+0000","last_clean":"2023-11-18T20:37:59.151129+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:37:59.151129+0000","last_undegraded":"2023-11-18T20:37:59.151129+0000","last_fullsized":"2023-11-18T20:37:59.151129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.163203+0000","last_change":"2023-11-18T20:37:58.169197+0000","last_active":"2023-11-18T20:37:59.163203+0000","last_peered":"2023-11-18T20:37:59.163203+0000","last_clean":"2023-11-18T20:37:59.163203+0000","last_became_active":"2023-11-18T20:37:58.167753+0000","last_became_peered":"2023-11-18T20:37:58.167753+0000","last_unstale":"2023-11-18T20:37:59.163203+0000","last_undegraded":"2023-11-18T20:37:59.163203+0000","last_fullsized":"2023-11-18T20:37:59.163203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:53:19.905517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.175901+0000","last_change":"2023-11-18T20:37:59.161310+0000","last_active":"2023-11-18T20:38:00.175901+0000","last_peered":"2023-11-18T20:38:00.175901+0000","last_clean":"2023-11-18T20:38:00.175901+0000","last_became_active":"2023-11-18T20:37:59.160573+0000","last_became_peered":"2023-11-18T20:37:59.160573+0000","last_unstale":"2023-11-18T20:38:00.175901+0000","last_undegraded":"2023-11-18T20:38:00.175901+0000","last_fullsized":"2023-11-18T20:38:00.175901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.748224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.149589+0000","last_change":"2023-11-18T20:37:58.164074+0000","last_active":"2023-11-18T20:37:59.149589+0000","last_peered":"2023-11-18T20:37:59.149589+0000","last_clean":"2023-11-18T20:37:59.149589+0000","last_became_active":"2023-11-18T20:37:58.163736+0000","last_became_peered":"2023-11-18T20:37:58.163736+0000","last_unstale":"2023-11-18T20:37:59.149589+0000","last_undegraded":"2023-11-18T20:37:59.149589+0000","last_fullsized":"2023-11-18T20:37:59.149589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:34.608711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178613+0000","last_change":"2023-11-18T20:37:59.159340+0000","last_active":"2023-11-18T20:38:00.178613+0000","last_peered":"2023-11-18T20:38:00.178613+0000","last_clean":"2023-11-18T20:38:00.178613+0000","last_became_active":"2023-11-18T20:37:59.157840+0000","last_became_peered":"2023-11-18T20:37:59.157840+0000","last_unstale":"2023-11-18T20:38:00.178613+0000","last_undegraded":"2023-11-18T20:38:00.178613+0000","last_fullsized":"2023-11-18T20:38:00.178613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:45.334641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.154943+0000","last_change":"2023-11-18T20:37:58.162360+0000","last_active":"2023-11-18T20:37:59.154943+0000","last_peered":"2023-11-18T20:37:59.154943+0000","last_clean":"2023-11-18T20:37:59.154943+0000","last_became_active":"2023-11-18T20:37:58.161032+0000","last_became_peered":"2023-11-18T20:37:58.161032+0000","last_unstale":"2023-11-18T20:37:59.154943+0000","last_undegraded":"2023-11-18T20:37:59.154943+0000","last_fullsized":"2023-11-18T20:37:59.154943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:22.310204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870267+0000","last_change":"2023-11-18T20:37:59.184190+0000","last_active":"2023-11-18T20:38:01.870267+0000","last_peered":"2023-11-18T20:38:01.870267+0000","last_clean":"2023-11-18T20:38:01.870267+0000","last_became_active":"2023-11-18T20:37:59.183849+0000","last_became_peered":"2023-11-18T20:37:59.183849+0000","last_unstale":"2023-11-18T20:38:01.870267+0000","last_undegraded":"2023-11-18T20:38:01.870267+0000","last_fullsized":"2023-11-18T20:38:01.870267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:47.280214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.152253+0000","last_change":"2023-11-18T20:37:58.170185+0000","last_active":"2023-11-18T20:37:59.152253+0000","last_peered":"2023-11-18T20:37:59.152253+0000","last_clean":"2023-11-18T20:37:59.152253+0000","last_became_active":"2023-11-18T20:37:58.169816+0000","last_became_peered":"2023-11-18T20:37:58.169816+0000","last_unstale":"2023-11-18T20:37:59.152253+0000","last_undegraded":"2023-11-18T20:37:59.152253+0000","last_fullsized":"2023-11-18T20:37:59.152253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:08.127960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866620+0000","last_change":"2023-11-18T20:37:59.174808+0000","last_active":"2023-11-18T20:38:00.866620+0000","last_peered":"2023-11-18T20:38:00.866620+0000","last_clean":"2023-11-18T20:38:00.866620+0000","last_became_active":"2023-11-18T20:37:59.174514+0000","last_became_peered":"2023-11-18T20:37:59.174514+0000","last_unstale":"2023-11-18T20:38:00.866620+0000","last_undegraded":"2023-11-18T20:38:00.866620+0000","last_fullsized":"2023-11-18T20:38:00.866620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:38.185159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.169106+0000","last_change":"2023-11-18T20:37:58.166623+0000","last_active":"2023-11-18T20:37:59.169106+0000","last_peered":"2023-11-18T20:37:59.169106+0000","last_clean":"2023-11-18T20:37:59.169106+0000","last_became_active":"2023-11-18T20:37:58.166264+0000","last_became_peered":"2023-11-18T20:37:58.166264+0000","last_unstale":"2023-11-18T20:37:59.169106+0000","last_undegraded":"2023-11-18T20:37:59.169106+0000","last_fullsized":"2023-11-18T20:37:59.169106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:50.825296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374320+0000","last_change":"2023-11-18T20:37:59.155770+0000","last_active":"2023-11-18T20:38:01.374320+0000","last_peered":"2023-11-18T20:38:01.374320+0000","last_clean":"2023-11-18T20:38:01.374320+0000","last_became_active":"2023-11-18T20:37:59.153043+0000","last_became_peered":"2023-11-18T20:37:59.153043+0000","last_unstale":"2023-11-18T20:38:01.374320+0000","last_undegraded":"2023-11-18T20:38:01.374320+0000","last_fullsized":"2023-11-18T20:38:01.374320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:03.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.165053+0000","last_change":"2023-11-18T20:37:58.171460+0000","last_active":"2023-11-18T20:37:59.165053+0000","last_peered":"2023-11-18T20:37:59.165053+0000","last_clean":"2023-11-18T20:37:59.165053+0000","last_became_active":"2023-11-18T20:37:58.171098+0000","last_became_peered":"2023-11-18T20:37:58.171098+0000","last_unstale":"2023-11-18T20:37:59.165053+0000","last_undegraded":"2023-11-18T20:37:59.165053+0000","last_fullsized":"2023-11-18T20:37:59.165053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:03.237240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179244+0000","last_change":"2023-11-18T20:37:59.185324+0000","last_active":"2023-11-18T20:38:00.179244+0000","last_peered":"2023-11-18T20:38:00.179244+0000","last_clean":"2023-11-18T20:38:00.179244+0000","last_became_active":"2023-11-18T20:37:59.184874+0000","last_became_peered":"2023-11-18T20:37:59.184874+0000","last_unstale":"2023-11-18T20:38:00.179244+0000","last_undegraded":"2023-11-18T20:38:00.179244+0000","last_fullsized":"2023-11-18T20:38:00.179244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:09.143367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177185+0000","last_change":"2023-11-18T20:37:58.172192+0000","last_active":"2023-11-18T20:38:00.177185+0000","last_peered":"2023-11-18T20:38:00.177185+0000","last_clean":"2023-11-18T20:38:00.177185+0000","last_became_active":"2023-11-18T20:37:58.171909+0000","last_became_peered":"2023-11-18T20:37:58.171909+0000","last_unstale":"2023-11-18T20:38:00.177185+0000","last_undegraded":"2023-11-18T20:38:00.177185+0000","last_fullsized":"2023-11-18T20:38:00.177185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.052630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176507+0000","last_change":"2023-11-18T20:37:59.156794+0000","last_active":"2023-11-18T20:38:00.176507+0000","last_peered":"2023-11-18T20:38:00.176507+0000","last_clean":"2023-11-18T20:38:00.176507+0000","last_became_active":"2023-11-18T20:37:59.156240+0000","last_became_peered":"2023-11-18T20:37:59.156240+0000","last_unstale":"2023-11-18T20:38:00.176507+0000","last_undegraded":"2023-11-18T20:38:00.176507+0000","last_fullsized":"2023-11-18T20:38:00.176507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:47.605864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190149+0000","last_change":"2023-11-18T20:37:58.172619+0000","last_active":"2023-11-18T20:37:59.190149+0000","last_peered":"2023-11-18T20:37:59.190149+0000","last_clean":"2023-11-18T20:37:59.190149+0000","last_became_active":"2023-11-18T20:37:58.172348+0000","last_became_peered":"2023-11-18T20:37:58.172348+0000","last_unstale":"2023-11-18T20:37:59.190149+0000","last_undegraded":"2023-11-18T20:37:59.190149+0000","last_fullsized":"2023-11-18T20:37:59.190149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:50.652943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177039+0000","last_change":"2023-11-18T20:37:59.163153+0000","last_active":"2023-11-18T20:38:00.177039+0000","last_peered":"2023-11-18T20:38:00.177039+0000","last_clean":"2023-11-18T20:38:00.177039+0000","last_became_active":"2023-11-18T20:37:59.162808+0000","last_became_peered":"2023-11-18T20:37:59.162808+0000","last_unstale":"2023-11-18T20:38:00.177039+0000","last_undegraded":"2023-11-18T20:38:00.177039+0000","last_fullsized":"2023-11-18T20:38:00.177039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:26:52.692005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.146031+0000","last_change":"2023-11-18T20:37:58.159754+0000","last_active":"2023-11-18T20:37:59.146031+0000","last_peered":"2023-11-18T20:37:59.146031+0000","last_clean":"2023-11-18T20:37:59.146031+0000","last_became_active":"2023-11-18T20:37:58.159469+0000","last_became_peered":"2023-11-18T20:37:58.159469+0000","last_unstale":"2023-11-18T20:37:59.146031+0000","last_undegraded":"2023-11-18T20:37:59.146031+0000","last_fullsized":"2023-11-18T20:37:59.146031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177843+0000","last_change":"2023-11-18T20:37:59.167253+0000","last_active":"2023-11-18T20:38:00.177843+0000","last_peered":"2023-11-18T20:38:00.177843+0000","last_clean":"2023-11-18T20:38:00.177843+0000","last_became_active":"2023-11-18T20:37:59.166946+0000","last_became_peered":"2023-11-18T20:37:59.166946+0000","last_unstale":"2023-11-18T20:38:00.177843+0000","last_undegraded":"2023-11-18T20:38:00.177843+0000","last_fullsized":"2023-11-18T20:38:00.177843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:26:48.310102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.150750+0000","last_change":"2023-11-18T20:37:58.168664+0000","last_active":"2023-11-18T20:37:59.150750+0000","last_peered":"2023-11-18T20:37:59.150750+0000","last_clean":"2023-11-18T20:37:59.150750+0000","last_became_active":"2023-11-18T20:37:58.167672+0000","last_became_peered":"2023-11-18T20:37:58.167672+0000","last_unstale":"2023-11-18T20:37:59.150750+0000","last_undegraded":"2023-11-18T20:37:59.150750+0000","last_fullsized":"2023-11-18T20:37:59.150750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:04:38.092659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.175604+0000","last_change":"2023-11-18T20:37:59.167864+0000","last_active":"2023-11-18T20:38:00.175604+0000","last_peered":"2023-11-18T20:38:00.175604+0000","last_clean":"2023-11-18T20:38:00.175604+0000","last_became_active":"2023-11-18T20:37:59.167604+0000","last_became_peered":"2023-11-18T20:37:59.167604+0000","last_unstale":"2023-11-18T20:38:00.175604+0000","last_undegraded":"2023-11-18T20:38:00.175604+0000","last_fullsized":"2023-11-18T20:38:00.175604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:38.365782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.141993+0000","last_change":"2023-11-18T20:37:58.163771+0000","last_active":"2023-11-18T20:37:59.141993+0000","last_peered":"2023-11-18T20:37:59.141993+0000","last_clean":"2023-11-18T20:37:59.141993+0000","last_became_active":"2023-11-18T20:37:58.156832+0000","last_became_peered":"2023-11-18T20:37:58.156832+0000","last_unstale":"2023-11-18T20:37:59.141993+0000","last_undegraded":"2023-11-18T20:37:59.141993+0000","last_fullsized":"2023-11-18T20:37:59.141993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:50:00.581467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.440110+0000","last_change":"2023-11-18T20:37:59.168936+0000","last_active":"2023-11-18T20:38:00.440110+0000","last_peered":"2023-11-18T20:38:00.440110+0000","last_clean":"2023-11-18T20:38:00.440110+0000","last_became_active":"2023-11-18T20:37:59.168646+0000","last_became_peered":"2023-11-18T20:37:59.168646+0000","last_unstale":"2023-11-18T20:38:00.440110+0000","last_undegraded":"2023-11-18T20:38:00.440110+0000","last_fullsized":"2023-11-18T20:38:00.440110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190819+0000","last_change":"2023-11-18T20:37:58.167173+0000","last_active":"2023-11-18T20:37:59.190819+0000","last_peered":"2023-11-18T20:37:59.190819+0000","last_clean":"2023-11-18T20:37:59.190819+0000","last_became_active":"2023-11-18T20:37:58.166871+0000","last_became_peered":"2023-11-18T20:37:58.166871+0000","last_unstale":"2023-11-18T20:37:59.190819+0000","last_undegraded":"2023-11-18T20:37:59.190819+0000","last_fullsized":"2023-11-18T20:37:59.190819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:16:18.678055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178247+0000","last_change":"2023-11-18T20:37:59.174211+0000","last_active":"2023-11-18T20:38:00.178247+0000","last_peered":"2023-11-18T20:38:00.178247+0000","last_clean":"2023-11-18T20:38:00.178247+0000","last_became_active":"2023-11-18T20:37:59.173927+0000","last_became_peered":"2023-11-18T20:37:59.173927+0000","last_unstale":"2023-11-18T20:38:00.178247+0000","last_undegraded":"2023-11-18T20:38:00.178247+0000","last_fullsized":"2023-11-18T20:38:00.178247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:13.326666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178272+0000","last_change":"2023-11-18T20:37:59.178202+0000","last_active":"2023-11-18T20:38:00.178272+0000","last_peered":"2023-11-18T20:38:00.178272+0000","last_clean":"2023-11-18T20:38:00.178272+0000","last_became_active":"2023-11-18T20:37:59.177947+0000","last_became_peered":"2023-11-18T20:37:59.177947+0000","last_unstale":"2023-11-18T20:38:00.178272+0000","last_undegraded":"2023-11-18T20:38:00.178272+0000","last_fullsized":"2023-11-18T20:38:00.178272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:09.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.191381+0000","last_change":"2023-11-18T20:37:58.158604+0000","last_active":"2023-11-18T20:37:59.191381+0000","last_peered":"2023-11-18T20:37:59.191381+0000","last_clean":"2023-11-18T20:37:59.191381+0000","last_became_active":"2023-11-18T20:37:58.158146+0000","last_became_peered":"2023-11-18T20:37:58.158146+0000","last_unstale":"2023-11-18T20:37:59.191381+0000","last_undegraded":"2023-11-18T20:37:59.191381+0000","last_fullsized":"2023-11-18T20:37:59.191381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:46.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870315+0000","last_change":"2023-11-18T20:37:59.172487+0000","last_active":"2023-11-18T20:38:01.870315+0000","last_peered":"2023-11-18T20:38:01.870315+0000","last_clean":"2023-11-18T20:38:01.870315+0000","last_became_active":"2023-11-18T20:37:59.172038+0000","last_became_peered":"2023-11-18T20:37:59.172038+0000","last_unstale":"2023-11-18T20:38:01.870315+0000","last_undegraded":"2023-11-18T20:38:01.870315+0000","last_fullsized":"2023-11-18T20:38:01.870315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190640+0000","last_change":"2023-11-18T20:37:58.158747+0000","last_active":"2023-11-18T20:37:59.190640+0000","last_peered":"2023-11-18T20:37:59.190640+0000","last_clean":"2023-11-18T20:37:59.190640+0000","last_became_active":"2023-11-18T20:37:58.156086+0000","last_became_peered":"2023-11-18T20:37:58.156086+0000","last_unstale":"2023-11-18T20:37:59.190640+0000","last_undegraded":"2023-11-18T20:37:59.190640+0000","last_fullsized":"2023-11-18T20:37:59.190640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.052630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871489+0000","last_change":"2023-11-18T20:37:59.173339+0000","last_active":"2023-11-18T20:38:01.871489+0000","last_peered":"2023-11-18T20:38:01.871489+0000","last_clean":"2023-11-18T20:38:01.871489+0000","last_became_active":"2023-11-18T20:37:59.172593+0000","last_became_peered":"2023-11-18T20:37:59.172593+0000","last_unstale":"2023-11-18T20:38:01.871489+0000","last_undegraded":"2023-11-18T20:38:01.871489+0000","last_fullsized":"2023-11-18T20:38:01.871489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:38.185159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189386+0000","last_change":"2023-11-18T20:37:58.157777+0000","last_active":"2023-11-18T20:37:59.189386+0000","last_peered":"2023-11-18T20:37:59.189386+0000","last_clean":"2023-11-18T20:37:59.189386+0000","last_became_active":"2023-11-18T20:37:58.156090+0000","last_became_peered":"2023-11-18T20:37:58.156090+0000","last_unstale":"2023-11-18T20:37:59.189386+0000","last_undegraded":"2023-11-18T20:37:59.189386+0000","last_fullsized":"2023-11-18T20:37:59.189386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:37.350375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871355+0000","last_change":"2023-11-18T20:37:59.180531+0000","last_active":"2023-11-18T20:38:01.871355+0000","last_peered":"2023-11-18T20:38:01.871355+0000","last_clean":"2023-11-18T20:38:01.871355+0000","last_became_active":"2023-11-18T20:37:59.177897+0000","last_became_peered":"2023-11-18T20:37:59.177897+0000","last_unstale":"2023-11-18T20:38:01.871355+0000","last_undegraded":"2023-11-18T20:38:01.871355+0000","last_fullsized":"2023-11-18T20:38:01.871355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:13.243273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190088+0000","last_change":"2023-11-18T20:37:58.168566+0000","last_active":"2023-11-18T20:37:59.190088+0000","last_peered":"2023-11-18T20:37:59.190088+0000","last_clean":"2023-11-18T20:37:59.190088+0000","last_became_active":"2023-11-18T20:37:58.168250+0000","last_became_peered":"2023-11-18T20:37:58.168250+0000","last_unstale":"2023-11-18T20:37:59.190088+0000","last_undegraded":"2023-11-18T20:37:59.190088+0000","last_fullsized":"2023-11-18T20:37:59.190088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:21:59.658278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":74131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":664591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.74}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":74713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.633}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":664569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:38:09.024 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T20:38:09.024 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-18T20:38:09.024 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-18T20:38:09.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-18T20:38:09.025 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-18T20:38:09.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.274+0000 7f6d7c9d2640 1 Processor -- start 2023-11-18T20:38:09.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.274+0000 7f6d7c9d2640 1 -- start start 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.275+0000 7f6d7c9d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6d7814c2e0 0x7f6d780c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.275+0000 7f6d7c9d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6d78072310 0x7f6d780a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.275+0000 7f6d7c9d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d78071e80 con 0x7f6d780c0440 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.275+0000 7f6d7c9d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d78071470 con 0x7f6d78072310 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.275+0000 7f6d7c9d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7814c6c0 con 0x7f6d7814c2e0 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.276+0000 7f6d77fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6d78072310 0x7f6d780a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.276+0000 7f6d77fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6d78072310 0x7f6d780a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57598/0 (socket says 172.21.15.132:57598) 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.276+0000 7f6d77fff640 1 -- 172.21.15.132:0/3414145341 learned_addr learned my addr 172.21.15.132:0/3414145341 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:09.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.276+0000 7f6d77fff640 1 -- 172.21.15.132:0/3414145341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6d7814c2e0 msgr2=0x7f6d780c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.276+0000 7f6d77fff640 1 --2- 172.21.15.132:0/3414145341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6d7814c2e0 0x7f6d780c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.276+0000 7f6d77fff640 1 -- 172.21.15.132:0/3414145341 >> v1:172.21.15.161:6789/0 conn(0x7f6d780c0440 legacy=0x7f6d78152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.276+0000 7f6d77fff640 1 -- 172.21.15.132:0/3414145341 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7806fdc0 con 0x7f6d78072310 2023-11-18T20:38:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.277+0000 7f6d77fff640 1 --2- 172.21.15.132:0/3414145341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d78072310 0x7f6d780a4d20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009e50 tx=0x7f6d7002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0764a1d6a24cdf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.277+0000 7f6d76ffd640 1 -- 172.21.15.132:0/3414145341 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7002c950 con 0x7f6d78072310 2023-11-18T20:38:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.277+0000 7f6d76ffd640 1 -- 172.21.15.132:0/3414145341 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7002cab0 con 0x7f6d78072310 2023-11-18T20:38:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.277+0000 7f6d76ffd640 1 -- 172.21.15.132:0/3414145341 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7002ce40 con 0x7f6d78072310 2023-11-18T20:38:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.278+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/3414145341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d78072310 msgr2=0x7f6d780a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.278+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/3414145341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d78072310 0x7f6d780a4d20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009e50 tx=0x7f6d7002bdb0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.278+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/3414145341 shutdown_connections 2023-11-18T20:38:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.278+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/3414145341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d78072310 0x7f6d780a4d20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.278+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/3414145341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6d7814c2e0 0x7f6d780c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.278+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/3414145341 >> 172.21.15.132:0/3414145341 conn(0x7f6d780a77f0 msgr2=0x7f6d780a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.278+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/3414145341 shutdown_connections 2023-11-18T20:38:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.278+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/3414145341 wait complete. 2023-11-18T20:38:09.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.280+0000 7f6d7c9d2640 1 Processor -- start 2023-11-18T20:38:09.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.280+0000 7f6d7c9d2640 1 -- start start 2023-11-18T20:38:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d7c9d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d78072310 0x7f6d78152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d7c9d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d780c0440 0x7f6d78155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d7c9d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6d7814c2e0 0x7f6d78144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d7c9d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780a8da0 con 0x7f6d780c0440 2023-11-18T20:38:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d7c9d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781eb3a0 con 0x7f6d78072310 2023-11-18T20:38:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d7c9d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781eb680 con 0x7f6d7814c2e0 2023-11-18T20:38:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d6ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d780c0440 0x7f6d78155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d6ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d780c0440 0x7f6d78155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57604/0 (socket says 172.21.15.132:57604) 2023-11-18T20:38:09.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d6ffff640 1 -- 172.21.15.132:0/2973309869 learned_addr learned my addr 172.21.15.132:0/2973309869 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:09.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d777fe640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d78072310 0x7f6d78152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d6ffff640 1 -- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6d7814c2e0 msgr2=0x7f6d78144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d6ffff640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6d7814c2e0 0x7f6d78144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.281+0000 7f6d6ffff640 1 -- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d78072310 msgr2=0x7f6d78152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d6ffff640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d78072310 0x7f6d78152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d6ffff640 1 -- 172.21.15.132:0/2973309869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70009b30 con 0x7f6d780c0440 2023-11-18T20:38:09.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d777fe640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d78072310 0x7f6d78152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:09.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d6ffff640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d780c0440 0x7f6d78155d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000c430 tx=0x7f6d6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:09.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d74ff9640 1 -- 172.21.15.132:0/2973309869 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60011790 con 0x7f6d780c0440 2023-11-18T20:38:09.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d74ff9640 1 -- 172.21.15.132:0/2973309869 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d600118f0 con 0x7f6d780c0440 2023-11-18T20:38:09.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d74ff9640 1 -- 172.21.15.132:0/2973309869 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60011ce0 con 0x7f6d780c0440 2023-11-18T20:38:09.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d781eb960 con 0x7f6d780c0440 2023-11-18T20:38:09.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.282+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d781562c0 con 0x7f6d780c0440 2023-11-18T20:38:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.283+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d780a8f10 con 0x7f6d780c0440 2023-11-18T20:38:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.284+0000 7f6d74ff9640 1 -- 172.21.15.132:0/2973309869 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d6001c460 con 0x7f6d780c0440 2023-11-18T20:38:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.285+0000 7f6d74ff9640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6d5806ae40 0x7f6d5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.285+0000 7f6d74ff9640 1 -- 172.21.15.132:0/2973309869 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d60089660 con 0x7f6d780c0440 2023-11-18T20:38:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.286+0000 7f6d777fe640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6d5806ae40 0x7f6d5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.286+0000 7f6d777fe640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6d5806ae40 0x7f6d5806d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800a870 tx=0x7f6d68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.290+0000 7f6d74ff9640 1 -- 172.21.15.132:0/2973309869 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d60054670 con 0x7f6d780c0440 2023-11-18T20:38:09.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.512+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6d7804e840 con 0x7f6d780c0440 2023-11-18T20:38:09.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.517+0000 7f6d74ff9640 1 -- 172.21.15.132:0/2973309869 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171036 (secure 0 0 0) 0x7f6d60057c90 con 0x7f6d780c0440 2023-11-18T20:38:09.520 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6d5806ae40 msgr2=0x7f6d5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6d5806ae40 0x7f6d5806d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800a870 tx=0x7f6d68008040 comp rx=0 tx=0).stop 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d780c0440 msgr2=0x7f6d78155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d780c0440 0x7f6d78155d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000c430 tx=0x7f6d6000c8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 shutdown_connections 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6d5806ae40 0x7f6d5806d300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6d7814c2e0 0x7f6d78144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d780c0440 0x7f6d78155d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 --2- 172.21.15.132:0/2973309869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d78072310 0x7f6d78152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.520+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 >> 172.21.15.132:0/2973309869 conn(0x7f6d780a77f0 msgr2=0x7f6d7814b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:09.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.521+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 shutdown_connections 2023-11-18T20:38:09.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.521+0000 7f6d7c9d2640 1 -- 172.21.15.132:0/2973309869 wait complete. 2023-11-18T20:38:09.538 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3584581377},{"type":"v1","addr":"172.21.15.161:6833","nonce":3584581377}]},"active_addr":"172.21.15.161:6833/3584581377","active_change":"2023-11-18T20:37:44.603724+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1774681217}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":219110706}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":683585230}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":726170412}]}]} 2023-11-18T20:38:09.542 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-18T20:38:09.542 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-18T20:38:09.542 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.751+0000 7f421e86d640 1 Processor -- start 2023-11-18T20:38:09.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.751+0000 7f421e86d640 1 -- start start 2023-11-18T20:38:09.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.753+0000 7f421e86d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4218151bc0 0x7f42180c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.753+0000 7f421e86d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f42180c4bc0 0x7f421806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.753+0000 7f421e86d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4218154660 con 0x7f42180c4740 2023-11-18T20:38:09.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.753+0000 7f421e86d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4218151fa0 con 0x7f42180c4bc0 2023-11-18T20:38:09.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.753+0000 7f421e86d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180c5010 con 0x7f4218151bc0 2023-11-18T20:38:09.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.753+0000 7f421d86b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4218151bc0 0x7f42180c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.754+0000 7f421d86b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4218151bc0 0x7f42180c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:47950/0 (socket says 172.21.15.132:47950) 2023-11-18T20:38:09.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.754+0000 7f421d86b640 1 -- 172.21.15.132:0/1152130770 learned_addr learned my addr 172.21.15.132:0/1152130770 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.754+0000 7f421e06c640 1 --2- 172.21.15.132:0/1152130770 >> v2:172.21.15.161:3300/0 conn(0x7f42180c4bc0 0x7f421806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.754+0000 7f421d86b640 1 -- 172.21.15.132:0/1152130770 >> v2:172.21.15.161:3300/0 conn(0x7f42180c4bc0 msgr2=0x7f421806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.754+0000 7f421d86b640 1 --2- 172.21.15.132:0/1152130770 >> v2:172.21.15.161:3300/0 conn(0x7f42180c4bc0 0x7f421806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.754+0000 7f421d86b640 1 -- 172.21.15.132:0/1152130770 >> v1:172.21.15.161:6789/0 conn(0x7f42180c4740 legacy=0x7f421806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.754+0000 7f421d86b640 1 -- 172.21.15.132:0/1152130770 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218154940 con 0x7f4218151bc0 2023-11-18T20:38:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.754+0000 7f421e06c640 1 --2- 172.21.15.132:0/1152130770 >> v2:172.21.15.161:3300/0 conn(0x7f42180c4bc0 0x7f421806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.755+0000 7f421d86b640 1 --2- 172.21.15.132:0/1152130770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4218151bc0 0x7f42180c7cc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4208009e50 tx=0x7f420802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41b3fc721838a63 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.756+0000 7f421c869640 1 -- 172.21.15.132:0/1152130770 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420802ca80 con 0x7f4218151bc0 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.756+0000 7f421c869640 1 -- 172.21.15.132:0/1152130770 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420802cbe0 con 0x7f4218151bc0 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.756+0000 7f421c869640 1 -- 172.21.15.132:0/1152130770 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42080343f0 con 0x7f4218151bc0 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.756+0000 7f421e86d640 1 -- 172.21.15.132:0/1152130770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4218151bc0 msgr2=0x7f42180c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.756+0000 7f421e86d640 1 --2- 172.21.15.132:0/1152130770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4218151bc0 0x7f42180c7cc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4208009e50 tx=0x7f420802bee0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.757+0000 7f421e86d640 1 -- 172.21.15.132:0/1152130770 shutdown_connections 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.757+0000 7f421e86d640 1 --2- 172.21.15.132:0/1152130770 >> v2:172.21.15.161:3300/0 conn(0x7f42180c4bc0 0x7f421806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.757+0000 7f421e86d640 1 --2- 172.21.15.132:0/1152130770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4218151bc0 0x7f42180c7cc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.757+0000 7f421e86d640 1 -- 172.21.15.132:0/1152130770 >> 172.21.15.132:0/1152130770 conn(0x7f42180ab950 msgr2=0x7f42180abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.757+0000 7f421e86d640 1 -- 172.21.15.132:0/1152130770 shutdown_connections 2023-11-18T20:38:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.757+0000 7f421e86d640 1 -- 172.21.15.132:0/1152130770 wait complete. 2023-11-18T20:38:09.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.758+0000 7f421e86d640 1 Processor -- start 2023-11-18T20:38:09.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.758+0000 7f421e86d640 1 -- start start 2023-11-18T20:38:09.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421e86d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42180c4740 0x7f42180c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421e86d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42180c4bc0 0x7f42181558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421e86d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4218151bc0 0x7f4218157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421e86d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42181552e0 con 0x7f42180c4740 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421e86d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42181578d0 con 0x7f4218151bc0 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421e86d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180be310 con 0x7f42180c4bc0 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421d86b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42180c4740 0x7f42180c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421d86b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42180c4740 0x7f42180c05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57606/0 (socket says 172.21.15.132:57606) 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.759+0000 7f421d86b640 1 -- 172.21.15.132:0/3738950867 learned_addr learned my addr 172.21.15.132:0/3738950867 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421e06c640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4218151bc0 0x7f4218157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421d06a640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42180c4bc0 0x7f42181558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421d86b640 1 -- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42180c4bc0 msgr2=0x7f42181558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421d86b640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42180c4bc0 0x7f42181558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421d86b640 1 -- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4218151bc0 msgr2=0x7f4218157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421d86b640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4218151bc0 0x7f4218157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421d86b640 1 -- 172.21.15.132:0/3738950867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208009b30 con 0x7f42180c4740 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421d86b640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42180c4740 0x7f42180c05f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4208000f80 tx=0x7f4208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f42167fc640 1 -- 172.21.15.132:0/3738950867 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208009510 con 0x7f42180c4740 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f42167fc640 1 -- 172.21.15.132:0/3738950867 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420803e450 con 0x7f42180c4740 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42180bda70 con 0x7f42180c4740 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.760+0000 7f42167fc640 1 -- 172.21.15.132:0/3738950867 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420803e800 con 0x7f42180c4740 2023-11-18T20:38:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.761+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42180be030 con 0x7f42180c4740 2023-11-18T20:38:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.762+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421804e840 con 0x7f42180c4740 2023-11-18T20:38:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.762+0000 7f42167fc640 1 -- 172.21.15.132:0/3738950867 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f420802cd50 con 0x7f42180c4740 2023-11-18T20:38:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.763+0000 7f42167fc640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f420406ae40 0x7f420406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.763+0000 7f42167fc640 1 -- 172.21.15.132:0/3738950867 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42080ac1b0 con 0x7f42180c4740 2023-11-18T20:38:09.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.764+0000 7f421d06a640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f420406ae40 0x7f420406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:09.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.765+0000 7f421d06a640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f420406ae40 0x7f420406d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42180c0b30 tx=0x7f420c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.768+0000 7f42167fc640 1 -- 172.21.15.132:0/3738950867 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42080771c0 con 0x7f42180c4740 2023-11-18T20:38:09.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.956+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42180abf40 con 0x7f42180c4740 2023-11-18T20:38:09.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.959+0000 7f42167fc640 1 -- 172.21.15.132:0/3738950867 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f420807a7e0 con 0x7f42180c4740 2023-11-18T20:38:09.961 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:09.961 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:09.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f420406ae40 msgr2=0x7f420406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f420406ae40 0x7f420406d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42180c0b30 tx=0x7f420c009040 comp rx=0 tx=0).stop 2023-11-18T20:38:09.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42180c4740 msgr2=0x7f42180c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:09.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42180c4740 0x7f42180c05f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4208000f80 tx=0x7f4208004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:09.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 shutdown_connections 2023-11-18T20:38:09.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f420406ae40 0x7f420406d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4218151bc0 0x7f4218157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42180c4bc0 0x7f42181558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 --2- 172.21.15.132:0/3738950867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42180c4740 0x7f42180c05f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:09.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 >> 172.21.15.132:0/3738950867 conn(0x7f42180ab950 msgr2=0x7f421806ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:09.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 shutdown_connections 2023-11-18T20:38:09.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:09.962+0000 7f421e86d640 1 -- 172.21.15.132:0/3738950867 wait complete. 2023-11-18T20:38:09.983 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-18T20:38:09.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.192+0000 7f288a4af640 1 Processor -- start 2023-11-18T20:38:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.192+0000 7f288a4af640 1 -- start start 2023-11-18T20:38:10.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.193+0000 7f288a4af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f288414fd30 0x7f2884152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.193+0000 7f288a4af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840c64a0 con 0x7f288406d0a0 2023-11-18T20:38:10.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.193+0000 7f288a4af640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840c5c00 con 0x7f28840c3ea0 2023-11-18T20:38:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.193+0000 7f288a4af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840c5ee0 con 0x7f288414fd30 2023-11-18T20:38:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.194+0000 7f2883fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f288414fd30 0x7f2884152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.194+0000 7f287bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f288406d0a0 0x7f28840a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48622/0 (socket says 172.21.15.132:48622) 2023-11-18T20:38:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.194+0000 7f287bfff640 1 -- 172.21.15.132:0/2322843531 learned_addr learned my addr 172.21.15.132:0/2322843531 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.194+0000 7f28837fe640 1 -- 172.21.15.132:0/2322843531 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458292345 0 0) 0x7f28840c64a0 con 0x7f288406d0a0 2023-11-18T20:38:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.194+0000 7f2883fff640 1 -- 172.21.15.132:0/2322843531 >> v1:172.21.15.161:6789/0 conn(0x7f28840c3ea0 legacy=0x7f28840c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.194+0000 7f2883fff640 1 -- 172.21.15.132:0/2322843531 >> v1:172.21.15.132:6789/0 conn(0x7f288406d0a0 legacy=0x7f28840a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.194+0000 7f2883fff640 1 -- 172.21.15.132:0/2322843531 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840c61c0 con 0x7f288414fd30 2023-11-18T20:38:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.195+0000 7f2883fff640 1 --2- 172.21.15.132:0/2322843531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f288414fd30 0x7f2884152f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f28740097a0 tx=0x7f287402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93d562dceda839 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f28837fe640 1 -- 172.21.15.132:0/2322843531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874030610 con 0x7f288414fd30 2023-11-18T20:38:10.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f28837fe640 1 -- 172.21.15.132:0/2322843531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874030770 con 0x7f288414fd30 2023-11-18T20:38:10.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f28837fe640 1 -- 172.21.15.132:0/2322843531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874030b00 con 0x7f288414fd30 2023-11-18T20:38:10.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f288a4af640 1 -- 172.21.15.132:0/2322843531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f288414fd30 msgr2=0x7f2884152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f288a4af640 1 --2- 172.21.15.132:0/2322843531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f288414fd30 0x7f2884152f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f28740097a0 tx=0x7f287402b960 comp rx=0 tx=0).stop 2023-11-18T20:38:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f288a4af640 1 -- 172.21.15.132:0/2322843531 shutdown_connections 2023-11-18T20:38:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f288a4af640 1 --2- 172.21.15.132:0/2322843531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f288414fd30 0x7f2884152f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f288a4af640 1 -- 172.21.15.132:0/2322843531 >> 172.21.15.132:0/2322843531 conn(0x7f288406a500 msgr2=0x7f288406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f288a4af640 1 -- 172.21.15.132:0/2322843531 shutdown_connections 2023-11-18T20:38:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.196+0000 7f288a4af640 1 -- 172.21.15.132:0/2322843531 wait complete. 2023-11-18T20:38:10.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.198+0000 7f288a4af640 1 Processor -- start 2023-11-18T20:38:10.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.198+0000 7f288a4af640 1 -- start start 2023-11-18T20:38:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f288a4af640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f288406d0a0 0x7f28840aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f288a4af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840c3ea0 0x7f28840a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f288a4af640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f288414fd30 0x7f28841507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f288a4af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884153b00 con 0x7f28840c3ea0 2023-11-18T20:38:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f288a4af640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840aa250 con 0x7f288414fd30 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f288a4af640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840a9520 con 0x7f288406d0a0 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f287bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840c3ea0 0x7f28840a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f287bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840c3ea0 0x7f28840a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57634/0 (socket says 172.21.15.132:57634) 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.199+0000 7f287bfff640 1 -- 172.21.15.132:0/2624714212 learned_addr learned my addr 172.21.15.132:0/2624714212 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f2888a4c640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f288414fd30 0x7f28841507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f287bfff640 1 -- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f288406d0a0 msgr2=0x7f28840aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f287bfff640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f288406d0a0 0x7f28840aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f287bfff640 1 -- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f288414fd30 msgr2=0x7f28841507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f287bfff640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f288414fd30 0x7f28841507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f287bfff640 1 -- 172.21.15.132:0/2624714212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009400 con 0x7f28840c3ea0 2023-11-18T20:38:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f2888a4c640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f288414fd30 0x7f28841507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f287bfff640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840c3ea0 0x7f28840a99b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f286c00c3f0 tx=0x7f286c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f28817fa640 1 -- 172.21.15.132:0/2624714212 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0074e0 con 0x7f28840c3ea0 2023-11-18T20:38:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f28817fa640 1 -- 172.21.15.132:0/2624714212 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c007660 con 0x7f28840c3ea0 2023-11-18T20:38:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f28817fa640 1 -- 172.21.15.132:0/2624714212 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c004a20 con 0x7f28840c3ea0 2023-11-18T20:38:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840a8f10 con 0x7f28840c3ea0 2023-11-18T20:38:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.200+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28840a91b0 con 0x7f28840c3ea0 2023-11-18T20:38:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.201+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2884068350 con 0x7f28840c3ea0 2023-11-18T20:38:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.202+0000 7f28817fa640 1 -- 172.21.15.132:0/2624714212 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f286c004b80 con 0x7f28840c3ea0 2023-11-18T20:38:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.203+0000 7f28817fa640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f286406ae70 0x7f286406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.203+0000 7f28817fa640 1 -- 172.21.15.132:0/2624714212 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f286c089330 con 0x7f28840c3ea0 2023-11-18T20:38:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.204+0000 7f2883fff640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f286406ae70 0x7f286406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.205+0000 7f2883fff640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f286406ae70 0x7f286406d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2874036000 tx=0x7f287403b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.207+0000 7f28817fa640 1 -- 172.21.15.132:0/2624714212 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f286c054470 con 0x7f28840c3ea0 2023-11-18T20:38:10.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.399+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28840a9660 con 0x7f28840c3ea0 2023-11-18T20:38:10.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.401+0000 7f28817fa640 1 -- 172.21.15.132:0/2624714212 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f286c057a90 con 0x7f28840c3ea0 2023-11-18T20:38:10.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:10.403 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:10.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f286406ae70 msgr2=0x7f286406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f286406ae70 0x7f286406d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2874036000 tx=0x7f287403b040 comp rx=0 tx=0).stop 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840c3ea0 msgr2=0x7f28840a99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840c3ea0 0x7f28840a99b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f286c00c3f0 tx=0x7f286c00c8b0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 shutdown_connections 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f286406ae70 0x7f286406d330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f288414fd30 0x7f28841507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840c3ea0 0x7f28840a99b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 --2- 172.21.15.132:0/2624714212 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f288406d0a0 0x7f28840aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 >> 172.21.15.132:0/2624714212 conn(0x7f288406a500 msgr2=0x7f28840a71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 shutdown_connections 2023-11-18T20:38:10.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.404+0000 7f288a4af640 1 -- 172.21.15.132:0/2624714212 wait complete. 2023-11-18T20:38:10.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-18T20:38:10.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-18T20:38:10.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-18T20:38:10.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-18T20:38:10.427 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-18T20:38:10.427 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-18T20:38:10.427 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-18T20:38:10.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-18T20:38:10.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.725+0000 7f57f9b4e640 1 Processor -- start 2023-11-18T20:38:10.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.726+0000 7f57f9b4e640 1 -- start start 2023-11-18T20:38:10.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.727+0000 7f57f9b4e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57f414e7c0 0x7f57f40c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.727+0000 7f57f9b4e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57f40c4c00 0x7f57f40ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.727+0000 7f57f9b4e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f4158a60 con 0x7f57f40ca990 2023-11-18T20:38:10.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.727+0000 7f57f9b4e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f40c5b10 con 0x7f57f40c4c00 2023-11-18T20:38:10.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.728+0000 7f57f9b4e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f4157ca0 con 0x7f57f414e7c0 2023-11-18T20:38:10.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.728+0000 7f57f934d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f57f40ca990 0x7f57f4154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48624/0 (socket says 172.21.15.132:48624) 2023-11-18T20:38:10.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.728+0000 7f57f8b4c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57f414e7c0 0x7f57f40c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.728+0000 7f57f934d640 1 -- 172.21.15.132:0/1258732011 learned_addr learned my addr 172.21.15.132:0/1258732011 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:10.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.728+0000 7f57f3fff640 1 --2- 172.21.15.132:0/1258732011 >> v2:172.21.15.132:3300/0 conn(0x7f57f40c4c00 0x7f57f40ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.729+0000 7fe716859640 1 Processor -- start 2023-11-18T20:38:10.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.729+0000 7fe716859640 1 -- start start 2023-11-18T20:38:10.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.729+0000 7f8d4cc7e640 1 Processor -- start 2023-11-18T20:38:10.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.730+0000 7f57f3fff640 1 -- 172.21.15.132:0/1258732011 >> v2:172.21.15.161:3300/0 conn(0x7f57f414e7c0 msgr2=0x7f57f40c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.730+0000 7f57f3fff640 1 --2- 172.21.15.132:0/1258732011 >> v2:172.21.15.161:3300/0 conn(0x7f57f414e7c0 0x7f57f40c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.731+0000 7fe716859640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7100c3d60 0x7fe710151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.730+0000 7f57f3fff640 1 -- 172.21.15.132:0/1258732011 >> v1:172.21.15.132:6789/0 conn(0x7f57f40ca990 legacy=0x7f57f4154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7fe716859640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100c0f70 con 0x7fe710151970 2023-11-18T20:38:10.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7fe716859640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe710154430 con 0x7fe7101579c0 2023-11-18T20:38:10.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7fe716859640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe710155320 con 0x7fe7100c3d60 2023-11-18T20:38:10.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7fe715857640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe710151970 0x7fe7100c0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48634/0 (socket says 172.21.15.132:48634) 2023-11-18T20:38:10.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7fe715857640 1 -- 172.21.15.132:0/3567806790 learned_addr learned my addr 172.21.15.132:0/3567806790 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:10.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.730+0000 7f57f3fff640 1 -- 172.21.15.132:0/1258732011 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4157f80 con 0x7f57f40c4c00 2023-11-18T20:38:10.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.729+0000 7f8d4cc7e640 1 -- start start 2023-11-18T20:38:10.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.731+0000 7f8d4cc7e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8d40004ad0 0x7f8d40047540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.731+0000 7f8d4cc7e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d40006f60 con 0x7f8d400dbfc0 2023-11-18T20:38:10.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.731+0000 7f8d4cc7e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d40007500 con 0x7f8d40047a80 2023-11-18T20:38:10.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.731+0000 7f8d4cc7e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d40009b80 con 0x7f8d40004ad0 2023-11-18T20:38:10.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.731+0000 7f8d477fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8d400dbfc0 0x7f8d4003ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48632/0 (socket says 172.21.15.132:48632) 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.731+0000 7f8d477fe640 1 -- 172.21.15.132:0/63232321 learned_addr learned my addr 172.21.15.132:0/63232321 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/63232321 >> v2:172.21.15.161:3300/0 conn(0x7f8d40004ad0 0x7f8d40047540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022290321 0 0) 0x7f8d40006f60 con 0x7f8d400dbfc0 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d30003520 con 0x7f8d400dbfc0 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2543363575 0 0) 0x7f8d30003520 con 0x7f8d400dbfc0 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 >> v2:172.21.15.161:3300/0 conn(0x7f8d40004ad0 msgr2=0x7f8d40047540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 --2- 172.21.15.132:0/63232321 >> v2:172.21.15.161:3300/0 conn(0x7f8d40004ad0 0x7f8d40047540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 >> v1:172.21.15.161:6789/0 conn(0x7f8d40047a80 legacy=0x7f8d400e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4000bad0 con 0x7f8d400dbfc0 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f8d38001670 con 0x7f8d400dbfc0 2023-11-18T20:38:10.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 >> v1:172.21.15.132:6789/0 conn(0x7f8d400dbfc0 legacy=0x7f8d4003ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f57f3fff640 1 --2- 172.21.15.132:0/1258732011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 0x7f57f40ca450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f57f408b7c0 tx=0x7f57ec02bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef10c75cb106ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d30003970 0x7f8d30003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7fe715056640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7100c3d60 0x7fe710151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256004184 0 0) 0x7fe710154430 con 0x7fe7101579c0 2023-11-18T20:38:10.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.734+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6fc003520 con 0x7fe7101579c0 2023-11-18T20:38:10.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.734+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111209375 0 0) 0x7fe7100c0f70 con 0x7fe710151970 2023-11-18T20:38:10.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.734+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe710154430 con 0x7fe710151970 2023-11-18T20:38:10.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d300047c0 0x7f8d30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d30005180 0x7f8d3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3000bfd0 con 0x7f8d300047c0 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3000c140 con 0x7f8d30005180 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.732+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3000c300 con 0x7f8d30003970 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d300047c0 0x7f8d30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d47fff640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d30005180 0x7f8d3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d46ffd640 1 -- 172.21.15.132:0/63232321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d30003970 msgr2=0x7f8d30003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d30003970 0x7f8d30003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d46ffd640 1 -- 172.21.15.132:0/63232321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d30005180 msgr2=0x7f8d3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d30005180 0x7f8d3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d46ffd640 1 -- 172.21.15.132:0/63232321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4000bad0 con 0x7f8d300047c0 2023-11-18T20:38:10.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d47fff640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d30005180 0x7f8d3000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:10.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.733+0000 7f8d47fff640 1 -- 172.21.15.132:0/63232321 reap_dead start 2023-11-18T20:38:10.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.734+0000 7f57f37fe640 1 -- 172.21.15.132:0/1258732011 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec02d920 con 0x7f57f40c4c00 2023-11-18T20:38:10.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.734+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2873578762 0 0) 0x7fe710154430 con 0x7fe710151970 2023-11-18T20:38:10.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7f57f37fe640 1 -- 172.21.15.132:0/1258732011 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec02da80 con 0x7f57f40c4c00 2023-11-18T20:38:10.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.734+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7100c3d60 msgr2=0x7fe710151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7100c3d60 0x7fe710151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 >> v1:172.21.15.161:6789/0 conn(0x7fe7101579c0 legacy=0x7fe710154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100c1210 con 0x7fe710151970 2023-11-18T20:38:10.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fe70c001670 con 0x7fe710151970 2023-11-18T20:38:10.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 >> v1:172.21.15.132:6789/0 conn(0x7fe710151970 legacy=0x7fe7100c0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6fc004b90 0x7fe6fc004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6fc003760 0x7fe6fc003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6fc004240 0x7fe6fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710155320 con 0x7fe6fc003760 2023-11-18T20:38:10.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc00c150 con 0x7fe6fc004240 2023-11-18T20:38:10.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc00c310 con 0x7fe6fc004b90 2023-11-18T20:38:10.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7f57f37fe640 1 -- 172.21.15.132:0/1258732011 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec02de10 con 0x7f57f40c4c00 2023-11-18T20:38:10.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d300047c0 0x7f8d30004c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009a90 tx=0x7f8d300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8319a7f4865efc32 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.735+0000 7fe716058640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6fc004240 0x7fe6fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.736+0000 7fe715857640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6fc004b90 0x7fe6fc004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.736+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c02c690 con 0x7f8d300047c0 2023-11-18T20:38:10.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.736+0000 7fe715056640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6fc003760 0x7fe6fc003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.736+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c02c7f0 con 0x7f8d300047c0 2023-11-18T20:38:10.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.736+0000 7f8d467fc640 1 -- 172.21.15.132:0/63232321 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c02cb80 con 0x7f8d300047c0 2023-11-18T20:38:10.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f57f9b4e640 1 -- 172.21.15.132:0/1258732011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 msgr2=0x7f57f40ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7fe715857640 1 -- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6fc004240 msgr2=0x7fe6fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7fe715857640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6fc004240 0x7fe6fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7fe715857640 1 -- 172.21.15.132:0/3567806790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6fc003760 msgr2=0x7fe6fc003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7fe715857640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6fc003760 0x7fe6fc003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7fe715857640 1 -- 172.21.15.132:0/3567806790 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100c1210 con 0x7fe6fc004b90 2023-11-18T20:38:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f57f9b4e640 1 --2- 172.21.15.132:0/1258732011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 0x7f57f40ca450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f57f408b7c0 tx=0x7f57ec02bbe0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/63232321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d300047c0 msgr2=0x7f8d30004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f8d4cc7e640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d300047c0 0x7f8d30004c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009a90 tx=0x7f8d300057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/63232321 shutdown_connections 2023-11-18T20:38:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f8d4cc7e640 1 --2- 172.21.15.132:0/63232321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d300047c0 0x7f8d30004c40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/63232321 >> 172.21.15.132:0/63232321 conn(0x7f8d400062b0 msgr2=0x7f8d400066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f594ab73640 1 Processor -- start 2023-11-18T20:38:10.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.737+0000 7f594ab73640 1 -- start start 2023-11-18T20:38:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.738+0000 7fea76813640 1 Processor -- start 2023-11-18T20:38:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.738+0000 7fe715857640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6fc004b90 0x7fe6fc004f90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c1b0 tx=0x7fe6fc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6744688c5b478ea3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.739+0000 7fea76813640 1 -- start start 2023-11-18T20:38:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.739+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c005ad0 con 0x7fe6fc004b90 2023-11-18T20:38:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.739+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c005c50 con 0x7fe6fc004b90 2023-11-18T20:38:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.739+0000 7fe714855640 1 -- 172.21.15.132:0/3567806790 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c02c7a0 con 0x7fe6fc004b90 2023-11-18T20:38:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.738+0000 7f57f9b4e640 1 -- 172.21.15.132:0/1258732011 shutdown_connections 2023-11-18T20:38:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.738+0000 7f57f9b4e640 1 --2- 172.21.15.132:0/1258732011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 0x7f57f40ca450 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.738+0000 7f57f9b4e640 1 --2- 172.21.15.132:0/1258732011 >> v2:172.21.15.161:3300/0 conn(0x7f57f414e7c0 0x7f57f40c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.738+0000 7f57f9b4e640 1 -- 172.21.15.132:0/1258732011 >> 172.21.15.132:0/1258732011 conn(0x7f57f40abf00 msgr2=0x7f57f40c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.738+0000 7f57f9b4e640 1 -- 172.21.15.132:0/1258732011 shutdown_connections 2023-11-18T20:38:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.738+0000 7f57f9b4e640 1 -- 172.21.15.132:0/1258732011 wait complete. 2023-11-18T20:38:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7f57f9b4e640 1 Processor -- start 2023-11-18T20:38:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/63232321 shutdown_connections 2023-11-18T20:38:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7f594ab73640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59440c1100 0x7f59441641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7f594ab73640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5944159800 con 0x7f5944155f60 2023-11-18T20:38:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7f594ab73640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5944158a40 con 0x7f594406e000 2023-11-18T20:38:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7f594ab73640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594406c440 con 0x7f59440c1100 2023-11-18T20:38:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fe716859640 1 -- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6fc004b90 msgr2=0x7fe6fc004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fe716859640 1 --2- 172.21.15.132:0/3567806790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6fc004b90 0x7fe6fc004f90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c1b0 tx=0x7fe6fc0057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fea76813640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680d0fc0 0x7fea6804dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fea76813640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fea6800ebe0 0x7fea68006e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fe716058640 1 -- 172.21.15.132:0/3567806790 reap_dead start 2023-11-18T20:38:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fea76813640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6804e1b0 con 0x7fea680073b0 2023-11-18T20:38:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fea76813640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea680d13a0 con 0x7fea6800ebe0 2023-11-18T20:38:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fea76813640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6800e1d0 con 0x7fea680d0fc0 2023-11-18T20:38:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7fe716859640 1 -- 172.21.15.132:0/3567806790 shutdown_connections 2023-11-18T20:38:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7fe716859640 1 -- 172.21.15.132:0/3567806790 >> 172.21.15.132:0/3567806790 conn(0x7fe7100c5b50 msgr2=0x7fe7100c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7f5949b71640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5944155f60 0x7f59440c18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48650/0 (socket says 172.21.15.132:48650) 2023-11-18T20:38:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7f5949b71640 1 -- 172.21.15.132:0/3890727611 learned_addr learned my addr 172.21.15.132:0/3890727611 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7f594a372640 1 --2- 172.21.15.132:0/3890727611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59440c1100 0x7f59441641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7fe716859640 1 -- 172.21.15.132:0/3567806790 shutdown_connections 2023-11-18T20:38:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7f57f9b4e640 1 -- start start 2023-11-18T20:38:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7fe716859640 1 -- 172.21.15.132:0/3567806790 wait complete. 2023-11-18T20:38:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.740+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/63232321 wait complete. 2023-11-18T20:38:10.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7fea75010640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fea6800ebe0 0x7fea68006e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7fea75010640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fea6800ebe0 0x7fea68006e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40078/0 (socket says 172.21.15.132:40078) 2023-11-18T20:38:10.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.741+0000 7fea75010640 1 -- 172.21.15.132:0/3092988746 learned_addr learned my addr 172.21.15.132:0/3092988746 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7fea75811640 1 --2- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680d0fc0 0x7fea6804dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7fea75010640 1 -- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680d0fc0 msgr2=0x7fea6804dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7fea75010640 1 --2- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680d0fc0 0x7fea6804dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7fea75010640 1 -- 172.21.15.132:0/3092988746 >> v1:172.21.15.132:6789/0 conn(0x7fea680073b0 legacy=0x7fea680da3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.743+0000 7f57f9b4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 0x7f57f4156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.743+0000 7f57f9b4e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ca990 0x7f57f41ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.743+0000 7f57f9b4e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57f414e7c0 0x7f57f41edee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.743+0000 7f57f9b4e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f414f770 con 0x7f57f40c4c00 2023-11-18T20:38:10.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.743+0000 7f57f9b4e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4156500 con 0x7f57f40ca990 2023-11-18T20:38:10.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.743+0000 7f57f9b4e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f414ed40 con 0x7f57f414e7c0 2023-11-18T20:38:10.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7f5948b6f640 1 -- 172.21.15.132:0/3890727611 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243142582 0 0) 0x7f5944159800 con 0x7f5944155f60 2023-11-18T20:38:10.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7f5948b6f640 1 -- 172.21.15.132:0/3890727611 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5934003520 con 0x7f5944155f60 2023-11-18T20:38:10.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7f594a372640 1 -- 172.21.15.132:0/3890727611 >> v1:172.21.15.161:6789/0 conn(0x7f594406e000 legacy=0x7f59440c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7f594a372640 1 -- 172.21.15.132:0/3890727611 >> v1:172.21.15.132:6789/0 conn(0x7f5944155f60 legacy=0x7f59440c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7f594a372640 1 -- 172.21.15.132:0/3890727611 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944158d20 con 0x7f59440c1100 2023-11-18T20:38:10.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7fea75010640 1 -- 172.21.15.132:0/3092988746 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680daf20 con 0x7fea6800ebe0 2023-11-18T20:38:10.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.742+0000 7fea75811640 1 --2- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680d0fc0 0x7fea6804dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:10.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.744+0000 7fe716859640 1 Processor -- start 2023-11-18T20:38:10.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.744+0000 7f594a372640 1 --2- 172.21.15.132:0/3890727611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59440c1100 0x7f59441641c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f593c009dc0 tx=0x7f593c02be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938cf46a47d3892e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.744+0000 7fe716859640 1 -- start start 2023-11-18T20:38:10.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.744+0000 7f8d4cc7e640 1 Processor -- start 2023-11-18T20:38:10.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.744+0000 7f57f934d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57f414e7c0 0x7f57f41edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.744+0000 7f57f934d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57f414e7c0 0x7f57f41edee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48026/0 (socket says 172.21.15.132:48026) 2023-11-18T20:38:10.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.744+0000 7f57f934d640 1 -- 172.21.15.132:0/2995261394 learned_addr learned my addr 172.21.15.132:0/2995261394 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.744+0000 7fea75010640 1 --2- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 0x7fea68006e70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea60009870 tx=0x7fea6002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f1c52dd9c9906be server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7f8d4cc7e640 1 -- start start 2023-11-18T20:38:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7f5948b6f640 1 -- 172.21.15.132:0/3890727611 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c02cbb0 con 0x7f59440c1100 2023-11-18T20:38:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7f57f934d640 1 -- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ca990 msgr2=0x7f57f41ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7f57f934d640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ca990 0x7f57f41ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7f57f934d640 1 -- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 msgr2=0x7f57f4156990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-18T20:38:10.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7f5948b6f640 1 -- 172.21.15.132:0/3890727611 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c02cd10 con 0x7f59440c1100 2023-11-18T20:38:10.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7f5948b6f640 1 -- 172.21.15.132:0/3890727611 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c034660 con 0x7f59440c1100 2023-11-18T20:38:10.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7fea7480f640 1 -- 172.21.15.132:0/3092988746 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600317c0 con 0x7fea6800ebe0 2023-11-18T20:38:10.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7fea7480f640 1 -- 172.21.15.132:0/3092988746 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60031920 con 0x7fea6800ebe0 2023-11-18T20:38:10.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.745+0000 7fea7480f640 1 -- 172.21.15.132:0/3092988746 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60031cb0 con 0x7fea6800ebe0 2023-11-18T20:38:10.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f594ab73640 1 -- 172.21.15.132:0/3890727611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59440c1100 msgr2=0x7f59441641c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f594ab73640 1 --2- 172.21.15.132:0/3890727611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59440c1100 0x7f59441641c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f593c009dc0 tx=0x7f593c02be00 comp rx=0 tx=0).stop 2023-11-18T20:38:10.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fe716859640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6fc004b90 0x7fe7101fa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fea76813640 1 -- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 msgr2=0x7fea68006e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fea76813640 1 --2- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 0x7fea68006e70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea60009870 tx=0x7fea6002b860 comp rx=0 tx=0).stop 2023-11-18T20:38:10.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fe716859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe710072500 0x7fe71014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f57f8b4c640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 0x7f57f4156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f57f934d640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 0x7f57f4156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f8d4cc7e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d300047c0 0x7f8d4004af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f8d4cc7e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d400ded90 0x7f8d4016fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f8d4cc7e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d4016ff50 0x7f8d400499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f8d4cc7e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4016f530 con 0x7f8d400ded90 2023-11-18T20:38:10.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f8d4cc7e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400e14e0 con 0x7f8d300047c0 2023-11-18T20:38:10.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fe716859640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7101535c0 0x7fe710150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fe716859640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710153dd0 con 0x7fe710072500 2023-11-18T20:38:10.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fe716859640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71006bcd0 con 0x7fe6fc004b90 2023-11-18T20:38:10.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f594ab73640 1 -- 172.21.15.132:0/3890727611 shutdown_connections 2023-11-18T20:38:10.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fe715056640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe710072500 0x7fe71014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7f8d4cc7e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400e1d60 con 0x7f8d4016ff50 2023-11-18T20:38:10.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fe715857640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6fc004b90 0x7fe7101fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fe715056640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe710072500 0x7fe71014fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57688/0 (socket says 172.21.15.132:57688) 2023-11-18T20:38:10.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f8d47fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d4016ff50 0x7f8d400499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f8d47fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d4016ff50 0x7f8d400499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48042/0 (socket says 172.21.15.132:48042) 2023-11-18T20:38:10.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f8d47fff640 1 -- 172.21.15.132:0/1655997917 learned_addr learned my addr 172.21.15.132:0/1655997917 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fe715056640 1 -- 172.21.15.132:0/3765607040 learned_addr learned my addr 172.21.15.132:0/3765607040 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7101fa9b0 con 0x7fe7101535c0 2023-11-18T20:38:10.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f57f934d640 1 -- 172.21.15.132:0/2995261394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec009a70 con 0x7f57f414e7c0 2023-11-18T20:38:10.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f766e9d5640 1 Processor -- start 2023-11-18T20:38:10.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f57f8b4c640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f40c4c00 0x7f57f4156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:10.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fea76813640 1 -- 172.21.15.132:0/3092988746 shutdown_connections 2023-11-18T20:38:10.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fea76813640 1 --2- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 0x7fea68006e70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fea76813640 1 --2- 172.21.15.132:0/3092988746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680d0fc0 0x7fea6804dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.746+0000 7fea76813640 1 -- 172.21.15.132:0/3092988746 >> 172.21.15.132:0/3092988746 conn(0x7fea6804c5d0 msgr2=0x7fea6804c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fea76813640 1 -- 172.21.15.132:0/3092988746 shutdown_connections 2023-11-18T20:38:10.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f594ab73640 1 --2- 172.21.15.132:0/3890727611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59440c1100 0x7f59441641c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f594ab73640 1 -- 172.21.15.132:0/3890727611 >> 172.21.15.132:0/3890727611 conn(0x7f59440a77f0 msgr2=0x7f59440a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fea76813640 1 -- 172.21.15.132:0/3092988746 wait complete. 2023-11-18T20:38:10.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7f766e9d5640 1 -- start start 2023-11-18T20:38:10.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.747+0000 7fe716058640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7101535c0 0x7fe710150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d400ded90 0x7f8d4016fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7f57f934d640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57f414e7c0 0x7f57f41edee0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f57e800c780 tx=0x7f57e800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7fe715056640 1 -- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7101535c0 msgr2=0x7fe710150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7fe715056640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7101535c0 0x7fe710150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7fe715056640 1 -- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6fc004b90 msgr2=0x7fe7101fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7fe715056640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6fc004b90 0x7fe7101fa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7fe715056640 1 -- 172.21.15.132:0/3765607040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71006bee0 con 0x7fe710072500 2023-11-18T20:38:10.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80072d0 con 0x7f57f414e7c0 2023-11-18T20:38:10.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e8007430 con 0x7f57f414e7c0 2023-11-18T20:38:10.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80047e0 con 0x7f57f414e7c0 2023-11-18T20:38:10.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7fe715056640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe710072500 0x7fe71014fe40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe70000f4c0 tx=0x7fe70000f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.748+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f414f020 con 0x7f57f414e7c0 2023-11-18T20:38:10.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f594ab73640 1 -- 172.21.15.132:0/3890727611 shutdown_connections 2023-11-18T20:38:10.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f594ab73640 1 -- 172.21.15.132:0/3890727611 wait complete. 2023-11-18T20:38:10.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f4152d30 con 0x7f57f414e7c0 2023-11-18T20:38:10.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f8d477fe640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d300047c0 0x7f8d4004af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f8d46ffd640 1 -- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d4016ff50 msgr2=0x7f8d400499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d4016ff50 0x7f8d400499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f8d46ffd640 1 -- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d300047c0 msgr2=0x7f8d4004af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d300047c0 0x7f8d4004af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f8d46ffd640 1 -- 172.21.15.132:0/1655997917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400e17a0 con 0x7f8d400ded90 2023-11-18T20:38:10.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f766e9d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f766814f9f0 0x7f766806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f766e9d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 0x7f76680c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f766e9d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76680a6de0 con 0x7f76680c4d20 2023-11-18T20:38:10.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f766e9d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76680a7740 con 0x7f766814f9f0 2023-11-18T20:38:10.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.749+0000 7f766e9d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680a7080 con 0x7f76680c7540 2023-11-18T20:38:10.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.750+0000 7f7667fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f766814f9f0 0x7f766806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.750+0000 7f7667fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f766814f9f0 0x7f766806dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57700/0 (socket says 172.21.15.132:57700) 2023-11-18T20:38:10.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.750+0000 7f7667fff640 1 -- 172.21.15.132:0/3676512799 learned_addr learned my addr 172.21.15.132:0/3676512799 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.750+0000 7f8d46ffd640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d400ded90 0x7f8d4016fa10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c033000 tx=0x7f8d3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.750+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700014870 con 0x7fe710072500 2023-11-18T20:38:10.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.750+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7000149d0 con 0x7fe710072500 2023-11-18T20:38:10.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.750+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700014d40 con 0x7fe710072500 2023-11-18T20:38:10.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.751+0000 7fea76813640 1 Processor -- start 2023-11-18T20:38:10.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.751+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71006c1c0 con 0x7fe710072500 2023-11-18T20:38:10.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.751+0000 7f594ab73640 1 Processor -- start 2023-11-18T20:38:10.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.751+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe710153a80 con 0x7fe710072500 2023-11-18T20:38:10.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.751+0000 7f76677fe640 1 --2- 172.21.15.132:0/3676512799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 0x7f76680c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.752+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57f40c50a0 con 0x7f57f414e7c0 2023-11-18T20:38:10.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.752+0000 7f594ab73640 1 -- start start 2023-11-18T20:38:10.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.751+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c003810 con 0x7f8d400ded90 2023-11-18T20:38:10.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.751+0000 7fea76813640 1 -- start start 2023-11-18T20:38:10.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.752+0000 7fea76813640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680073b0 0x7fea680c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7fea76813640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 0x7fea68034c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7fea76813640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea680d0fc0 0x7fea680351b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f465a66d640 1 Processor -- start 2023-11-18T20:38:10.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7101546f0 con 0x7fe710072500 2023-11-18T20:38:10.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f594ab73640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f594406e000 0x7f5944071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f594ab73640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59440c1100 0x7f59441ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f594ab73640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5944155f60 0x7f59441ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f594ab73640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594415c790 con 0x7f5944155f60 2023-11-18T20:38:10.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f594ab73640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59441ed220 con 0x7f59440c1100 2023-11-18T20:38:10.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f594ab73640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59441ec310 con 0x7f594406e000 2023-11-18T20:38:10.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57e8004940 con 0x7f57f414e7c0 2023-11-18T20:38:10.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d400e1a80 con 0x7f8d400ded90 2023-11-18T20:38:10.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d400cc7d0 con 0x7f8d400ded90 2023-11-18T20:38:10.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d40007190 con 0x7f8d400ded90 2023-11-18T20:38:10.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c003970 con 0x7f8d400ded90 2023-11-18T20:38:10.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c003d60 con 0x7f8d400ded90 2023-11-18T20:38:10.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7f5949370640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59440c1100 0x7f59441ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7f594a372640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5944155f60 0x7f59441ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7fea75010640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 0x7fea68034c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7fea75010640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 0x7fea68034c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40116/0 (socket says 172.21.15.132:40116) 2023-11-18T20:38:10.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7fea75010640 1 -- 172.21.15.132:0/4175825990 learned_addr learned my addr 172.21.15.132:0/4175825990 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68047530 con 0x7fea680d0fc0 2023-11-18T20:38:10.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68177890 con 0x7fea6800ebe0 2023-11-18T20:38:10.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea680356f0 con 0x7fea680073b0 2023-11-18T20:38:10.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7fea75811640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680073b0 0x7fea680c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7f5949370640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59440c1100 0x7f59441ec7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40120/0 (socket says 172.21.15.132:40120) 2023-11-18T20:38:10.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7f5949370640 1 -- 172.21.15.132:0/2277074883 learned_addr learned my addr 172.21.15.132:0/2277074883 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7f5949b71640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f594406e000 0x7f5944071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.754+0000 7fea76012640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea680d0fc0 0x7fea680351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f57f17fa640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57e006ae40 0x7f57e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7fea75811640 1 -- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 msgr2=0x7fea68034c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7fea75811640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea6800ebe0 0x7fea68034c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7fea75811640 1 -- 172.21.15.132:0/4175825990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea680d0fc0 msgr2=0x7fea680351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7fea75811640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea680d0fc0 0x7fea680351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7fea75811640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600094d0 con 0x7fea680073b0 2023-11-18T20:38:10.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57e8088930 con 0x7f57f414e7c0 2023-11-18T20:38:10.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f57f17fa640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7f57e0072fe0 0x7f57e0075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 --> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57e0075ab0 con 0x7f57e0072fe0 2023-11-18T20:38:10.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57e808d280 con 0x7f57f414e7c0 2023-11-18T20:38:10.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f7667fff640 1 -- 172.21.15.132:0/3676512799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 msgr2=0x7f76680c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f7667fff640 1 --2- 172.21.15.132:0/3676512799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 0x7f76680c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f7667fff640 1 -- 172.21.15.132:0/3676512799 >> v1:172.21.15.132:6789/0 conn(0x7f76680c4d20 legacy=0x7f7668152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f7667fff640 1 -- 172.21.15.132:0/3676512799 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680a7360 con 0x7f766814f9f0 2023-11-18T20:38:10.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f594a372640 1 -- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f594406e000 msgr2=0x7f5944071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f594a372640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f594406e000 0x7f5944071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f594a372640 1 -- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59440c1100 msgr2=0x7f59441ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f594a372640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59440c1100 0x7f59441ec7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f594a372640 1 -- 172.21.15.132:0/2277074883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c009a70 con 0x7f5944155f60 2023-11-18T20:38:10.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7fea75811640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680073b0 0x7fea680c4220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00e7e0 tx=0x7fea6c00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7f57f3fff640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7f57e0072fe0 0x7f57e0075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7f57f8b4c640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57e006ae40 0x7f57e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7f594a372640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5944155f60 0x7f59441ecce0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f593c033000 tx=0x7f593c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c004030 con 0x7fea680073b0 2023-11-18T20:38:10.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c004190 con 0x7fea680073b0 2023-11-18T20:38:10.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00c6d0 con 0x7fea680073b0 2023-11-18T20:38:10.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea680da5e0 con 0x7fea680073b0 2023-11-18T20:38:10.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.757+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c03f420 con 0x7f5944155f60 2023-11-18T20:38:10.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.753+0000 7f465a66d640 1 -- start start 2023-11-18T20:38:10.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f465a66d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46540ca450 0x7f46540ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f465a66d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4654154580 0x7f4654154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f465a66d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4654158a60 con 0x7f465414e7c0 2023-11-18T20:38:10.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f465a66d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540c5b10 con 0x7f4654154580 2023-11-18T20:38:10.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.755+0000 7f465a66d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540c4dd0 con 0x7f46540ca450 2023-11-18T20:38:10.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7f465966b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f465414e7c0 0x7f46540c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:55336/0 (socket says 172.21.15.132:55336) 2023-11-18T20:38:10.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.756+0000 7f465966b640 1 -- 172.21.15.132:0/19660684 learned_addr learned my addr 172.21.15.132:0/19660684 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:10.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.757+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c03f580 con 0x7f5944155f60 2023-11-18T20:38:10.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.757+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c03f950 con 0x7f5944155f60 2023-11-18T20:38:10.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.757+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59441550c0 con 0x7f5944155f60 2023-11-18T20:38:10.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.757+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5944070ec0 con 0x7f5944155f60 2023-11-18T20:38:10.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.757+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe700015410 con 0x7fe710072500 2023-11-18T20:38:10.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.757+0000 7f57f3fff640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7f57e0072fe0 0x7f57e0075400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.758+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea68177dc0 con 0x7fea680073b0 2023-11-18T20:38:10.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7f57f8b4c640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57e006ae40 0x7f57e006d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009a20 tx=0x7f57e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 <== osd.0 v2:172.21.15.132:6800/3421044779 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f57e0075ab0 con 0x7f57e0072fe0 2023-11-18T20:38:10.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f592c000fc0 con 0x7f5944155f60 2023-11-18T20:38:10.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.760+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d3c03b070 con 0x7f8d400ded90 2023-11-18T20:38:10.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.761+0000 7f8d2ffff640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8d3406ae70 0x7f8d3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7fe7067fc640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe6f406af10 0x7fe6f406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe700089f30 con 0x7fe710072500 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7fe7067fc640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fe6f40730b0 0x7fe6f40754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 --> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6f4075b80 con 0x7fe6f40730b0 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe700055050 con 0x7fe710072500 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.760+0000 7fe716058640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fe6f40730b0 0x7fe6f40754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.760+0000 7fe716058640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fe6f40730b0 0x7fe6f40754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.761+0000 7fe715857640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe6f406af10 0x7fe6f406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.762+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 <== osd.2 v2:172.21.15.132:6813/1610126075 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe6f4075b80 con 0x7fe6f40730b0 2023-11-18T20:38:10.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7f4653fff640 1 -- 172.21.15.132:0/19660684 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366378558 0 0) 0x7f4654158a60 con 0x7f465414e7c0 2023-11-18T20:38:10.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7f4653fff640 1 -- 172.21.15.132:0/19660684 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4644003520 con 0x7f465414e7c0 2023-11-18T20:38:10.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7f4658e6a640 1 --2- 172.21.15.132:0/19660684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46540ca450 0x7f46540ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7f4659e6c640 1 --2- 172.21.15.132:0/19660684 >> v2:172.21.15.132:3300/0 conn(0x7f4654154580 0x7f4654154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.760+0000 7f4659e6c640 1 -- 172.21.15.132:0/19660684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46540ca450 msgr2=0x7f46540ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.760+0000 7f4659e6c640 1 --2- 172.21.15.132:0/19660684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46540ca450 0x7f46540ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.760+0000 7f4659e6c640 1 -- 172.21.15.132:0/19660684 >> v1:172.21.15.161:6789/0 conn(0x7f465414e7c0 legacy=0x7f46540c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.760+0000 7f4659e6c640 1 -- 172.21.15.132:0/19660684 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654157ca0 con 0x7f4654154580 2023-11-18T20:38:10.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.759+0000 7f7667fff640 1 --2- 172.21.15.132:0/3676512799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f766814f9f0 0x7f766806dd20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7660009870 tx=0x7f766002b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c96c31b496c8bf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.761+0000 7f7666ffd640 1 -- 172.21.15.132:0/3676512799 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660030710 con 0x7f766814f9f0 2023-11-18T20:38:10.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.761+0000 7f7666ffd640 1 -- 172.21.15.132:0/3676512799 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766002e050 con 0x7f766814f9f0 2023-11-18T20:38:10.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.761+0000 7f7666ffd640 1 -- 172.21.15.132:0/3676512799 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660030710 con 0x7f766814f9f0 2023-11-18T20:38:10.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.762+0000 7f766e9d5640 1 -- 172.21.15.132:0/3676512799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f766814f9f0 msgr2=0x7f766806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.762+0000 7f766e9d5640 1 --2- 172.21.15.132:0/3676512799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f766814f9f0 0x7f766806dd20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7660009870 tx=0x7f766002b740 comp rx=0 tx=0).stop 2023-11-18T20:38:10.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7fe715857640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe6f406af10 0x7fe6f406d3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe70c034000 tx=0x7fe70c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f766e9d5640 1 -- 172.21.15.132:0/3676512799 shutdown_connections 2023-11-18T20:38:10.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f766e9d5640 1 --2- 172.21.15.132:0/3676512799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 0x7f76680c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f766e9d5640 1 --2- 172.21.15.132:0/3676512799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f766814f9f0 0x7f766806dd20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f766e9d5640 1 -- 172.21.15.132:0/3676512799 >> 172.21.15.132:0/3676512799 conn(0x7f76680c7dc0 msgr2=0x7f76680c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.762+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d3c0ab810 con 0x7f8d400ded90 2023-11-18T20:38:10.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.762+0000 7f8d2ffff640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f8d34073090 0x7f8d340754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.762+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 --> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d34075b60 con 0x7f8d34073090 2023-11-18T20:38:10.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.762+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d3c0abbc0 con 0x7f8d400ded90 2023-11-18T20:38:10.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f4659e6c640 1 --2- 172.21.15.132:0/19660684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4654154580 0x7f4654154a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097a0 tx=0x7f464c02b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3666294000da41d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f8d477fe640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8d3406ae70 0x7f8d3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f766e9d5640 1 -- 172.21.15.132:0/3676512799 shutdown_connections 2023-11-18T20:38:10.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f4653fff640 1 -- 172.21.15.132:0/19660684 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640001670 con 0x7f4654154580 2023-11-18T20:38:10.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f4653fff640 1 -- 172.21.15.132:0/19660684 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c02e050 con 0x7f4654154580 2023-11-18T20:38:10.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f4653fff640 1 -- 172.21.15.132:0/19660684 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c030730 con 0x7f4654154580 2023-11-18T20:38:10.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.764+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea6c00c830 con 0x7fea680073b0 2023-11-18T20:38:10.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.764+0000 7f766e9d5640 1 -- 172.21.15.132:0/3676512799 wait complete. 2023-11-18T20:38:10.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.763+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f593c03fab0 con 0x7f5944155f60 2023-11-18T20:38:10.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.764+0000 7f59427fc640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f592806ae40 0x7f592806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.764+0000 7f465a66d640 1 -- 172.21.15.132:0/19660684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4654154580 msgr2=0x7f4654154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.764+0000 7f465a66d640 1 --2- 172.21.15.132:0/19660684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4654154580 0x7f4654154a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097a0 tx=0x7f464c02b580 comp rx=0 tx=0).stop 2023-11-18T20:38:10.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f593c07b400 con 0x7f5944155f60 2023-11-18T20:38:10.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f59427fc640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7f5928073cc0 0x7f5928076160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f5949b71640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f592806ae40 0x7f592806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 --> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5928076830 con 0x7f5928073cc0 2023-11-18T20:38:10.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f593c07b1d0 con 0x7f5944155f60 2023-11-18T20:38:10.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7fea667fc640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea5406af10 0x7fea5406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea6800e6c0 con 0x7fea680073b0 2023-11-18T20:38:10.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f465a66d640 1 -- 172.21.15.132:0/19660684 shutdown_connections 2023-11-18T20:38:10.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f465a66d640 1 --2- 172.21.15.132:0/19660684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4654154580 0x7f4654154a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f465a66d640 1 --2- 172.21.15.132:0/19660684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46540ca450 0x7f46540ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f465a66d640 1 -- 172.21.15.132:0/19660684 >> 172.21.15.132:0/19660684 conn(0x7f46540abf00 msgr2=0x7f46540c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7f8d477fe640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8d3406ae70 0x7f8d3406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d38000c00 tx=0x7f8d38001ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.765+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea6c089570 con 0x7fea680073b0 2023-11-18T20:38:10.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7fea667fc640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fea540730b0 0x7fea540754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea54075b80 con 0x7fea540730b0 2023-11-18T20:38:10.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7fea75010640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea5406af10 0x7fea5406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea6c0093a0 con 0x7fea680073b0 2023-11-18T20:38:10.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7f465a66d640 1 -- 172.21.15.132:0/19660684 shutdown_connections 2023-11-18T20:38:10.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7f8d47fff640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f8d34073090 0x7f8d340754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7f5949370640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7f5928073cc0 0x7f5928076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7fea76012640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fea540730b0 0x7fea540754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7f766e9d5640 1 Processor -- start 2023-11-18T20:38:10.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7ff9d2d61640 1 Processor -- start 2023-11-18T20:38:10.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.767+0000 7f5949b71640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f592806ae40 0x7f592806d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5938007fd0 tx=0x7f5938007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.767+0000 7ff9d2d61640 1 -- start start 2023-11-18T20:38:10.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.767+0000 7f8d47fff640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f8d34073090 0x7f8d340754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.767+0000 7f766e9d5640 1 -- start start 2023-11-18T20:38:10.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.767+0000 7fea75010640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea5406af10 0x7fea5406d3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea60009870 tx=0x7fea6003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.768+0000 7fea76012640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fea540730b0 0x7fea540754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.768+0000 7f5949370640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7f5928073cc0 0x7f5928076160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.766+0000 7f465a66d640 1 -- 172.21.15.132:0/19660684 wait complete. 2023-11-18T20:38:10.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.768+0000 7f465a66d640 1 Processor -- start 2023-11-18T20:38:10.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.768+0000 7f766e9d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76680c4d20 0x7f7668155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f465a66d640 1 -- start start 2023-11-18T20:38:10.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f766e9d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 0x7f766806c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f766e9d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f766814f9f0 0x7f76681540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 <== osd.1 v2:172.21.15.132:6808/3030620385 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8d34075b60 con 0x7f8d34073090 2023-11-18T20:38:10.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f766e9d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7668151350 con 0x7f766814f9f0 2023-11-18T20:38:10.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f766e9d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7668147160 con 0x7f76680c4d20 2023-11-18T20:38:10.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f766e9d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680c2400 con 0x7f76680c7540 2023-11-18T20:38:10.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f7667fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76680c4d20 0x7f7668155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7ff9d2d61640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9cc0aa700 0x7ff9cc0c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7ff9d2d61640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff9cc0c06c0 0x7ff9cc0c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f7667fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76680c4d20 0x7f7668155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40134/0 (socket says 172.21.15.132:40134) 2023-11-18T20:38:10.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7f7667fff640 1 -- 172.21.15.132:0/3765228563 learned_addr learned my addr 172.21.15.132:0/3765228563 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.769+0000 7ff9d2d61640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c4870 0x7ff9cc0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f76677fe640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 0x7f766806c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7ff9d2d61640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0c3f10 con 0x7ff9cc0c06c0 2023-11-18T20:38:10.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7ff9d2d61640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc1517f0 con 0x7ff9cc0aa700 2023-11-18T20:38:10.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7ff9d2d61640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0c5af0 con 0x7ff9cc0c4870 2023-11-18T20:38:10.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 <== osd.3 v2:172.21.15.132:6818/121019578 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5928076830 con 0x7f5928073cc0 2023-11-18T20:38:10.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7ff9d12fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c4870 0x7ff9cc0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f766cf72640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f766814f9f0 0x7f76681540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f465a66d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46540ca450 0x7f4654153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f465a66d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f465414e7c0 0x7f4654153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f465a66d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4654154580 0x7f46541ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f465a66d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654153bc0 con 0x7f465414e7c0 2023-11-18T20:38:10.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f465a66d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540a9b80 con 0x7f46540ca450 2023-11-18T20:38:10.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.770+0000 7f465a66d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465414d7e0 con 0x7f4654154580 2023-11-18T20:38:10.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7ff9cbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff9cc0c06c0 0x7ff9cc0c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7ff9cbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff9cc0c06c0 0x7ff9cc0c0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57742/0 (socket says 172.21.15.132:57742) 2023-11-18T20:38:10.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7ff9cbfff640 1 -- 172.21.15.132:0/1672920148 learned_addr learned my addr 172.21.15.132:0/1672920148 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7ff9d0afd640 1 --2- 172.21.15.132:0/1672920148 >> v2:172.21.15.161:3300/0 conn(0x7ff9cc0aa700 0x7ff9cc0c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7f4659e6c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4654154580 0x7f46541ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7f7667fff640 1 -- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 msgr2=0x7f766806c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7f7667fff640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76680c7540 0x7f766806c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7f7667fff640 1 -- 172.21.15.132:0/3765228563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f766814f9f0 msgr2=0x7f76681540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7f7667fff640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f766814f9f0 0x7f76681540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7f7667fff640 1 -- 172.21.15.132:0/3765228563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600094d0 con 0x7f76680c4d20 2023-11-18T20:38:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.771+0000 7f465966b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46540ca450 0x7f4654153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7f465966b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46540ca450 0x7f4654153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40154/0 (socket says 172.21.15.132:40154) 2023-11-18T20:38:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7f465966b640 1 -- 172.21.15.132:0/2007387832 learned_addr learned my addr 172.21.15.132:0/2007387832 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7ff9cbfff640 1 -- 172.21.15.132:0/1672920148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c4870 msgr2=0x7ff9cc0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7ff9cbfff640 1 --2- 172.21.15.132:0/1672920148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c4870 0x7ff9cc0c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7ff9cbfff640 1 -- 172.21.15.132:0/1672920148 >> v2:172.21.15.161:3300/0 conn(0x7ff9cc0aa700 msgr2=0x7ff9cc0c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7ff9cbfff640 1 --2- 172.21.15.132:0/1672920148 >> v2:172.21.15.161:3300/0 conn(0x7ff9cc0aa700 0x7ff9cc0c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7ff9cbfff640 1 -- 172.21.15.132:0/1672920148 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0c3100 con 0x7ff9cc0c06c0 2023-11-18T20:38:10.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7f4658e6a640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f465414e7c0 0x7f4654153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 <== osd.4 v2:172.21.15.161:6800/3367196689 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fea54075b80 con 0x7fea540730b0 2023-11-18T20:38:10.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.772+0000 7f7667fff640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76680c4d20 0x7f7668155330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7660000c00 tx=0x7f76600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f4658e6a640 1 -- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4654154580 msgr2=0x7f46541ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f4658e6a640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4654154580 0x7f46541ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f4658e6a640 1 -- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46540ca450 msgr2=0x7f4654153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f4658e6a640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46540ca450 0x7f4654153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f4658e6a640 1 -- 172.21.15.132:0/2007387832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c009400 con 0x7f465414e7c0 2023-11-18T20:38:10.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660030710 con 0x7f76680c4d20 2023-11-18T20:38:10.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660030870 con 0x7f76680c4d20 2023-11-18T20:38:10.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660030c20 con 0x7f76680c4d20 2023-11-18T20:38:10.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7f4658e6a640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f465414e7c0 0x7f4654153680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f464800ebf0 tx=0x7f464800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.774+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7668151070 con 0x7f76680c4d20 2023-11-18T20:38:10.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.774+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7668151b20 con 0x7f76680c4d20 2023-11-18T20:38:10.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.773+0000 7ff9cbfff640 1 --2- 172.21.15.132:0/1672920148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0c06c0 0x7ff9cc0c0b00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0c69b0 tx=0x7ff9c002b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941a9a2eec99020c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.774+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800cda0 con 0x7f465414e7c0 2023-11-18T20:38:10.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.775+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465414dac0 con 0x7f465414e7c0 2023-11-18T20:38:10.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.775+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464800f040 con 0x7f465414e7c0 2023-11-18T20:38:10.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.775+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46480146c0 con 0x7f465414e7c0 2023-11-18T20:38:10.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.774+0000 7ff9cb7fe640 1 -- 172.21.15.132:0/1672920148 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0031760 con 0x7ff9cc0c06c0 2023-11-18T20:38:10.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.775+0000 7ff9cb7fe640 1 -- 172.21.15.132:0/1672920148 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c00318c0 con 0x7ff9cc0c06c0 2023-11-18T20:38:10.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.775+0000 7ff9cb7fe640 1 -- 172.21.15.132:0/1672920148 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0031c50 con 0x7ff9cc0c06c0 2023-11-18T20:38:10.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.775+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f766814fdd0 con 0x7f76680c4d20 2023-11-18T20:38:10.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.776+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465414c150 con 0x7f465414e7c0 2023-11-18T20:38:10.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.776+0000 7ff9d2d61640 1 -- 172.21.15.132:0/1672920148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0c06c0 msgr2=0x7ff9cc0c0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.776+0000 7ff9d2d61640 1 --2- 172.21.15.132:0/1672920148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0c06c0 0x7ff9cc0c0b00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0c69b0 tx=0x7ff9c002b800 comp rx=0 tx=0).stop 2023-11-18T20:38:10.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.777+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46540c5ed0 con 0x7f465414e7c0 2023-11-18T20:38:10.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.777+0000 7ff9d2d61640 1 -- 172.21.15.132:0/1672920148 shutdown_connections 2023-11-18T20:38:10.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.777+0000 7ff9d2d61640 1 --2- 172.21.15.132:0/1672920148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c4870 0x7ff9cc0c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.777+0000 7ff9d2d61640 1 --2- 172.21.15.132:0/1672920148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0c06c0 0x7ff9cc0c0b00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.777+0000 7ff9d2d61640 1 --2- 172.21.15.132:0/1672920148 >> v2:172.21.15.161:3300/0 conn(0x7ff9cc0aa700 0x7ff9cc0c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.777+0000 7ff9d2d61640 1 -- 172.21.15.132:0/1672920148 >> 172.21.15.132:0/1672920148 conn(0x7ff9cc0c5cc0 msgr2=0x7ff9cc0c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.777+0000 7ff9d2d61640 1 -- 172.21.15.132:0/1672920148 shutdown_connections 2023-11-18T20:38:10.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.777+0000 7ff9d2d61640 1 -- 172.21.15.132:0/1672920148 wait complete. 2023-11-18T20:38:10.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.781+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7660030d80 con 0x7f76680c4d20 2023-11-18T20:38:10.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.780+0000 7ff9d2d61640 1 Processor -- start 2023-11-18T20:38:10.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.780+0000 7ff9d2d61640 1 -- start start 2023-11-18T20:38:10.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.780+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4648014820 con 0x7f465414e7c0 2023-11-18T20:38:10.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.782+0000 7ff9d2d61640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0aa700 0x7ff9cc1e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.782+0000 7ff9d2d61640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c06c0 0x7ff9cc071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9d0afd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0aa700 0x7ff9cc1e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9d2d61640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc0c4870 0x7ff9cc14aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9d0afd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0aa700 0x7ff9cc1e6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57750/0 (socket says 172.21.15.132:57750) 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9d2d61640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1e7070 con 0x7ff9cc0aa700 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9d2d61640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1e7630 con 0x7ff9cc0c4870 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9d2d61640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1e6b60 con 0x7ff9cc0c06c0 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9d0afd640 1 -- 172.21.15.132:0/182360551 learned_addr learned my addr 172.21.15.132:0/182360551 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9cbfff640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c06c0 0x7ff9cc071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f4651ffb640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f463806ae40 0x7f463806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4648089590 con 0x7f465414e7c0 2023-11-18T20:38:10.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f4651ffb640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4638072fe0 0x7f4638075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 --> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4638075ab0 con 0x7f4638072fe0 2023-11-18T20:38:10.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4648089830 con 0x7f465414e7c0 2023-11-18T20:38:10.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7ff9d12fe640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc0c4870 0x7ff9cc14aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.782+0000 7f7664ff9640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f764806ae90 0x7f764806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.782+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76600ab770 con 0x7f76680c4d20 2023-11-18T20:38:10.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.782+0000 7f7664ff9640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f76480730b0 0x7f76480754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 --> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7648075b80 con 0x7f76480730b0 2023-11-18T20:38:10.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76600abae0 con 0x7f76680c4d20 2023-11-18T20:38:10.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f76677fe640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f764806ae90 0x7f764806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.783+0000 7f766cf72640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f76480730b0 0x7f76480754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.784+0000 7ff9d0afd640 1 -- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c06c0 msgr2=0x7ff9cc071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.784+0000 7ff9d0afd640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9cc0c06c0 0x7ff9cc071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.784+0000 7ff9d0afd640 1 -- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc0c4870 msgr2=0x7ff9cc14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.784+0000 7ff9d0afd640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc0c4870 0x7ff9cc14aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.784+0000 7ff9d0afd640 1 -- 172.21.15.132:0/182360551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c00094d0 con 0x7ff9cc0aa700 2023-11-18T20:38:10.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.785+0000 7f766cf72640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f76480730b0 0x7f76480754d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.784+0000 7f465966b640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f463806ae40 0x7f463806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.785+0000 7ff9d0afd640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0aa700 0x7ff9cc1e6620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8010bf0 tx=0x7ff9b800e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.785+0000 7f4659e6c640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4638072fe0 0x7f4638075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.785+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8015a60 con 0x7ff9cc0aa700 2023-11-18T20:38:10.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.785+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b8015bc0 con 0x7ff9cc0aa700 2023-11-18T20:38:10.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.785+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800eea0 con 0x7ff9cc0aa700 2023-11-18T20:38:10.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.786+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc154b40 con 0x7ff9cc0aa700 2023-11-18T20:38:10.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.786+0000 7f76677fe640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f764806ae90 0x7f764806d350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f766814e0e0 tx=0x7f7650008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.786+0000 7f4659e6c640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4638072fe0 0x7f4638075400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.786+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc1e72c0 con 0x7ff9cc0aa700 2023-11-18T20:38:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.787+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 --> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7100c6920 con 0x7fe6f40730b0 2023-11-18T20:38:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.787+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9cc0aaf20 con 0x7ff9cc0aa700 2023-11-18T20:38:10.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.787+0000 7f465966b640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f463806ae40 0x7f463806d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46400017a0 tx=0x7f4640001b30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.787+0000 7fe7067fc640 1 -- 172.21.15.132:0/3765607040 <== osd.2 v2:172.21.15.132:6813/1610126075 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7100c6920 con 0x7fe6f40730b0 2023-11-18T20:38:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.788+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 <== osd.6 v2:172.21.15.161:6824/176202877 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7648075b80 con 0x7f76480730b0 2023-11-18T20:38:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.788+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fe6f40730b0 msgr2=0x7fe6f40754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.788+0000 7fe716859640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fe6f40730b0 0x7fe6f40754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.789+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe6f406af10 msgr2=0x7fe6f406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.789+0000 7fe716859640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe6f406af10 0x7fe6f406d3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe70c034000 tx=0x7fe70c009030 comp rx=0 tx=0).stop 2023-11-18T20:38:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.789+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe710072500 msgr2=0x7fe71014fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.789+0000 7fe716859640 1 --2- 172.21.15.132:0/3765607040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe710072500 0x7fe71014fe40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe70000f4c0 tx=0x7fe70000f980 comp rx=0 tx=0).stop 2023-11-18T20:38:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.789+0000 7fe716058640 1 -- 172.21.15.132:0/3765607040 reap_dead start 2023-11-18T20:38:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.789+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 shutdown_connections 2023-11-18T20:38:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.789+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 >> 172.21.15.132:0/3765607040 conn(0x7fe7100c5b50 msgr2=0x7fe710151130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.789+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 <== osd.5 v2:172.21.15.161:6816/1224738200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4638075ab0 con 0x7f4638072fe0 2023-11-18T20:38:10.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.790+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 shutdown_connections 2023-11-18T20:38:10.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.790+0000 7fe716859640 1 -- 172.21.15.132:0/3765607040 wait complete. 2023-11-18T20:38:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.790+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9b801e400 con 0x7ff9cc0aa700 2023-11-18T20:38:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.791+0000 7ff9c97fa640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff9b006af10 0x7ff9b006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.792+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9b808e630 con 0x7ff9cc0aa700 2023-11-18T20:38:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.792+0000 7ff9c97fa640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7ff9b0073130 0x7ff9b0075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.792+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 --> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9b0075c00 con 0x7ff9b0073130 2023-11-18T20:38:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.792+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b808e9e0 con 0x7ff9cc0aa700 2023-11-18T20:38:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.792+0000 7ff9cbfff640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff9b006af10 0x7ff9b006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.793+0000 7ff9d12fe640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7ff9b0073130 0x7ff9b0075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.793+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 --> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57f4158540 con 0x7f57e0072fe0 2023-11-18T20:38:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.794+0000 7ff9d12fe640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7ff9b0073130 0x7ff9b0075550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.794+0000 7ff9cbfff640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff9b006af10 0x7ff9b006d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0036000 tx=0x7ff9c003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.794+0000 7f57f17fa640 1 -- 172.21.15.132:0/2995261394 <== osd.0 v2:172.21.15.132:6800/3421044779 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57ec009450 con 0x7f57e0072fe0 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.795+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7f57e0072fe0 msgr2=0x7f57e0075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.795+0000 7f57f9b4e640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7f57e0072fe0 0x7f57e0075400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.795+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57e006ae40 msgr2=0x7f57e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.795+0000 7f57f9b4e640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57e006ae40 0x7f57e006d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009a20 tx=0x7f57e4008040 comp rx=0 tx=0).stop 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.795+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57f414e7c0 msgr2=0x7f57f41edee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.795+0000 7f57f9b4e640 1 --2- 172.21.15.132:0/2995261394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57f414e7c0 0x7f57f41edee0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f57e800c780 tx=0x7f57e800cc40 comp rx=0 tx=0).stop 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.796+0000 7f57f934d640 1 -- 172.21.15.132:0/2995261394 reap_dead start 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.796+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 shutdown_connections 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.796+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 >> 172.21.15.132:0/2995261394 conn(0x7f57f40abf00 msgr2=0x7f57f4146bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.796+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 shutdown_connections 2023-11-18T20:38:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.796+0000 7f57f9b4e640 1 -- 172.21.15.132:0/2995261394 wait complete. 2023-11-18T20:38:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.799+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 <== osd.7 v2:172.21.15.161:6808/2126116111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff9b0075c00 con 0x7ff9b0073130 2023-11-18T20:38:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.800+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 --> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f592c002ca0 con 0x7f5928073cc0 2023-11-18T20:38:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.802+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 --> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d400057b0 con 0x7f8d34073090 2023-11-18T20:38:10.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.801+0000 7f59427fc640 1 -- 172.21.15.132:0/2277074883 <== osd.3 v2:172.21.15.132:6818/121019578 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f592c002ca0 con 0x7f5928073cc0 2023-11-18T20:38:10.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7f5928073cc0 msgr2=0x7f5928076160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f8d2ffff640 1 -- 172.21.15.132:0/1655997917 <== osd.1 v2:172.21.15.132:6808/3030620385 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d400057b0 con 0x7f8d34073090 2023-11-18T20:38:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594ab73640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7f5928073cc0 0x7f5928076160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f592806ae40 msgr2=0x7f592806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594ab73640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f592806ae40 0x7f592806d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5938007fd0 tx=0x7f5938007dc0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5944155f60 msgr2=0x7f59441ecce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594ab73640 1 --2- 172.21.15.132:0/2277074883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5944155f60 0x7f59441ecce0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f593c033000 tx=0x7f593c004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:10.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594a372640 1 -- 172.21.15.132:0/2277074883 reap_dead start 2023-11-18T20:38:10.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 shutdown_connections 2023-11-18T20:38:10.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.803+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 >> 172.21.15.132:0/2277074883 conn(0x7f59440a77f0 msgr2=0x7f59440a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.804+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 shutdown_connections 2023-11-18T20:38:10.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.804+0000 7f594ab73640 1 -- 172.21.15.132:0/2277074883 wait complete. 2023-11-18T20:38:10.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.806+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f8d34073090 msgr2=0x7f8d340754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.806+0000 7f8d4cc7e640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f8d34073090 0x7f8d340754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.806+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8d3406ae70 msgr2=0x7f8d3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.806+0000 7f8d4cc7e640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8d3406ae70 0x7f8d3406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d38000c00 tx=0x7f8d38001ab0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.807+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d400ded90 msgr2=0x7f8d4016fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.807+0000 7f8d4cc7e640 1 --2- 172.21.15.132:0/1655997917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d400ded90 0x7f8d4016fa10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c033000 tx=0x7f8d3c004730 comp rx=0 tx=0).stop 2023-11-18T20:38:10.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.808+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 --> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea6800e3e0 con 0x7fea540730b0 2023-11-18T20:38:10.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.808+0000 7f8d47fff640 1 -- 172.21.15.132:0/1655997917 reap_dead start 2023-11-18T20:38:10.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.808+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 shutdown_connections 2023-11-18T20:38:10.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.808+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 >> 172.21.15.132:0/1655997917 conn(0x7f8d400062b0 msgr2=0x7f8d400d82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.808+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 shutdown_connections 2023-11-18T20:38:10.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.808+0000 7f8d4cc7e640 1 -- 172.21.15.132:0/1655997917 wait complete. 2023-11-18T20:38:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.809+0000 7fea667fc640 1 -- 172.21.15.132:0/4175825990 <== osd.4 v2:172.21.15.161:6800/3367196689 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea7004f090 con 0x7fea540730b0 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fea540730b0 msgr2=0x7fea540754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fea540730b0 0x7fea540754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea5406af10 msgr2=0x7fea5406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea5406af10 0x7fea5406d3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea60009870 tx=0x7fea6003d040 comp rx=0 tx=0).stop 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680073b0 msgr2=0x7fea680c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 --2- 172.21.15.132:0/4175825990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea680073b0 0x7fea680c4220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00e7e0 tx=0x7fea6c00eca0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76012640 1 -- 172.21.15.132:0/4175825990 reap_dead start 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 shutdown_connections 2023-11-18T20:38:10.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 >> 172.21.15.132:0/4175825990 conn(0x7fea6804c5d0 msgr2=0x7fea680d9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 shutdown_connections 2023-11-18T20:38:10.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.810+0000 7fea76813640 1 -- 172.21.15.132:0/4175825990 wait complete. 2023-11-18T20:38:10.859 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:10.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-18T20:38:10.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.819+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 --> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4654158540 con 0x7f4638072fe0 2023-11-18T20:38:10.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.820+0000 7f4651ffb640 1 -- 172.21.15.132:0/2007387832 <== osd.5 v2:172.21.15.161:6816/1224738200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f464c030830 con 0x7f4638072fe0 2023-11-18T20:38:10.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.821+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4638072fe0 msgr2=0x7f4638075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.821+0000 7f465a66d640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4638072fe0 0x7f4638075400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.821+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f463806ae40 msgr2=0x7f463806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.821+0000 7f465a66d640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f463806ae40 0x7f463806d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46400017a0 tx=0x7f4640001b30 comp rx=0 tx=0).stop 2023-11-18T20:38:10.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.821+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f465414e7c0 msgr2=0x7f4654153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.821+0000 7f465a66d640 1 --2- 172.21.15.132:0/2007387832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f465414e7c0 0x7f4654153680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f464800ebf0 tx=0x7f464800c490 comp rx=0 tx=0).stop 2023-11-18T20:38:10.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.821+0000 7f4659e6c640 1 -- 172.21.15.132:0/2007387832 reap_dead start 2023-11-18T20:38:10.863 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:10.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-18T20:38:10.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.822+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 --> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76681516a0 con 0x7f76480730b0 2023-11-18T20:38:10.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.823+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 shutdown_connections 2023-11-18T20:38:10.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.823+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 >> 172.21.15.132:0/2007387832 conn(0x7f46540abf00 msgr2=0x7f465406c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.823+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 shutdown_connections 2023-11-18T20:38:10.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.823+0000 7f7664ff9640 1 -- 172.21.15.132:0/3765228563 <== osd.6 v2:172.21.15.161:6824/176202877 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76681516a0 con 0x7f76480730b0 2023-11-18T20:38:10.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.823+0000 7f465a66d640 1 -- 172.21.15.132:0/2007387832 wait complete. 2023-11-18T20:38:10.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f76480730b0 msgr2=0x7f76480754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766e9d5640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f76480730b0 0x7f76480754d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f764806ae90 msgr2=0x7f764806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766e9d5640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f764806ae90 0x7f764806d350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f766814e0e0 tx=0x7f7650008040 comp rx=0 tx=0).stop 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76680c4d20 msgr2=0x7f7668155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766e9d5640 1 --2- 172.21.15.132:0/3765228563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76680c4d20 0x7f7668155330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7660000c00 tx=0x7f76600046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766cf72640 1 -- 172.21.15.132:0/3765228563 reap_dead start 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 shutdown_connections 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.824+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 >> 172.21.15.132:0/3765228563 conn(0x7f76680c7dc0 msgr2=0x7f766806f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.825+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 shutdown_connections 2023-11-18T20:38:10.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.825+0000 7f766e9d5640 1 -- 172.21.15.132:0/3765228563 wait complete. 2023-11-18T20:38:10.867 INFO:teuthology.orchestra.run.smithi132.stdout:60129542151 2023-11-18T20:38:10.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T20:38:10.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.830+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 --> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff9cc0c4390 con 0x7ff9b0073130 2023-11-18T20:38:10.868 INFO:teuthology.orchestra.run.smithi132.stdout:60129542151 2023-11-18T20:38:10.868 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-18T20:38:10.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9c97fa640 1 -- 172.21.15.132:0/182360551 <== osd.7 v2:172.21.15.161:6808/2126116111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff9c4009cb0 con 0x7ff9b0073130 2023-11-18T20:38:10.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7ff9b0073130 msgr2=0x7ff9b0075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7ff9b0073130 0x7ff9b0075550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:10.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff9b006af10 msgr2=0x7ff9b006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff9b006af10 0x7ff9b006d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0036000 tx=0x7ff9c003d040 comp rx=0 tx=0).stop 2023-11-18T20:38:10.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0aa700 msgr2=0x7ff9cc1e6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:10.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 --2- 172.21.15.132:0/182360551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9cc0aa700 0x7ff9cc1e6620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8010bf0 tx=0x7ff9b800e730 comp rx=0 tx=0).stop 2023-11-18T20:38:10.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d12fe640 1 -- 172.21.15.132:0/182360551 reap_dead start 2023-11-18T20:38:10.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 shutdown_connections 2023-11-18T20:38:10.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 >> 172.21.15.132:0/182360551 conn(0x7ff9cc0c5cc0 msgr2=0x7ff9cc14e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:10.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.831+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 shutdown_connections 2023-11-18T20:38:10.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:10.832+0000 7ff9d2d61640 1 -- 172.21.15.132:0/182360551 wait complete. 2023-11-18T20:38:10.871 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:10.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-18T20:38:10.872 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:10.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T20:38:10.873 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:10.873 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-18T20:38:10.874 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:10.874 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-18T20:38:11.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.195+0000 7f3bd85fb640 1 Processor -- start 2023-11-18T20:38:11.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.195+0000 7f3bd85fb640 1 -- start start 2023-11-18T20:38:11.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.198+0000 7f3bd85fb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3bc80d3b00 0x7f3bc8046ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.198+0000 7f3bd85fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bc804b0d0 0x7f3bc8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd6397640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3bc80d3b00 0x7f3bc8046ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd85fb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc80073a0 0x7f3bc80d66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd6397640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3bc80d3b00 0x7f3bc8046ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40176/0 (socket says 172.21.15.132:40176) 2023-11-18T20:38:11.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd6397640 1 -- 172.21.15.132:0/92265006 learned_addr learned my addr 172.21.15.132:0/92265006 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd85fb640 1 -- 172.21.15.132:0/92265006 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc8047010 con 0x7f3bc804b0d0 2023-11-18T20:38:11.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd85fb640 1 -- 172.21.15.132:0/92265006 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc80d9c20 con 0x7f3bc80d3b00 2023-11-18T20:38:11.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd85fb640 1 -- 172.21.15.132:0/92265006 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80d9f00 con 0x7f3bc80073a0 2023-11-18T20:38:11.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd6b98640 1 --2- 172.21.15.132:0/92265006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc80073a0 0x7f3bc80d66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.199+0000 7f3bd5b96640 1 --2- 172.21.15.132:0/92265006 >> v2:172.21.15.132:3300/0 conn(0x7f3bc804b0d0 0x7f3bc8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.200+0000 7f3bd5b96640 1 -- 172.21.15.132:0/92265006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc80073a0 msgr2=0x7f3bc80d66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.200+0000 7f3bd5b96640 1 --2- 172.21.15.132:0/92265006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc80073a0 0x7f3bc80d66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.200+0000 7f3bd5b96640 1 -- 172.21.15.132:0/92265006 >> v2:172.21.15.161:3300/0 conn(0x7f3bc80d3b00 msgr2=0x7f3bc8046ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.200+0000 7f3bd5b96640 1 --2- 172.21.15.132:0/92265006 >> v2:172.21.15.161:3300/0 conn(0x7f3bc80d3b00 0x7f3bc8046ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.200+0000 7f3bd5b96640 1 -- 172.21.15.132:0/92265006 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80da1e0 con 0x7f3bc804b0d0 2023-11-18T20:38:11.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.202+0000 7f3bd5b96640 1 --2- 172.21.15.132:0/92265006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc804b0d0 0x7f3bc8006e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0050140 tx=0x7f3bd00a8390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f677351a40f69c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.200+0000 7fb794fe9640 1 Processor -- start 2023-11-18T20:38:11.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.200+0000 7fb794fe9640 1 -- start start 2023-11-18T20:38:11.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.202+0000 7fb794fe9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb78804dfb0 0x7fb78804e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.202+0000 7fb794fe9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78800f990 con 0x7fb78804daa0 2023-11-18T20:38:11.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.202+0000 7fb794fe9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880da470 con 0x7fb7880d7aa0 2023-11-18T20:38:11.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.202+0000 7fb794fe9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880da750 con 0x7fb78804dfb0 2023-11-18T20:38:11.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.203+0000 7f3bd5395640 1 -- 172.21.15.132:0/92265006 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00b0440 con 0x7f3bc804b0d0 2023-11-18T20:38:11.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.203+0000 7f3bd5395640 1 -- 172.21.15.132:0/92265006 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd00b05e0 con 0x7f3bc804b0d0 2023-11-18T20:38:11.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.203+0000 7f3bd5395640 1 -- 172.21.15.132:0/92265006 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00b0a10 con 0x7f3bc804b0d0 2023-11-18T20:38:11.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.203+0000 7fb78e59c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb7880d7aa0 0x7fb788007170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:55352/0 (socket says 172.21.15.132:55352) 2023-11-18T20:38:11.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.203+0000 7fb78e59c640 1 -- 172.21.15.132:0/2439732858 learned_addr learned my addr 172.21.15.132:0/2439732858 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:11.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.204+0000 7f3bd85fb640 1 -- 172.21.15.132:0/92265006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc804b0d0 msgr2=0x7f3bc8006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.204+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/92265006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc804b0d0 0x7f3bc8006e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0050140 tx=0x7f3bd00a8390 comp rx=0 tx=0).stop 2023-11-18T20:38:11.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.204+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229007790 0 0) 0x7fb7880da470 con 0x7fb7880d7aa0 2023-11-18T20:38:11.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.204+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb778003520 con 0x7fb7880d7aa0 2023-11-18T20:38:11.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692854329 0 0) 0x7fb78800f990 con 0x7fb78804daa0 2023-11-18T20:38:11.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7880da470 con 0x7fb78804daa0 2023-11-18T20:38:11.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7f3bd85fb640 1 -- 172.21.15.132:0/92265006 shutdown_connections 2023-11-18T20:38:11.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/92265006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc80073a0 0x7f3bc80d66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/92265006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc804b0d0 0x7f3bc8006e60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/92265006 >> v2:172.21.15.161:3300/0 conn(0x7f3bc80d3b00 0x7f3bc8046ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7f3bd85fb640 1 -- 172.21.15.132:0/92265006 >> 172.21.15.132:0/92265006 conn(0x7f3bc8048210 msgr2=0x7f3bc8048620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1621696044 0 0) 0x7fb778003520 con 0x7fb7880d7aa0 2023-11-18T20:38:11.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 >> v2:172.21.15.161:3300/0 conn(0x7fb78804dfb0 msgr2=0x7fb78804e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7fb78d59a640 1 --2- 172.21.15.132:0/2439732858 >> v2:172.21.15.161:3300/0 conn(0x7fb78804dfb0 0x7fb78804e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 >> v1:172.21.15.132:6789/0 conn(0x7fb78804daa0 legacy=0x7fb78804ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880daa30 con 0x7fb7880d7aa0 2023-11-18T20:38:11.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fb780001670 con 0x7fb7880d7aa0 2023-11-18T20:38:11.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 >> v1:172.21.15.161:6789/0 conn(0x7fb7880d7aa0 legacy=0x7fb788007170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb778003b00 0x7fb778003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7780047c0 0x7fb778004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7780051d0 0x7fb77800ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790073050 con 0x7fb778003b00 2023-11-18T20:38:11.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880da750 con 0x7fb7780047c0 2023-11-18T20:38:11.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77800c220 con 0x7fb7780051d0 2023-11-18T20:38:11.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.205+0000 7f3bd85fb640 1 -- 172.21.15.132:0/92265006 shutdown_connections 2023-11-18T20:38:11.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7fb78e59c640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb778003b00 0x7fb778003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.207+0000 7fb78ed9d640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7780051d0 0x7fb77800ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.206+0000 7f3bd85fb640 1 -- 172.21.15.132:0/92265006 wait complete. 2023-11-18T20:38:11.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.207+0000 7fb78e59c640 1 -- 172.21.15.132:0/2439732858 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7780051d0 msgr2=0x7fb77800ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.207+0000 7fb78e59c640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7780051d0 0x7fb77800ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.207+0000 7fb78e59c640 1 -- 172.21.15.132:0/2439732858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7780047c0 msgr2=0x7fb778004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.207+0000 7fb78e59c640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7780047c0 0x7fb778004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.207+0000 7fb78e59c640 1 -- 172.21.15.132:0/2439732858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778003520 con 0x7fb778003b00 2023-11-18T20:38:11.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.208+0000 7fb78ed9d640 1 -- 172.21.15.132:0/2439732858 reap_dead start 2023-11-18T20:38:11.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.209+0000 7f3bd85fb640 1 Processor -- start 2023-11-18T20:38:11.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.209+0000 7f3bd85fb640 1 -- start start 2023-11-18T20:38:11.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.209+0000 7fb78e59c640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb778003b00 0x7fb778003ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c190 tx=0x7fb7780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cecba6ebff645f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.210+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780005ad0 con 0x7fb778003b00 2023-11-18T20:38:11.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.210+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780005c30 con 0x7fb778003b00 2023-11-18T20:38:11.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.210+0000 7fb78d59a640 1 -- 172.21.15.132:0/2439732858 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780005ad0 con 0x7fb778003b00 2023-11-18T20:38:11.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.211+0000 7fb794fe9640 1 -- 172.21.15.132:0/2439732858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb778003b00 msgr2=0x7fb778003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.211+0000 7fb794fe9640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb778003b00 0x7fb778003ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c190 tx=0x7fb7780057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.211+0000 7fb794fe9640 1 -- 172.21.15.132:0/2439732858 shutdown_connections 2023-11-18T20:38:11.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.211+0000 7fb794fe9640 1 --2- 172.21.15.132:0/2439732858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb778003b00 0x7fb778003ee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.211+0000 7fb794fe9640 1 -- 172.21.15.132:0/2439732858 >> 172.21.15.132:0/2439732858 conn(0x7fb78804c620 msgr2=0x7fb78804ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.211+0000 7f3bd85fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc80073a0 0x7f3bc802cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.212+0000 7fb794fe9640 1 -- 172.21.15.132:0/2439732858 shutdown_connections 2023-11-18T20:38:11.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.212+0000 7fb794fe9640 1 -- 172.21.15.132:0/2439732858 wait complete. 2023-11-18T20:38:11.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.212+0000 7f3bd85fb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc804b0d0 0x7f3bc80d8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.212+0000 7f3bd6397640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc80073a0 0x7f3bc802cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.212+0000 7f3bd85fb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc80d3b00 0x7f3bc80d1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.212+0000 7f3bd85fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc816c680 con 0x7f3bc80073a0 2023-11-18T20:38:11.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.212+0000 7f3bd85fb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc802b0e0 con 0x7f3bc80d3b00 2023-11-18T20:38:11.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.212+0000 7f3bd85fb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc816c0e0 con 0x7f3bc804b0d0 2023-11-18T20:38:11.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.213+0000 7f3bd5b96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc804b0d0 0x7f3bc80d8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.213+0000 7f3bd6397640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc80073a0 0x7f3bc802cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57790/0 (socket says 172.21.15.132:57790) 2023-11-18T20:38:11.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.213+0000 7f3bd6397640 1 -- 172.21.15.132:0/3071896192 learned_addr learned my addr 172.21.15.132:0/3071896192 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.213+0000 7f3bd6b98640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc80d3b00 0x7f3bc80d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.213+0000 7f7b45b33640 1 Processor -- start 2023-11-18T20:38:11.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.214+0000 7f3bd6397640 1 -- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc804b0d0 msgr2=0x7f3bc80d8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.214+0000 7f3bd6397640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc804b0d0 0x7f3bc80d8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.214+0000 7f3bd6397640 1 -- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc80d3b00 msgr2=0x7f3bc80d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.214+0000 7f3bd6397640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc80d3b00 0x7f3bc80d1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.214+0000 7f3bd6397640 1 -- 172.21.15.132:0/3071896192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd004f730 con 0x7f3bc80073a0 2023-11-18T20:38:11.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.215+0000 7fb794fe9640 1 Processor -- start 2023-11-18T20:38:11.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.215+0000 7fb794fe9640 1 -- start start 2023-11-18T20:38:11.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.215+0000 7f12dbfff640 1 Processor -- start 2023-11-18T20:38:11.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.216+0000 7f12dbfff640 1 -- start start 2023-11-18T20:38:11.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.214+0000 7f7b45b33640 1 -- start start 2023-11-18T20:38:11.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7fb794fe9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb778003b00 0x7fb7880d9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7fb794fe9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7880d8c50 0x7fb788030830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7fb794fe9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78816cd80 0x7fb78816d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7fb794fe9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880dc260 con 0x7fb78816cd80 2023-11-18T20:38:11.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7fb794fe9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880d9dc0 con 0x7fb778003b00 2023-11-18T20:38:11.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7fb794fe9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880da0a0 con 0x7fb7880d8c50 2023-11-18T20:38:11.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.216+0000 7f3bd6397640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc80073a0 0x7f3bc802cc60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00d6c0 tx=0x7f3bcc00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/3071896192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00f040 con 0x7f3bc80073a0 2023-11-18T20:38:11.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/3071896192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00b820 con 0x7f3bc80073a0 2023-11-18T20:38:11.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/3071896192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00bbb0 con 0x7f3bc80073a0 2023-11-18T20:38:11.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc816c3a0 con 0x7f3bc80073a0 2023-11-18T20:38:11.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.217+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc8042c70 con 0x7f3bc80073a0 2023-11-18T20:38:11.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.218+0000 7f7b45b33640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b40159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.218+0000 7f7b45b33640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7b400c2e60 0x7f7b40163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.218+0000 7f7b45b33640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4006d580 con 0x7f7b400c1ca0 2023-11-18T20:38:11.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.218+0000 7f7b45b33640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4006dd60 con 0x7f7b400c2e60 2023-11-18T20:38:11.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.218+0000 7f7b45b33640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c6580 con 0x7f7b40155fc0 2023-11-18T20:38:11.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f12dbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f12d4047470 0x7f12d4006e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f12dbfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12d40073b0 0x7f12d400a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f12dbfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d400a3f0 con 0x7f12d40dbcb0 2023-11-18T20:38:11.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f12dbfff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d400bb20 con 0x7f12d4047470 2023-11-18T20:38:11.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f12dbfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4048030 con 0x7f12d40073b0 2023-11-18T20:38:11.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.220+0000 7f12daffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f12d40dbcb0 0x7f12d40df150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:55362/0 (socket says 172.21.15.132:55362) 2023-11-18T20:38:11.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7fb78e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb778003b00 0x7fb7880d9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7fb78e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb778003b00 0x7fb7880d9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40218/0 (socket says 172.21.15.132:40218) 2023-11-18T20:38:11.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7fb78e59c640 1 -- 172.21.15.132:0/1418251331 learned_addr learned my addr 172.21.15.132:0/1418251331 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.220+0000 7f12daffd640 1 -- 172.21.15.132:0/1488923157 learned_addr learned my addr 172.21.15.132:0/1488923157 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:11.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.220+0000 7fb78dd9b640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7880d8c50 0x7fb788030830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7b400c1ca0 0x7f7b400c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48688/0 (socket says 172.21.15.132:48688) 2023-11-18T20:38:11.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3effd640 1 -- 172.21.15.132:0/2733604515 learned_addr learned my addr 172.21.15.132:0/2733604515 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:11.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3ffff640 1 --2- 172.21.15.132:0/2733604515 >> v2:172.21.15.161:3300/0 conn(0x7f7b400c2e60 0x7f7b40163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.220+0000 7fb78ed9d640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78816cd80 0x7fb78816d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3f7fe640 1 --2- 172.21.15.132:0/2733604515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b40159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3e7fc640 1 -- 172.21.15.132:0/2733604515 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22951962 0 0) 0x7f7b4006d580 con 0x7f7b400c1ca0 2023-11-18T20:38:11.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3ffff640 1 -- 172.21.15.132:0/2733604515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 msgr2=0x7f7b40159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3ffff640 1 --2- 172.21.15.132:0/2733604515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b40159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3ffff640 1 -- 172.21.15.132:0/2733604515 >> v1:172.21.15.132:6789/0 conn(0x7f7b400c1ca0 legacy=0x7f7b400c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7f7b3ffff640 1 -- 172.21.15.132:0/2733604515 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400726d0 con 0x7f7b400c2e60 2023-11-18T20:38:11.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.220+0000 7f12da7fc640 1 --2- 172.21.15.132:0/1488923157 >> v2:172.21.15.161:3300/0 conn(0x7f12d4047470 0x7f12d4006e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.220+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260918673 0 0) 0x7f12d400a3f0 con 0x7f12d40dbcb0 2023-11-18T20:38:11.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c4003520 con 0x7f12d40dbcb0 2023-11-18T20:38:11.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fb78e59c640 1 -- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7880d8c50 msgr2=0x7fb788030830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fb78e59c640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7880d8c50 0x7fb788030830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.219+0000 7fd234b41640 1 Processor -- start 2023-11-18T20:38:11.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.220+0000 7fd234b41640 1 -- start start 2023-11-18T20:38:11.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fb78e59c640 1 -- 172.21.15.132:0/1418251331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78816cd80 msgr2=0x7fb78816d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fb78e59c640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78816cd80 0x7fb78816d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fb78e59c640 1 -- 172.21.15.132:0/1418251331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880dbc10 con 0x7fb778003b00 2023-11-18T20:38:11.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fd234b41640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd230070560 0x7fd2300c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fd234b41640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd2300c5cc0 0x7fd2300c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fd234b41640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd230158b50 con 0x7fd2300c2040 2023-11-18T20:38:11.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fd234b41640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2301597b0 con 0x7fd230070560 2023-11-18T20:38:11.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7fd234b41640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd230158e10 con 0x7fd2300c5cc0 2023-11-18T20:38:11.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc8005350 con 0x7f3bc80073a0 2023-11-18T20:38:11.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1484614795 0 0) 0x7f12c4003520 con 0x7f12d40dbcb0 2023-11-18T20:38:11.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12d40073b0 msgr2=0x7f12d400a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7f12d9ffb640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12d40073b0 0x7f12d400a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7fd22e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd230070560 0x7fd2300c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 >> v2:172.21.15.161:3300/0 conn(0x7f12d4047470 msgr2=0x7f12d4006e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7fd22ed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd2300c5cc0 0x7fd2300c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7fd22ed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd2300c5cc0 0x7fd2300c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40250/0 (socket says 172.21.15.132:40250) 2023-11-18T20:38:11.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7fd22ed9d640 1 -- 172.21.15.132:0/3045032168 learned_addr learned my addr 172.21.15.132:0/3045032168 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.221+0000 7f12d9ffb640 1 --2- 172.21.15.132:0/1488923157 >> v2:172.21.15.161:3300/0 conn(0x7f12d4047470 0x7f12d4006e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d400a0c0 con 0x7f12d40dbcb0 2023-11-18T20:38:11.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f12cc001670 con 0x7f12d40dbcb0 2023-11-18T20:38:11.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 >> v1:172.21.15.161:6789/0 conn(0x7f12d40dbcb0 legacy=0x7f12d40df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12c4003970 0x7f12c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12c40047c0 0x7f12c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4005180 0x7f12c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.223+0000 7f7b3ffff640 1 --2- 172.21.15.132:0/2733604515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c2e60 0x7f7b40163370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009d90 tx=0x7f7b3802bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5096897a53dec62c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d400bb20 con 0x7f12c4003970 2023-11-18T20:38:11.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4048030 con 0x7f12c4005180 2023-11-18T20:38:11.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.222+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c400c0d0 con 0x7f12c40047c0 2023-11-18T20:38:11.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.223+0000 7f12daffd640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12c4003970 0x7f12c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.223+0000 7f12da7fc640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12c40047c0 0x7f12c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.223+0000 7f12db7fe640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4005180 0x7f12c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.223+0000 7f7b3e7fc640 1 -- 172.21.15.132:0/2733604515 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3802cb40 con 0x7f7b400c2e60 2023-11-18T20:38:11.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f7b3e7fc640 1 -- 172.21.15.132:0/2733604515 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3802cca0 con 0x7f7b400c2e60 2023-11-18T20:38:11.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f7b3e7fc640 1 -- 172.21.15.132:0/2733604515 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38034660 con 0x7f7b400c2e60 2023-11-18T20:38:11.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7fb78e59c640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb778003b00 0x7fb7880d9770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb78002c3d0 tx=0x7fb780001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/3071896192 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3bcc00bd10 con 0x7f3bc80073a0 2023-11-18T20:38:11.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7fb77effd640 1 -- 172.21.15.132:0/1418251331 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78003c070 con 0x7fb778003b00 2023-11-18T20:38:11.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7fb77effd640 1 -- 172.21.15.132:0/1418251331 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78002cb00 con 0x7fb778003b00 2023-11-18T20:38:11.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7fb77effd640 1 -- 172.21.15.132:0/1418251331 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780007070 con 0x7fb778003b00 2023-11-18T20:38:11.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f12daffd640 1 -- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12c40047c0 msgr2=0x7f12c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f12daffd640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12c40047c0 0x7f12c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f12daffd640 1 -- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4005180 msgr2=0x7f12c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f12daffd640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4005180 0x7f12c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f12daffd640 1 -- 172.21.15.132:0/1488923157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4003520 con 0x7f12c4003970 2023-11-18T20:38:11.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7880dbef0 con 0x7fb778003b00 2023-11-18T20:38:11.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7f2732d1d640 1 Processor -- start 2023-11-18T20:38:11.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7fd22e59c640 1 -- 172.21.15.132:0/3045032168 >> v2:172.21.15.161:3300/0 conn(0x7fd2300c5cc0 msgr2=0x7fd2300c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7fd22e59c640 1 --2- 172.21.15.132:0/3045032168 >> v2:172.21.15.161:3300/0 conn(0x7fd2300c5cc0 0x7fd2300c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7fd22e59c640 1 -- 172.21.15.132:0/3045032168 >> v1:172.21.15.132:6789/0 conn(0x7fd2300c2040 legacy=0x7fd23006cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7fd22e59c640 1 -- 172.21.15.132:0/3045032168 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2301590f0 con 0x7fd230070560 2023-11-18T20:38:11.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7880d9090 con 0x7fb778003b00 2023-11-18T20:38:11.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.226+0000 7fd22ed9d640 1 --2- 172.21.15.132:0/3045032168 >> v2:172.21.15.161:3300/0 conn(0x7fd2300c5cc0 0x7fd2300c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:38:11.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7f3bc6ffd640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3bb406af10 0x7f3bb406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.226+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/3071896192 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bcc0897d0 con 0x7f3bc80073a0 2023-11-18T20:38:11.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f7b45b33640 1 -- 172.21.15.132:0/2733604515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c2e60 msgr2=0x7f7b40163370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.224+0000 7f7b45b33640 1 --2- 172.21.15.132:0/2733604515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c2e60 0x7f7b40163370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009d90 tx=0x7f7b3802bd90 comp rx=0 tx=0).stop 2023-11-18T20:38:11.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7f7b45b33640 1 -- 172.21.15.132:0/2733604515 shutdown_connections 2023-11-18T20:38:11.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7f7b45b33640 1 --2- 172.21.15.132:0/2733604515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c2e60 0x7f7b40163370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7f7b45b33640 1 --2- 172.21.15.132:0/2733604515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b40159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7f7b45b33640 1 -- 172.21.15.132:0/2733604515 >> 172.21.15.132:0/2733604515 conn(0x7f7b4006a500 msgr2=0x7f7b4006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7f7b45b33640 1 -- 172.21.15.132:0/2733604515 shutdown_connections 2023-11-18T20:38:11.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.225+0000 7f2732d1d640 1 -- start start 2023-11-18T20:38:11.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.226+0000 7f7b45b33640 1 -- 172.21.15.132:0/2733604515 wait complete. 2023-11-18T20:38:11.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.227+0000 7f3bd5b96640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3bb406af10 0x7f3bb406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.227+0000 7fd22e59c640 1 --2- 172.21.15.132:0/3045032168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd2300c7250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd23006ca10 tx=0x7fd22002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316819b28d3e7b13 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.227+0000 7f12daffd640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12c4003970 0x7f12c4003d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c190 tx=0x7f12c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b465c6e43a34f03 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.227+0000 7f2732d1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c155fc0 0x7f272c159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.227+0000 7f2732d1d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f272c0c1ca0 0x7f272c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.227+0000 7f2732d1d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c06d580 con 0x7f272c071e30 2023-11-18T20:38:11.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.227+0000 7f2732d1d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c06dd60 con 0x7f272c0c1ca0 2023-11-18T20:38:11.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.227+0000 7f2732d1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0c6580 con 0x7f272c155fc0 2023-11-18T20:38:11.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.228+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7880dc080 con 0x7fb778003b00 2023-11-18T20:38:11.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.228+0000 7f3bd5b96640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3bb406af10 0x7f3bb406d3d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80490d0 tx=0x7f3bd00bb040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.228+0000 7f2730ab9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c155fc0 0x7f272c159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.228+0000 7f2723fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f272c0c1ca0 0x7f272c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.228+0000 7f2723fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f272c0c1ca0 0x7f272c0c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40260/0 (socket says 172.21.15.132:40260) 2023-11-18T20:38:11.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.228+0000 7f2723fff640 1 -- 172.21.15.132:0/3685703285 learned_addr learned my addr 172.21.15.132:0/3685703285 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.228+0000 7f729df01640 1 Processor -- start 2023-11-18T20:38:11.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.229+0000 7f729df01640 1 -- start start 2023-11-18T20:38:11.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.229+0000 7f2730ab9640 1 -- 172.21.15.132:0/3685703285 >> v2:172.21.15.161:3300/0 conn(0x7f272c0c1ca0 msgr2=0x7f272c0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.229+0000 7f2730ab9640 1 --2- 172.21.15.132:0/3685703285 >> v2:172.21.15.161:3300/0 conn(0x7f272c0c1ca0 0x7f272c0c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.229+0000 7f2730ab9640 1 -- 172.21.15.132:0/3685703285 >> v1:172.21.15.161:6789/0 conn(0x7f272c071e30 legacy=0x7f272c15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.229+0000 7f2730ab9640 1 -- 172.21.15.132:0/3685703285 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0726d0 con 0x7f272c155fc0 2023-11-18T20:38:11.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.229+0000 7f7b45b33640 1 Processor -- start 2023-11-18T20:38:11.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.230+0000 7f7b45b33640 1 -- start start 2023-11-18T20:38:11.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.230+0000 7fb77effd640 1 -- 172.21.15.132:0/1418251331 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb780032070 con 0x7fb778003b00 2023-11-18T20:38:11.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.230+0000 7f729df01640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72980c7e90 0x7f72980c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.230+0000 7f729df01640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f72980c4e50 0x7f729806b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.230+0000 7f729df01640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72980bd8d0 con 0x7f729814e810 2023-11-18T20:38:11.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.230+0000 7f729df01640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72980c6e60 con 0x7f72980c7e90 2023-11-18T20:38:11.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.230+0000 7f729df01640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72980c70d0 con 0x7f72980c4e50 2023-11-18T20:38:11.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.231+0000 7f728ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72980c7e90 0x7f72980c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.231+0000 7f2730ab9640 1 --2- 172.21.15.132:0/3685703285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c155fc0 0x7f272c159470 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f271c009d90 tx=0x7f271c02bbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f872bfb28bcfda server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.231+0000 7f728ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72980c7e90 0x7f72980c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57828/0 (socket says 172.21.15.132:57828) 2023-11-18T20:38:11.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.231+0000 7f728ffff640 1 -- 172.21.15.132:0/1917781116 learned_addr learned my addr 172.21.15.132:0/1917781116 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.231+0000 7f7297fff640 1 --2- 172.21.15.132:0/1917781116 >> v2:172.21.15.161:3300/0 conn(0x7f72980c4e50 0x7f729806b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.231+0000 7f7b45b33640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c1ca0 0x7f7b401efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.231+0000 7f272bfff640 1 -- 172.21.15.132:0/3685703285 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c02d900 con 0x7f272c155fc0 2023-11-18T20:38:11.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f728ffff640 1 -- 172.21.15.132:0/1917781116 >> v2:172.21.15.161:3300/0 conn(0x7f72980c4e50 msgr2=0x7f729806b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:11.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f728ffff640 1 --2- 172.21.15.132:0/1917781116 >> v2:172.21.15.161:3300/0 conn(0x7f72980c4e50 0x7f729806b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f728ffff640 1 -- 172.21.15.132:0/1917781116 >> v1:172.21.15.161:6789/0 conn(0x7f729814e810 legacy=0x7f72981550c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-18T20:38:11.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f272bfff640 1 -- 172.21.15.132:0/3685703285 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c02da60 con 0x7f272c155fc0 2023-11-18T20:38:11.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f272bfff640 1 -- 172.21.15.132:0/3685703285 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c02ddf0 con 0x7f272c155fc0 2023-11-18T20:38:11.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f728ffff640 1 -- 172.21.15.132:0/1917781116 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980c73b0 con 0x7f72980c7e90 2023-11-18T20:38:11.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.231+0000 7f7b45b33640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b400c2e60 0x7f7b40150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7fb77effd640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb77006ae40 0x7fb77006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7fb77effd640 1 -- 172.21.15.132:0/1418251331 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7800aa540 con 0x7fb778003b00 2023-11-18T20:38:11.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7fb78dd9b640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb77006ae40 0x7fb77006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f7b45b33640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b400a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f7b45b33640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400bb8a0 con 0x7f7b400c2e60 2023-11-18T20:38:11.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f7b45b33640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401f2a90 con 0x7f7b400c1ca0 2023-11-18T20:38:11.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f7b45b33640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4006a950 con 0x7f7b40155fc0 2023-11-18T20:38:11.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.232+0000 7f7b3effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b400c2e60 0x7f7b40150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b400c2e60 0x7f7b40150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57840/0 (socket says 172.21.15.132:57840) 2023-11-18T20:38:11.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3effd640 1 -- 172.21.15.132:0/4292205637 learned_addr learned my addr 172.21.15.132:0/4292205637 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3f7fe640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c1ca0 0x7f7b401efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7fe116d68640 1 Processor -- start 2023-11-18T20:38:11.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f2732d1d640 1 -- 172.21.15.132:0/3685703285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c155fc0 msgr2=0x7f272c159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f2732d1d640 1 --2- 172.21.15.132:0/3685703285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c155fc0 0x7f272c159470 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f271c009d90 tx=0x7f271c02bbc0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7fd22dd9b640 1 -- 172.21.15.132:0/3045032168 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22002cbe0 con 0x7fd230070560 2023-11-18T20:38:11.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7fd22dd9b640 1 -- 172.21.15.132:0/3045032168 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22002cd40 con 0x7fd230070560 2023-11-18T20:38:11.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7fd22dd9b640 1 -- 172.21.15.132:0/3045032168 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220034660 con 0x7fd230070560 2023-11-18T20:38:11.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3ffff640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b400a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f2732d1d640 1 -- 172.21.15.132:0/3685703285 shutdown_connections 2023-11-18T20:38:11.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f2732d1d640 1 --2- 172.21.15.132:0/3685703285 >> v2:172.21.15.161:3300/0 conn(0x7f272c0c1ca0 0x7f272c0c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f2732d1d640 1 --2- 172.21.15.132:0/3685703285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c155fc0 0x7f272c159470 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f2732d1d640 1 -- 172.21.15.132:0/3685703285 >> 172.21.15.132:0/3685703285 conn(0x7f272c06a500 msgr2=0x7f272c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc005ad0 con 0x7f12c4003970 2023-11-18T20:38:11.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f12d9ffb640 1 -- 172.21.15.132:0/1488923157 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc005c50 con 0x7f12c4003970 2023-11-18T20:38:11.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3effd640 1 -- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 msgr2=0x7f7b400a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3effd640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b400a48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3effd640 1 -- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c1ca0 msgr2=0x7f7b401efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3effd640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c1ca0 0x7f7b401efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f7b3effd640 1 -- 172.21.15.132:0/4292205637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38009a70 con 0x7f7b400c2e60 2023-11-18T20:38:11.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f2732d1d640 1 -- 172.21.15.132:0/3685703285 shutdown_connections 2023-11-18T20:38:11.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f2732d1d640 1 -- 172.21.15.132:0/3685703285 wait complete. 2023-11-18T20:38:11.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7fb78dd9b640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb77006ae40 0x7fb77006d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb78804fa00 tx=0x7fb784009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/3071896192 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3bcc0549a0 con 0x7f3bc80073a0 2023-11-18T20:38:11.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.234+0000 7f7b3ffff640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b400a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:11.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.234+0000 7f728ffff640 1 --2- 172.21.15.132:0/1917781116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72980c7e90 0x7f72980c4910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7298158cd0 tx=0x7f728002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be68323cdbd68d22 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.234+0000 7f7b3effd640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b400c2e60 0x7f7b40150f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c4a0 tx=0x7f7b3000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.234+0000 7f12dbfff640 1 -- 172.21.15.132:0/1488923157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12c4003970 msgr2=0x7f12c4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.234+0000 7f12dbfff640 1 --2- 172.21.15.132:0/1488923157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12c4003970 0x7f12c4003d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c190 tx=0x7f12c40057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.234+0000 7f12db7fe640 1 -- 172.21.15.132:0/1488923157 reap_dead start 2023-11-18T20:38:11.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f12dbfff640 1 -- 172.21.15.132:0/1488923157 shutdown_connections 2023-11-18T20:38:11.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f12dbfff640 1 -- 172.21.15.132:0/1488923157 >> 172.21.15.132:0/1488923157 conn(0x7f12d4048220 msgr2=0x7f12d4048630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.233+0000 7fe116d68640 1 -- start start 2023-11-18T20:38:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7fe116d68640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1100c1ca0 0x7fe1100c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7fe116d68640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11006d580 con 0x7fe110071e30 2023-11-18T20:38:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f7b27fff640 1 -- 172.21.15.132:0/4292205637 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300074e0 con 0x7f7b400c2e60 2023-11-18T20:38:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b401514b0 con 0x7f7b400c2e60 2023-11-18T20:38:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b400bafc0 con 0x7f7b400c2e60 2023-11-18T20:38:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7fe116d68640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1100726d0 con 0x7fe110155fc0 2023-11-18T20:38:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7fe116d68640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11006dd60 con 0x7fe1100c1ca0 2023-11-18T20:38:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f7296ffd640 1 -- 172.21.15.132:0/1917781116 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800317e0 con 0x7f72980c7e90 2023-11-18T20:38:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f7296ffd640 1 -- 172.21.15.132:0/1917781116 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7280031940 con 0x7f72980c7e90 2023-11-18T20:38:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f7296ffd640 1 -- 172.21.15.132:0/1917781116 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280031cd0 con 0x7f72980c7e90 2023-11-18T20:38:11.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f12dbfff640 1 -- 172.21.15.132:0/1488923157 shutdown_connections 2023-11-18T20:38:11.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7fe115305640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe110071e30 0x7fe110163370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48710/0 (socket says 172.21.15.132:48710) 2023-11-18T20:38:11.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7fe107fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1100c1ca0 0x7fe1100c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7fe115305640 1 -- 172.21.15.132:0/3775232742 learned_addr learned my addr 172.21.15.132:0/3775232742 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:11.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.235+0000 7f12dbfff640 1 -- 172.21.15.132:0/1488923157 wait complete. 2023-11-18T20:38:11.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7f7b27fff640 1 -- 172.21.15.132:0/4292205637 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b30007640 con 0x7f7b400c2e60 2023-11-18T20:38:11.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7f7b27fff640 1 -- 172.21.15.132:0/4292205637 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300049e0 con 0x7f7b400c2e60 2023-11-18T20:38:11.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7f729df01640 1 -- 172.21.15.132:0/1917781116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72980c7e90 msgr2=0x7f72980c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7f729df01640 1 --2- 172.21.15.132:0/1917781116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72980c7e90 0x7f72980c4910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7298158cd0 tx=0x7f728002b880 comp rx=0 tx=0).stop 2023-11-18T20:38:11.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f729df01640 1 -- 172.21.15.132:0/1917781116 shutdown_connections 2023-11-18T20:38:11.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f729df01640 1 --2- 172.21.15.132:0/1917781116 >> v2:172.21.15.161:3300/0 conn(0x7f72980c4e50 0x7f729806b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f729df01640 1 --2- 172.21.15.132:0/1917781116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72980c7e90 0x7f72980c4910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7fe1077fe640 1 -- 172.21.15.132:0/3775232742 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769389914 0 0) 0x7fe11006d580 con 0x7fe110071e30 2023-11-18T20:38:11.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7fe107fff640 1 -- 172.21.15.132:0/3775232742 >> v1:172.21.15.161:6789/0 conn(0x7fe110155fc0 legacy=0x7fe110159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7fe107fff640 1 -- 172.21.15.132:0/3775232742 >> v1:172.21.15.132:6789/0 conn(0x7fe110071e30 legacy=0x7fe110163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f729df01640 1 -- 172.21.15.132:0/1917781116 >> 172.21.15.132:0/1917781116 conn(0x7f72980ca170 msgr2=0x7f72980ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7fe107fff640 1 -- 172.21.15.132:0/3775232742 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11006da80 con 0x7fe1100c1ca0 2023-11-18T20:38:11.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7f2732d1d640 1 Processor -- start 2023-11-18T20:38:11.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7f2732d1d640 1 -- start start 2023-11-18T20:38:11.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b40068350 con 0x7f7b400c2e60 2023-11-18T20:38:11.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f2732d1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c071e30 0x7f272c1f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f2732d1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c0c1ca0 0x7f272c1f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f2732d1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c155fc0 0x7f272c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f2732d1d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0a5480 con 0x7f272c0c1ca0 2023-11-18T20:38:11.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f2732d1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0a8930 con 0x7f272c155fc0 2023-11-18T20:38:11.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.237+0000 7f2732d1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0a7e00 con 0x7f272c071e30 2023-11-18T20:38:11.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c0c1ca0 0x7f272c1f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f12dbfff640 1 Processor -- start 2023-11-18T20:38:11.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c0c1ca0 0x7f272c1f6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57850/0 (socket says 172.21.15.132:57850) 2023-11-18T20:38:11.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 -- 172.21.15.132:0/1956145884 learned_addr learned my addr 172.21.15.132:0/1956145884 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 -- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c071e30 msgr2=0x7f272c1f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c071e30 0x7f272c1f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 -- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c155fc0 msgr2=0x7f272c1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c155fc0 0x7f272c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 -- 172.21.15.132:0/1956145884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c009a70 con 0x7f272c0c1ca0 2023-11-18T20:38:11.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f12dbfff640 1 -- start start 2023-11-18T20:38:11.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f2723fff640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c0c1ca0 0x7f272c1f6de0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f271400e810 tx=0x7f271400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.238+0000 7f729df01640 1 -- 172.21.15.132:0/1917781116 shutdown_connections 2023-11-18T20:38:11.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7fd234b41640 1 -- 172.21.15.132:0/3045032168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 msgr2=0x7fd2300c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.236+0000 7fd234b41640 1 --2- 172.21.15.132:0/3045032168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd2300c7250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd23006ca10 tx=0x7fd22002be30 comp rx=0 tx=0).stop 2023-11-18T20:38:11.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f2729ffb640 1 -- 172.21.15.132:0/1956145884 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271400c8d0 con 0x7f272c0c1ca0 2023-11-18T20:38:11.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f729df01640 1 -- 172.21.15.132:0/1917781116 wait complete. 2023-11-18T20:38:11.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f2729ffb640 1 -- 172.21.15.132:0/1956145884 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271400ca30 con 0x7f272c0c1ca0 2023-11-18T20:38:11.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f2729ffb640 1 -- 172.21.15.132:0/1956145884 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271400cde0 con 0x7f272c0c1ca0 2023-11-18T20:38:11.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c1f7320 con 0x7f272c0c1ca0 2023-11-18T20:38:11.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c0a51a0 con 0x7f272c0c1ca0 2023-11-18T20:38:11.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7fd234b41640 1 -- 172.21.15.132:0/3045032168 shutdown_connections 2023-11-18T20:38:11.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7fd234b41640 1 --2- 172.21.15.132:0/3045032168 >> v2:172.21.15.161:3300/0 conn(0x7fd2300c5cc0 0x7fd2300c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7fd234b41640 1 --2- 172.21.15.132:0/3045032168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd2300c7250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7fd234b41640 1 -- 172.21.15.132:0/3045032168 >> 172.21.15.132:0/3045032168 conn(0x7fd2300a9b70 msgr2=0x7fd2300a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f12dbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4003970 0x7f12d4174680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f12dbfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12d4041b90 0x7f12d4177a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.239+0000 7f12dbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d404a610 0x7f12d403f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f12db7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d404a610 0x7f12d403f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f12db7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d404a610 0x7f12d403f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57864/0 (socket says 172.21.15.132:57864) 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f12daffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4003970 0x7f12d4174680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f12db7fe640 1 -- 172.21.15.132:0/176924627 learned_addr learned my addr 172.21.15.132:0/176924627 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4040d90 con 0x7f12d404a610 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4177f50 con 0x7f12c4003970 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4042010 con 0x7f12d4041b90 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f12da7fc640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12d4041b90 0x7f12d4177a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.241+0000 7f12db7fe640 1 -- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12d4041b90 msgr2=0x7f12d4177a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.241+0000 7f12db7fe640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12d4041b90 0x7f12d4177a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.241+0000 7f12db7fe640 1 -- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4003970 msgr2=0x7f12d4174680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.241+0000 7f12db7fe640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4003970 0x7f12d4174680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.241+0000 7f12db7fe640 1 -- 172.21.15.132:0/176924627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4042270 con 0x7f12d404a610 2023-11-18T20:38:11.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.241+0000 7fe107fff640 1 --2- 172.21.15.132:0/3775232742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 0x7fe1100c2750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097a0 tx=0x7fe10002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb7bbe2d24196138 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.241+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c068350 con 0x7f272c0c1ca0 2023-11-18T20:38:11.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.240+0000 7f7b27fff640 1 -- 172.21.15.132:0/4292205637 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b30004b40 con 0x7f7b400c2e60 2023-11-18T20:38:11.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.242+0000 7f12db7fe640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d404a610 0x7f12d403f5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12dc050020 tx=0x7f12dc067f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.242+0000 7f7b27fff640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b2c06ae70 0x7f7b2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.242+0000 7f729df01640 1 Processor -- start 2023-11-18T20:38:11.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.242+0000 7f7b27fff640 1 -- 172.21.15.132:0/4292205637 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b30088a60 con 0x7f7b400c2e60 2023-11-18T20:38:11.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.242+0000 7f729df01640 1 -- start start 2023-11-18T20:38:11.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.242+0000 7f7b3f7fe640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b2c06ae70 0x7f7b2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7fd234b41640 1 -- 172.21.15.132:0/3045032168 shutdown_connections 2023-11-18T20:38:11.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7fd234b41640 1 -- 172.21.15.132:0/3045032168 wait complete. 2023-11-18T20:38:11.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7f729df01640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72980c4e50 0x7f72981ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7f729df01640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72980c7e90 0x7f72980c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7f729df01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f729814e810 0x7f72980c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7f729df01640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72981477c0 con 0x7f729814e810 2023-11-18T20:38:11.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7f729df01640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72980c0a90 con 0x7f72980c7e90 2023-11-18T20:38:11.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7f729df01640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7298147070 con 0x7f72980c4e50 2023-11-18T20:38:11.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.243+0000 7f7b3f7fe640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b2c06ae70 0x7f7b2c06d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b340079a0 tx=0x7f7b34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f72977fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72980c4e50 0x7f72981ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f72977fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72980c4e50 0x7f72981ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48208/0 (socket says 172.21.15.132:48208) 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f72977fe640 1 -- 172.21.15.132:0/1119050426 learned_addr learned my addr 172.21.15.132:0/1119050426 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f7297fff640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f729814e810 0x7f72980c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f728ffff640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72980c7e90 0x7f72980c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f7297fff640 1 -- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72980c4e50 msgr2=0x7f72981ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f7297fff640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72980c4e50 0x7f72981ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f7297fff640 1 -- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72980c7e90 msgr2=0x7f72980c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f7297fff640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72980c7e90 0x7f72980c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.244+0000 7f7297fff640 1 -- 172.21.15.132:0/1119050426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800094d0 con 0x7f729814e810 2023-11-18T20:38:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.245+0000 7f7297fff640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f729814e810 0x7f72980c38f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f729000efc0 tx=0x7f729000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.245+0000 7fd234b41640 1 Processor -- start 2023-11-18T20:38:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.245+0000 7fd234b41640 1 -- start start 2023-11-18T20:38:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.245+0000 7f2729ffb640 1 -- 172.21.15.132:0/1956145884 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2714026480 con 0x7f272c0c1ca0 2023-11-18T20:38:11.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.246+0000 7fd234b41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd23015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.246+0000 7fd234b41640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2300c2040 0x7fd2300ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.246+0000 7fd234b41640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2300c5cc0 0x7fd23014e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.246+0000 7fd234b41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300c3ab0 con 0x7fd230070560 2023-11-18T20:38:11.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.246+0000 7fd234b41640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301eed50 con 0x7fd2300c2040 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.246+0000 7fd234b41640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301edf90 con 0x7fd2300c5cc0 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.246+0000 7fd22e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd23015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd23015c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57880/0 (socket says 172.21.15.132:57880) 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22e59c640 1 -- 172.21.15.132:0/2424647733 learned_addr learned my addr 172.21.15.132:0/2424647733 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd225d9b640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2300c2040 0x7fd2300ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22ed9d640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2300c5cc0 0x7fd23014e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22e59c640 1 -- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2300c5cc0 msgr2=0x7fd23014e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22e59c640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2300c5cc0 0x7fd23014e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22e59c640 1 -- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2300c2040 msgr2=0x7fd2300ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22e59c640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2300c2040 0x7fd2300ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22e59c640 1 -- 172.21.15.132:0/2424647733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280094d0 con 0x7fd230070560 2023-11-18T20:38:11.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22ed9d640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2300c5cc0 0x7fd23014e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:11.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7fd22e59c640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd23015c880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e80 tx=0x7fd220004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7f2729ffb640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f270c06ae40 0x7f270c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.248+0000 7f2729ffb640 1 -- 172.21.15.132:0/1956145884 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2714058d20 con 0x7f272c0c1ca0 2023-11-18T20:38:11.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.248+0000 7f2730ab9640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f270c06ae40 0x7f270c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7f12c37fe640 1 -- 172.21.15.132:0/176924627 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc06bd70 con 0x7f12d404a610 2023-11-18T20:38:11.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.247+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d4042550 con 0x7f12d404a610 2023-11-18T20:38:11.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.248+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d4173e80 con 0x7f12d404a610 2023-11-18T20:38:11.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.248+0000 7f12c37fe640 1 -- 172.21.15.132:0/176924627 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc067860 con 0x7f12d404a610 2023-11-18T20:38:11.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.248+0000 7f12c37fe640 1 -- 172.21.15.132:0/176924627 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0723e0 con 0x7f12d404a610 2023-11-18T20:38:11.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.249+0000 7f7294ff9640 1 -- 172.21.15.132:0/1119050426 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7290009c00 con 0x7f729814e810 2023-11-18T20:38:11.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.249+0000 7f7294ff9640 1 -- 172.21.15.132:0/1119050426 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729000f040 con 0x7f729814e810 2023-11-18T20:38:11.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.249+0000 7f7294ff9640 1 -- 172.21.15.132:0/1119050426 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72900146c0 con 0x7f729814e810 2023-11-18T20:38:11.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.249+0000 7f7b27fff640 1 -- 172.21.15.132:0/4292205637 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b30053bb0 con 0x7f7b400c2e60 2023-11-18T20:38:11.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.249+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72981ee160 con 0x7f729814e810 2023-11-18T20:38:11.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.249+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72980bfe20 con 0x7f729814e810 2023-11-18T20:38:11.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.249+0000 7f2730ab9640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f270c06ae40 0x7f270c06d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f271c036000 tx=0x7f271c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.249+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc005250 con 0x7f12d404a610 2023-11-18T20:38:11.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.250+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72981ee2f0 con 0x7f729814e810 2023-11-18T20:38:11.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.250+0000 7fb77effd640 1 -- 172.21.15.132:0/1418251331 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb780075690 con 0x7fb778003b00 2023-11-18T20:38:11.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.250+0000 7fe1077fe640 1 -- 172.21.15.132:0/3775232742 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10002e070 con 0x7fe1100c1ca0 2023-11-18T20:38:11.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.250+0000 7fe1077fe640 1 -- 172.21.15.132:0/3775232742 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1000315a0 con 0x7fe1100c1ca0 2023-11-18T20:38:11.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.250+0000 7fe1077fe640 1 -- 172.21.15.132:0/3775232742 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100031930 con 0x7fe1100c1ca0 2023-11-18T20:38:11.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.251+0000 7fe116d68640 1 -- 172.21.15.132:0/3775232742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 msgr2=0x7fe1100c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.251+0000 7fe116d68640 1 --2- 172.21.15.132:0/3775232742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 0x7fe1100c2750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097a0 tx=0x7fe10002b840 comp rx=0 tx=0).stop 2023-11-18T20:38:11.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.253+0000 7fe116d68640 1 -- 172.21.15.132:0/3775232742 shutdown_connections 2023-11-18T20:38:11.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.253+0000 7fe116d68640 1 --2- 172.21.15.132:0/3775232742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 0x7fe1100c2750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.253+0000 7fe116d68640 1 -- 172.21.15.132:0/3775232742 >> 172.21.15.132:0/3775232742 conn(0x7fe11006a500 msgr2=0x7fe11006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.253+0000 7fd2277fe640 1 -- 172.21.15.132:0/2424647733 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22003e610 con 0x7fd230070560 2023-11-18T20:38:11.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.253+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd220009a70 con 0x7fd230070560 2023-11-18T20:38:11.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.254+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2301ee550 con 0x7fd230070560 2023-11-18T20:38:11.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.253+0000 7f2729ffb640 1 -- 172.21.15.132:0/1956145884 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2714054960 con 0x7f272c0c1ca0 2023-11-18T20:38:11.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.254+0000 7fe116d68640 1 -- 172.21.15.132:0/3775232742 shutdown_connections 2023-11-18T20:38:11.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.254+0000 7fe116d68640 1 -- 172.21.15.132:0/3775232742 wait complete. 2023-11-18T20:38:11.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.255+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd230068350 con 0x7fd230070560 2023-11-18T20:38:11.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.255+0000 7fd2277fe640 1 -- 172.21.15.132:0/2424647733 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220009450 con 0x7fd230070560 2023-11-18T20:38:11.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.255+0000 7fd2277fe640 1 -- 172.21.15.132:0/2424647733 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22003e970 con 0x7fd230070560 2023-11-18T20:38:11.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.256+0000 7f7294ff9640 1 -- 172.21.15.132:0/1119050426 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7290014820 con 0x7f729814e810 2023-11-18T20:38:11.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.257+0000 7f7294ff9640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f727c06ae90 0x7f727c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.257+0000 7f7294ff9640 1 -- 172.21.15.132:0/1119050426 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f729008a9f0 con 0x7f729814e810 2023-11-18T20:38:11.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.258+0000 7fd2277fe640 1 -- 172.21.15.132:0/2424647733 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd22003b050 con 0x7fd230070560 2023-11-18T20:38:11.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.258+0000 7fe116d68640 1 Processor -- start 2023-11-18T20:38:11.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.259+0000 7fe116d68640 1 -- start start 2023-11-18T20:38:11.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.259+0000 7fd2277fe640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd21006ae40 0x7fd21006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.256+0000 7f12c37fe640 1 -- 172.21.15.132:0/176924627 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12dc072540 con 0x7f12d404a610 2023-11-18T20:38:11.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.258+0000 7f12c37fe640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f12c806ae40 0x7f12c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.258+0000 7f12c37fe640 1 -- 172.21.15.132:0/176924627 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12dc103310 con 0x7f12d404a610 2023-11-18T20:38:11.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.260+0000 7f12daffd640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f12c806ae40 0x7f12c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.260+0000 7fd225d9b640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd21006ae40 0x7fd21006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.260+0000 7f72977fe640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f727c06ae90 0x7f727c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.261+0000 7fe116d68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe110071e30 0x7fe1101f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.261+0000 7fd225d9b640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd21006ae40 0x7fd21006d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2300c6cd0 tx=0x7fd218009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.261+0000 7f72977fe640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f727c06ae90 0x7f727c06d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f72880099a0 tx=0x7f72880090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.261+0000 7f12daffd640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f12c806ae40 0x7f12c806d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12cc034000 tx=0x7f12cc007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.262+0000 7fe116d68640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 0x7fe1101eb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.262+0000 7fe114b04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe110071e30 0x7fe1101f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.262+0000 7fe114b04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe110071e30 0x7fe1101f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57884/0 (socket says 172.21.15.132:57884) 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.262+0000 7fe114b04640 1 -- 172.21.15.132:0/2819398826 learned_addr learned my addr 172.21.15.132:0/2819398826 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.262+0000 7fe116d68640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe110155fc0 0x7fe11015b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.262+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101f2750 con 0x7fe110071e30 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.262+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101f2470 con 0x7fe1100c1ca0 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.263+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100a3e00 con 0x7fe110155fc0 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.263+0000 7fe115305640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe110155fc0 0x7fe11015b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.264+0000 7fe107fff640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 0x7fe1101eb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.265+0000 7f12c37fe640 1 -- 172.21.15.132:0/176924627 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12dc0ce3a0 con 0x7f12d404a610 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.264+0000 7fe115305640 1 -- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 msgr2=0x7fe1101eb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.264+0000 7fe115305640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 0x7fe1101eb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.264+0000 7fe115305640 1 -- 172.21.15.132:0/2819398826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe110071e30 msgr2=0x7fe1101f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.264+0000 7fe115305640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe110071e30 0x7fe1101f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.264+0000 7fe115305640 1 -- 172.21.15.132:0/2819398826 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100009400 con 0x7fe110155fc0 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.264+0000 7fe115305640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe110155fc0 0x7fe11015b140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe108001560 tx=0x7fe10800cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.265+0000 7fe1057fa640 1 -- 172.21.15.132:0/2819398826 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800ce30 con 0x7fe110155fc0 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.265+0000 7fe1057fa640 1 -- 172.21.15.132:0/2819398826 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10800a640 con 0x7fe110155fc0 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.265+0000 7fe1057fa640 1 -- 172.21.15.132:0/2819398826 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800a9b0 con 0x7fe110155fc0 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.265+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1100a40e0 con 0x7fe110155fc0 2023-11-18T20:38:11.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.265+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1100a5050 con 0x7fe110155fc0 2023-11-18T20:38:11.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.267+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1100a4600 con 0x7fe110155fc0 2023-11-18T20:38:11.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.269+0000 7fe1057fa640 1 -- 172.21.15.132:0/2819398826 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe10800ab10 con 0x7fe110155fc0 2023-11-18T20:38:11.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.270+0000 7fe1057fa640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0fc06ae40 0x7fe0fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:11.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.270+0000 7fe1057fa640 1 -- 172.21.15.132:0/2819398826 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1080889f0 con 0x7fe110155fc0 2023-11-18T20:38:11.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.272+0000 7fe114b04640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0fc06ae40 0x7fe0fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:11.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.274+0000 7fd2277fe640 1 -- 172.21.15.132:0/2424647733 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd22007bb10 con 0x7fd230070560 2023-11-18T20:38:11.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.274+0000 7f7294ff9640 1 -- 172.21.15.132:0/1119050426 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7290055b30 con 0x7f729814e810 2023-11-18T20:38:11.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.278+0000 7fe114b04640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0fc06ae40 0x7fe0fc06d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0017a0 tx=0x7fe10c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:11.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.282+0000 7fd2277fe640 1 -- 172.21.15.132:0/2424647733 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd220077750 con 0x7fd230070560 2023-11-18T20:38:11.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.290+0000 7fe1057fa640 1 -- 172.21.15.132:0/2819398826 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1100a4600 con 0x7fe110155fc0 2023-11-18T20:38:11.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.631+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3bc8047ff0 con 0x7f3bc80073a0 2023-11-18T20:38:11.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.632+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/3071896192 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3bcc057fc0 con 0x7f3bc80073a0 2023-11-18T20:38:11.634 INFO:teuthology.orchestra.run.smithi132.stdout:60129542149 2023-11-18T20:38:11.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.636+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3bb406af10 msgr2=0x7f3bb406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.636+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3bb406af10 0x7f3bb406d3d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80490d0 tx=0x7f3bd00bb040 comp rx=0 tx=0).stop 2023-11-18T20:38:11.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.636+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc80073a0 msgr2=0x7f3bc802cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.637+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc80073a0 0x7f3bc802cc60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00d6c0 tx=0x7f3bcc00db80 comp rx=0 tx=0).stop 2023-11-18T20:38:11.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.637+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 shutdown_connections 2023-11-18T20:38:11.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.637+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3bb406af10 0x7f3bb406d3d0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80490d0 tx=0x7f3bd00bb040 comp rx=0 tx=0).stop 2023-11-18T20:38:11.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.637+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc80d3b00 0x7f3bc80d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.638+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc804b0d0 0x7f3bc80d8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.638+0000 7f3bd85fb640 1 --2- 172.21.15.132:0/3071896192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc80073a0 0x7f3bc802cc60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.638+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 >> 172.21.15.132:0/3071896192 conn(0x7f3bc8048210 msgr2=0x7f3bc8009f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.638+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 shutdown_connections 2023-11-18T20:38:11.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.638+0000 7f3bd85fb640 1 -- 172.21.15.132:0/3071896192 wait complete. 2023-11-18T20:38:11.658 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:11.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.655+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b40072980 con 0x7f7b400c2e60 2023-11-18T20:38:11.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.656+0000 7f7b27fff640 1 -- 172.21.15.132:0/4292205637 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b30018070 con 0x7f7b400c2e60 2023-11-18T20:38:11.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.658+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f272c06d730 con 0x7f272c0c1ca0 2023-11-18T20:38:11.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.659+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b2c06ae70 msgr2=0x7f7b2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.659+0000 7f7b45b33640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b2c06ae70 0x7f7b2c06d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b340079a0 tx=0x7f7b34008040 comp rx=0 tx=0).stop 2023-11-18T20:38:11.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.659+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b400c2e60 msgr2=0x7f7b40150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.659+0000 7f7b45b33640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b400c2e60 0x7f7b40150f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c4a0 tx=0x7f7b3000c960 comp rx=0 tx=0).stop 2023-11-18T20:38:11.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.659+0000 7f2729ffb640 1 -- 172.21.15.132:0/1956145884 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2714021070 con 0x7f272c0c1ca0 2023-11-18T20:38:11.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.660+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 shutdown_connections 2023-11-18T20:38:11.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.660+0000 7f7b45b33640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b2c06ae70 0x7f7b2c06d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.660+0000 7f7b45b33640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b40155fc0 0x7f7b400a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.660+0000 7f7b45b33640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b400c2e60 0x7f7b40150f70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.660+0000 7f7b45b33640 1 --2- 172.21.15.132:0/4292205637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b400c1ca0 0x7f7b401efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.660+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 >> 172.21.15.132:0/4292205637 conn(0x7f7b4006a500 msgr2=0x7f7b40153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.660+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 shutdown_connections 2023-11-18T20:38:11.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.660+0000 7f7b45b33640 1 -- 172.21.15.132:0/4292205637 wait complete. 2023-11-18T20:38:11.665 INFO:teuthology.orchestra.run.smithi132.stdout:60129542149 2023-11-18T20:38:11.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.663+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f270c06ae40 msgr2=0x7f270c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.663+0000 7f2732d1d640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f270c06ae40 0x7f270c06d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f271c036000 tx=0x7f271c030000 comp rx=0 tx=0).stop 2023-11-18T20:38:11.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.663+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c0c1ca0 msgr2=0x7f272c1f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.663+0000 7f2732d1d640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c0c1ca0 0x7f272c1f6de0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f271400e810 tx=0x7f271400ecd0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.664+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 shutdown_connections 2023-11-18T20:38:11.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.664+0000 7f2732d1d640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f270c06ae40 0x7f270c06d300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.664+0000 7f2732d1d640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c155fc0 0x7f272c1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.664+0000 7f2732d1d640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c0c1ca0 0x7f272c1f6de0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.664+0000 7f2732d1d640 1 --2- 172.21.15.132:0/1956145884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c071e30 0x7f272c1f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.664+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 >> 172.21.15.132:0/1956145884 conn(0x7f272c06a500 msgr2=0x7f272c0c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.665+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 shutdown_connections 2023-11-18T20:38:11.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.665+0000 7f2732d1d640 1 -- 172.21.15.132:0/1956145884 wait complete. 2023-11-18T20:38:11.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2023-11-18T20:38:11.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.673+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7880da1e0 con 0x7fb778003b00 2023-11-18T20:38:11.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.674+0000 7fb77effd640 1 -- 172.21.15.132:0/1418251331 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7880da1e0 con 0x7fb778003b00 2023-11-18T20:38:11.675 INFO:teuthology.orchestra.run.smithi132.stdout:60129542149 2023-11-18T20:38:11.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.675+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd2300a9570 con 0x7fd230070560 2023-11-18T20:38:11.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.676+0000 7fd2277fe640 1 -- 172.21.15.132:0/2424647733 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd22004e090 con 0x7fd230070560 2023-11-18T20:38:11.677 INFO:teuthology.orchestra.run.smithi132.stdout:60129542149 2023-11-18T20:38:11.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd21006ae40 msgr2=0x7fd21006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fd234b41640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd21006ae40 0x7fd21006d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2300c6cd0 tx=0x7fd218009040 comp rx=0 tx=0).stop 2023-11-18T20:38:11.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 msgr2=0x7fd23015c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fd234b41640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd23015c880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e80 tx=0x7fd220004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb77006ae40 msgr2=0x7fb77006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fb794fe9640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb77006ae40 0x7fb77006d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb78804fa00 tx=0x7fb784009110 comp rx=0 tx=0).stop 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb778003b00 msgr2=0x7fb7880d9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fb794fe9640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb778003b00 0x7fb7880d9770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb78002c3d0 tx=0x7fb780001930 comp rx=0 tx=0).stop 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 shutdown_connections 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fb794fe9640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb77006ae40 0x7fb77006d300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.678+0000 7fb794fe9640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb78816cd80 0x7fb78816d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fb794fe9640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7880d8c50 0x7fb788030830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fb794fe9640 1 --2- 172.21.15.132:0/1418251331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb778003b00 0x7fb7880d9770 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb78002c3d0 tx=0x7fb780001930 comp rx=0 tx=0).stop 2023-11-18T20:38:11.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 >> 172.21.15.132:0/1418251331 conn(0x7fb78804c620 msgr2=0x7fb7880d6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 shutdown_connections 2023-11-18T20:38:11.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fd234b41640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd21006ae40 0x7fd21006d300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fd234b41640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2300c5cc0 0x7fd23014e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fd234b41640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2300c2040 0x7fd2300ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fd234b41640 1 --2- 172.21.15.132:0/2424647733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd230070560 0x7fd23015c880 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 >> 172.21.15.132:0/2424647733 conn(0x7fd2300a9b70 msgr2=0x7fd2300c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 shutdown_connections 2023-11-18T20:38:11.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.679+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 shutdown_connections 2023-11-18T20:38:11.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.680+0000 7fd234b41640 1 -- 172.21.15.132:0/2424647733 wait complete. 2023-11-18T20:38:11.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.680+0000 7fb794fe9640 1 -- 172.21.15.132:0/1418251331 wait complete. 2023-11-18T20:38:11.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.680+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f12bc0057d0 con 0x7f12d404a610 2023-11-18T20:38:11.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.681+0000 7f12c37fe640 1 -- 172.21.15.132:0/176924627 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12dc0d19c0 con 0x7f12d404a610 2023-11-18T20:38:11.684 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:11.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.682+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7298068350 con 0x7f729814e810 2023-11-18T20:38:11.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.683+0000 7f7294ff9640 1 -- 172.21.15.132:0/1119050426 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7290018090 con 0x7f729814e810 2023-11-18T20:38:11.685 INFO:teuthology.orchestra.run.smithi132.stdout:60129542149 2023-11-18T20:38:11.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.684+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f12c806ae40 msgr2=0x7f12c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.684+0000 7f12dbfff640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f12c806ae40 0x7f12c806d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12cc034000 tx=0x7f12cc007000 comp rx=0 tx=0).stop 2023-11-18T20:38:11.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.684+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d404a610 msgr2=0x7f12d403f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.684+0000 7f12dbfff640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d404a610 0x7f12d403f5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12dc050020 tx=0x7f12dc067f10 comp rx=0 tx=0).stop 2023-11-18T20:38:11.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.687+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 shutdown_connections 2023-11-18T20:38:11.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.687+0000 7f12dbfff640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f12c806ae40 0x7f12c806d300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.687+0000 7f12dbfff640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d404a610 0x7f12d403f5d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.687+0000 7f12dbfff640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12d4041b90 0x7f12d4177a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.687+0000 7f12dbfff640 1 --2- 172.21.15.132:0/176924627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c4003970 0x7f12d4174680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.687+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 >> 172.21.15.132:0/176924627 conn(0x7f12d4048220 msgr2=0x7f12d40e0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.687+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 shutdown_connections 2023-11-18T20:38:11.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.687+0000 7f12dbfff640 1 -- 172.21.15.132:0/176924627 wait complete. 2023-11-18T20:38:11.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.1 2023-11-18T20:38:11.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f727c06ae90 msgr2=0x7f727c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f727c06ae90 0x7f727c06d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f72880099a0 tx=0x7f72880090e0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f729814e810 msgr2=0x7f72980c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f729814e810 0x7f72980c38f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f729000efc0 tx=0x7f729000c490 comp rx=0 tx=0).stop 2023-11-18T20:38:11.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 shutdown_connections 2023-11-18T20:38:11.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f727c06ae90 0x7f727c06d350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f729814e810 0x7f72980c38f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72980c7e90 0x7f72980c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 --2- 172.21.15.132:0/1119050426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72980c4e50 0x7f72981ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 >> 172.21.15.132:0/1119050426 conn(0x7f72980ca170 msgr2=0x7f7298157410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 shutdown_connections 2023-11-18T20:38:11.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.688+0000 7f729df01640 1 -- 172.21.15.132:0/1119050426 wait complete. 2023-11-18T20:38:11.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2023-11-18T20:38:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.696+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe1100a4600 con 0x7fe110155fc0 2023-11-18T20:38:11.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.697+0000 7fe1057fa640 1 -- 172.21.15.132:0/2819398826 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1100a4600 con 0x7fe110155fc0 2023-11-18T20:38:11.699 INFO:teuthology.orchestra.run.smithi132.stdout:60129542149 2023-11-18T20:38:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0fc06ae40 msgr2=0x7fe0fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0fc06ae40 0x7fe0fc06d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0017a0 tx=0x7fe10c009040 comp rx=0 tx=0).stop 2023-11-18T20:38:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe110155fc0 msgr2=0x7fe11015b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe110155fc0 0x7fe11015b140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe108001560 tx=0x7fe10800cbe0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 shutdown_connections 2023-11-18T20:38:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0fc06ae40 0x7fe0fc06d300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe110155fc0 0x7fe11015b140 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1100c1ca0 0x7fe1101eb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.700+0000 7fe116d68640 1 --2- 172.21.15.132:0/2819398826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe110071e30 0x7fe1101f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.701+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 >> 172.21.15.132:0/2819398826 conn(0x7fe11006a500 msgr2=0x7fe1100c26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.701+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 shutdown_connections 2023-11-18T20:38:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:11.701+0000 7fe116d68640 1 -- 172.21.15.132:0/2819398826 wait complete. 2023-11-18T20:38:11.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2023-11-18T20:38:11.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2023-11-18T20:38:11.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2023-11-18T20:38:11.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2023-11-18T20:38:11.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2023-11-18T20:38:12.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-18T20:38:12.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-18T20:38:12.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T20:38:12.705 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-18T20:38:12.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-18T20:38:12.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-18T20:38:12.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T20:38:12.719 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-18T20:38:12.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.962+0000 7feaea547640 1 Processor -- start 2023-11-18T20:38:12.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.963+0000 7feaea547640 1 -- start start 2023-11-18T20:38:12.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.965+0000 7feaea547640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feae40c2180 0x7feae406bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:12.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.965+0000 7feaea547640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae40c4fe0 con 0x7feae406c210 2023-11-18T20:38:12.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.965+0000 7feaea547640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae406e680 con 0x7feae41511e0 2023-11-18T20:38:12.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.965+0000 7feaea547640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae40c4410 con 0x7feae40c2180 2023-11-18T20:38:12.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.966+0000 7feadbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feae40c2180 0x7feae406bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:12.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.966+0000 7feae8ae4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feae406c210 0x7feae415af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48724/0 (socket says 172.21.15.132:48724) 2023-11-18T20:38:12.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.966+0000 7feae8ae4640 1 -- 172.21.15.132:0/83508511 learned_addr learned my addr 172.21.15.132:0/83508511 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:12.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.966+0000 7feae3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7feae41511e0 0x7feae40a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:55390/0 (socket says 172.21.15.132:55390) 2023-11-18T20:38:12.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.967+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625831029 0 0) 0x7feae40c4fe0 con 0x7feae406c210 2023-11-18T20:38:12.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.967+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead0003520 con 0x7feae406c210 2023-11-18T20:38:12.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.968+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762896242 0 0) 0x7fead0003520 con 0x7feae406c210 2023-11-18T20:38:12.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.968+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 >> v2:172.21.15.161:3300/0 conn(0x7feae40c2180 msgr2=0x7feae406bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:12.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.968+0000 7feae37fe640 1 --2- 172.21.15.132:0/83508511 >> v2:172.21.15.161:3300/0 conn(0x7feae40c2180 0x7feae406bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:12.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.968+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 >> v1:172.21.15.161:6789/0 conn(0x7feae41511e0 legacy=0x7feae40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:12.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.968+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40c1eb0 con 0x7feae406c210 2023-11-18T20:38:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7feadc0019f0 con 0x7feae406c210 2023-11-18T20:38:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 >> v1:172.21.15.132:6789/0 conn(0x7feae406c210 legacy=0x7feae415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feae37fe640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead0003970 0x7fead0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feae37fe640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead00047c0 0x7fead0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feae37fe640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead0005250 0x7fead000ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:12.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae40c4410 con 0x7fead00047c0 2023-11-18T20:38:12.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead000d2b0 con 0x7fead0005250 2023-11-18T20:38:12.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead000d470 con 0x7fead0003970 2023-11-18T20:38:12.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.970+0000 7feadbfff640 1 --2- 172.21.15.132:0/83508511 >> v2:172.21.15.161:3300/0 conn(0x7feae40c2180 0x7feae406bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:12.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.971+0000 7feadbfff640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead00047c0 0x7fead0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:12.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.971+0000 7feae3fff640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead0003970 0x7fead0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:12.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.971+0000 7feae8ae4640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead0005250 0x7fead000ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:12.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.972+0000 7feae3fff640 1 -- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead0005250 msgr2=0x7fead000ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:12.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.973+0000 7feae3fff640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead0005250 0x7fead000ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:12.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.973+0000 7feae3fff640 1 -- 172.21.15.132:0/83508511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead00047c0 msgr2=0x7fead0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:12.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.973+0000 7feae3fff640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead00047c0 0x7fead0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:12.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.973+0000 7feae3fff640 1 -- 172.21.15.132:0/83508511 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0003520 con 0x7fead0003970 2023-11-18T20:38:12.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.975+0000 7feadbfff640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead00047c0 0x7fead0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:38:12.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.975+0000 7feae8ae4640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead0005250 0x7fead000ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:12.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.975+0000 7feae8ae4640 1 -- 172.21.15.132:0/83508511 reap_dead start 2023-11-18T20:38:12.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.977+0000 7feae3fff640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead0003970 0x7fead0003d50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feacc001890 tx=0x7fead00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55362772d7d89e3f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:12.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.978+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc007270 con 0x7fead0003970 2023-11-18T20:38:12.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.978+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc0073d0 con 0x7fead0003970 2023-11-18T20:38:12.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.979+0000 7feaea547640 1 -- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead0003970 msgr2=0x7fead0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:12.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.979+0000 7feae37fe640 1 -- 172.21.15.132:0/83508511 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc007270 con 0x7fead0003970 2023-11-18T20:38:12.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.979+0000 7feaea547640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead0003970 0x7fead0003d50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feacc001890 tx=0x7fead00057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:12.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.980+0000 7feaea547640 1 -- 172.21.15.132:0/83508511 shutdown_connections 2023-11-18T20:38:12.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.980+0000 7feaea547640 1 --2- 172.21.15.132:0/83508511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead0003970 0x7fead0003d50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:12.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.980+0000 7feaea547640 1 -- 172.21.15.132:0/83508511 >> 172.21.15.132:0/83508511 conn(0x7feae40a7900 msgr2=0x7feae40a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:12.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.980+0000 7feaea547640 1 -- 172.21.15.132:0/83508511 shutdown_connections 2023-11-18T20:38:12.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.980+0000 7feaea547640 1 -- 172.21.15.132:0/83508511 wait complete. 2023-11-18T20:38:12.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.984+0000 7feaea547640 1 Processor -- start 2023-11-18T20:38:12.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.984+0000 7feaea547640 1 -- start start 2023-11-18T20:38:12.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.986+0000 7feaea547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead0003970 0x7feae4154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:12.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.986+0000 7feaea547640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae40bb820 0x7feae40a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:12.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.986+0000 7feaea547640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae4071810 0x7feae4071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:12.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.986+0000 7feaea547640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae414c080 con 0x7fead0003970 2023-11-18T20:38:12.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.986+0000 7feaea547640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae414c2d0 con 0x7feae40bb820 2023-11-18T20:38:12.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.986+0000 7feaea547640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae414c5b0 con 0x7feae4071810 2023-11-18T20:38:12.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.987+0000 7feae8ae4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae4071810 0x7feae4071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:12.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.987+0000 7feae8ae4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae4071810 0x7feae4071cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48226/0 (socket says 172.21.15.132:48226) 2023-11-18T20:38:12.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.987+0000 7feae8ae4640 1 -- 172.21.15.132:0/3922487429 learned_addr learned my addr 172.21.15.132:0/3922487429 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:12.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.988+0000 7feae3fff640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead0003970 0x7feae4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:12.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.988+0000 7feae8ae4640 1 -- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae40bb820 msgr2=0x7feae40a9330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-18T20:38:12.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.988+0000 7feae8ae4640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae40bb820 0x7feae40a9330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:12.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.989+0000 7feae8ae4640 1 -- 172.21.15.132:0/3922487429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead0003970 msgr2=0x7feae4154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:12.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.989+0000 7feae8ae4640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead0003970 0x7feae4154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:12.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.989+0000 7feae8ae4640 1 -- 172.21.15.132:0/3922487429 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae414c890 con 0x7feae4071810 2023-11-18T20:38:12.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.989+0000 7feae3fff640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead0003970 0x7feae4154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:12.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.990+0000 7feae8ae4640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae4071810 0x7feae4071cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feadc004bf0 tx=0x7feadc008b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:12.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.990+0000 7feae17fa640 1 -- 172.21.15.132:0/3922487429 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00eb70 con 0x7feae4071810 2023-11-18T20:38:12.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.990+0000 7feae17fa640 1 -- 172.21.15.132:0/3922487429 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc00ecd0 con 0x7feae4071810 2023-11-18T20:38:12.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.990+0000 7feae17fa640 1 -- 172.21.15.132:0/3922487429 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc015430 con 0x7feae4071810 2023-11-18T20:38:12.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.991+0000 7feaea547640 1 -- 172.21.15.132:0/3922487429 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae41e5630 con 0x7feae4071810 2023-11-18T20:38:12.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.991+0000 7feaea547640 1 -- 172.21.15.132:0/3922487429 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae40bab70 con 0x7feae4071810 2023-11-18T20:38:12.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.995+0000 7feae17fa640 1 -- 172.21.15.132:0/3922487429 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feadc015590 con 0x7feae4071810 2023-11-18T20:38:12.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.997+0000 7feae17fa640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac406aec0 0x7feac406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:12.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.997+0000 7feae17fa640 1 -- 172.21.15.132:0/3922487429 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feadc0590d0 con 0x7feae4071810 2023-11-18T20:38:12.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.998+0000 7feae3fff640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac406aec0 0x7feac406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.999+0000 7feae3fff640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac406aec0 0x7feac406d380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feacc034000 tx=0x7feacc009070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:12.999+0000 7feada7fc640 1 -- 172.21.15.132:0/3922487429 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae404e840 con 0x7feae4071810 2023-11-18T20:38:13.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.012+0000 7f2b688a1640 1 Processor -- start 2023-11-18T20:38:13.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.012+0000 7f2b688a1640 1 -- start start 2023-11-18T20:38:13.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.014+0000 7feae17fa640 1 -- 172.21.15.132:0/3922487429 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feadc0554a0 con 0x7feae4071810 2023-11-18T20:38:13.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.015+0000 7f2b688a1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c00ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.015+0000 7f2b688a1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2b5c00fcc0 0x7f2b5c0069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.015+0000 7f2b688a1640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c0d7cd0 con 0x7f2b5c0506f0 2023-11-18T20:38:13.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.015+0000 7f2b688a1640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c0db220 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.015+0000 7f2b688a1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c04b9d0 con 0x7f2b5c0d78f0 2023-11-18T20:38:13.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.016+0000 7f2b62d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c00ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.016+0000 7f2b62d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c00ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48242/0 (socket says 172.21.15.132:48242) 2023-11-18T20:38:13.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.016+0000 7f2b62d9d640 1 -- 172.21.15.132:0/469817761 learned_addr learned my addr 172.21.15.132:0/469817761 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.016+0000 7f2b6359e640 1 --2- 172.21.15.132:0/469817761 >> v2:172.21.15.161:3300/0 conn(0x7f2b5c00fcc0 0x7f2b5c0069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.017+0000 7f2b61d9b640 1 -- 172.21.15.132:0/469817761 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199819014 0 0) 0x7f2b5c0d7cd0 con 0x7f2b5c0506f0 2023-11-18T20:38:13.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.017+0000 7f2b61d9b640 1 -- 172.21.15.132:0/469817761 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b4c003520 con 0x7f2b5c0506f0 2023-11-18T20:38:13.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.017+0000 7f2b6359e640 1 -- 172.21.15.132:0/469817761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 msgr2=0x7f2b5c00ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.017+0000 7f2b6359e640 1 --2- 172.21.15.132:0/469817761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c00ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.017+0000 7f2b6359e640 1 -- 172.21.15.132:0/469817761 >> v1:172.21.15.161:6789/0 conn(0x7f2b5c0506f0 legacy=0x7f2b5c006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.018+0000 7f2b6359e640 1 -- 172.21.15.132:0/469817761 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c04bcb0 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.019+0000 7f2b6359e640 1 --2- 172.21.15.132:0/469817761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c0069a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b640641d0 tx=0x7f2b640a5ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d4ec010050c76cf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.020+0000 7f2b61d9b640 1 -- 172.21.15.132:0/469817761 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640a6c70 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.020+0000 7f2b61d9b640 1 -- 172.21.15.132:0/469817761 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b640a6dd0 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.020+0000 7f2b61d9b640 1 -- 172.21.15.132:0/469817761 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640ae640 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.021+0000 7f2b688a1640 1 -- 172.21.15.132:0/469817761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c00fcc0 msgr2=0x7f2b5c0069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.021+0000 7f2b688a1640 1 --2- 172.21.15.132:0/469817761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c0069a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b640641d0 tx=0x7f2b640a5ec0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.022+0000 7f2b688a1640 1 -- 172.21.15.132:0/469817761 shutdown_connections 2023-11-18T20:38:13.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.022+0000 7f2b688a1640 1 --2- 172.21.15.132:0/469817761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c0069a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.022+0000 7f2b688a1640 1 --2- 172.21.15.132:0/469817761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c00ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.022+0000 7f2b688a1640 1 -- 172.21.15.132:0/469817761 >> 172.21.15.132:0/469817761 conn(0x7f2b5c04fbd0 msgr2=0x7f2b5c04ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.022+0000 7f2b688a1640 1 -- 172.21.15.132:0/469817761 shutdown_connections 2023-11-18T20:38:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.022+0000 7f2b688a1640 1 -- 172.21.15.132:0/469817761 wait complete. 2023-11-18T20:38:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.025+0000 7f2b688a1640 1 Processor -- start 2023-11-18T20:38:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.025+0000 7f2b688a1640 1 -- start start 2023-11-18T20:38:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.026+0000 7f8e4183f640 1 Processor -- start 2023-11-18T20:38:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f2b688a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c032870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.026+0000 7f8e4183f640 1 -- start start 2023-11-18T20:38:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f8e4183f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c0c7e90 0x7f8e3c0c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f8e4183f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8e3c0c4e50 0x7f8e3c06b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f8e4183f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0bd8d0 con 0x7f8e3c14e810 2023-11-18T20:38:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f8e4183f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c0c6e60 con 0x7f8e3c0c4e50 2023-11-18T20:38:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f8e4183f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0c70d0 con 0x7f8e3c0c7e90 2023-11-18T20:38:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f2b688a1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c0506f0 0x7f2b5c0341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f2b688a1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c030800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f2b688a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0336a0 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f2b688a1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0d8390 con 0x7f2b5c0506f0 2023-11-18T20:38:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f2b688a1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0d8040 con 0x7f2b5c0d78f0 2023-11-18T20:38:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f8e3affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8e3c14e810 0x7f8e3c1550c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48740/0 (socket says 172.21.15.132:48740) 2023-11-18T20:38:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f8e3affd640 1 -- 172.21.15.132:0/1666802422 learned_addr learned my addr 172.21.15.132:0/1666802422 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.028+0000 7f2b62d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c032870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.029+0000 7f2b62d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c032870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57900/0 (socket says 172.21.15.132:57900) 2023-11-18T20:38:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.029+0000 7f2b62d9d640 1 -- 172.21.15.132:0/2042911057 learned_addr learned my addr 172.21.15.132:0/2042911057 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.029+0000 7f8e3a7fc640 1 --2- 172.21.15.132:0/1666802422 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c0c7e90 0x7f8e3c0c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.029+0000 7f8e3b7fe640 1 --2- 172.21.15.132:0/1666802422 >> v2:172.21.15.132:3300/0 conn(0x7f8e3c0c4e50 0x7f8e3c06b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.029+0000 7f2b6259c640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c0506f0 0x7f2b5c0341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.029+0000 7f2b6359e640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c030800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7fa9781a9640 1 Processor -- start 2023-11-18T20:38:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f0bc63f0640 1 Processor -- start 2023-11-18T20:38:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f8e3a7fc640 1 -- 172.21.15.132:0/1666802422 >> v2:172.21.15.132:3300/0 conn(0x7f8e3c0c4e50 msgr2=0x7f8e3c06b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f8e3a7fc640 1 --2- 172.21.15.132:0/1666802422 >> v2:172.21.15.132:3300/0 conn(0x7f8e3c0c4e50 0x7f8e3c06b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f8e3a7fc640 1 -- 172.21.15.132:0/1666802422 >> v1:172.21.15.132:6789/0 conn(0x7f8e3c14e810 legacy=0x7f8e3c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f8e3a7fc640 1 -- 172.21.15.132:0/1666802422 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0c73b0 con 0x7f8e3c0c7e90 2023-11-18T20:38:13.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f2b62d9d640 1 -- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 msgr2=0x7f2b5c030800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f2b62d9d640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c030800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f2b62d9d640 1 -- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c0506f0 msgr2=0x7f2b5c0341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f2b62d9d640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c0506f0 0x7f2b5c0341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f2b62d9d640 1 -- 172.21.15.132:0/2042911057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6404f730 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f2b6359e640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c030800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:38:13.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.031+0000 7f2b6259c640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c0506f0 0x7f2b5c0341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:13.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7f0bc63f0640 1 -- start start 2023-11-18T20:38:13.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7f2b62d9d640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c032870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400d7d0 tx=0x7f2b5400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.030+0000 7fa9781a9640 1 -- start start 2023-11-18T20:38:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7fa9781a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa97006e2f0 0x7fa9700c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7fa9781a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa9700aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7fa9781a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa970154e00 con 0x7fa9700c4f60 2023-11-18T20:38:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7fa9781a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9700c10d0 con 0x7fa97006e2f0 2023-11-18T20:38:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7fa9781a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9701542d0 con 0x7fa9700c21b0 2023-11-18T20:38:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7f0bc63f0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc0155fc0 0x7f0bc0159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7f2b4b7fe640 1 -- 172.21.15.132:0/2042911057 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b540096a0 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.033+0000 7f0bc63f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0bc00c2e60 0x7f0bc0163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.032+0000 7f8e3a7fc640 1 --2- 172.21.15.132:0/1666802422 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c0c7e90 0x7f8e3c0c4910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0097a0 tx=0x7f8e2c02b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef15ce2d44d2a908 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.033+0000 7f8e39ffb640 1 -- 172.21.15.132:0/1666802422 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c030710 con 0x7f8e3c0c7e90 2023-11-18T20:38:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.033+0000 7f8e39ffb640 1 -- 172.21.15.132:0/1666802422 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c02e050 con 0x7f8e3c0c7e90 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.033+0000 7f8e39ffb640 1 -- 172.21.15.132:0/1666802422 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c030a90 con 0x7f8e3c0c7e90 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f8e4183f640 1 -- 172.21.15.132:0/1666802422 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c0c7e90 msgr2=0x7f8e3c0c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f8e4183f640 1 --2- 172.21.15.132:0/1666802422 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c0c7e90 0x7f8e3c0c4910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0097a0 tx=0x7f8e2c02b660 comp rx=0 tx=0).stop 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f8e4183f640 1 -- 172.21.15.132:0/1666802422 shutdown_connections 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f8e4183f640 1 --2- 172.21.15.132:0/1666802422 >> v2:172.21.15.132:3300/0 conn(0x7f8e3c0c4e50 0x7f8e3c06b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f8e4183f640 1 --2- 172.21.15.132:0/1666802422 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c0c7e90 0x7f8e3c0c4910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f8e4183f640 1 -- 172.21.15.132:0/1666802422 >> 172.21.15.132:0/1666802422 conn(0x7f8e3c0ca170 msgr2=0x7f8e3c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.033+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c170940 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.033+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c034710 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7fa975744640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa97006e2f0 0x7fa9700c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7fa976746640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa9700aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7fa976746640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa9700aaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48266/0 (socket says 172.21.15.132:48266) 2023-11-18T20:38:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7fa976746640 1 -- 172.21.15.132:0/1403823111 learned_addr learned my addr 172.21.15.132:0/1403823111 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.033+0000 7fa63b94e640 1 Processor -- start 2023-11-18T20:38:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.033+0000 7fa63b94e640 1 -- start start 2023-11-18T20:38:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f0bbffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc0155fc0 0x7f0bc0159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f0bb77fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0bc00c1ca0 0x7f0bc00c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:55416/0 (socket says 172.21.15.132:55416) 2023-11-18T20:38:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f0bc63f0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc006d580 con 0x7f0bc00c1ca0 2023-11-18T20:38:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f0bc63f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc006dd60 con 0x7f0bc00c2e60 2023-11-18T20:38:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f0bc63f0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c6580 con 0x7f0bc0155fc0 2023-11-18T20:38:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7f8e4183f640 1 -- 172.21.15.132:0/1666802422 shutdown_connections 2023-11-18T20:38:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c005360 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f2b4b7fe640 1 -- 172.21.15.132:0/2042911057 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54009800 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.034+0000 7f2b4b7fe640 1 -- 172.21.15.132:0/2042911057 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54009bb0 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7f8e4183f640 1 -- 172.21.15.132:0/1666802422 wait complete. 2023-11-18T20:38:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7f0bbffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc0155fc0 0x7f0bc0159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48256/0 (socket says 172.21.15.132:48256) 2023-11-18T20:38:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7f0bbffff640 1 -- 172.21.15.132:0/2339120768 learned_addr learned my addr 172.21.15.132:0/2339120768 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7fa976746640 1 -- 172.21.15.132:0/1403823111 >> v2:172.21.15.132:3300/0 conn(0x7fa97006e2f0 msgr2=0x7fa9700c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7fa976746640 1 --2- 172.21.15.132:0/1403823111 >> v2:172.21.15.132:3300/0 conn(0x7fa97006e2f0 0x7fa9700c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7fa976746640 1 -- 172.21.15.132:0/1403823111 >> v1:172.21.15.132:6789/0 conn(0x7fa9700c4f60 legacy=0x7fa9701546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7fa976746640 1 -- 172.21.15.132:0/1403823111 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9700c0860 con 0x7fa9700c21b0 2023-11-18T20:38:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7f0bbf7fe640 1 -- 172.21.15.132:0/2339120768 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754205221 0 0) 0x7f0bc006d580 con 0x7f0bc00c1ca0 2023-11-18T20:38:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7f0bbf7fe640 1 -- 172.21.15.132:0/2339120768 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bac003520 con 0x7f0bc00c1ca0 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.035+0000 7fa63b94e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa634156460 0x7fa6340c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7fa6396ea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa634156460 0x7fa6340c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7fa6396ea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa634156460 0x7fa6340c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57950/0 (socket says 172.21.15.132:57950) 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7fa6396ea640 1 -- 172.21.15.132:0/2852356723 learned_addr learned my addr 172.21.15.132:0/2852356723 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7fa63b94e640 1 --2- 172.21.15.132:0/2852356723 >> v2:172.21.15.161:3300/0 conn(0x7fa6340c7f00 0x7fa634158f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7fa63b94e640 1 -- 172.21.15.132:0/2852356723 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63415d0b0 con 0x7fa63415cbb0 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7fa63b94e640 1 -- 172.21.15.132:0/2852356723 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa634159bd0 con 0x7fa634156460 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7fa63b94e640 1 -- 172.21.15.132:0/2852356723 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6340c77d0 con 0x7fa6340c7f00 2023-11-18T20:38:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7f0bc498d640 1 --2- 172.21.15.132:0/2339120768 >> v2:172.21.15.132:3300/0 conn(0x7f0bc00c2e60 0x7f0bc0163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7fa976746640 1 --2- 172.21.15.132:0/1403823111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa9700aaa00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9680060b0 tx=0x7fa96802e2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=129ae8dfa5f203d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7f7caa400640 1 Processor -- start 2023-11-18T20:38:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7f0bbffff640 1 -- 172.21.15.132:0/2339120768 >> v2:172.21.15.132:3300/0 conn(0x7f0bc00c2e60 msgr2=0x7f0bc0163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7f0bbffff640 1 --2- 172.21.15.132:0/2339120768 >> v2:172.21.15.132:3300/0 conn(0x7f0bc00c2e60 0x7f0bc0163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7f0bbffff640 1 -- 172.21.15.132:0/2339120768 >> v1:172.21.15.161:6789/0 conn(0x7f0bc00c1ca0 legacy=0x7f0bc00c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7f7caa400640 1 -- start start 2023-11-18T20:38:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7f0bbffff640 1 -- 172.21.15.132:0/2339120768 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00726d0 con 0x7f0bc0155fc0 2023-11-18T20:38:13.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7fa974f43640 1 -- 172.21.15.132:0/1403823111 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968038600 con 0x7fa9700c21b0 2023-11-18T20:38:13.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7fa974f43640 1 -- 172.21.15.132:0/1403823111 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968032070 con 0x7fa9700c21b0 2023-11-18T20:38:13.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7fa974f43640 1 -- 172.21.15.132:0/1403823111 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968038960 con 0x7fa9700c21b0 2023-11-18T20:38:13.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.038+0000 7f8e4183f640 1 Processor -- start 2023-11-18T20:38:13.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.038+0000 7f8e4183f640 1 -- start start 2023-11-18T20:38:13.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.036+0000 7fa638ee9640 1 --2- 172.21.15.132:0/2852356723 >> v2:172.21.15.161:3300/0 conn(0x7fa6340c7f00 0x7fa634158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7fa6396ea640 1 -- 172.21.15.132:0/2852356723 >> v2:172.21.15.161:3300/0 conn(0x7fa6340c7f00 msgr2=0x7fa634158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7fa6396ea640 1 --2- 172.21.15.132:0/2852356723 >> v2:172.21.15.161:3300/0 conn(0x7fa6340c7f00 0x7fa634158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7fa6396ea640 1 -- 172.21.15.132:0/2852356723 >> v1:172.21.15.161:6789/0 conn(0x7fa63415cbb0 legacy=0x7fa6341594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.037+0000 7fa6396ea640 1 -- 172.21.15.132:0/2852356723 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340c6ea0 con 0x7fa634156460 2023-11-18T20:38:13.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7f8e4183f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e3c0c4e50 0x7f8e3c1f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7f8e4183f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3c0c7e90 0x7f8e3c1f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7f8e4183f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c14e810 0x7f8e3c150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7f8e4183f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c151d90 con 0x7f8e3c0c4e50 2023-11-18T20:38:13.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7f8e4183f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0be8d0 con 0x7f8e3c0c7e90 2023-11-18T20:38:13.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7f8e4183f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0bebb0 con 0x7f8e3c14e810 2023-11-18T20:38:13.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7fa9781a9640 1 -- 172.21.15.132:0/1403823111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 msgr2=0x7fa9700aaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1403823111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa9700aaa00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9680060b0 tx=0x7fa96802e2c0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7fa6396ea640 1 --2- 172.21.15.132:0/2852356723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa634156460 0x7fa6340c4910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6340acbe0 tx=0x7fa63002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1adceb82d09a2d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.039+0000 7f7caa400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ca414e810 0x7f7ca41550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f7caa400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7ca40c7e90 0x7f7ca40c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f7caa400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca40bd8d0 con 0x7f7ca40c4e50 2023-11-18T20:38:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f7caa400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca40c6e60 con 0x7f7ca40c7e90 2023-11-18T20:38:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f7caa400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca4155600 con 0x7f7ca414e810 2023-11-18T20:38:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f8e3a7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3c0c7e90 0x7f8e3c1f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f8e3b7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c14e810 0x7f8e3c150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f8e3a7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3c0c7e90 0x7f8e3c1f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40380/0 (socket says 172.21.15.132:40380) 2023-11-18T20:38:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f7ca3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ca414e810 0x7f7ca41550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f8e3a7fc640 1 -- 172.21.15.132:0/3911715525 learned_addr learned my addr 172.21.15.132:0/3911715525 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f7ca3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ca414e810 0x7f7ca41550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40382/0 (socket says 172.21.15.132:40382) 2023-11-18T20:38:13.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.040+0000 7f7ca3fff640 1 -- 172.21.15.132:0/3644290581 learned_addr learned my addr 172.21.15.132:0/3644290581 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7f2b4b7fe640 1 -- 172.21.15.132:0/2042911057 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b54009d10 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7fa9781a9640 1 -- 172.21.15.132:0/1403823111 shutdown_connections 2023-11-18T20:38:13.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1403823111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa9700aaa00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1403823111 >> v2:172.21.15.132:3300/0 conn(0x7fa97006e2f0 0x7fa9700c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7f8e3b7fe640 1 -- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3c0c7e90 msgr2=0x7f8e3c1f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7f8e3b7fe640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3c0c7e90 0x7f8e3c1f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7f8e3b7fe640 1 -- 172.21.15.132:0/3911715525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e3c0c4e50 msgr2=0x7f8e3c1f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7f8e3b7fe640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e3c0c4e50 0x7f8e3c1f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7f7ca37fe640 1 --2- 172.21.15.132:0/3644290581 >> v2:172.21.15.132:3300/0 conn(0x7f7ca40c7e90 0x7f7ca40c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7f7ca3fff640 1 -- 172.21.15.132:0/3644290581 >> v2:172.21.15.132:3300/0 conn(0x7f7ca40c7e90 msgr2=0x7f7ca40c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7f8e3b7fe640 1 -- 172.21.15.132:0/3911715525 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c009400 con 0x7f8e3c14e810 2023-11-18T20:38:13.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7fa9781a9640 1 -- 172.21.15.132:0/1403823111 >> 172.21.15.132:0/1403823111 conn(0x7fa9700c5cc0 msgr2=0x7fa9700c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7fa9781a9640 1 -- 172.21.15.132:0/1403823111 shutdown_connections 2023-11-18T20:38:13.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.041+0000 7fa9781a9640 1 -- 172.21.15.132:0/1403823111 wait complete. 2023-11-18T20:38:13.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.042+0000 7f8e3b7fe640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c14e810 0x7f8e3c150e40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000e7f0 tx=0x7f8e3000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.042+0000 7f7ca3fff640 1 --2- 172.21.15.132:0/3644290581 >> v2:172.21.15.132:3300/0 conn(0x7f7ca40c7e90 0x7f7ca40c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.042+0000 7f7ca3fff640 1 -- 172.21.15.132:0/3644290581 >> v1:172.21.15.132:6789/0 conn(0x7f7ca40c4e50 legacy=0x7f7ca406b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.042+0000 7f7ca3fff640 1 -- 172.21.15.132:0/3644290581 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40c70d0 con 0x7f7ca414e810 2023-11-18T20:38:13.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.042+0000 7f8e23fff640 1 -- 172.21.15.132:0/3911715525 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30009590 con 0x7f8e3c14e810 2023-11-18T20:38:13.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.042+0000 7f8e23fff640 1 -- 172.21.15.132:0/3911715525 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000c940 con 0x7f8e3c14e810 2023-11-18T20:38:13.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.042+0000 7f8e23fff640 1 -- 172.21.15.132:0/3911715525 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000ccd0 con 0x7f8e3c14e810 2023-11-18T20:38:13.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.042+0000 7f7ca37fe640 1 --2- 172.21.15.132:0/3644290581 >> v2:172.21.15.132:3300/0 conn(0x7f7ca40c7e90 0x7f7ca40c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:13.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.043+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c0bee90 con 0x7f8e3c14e810 2023-11-18T20:38:13.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.043+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c0bfca0 con 0x7f8e3c14e810 2023-11-18T20:38:13.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.044+0000 7f0bbffff640 1 --2- 172.21.15.132:0/2339120768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc0155fc0 0x7f0bc0159470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009870 tx=0x7f0ba802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c460f3c0e0c55111 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.044+0000 7f2b4b7fe640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2b5006ae40 0x7f2b5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.044+0000 7f2b4b7fe640 1 -- 172.21.15.132:0/2042911057 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b5408a2f0 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.045+0000 7f7ca3fff640 1 --2- 172.21.15.132:0/3644290581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca414e810 0x7f7ca41550c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40a98f0 tx=0x7f7c9c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66bf825bb3123296 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.045+0000 7f2b6259c640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2b5006ae40 0x7f2b5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.045+0000 7fa9781a9640 1 Processor -- start 2023-11-18T20:38:13.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.045+0000 7fa9781a9640 1 -- start start 2023-11-18T20:38:13.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.045+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c0bf3b0 con 0x7f8e3c14e810 2023-11-18T20:38:13.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.046+0000 7f7ca2ffd640 1 -- 172.21.15.132:0/3644290581 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c02ca80 con 0x7f7ca414e810 2023-11-18T20:38:13.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.046+0000 7f7ca2ffd640 1 -- 172.21.15.132:0/3644290581 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c02cbe0 con 0x7f7ca414e810 2023-11-18T20:38:13.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.046+0000 7f7ca2ffd640 1 -- 172.21.15.132:0/3644290581 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0343f0 con 0x7f7ca414e810 2023-11-18T20:38:13.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.046+0000 7fa81927c640 1 Processor -- start 2023-11-18T20:38:13.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.046+0000 7f2b6259c640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2b5006ae40 0x7f2b5006d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c04f220 tx=0x7f2b58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f7caa400640 1 -- 172.21.15.132:0/3644290581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca414e810 msgr2=0x7f7ca41550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f7caa400640 1 --2- 172.21.15.132:0/3644290581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca414e810 0x7f7ca41550c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40a98f0 tx=0x7f7c9c02bee0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7fa81927c640 1 -- start start 2023-11-18T20:38:13.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f7caa400640 1 -- 172.21.15.132:0/3644290581 shutdown_connections 2023-11-18T20:38:13.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f7caa400640 1 --2- 172.21.15.132:0/3644290581 >> v2:172.21.15.132:3300/0 conn(0x7f7ca40c7e90 0x7f7ca40c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f7caa400640 1 --2- 172.21.15.132:0/3644290581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca414e810 0x7f7ca41550c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f7caa400640 1 -- 172.21.15.132:0/3644290581 >> 172.21.15.132:0/3644290581 conn(0x7f7ca40ca170 msgr2=0x7f7ca40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7fa9781a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97006e2f0 0x7fa97014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7fa9781a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa970148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7fa9781a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9700c4f60 0x7fa9700bf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7fa9781a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97014ad60 con 0x7fa9700c4f60 2023-11-18T20:38:13.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7fa9781a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97014d0f0 con 0x7fa97006e2f0 2023-11-18T20:38:13.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7fa9781a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97014afb0 con 0x7fa9700c21b0 2023-11-18T20:38:13.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f0bbf7fe640 1 -- 172.21.15.132:0/2339120768 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80317c0 con 0x7f0bc0155fc0 2023-11-18T20:38:13.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f0bbf7fe640 1 -- 172.21.15.132:0/2339120768 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8031920 con 0x7f0bc0155fc0 2023-11-18T20:38:13.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f0bbf7fe640 1 -- 172.21.15.132:0/2339120768 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8031cb0 con 0x7f0bc0155fc0 2023-11-18T20:38:13.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f7caa400640 1 -- 172.21.15.132:0/3644290581 shutdown_connections 2023-11-18T20:38:13.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.046+0000 7f8e23fff640 1 -- 172.21.15.132:0/3911715525 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e30013470 con 0x7f8e3c14e810 2023-11-18T20:38:13.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f8e23fff640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e2806ae40 0x7f8e2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f8e23fff640 1 -- 172.21.15.132:0/3911715525 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e300896b0 con 0x7f8e3c14e810 2023-11-18T20:38:13.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7fa975f45640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97006e2f0 0x7fa97014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7fa975f45640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97006e2f0 0x7fa97014cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40398/0 (socket says 172.21.15.132:40398) 2023-11-18T20:38:13.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7fa976746640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9700c4f60 0x7fa9700bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7fa62bfff640 1 -- 172.21.15.132:0/2852356723 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630031750 con 0x7fa634156460 2023-11-18T20:38:13.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7fa62bfff640 1 -- 172.21.15.132:0/2852356723 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6300318b0 con 0x7fa634156460 2023-11-18T20:38:13.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7fa62bfff640 1 -- 172.21.15.132:0/2852356723 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630031c40 con 0x7fa634156460 2023-11-18T20:38:13.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7f2b4b7fe640 1 -- 172.21.15.132:0/2042911057 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b54055380 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7fa975f45640 1 -- 172.21.15.132:0/1675746671 learned_addr learned my addr 172.21.15.132:0/1675746671 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2339120768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc0155fc0 msgr2=0x7f0bc0159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2339120768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc0155fc0 0x7f0bc0159470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009870 tx=0x7f0ba802b860 comp rx=0 tx=0).stop 2023-11-18T20:38:13.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.048+0000 7fa975744640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa970148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2339120768 shutdown_connections 2023-11-18T20:38:13.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2339120768 >> v2:172.21.15.132:3300/0 conn(0x7f0bc00c2e60 0x7f0bc0163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2339120768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc0155fc0 0x7f0bc0159470 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2339120768 >> 172.21.15.132:0/2339120768 conn(0x7f0bc006a500 msgr2=0x7f0bc006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa63b94e640 1 -- 172.21.15.132:0/2852356723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa634156460 msgr2=0x7fa6340c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2339120768 shutdown_connections 2023-11-18T20:38:13.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2339120768 wait complete. 2023-11-18T20:38:13.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa63b94e640 1 --2- 172.21.15.132:0/2852356723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa634156460 0x7fa6340c4910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6340acbe0 tx=0x7fa63002b7f0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa81927c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8140c1500 0x7fa8140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa81927c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8140c4080 0x7fa814155490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa81927c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140a9430 0x7fa8140a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa81927c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8140a5820 con 0x7fa8140c1500 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa81927c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8141559d0 con 0x7fa8140c4080 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa81927c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140c06c0 con 0x7fa8140a9430 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa812ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8140c1500 0x7fa8140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa812ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8140c1500 0x7fa8140a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57974/0 (socket says 172.21.15.132:57974) 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.049+0000 7fa812ffd640 1 -- 172.21.15.132:0/1065344267 learned_addr learned my addr 172.21.15.132:0/1065344267 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa812ffd640 1 -- 172.21.15.132:0/1065344267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140a9430 msgr2=0x7fa8140a98c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa812ffd640 1 --2- 172.21.15.132:0/1065344267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140a9430 0x7fa8140a98c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa812ffd640 1 -- 172.21.15.132:0/1065344267 >> v2:172.21.15.161:3300/0 conn(0x7fa8140c4080 msgr2=0x7fa814155490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:38:13.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa80a7fc640 1 --2- 172.21.15.132:0/1065344267 >> v2:172.21.15.161:3300/0 conn(0x7fa8140c4080 0x7fa814155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa812ffd640 1 --2- 172.21.15.132:0/1065344267 >> v2:172.21.15.161:3300/0 conn(0x7fa8140c4080 0x7fa814155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa812ffd640 1 -- 172.21.15.132:0/1065344267 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140c1020 con 0x7fa8140c1500 2023-11-18T20:38:13.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7f8e3affd640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e2806ae40 0x7f8e2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.047+0000 7f7caa400640 1 -- 172.21.15.132:0/3644290581 wait complete. 2023-11-18T20:38:13.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7f7caa400640 1 Processor -- start 2023-11-18T20:38:13.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa63b94e640 1 -- 172.21.15.132:0/2852356723 shutdown_connections 2023-11-18T20:38:13.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa63b94e640 1 --2- 172.21.15.132:0/2852356723 >> v2:172.21.15.161:3300/0 conn(0x7fa6340c7f00 0x7fa634158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7f7caa400640 1 -- start start 2023-11-18T20:38:13.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.050+0000 7fa63b94e640 1 --2- 172.21.15.132:0/2852356723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa634156460 0x7fa6340c4910 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa976746640 1 -- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 msgr2=0x7fa970148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa976746640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa970148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa63b94e640 1 -- 172.21.15.132:0/2852356723 >> 172.21.15.132:0/2852356723 conn(0x7fa6340ca170 msgr2=0x7fa6340ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa976746640 1 -- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97006e2f0 msgr2=0x7fa97014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa976746640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97006e2f0 0x7fa97014cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa976746640 1 -- 172.21.15.132:0/1675746671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968005d10 con 0x7fa9700c4f60 2023-11-18T20:38:13.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7f8e3affd640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e2806ae40 0x7f8e2806d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e34007fd0 tx=0x7f8e34007d00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa63b94e640 1 -- 172.21.15.132:0/2852356723 shutdown_connections 2023-11-18T20:38:13.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa812ffd640 1 --2- 172.21.15.132:0/1065344267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140c1500 0x7fa8140a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa8140a5160 tx=0x7fa80403c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cc35cf56927e95 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.051+0000 7fa63b94e640 1 -- 172.21.15.132:0/2852356723 wait complete. 2023-11-18T20:38:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.052+0000 7fa8127fc640 1 -- 172.21.15.132:0/1065344267 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80403e040 con 0x7fa8140c1500 2023-11-18T20:38:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.052+0000 7fa8127fc640 1 -- 172.21.15.132:0/1065344267 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa804042810 con 0x7fa8140c1500 2023-11-18T20:38:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.052+0000 7fa8127fc640 1 -- 172.21.15.132:0/1065344267 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804042ba0 con 0x7fa8140c1500 2023-11-18T20:38:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7f7caa400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca40c4e50 0x7f7ca40c0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 -- 172.21.15.132:0/1065344267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140c1500 msgr2=0x7fa8140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 --2- 172.21.15.132:0/1065344267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140c1500 0x7fa8140a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa8140a5160 tx=0x7fa80403c8b0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7f7caa400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca40c7e90 0x7f7ca41ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 -- 172.21.15.132:0/1065344267 shutdown_connections 2023-11-18T20:38:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 --2- 172.21.15.132:0/1065344267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140a9430 0x7fa8140a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 --2- 172.21.15.132:0/1065344267 >> v2:172.21.15.161:3300/0 conn(0x7fa8140c4080 0x7fa814155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 --2- 172.21.15.132:0/1065344267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140c1500 0x7fa8140a51b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 -- 172.21.15.132:0/1065344267 >> 172.21.15.132:0/1065344267 conn(0x7fa81406a500 msgr2=0x7fa81406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 -- 172.21.15.132:0/1065344267 shutdown_connections 2023-11-18T20:38:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7f0bc63f0640 1 Processor -- start 2023-11-18T20:38:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7fa81927c640 1 -- 172.21.15.132:0/1065344267 wait complete. 2023-11-18T20:38:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7f7caa400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca414e810 0x7f7ca40be830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7f0bc63f0640 1 -- start start 2023-11-18T20:38:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7f7ca3fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca40c4e50 0x7f7ca40c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.054+0000 7fa976746640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9700c4f60 0x7fa9700bf390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa968036000 tx=0x7fa968004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.053+0000 7f7ca899d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca414e810 0x7f7ca40be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.054+0000 7f7ca899d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca414e810 0x7f7ca40be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57990/0 (socket says 172.21.15.132:57990) 2023-11-18T20:38:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.054+0000 7f7ca899d640 1 -- 172.21.15.132:0/3401586743 learned_addr learned my addr 172.21.15.132:0/3401586743 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.054+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41ee2b0 con 0x7f7ca414e810 2023-11-18T20:38:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.054+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41edfd0 con 0x7f7ca40c7e90 2023-11-18T20:38:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.054+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41564d0 con 0x7f7ca40c4e50 2023-11-18T20:38:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f7ca899d640 1 -- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca40c4e50 msgr2=0x7f7ca40c0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f7ca37fe640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca40c7e90 0x7f7ca41ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f0bc63f0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc00c1ca0 0x7f0bc00bace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7fa81927c640 1 Processor -- start 2023-11-18T20:38:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7fa63b94e640 1 Processor -- start 2023-11-18T20:38:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7fa9667fc640 1 -- 172.21.15.132:0/1675746671 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968004880 con 0x7fa9700c4f60 2023-11-18T20:38:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7fa9667fc640 1 -- 172.21.15.132:0/1675746671 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968042410 con 0x7fa9700c4f60 2023-11-18T20:38:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7fa9667fc640 1 -- 172.21.15.132:0/1675746671 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680427a0 con 0x7fa9700c4f60 2023-11-18T20:38:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f0bc63f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc00c2e60 0x7f0bc00c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f0bc63f0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bc0155fc0 0x7f0bc0151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f0bc63f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00bbce0 con 0x7f0bc00c2e60 2023-11-18T20:38:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7fa81927c640 1 -- start start 2023-11-18T20:38:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f0bc63f0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01f13c0 con 0x7f0bc0155fc0 2023-11-18T20:38:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f0bc63f0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01f16a0 con 0x7f0bc00c1ca0 2023-11-18T20:38:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7fa63b94e640 1 -- start start 2023-11-18T20:38:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f7ca899d640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca40c4e50 0x7f7ca40c0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f7ca899d640 1 -- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca40c7e90 msgr2=0x7f7ca41ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f7ca899d640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca40c7e90 0x7f7ca41ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f7ca899d640 1 -- 172.21.15.132:0/3401586743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c009b30 con 0x7f7ca414e810 2023-11-18T20:38:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.055+0000 7f7ca899d640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca414e810 0x7f7ca40be830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c3c0 tx=0x7f7c9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97014ddb0 con 0x7fa9700c4f60 2023-11-18T20:38:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7f7ca0ff9640 1 -- 172.21.15.132:0/3401586743 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940052d0 con 0x7f7ca414e810 2023-11-18T20:38:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7f7ca0ff9640 1 -- 172.21.15.132:0/3401586743 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c94005430 con 0x7f7ca414e810 2023-11-18T20:38:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7f0bbffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc00c1ca0 0x7f0bc00bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7f7ca0ff9640 1 -- 172.21.15.132:0/3401586743 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94007260 con 0x7f7ca414e810 2023-11-18T20:38:13.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7f0bb77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc00c2e60 0x7f0bc00c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.056+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97014c0d0 con 0x7fa9700c4f60 2023-11-18T20:38:13.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.057+0000 7f0bbffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc00c1ca0 0x7f0bc00bace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48302/0 (socket says 172.21.15.132:48302) 2023-11-18T20:38:13.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.057+0000 7f0bbffff640 1 -- 172.21.15.132:0/2464419489 learned_addr learned my addr 172.21.15.132:0/2464419489 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.057+0000 7f0bc498d640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bc0155fc0 0x7f0bc0151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.057+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca41567b0 con 0x7f7ca414e810 2023-11-18T20:38:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.057+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca41edb20 con 0x7f7ca414e810 2023-11-18T20:38:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa81927c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8140a9430 0x7fa814070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7f0bb77fe640 1 -- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc00c1ca0 msgr2=0x7f0bc00bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7f0bb77fe640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc00c1ca0 0x7f0bc00bace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7f0bb77fe640 1 -- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bc0155fc0 msgr2=0x7f0bc0151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7f0bb77fe640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bc0155fc0 0x7f0bc0151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7f0bb77fe640 1 -- 172.21.15.132:0/2464419489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba80094d0 con 0x7f0bc00c2e60 2023-11-18T20:38:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7f0bc498d640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bc0155fc0 0x7f0bc0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:38:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa81927c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140c4080 0x7fa81414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa81927c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140a7650 0x7fa81414ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa812ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8140a9430 0x7fa814070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa81927c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814152b80 con 0x7fa8140a7650 2023-11-18T20:38:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa81927c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140721b0 con 0x7fa8140a9430 2023-11-18T20:38:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa81927c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa814152dd0 con 0x7fa8140c4080 2023-11-18T20:38:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.060+0000 7f0bb77fe640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc00c2e60 0x7f0bc00c42e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c430 tx=0x7f0bb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa8137fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140a7650 0x7fa81414ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa812ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8140a9430 0x7fa814070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40424/0 (socket says 172.21.15.132:40424) 2023-11-18T20:38:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.059+0000 7fa812ffd640 1 -- 172.21.15.132:0/1725520215 learned_addr learned my addr 172.21.15.132:0/1725520215 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.060+0000 7fa80a7fc640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140c4080 0x7fa81414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7fa8137fe640 1 -- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140c4080 msgr2=0x7fa81414c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7fa8137fe640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140c4080 0x7fa81414c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7fa8137fe640 1 -- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8140a9430 msgr2=0x7fa814070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7fa8137fe640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8140a9430 0x7fa814070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7fa8137fe640 1 -- 172.21.15.132:0/1725520215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040094d0 con 0x7fa8140a7650 2023-11-18T20:38:13.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7f7ca0ff9640 1 -- 172.21.15.132:0/3401586743 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c940073c0 con 0x7f7ca414e810 2023-11-18T20:38:13.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7fa63b94e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6340c7f00 0x7fa6340c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7fa63b94e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa634156460 0x7fa6340c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.060+0000 7f0bbd7fa640 1 -- 172.21.15.132:0/2464419489 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00074e0 con 0x7f0bc00c2e60 2023-11-18T20:38:13.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.060+0000 7f0bbd7fa640 1 -- 172.21.15.132:0/2464419489 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0007660 con 0x7f0bc00c2e60 2023-11-18T20:38:13.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.060+0000 7f0bbd7fa640 1 -- 172.21.15.132:0/2464419489 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0004a20 con 0x7f0bc00c2e60 2023-11-18T20:38:13.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.060+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc01f1980 con 0x7f0bc00c2e60 2023-11-18T20:38:13.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.060+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc01f1f40 con 0x7f0bc00c2e60 2023-11-18T20:38:13.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.061+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc0068350 con 0x7f0bc00c2e60 2023-11-18T20:38:13.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7fa63b94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa63415cbb0 0x7fa6340bf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84005250 con 0x7f7ca414e810 2023-11-18T20:38:13.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7fa8137fe640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140a7650 0x7fa81414ba60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00be30 tx=0x7fa80c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7f7ca3fff640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca40c4e50 0x7f7ca40c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:13.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7f7ca0ff9640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7c9006ae90 0x7f7c9006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7f7ca0ff9640 1 -- 172.21.15.132:0/3401586743 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c94088910 con 0x7f7ca414e810 2023-11-18T20:38:13.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.064+0000 7f8e23fff640 1 -- 172.21.15.132:0/3911715525 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e3c0bf3b0 con 0x7f8e3c14e810 2023-11-18T20:38:13.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.058+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa970068350 con 0x7fa9700c4f60 2023-11-18T20:38:13.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.063+0000 7fa9667fc640 1 -- 172.21.15.132:0/1675746671 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa968038400 con 0x7fa9700c4f60 2023-11-18T20:38:13.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.063+0000 7fa9667fc640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95406af10 0x7fa95406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.063+0000 7fa9667fc640 1 -- 172.21.15.132:0/1675746671 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9680ab9b0 con 0x7fa9700c4f60 2023-11-18T20:38:13.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.064+0000 7f0bbd7fa640 1 -- 172.21.15.132:0/2464419489 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bb0004b80 con 0x7f0bc00c2e60 2023-11-18T20:38:13.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7fa6396ea640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6340c7f00 0x7fa6340c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7fa6396ea640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6340c7f00 0x7fa6340c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48322/0 (socket says 172.21.15.132:48322) 2023-11-18T20:38:13.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7fa638ee9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa634156460 0x7fa6340c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.062+0000 7fa638ee9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa634156460 0x7fa6340c1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:40432/0 (socket says 172.21.15.132:40432) 2023-11-18T20:38:13.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.064+0000 7fa63b94e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340bce30 con 0x7fa63415cbb0 2023-11-18T20:38:13.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.064+0000 7fa63b94e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340c0170 con 0x7fa634156460 2023-11-18T20:38:13.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.064+0000 7fa63b94e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6341513f0 con 0x7fa6340c7f00 2023-11-18T20:38:13.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.064+0000 7fa6396ea640 1 -- 172.21.15.132:0/1401751852 learned_addr learned my addr 172.21.15.132:0/1401751852 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.065+0000 7f7ca3fff640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7c9006ae90 0x7f7c9006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.065+0000 7fa6396ea640 1 -- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa634156460 msgr2=0x7fa6340c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.065+0000 7fa6396ea640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa634156460 0x7fa6340c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.065+0000 7fa6396ea640 1 -- 172.21.15.132:0/1401751852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa63415cbb0 msgr2=0x7fa6340bf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.065+0000 7fa6396ea640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa63415cbb0 0x7fa6340bf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.065+0000 7fa6396ea640 1 -- 172.21.15.132:0/1401751852 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300094d0 con 0x7fa6340c7f00 2023-11-18T20:38:13.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.065+0000 7f0bbd7fa640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ba006ae40 0x7f0ba006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.066+0000 7fa975f45640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95406af10 0x7fa95406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.066+0000 7fa6396ea640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6340c7f00 0x7fa6340c3f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa630000c00 tx=0x7fa6300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.066+0000 7f0bbd7fa640 1 -- 172.21.15.132:0/2464419489 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bb0089650 con 0x7f0bc00c2e60 2023-11-18T20:38:13.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.066+0000 7f0bbffff640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ba006ae40 0x7f0ba006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.066+0000 7fa629ffb640 1 -- 172.21.15.132:0/1401751852 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630033c80 con 0x7fa6340c7f00 2023-11-18T20:38:13.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.067+0000 7fa629ffb640 1 -- 172.21.15.132:0/1401751852 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630033de0 con 0x7fa6340c7f00 2023-11-18T20:38:13.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.067+0000 7fa629ffb640 1 -- 172.21.15.132:0/1401751852 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63003c600 con 0x7fa6340c7f00 2023-11-18T20:38:13.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.067+0000 7fa63b94e640 1 -- 172.21.15.132:0/1401751852 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6340bd2f0 con 0x7fa6340c7f00 2023-11-18T20:38:13.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.067+0000 7fa63b94e640 1 -- 172.21.15.132:0/1401751852 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6341f2c20 con 0x7fa6340c7f00 2023-11-18T20:38:13.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.068+0000 7f0bbffff640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ba006ae40 0x7f0ba006d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009870 tx=0x7f0ba803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.068+0000 7fa6177fe640 1 -- 172.21.15.132:0/1401751852 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa610005250 con 0x7fa6340c7f00 2023-11-18T20:38:13.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.069+0000 7f7ca3fff640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7c9006ae90 0x7f7c9006d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c035000 tx=0x7f7c9c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.069+0000 7fa975f45640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95406af10 0x7fa95406d3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa960001840 tx=0x7fa960009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.071+0000 7fa629ffb640 1 -- 172.21.15.132:0/1401751852 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa63003a040 con 0x7fa6340c7f00 2023-11-18T20:38:13.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.072+0000 7fa9667fc640 1 -- 172.21.15.132:0/1675746671 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa968076b80 con 0x7fa9700c4f60 2023-11-18T20:38:13.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.072+0000 7fa629ffb640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa61806af40 0x7fa61806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.073+0000 7fa629ffb640 1 -- 172.21.15.132:0/1401751852 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6300ab570 con 0x7fa6340c7f00 2023-11-18T20:38:13.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.073+0000 7fa638ee9640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa61806af40 0x7fa61806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.074+0000 7fa638ee9640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa61806af40 0x7fa61806d400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6341561c0 tx=0x7fa624008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.078+0000 7f7ca0ff9640 1 -- 172.21.15.132:0/3401586743 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c94053a30 con 0x7f7ca414e810 2023-11-18T20:38:13.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.083+0000 7fa629ffb640 1 -- 172.21.15.132:0/1401751852 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa630076860 con 0x7fa6340c7f00 2023-11-18T20:38:13.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.086+0000 7fa80bfff640 1 -- 172.21.15.132:0/1725520215 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00ce90 con 0x7fa8140a7650 2023-11-18T20:38:13.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.086+0000 7fa80bfff640 1 -- 172.21.15.132:0/1725520215 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c014440 con 0x7fa8140a7650 2023-11-18T20:38:13.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.086+0000 7f0bbd7fa640 1 -- 172.21.15.132:0/2464419489 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0bb0054870 con 0x7f0bc00c2e60 2023-11-18T20:38:13.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.086+0000 7fa80bfff640 1 -- 172.21.15.132:0/1725520215 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0147f0 con 0x7fa8140a7650 2023-11-18T20:38:13.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.086+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8141530b0 con 0x7fa8140a7650 2023-11-18T20:38:13.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.086+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa814071e40 con 0x7fa8140a7650 2023-11-18T20:38:13.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.089+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8140a8900 con 0x7fa8140a7650 2023-11-18T20:38:13.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.091+0000 7fa80bfff640 1 -- 172.21.15.132:0/1725520215 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa80c01d3b0 con 0x7fa8140a7650 2023-11-18T20:38:13.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.093+0000 7fa80bfff640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f406ae90 0x7fa7f406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.093+0000 7fa80bfff640 1 -- 172.21.15.132:0/1725520215 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa80c0896f0 con 0x7fa8140a7650 2023-11-18T20:38:13.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.094+0000 7fa812ffd640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f406ae90 0x7fa7f406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.096+0000 7fa812ffd640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f406ae90 0x7fa7f406d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa80403c8f0 tx=0x7fa80404d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.101+0000 7fa80bfff640 1 -- 172.21.15.132:0/1725520215 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa80c0548c0 con 0x7fa8140a7650 2023-11-18T20:38:13.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.394+0000 7feada7fc640 1 -- 172.21.15.132:0/3922487429 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feae40c16b0 con 0x7feae4071810 2023-11-18T20:38:13.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.395+0000 7feae17fa640 1 -- 172.21.15.132:0/3922487429 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feadc0554a0 con 0x7feae4071810 2023-11-18T20:38:13.399 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:13.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.399+0000 7feada7fc640 1 -- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac406aec0 msgr2=0x7feac406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.399+0000 7feada7fc640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac406aec0 0x7feac406d380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feacc034000 tx=0x7feacc009070 comp rx=0 tx=0).stop 2023-11-18T20:38:13.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.399+0000 7feada7fc640 1 -- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae4071810 msgr2=0x7feae4071cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.399+0000 7feada7fc640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae4071810 0x7feae4071cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feadc004bf0 tx=0x7feadc008b80 comp rx=0 tx=0).stop 2023-11-18T20:38:13.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.400+0000 7feada7fc640 1 -- 172.21.15.132:0/3922487429 shutdown_connections 2023-11-18T20:38:13.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.400+0000 7feada7fc640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac406aec0 0x7feac406d380 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feacc034000 tx=0x7feacc009070 comp rx=0 tx=0).stop 2023-11-18T20:38:13.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.400+0000 7feada7fc640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae4071810 0x7feae4071cc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.400+0000 7feada7fc640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae40bb820 0x7feae40a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.400+0000 7feada7fc640 1 --2- 172.21.15.132:0/3922487429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead0003970 0x7feae4154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.400+0000 7feada7fc640 1 -- 172.21.15.132:0/3922487429 >> 172.21.15.132:0/3922487429 conn(0x7feae40a7900 msgr2=0x7feae406c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.400+0000 7feada7fc640 1 -- 172.21.15.132:0/3922487429 shutdown_connections 2023-11-18T20:38:13.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.401+0000 7feada7fc640 1 -- 172.21.15.132:0/3922487429 wait complete. 2023-11-18T20:38:13.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2023-11-18T20:38:13.429 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:13.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.446+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2b5c0d81b0 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.447+0000 7f2b4b7fe640 1 -- 172.21.15.132:0/2042911057 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b540589a0 con 0x7f2b5c00fcc0 2023-11-18T20:38:13.448 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:13.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.450+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2b5006ae40 msgr2=0x7f2b5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.450+0000 7f2b688a1640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2b5006ae40 0x7f2b5006d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c04f220 tx=0x7f2b58009040 comp rx=0 tx=0).stop 2023-11-18T20:38:13.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.450+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c00fcc0 msgr2=0x7f2b5c032870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.450+0000 7f2b688a1640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c032870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400d7d0 tx=0x7f2b5400dc90 comp rx=0 tx=0).stop 2023-11-18T20:38:13.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.451+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 shutdown_connections 2023-11-18T20:38:13.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.451+0000 7f2b688a1640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2b5006ae40 0x7f2b5006d300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.451+0000 7f2b688a1640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b5c0d78f0 0x7f2b5c030800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.451+0000 7f2b688a1640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c0506f0 0x7f2b5c0341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.451+0000 7f2b688a1640 1 --2- 172.21.15.132:0/2042911057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c00fcc0 0x7f2b5c032870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.451+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 >> 172.21.15.132:0/2042911057 conn(0x7f2b5c04fbd0 msgr2=0x7f2b5c006190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.451+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 shutdown_connections 2023-11-18T20:38:13.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.451+0000 7f2b688a1640 1 -- 172.21.15.132:0/2042911057 wait complete. 2023-11-18T20:38:13.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.459+0000 7fa6177fe640 1 -- 172.21.15.132:0/1401751852 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa6100057d0 con 0x7fa6340c7f00 2023-11-18T20:38:13.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.460+0000 7fa629ffb640 1 -- 172.21.15.132:0/1401751852 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa630038020 con 0x7fa6340c7f00 2023-11-18T20:38:13.461 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:13.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 -- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa61806af40 msgr2=0x7fa61806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa61806af40 0x7fa61806d400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6341561c0 tx=0x7fa624008040 comp rx=0 tx=0).stop 2023-11-18T20:38:13.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 -- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6340c7f00 msgr2=0x7fa6340c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6340c7f00 0x7fa6340c3f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa630000c00 tx=0x7fa6300046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 -- 172.21.15.132:0/1401751852 shutdown_connections 2023-11-18T20:38:13.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa61806af40 0x7fa61806d400 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa63415cbb0 0x7fa6340bf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa634156460 0x7fa6340c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 --2- 172.21.15.132:0/1401751852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6340c7f00 0x7fa6340c3f70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.462+0000 7fa6177fe640 1 -- 172.21.15.132:0/1401751852 >> 172.21.15.132:0/1401751852 conn(0x7fa6340ca170 msgr2=0x7fa634157af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.464+0000 7fa6177fe640 1 -- 172.21.15.132:0/1401751852 shutdown_connections 2023-11-18T20:38:13.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.464+0000 7fa6177fe640 1 -- 172.21.15.132:0/1401751852 wait complete. 2023-11-18T20:38:13.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.465+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e3c0bf3b0 con 0x7f8e3c14e810 2023-11-18T20:38:13.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.466+0000 7f8e23fff640 1 -- 172.21.15.132:0/3911715525 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e3c0bf3b0 con 0x7f8e3c14e810 2023-11-18T20:38:13.467 INFO:teuthology.orchestra.run.smithi132.stdout:60129542151 2023-11-18T20:38:13.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.469+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e2806ae40 msgr2=0x7f8e2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.469+0000 7f8e4183f640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e2806ae40 0x7f8e2806d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e34007fd0 tx=0x7f8e34007d00 comp rx=0 tx=0).stop 2023-11-18T20:38:13.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.469+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c14e810 msgr2=0x7f8e3c150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.469+0000 7f8e4183f640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c14e810 0x7f8e3c150e40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000e7f0 tx=0x7f8e3000ecb0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.470+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 shutdown_connections 2023-11-18T20:38:13.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.470+0000 7f8e4183f640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e2806ae40 0x7f8e2806d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.470+0000 7f8e4183f640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e3c14e810 0x7f8e3c150e40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.470+0000 7f8e4183f640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3c0c7e90 0x7f8e3c1f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.470+0000 7f8e4183f640 1 --2- 172.21.15.132:0/3911715525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e3c0c4e50 0x7f8e3c1f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.470+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 >> 172.21.15.132:0/3911715525 conn(0x7f8e3c0ca170 msgr2=0x7f8e3c155dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.470+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 shutdown_connections 2023-11-18T20:38:13.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.470+0000 7f8e4183f640 1 -- 172.21.15.132:0/3911715525 wait complete. 2023-11-18T20:38:13.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2023-11-18T20:38:13.478 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:13.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2023-11-18T20:38:13.485 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:13.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2023-11-18T20:38:13.490 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:13.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.494+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa9700c02a0 con 0x7fa9700c4f60 2023-11-18T20:38:13.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.495+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7c84005500 con 0x7f7ca414e810 2023-11-18T20:38:13.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.495+0000 7fa9667fc640 1 -- 172.21.15.132:0/1675746671 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa968047090 con 0x7fa9700c4f60 2023-11-18T20:38:13.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.495+0000 7f7ca0ff9640 1 -- 172.21.15.132:0/3401586743 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c94057050 con 0x7f7ca414e810 2023-11-18T20:38:13.496 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:13.497 INFO:teuthology.orchestra.run.smithi132.stdout:60129542151 2023-11-18T20:38:13.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95406af10 msgr2=0x7fa95406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95406af10 0x7fa95406d3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa960001840 tx=0x7fa960009040 comp rx=0 tx=0).stop 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9700c4f60 msgr2=0x7fa9700bf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9700c4f60 0x7fa9700bf390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa968036000 tx=0x7fa968004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 shutdown_connections 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa95406af10 0x7fa95406d3d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9700c4f60 0x7fa9700bf390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c21b0 0x7fa970148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 --2- 172.21.15.132:0/1675746671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97006e2f0 0x7fa97014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 >> 172.21.15.132:0/1675746671 conn(0x7fa9700c5cc0 msgr2=0x7fa9700c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7c9006ae90 msgr2=0x7f7c9006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7c9006ae90 0x7f7c9006d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c035000 tx=0x7f7c9c030000 comp rx=0 tx=0).stop 2023-11-18T20:38:13.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca414e810 msgr2=0x7f7ca40be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca414e810 0x7f7ca40be830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c3c0 tx=0x7f7c9400c880 comp rx=0 tx=0).stop 2023-11-18T20:38:13.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 shutdown_connections 2023-11-18T20:38:13.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 shutdown_connections 2023-11-18T20:38:13.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7c9006ae90 0x7f7c9006d350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca414e810 0x7f7ca40be830 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca40c7e90 0x7f7ca41ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 --2- 172.21.15.132:0/3401586743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ca40c4e50 0x7f7ca40c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.498+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 >> 172.21.15.132:0/3401586743 conn(0x7f7ca40ca170 msgr2=0x7f7ca414ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.499+0000 7fa9781a9640 1 -- 172.21.15.132:0/1675746671 wait complete. 2023-11-18T20:38:13.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.499+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 shutdown_connections 2023-11-18T20:38:13.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.499+0000 7f7caa400640 1 -- 172.21.15.132:0/3401586743 wait complete. 2023-11-18T20:38:13.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.504+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0bc0071140 con 0x7f0bc00c2e60 2023-11-18T20:38:13.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.504+0000 7f0bbd7fa640 1 -- 172.21.15.132:0/2464419489 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0bb0057e90 con 0x7f0bc00c2e60 2023-11-18T20:38:13.506 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ba006ae40 msgr2=0x7f0ba006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ba006ae40 0x7f0ba006d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009870 tx=0x7f0ba803d040 comp rx=0 tx=0).stop 2023-11-18T20:38:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc00c2e60 msgr2=0x7f0bc00c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc00c2e60 0x7f0bc00c42e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c430 tx=0x7f0bb000c8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 shutdown_connections 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ba006ae40 0x7f0ba006d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bc0155fc0 0x7f0bc0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc00c2e60 0x7f0bc00c42e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 --2- 172.21.15.132:0/2464419489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bc00c1ca0 0x7f0bc00bace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 >> 172.21.15.132:0/2464419489 conn(0x7f0bc006a500 msgr2=0x7f0bc00c2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 shutdown_connections 2023-11-18T20:38:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.508+0000 7f0bc63f0640 1 -- 172.21.15.132:0/2464419489 wait complete. 2023-11-18T20:38:13.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.513+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa814068350 con 0x7fa8140a7650 2023-11-18T20:38:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.513+0000 7fa80bfff640 1 -- 172.21.15.132:0/1725520215 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa80c057ee0 con 0x7fa8140a7650 2023-11-18T20:38:13.514 INFO:teuthology.orchestra.run.smithi132.stdout:60129542150 2023-11-18T20:38:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f406ae90 msgr2=0x7fa7f406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f406ae90 0x7fa7f406d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa80403c8f0 tx=0x7fa80404d040 comp rx=0 tx=0).stop 2023-11-18T20:38:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140a7650 msgr2=0x7fa81414ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140a7650 0x7fa81414ba60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00be30 tx=0x7fa80c00bf20 comp rx=0 tx=0).stop 2023-11-18T20:38:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 shutdown_connections 2023-11-18T20:38:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f406ae90 0x7fa7f406d350 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8140a7650 0x7fa81414ba60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8140c4080 0x7fa81414c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 --2- 172.21.15.132:0/1725520215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8140a9430 0x7fa814070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 >> 172.21.15.132:0/1725520215 conn(0x7fa81406a500 msgr2=0x7fa814155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 shutdown_connections 2023-11-18T20:38:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.516+0000 7fa81927c640 1 -- 172.21.15.132:0/1725520215 wait complete. 2023-11-18T20:38:13.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2023-11-18T20:38:13.519 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:13.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2023-11-18T20:38:13.523 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:13.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2023-11-18T20:38:13.529 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:13.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2023-11-18T20:38:13.533 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:13.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-18T20:38:13.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:38:13.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.781+0000 7f1542bcc640 1 Processor -- start 2023-11-18T20:38:13.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.781+0000 7f1542bcc640 1 -- start start 2023-11-18T20:38:13.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1542bcc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c14fd30 0x7f153c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1542bcc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f153c0c3ea0 0x7f153c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1542bcc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c0c64a0 con 0x7f153c06d0a0 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1542bcc640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c0c5c00 con 0x7f153c0c3ea0 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1542bcc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0c5ee0 con 0x7f153c14fd30 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1541169640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f153c0c3ea0 0x7f153c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1541169640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f153c0c3ea0 0x7f153c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58032/0 (socket says 172.21.15.132:58032) 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1541169640 1 -- 172.21.15.132:0/1228686592 learned_addr learned my addr 172.21.15.132:0/1228686592 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1540968640 1 --2- 172.21.15.132:0/1228686592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c14fd30 0x7f153c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1541169640 1 -- 172.21.15.132:0/1228686592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c14fd30 msgr2=0x7f153c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1541169640 1 --2- 172.21.15.132:0/1228686592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c14fd30 0x7f153c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1541169640 1 -- 172.21.15.132:0/1228686592 >> v1:172.21.15.161:6789/0 conn(0x7f153c06d0a0 legacy=0x7f153c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.783+0000 7f1541169640 1 -- 172.21.15.132:0/1228686592 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0c61c0 con 0x7f153c0c3ea0 2023-11-18T20:38:13.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.784+0000 7f1541169640 1 --2- 172.21.15.132:0/1228686592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c0c3ea0 0x7f153c0c4330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1534009e50 tx=0x7f153402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aa39ce54cd2e4b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.785+0000 7f153b7fe640 1 -- 172.21.15.132:0/1228686592 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153402ca80 con 0x7f153c0c3ea0 2023-11-18T20:38:13.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.785+0000 7f153b7fe640 1 -- 172.21.15.132:0/1228686592 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153402cbe0 con 0x7f153c0c3ea0 2023-11-18T20:38:13.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.785+0000 7f153b7fe640 1 -- 172.21.15.132:0/1228686592 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15340343f0 con 0x7f153c0c3ea0 2023-11-18T20:38:13.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.785+0000 7f1542bcc640 1 -- 172.21.15.132:0/1228686592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c0c3ea0 msgr2=0x7f153c0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.785+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1228686592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c0c3ea0 0x7f153c0c4330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1534009e50 tx=0x7f153402bee0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.786+0000 7f1542bcc640 1 -- 172.21.15.132:0/1228686592 shutdown_connections 2023-11-18T20:38:13.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.786+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1228686592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c0c3ea0 0x7f153c0c4330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.786+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1228686592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c14fd30 0x7f153c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.786+0000 7f1542bcc640 1 -- 172.21.15.132:0/1228686592 >> 172.21.15.132:0/1228686592 conn(0x7f153c06a500 msgr2=0x7f153c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.786+0000 7f1542bcc640 1 -- 172.21.15.132:0/1228686592 shutdown_connections 2023-11-18T20:38:13.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.786+0000 7f1542bcc640 1 -- 172.21.15.132:0/1228686592 wait complete. 2023-11-18T20:38:13.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.787+0000 7f1542bcc640 1 Processor -- start 2023-11-18T20:38:13.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.787+0000 7f1542bcc640 1 -- start start 2023-11-18T20:38:13.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1542bcc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c06d0a0 0x7f153c1de1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1542bcc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c0c3ea0 0x7f153c06ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1542bcc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f153c14fd30 0x7f153c070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1542bcc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1ddae0 con 0x7f153c06d0a0 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1542bcc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0716a0 con 0x7f153c14fd30 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1542bcc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1eb170 con 0x7f153c0c3ea0 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1540968640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c06d0a0 0x7f153c1de1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1540968640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c06d0a0 0x7f153c1de1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58034/0 (socket says 172.21.15.132:58034) 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.788+0000 7f1540968640 1 -- 172.21.15.132:0/1436288856 learned_addr learned my addr 172.21.15.132:0/1436288856 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f1541169640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f153c14fd30 0x7f153c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f153bfff640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c0c3ea0 0x7f153c06ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f1540968640 1 -- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c0c3ea0 msgr2=0x7f153c06ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f1540968640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c0c3ea0 0x7f153c06ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f1540968640 1 -- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f153c14fd30 msgr2=0x7f153c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f1540968640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f153c14fd30 0x7f153c070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f1540968640 1 -- 172.21.15.132:0/1436288856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534009b30 con 0x7f153c06d0a0 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f153bfff640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c0c3ea0 0x7f153c06ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f1540968640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c06d0a0 0x7f153c1de1e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f153000c7f0 tx=0x7f153000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f15397fa640 1 -- 172.21.15.132:0/1436288856 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530004220 con 0x7f153c06d0a0 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f15397fa640 1 -- 172.21.15.132:0/1436288856 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15300043a0 con 0x7f153c06d0a0 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f15397fa640 1 -- 172.21.15.132:0/1436288856 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530007860 con 0x7f153c06d0a0 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.789+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c071940 con 0x7f153c06d0a0 2023-11-18T20:38:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.790+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c1de720 con 0x7f153c06d0a0 2023-11-18T20:38:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.790+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c1dc5a0 con 0x7f153c06d0a0 2023-11-18T20:38:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.791+0000 7f15397fa640 1 -- 172.21.15.132:0/1436288856 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1530007bd0 con 0x7f153c06d0a0 2023-11-18T20:38:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.792+0000 7f15397fa640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f152006ae40 0x7f152006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.792+0000 7f15397fa640 1 -- 172.21.15.132:0/1436288856 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1530089570 con 0x7f153c06d0a0 2023-11-18T20:38:13.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.793+0000 7f153bfff640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f152006ae40 0x7f152006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:13.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.794+0000 7f153bfff640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f152006ae40 0x7f152006d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f153c1569c0 tx=0x7f1528008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.796+0000 7f15397fa640 1 -- 172.21.15.132:0/1436288856 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f153c1dc5a0 con 0x7f153c06d0a0 2023-11-18T20:38:13.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.969+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f153c072980 con 0x7f152006ae40 2023-11-18T20:38:13.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.989+0000 7f15397fa640 1 -- 172.21.15.132:0/1436288856 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264369 (secure 0 0 0) 0x7f152800ad80 con 0x7f152006ae40 2023-11-18T20:38:13.992 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:13.995 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:38:13.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.994+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f152006ae40 msgr2=0x7f152006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.994+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f152006ae40 0x7f152006d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f153c1569c0 tx=0x7f1528008040 comp rx=0 tx=0).stop 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.994+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c06d0a0 msgr2=0x7f153c1de1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c06d0a0 0x7f153c1de1e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f153000c7f0 tx=0x7f153000ccb0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 shutdown_connections 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f152006ae40 0x7f152006d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f153c14fd30 0x7f153c070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f153c0c3ea0 0x7f153c06ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 --2- 172.21.15.132:0/1436288856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153c06d0a0 0x7f153c1de1e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 >> 172.21.15.132:0/1436288856 conn(0x7f153c06a500 msgr2=0x7f153c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 shutdown_connections 2023-11-18T20:38:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:13.995+0000 7f1542bcc640 1 -- 172.21.15.132:0/1436288856 wait complete. 2023-11-18T20:38:14.013 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-18T20:38:12.634713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2957312,"data_stored":1778604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004415"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866689+0000","last_change":"2023-11-18T20:37:59.173833+0000","last_active":"2023-11-18T20:38:00.866689+0000","last_peered":"2023-11-18T20:38:00.866689+0000","last_clean":"2023-11-18T20:38:00.866689+0000","last_became_active":"2023-11-18T20:37:59.170737+0000","last_became_peered":"2023-11-18T20:37:59.170737+0000","last_unstale":"2023-11-18T20:38:00.866689+0000","last_undegraded":"2023-11-18T20:38:00.866689+0000","last_fullsized":"2023-11-18T20:38:00.866689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:40.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871317+0000","last_change":"2023-11-18T20:37:59.178504+0000","last_active":"2023-11-18T20:38:01.871317+0000","last_peered":"2023-11-18T20:38:01.871317+0000","last_clean":"2023-11-18T20:38:01.871317+0000","last_became_active":"2023-11-18T20:37:59.178247+0000","last_became_peered":"2023-11-18T20:37:59.178247+0000","last_unstale":"2023-11-18T20:38:01.871317+0000","last_undegraded":"2023-11-18T20:38:01.871317+0000","last_fullsized":"2023-11-18T20:38:01.871317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:31.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870992+0000","last_change":"2023-11-18T20:37:59.181891+0000","last_active":"2023-11-18T20:38:01.870992+0000","last_peered":"2023-11-18T20:38:01.870992+0000","last_clean":"2023-11-18T20:38:01.870992+0000","last_became_active":"2023-11-18T20:37:59.180998+0000","last_became_peered":"2023-11-18T20:37:59.180998+0000","last_unstale":"2023-11-18T20:38:01.870992+0000","last_undegraded":"2023-11-18T20:38:01.870992+0000","last_fullsized":"2023-11-18T20:38:01.870992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:56:30.271654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374214+0000","last_change":"2023-11-18T20:37:59.159821+0000","last_active":"2023-11-18T20:38:01.374214+0000","last_peered":"2023-11-18T20:38:01.374214+0000","last_clean":"2023-11-18T20:38:01.374214+0000","last_became_active":"2023-11-18T20:37:59.159479+0000","last_became_peered":"2023-11-18T20:37:59.159479+0000","last_unstale":"2023-11-18T20:38:01.374214+0000","last_undegraded":"2023-11-18T20:38:01.374214+0000","last_fullsized":"2023-11-18T20:38:01.374214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866190+0000","last_change":"2023-11-18T20:37:59.181850+0000","last_active":"2023-11-18T20:38:00.866190+0000","last_peered":"2023-11-18T20:38:00.866190+0000","last_clean":"2023-11-18T20:38:00.866190+0000","last_became_active":"2023-11-18T20:37:59.181582+0000","last_became_peered":"2023-11-18T20:37:59.181582+0000","last_unstale":"2023-11-18T20:38:00.866190+0000","last_undegraded":"2023-11-18T20:38:00.866190+0000","last_fullsized":"2023-11-18T20:38:00.866190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:56:30.271654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.373610+0000","last_change":"2023-11-18T20:37:59.162681+0000","last_active":"2023-11-18T20:38:01.373610+0000","last_peered":"2023-11-18T20:38:01.373610+0000","last_clean":"2023-11-18T20:38:01.373610+0000","last_became_active":"2023-11-18T20:37:59.162312+0000","last_became_peered":"2023-11-18T20:37:59.162312+0000","last_unstale":"2023-11-18T20:38:01.373610+0000","last_undegraded":"2023-11-18T20:38:01.373610+0000","last_fullsized":"2023-11-18T20:38:01.373610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.865742+0000","last_change":"2023-11-18T20:37:59.164374+0000","last_active":"2023-11-18T20:38:00.865742+0000","last_peered":"2023-11-18T20:38:00.865742+0000","last_clean":"2023-11-18T20:38:00.865742+0000","last_became_active":"2023-11-18T20:37:59.163501+0000","last_became_peered":"2023-11-18T20:37:59.163501+0000","last_unstale":"2023-11-18T20:38:00.865742+0000","last_undegraded":"2023-11-18T20:38:00.865742+0000","last_fullsized":"2023-11-18T20:38:00.865742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:26.137811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870066+0000","last_change":"2023-11-18T20:37:59.176287+0000","last_active":"2023-11-18T20:38:01.870066+0000","last_peered":"2023-11-18T20:38:01.870066+0000","last_clean":"2023-11-18T20:38:01.870066+0000","last_became_active":"2023-11-18T20:37:59.175983+0000","last_became_peered":"2023-11-18T20:37:59.175983+0000","last_unstale":"2023-11-18T20:38:01.870066+0000","last_undegraded":"2023-11-18T20:38:01.870066+0000","last_fullsized":"2023-11-18T20:38:01.870066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:44.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870744+0000","last_change":"2023-11-18T20:37:59.167988+0000","last_active":"2023-11-18T20:38:01.870744+0000","last_peered":"2023-11-18T20:38:01.870744+0000","last_clean":"2023-11-18T20:38:01.870744+0000","last_became_active":"2023-11-18T20:37:59.167720+0000","last_became_peered":"2023-11-18T20:37:59.167720+0000","last_unstale":"2023-11-18T20:38:01.870744+0000","last_undegraded":"2023-11-18T20:38:01.870744+0000","last_fullsized":"2023-11-18T20:38:01.870744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:03.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866504+0000","last_change":"2023-11-18T20:37:59.179519+0000","last_active":"2023-11-18T20:38:00.866504+0000","last_peered":"2023-11-18T20:38:00.866504+0000","last_clean":"2023-11-18T20:38:00.866504+0000","last_became_active":"2023-11-18T20:37:59.178702+0000","last_became_peered":"2023-11-18T20:37:59.178702+0000","last_unstale":"2023-11-18T20:38:00.866504+0000","last_undegraded":"2023-11-18T20:38:00.866504+0000","last_fullsized":"2023-11-18T20:38:00.866504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:52.246806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866089+0000","last_change":"2023-11-18T20:37:59.177195+0000","last_active":"2023-11-18T20:38:00.866089+0000","last_peered":"2023-11-18T20:38:00.866089+0000","last_clean":"2023-11-18T20:38:00.866089+0000","last_became_active":"2023-11-18T20:37:59.176951+0000","last_became_peered":"2023-11-18T20:37:59.176951+0000","last_unstale":"2023-11-18T20:38:00.866089+0000","last_undegraded":"2023-11-18T20:38:00.866089+0000","last_fullsized":"2023-11-18T20:38:00.866089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:04:48.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866337+0000","last_change":"2023-11-18T20:37:59.172484+0000","last_active":"2023-11-18T20:38:00.866337+0000","last_peered":"2023-11-18T20:38:00.866337+0000","last_clean":"2023-11-18T20:38:00.866337+0000","last_became_active":"2023-11-18T20:37:59.172090+0000","last_became_peered":"2023-11-18T20:37:59.172090+0000","last_unstale":"2023-11-18T20:38:00.866337+0000","last_undegraded":"2023-11-18T20:38:00.866337+0000","last_fullsized":"2023-11-18T20:38:00.866337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:13.243273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178764+0000","last_change":"2023-11-18T20:37:59.178350+0000","last_active":"2023-11-18T20:38:00.178764+0000","last_peered":"2023-11-18T20:38:00.178764+0000","last_clean":"2023-11-18T20:38:00.178764+0000","last_became_active":"2023-11-18T20:37:59.176498+0000","last_became_peered":"2023-11-18T20:37:59.176498+0000","last_unstale":"2023-11-18T20:38:00.178764+0000","last_undegraded":"2023-11-18T20:38:00.178764+0000","last_fullsized":"2023-11-18T20:38:00.178764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:26:46.631259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178666+0000","last_change":"2023-11-18T20:37:59.162833+0000","last_active":"2023-11-18T20:38:00.178666+0000","last_peered":"2023-11-18T20:38:00.178666+0000","last_clean":"2023-11-18T20:38:00.178666+0000","last_became_active":"2023-11-18T20:37:59.162504+0000","last_became_peered":"2023-11-18T20:37:59.162504+0000","last_unstale":"2023-11-18T20:38:00.178666+0000","last_undegraded":"2023-11-18T20:38:00.178666+0000","last_fullsized":"2023-11-18T20:38:00.178666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:35.624119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870080+0000","last_change":"2023-11-18T20:37:59.176118+0000","last_active":"2023-11-18T20:38:01.870080+0000","last_peered":"2023-11-18T20:38:01.870080+0000","last_clean":"2023-11-18T20:38:01.870080+0000","last_became_active":"2023-11-18T20:37:59.175321+0000","last_became_peered":"2023-11-18T20:37:59.175321+0000","last_unstale":"2023-11-18T20:38:01.870080+0000","last_undegraded":"2023-11-18T20:38:01.870080+0000","last_fullsized":"2023-11-18T20:38:01.870080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:47.605864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177758+0000","last_change":"2023-11-18T20:37:59.177889+0000","last_active":"2023-11-18T20:38:00.177758+0000","last_peered":"2023-11-18T20:38:00.177758+0000","last_clean":"2023-11-18T20:38:00.177758+0000","last_became_active":"2023-11-18T20:37:59.176377+0000","last_became_peered":"2023-11-18T20:37:59.176377+0000","last_unstale":"2023-11-18T20:38:00.177758+0000","last_undegraded":"2023-11-18T20:38:00.177758+0000","last_fullsized":"2023-11-18T20:38:00.177758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:15.779817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178823+0000","last_change":"2023-11-18T20:37:59.183309+0000","last_active":"2023-11-18T20:38:00.178823+0000","last_peered":"2023-11-18T20:38:00.178823+0000","last_clean":"2023-11-18T20:38:00.178823+0000","last_became_active":"2023-11-18T20:37:59.182787+0000","last_became_peered":"2023-11-18T20:37:59.182787+0000","last_unstale":"2023-11-18T20:38:00.178823+0000","last_undegraded":"2023-11-18T20:38:00.178823+0000","last_fullsized":"2023-11-18T20:38:00.178823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:28.368691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.440348+0000","last_change":"2023-11-18T20:37:59.171247+0000","last_active":"2023-11-18T20:38:00.440348+0000","last_peered":"2023-11-18T20:38:00.440348+0000","last_clean":"2023-11-18T20:38:00.440348+0000","last_became_active":"2023-11-18T20:37:59.170983+0000","last_became_peered":"2023-11-18T20:37:59.170983+0000","last_unstale":"2023-11-18T20:38:00.440348+0000","last_undegraded":"2023-11-18T20:38:00.440348+0000","last_fullsized":"2023-11-18T20:38:00.440348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178586+0000","last_change":"2023-11-18T20:37:59.167413+0000","last_active":"2023-11-18T20:38:00.178586+0000","last_peered":"2023-11-18T20:38:00.178586+0000","last_clean":"2023-11-18T20:38:00.178586+0000","last_became_active":"2023-11-18T20:37:59.167085+0000","last_became_peered":"2023-11-18T20:37:59.167085+0000","last_unstale":"2023-11-18T20:38:00.178586+0000","last_undegraded":"2023-11-18T20:38:00.178586+0000","last_fullsized":"2023-11-18T20:38:00.178586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:41.166222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866787+0000","last_change":"2023-11-18T20:37:59.172328+0000","last_active":"2023-11-18T20:38:00.866787+0000","last_peered":"2023-11-18T20:38:00.866787+0000","last_clean":"2023-11-18T20:38:00.866787+0000","last_became_active":"2023-11-18T20:37:59.171693+0000","last_became_peered":"2023-11-18T20:37:59.171693+0000","last_unstale":"2023-11-18T20:38:00.866787+0000","last_undegraded":"2023-11-18T20:38:00.866787+0000","last_fullsized":"2023-11-18T20:38:00.866787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:03.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176269+0000","last_change":"2023-11-18T20:37:59.172679+0000","last_active":"2023-11-18T20:38:00.176269+0000","last_peered":"2023-11-18T20:38:00.176269+0000","last_clean":"2023-11-18T20:38:00.176269+0000","last_became_active":"2023-11-18T20:37:59.172347+0000","last_became_peered":"2023-11-18T20:37:59.172347+0000","last_unstale":"2023-11-18T20:38:00.176269+0000","last_undegraded":"2023-11-18T20:38:00.176269+0000","last_fullsized":"2023-11-18T20:38:00.176269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:51.840703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.869989+0000","last_change":"2023-11-18T20:37:59.172497+0000","last_active":"2023-11-18T20:38:01.869989+0000","last_peered":"2023-11-18T20:38:01.869989+0000","last_clean":"2023-11-18T20:38:01.869989+0000","last_became_active":"2023-11-18T20:37:59.172210+0000","last_became_peered":"2023-11-18T20:37:59.172210+0000","last_unstale":"2023-11-18T20:38:01.869989+0000","last_undegraded":"2023-11-18T20:38:01.869989+0000","last_fullsized":"2023-11-18T20:38:01.869989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870306+0000","last_change":"2023-11-18T20:37:59.175891+0000","last_active":"2023-11-18T20:38:01.870306+0000","last_peered":"2023-11-18T20:38:01.870306+0000","last_clean":"2023-11-18T20:38:01.870306+0000","last_became_active":"2023-11-18T20:37:59.174312+0000","last_became_peered":"2023-11-18T20:37:59.174312+0000","last_unstale":"2023-11-18T20:38:01.870306+0000","last_undegraded":"2023-11-18T20:38:01.870306+0000","last_fullsized":"2023-11-18T20:38:01.870306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:26:52.692005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177728+0000","last_change":"2023-11-18T20:37:59.179795+0000","last_active":"2023-11-18T20:38:00.177728+0000","last_peered":"2023-11-18T20:38:00.177728+0000","last_clean":"2023-11-18T20:38:00.177728+0000","last_became_active":"2023-11-18T20:37:59.179511+0000","last_became_peered":"2023-11-18T20:37:59.179511+0000","last_unstale":"2023-11-18T20:38:00.177728+0000","last_undegraded":"2023-11-18T20:38:00.177728+0000","last_fullsized":"2023-11-18T20:38:00.177728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:20.321237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871404+0000","last_change":"2023-11-18T20:37:59.177402+0000","last_active":"2023-11-18T20:38:01.871404+0000","last_peered":"2023-11-18T20:38:01.871404+0000","last_clean":"2023-11-18T20:38:01.871404+0000","last_became_active":"2023-11-18T20:37:59.172869+0000","last_became_peered":"2023-11-18T20:37:59.172869+0000","last_unstale":"2023-11-18T20:38:01.871404+0000","last_undegraded":"2023-11-18T20:38:01.871404+0000","last_fullsized":"2023-11-18T20:38:01.871404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:52.246806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374657+0000","last_change":"2023-11-18T20:37:59.162828+0000","last_active":"2023-11-18T20:38:01.374657+0000","last_peered":"2023-11-18T20:38:01.374657+0000","last_clean":"2023-11-18T20:38:01.374657+0000","last_became_active":"2023-11-18T20:37:59.162583+0000","last_became_peered":"2023-11-18T20:37:59.162583+0000","last_unstale":"2023-11-18T20:38:01.374657+0000","last_undegraded":"2023-11-18T20:38:01.374657+0000","last_fullsized":"2023-11-18T20:38:01.374657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179070+0000","last_change":"2023-11-18T20:37:59.169834+0000","last_active":"2023-11-18T20:38:00.179070+0000","last_peered":"2023-11-18T20:38:00.179070+0000","last_clean":"2023-11-18T20:38:00.179070+0000","last_became_active":"2023-11-18T20:37:59.169554+0000","last_became_peered":"2023-11-18T20:37:59.169554+0000","last_unstale":"2023-11-18T20:38:00.179070+0000","last_undegraded":"2023-11-18T20:38:00.179070+0000","last_fullsized":"2023-11-18T20:38:00.179070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:55:40.990469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179047+0000","last_change":"2023-11-18T20:37:59.177120+0000","last_active":"2023-11-18T20:38:00.179047+0000","last_peered":"2023-11-18T20:38:00.179047+0000","last_clean":"2023-11-18T20:38:00.179047+0000","last_became_active":"2023-11-18T20:37:59.176750+0000","last_became_peered":"2023-11-18T20:37:59.176750+0000","last_unstale":"2023-11-18T20:38:00.179047+0000","last_undegraded":"2023-11-18T20:38:00.179047+0000","last_fullsized":"2023-11-18T20:38:00.179047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:43:15.160907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870806+0000","last_change":"2023-11-18T20:37:59.180478+0000","last_active":"2023-11-18T20:38:01.870806+0000","last_peered":"2023-11-18T20:38:01.870806+0000","last_clean":"2023-11-18T20:38:01.870806+0000","last_became_active":"2023-11-18T20:37:59.178800+0000","last_became_peered":"2023-11-18T20:37:59.178800+0000","last_unstale":"2023-11-18T20:38:01.870806+0000","last_undegraded":"2023-11-18T20:38:01.870806+0000","last_fullsized":"2023-11-18T20:38:01.870806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:04:48.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177859+0000","last_change":"2023-11-18T20:37:59.171746+0000","last_active":"2023-11-18T20:38:00.177859+0000","last_peered":"2023-11-18T20:38:00.177859+0000","last_clean":"2023-11-18T20:38:00.177859+0000","last_became_active":"2023-11-18T20:37:59.171244+0000","last_became_peered":"2023-11-18T20:37:59.171244+0000","last_unstale":"2023-11-18T20:38:00.177859+0000","last_undegraded":"2023-11-18T20:38:00.177859+0000","last_fullsized":"2023-11-18T20:38:00.177859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:16:16.372839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.439791+0000","last_change":"2023-11-18T20:37:59.171816+0000","last_active":"2023-11-18T20:38:00.439791+0000","last_peered":"2023-11-18T20:38:00.439791+0000","last_clean":"2023-11-18T20:38:00.439791+0000","last_became_active":"2023-11-18T20:37:59.171323+0000","last_became_peered":"2023-11-18T20:37:59.171323+0000","last_unstale":"2023-11-18T20:38:00.439791+0000","last_undegraded":"2023-11-18T20:38:00.439791+0000","last_fullsized":"2023-11-18T20:38:00.439791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.373526+0000","last_change":"2023-11-18T20:37:59.156479+0000","last_active":"2023-11-18T20:38:01.373526+0000","last_peered":"2023-11-18T20:38:01.373526+0000","last_clean":"2023-11-18T20:38:01.373526+0000","last_became_active":"2023-11-18T20:37:59.156003+0000","last_became_peered":"2023-11-18T20:37:59.156003+0000","last_unstale":"2023-11-18T20:38:01.373526+0000","last_undegraded":"2023-11-18T20:38:01.373526+0000","last_fullsized":"2023-11-18T20:38:01.373526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870349+0000","last_change":"2023-11-18T20:37:59.182472+0000","last_active":"2023-11-18T20:38:01.870349+0000","last_peered":"2023-11-18T20:38:01.870349+0000","last_clean":"2023-11-18T20:38:01.870349+0000","last_became_active":"2023-11-18T20:37:59.182167+0000","last_became_peered":"2023-11-18T20:37:59.182167+0000","last_unstale":"2023-11-18T20:38:01.870349+0000","last_undegraded":"2023-11-18T20:38:01.870349+0000","last_fullsized":"2023-11-18T20:38:01.870349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189196+0000","last_change":"2023-11-18T20:37:58.158696+0000","last_active":"2023-11-18T20:37:59.189196+0000","last_peered":"2023-11-18T20:37:59.189196+0000","last_clean":"2023-11-18T20:37:59.189196+0000","last_became_active":"2023-11-18T20:37:58.158374+0000","last_became_peered":"2023-11-18T20:37:58.158374+0000","last_unstale":"2023-11-18T20:37:59.189196+0000","last_undegraded":"2023-11-18T20:37:59.189196+0000","last_fullsized":"2023-11-18T20:37:59.189196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:08.732817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176688+0000","last_change":"2023-11-18T20:37:59.171211+0000","last_active":"2023-11-18T20:38:00.176688+0000","last_peered":"2023-11-18T20:38:00.176688+0000","last_clean":"2023-11-18T20:38:00.176688+0000","last_became_active":"2023-11-18T20:37:59.170977+0000","last_became_peered":"2023-11-18T20:37:59.170977+0000","last_unstale":"2023-11-18T20:38:00.176688+0000","last_undegraded":"2023-11-18T20:38:00.176688+0000","last_fullsized":"2023-11-18T20:38:00.176688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:47.280214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190613+0000","last_change":"2023-11-18T20:37:58.170075+0000","last_active":"2023-11-18T20:37:59.190613+0000","last_peered":"2023-11-18T20:37:59.190613+0000","last_clean":"2023-11-18T20:37:59.190613+0000","last_became_active":"2023-11-18T20:37:58.169733+0000","last_became_peered":"2023-11-18T20:37:58.169733+0000","last_unstale":"2023-11-18T20:37:59.190613+0000","last_undegraded":"2023-11-18T20:37:59.190613+0000","last_fullsized":"2023-11-18T20:37:59.190613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:43:14.145500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.142761+0000","last_change":"2023-11-18T20:37:58.172306+0000","last_active":"2023-11-18T20:37:59.142761+0000","last_peered":"2023-11-18T20:37:59.142761+0000","last_clean":"2023-11-18T20:37:59.142761+0000","last_became_active":"2023-11-18T20:37:58.171954+0000","last_became_peered":"2023-11-18T20:37:58.171954+0000","last_unstale":"2023-11-18T20:37:59.142761+0000","last_undegraded":"2023-11-18T20:37:59.142761+0000","last_fullsized":"2023-11-18T20:37:59.142761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:30:15.515458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870314+0000","last_change":"2023-11-18T20:37:59.165306+0000","last_active":"2023-11-18T20:38:01.870314+0000","last_peered":"2023-11-18T20:38:01.870314+0000","last_clean":"2023-11-18T20:38:01.870314+0000","last_became_active":"2023-11-18T20:37:59.165035+0000","last_became_peered":"2023-11-18T20:37:59.165035+0000","last_unstale":"2023-11-18T20:38:01.870314+0000","last_undegraded":"2023-11-18T20:38:01.870314+0000","last_fullsized":"2023-11-18T20:38:01.870314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:26.137811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.149243+0000","last_change":"2023-11-18T20:37:58.164000+0000","last_active":"2023-11-18T20:37:59.149243+0000","last_peered":"2023-11-18T20:37:59.149243+0000","last_clean":"2023-11-18T20:37:59.149243+0000","last_became_active":"2023-11-18T20:37:58.163682+0000","last_became_peered":"2023-11-18T20:37:58.163682+0000","last_unstale":"2023-11-18T20:37:59.149243+0000","last_undegraded":"2023-11-18T20:37:59.149243+0000","last_fullsized":"2023-11-18T20:37:59.149243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:44.319234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176366+0000","last_change":"2023-11-18T20:37:59.168169+0000","last_active":"2023-11-18T20:38:00.176366+0000","last_peered":"2023-11-18T20:38:00.176366+0000","last_clean":"2023-11-18T20:38:00.176366+0000","last_became_active":"2023-11-18T20:37:59.167908+0000","last_became_peered":"2023-11-18T20:37:59.167908+0000","last_unstale":"2023-11-18T20:38:00.176366+0000","last_undegraded":"2023-11-18T20:38:00.176366+0000","last_fullsized":"2023-11-18T20:38:00.176366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:44.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.160095+0000","last_change":"2023-11-18T20:37:58.166557+0000","last_active":"2023-11-18T20:37:59.160095+0000","last_peered":"2023-11-18T20:37:59.160095+0000","last_clean":"2023-11-18T20:37:59.160095+0000","last_became_active":"2023-11-18T20:37:58.166295+0000","last_became_peered":"2023-11-18T20:37:58.166295+0000","last_unstale":"2023-11-18T20:37:59.160095+0000","last_undegraded":"2023-11-18T20:37:59.160095+0000","last_fullsized":"2023-11-18T20:37:59.160095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374829+0000","last_change":"2023-11-18T20:37:59.168548+0000","last_active":"2023-11-18T20:38:01.374829+0000","last_peered":"2023-11-18T20:38:01.374829+0000","last_clean":"2023-11-18T20:38:01.374829+0000","last_became_active":"2023-11-18T20:37:59.164088+0000","last_became_peered":"2023-11-18T20:37:59.164088+0000","last_unstale":"2023-11-18T20:38:01.374829+0000","last_undegraded":"2023-11-18T20:38:01.374829+0000","last_fullsized":"2023-11-18T20:38:01.374829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:04:39.108066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.161047+0000","last_change":"2023-11-18T20:37:58.157681+0000","last_active":"2023-11-18T20:37:59.161047+0000","last_peered":"2023-11-18T20:37:59.161047+0000","last_clean":"2023-11-18T20:37:59.161047+0000","last_became_active":"2023-11-18T20:37:58.157385+0000","last_became_peered":"2023-11-18T20:37:58.157385+0000","last_unstale":"2023-11-18T20:37:59.161047+0000","last_undegraded":"2023-11-18T20:37:59.161047+0000","last_fullsized":"2023-11-18T20:37:59.161047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:46.590457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871732+0000","last_change":"2023-11-18T20:37:59.173174+0000","last_active":"2023-11-18T20:38:01.871732+0000","last_peered":"2023-11-18T20:38:01.871732+0000","last_clean":"2023-11-18T20:38:01.871732+0000","last_became_active":"2023-11-18T20:37:59.172244+0000","last_became_peered":"2023-11-18T20:37:59.172244+0000","last_unstale":"2023-11-18T20:38:01.871732+0000","last_undegraded":"2023-11-18T20:38:01.871732+0000","last_fullsized":"2023-11-18T20:38:01.871732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:40.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.194185+0000","last_change":"2023-11-18T20:37:58.167812+0000","last_active":"2023-11-18T20:37:59.194185+0000","last_peered":"2023-11-18T20:37:59.194185+0000","last_clean":"2023-11-18T20:37:59.194185+0000","last_became_active":"2023-11-18T20:37:58.167312+0000","last_became_peered":"2023-11-18T20:37:58.167312+0000","last_unstale":"2023-11-18T20:37:59.194185+0000","last_undegraded":"2023-11-18T20:37:59.194185+0000","last_fullsized":"2023-11-18T20:37:59.194185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:28.447114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178044+0000","last_change":"2023-11-18T20:37:59.175489+0000","last_active":"2023-11-18T20:38:00.178044+0000","last_peered":"2023-11-18T20:38:00.178044+0000","last_clean":"2023-11-18T20:38:00.178044+0000","last_became_active":"2023-11-18T20:37:59.175234+0000","last_became_peered":"2023-11-18T20:37:59.175234+0000","last_unstale":"2023-11-18T20:38:00.178044+0000","last_undegraded":"2023-11-18T20:38:00.178044+0000","last_fullsized":"2023-11-18T20:38:00.178044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:19:55.270924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.196632+0000","last_change":"2023-11-18T20:37:58.169135+0000","last_active":"2023-11-18T20:37:59.196632+0000","last_peered":"2023-11-18T20:37:59.196632+0000","last_clean":"2023-11-18T20:37:59.196632+0000","last_became_active":"2023-11-18T20:37:58.168858+0000","last_became_peered":"2023-11-18T20:37:58.168858+0000","last_unstale":"2023-11-18T20:37:59.196632+0000","last_undegraded":"2023-11-18T20:37:59.196632+0000","last_fullsized":"2023-11-18T20:37:59.196632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:43.509370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866196+0000","last_change":"2023-11-18T20:37:59.166111+0000","last_active":"2023-11-18T20:38:00.866196+0000","last_peered":"2023-11-18T20:38:00.866196+0000","last_clean":"2023-11-18T20:38:00.866196+0000","last_became_active":"2023-11-18T20:37:59.165719+0000","last_became_peered":"2023-11-18T20:37:59.165719+0000","last_unstale":"2023-11-18T20:38:00.866196+0000","last_undegraded":"2023-11-18T20:38:00.866196+0000","last_fullsized":"2023-11-18T20:38:00.866196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:31.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.193497+0000","last_change":"2023-11-18T20:37:58.162763+0000","last_active":"2023-11-18T20:37:59.193497+0000","last_peered":"2023-11-18T20:37:59.193497+0000","last_clean":"2023-11-18T20:37:59.193497+0000","last_became_active":"2023-11-18T20:37:58.162392+0000","last_became_peered":"2023-11-18T20:37:58.162392+0000","last_unstale":"2023-11-18T20:37:59.193497+0000","last_undegraded":"2023-11-18T20:37:59.193497+0000","last_fullsized":"2023-11-18T20:37:59.193497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178818+0000","last_change":"2023-11-18T20:37:59.165551+0000","last_active":"2023-11-18T20:38:00.178818+0000","last_peered":"2023-11-18T20:38:00.178818+0000","last_clean":"2023-11-18T20:38:00.178818+0000","last_became_active":"2023-11-18T20:37:59.163366+0000","last_became_peered":"2023-11-18T20:37:59.163366+0000","last_unstale":"2023-11-18T20:38:00.178818+0000","last_undegraded":"2023-11-18T20:38:00.178818+0000","last_fullsized":"2023-11-18T20:38:00.178818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:01.609933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.151545+0000","last_change":"2023-11-18T20:37:58.170692+0000","last_active":"2023-11-18T20:37:59.151545+0000","last_peered":"2023-11-18T20:37:59.151545+0000","last_clean":"2023-11-18T20:37:59.151545+0000","last_became_active":"2023-11-18T20:37:58.170367+0000","last_became_peered":"2023-11-18T20:37:58.170367+0000","last_unstale":"2023-11-18T20:37:59.151545+0000","last_undegraded":"2023-11-18T20:37:59.151545+0000","last_fullsized":"2023-11-18T20:37:59.151545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:55:39.975062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177661+0000","last_change":"2023-11-18T20:37:59.183248+0000","last_active":"2023-11-18T20:38:00.177661+0000","last_peered":"2023-11-18T20:38:00.177661+0000","last_clean":"2023-11-18T20:38:00.177661+0000","last_became_active":"2023-11-18T20:37:59.182319+0000","last_became_peered":"2023-11-18T20:37:59.182319+0000","last_unstale":"2023-11-18T20:38:00.177661+0000","last_undegraded":"2023-11-18T20:38:00.177661+0000","last_fullsized":"2023-11-18T20:38:00.177661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:14.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.147170+0000","last_change":"2023-11-18T20:37:58.168153+0000","last_active":"2023-11-18T20:37:59.147170+0000","last_peered":"2023-11-18T20:37:59.147170+0000","last_clean":"2023-11-18T20:37:59.147170+0000","last_became_active":"2023-11-18T20:37:58.165711+0000","last_became_peered":"2023-11-18T20:37:58.165711+0000","last_unstale":"2023-11-18T20:37:59.147170+0000","last_undegraded":"2023-11-18T20:37:59.147170+0000","last_fullsized":"2023-11-18T20:37:59.147170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:52:59.215314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.869868+0000","last_change":"2023-11-18T20:37:59.180171+0000","last_active":"2023-11-18T20:38:01.869868+0000","last_peered":"2023-11-18T20:38:01.869868+0000","last_clean":"2023-11-18T20:38:01.869868+0000","last_became_active":"2023-11-18T20:37:59.179858+0000","last_became_peered":"2023-11-18T20:37:59.179858+0000","last_unstale":"2023-11-18T20:38:01.869868+0000","last_undegraded":"2023-11-18T20:38:01.869868+0000","last_fullsized":"2023-11-18T20:38:01.869868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:00.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.194143+0000","last_change":"2023-11-18T20:37:58.162399+0000","last_active":"2023-11-18T20:37:59.194143+0000","last_peered":"2023-11-18T20:37:59.194143+0000","last_clean":"2023-11-18T20:37:59.194143+0000","last_became_active":"2023-11-18T20:37:58.161728+0000","last_became_peered":"2023-11-18T20:37:58.161728+0000","last_unstale":"2023-11-18T20:37:59.194143+0000","last_undegraded":"2023-11-18T20:37:59.194143+0000","last_fullsized":"2023-11-18T20:37:59.194143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177729+0000","last_change":"2023-11-18T20:37:59.176781+0000","last_active":"2023-11-18T20:38:00.177729+0000","last_peered":"2023-11-18T20:38:00.177729+0000","last_clean":"2023-11-18T20:38:00.177729+0000","last_became_active":"2023-11-18T20:37:59.176177+0000","last_became_peered":"2023-11-18T20:37:59.176177+0000","last_unstale":"2023-11-18T20:38:00.177729+0000","last_undegraded":"2023-11-18T20:38:00.177729+0000","last_fullsized":"2023-11-18T20:38:00.177729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:40:24.771147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190289+0000","last_change":"2023-11-18T20:37:58.162267+0000","last_active":"2023-11-18T20:37:59.190289+0000","last_peered":"2023-11-18T20:37:59.190289+0000","last_clean":"2023-11-18T20:37:59.190289+0000","last_became_active":"2023-11-18T20:37:58.161948+0000","last_became_peered":"2023-11-18T20:37:58.161948+0000","last_unstale":"2023-11-18T20:37:59.190289+0000","last_undegraded":"2023-11-18T20:37:59.190289+0000","last_fullsized":"2023-11-18T20:37:59.190289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:08.418442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374826+0000","last_change":"2023-11-18T20:37:59.173619+0000","last_active":"2023-11-18T20:38:01.374826+0000","last_peered":"2023-11-18T20:38:01.374826+0000","last_clean":"2023-11-18T20:38:01.374826+0000","last_became_active":"2023-11-18T20:37:59.173303+0000","last_became_peered":"2023-11-18T20:37:59.173303+0000","last_unstale":"2023-11-18T20:38:01.374826+0000","last_undegraded":"2023-11-18T20:38:01.374826+0000","last_fullsized":"2023-11-18T20:38:01.374826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:00.673685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189711+0000","last_change":"2023-11-18T20:37:58.163432+0000","last_active":"2023-11-18T20:37:59.189711+0000","last_peered":"2023-11-18T20:37:59.189711+0000","last_clean":"2023-11-18T20:37:59.189711+0000","last_became_active":"2023-11-18T20:37:58.163136+0000","last_became_peered":"2023-11-18T20:37:58.163136+0000","last_unstale":"2023-11-18T20:37:59.189711+0000","last_undegraded":"2023-11-18T20:37:59.189711+0000","last_fullsized":"2023-11-18T20:37:59.189711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:02.758344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866722+0000","last_change":"2023-11-18T20:37:59.173529+0000","last_active":"2023-11-18T20:38:00.866722+0000","last_peered":"2023-11-18T20:38:00.866722+0000","last_clean":"2023-11-18T20:38:00.866722+0000","last_became_active":"2023-11-18T20:37:59.173236+0000","last_became_peered":"2023-11-18T20:37:59.173236+0000","last_unstale":"2023-11-18T20:38:00.866722+0000","last_undegraded":"2023-11-18T20:38:00.866722+0000","last_fullsized":"2023-11-18T20:38:00.866722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:56.471403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190765+0000","last_change":"2023-11-18T20:37:58.155736+0000","last_active":"2023-11-18T20:37:59.190765+0000","last_peered":"2023-11-18T20:37:59.190765+0000","last_clean":"2023-11-18T20:37:59.190765+0000","last_became_active":"2023-11-18T20:37:58.155358+0000","last_became_peered":"2023-11-18T20:37:58.155358+0000","last_unstale":"2023-11-18T20:37:59.190765+0000","last_undegraded":"2023-11-18T20:37:59.190765+0000","last_fullsized":"2023-11-18T20:37:59.190765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:08.418442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866947+0000","last_change":"2023-11-18T20:37:59.180009+0000","last_active":"2023-11-18T20:38:00.866947+0000","last_peered":"2023-11-18T20:38:00.866947+0000","last_clean":"2023-11-18T20:38:00.866947+0000","last_became_active":"2023-11-18T20:37:59.179749+0000","last_became_peered":"2023-11-18T20:37:59.179749+0000","last_unstale":"2023-11-18T20:38:00.866947+0000","last_undegraded":"2023-11-18T20:38:00.866947+0000","last_fullsized":"2023-11-18T20:38:00.866947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:32:26.758536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.147372+0000","last_change":"2023-11-18T20:37:58.172930+0000","last_active":"2023-11-18T20:37:59.147372+0000","last_peered":"2023-11-18T20:37:59.147372+0000","last_clean":"2023-11-18T20:37:59.147372+0000","last_became_active":"2023-11-18T20:37:58.172547+0000","last_became_peered":"2023-11-18T20:37:58.172547+0000","last_unstale":"2023-11-18T20:37:59.147372+0000","last_undegraded":"2023-11-18T20:37:59.147372+0000","last_fullsized":"2023-11-18T20:37:59.147372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:53.514145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178371+0000","last_change":"2023-11-18T20:37:59.170278+0000","last_active":"2023-11-18T20:38:00.178371+0000","last_peered":"2023-11-18T20:38:00.178371+0000","last_clean":"2023-11-18T20:38:00.178371+0000","last_became_active":"2023-11-18T20:37:59.169600+0000","last_became_peered":"2023-11-18T20:37:59.169600+0000","last_unstale":"2023-11-18T20:38:00.178371+0000","last_undegraded":"2023-11-18T20:38:00.178371+0000","last_fullsized":"2023-11-18T20:38:00.178371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:58.745666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.151129+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:37:59.151129+0000","last_peered":"2023-11-18T20:37:59.151129+0000","last_clean":"2023-11-18T20:37:59.151129+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:37:59.151129+0000","last_undegraded":"2023-11-18T20:37:59.151129+0000","last_fullsized":"2023-11-18T20:37:59.151129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.163203+0000","last_change":"2023-11-18T20:37:58.169197+0000","last_active":"2023-11-18T20:37:59.163203+0000","last_peered":"2023-11-18T20:37:59.163203+0000","last_clean":"2023-11-18T20:37:59.163203+0000","last_became_active":"2023-11-18T20:37:58.167753+0000","last_became_peered":"2023-11-18T20:37:58.167753+0000","last_unstale":"2023-11-18T20:37:59.163203+0000","last_undegraded":"2023-11-18T20:37:59.163203+0000","last_fullsized":"2023-11-18T20:37:59.163203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:53:19.905517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.175901+0000","last_change":"2023-11-18T20:37:59.161310+0000","last_active":"2023-11-18T20:38:00.175901+0000","last_peered":"2023-11-18T20:38:00.175901+0000","last_clean":"2023-11-18T20:38:00.175901+0000","last_became_active":"2023-11-18T20:37:59.160573+0000","last_became_peered":"2023-11-18T20:37:59.160573+0000","last_unstale":"2023-11-18T20:38:00.175901+0000","last_undegraded":"2023-11-18T20:38:00.175901+0000","last_fullsized":"2023-11-18T20:38:00.175901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.748224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.149589+0000","last_change":"2023-11-18T20:37:58.164074+0000","last_active":"2023-11-18T20:37:59.149589+0000","last_peered":"2023-11-18T20:37:59.149589+0000","last_clean":"2023-11-18T20:37:59.149589+0000","last_became_active":"2023-11-18T20:37:58.163736+0000","last_became_peered":"2023-11-18T20:37:58.163736+0000","last_unstale":"2023-11-18T20:37:59.149589+0000","last_undegraded":"2023-11-18T20:37:59.149589+0000","last_fullsized":"2023-11-18T20:37:59.149589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:34.608711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178613+0000","last_change":"2023-11-18T20:37:59.159340+0000","last_active":"2023-11-18T20:38:00.178613+0000","last_peered":"2023-11-18T20:38:00.178613+0000","last_clean":"2023-11-18T20:38:00.178613+0000","last_became_active":"2023-11-18T20:37:59.157840+0000","last_became_peered":"2023-11-18T20:37:59.157840+0000","last_unstale":"2023-11-18T20:38:00.178613+0000","last_undegraded":"2023-11-18T20:38:00.178613+0000","last_fullsized":"2023-11-18T20:38:00.178613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:45.334641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.154943+0000","last_change":"2023-11-18T20:37:58.162360+0000","last_active":"2023-11-18T20:37:59.154943+0000","last_peered":"2023-11-18T20:37:59.154943+0000","last_clean":"2023-11-18T20:37:59.154943+0000","last_became_active":"2023-11-18T20:37:58.161032+0000","last_became_peered":"2023-11-18T20:37:58.161032+0000","last_unstale":"2023-11-18T20:37:59.154943+0000","last_undegraded":"2023-11-18T20:37:59.154943+0000","last_fullsized":"2023-11-18T20:37:59.154943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:22.310204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870267+0000","last_change":"2023-11-18T20:37:59.184190+0000","last_active":"2023-11-18T20:38:01.870267+0000","last_peered":"2023-11-18T20:38:01.870267+0000","last_clean":"2023-11-18T20:38:01.870267+0000","last_became_active":"2023-11-18T20:37:59.183849+0000","last_became_peered":"2023-11-18T20:37:59.183849+0000","last_unstale":"2023-11-18T20:38:01.870267+0000","last_undegraded":"2023-11-18T20:38:01.870267+0000","last_fullsized":"2023-11-18T20:38:01.870267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:47.280214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.152253+0000","last_change":"2023-11-18T20:37:58.170185+0000","last_active":"2023-11-18T20:37:59.152253+0000","last_peered":"2023-11-18T20:37:59.152253+0000","last_clean":"2023-11-18T20:37:59.152253+0000","last_became_active":"2023-11-18T20:37:58.169816+0000","last_became_peered":"2023-11-18T20:37:58.169816+0000","last_unstale":"2023-11-18T20:37:59.152253+0000","last_undegraded":"2023-11-18T20:37:59.152253+0000","last_fullsized":"2023-11-18T20:37:59.152253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:08.127960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866620+0000","last_change":"2023-11-18T20:37:59.174808+0000","last_active":"2023-11-18T20:38:00.866620+0000","last_peered":"2023-11-18T20:38:00.866620+0000","last_clean":"2023-11-18T20:38:00.866620+0000","last_became_active":"2023-11-18T20:37:59.174514+0000","last_became_peered":"2023-11-18T20:37:59.174514+0000","last_unstale":"2023-11-18T20:38:00.866620+0000","last_undegraded":"2023-11-18T20:38:00.866620+0000","last_fullsized":"2023-11-18T20:38:00.866620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:38.185159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.169106+0000","last_change":"2023-11-18T20:37:58.166623+0000","last_active":"2023-11-18T20:37:59.169106+0000","last_peered":"2023-11-18T20:37:59.169106+0000","last_clean":"2023-11-18T20:37:59.169106+0000","last_became_active":"2023-11-18T20:37:58.166264+0000","last_became_peered":"2023-11-18T20:37:58.166264+0000","last_unstale":"2023-11-18T20:37:59.169106+0000","last_undegraded":"2023-11-18T20:37:59.169106+0000","last_fullsized":"2023-11-18T20:37:59.169106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:50.825296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374320+0000","last_change":"2023-11-18T20:37:59.155770+0000","last_active":"2023-11-18T20:38:01.374320+0000","last_peered":"2023-11-18T20:38:01.374320+0000","last_clean":"2023-11-18T20:38:01.374320+0000","last_became_active":"2023-11-18T20:37:59.153043+0000","last_became_peered":"2023-11-18T20:37:59.153043+0000","last_unstale":"2023-11-18T20:38:01.374320+0000","last_undegraded":"2023-11-18T20:38:01.374320+0000","last_fullsized":"2023-11-18T20:38:01.374320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:03.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.165053+0000","last_change":"2023-11-18T20:37:58.171460+0000","last_active":"2023-11-18T20:37:59.165053+0000","last_peered":"2023-11-18T20:37:59.165053+0000","last_clean":"2023-11-18T20:37:59.165053+0000","last_became_active":"2023-11-18T20:37:58.171098+0000","last_became_peered":"2023-11-18T20:37:58.171098+0000","last_unstale":"2023-11-18T20:37:59.165053+0000","last_undegraded":"2023-11-18T20:37:59.165053+0000","last_fullsized":"2023-11-18T20:37:59.165053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:03.237240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179244+0000","last_change":"2023-11-18T20:37:59.185324+0000","last_active":"2023-11-18T20:38:00.179244+0000","last_peered":"2023-11-18T20:38:00.179244+0000","last_clean":"2023-11-18T20:38:00.179244+0000","last_became_active":"2023-11-18T20:37:59.184874+0000","last_became_peered":"2023-11-18T20:37:59.184874+0000","last_unstale":"2023-11-18T20:38:00.179244+0000","last_undegraded":"2023-11-18T20:38:00.179244+0000","last_fullsized":"2023-11-18T20:38:00.179244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:09.143367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177185+0000","last_change":"2023-11-18T20:37:58.172192+0000","last_active":"2023-11-18T20:38:00.177185+0000","last_peered":"2023-11-18T20:38:00.177185+0000","last_clean":"2023-11-18T20:38:00.177185+0000","last_became_active":"2023-11-18T20:37:58.171909+0000","last_became_peered":"2023-11-18T20:37:58.171909+0000","last_unstale":"2023-11-18T20:38:00.177185+0000","last_undegraded":"2023-11-18T20:38:00.177185+0000","last_fullsized":"2023-11-18T20:38:00.177185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.052630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176507+0000","last_change":"2023-11-18T20:37:59.156794+0000","last_active":"2023-11-18T20:38:00.176507+0000","last_peered":"2023-11-18T20:38:00.176507+0000","last_clean":"2023-11-18T20:38:00.176507+0000","last_became_active":"2023-11-18T20:37:59.156240+0000","last_became_peered":"2023-11-18T20:37:59.156240+0000","last_unstale":"2023-11-18T20:38:00.176507+0000","last_undegraded":"2023-11-18T20:38:00.176507+0000","last_fullsized":"2023-11-18T20:38:00.176507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:47.605864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190149+0000","last_change":"2023-11-18T20:37:58.172619+0000","last_active":"2023-11-18T20:37:59.190149+0000","last_peered":"2023-11-18T20:37:59.190149+0000","last_clean":"2023-11-18T20:37:59.190149+0000","last_became_active":"2023-11-18T20:37:58.172348+0000","last_became_peered":"2023-11-18T20:37:58.172348+0000","last_unstale":"2023-11-18T20:37:59.190149+0000","last_undegraded":"2023-11-18T20:37:59.190149+0000","last_fullsized":"2023-11-18T20:37:59.190149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:50.652943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177039+0000","last_change":"2023-11-18T20:37:59.163153+0000","last_active":"2023-11-18T20:38:00.177039+0000","last_peered":"2023-11-18T20:38:00.177039+0000","last_clean":"2023-11-18T20:38:00.177039+0000","last_became_active":"2023-11-18T20:37:59.162808+0000","last_became_peered":"2023-11-18T20:37:59.162808+0000","last_unstale":"2023-11-18T20:38:00.177039+0000","last_undegraded":"2023-11-18T20:38:00.177039+0000","last_fullsized":"2023-11-18T20:38:00.177039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:26:52.692005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.146031+0000","last_change":"2023-11-18T20:37:58.159754+0000","last_active":"2023-11-18T20:37:59.146031+0000","last_peered":"2023-11-18T20:37:59.146031+0000","last_clean":"2023-11-18T20:37:59.146031+0000","last_became_active":"2023-11-18T20:37:58.159469+0000","last_became_peered":"2023-11-18T20:37:58.159469+0000","last_unstale":"2023-11-18T20:37:59.146031+0000","last_undegraded":"2023-11-18T20:37:59.146031+0000","last_fullsized":"2023-11-18T20:37:59.146031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177843+0000","last_change":"2023-11-18T20:37:59.167253+0000","last_active":"2023-11-18T20:38:00.177843+0000","last_peered":"2023-11-18T20:38:00.177843+0000","last_clean":"2023-11-18T20:38:00.177843+0000","last_became_active":"2023-11-18T20:37:59.166946+0000","last_became_peered":"2023-11-18T20:37:59.166946+0000","last_unstale":"2023-11-18T20:38:00.177843+0000","last_undegraded":"2023-11-18T20:38:00.177843+0000","last_fullsized":"2023-11-18T20:38:00.177843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:26:48.310102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.150750+0000","last_change":"2023-11-18T20:37:58.168664+0000","last_active":"2023-11-18T20:37:59.150750+0000","last_peered":"2023-11-18T20:37:59.150750+0000","last_clean":"2023-11-18T20:37:59.150750+0000","last_became_active":"2023-11-18T20:37:58.167672+0000","last_became_peered":"2023-11-18T20:37:58.167672+0000","last_unstale":"2023-11-18T20:37:59.150750+0000","last_undegraded":"2023-11-18T20:37:59.150750+0000","last_fullsized":"2023-11-18T20:37:59.150750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:04:38.092659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.175604+0000","last_change":"2023-11-18T20:37:59.167864+0000","last_active":"2023-11-18T20:38:00.175604+0000","last_peered":"2023-11-18T20:38:00.175604+0000","last_clean":"2023-11-18T20:38:00.175604+0000","last_became_active":"2023-11-18T20:37:59.167604+0000","last_became_peered":"2023-11-18T20:37:59.167604+0000","last_unstale":"2023-11-18T20:38:00.175604+0000","last_undegraded":"2023-11-18T20:38:00.175604+0000","last_fullsized":"2023-11-18T20:38:00.175604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:38.365782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.141993+0000","last_change":"2023-11-18T20:37:58.163771+0000","last_active":"2023-11-18T20:37:59.141993+0000","last_peered":"2023-11-18T20:37:59.141993+0000","last_clean":"2023-11-18T20:37:59.141993+0000","last_became_active":"2023-11-18T20:37:58.156832+0000","last_became_peered":"2023-11-18T20:37:58.156832+0000","last_unstale":"2023-11-18T20:37:59.141993+0000","last_undegraded":"2023-11-18T20:37:59.141993+0000","last_fullsized":"2023-11-18T20:37:59.141993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:50:00.581467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.440110+0000","last_change":"2023-11-18T20:37:59.168936+0000","last_active":"2023-11-18T20:38:00.440110+0000","last_peered":"2023-11-18T20:38:00.440110+0000","last_clean":"2023-11-18T20:38:00.440110+0000","last_became_active":"2023-11-18T20:37:59.168646+0000","last_became_peered":"2023-11-18T20:37:59.168646+0000","last_unstale":"2023-11-18T20:38:00.440110+0000","last_undegraded":"2023-11-18T20:38:00.440110+0000","last_fullsized":"2023-11-18T20:38:00.440110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190819+0000","last_change":"2023-11-18T20:37:58.167173+0000","last_active":"2023-11-18T20:37:59.190819+0000","last_peered":"2023-11-18T20:37:59.190819+0000","last_clean":"2023-11-18T20:37:59.190819+0000","last_became_active":"2023-11-18T20:37:58.166871+0000","last_became_peered":"2023-11-18T20:37:58.166871+0000","last_unstale":"2023-11-18T20:37:59.190819+0000","last_undegraded":"2023-11-18T20:37:59.190819+0000","last_fullsized":"2023-11-18T20:37:59.190819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:16:18.678055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178247+0000","last_change":"2023-11-18T20:37:59.174211+0000","last_active":"2023-11-18T20:38:00.178247+0000","last_peered":"2023-11-18T20:38:00.178247+0000","last_clean":"2023-11-18T20:38:00.178247+0000","last_became_active":"2023-11-18T20:37:59.173927+0000","last_became_peered":"2023-11-18T20:37:59.173927+0000","last_unstale":"2023-11-18T20:38:00.178247+0000","last_undegraded":"2023-11-18T20:38:00.178247+0000","last_fullsized":"2023-11-18T20:38:00.178247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:13.326666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178272+0000","last_change":"2023-11-18T20:37:59.178202+0000","last_active":"2023-11-18T20:38:00.178272+0000","last_peered":"2023-11-18T20:38:00.178272+0000","last_clean":"2023-11-18T20:38:00.178272+0000","last_became_active":"2023-11-18T20:37:59.177947+0000","last_became_peered":"2023-11-18T20:37:59.177947+0000","last_unstale":"2023-11-18T20:38:00.178272+0000","last_undegraded":"2023-11-18T20:38:00.178272+0000","last_fullsized":"2023-11-18T20:38:00.178272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:09.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.191381+0000","last_change":"2023-11-18T20:37:58.158604+0000","last_active":"2023-11-18T20:37:59.191381+0000","last_peered":"2023-11-18T20:37:59.191381+0000","last_clean":"2023-11-18T20:37:59.191381+0000","last_became_active":"2023-11-18T20:37:58.158146+0000","last_became_peered":"2023-11-18T20:37:58.158146+0000","last_unstale":"2023-11-18T20:37:59.191381+0000","last_undegraded":"2023-11-18T20:37:59.191381+0000","last_fullsized":"2023-11-18T20:37:59.191381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:46.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870315+0000","last_change":"2023-11-18T20:37:59.172487+0000","last_active":"2023-11-18T20:38:01.870315+0000","last_peered":"2023-11-18T20:38:01.870315+0000","last_clean":"2023-11-18T20:38:01.870315+0000","last_became_active":"2023-11-18T20:37:59.172038+0000","last_became_peered":"2023-11-18T20:37:59.172038+0000","last_unstale":"2023-11-18T20:38:01.870315+0000","last_undegraded":"2023-11-18T20:38:01.870315+0000","last_fullsized":"2023-11-18T20:38:01.870315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190640+0000","last_change":"2023-11-18T20:37:58.158747+0000","last_active":"2023-11-18T20:37:59.190640+0000","last_peered":"2023-11-18T20:37:59.190640+0000","last_clean":"2023-11-18T20:37:59.190640+0000","last_became_active":"2023-11-18T20:37:58.156086+0000","last_became_peered":"2023-11-18T20:37:58.156086+0000","last_unstale":"2023-11-18T20:37:59.190640+0000","last_undegraded":"2023-11-18T20:37:59.190640+0000","last_fullsized":"2023-11-18T20:37:59.190640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.052630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871489+0000","last_change":"2023-11-18T20:37:59.173339+0000","last_active":"2023-11-18T20:38:01.871489+0000","last_peered":"2023-11-18T20:38:01.871489+0000","last_clean":"2023-11-18T20:38:01.871489+0000","last_became_active":"2023-11-18T20:37:59.172593+0000","last_became_peered":"2023-11-18T20:37:59.172593+0000","last_unstale":"2023-11-18T20:38:01.871489+0000","last_undegraded":"2023-11-18T20:38:01.871489+0000","last_fullsized":"2023-11-18T20:38:01.871489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:38.185159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189386+0000","last_change":"2023-11-18T20:37:58.157777+0000","last_active":"2023-11-18T20:37:59.189386+0000","last_peered":"2023-11-18T20:37:59.189386+0000","last_clean":"2023-11-18T20:37:59.189386+0000","last_became_active":"2023-11-18T20:37:58.156090+0000","last_became_peered":"2023-11-18T20:37:58.156090+0000","last_unstale":"2023-11-18T20:37:59.189386+0000","last_undegraded":"2023-11-18T20:37:59.189386+0000","last_fullsized":"2023-11-18T20:37:59.189386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:37.350375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871355+0000","last_change":"2023-11-18T20:37:59.180531+0000","last_active":"2023-11-18T20:38:01.871355+0000","last_peered":"2023-11-18T20:38:01.871355+0000","last_clean":"2023-11-18T20:38:01.871355+0000","last_became_active":"2023-11-18T20:37:59.177897+0000","last_became_peered":"2023-11-18T20:37:59.177897+0000","last_unstale":"2023-11-18T20:38:01.871355+0000","last_undegraded":"2023-11-18T20:38:01.871355+0000","last_fullsized":"2023-11-18T20:38:01.871355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:13.243273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190088+0000","last_change":"2023-11-18T20:37:58.168566+0000","last_active":"2023-11-18T20:37:59.190088+0000","last_peered":"2023-11-18T20:37:59.190088+0000","last_clean":"2023-11-18T20:37:59.190088+0000","last_became_active":"2023-11-18T20:37:58.168250+0000","last_became_peered":"2023-11-18T20:37:58.168250+0000","last_unstale":"2023-11-18T20:37:59.190088+0000","last_undegraded":"2023-11-18T20:37:59.190088+0000","last_fullsized":"2023-11-18T20:37:59.190088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:21:59.658278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":74131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":664591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.962}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0819999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6930000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":74713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.633}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":664569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.633}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:38:14.017 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:38:14.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.264+0000 7f052b14e640 1 Processor -- start 2023-11-18T20:38:14.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.264+0000 7f052b14e640 1 -- start start 2023-11-18T20:38:14.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.266+0000 7f052b14e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f052406e000 0x7f05240c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.266+0000 7f052b14e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0524159800 con 0x7f0524155f60 2023-11-18T20:38:14.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.266+0000 7f052b14e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0524158a40 con 0x7f05240c1100 2023-11-18T20:38:14.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.266+0000 7f052b14e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052406c440 con 0x7f052406e000 2023-11-18T20:38:14.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.266+0000 7f052994b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f052406e000 0x7f05240c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:14.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.266+0000 7f052a14c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0524155f60 0x7f05240c18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48754/0 (socket says 172.21.15.132:48754) 2023-11-18T20:38:14.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.266+0000 7f052a14c640 1 -- 172.21.15.132:0/970590215 learned_addr learned my addr 172.21.15.132:0/970590215 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:14.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.267+0000 7f052994b640 1 -- 172.21.15.132:0/970590215 >> v1:172.21.15.161:6789/0 conn(0x7f05240c1100 legacy=0x7f05240c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:14.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.267+0000 7f052994b640 1 -- 172.21.15.132:0/970590215 >> v1:172.21.15.132:6789/0 conn(0x7f0524155f60 legacy=0x7f05240c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.267+0000 7f052994b640 1 -- 172.21.15.132:0/970590215 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524158d20 con 0x7f052406e000 2023-11-18T20:38:14.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.268+0000 7f052994b640 1 --2- 172.21.15.132:0/970590215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240c3940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f05140097a0 tx=0x7f051402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb639c7223fe360 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:14.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.268+0000 7f052914a640 1 -- 172.21.15.132:0/970590215 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514030610 con 0x7f052406e000 2023-11-18T20:38:14.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.268+0000 7f052914a640 1 -- 172.21.15.132:0/970590215 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514030770 con 0x7f052406e000 2023-11-18T20:38:14.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.268+0000 7f052914a640 1 -- 172.21.15.132:0/970590215 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514030b00 con 0x7f052406e000 2023-11-18T20:38:14.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.269+0000 7f052b14e640 1 -- 172.21.15.132:0/970590215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 msgr2=0x7f05240c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.269+0000 7f052b14e640 1 --2- 172.21.15.132:0/970590215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240c3940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f05140097a0 tx=0x7f051402b960 comp rx=0 tx=0).stop 2023-11-18T20:38:14.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.269+0000 7f052b14e640 1 -- 172.21.15.132:0/970590215 shutdown_connections 2023-11-18T20:38:14.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.269+0000 7f052b14e640 1 --2- 172.21.15.132:0/970590215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240c3940 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.269+0000 7f052b14e640 1 -- 172.21.15.132:0/970590215 >> 172.21.15.132:0/970590215 conn(0x7f05240a77f0 msgr2=0x7f05240a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:14.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.269+0000 7f052b14e640 1 -- 172.21.15.132:0/970590215 shutdown_connections 2023-11-18T20:38:14.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.269+0000 7f052b14e640 1 -- 172.21.15.132:0/970590215 wait complete. 2023-11-18T20:38:14.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.271+0000 7f052b14e640 1 Processor -- start 2023-11-18T20:38:14.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.271+0000 7f052b14e640 1 -- start start 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052b14e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052b14e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05240c1100 0x7f0524153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052b14e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0524155f60 0x7f0524152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052b14e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05241eeeb0 con 0x7f052406e000 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052b14e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0524150e80 con 0x7f05240c1100 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052b14e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05240a4d50 con 0x7f0524155f60 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58050/0 (socket says 172.21.15.132:58050) 2023-11-18T20:38:14.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 -- 172.21.15.132:0/3844729615 learned_addr learned my addr 172.21.15.132:0/3844729615 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 -- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0524155f60 msgr2=0x7f0524152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0524155f60 0x7f0524152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 -- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05240c1100 msgr2=0x7f0524153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05240c1100 0x7f0524153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 -- 172.21.15.132:0/3844729615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514009400 con 0x7f052406e000 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.272+0000 7f052a14c640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240a2270 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f052000c480 tx=0x7f052000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.273+0000 7f051affd640 1 -- 172.21.15.132:0/3844729615 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520005ce0 con 0x7f052406e000 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.273+0000 7f051affd640 1 -- 172.21.15.132:0/3844729615 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0520005e40 con 0x7f052406e000 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.273+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05241ef150 con 0x7f052406e000 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.273+0000 7f051affd640 1 -- 172.21.15.132:0/3844729615 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05200072f0 con 0x7f052406e000 2023-11-18T20:38:14.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.273+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05240abcd0 con 0x7f052406e000 2023-11-18T20:38:14.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.274+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052404e840 con 0x7f052406e000 2023-11-18T20:38:14.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.275+0000 7f051affd640 1 -- 172.21.15.132:0/3844729615 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0520007450 con 0x7f052406e000 2023-11-18T20:38:14.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.276+0000 7f051affd640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f050806ae70 0x7f050806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.276+0000 7f051affd640 1 -- 172.21.15.132:0/3844729615 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0520088a40 con 0x7f052406e000 2023-11-18T20:38:14.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.276+0000 7f052994b640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f050806ae70 0x7f050806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:14.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.277+0000 7f052994b640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f050806ae70 0x7f050806d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0514036000 tx=0x7f051403b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:14.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.280+0000 7f051affd640 1 -- 172.21.15.132:0/3844729615 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f052008ae60 con 0x7f052406e000 2023-11-18T20:38:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.455+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f052406c9b0 con 0x7f050806ae70 2023-11-18T20:38:14.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.475+0000 7f051affd640 1 -- 172.21.15.132:0/3844729615 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264369 (secure 0 0 0) 0x7f0514030960 con 0x7f050806ae70 2023-11-18T20:38:14.479 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:14.481 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:38:14.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.479+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f050806ae70 msgr2=0x7f050806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.479+0000 7f052b14e640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f050806ae70 0x7f050806d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0514036000 tx=0x7f051403b040 comp rx=0 tx=0).stop 2023-11-18T20:38:14.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.479+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 msgr2=0x7f05240a2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.479+0000 7f052b14e640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240a2270 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f052000c480 tx=0x7f052000c940 comp rx=0 tx=0).stop 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.480+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 shutdown_connections 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.480+0000 7f052b14e640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f050806ae70 0x7f050806d330 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.480+0000 7f052b14e640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0524155f60 0x7f0524152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.480+0000 7f052b14e640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05240c1100 0x7f0524153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.480+0000 7f052b14e640 1 --2- 172.21.15.132:0/3844729615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f052406e000 0x7f05240a2270 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.480+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 >> 172.21.15.132:0/3844729615 conn(0x7f05240a77f0 msgr2=0x7f05240a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.480+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 shutdown_connections 2023-11-18T20:38:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.480+0000 7f052b14e640 1 -- 172.21.15.132:0/3844729615 wait complete. 2023-11-18T20:38:14.499 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-18T20:38:12.634713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2957312,"data_stored":1778604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004415"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866689+0000","last_change":"2023-11-18T20:37:59.173833+0000","last_active":"2023-11-18T20:38:00.866689+0000","last_peered":"2023-11-18T20:38:00.866689+0000","last_clean":"2023-11-18T20:38:00.866689+0000","last_became_active":"2023-11-18T20:37:59.170737+0000","last_became_peered":"2023-11-18T20:37:59.170737+0000","last_unstale":"2023-11-18T20:38:00.866689+0000","last_undegraded":"2023-11-18T20:38:00.866689+0000","last_fullsized":"2023-11-18T20:38:00.866689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:40.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871317+0000","last_change":"2023-11-18T20:37:59.178504+0000","last_active":"2023-11-18T20:38:01.871317+0000","last_peered":"2023-11-18T20:38:01.871317+0000","last_clean":"2023-11-18T20:38:01.871317+0000","last_became_active":"2023-11-18T20:37:59.178247+0000","last_became_peered":"2023-11-18T20:37:59.178247+0000","last_unstale":"2023-11-18T20:38:01.871317+0000","last_undegraded":"2023-11-18T20:38:01.871317+0000","last_fullsized":"2023-11-18T20:38:01.871317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:31.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870992+0000","last_change":"2023-11-18T20:37:59.181891+0000","last_active":"2023-11-18T20:38:01.870992+0000","last_peered":"2023-11-18T20:38:01.870992+0000","last_clean":"2023-11-18T20:38:01.870992+0000","last_became_active":"2023-11-18T20:37:59.180998+0000","last_became_peered":"2023-11-18T20:37:59.180998+0000","last_unstale":"2023-11-18T20:38:01.870992+0000","last_undegraded":"2023-11-18T20:38:01.870992+0000","last_fullsized":"2023-11-18T20:38:01.870992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:56:30.271654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374214+0000","last_change":"2023-11-18T20:37:59.159821+0000","last_active":"2023-11-18T20:38:01.374214+0000","last_peered":"2023-11-18T20:38:01.374214+0000","last_clean":"2023-11-18T20:38:01.374214+0000","last_became_active":"2023-11-18T20:37:59.159479+0000","last_became_peered":"2023-11-18T20:37:59.159479+0000","last_unstale":"2023-11-18T20:38:01.374214+0000","last_undegraded":"2023-11-18T20:38:01.374214+0000","last_fullsized":"2023-11-18T20:38:01.374214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866190+0000","last_change":"2023-11-18T20:37:59.181850+0000","last_active":"2023-11-18T20:38:00.866190+0000","last_peered":"2023-11-18T20:38:00.866190+0000","last_clean":"2023-11-18T20:38:00.866190+0000","last_became_active":"2023-11-18T20:37:59.181582+0000","last_became_peered":"2023-11-18T20:37:59.181582+0000","last_unstale":"2023-11-18T20:38:00.866190+0000","last_undegraded":"2023-11-18T20:38:00.866190+0000","last_fullsized":"2023-11-18T20:38:00.866190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:56:30.271654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.373610+0000","last_change":"2023-11-18T20:37:59.162681+0000","last_active":"2023-11-18T20:38:01.373610+0000","last_peered":"2023-11-18T20:38:01.373610+0000","last_clean":"2023-11-18T20:38:01.373610+0000","last_became_active":"2023-11-18T20:37:59.162312+0000","last_became_peered":"2023-11-18T20:37:59.162312+0000","last_unstale":"2023-11-18T20:38:01.373610+0000","last_undegraded":"2023-11-18T20:38:01.373610+0000","last_fullsized":"2023-11-18T20:38:01.373610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.865742+0000","last_change":"2023-11-18T20:37:59.164374+0000","last_active":"2023-11-18T20:38:00.865742+0000","last_peered":"2023-11-18T20:38:00.865742+0000","last_clean":"2023-11-18T20:38:00.865742+0000","last_became_active":"2023-11-18T20:37:59.163501+0000","last_became_peered":"2023-11-18T20:37:59.163501+0000","last_unstale":"2023-11-18T20:38:00.865742+0000","last_undegraded":"2023-11-18T20:38:00.865742+0000","last_fullsized":"2023-11-18T20:38:00.865742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:26.137811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870066+0000","last_change":"2023-11-18T20:37:59.176287+0000","last_active":"2023-11-18T20:38:01.870066+0000","last_peered":"2023-11-18T20:38:01.870066+0000","last_clean":"2023-11-18T20:38:01.870066+0000","last_became_active":"2023-11-18T20:37:59.175983+0000","last_became_peered":"2023-11-18T20:37:59.175983+0000","last_unstale":"2023-11-18T20:38:01.870066+0000","last_undegraded":"2023-11-18T20:38:01.870066+0000","last_fullsized":"2023-11-18T20:38:01.870066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:44.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870744+0000","last_change":"2023-11-18T20:37:59.167988+0000","last_active":"2023-11-18T20:38:01.870744+0000","last_peered":"2023-11-18T20:38:01.870744+0000","last_clean":"2023-11-18T20:38:01.870744+0000","last_became_active":"2023-11-18T20:37:59.167720+0000","last_became_peered":"2023-11-18T20:37:59.167720+0000","last_unstale":"2023-11-18T20:38:01.870744+0000","last_undegraded":"2023-11-18T20:38:01.870744+0000","last_fullsized":"2023-11-18T20:38:01.870744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:03.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866504+0000","last_change":"2023-11-18T20:37:59.179519+0000","last_active":"2023-11-18T20:38:00.866504+0000","last_peered":"2023-11-18T20:38:00.866504+0000","last_clean":"2023-11-18T20:38:00.866504+0000","last_became_active":"2023-11-18T20:37:59.178702+0000","last_became_peered":"2023-11-18T20:37:59.178702+0000","last_unstale":"2023-11-18T20:38:00.866504+0000","last_undegraded":"2023-11-18T20:38:00.866504+0000","last_fullsized":"2023-11-18T20:38:00.866504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:52.246806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866089+0000","last_change":"2023-11-18T20:37:59.177195+0000","last_active":"2023-11-18T20:38:00.866089+0000","last_peered":"2023-11-18T20:38:00.866089+0000","last_clean":"2023-11-18T20:38:00.866089+0000","last_became_active":"2023-11-18T20:37:59.176951+0000","last_became_peered":"2023-11-18T20:37:59.176951+0000","last_unstale":"2023-11-18T20:38:00.866089+0000","last_undegraded":"2023-11-18T20:38:00.866089+0000","last_fullsized":"2023-11-18T20:38:00.866089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:04:48.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866337+0000","last_change":"2023-11-18T20:37:59.172484+0000","last_active":"2023-11-18T20:38:00.866337+0000","last_peered":"2023-11-18T20:38:00.866337+0000","last_clean":"2023-11-18T20:38:00.866337+0000","last_became_active":"2023-11-18T20:37:59.172090+0000","last_became_peered":"2023-11-18T20:37:59.172090+0000","last_unstale":"2023-11-18T20:38:00.866337+0000","last_undegraded":"2023-11-18T20:38:00.866337+0000","last_fullsized":"2023-11-18T20:38:00.866337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:13.243273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178764+0000","last_change":"2023-11-18T20:37:59.178350+0000","last_active":"2023-11-18T20:38:00.178764+0000","last_peered":"2023-11-18T20:38:00.178764+0000","last_clean":"2023-11-18T20:38:00.178764+0000","last_became_active":"2023-11-18T20:37:59.176498+0000","last_became_peered":"2023-11-18T20:37:59.176498+0000","last_unstale":"2023-11-18T20:38:00.178764+0000","last_undegraded":"2023-11-18T20:38:00.178764+0000","last_fullsized":"2023-11-18T20:38:00.178764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:26:46.631259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178666+0000","last_change":"2023-11-18T20:37:59.162833+0000","last_active":"2023-11-18T20:38:00.178666+0000","last_peered":"2023-11-18T20:38:00.178666+0000","last_clean":"2023-11-18T20:38:00.178666+0000","last_became_active":"2023-11-18T20:37:59.162504+0000","last_became_peered":"2023-11-18T20:37:59.162504+0000","last_unstale":"2023-11-18T20:38:00.178666+0000","last_undegraded":"2023-11-18T20:38:00.178666+0000","last_fullsized":"2023-11-18T20:38:00.178666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:35.624119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870080+0000","last_change":"2023-11-18T20:37:59.176118+0000","last_active":"2023-11-18T20:38:01.870080+0000","last_peered":"2023-11-18T20:38:01.870080+0000","last_clean":"2023-11-18T20:38:01.870080+0000","last_became_active":"2023-11-18T20:37:59.175321+0000","last_became_peered":"2023-11-18T20:37:59.175321+0000","last_unstale":"2023-11-18T20:38:01.870080+0000","last_undegraded":"2023-11-18T20:38:01.870080+0000","last_fullsized":"2023-11-18T20:38:01.870080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:47.605864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177758+0000","last_change":"2023-11-18T20:37:59.177889+0000","last_active":"2023-11-18T20:38:00.177758+0000","last_peered":"2023-11-18T20:38:00.177758+0000","last_clean":"2023-11-18T20:38:00.177758+0000","last_became_active":"2023-11-18T20:37:59.176377+0000","last_became_peered":"2023-11-18T20:37:59.176377+0000","last_unstale":"2023-11-18T20:38:00.177758+0000","last_undegraded":"2023-11-18T20:38:00.177758+0000","last_fullsized":"2023-11-18T20:38:00.177758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:15.779817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178823+0000","last_change":"2023-11-18T20:37:59.183309+0000","last_active":"2023-11-18T20:38:00.178823+0000","last_peered":"2023-11-18T20:38:00.178823+0000","last_clean":"2023-11-18T20:38:00.178823+0000","last_became_active":"2023-11-18T20:37:59.182787+0000","last_became_peered":"2023-11-18T20:37:59.182787+0000","last_unstale":"2023-11-18T20:38:00.178823+0000","last_undegraded":"2023-11-18T20:38:00.178823+0000","last_fullsized":"2023-11-18T20:38:00.178823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:28.368691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.440348+0000","last_change":"2023-11-18T20:37:59.171247+0000","last_active":"2023-11-18T20:38:00.440348+0000","last_peered":"2023-11-18T20:38:00.440348+0000","last_clean":"2023-11-18T20:38:00.440348+0000","last_became_active":"2023-11-18T20:37:59.170983+0000","last_became_peered":"2023-11-18T20:37:59.170983+0000","last_unstale":"2023-11-18T20:38:00.440348+0000","last_undegraded":"2023-11-18T20:38:00.440348+0000","last_fullsized":"2023-11-18T20:38:00.440348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178586+0000","last_change":"2023-11-18T20:37:59.167413+0000","last_active":"2023-11-18T20:38:00.178586+0000","last_peered":"2023-11-18T20:38:00.178586+0000","last_clean":"2023-11-18T20:38:00.178586+0000","last_became_active":"2023-11-18T20:37:59.167085+0000","last_became_peered":"2023-11-18T20:37:59.167085+0000","last_unstale":"2023-11-18T20:38:00.178586+0000","last_undegraded":"2023-11-18T20:38:00.178586+0000","last_fullsized":"2023-11-18T20:38:00.178586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:41.166222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866787+0000","last_change":"2023-11-18T20:37:59.172328+0000","last_active":"2023-11-18T20:38:00.866787+0000","last_peered":"2023-11-18T20:38:00.866787+0000","last_clean":"2023-11-18T20:38:00.866787+0000","last_became_active":"2023-11-18T20:37:59.171693+0000","last_became_peered":"2023-11-18T20:37:59.171693+0000","last_unstale":"2023-11-18T20:38:00.866787+0000","last_undegraded":"2023-11-18T20:38:00.866787+0000","last_fullsized":"2023-11-18T20:38:00.866787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:03.388618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176269+0000","last_change":"2023-11-18T20:37:59.172679+0000","last_active":"2023-11-18T20:38:00.176269+0000","last_peered":"2023-11-18T20:38:00.176269+0000","last_clean":"2023-11-18T20:38:00.176269+0000","last_became_active":"2023-11-18T20:37:59.172347+0000","last_became_peered":"2023-11-18T20:37:59.172347+0000","last_unstale":"2023-11-18T20:38:00.176269+0000","last_undegraded":"2023-11-18T20:38:00.176269+0000","last_fullsized":"2023-11-18T20:38:00.176269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:51.840703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.869989+0000","last_change":"2023-11-18T20:37:59.172497+0000","last_active":"2023-11-18T20:38:01.869989+0000","last_peered":"2023-11-18T20:38:01.869989+0000","last_clean":"2023-11-18T20:38:01.869989+0000","last_became_active":"2023-11-18T20:37:59.172210+0000","last_became_peered":"2023-11-18T20:37:59.172210+0000","last_unstale":"2023-11-18T20:38:01.869989+0000","last_undegraded":"2023-11-18T20:38:01.869989+0000","last_fullsized":"2023-11-18T20:38:01.869989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870306+0000","last_change":"2023-11-18T20:37:59.175891+0000","last_active":"2023-11-18T20:38:01.870306+0000","last_peered":"2023-11-18T20:38:01.870306+0000","last_clean":"2023-11-18T20:38:01.870306+0000","last_became_active":"2023-11-18T20:37:59.174312+0000","last_became_peered":"2023-11-18T20:37:59.174312+0000","last_unstale":"2023-11-18T20:38:01.870306+0000","last_undegraded":"2023-11-18T20:38:01.870306+0000","last_fullsized":"2023-11-18T20:38:01.870306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:26:52.692005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177728+0000","last_change":"2023-11-18T20:37:59.179795+0000","last_active":"2023-11-18T20:38:00.177728+0000","last_peered":"2023-11-18T20:38:00.177728+0000","last_clean":"2023-11-18T20:38:00.177728+0000","last_became_active":"2023-11-18T20:37:59.179511+0000","last_became_peered":"2023-11-18T20:37:59.179511+0000","last_unstale":"2023-11-18T20:38:00.177728+0000","last_undegraded":"2023-11-18T20:38:00.177728+0000","last_fullsized":"2023-11-18T20:38:00.177728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:20.321237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871404+0000","last_change":"2023-11-18T20:37:59.177402+0000","last_active":"2023-11-18T20:38:01.871404+0000","last_peered":"2023-11-18T20:38:01.871404+0000","last_clean":"2023-11-18T20:38:01.871404+0000","last_became_active":"2023-11-18T20:37:59.172869+0000","last_became_peered":"2023-11-18T20:37:59.172869+0000","last_unstale":"2023-11-18T20:38:01.871404+0000","last_undegraded":"2023-11-18T20:38:01.871404+0000","last_fullsized":"2023-11-18T20:38:01.871404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:52.246806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374657+0000","last_change":"2023-11-18T20:37:59.162828+0000","last_active":"2023-11-18T20:38:01.374657+0000","last_peered":"2023-11-18T20:38:01.374657+0000","last_clean":"2023-11-18T20:38:01.374657+0000","last_became_active":"2023-11-18T20:37:59.162583+0000","last_became_peered":"2023-11-18T20:37:59.162583+0000","last_unstale":"2023-11-18T20:38:01.374657+0000","last_undegraded":"2023-11-18T20:38:01.374657+0000","last_fullsized":"2023-11-18T20:38:01.374657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179070+0000","last_change":"2023-11-18T20:37:59.169834+0000","last_active":"2023-11-18T20:38:00.179070+0000","last_peered":"2023-11-18T20:38:00.179070+0000","last_clean":"2023-11-18T20:38:00.179070+0000","last_became_active":"2023-11-18T20:37:59.169554+0000","last_became_peered":"2023-11-18T20:37:59.169554+0000","last_unstale":"2023-11-18T20:38:00.179070+0000","last_undegraded":"2023-11-18T20:38:00.179070+0000","last_fullsized":"2023-11-18T20:38:00.179070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:55:40.990469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179047+0000","last_change":"2023-11-18T20:37:59.177120+0000","last_active":"2023-11-18T20:38:00.179047+0000","last_peered":"2023-11-18T20:38:00.179047+0000","last_clean":"2023-11-18T20:38:00.179047+0000","last_became_active":"2023-11-18T20:37:59.176750+0000","last_became_peered":"2023-11-18T20:37:59.176750+0000","last_unstale":"2023-11-18T20:38:00.179047+0000","last_undegraded":"2023-11-18T20:38:00.179047+0000","last_fullsized":"2023-11-18T20:38:00.179047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:43:15.160907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870806+0000","last_change":"2023-11-18T20:37:59.180478+0000","last_active":"2023-11-18T20:38:01.870806+0000","last_peered":"2023-11-18T20:38:01.870806+0000","last_clean":"2023-11-18T20:38:01.870806+0000","last_became_active":"2023-11-18T20:37:59.178800+0000","last_became_peered":"2023-11-18T20:37:59.178800+0000","last_unstale":"2023-11-18T20:38:01.870806+0000","last_undegraded":"2023-11-18T20:38:01.870806+0000","last_fullsized":"2023-11-18T20:38:01.870806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:04:48.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177859+0000","last_change":"2023-11-18T20:37:59.171746+0000","last_active":"2023-11-18T20:38:00.177859+0000","last_peered":"2023-11-18T20:38:00.177859+0000","last_clean":"2023-11-18T20:38:00.177859+0000","last_became_active":"2023-11-18T20:37:59.171244+0000","last_became_peered":"2023-11-18T20:37:59.171244+0000","last_unstale":"2023-11-18T20:38:00.177859+0000","last_undegraded":"2023-11-18T20:38:00.177859+0000","last_fullsized":"2023-11-18T20:38:00.177859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:16:16.372839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.439791+0000","last_change":"2023-11-18T20:37:59.171816+0000","last_active":"2023-11-18T20:38:00.439791+0000","last_peered":"2023-11-18T20:38:00.439791+0000","last_clean":"2023-11-18T20:38:00.439791+0000","last_became_active":"2023-11-18T20:37:59.171323+0000","last_became_peered":"2023-11-18T20:37:59.171323+0000","last_unstale":"2023-11-18T20:38:00.439791+0000","last_undegraded":"2023-11-18T20:38:00.439791+0000","last_fullsized":"2023-11-18T20:38:00.439791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.373526+0000","last_change":"2023-11-18T20:37:59.156479+0000","last_active":"2023-11-18T20:38:01.373526+0000","last_peered":"2023-11-18T20:38:01.373526+0000","last_clean":"2023-11-18T20:38:01.373526+0000","last_became_active":"2023-11-18T20:37:59.156003+0000","last_became_peered":"2023-11-18T20:37:59.156003+0000","last_unstale":"2023-11-18T20:38:01.373526+0000","last_undegraded":"2023-11-18T20:38:01.373526+0000","last_fullsized":"2023-11-18T20:38:01.373526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:57.889312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870349+0000","last_change":"2023-11-18T20:37:59.182472+0000","last_active":"2023-11-18T20:38:01.870349+0000","last_peered":"2023-11-18T20:38:01.870349+0000","last_clean":"2023-11-18T20:38:01.870349+0000","last_became_active":"2023-11-18T20:37:59.182167+0000","last_became_peered":"2023-11-18T20:37:59.182167+0000","last_unstale":"2023-11-18T20:38:01.870349+0000","last_undegraded":"2023-11-18T20:38:01.870349+0000","last_fullsized":"2023-11-18T20:38:01.870349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:36.300415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189196+0000","last_change":"2023-11-18T20:37:58.158696+0000","last_active":"2023-11-18T20:37:59.189196+0000","last_peered":"2023-11-18T20:37:59.189196+0000","last_clean":"2023-11-18T20:37:59.189196+0000","last_became_active":"2023-11-18T20:37:58.158374+0000","last_became_peered":"2023-11-18T20:37:58.158374+0000","last_unstale":"2023-11-18T20:37:59.189196+0000","last_undegraded":"2023-11-18T20:37:59.189196+0000","last_fullsized":"2023-11-18T20:37:59.189196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:08.732817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176688+0000","last_change":"2023-11-18T20:37:59.171211+0000","last_active":"2023-11-18T20:38:00.176688+0000","last_peered":"2023-11-18T20:38:00.176688+0000","last_clean":"2023-11-18T20:38:00.176688+0000","last_became_active":"2023-11-18T20:37:59.170977+0000","last_became_peered":"2023-11-18T20:37:59.170977+0000","last_unstale":"2023-11-18T20:38:00.176688+0000","last_undegraded":"2023-11-18T20:38:00.176688+0000","last_fullsized":"2023-11-18T20:38:00.176688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:47.280214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190613+0000","last_change":"2023-11-18T20:37:58.170075+0000","last_active":"2023-11-18T20:37:59.190613+0000","last_peered":"2023-11-18T20:37:59.190613+0000","last_clean":"2023-11-18T20:37:59.190613+0000","last_became_active":"2023-11-18T20:37:58.169733+0000","last_became_peered":"2023-11-18T20:37:58.169733+0000","last_unstale":"2023-11-18T20:37:59.190613+0000","last_undegraded":"2023-11-18T20:37:59.190613+0000","last_fullsized":"2023-11-18T20:37:59.190613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:43:14.145500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.142761+0000","last_change":"2023-11-18T20:37:58.172306+0000","last_active":"2023-11-18T20:37:59.142761+0000","last_peered":"2023-11-18T20:37:59.142761+0000","last_clean":"2023-11-18T20:37:59.142761+0000","last_became_active":"2023-11-18T20:37:58.171954+0000","last_became_peered":"2023-11-18T20:37:58.171954+0000","last_unstale":"2023-11-18T20:37:59.142761+0000","last_undegraded":"2023-11-18T20:37:59.142761+0000","last_fullsized":"2023-11-18T20:37:59.142761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:30:15.515458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870314+0000","last_change":"2023-11-18T20:37:59.165306+0000","last_active":"2023-11-18T20:38:01.870314+0000","last_peered":"2023-11-18T20:38:01.870314+0000","last_clean":"2023-11-18T20:38:01.870314+0000","last_became_active":"2023-11-18T20:37:59.165035+0000","last_became_peered":"2023-11-18T20:37:59.165035+0000","last_unstale":"2023-11-18T20:38:01.870314+0000","last_undegraded":"2023-11-18T20:38:01.870314+0000","last_fullsized":"2023-11-18T20:38:01.870314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:26.137811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.149243+0000","last_change":"2023-11-18T20:37:58.164000+0000","last_active":"2023-11-18T20:37:59.149243+0000","last_peered":"2023-11-18T20:37:59.149243+0000","last_clean":"2023-11-18T20:37:59.149243+0000","last_became_active":"2023-11-18T20:37:58.163682+0000","last_became_peered":"2023-11-18T20:37:58.163682+0000","last_unstale":"2023-11-18T20:37:59.149243+0000","last_undegraded":"2023-11-18T20:37:59.149243+0000","last_fullsized":"2023-11-18T20:37:59.149243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:44.319234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176366+0000","last_change":"2023-11-18T20:37:59.168169+0000","last_active":"2023-11-18T20:38:00.176366+0000","last_peered":"2023-11-18T20:38:00.176366+0000","last_clean":"2023-11-18T20:38:00.176366+0000","last_became_active":"2023-11-18T20:37:59.167908+0000","last_became_peered":"2023-11-18T20:37:59.167908+0000","last_unstale":"2023-11-18T20:38:00.176366+0000","last_undegraded":"2023-11-18T20:38:00.176366+0000","last_fullsized":"2023-11-18T20:38:00.176366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:44.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.160095+0000","last_change":"2023-11-18T20:37:58.166557+0000","last_active":"2023-11-18T20:37:59.160095+0000","last_peered":"2023-11-18T20:37:59.160095+0000","last_clean":"2023-11-18T20:37:59.160095+0000","last_became_active":"2023-11-18T20:37:58.166295+0000","last_became_peered":"2023-11-18T20:37:58.166295+0000","last_unstale":"2023-11-18T20:37:59.160095+0000","last_undegraded":"2023-11-18T20:37:59.160095+0000","last_fullsized":"2023-11-18T20:37:59.160095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374829+0000","last_change":"2023-11-18T20:37:59.168548+0000","last_active":"2023-11-18T20:38:01.374829+0000","last_peered":"2023-11-18T20:38:01.374829+0000","last_clean":"2023-11-18T20:38:01.374829+0000","last_became_active":"2023-11-18T20:37:59.164088+0000","last_became_peered":"2023-11-18T20:37:59.164088+0000","last_unstale":"2023-11-18T20:38:01.374829+0000","last_undegraded":"2023-11-18T20:38:01.374829+0000","last_fullsized":"2023-11-18T20:38:01.374829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:04:39.108066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.161047+0000","last_change":"2023-11-18T20:37:58.157681+0000","last_active":"2023-11-18T20:37:59.161047+0000","last_peered":"2023-11-18T20:37:59.161047+0000","last_clean":"2023-11-18T20:37:59.161047+0000","last_became_active":"2023-11-18T20:37:58.157385+0000","last_became_peered":"2023-11-18T20:37:58.157385+0000","last_unstale":"2023-11-18T20:37:59.161047+0000","last_undegraded":"2023-11-18T20:37:59.161047+0000","last_fullsized":"2023-11-18T20:37:59.161047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:46.590457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871732+0000","last_change":"2023-11-18T20:37:59.173174+0000","last_active":"2023-11-18T20:38:01.871732+0000","last_peered":"2023-11-18T20:38:01.871732+0000","last_clean":"2023-11-18T20:38:01.871732+0000","last_became_active":"2023-11-18T20:37:59.172244+0000","last_became_peered":"2023-11-18T20:37:59.172244+0000","last_unstale":"2023-11-18T20:38:01.871732+0000","last_undegraded":"2023-11-18T20:38:01.871732+0000","last_fullsized":"2023-11-18T20:38:01.871732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:40.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.194185+0000","last_change":"2023-11-18T20:37:58.167812+0000","last_active":"2023-11-18T20:37:59.194185+0000","last_peered":"2023-11-18T20:37:59.194185+0000","last_clean":"2023-11-18T20:37:59.194185+0000","last_became_active":"2023-11-18T20:37:58.167312+0000","last_became_peered":"2023-11-18T20:37:58.167312+0000","last_unstale":"2023-11-18T20:37:59.194185+0000","last_undegraded":"2023-11-18T20:37:59.194185+0000","last_fullsized":"2023-11-18T20:37:59.194185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:28.447114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178044+0000","last_change":"2023-11-18T20:37:59.175489+0000","last_active":"2023-11-18T20:38:00.178044+0000","last_peered":"2023-11-18T20:38:00.178044+0000","last_clean":"2023-11-18T20:38:00.178044+0000","last_became_active":"2023-11-18T20:37:59.175234+0000","last_became_peered":"2023-11-18T20:37:59.175234+0000","last_unstale":"2023-11-18T20:38:00.178044+0000","last_undegraded":"2023-11-18T20:38:00.178044+0000","last_fullsized":"2023-11-18T20:38:00.178044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:19:55.270924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.196632+0000","last_change":"2023-11-18T20:37:58.169135+0000","last_active":"2023-11-18T20:37:59.196632+0000","last_peered":"2023-11-18T20:37:59.196632+0000","last_clean":"2023-11-18T20:37:59.196632+0000","last_became_active":"2023-11-18T20:37:58.168858+0000","last_became_peered":"2023-11-18T20:37:58.168858+0000","last_unstale":"2023-11-18T20:37:59.196632+0000","last_undegraded":"2023-11-18T20:37:59.196632+0000","last_fullsized":"2023-11-18T20:37:59.196632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:43.509370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866196+0000","last_change":"2023-11-18T20:37:59.166111+0000","last_active":"2023-11-18T20:38:00.866196+0000","last_peered":"2023-11-18T20:38:00.866196+0000","last_clean":"2023-11-18T20:38:00.866196+0000","last_became_active":"2023-11-18T20:37:59.165719+0000","last_became_peered":"2023-11-18T20:37:59.165719+0000","last_unstale":"2023-11-18T20:38:00.866196+0000","last_undegraded":"2023-11-18T20:38:00.866196+0000","last_fullsized":"2023-11-18T20:38:00.866196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:31.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.193497+0000","last_change":"2023-11-18T20:37:58.162763+0000","last_active":"2023-11-18T20:37:59.193497+0000","last_peered":"2023-11-18T20:37:59.193497+0000","last_clean":"2023-11-18T20:37:59.193497+0000","last_became_active":"2023-11-18T20:37:58.162392+0000","last_became_peered":"2023-11-18T20:37:58.162392+0000","last_unstale":"2023-11-18T20:37:59.193497+0000","last_undegraded":"2023-11-18T20:37:59.193497+0000","last_fullsized":"2023-11-18T20:37:59.193497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178818+0000","last_change":"2023-11-18T20:37:59.165551+0000","last_active":"2023-11-18T20:38:00.178818+0000","last_peered":"2023-11-18T20:38:00.178818+0000","last_clean":"2023-11-18T20:38:00.178818+0000","last_became_active":"2023-11-18T20:37:59.163366+0000","last_became_peered":"2023-11-18T20:37:59.163366+0000","last_unstale":"2023-11-18T20:38:00.178818+0000","last_undegraded":"2023-11-18T20:38:00.178818+0000","last_fullsized":"2023-11-18T20:38:00.178818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:01.609933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.151545+0000","last_change":"2023-11-18T20:37:58.170692+0000","last_active":"2023-11-18T20:37:59.151545+0000","last_peered":"2023-11-18T20:37:59.151545+0000","last_clean":"2023-11-18T20:37:59.151545+0000","last_became_active":"2023-11-18T20:37:58.170367+0000","last_became_peered":"2023-11-18T20:37:58.170367+0000","last_unstale":"2023-11-18T20:37:59.151545+0000","last_undegraded":"2023-11-18T20:37:59.151545+0000","last_fullsized":"2023-11-18T20:37:59.151545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:55:39.975062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177661+0000","last_change":"2023-11-18T20:37:59.183248+0000","last_active":"2023-11-18T20:38:00.177661+0000","last_peered":"2023-11-18T20:38:00.177661+0000","last_clean":"2023-11-18T20:38:00.177661+0000","last_became_active":"2023-11-18T20:37:59.182319+0000","last_became_peered":"2023-11-18T20:37:59.182319+0000","last_unstale":"2023-11-18T20:38:00.177661+0000","last_undegraded":"2023-11-18T20:38:00.177661+0000","last_fullsized":"2023-11-18T20:38:00.177661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:14.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.147170+0000","last_change":"2023-11-18T20:37:58.168153+0000","last_active":"2023-11-18T20:37:59.147170+0000","last_peered":"2023-11-18T20:37:59.147170+0000","last_clean":"2023-11-18T20:37:59.147170+0000","last_became_active":"2023-11-18T20:37:58.165711+0000","last_became_peered":"2023-11-18T20:37:58.165711+0000","last_unstale":"2023-11-18T20:37:59.147170+0000","last_undegraded":"2023-11-18T20:37:59.147170+0000","last_fullsized":"2023-11-18T20:37:59.147170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:52:59.215314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.869868+0000","last_change":"2023-11-18T20:37:59.180171+0000","last_active":"2023-11-18T20:38:01.869868+0000","last_peered":"2023-11-18T20:38:01.869868+0000","last_clean":"2023-11-18T20:38:01.869868+0000","last_became_active":"2023-11-18T20:37:59.179858+0000","last_became_peered":"2023-11-18T20:37:59.179858+0000","last_unstale":"2023-11-18T20:38:01.869868+0000","last_undegraded":"2023-11-18T20:38:01.869868+0000","last_fullsized":"2023-11-18T20:38:01.869868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:00.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.194143+0000","last_change":"2023-11-18T20:37:58.162399+0000","last_active":"2023-11-18T20:37:59.194143+0000","last_peered":"2023-11-18T20:37:59.194143+0000","last_clean":"2023-11-18T20:37:59.194143+0000","last_became_active":"2023-11-18T20:37:58.161728+0000","last_became_peered":"2023-11-18T20:37:58.161728+0000","last_unstale":"2023-11-18T20:37:59.194143+0000","last_undegraded":"2023-11-18T20:37:59.194143+0000","last_fullsized":"2023-11-18T20:37:59.194143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177729+0000","last_change":"2023-11-18T20:37:59.176781+0000","last_active":"2023-11-18T20:38:00.177729+0000","last_peered":"2023-11-18T20:38:00.177729+0000","last_clean":"2023-11-18T20:38:00.177729+0000","last_became_active":"2023-11-18T20:37:59.176177+0000","last_became_peered":"2023-11-18T20:37:59.176177+0000","last_unstale":"2023-11-18T20:38:00.177729+0000","last_undegraded":"2023-11-18T20:38:00.177729+0000","last_fullsized":"2023-11-18T20:38:00.177729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:40:24.771147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190289+0000","last_change":"2023-11-18T20:37:58.162267+0000","last_active":"2023-11-18T20:37:59.190289+0000","last_peered":"2023-11-18T20:37:59.190289+0000","last_clean":"2023-11-18T20:37:59.190289+0000","last_became_active":"2023-11-18T20:37:58.161948+0000","last_became_peered":"2023-11-18T20:37:58.161948+0000","last_unstale":"2023-11-18T20:37:59.190289+0000","last_undegraded":"2023-11-18T20:37:59.190289+0000","last_fullsized":"2023-11-18T20:37:59.190289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:08.418442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374826+0000","last_change":"2023-11-18T20:37:59.173619+0000","last_active":"2023-11-18T20:38:01.374826+0000","last_peered":"2023-11-18T20:38:01.374826+0000","last_clean":"2023-11-18T20:38:01.374826+0000","last_became_active":"2023-11-18T20:37:59.173303+0000","last_became_peered":"2023-11-18T20:37:59.173303+0000","last_unstale":"2023-11-18T20:38:01.374826+0000","last_undegraded":"2023-11-18T20:38:01.374826+0000","last_fullsized":"2023-11-18T20:38:01.374826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:00.673685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189711+0000","last_change":"2023-11-18T20:37:58.163432+0000","last_active":"2023-11-18T20:37:59.189711+0000","last_peered":"2023-11-18T20:37:59.189711+0000","last_clean":"2023-11-18T20:37:59.189711+0000","last_became_active":"2023-11-18T20:37:58.163136+0000","last_became_peered":"2023-11-18T20:37:58.163136+0000","last_unstale":"2023-11-18T20:37:59.189711+0000","last_undegraded":"2023-11-18T20:37:59.189711+0000","last_fullsized":"2023-11-18T20:37:59.189711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:02.758344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866722+0000","last_change":"2023-11-18T20:37:59.173529+0000","last_active":"2023-11-18T20:38:00.866722+0000","last_peered":"2023-11-18T20:38:00.866722+0000","last_clean":"2023-11-18T20:38:00.866722+0000","last_became_active":"2023-11-18T20:37:59.173236+0000","last_became_peered":"2023-11-18T20:37:59.173236+0000","last_unstale":"2023-11-18T20:38:00.866722+0000","last_undegraded":"2023-11-18T20:38:00.866722+0000","last_fullsized":"2023-11-18T20:38:00.866722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:56.471403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190765+0000","last_change":"2023-11-18T20:37:58.155736+0000","last_active":"2023-11-18T20:37:59.190765+0000","last_peered":"2023-11-18T20:37:59.190765+0000","last_clean":"2023-11-18T20:37:59.190765+0000","last_became_active":"2023-11-18T20:37:58.155358+0000","last_became_peered":"2023-11-18T20:37:58.155358+0000","last_unstale":"2023-11-18T20:37:59.190765+0000","last_undegraded":"2023-11-18T20:37:59.190765+0000","last_fullsized":"2023-11-18T20:37:59.190765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:08.418442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866947+0000","last_change":"2023-11-18T20:37:59.180009+0000","last_active":"2023-11-18T20:38:00.866947+0000","last_peered":"2023-11-18T20:38:00.866947+0000","last_clean":"2023-11-18T20:38:00.866947+0000","last_became_active":"2023-11-18T20:37:59.179749+0000","last_became_peered":"2023-11-18T20:37:59.179749+0000","last_unstale":"2023-11-18T20:38:00.866947+0000","last_undegraded":"2023-11-18T20:38:00.866947+0000","last_fullsized":"2023-11-18T20:38:00.866947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:32:26.758536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.147372+0000","last_change":"2023-11-18T20:37:58.172930+0000","last_active":"2023-11-18T20:37:59.147372+0000","last_peered":"2023-11-18T20:37:59.147372+0000","last_clean":"2023-11-18T20:37:59.147372+0000","last_became_active":"2023-11-18T20:37:58.172547+0000","last_became_peered":"2023-11-18T20:37:58.172547+0000","last_unstale":"2023-11-18T20:37:59.147372+0000","last_undegraded":"2023-11-18T20:37:59.147372+0000","last_fullsized":"2023-11-18T20:37:59.147372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:53.514145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178371+0000","last_change":"2023-11-18T20:37:59.170278+0000","last_active":"2023-11-18T20:38:00.178371+0000","last_peered":"2023-11-18T20:38:00.178371+0000","last_clean":"2023-11-18T20:38:00.178371+0000","last_became_active":"2023-11-18T20:37:59.169600+0000","last_became_peered":"2023-11-18T20:37:59.169600+0000","last_unstale":"2023-11-18T20:38:00.178371+0000","last_undegraded":"2023-11-18T20:38:00.178371+0000","last_fullsized":"2023-11-18T20:38:00.178371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:58.745666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.151129+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:37:59.151129+0000","last_peered":"2023-11-18T20:37:59.151129+0000","last_clean":"2023-11-18T20:37:59.151129+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:37:59.151129+0000","last_undegraded":"2023-11-18T20:37:59.151129+0000","last_fullsized":"2023-11-18T20:37:59.151129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.163203+0000","last_change":"2023-11-18T20:37:58.169197+0000","last_active":"2023-11-18T20:37:59.163203+0000","last_peered":"2023-11-18T20:37:59.163203+0000","last_clean":"2023-11-18T20:37:59.163203+0000","last_became_active":"2023-11-18T20:37:58.167753+0000","last_became_peered":"2023-11-18T20:37:58.167753+0000","last_unstale":"2023-11-18T20:37:59.163203+0000","last_undegraded":"2023-11-18T20:37:59.163203+0000","last_fullsized":"2023-11-18T20:37:59.163203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:53:19.905517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.175901+0000","last_change":"2023-11-18T20:37:59.161310+0000","last_active":"2023-11-18T20:38:00.175901+0000","last_peered":"2023-11-18T20:38:00.175901+0000","last_clean":"2023-11-18T20:38:00.175901+0000","last_became_active":"2023-11-18T20:37:59.160573+0000","last_became_peered":"2023-11-18T20:37:59.160573+0000","last_unstale":"2023-11-18T20:38:00.175901+0000","last_undegraded":"2023-11-18T20:38:00.175901+0000","last_fullsized":"2023-11-18T20:38:00.175901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.748224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.149589+0000","last_change":"2023-11-18T20:37:58.164074+0000","last_active":"2023-11-18T20:37:59.149589+0000","last_peered":"2023-11-18T20:37:59.149589+0000","last_clean":"2023-11-18T20:37:59.149589+0000","last_became_active":"2023-11-18T20:37:58.163736+0000","last_became_peered":"2023-11-18T20:37:58.163736+0000","last_unstale":"2023-11-18T20:37:59.149589+0000","last_undegraded":"2023-11-18T20:37:59.149589+0000","last_fullsized":"2023-11-18T20:37:59.149589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:34.608711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178613+0000","last_change":"2023-11-18T20:37:59.159340+0000","last_active":"2023-11-18T20:38:00.178613+0000","last_peered":"2023-11-18T20:38:00.178613+0000","last_clean":"2023-11-18T20:38:00.178613+0000","last_became_active":"2023-11-18T20:37:59.157840+0000","last_became_peered":"2023-11-18T20:37:59.157840+0000","last_unstale":"2023-11-18T20:38:00.178613+0000","last_undegraded":"2023-11-18T20:38:00.178613+0000","last_fullsized":"2023-11-18T20:38:00.178613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:45.334641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.154943+0000","last_change":"2023-11-18T20:37:58.162360+0000","last_active":"2023-11-18T20:37:59.154943+0000","last_peered":"2023-11-18T20:37:59.154943+0000","last_clean":"2023-11-18T20:37:59.154943+0000","last_became_active":"2023-11-18T20:37:58.161032+0000","last_became_peered":"2023-11-18T20:37:58.161032+0000","last_unstale":"2023-11-18T20:37:59.154943+0000","last_undegraded":"2023-11-18T20:37:59.154943+0000","last_fullsized":"2023-11-18T20:37:59.154943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:22.310204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870267+0000","last_change":"2023-11-18T20:37:59.184190+0000","last_active":"2023-11-18T20:38:01.870267+0000","last_peered":"2023-11-18T20:38:01.870267+0000","last_clean":"2023-11-18T20:38:01.870267+0000","last_became_active":"2023-11-18T20:37:59.183849+0000","last_became_peered":"2023-11-18T20:37:59.183849+0000","last_unstale":"2023-11-18T20:38:01.870267+0000","last_undegraded":"2023-11-18T20:38:01.870267+0000","last_fullsized":"2023-11-18T20:38:01.870267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:47.280214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.152253+0000","last_change":"2023-11-18T20:37:58.170185+0000","last_active":"2023-11-18T20:37:59.152253+0000","last_peered":"2023-11-18T20:37:59.152253+0000","last_clean":"2023-11-18T20:37:59.152253+0000","last_became_active":"2023-11-18T20:37:58.169816+0000","last_became_peered":"2023-11-18T20:37:58.169816+0000","last_unstale":"2023-11-18T20:37:59.152253+0000","last_undegraded":"2023-11-18T20:37:59.152253+0000","last_fullsized":"2023-11-18T20:37:59.152253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:08.127960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.866620+0000","last_change":"2023-11-18T20:37:59.174808+0000","last_active":"2023-11-18T20:38:00.866620+0000","last_peered":"2023-11-18T20:38:00.866620+0000","last_clean":"2023-11-18T20:38:00.866620+0000","last_became_active":"2023-11-18T20:37:59.174514+0000","last_became_peered":"2023-11-18T20:37:59.174514+0000","last_unstale":"2023-11-18T20:38:00.866620+0000","last_undegraded":"2023-11-18T20:38:00.866620+0000","last_fullsized":"2023-11-18T20:38:00.866620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:38.185159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.169106+0000","last_change":"2023-11-18T20:37:58.166623+0000","last_active":"2023-11-18T20:37:59.169106+0000","last_peered":"2023-11-18T20:37:59.169106+0000","last_clean":"2023-11-18T20:37:59.169106+0000","last_became_active":"2023-11-18T20:37:58.166264+0000","last_became_peered":"2023-11-18T20:37:58.166264+0000","last_unstale":"2023-11-18T20:37:59.169106+0000","last_undegraded":"2023-11-18T20:37:59.169106+0000","last_fullsized":"2023-11-18T20:37:59.169106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:50.825296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.374320+0000","last_change":"2023-11-18T20:37:59.155770+0000","last_active":"2023-11-18T20:38:01.374320+0000","last_peered":"2023-11-18T20:38:01.374320+0000","last_clean":"2023-11-18T20:38:01.374320+0000","last_became_active":"2023-11-18T20:37:59.153043+0000","last_became_peered":"2023-11-18T20:37:59.153043+0000","last_unstale":"2023-11-18T20:38:01.374320+0000","last_undegraded":"2023-11-18T20:38:01.374320+0000","last_fullsized":"2023-11-18T20:38:01.374320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:03.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.165053+0000","last_change":"2023-11-18T20:37:58.171460+0000","last_active":"2023-11-18T20:37:59.165053+0000","last_peered":"2023-11-18T20:37:59.165053+0000","last_clean":"2023-11-18T20:37:59.165053+0000","last_became_active":"2023-11-18T20:37:58.171098+0000","last_became_peered":"2023-11-18T20:37:58.171098+0000","last_unstale":"2023-11-18T20:37:59.165053+0000","last_undegraded":"2023-11-18T20:37:59.165053+0000","last_fullsized":"2023-11-18T20:37:59.165053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:03.237240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.179244+0000","last_change":"2023-11-18T20:37:59.185324+0000","last_active":"2023-11-18T20:38:00.179244+0000","last_peered":"2023-11-18T20:38:00.179244+0000","last_clean":"2023-11-18T20:38:00.179244+0000","last_became_active":"2023-11-18T20:37:59.184874+0000","last_became_peered":"2023-11-18T20:37:59.184874+0000","last_unstale":"2023-11-18T20:38:00.179244+0000","last_undegraded":"2023-11-18T20:38:00.179244+0000","last_fullsized":"2023-11-18T20:38:00.179244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:09.143367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177185+0000","last_change":"2023-11-18T20:37:58.172192+0000","last_active":"2023-11-18T20:38:00.177185+0000","last_peered":"2023-11-18T20:38:00.177185+0000","last_clean":"2023-11-18T20:38:00.177185+0000","last_became_active":"2023-11-18T20:37:58.171909+0000","last_became_peered":"2023-11-18T20:37:58.171909+0000","last_unstale":"2023-11-18T20:38:00.177185+0000","last_undegraded":"2023-11-18T20:38:00.177185+0000","last_fullsized":"2023-11-18T20:38:00.177185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.052630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.176507+0000","last_change":"2023-11-18T20:37:59.156794+0000","last_active":"2023-11-18T20:38:00.176507+0000","last_peered":"2023-11-18T20:38:00.176507+0000","last_clean":"2023-11-18T20:38:00.176507+0000","last_became_active":"2023-11-18T20:37:59.156240+0000","last_became_peered":"2023-11-18T20:37:59.156240+0000","last_unstale":"2023-11-18T20:38:00.176507+0000","last_undegraded":"2023-11-18T20:38:00.176507+0000","last_fullsized":"2023-11-18T20:38:00.176507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:47.605864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190149+0000","last_change":"2023-11-18T20:37:58.172619+0000","last_active":"2023-11-18T20:37:59.190149+0000","last_peered":"2023-11-18T20:37:59.190149+0000","last_clean":"2023-11-18T20:37:59.190149+0000","last_became_active":"2023-11-18T20:37:58.172348+0000","last_became_peered":"2023-11-18T20:37:58.172348+0000","last_unstale":"2023-11-18T20:37:59.190149+0000","last_undegraded":"2023-11-18T20:37:59.190149+0000","last_fullsized":"2023-11-18T20:37:59.190149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:50.652943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177039+0000","last_change":"2023-11-18T20:37:59.163153+0000","last_active":"2023-11-18T20:38:00.177039+0000","last_peered":"2023-11-18T20:38:00.177039+0000","last_clean":"2023-11-18T20:38:00.177039+0000","last_became_active":"2023-11-18T20:37:59.162808+0000","last_became_peered":"2023-11-18T20:37:59.162808+0000","last_unstale":"2023-11-18T20:38:00.177039+0000","last_undegraded":"2023-11-18T20:38:00.177039+0000","last_fullsized":"2023-11-18T20:38:00.177039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:26:52.692005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.146031+0000","last_change":"2023-11-18T20:37:58.159754+0000","last_active":"2023-11-18T20:37:59.146031+0000","last_peered":"2023-11-18T20:37:59.146031+0000","last_clean":"2023-11-18T20:37:59.146031+0000","last_became_active":"2023-11-18T20:37:58.159469+0000","last_became_peered":"2023-11-18T20:37:58.159469+0000","last_unstale":"2023-11-18T20:37:59.146031+0000","last_undegraded":"2023-11-18T20:37:59.146031+0000","last_fullsized":"2023-11-18T20:37:59.146031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:05.111526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.177843+0000","last_change":"2023-11-18T20:37:59.167253+0000","last_active":"2023-11-18T20:38:00.177843+0000","last_peered":"2023-11-18T20:38:00.177843+0000","last_clean":"2023-11-18T20:38:00.177843+0000","last_became_active":"2023-11-18T20:37:59.166946+0000","last_became_peered":"2023-11-18T20:37:59.166946+0000","last_unstale":"2023-11-18T20:38:00.177843+0000","last_undegraded":"2023-11-18T20:38:00.177843+0000","last_fullsized":"2023-11-18T20:38:00.177843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:26:48.310102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.150750+0000","last_change":"2023-11-18T20:37:58.168664+0000","last_active":"2023-11-18T20:37:59.150750+0000","last_peered":"2023-11-18T20:37:59.150750+0000","last_clean":"2023-11-18T20:37:59.150750+0000","last_became_active":"2023-11-18T20:37:58.167672+0000","last_became_peered":"2023-11-18T20:37:58.167672+0000","last_unstale":"2023-11-18T20:37:59.150750+0000","last_undegraded":"2023-11-18T20:37:59.150750+0000","last_fullsized":"2023-11-18T20:37:59.150750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:04:38.092659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.175604+0000","last_change":"2023-11-18T20:37:59.167864+0000","last_active":"2023-11-18T20:38:00.175604+0000","last_peered":"2023-11-18T20:38:00.175604+0000","last_clean":"2023-11-18T20:38:00.175604+0000","last_became_active":"2023-11-18T20:37:59.167604+0000","last_became_peered":"2023-11-18T20:37:59.167604+0000","last_unstale":"2023-11-18T20:38:00.175604+0000","last_undegraded":"2023-11-18T20:38:00.175604+0000","last_fullsized":"2023-11-18T20:38:00.175604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:38.365782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.141993+0000","last_change":"2023-11-18T20:37:58.163771+0000","last_active":"2023-11-18T20:37:59.141993+0000","last_peered":"2023-11-18T20:37:59.141993+0000","last_clean":"2023-11-18T20:37:59.141993+0000","last_became_active":"2023-11-18T20:37:58.156832+0000","last_became_peered":"2023-11-18T20:37:58.156832+0000","last_unstale":"2023-11-18T20:37:59.141993+0000","last_undegraded":"2023-11-18T20:37:59.141993+0000","last_fullsized":"2023-11-18T20:37:59.141993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:50:00.581467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.440110+0000","last_change":"2023-11-18T20:37:59.168936+0000","last_active":"2023-11-18T20:38:00.440110+0000","last_peered":"2023-11-18T20:38:00.440110+0000","last_clean":"2023-11-18T20:38:00.440110+0000","last_became_active":"2023-11-18T20:37:59.168646+0000","last_became_peered":"2023-11-18T20:37:59.168646+0000","last_unstale":"2023-11-18T20:38:00.440110+0000","last_undegraded":"2023-11-18T20:38:00.440110+0000","last_fullsized":"2023-11-18T20:38:00.440110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190819+0000","last_change":"2023-11-18T20:37:58.167173+0000","last_active":"2023-11-18T20:37:59.190819+0000","last_peered":"2023-11-18T20:37:59.190819+0000","last_clean":"2023-11-18T20:37:59.190819+0000","last_became_active":"2023-11-18T20:37:58.166871+0000","last_became_peered":"2023-11-18T20:37:58.166871+0000","last_unstale":"2023-11-18T20:37:59.190819+0000","last_undegraded":"2023-11-18T20:37:59.190819+0000","last_fullsized":"2023-11-18T20:37:59.190819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:16:18.678055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178247+0000","last_change":"2023-11-18T20:37:59.174211+0000","last_active":"2023-11-18T20:38:00.178247+0000","last_peered":"2023-11-18T20:38:00.178247+0000","last_clean":"2023-11-18T20:38:00.178247+0000","last_became_active":"2023-11-18T20:37:59.173927+0000","last_became_peered":"2023-11-18T20:37:59.173927+0000","last_unstale":"2023-11-18T20:38:00.178247+0000","last_undegraded":"2023-11-18T20:38:00.178247+0000","last_fullsized":"2023-11-18T20:38:00.178247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:13.326666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:00.178272+0000","last_change":"2023-11-18T20:37:59.178202+0000","last_active":"2023-11-18T20:38:00.178272+0000","last_peered":"2023-11-18T20:38:00.178272+0000","last_clean":"2023-11-18T20:38:00.178272+0000","last_became_active":"2023-11-18T20:37:59.177947+0000","last_became_peered":"2023-11-18T20:37:59.177947+0000","last_unstale":"2023-11-18T20:38:00.178272+0000","last_undegraded":"2023-11-18T20:38:00.178272+0000","last_fullsized":"2023-11-18T20:38:00.178272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:09.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.191381+0000","last_change":"2023-11-18T20:37:58.158604+0000","last_active":"2023-11-18T20:37:59.191381+0000","last_peered":"2023-11-18T20:37:59.191381+0000","last_clean":"2023-11-18T20:37:59.191381+0000","last_became_active":"2023-11-18T20:37:58.158146+0000","last_became_peered":"2023-11-18T20:37:58.158146+0000","last_unstale":"2023-11-18T20:37:59.191381+0000","last_undegraded":"2023-11-18T20:37:59.191381+0000","last_fullsized":"2023-11-18T20:37:59.191381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:39:46.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.870315+0000","last_change":"2023-11-18T20:37:59.172487+0000","last_active":"2023-11-18T20:38:01.870315+0000","last_peered":"2023-11-18T20:38:01.870315+0000","last_clean":"2023-11-18T20:38:01.870315+0000","last_became_active":"2023-11-18T20:37:59.172038+0000","last_became_peered":"2023-11-18T20:37:59.172038+0000","last_unstale":"2023-11-18T20:38:01.870315+0000","last_undegraded":"2023-11-18T20:38:01.870315+0000","last_fullsized":"2023-11-18T20:38:01.870315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:29:31.616963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190640+0000","last_change":"2023-11-18T20:37:58.158747+0000","last_active":"2023-11-18T20:37:59.190640+0000","last_peered":"2023-11-18T20:37:59.190640+0000","last_clean":"2023-11-18T20:37:59.190640+0000","last_became_active":"2023-11-18T20:37:58.156086+0000","last_became_peered":"2023-11-18T20:37:58.156086+0000","last_unstale":"2023-11-18T20:37:59.190640+0000","last_undegraded":"2023-11-18T20:37:59.190640+0000","last_fullsized":"2023-11-18T20:37:59.190640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.052630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871489+0000","last_change":"2023-11-18T20:37:59.173339+0000","last_active":"2023-11-18T20:38:01.871489+0000","last_peered":"2023-11-18T20:38:01.871489+0000","last_clean":"2023-11-18T20:38:01.871489+0000","last_became_active":"2023-11-18T20:37:59.172593+0000","last_became_peered":"2023-11-18T20:37:59.172593+0000","last_unstale":"2023-11-18T20:38:01.871489+0000","last_undegraded":"2023-11-18T20:38:01.871489+0000","last_fullsized":"2023-11-18T20:38:01.871489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:38.185159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.189386+0000","last_change":"2023-11-18T20:37:58.157777+0000","last_active":"2023-11-18T20:37:59.189386+0000","last_peered":"2023-11-18T20:37:59.189386+0000","last_clean":"2023-11-18T20:37:59.189386+0000","last_became_active":"2023-11-18T20:37:58.156090+0000","last_became_peered":"2023-11-18T20:37:58.156090+0000","last_unstale":"2023-11-18T20:37:59.189386+0000","last_undegraded":"2023-11-18T20:37:59.189386+0000","last_fullsized":"2023-11-18T20:37:59.189386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:37.350375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-18T20:38:01.871355+0000","last_change":"2023-11-18T20:37:59.180531+0000","last_active":"2023-11-18T20:38:01.871355+0000","last_peered":"2023-11-18T20:38:01.871355+0000","last_clean":"2023-11-18T20:38:01.871355+0000","last_became_active":"2023-11-18T20:37:59.177897+0000","last_became_peered":"2023-11-18T20:37:59.177897+0000","last_unstale":"2023-11-18T20:38:01.871355+0000","last_undegraded":"2023-11-18T20:38:01.871355+0000","last_fullsized":"2023-11-18T20:38:01.871355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:58.122132+0000","last_clean_scrub_stamp":"2023-11-18T20:37:58.122132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:13.243273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T20:37:59.190088+0000","last_change":"2023-11-18T20:37:58.168566+0000","last_active":"2023-11-18T20:37:59.190088+0000","last_peered":"2023-11-18T20:37:59.190088+0000","last_clean":"2023-11-18T20:37:59.190088+0000","last_became_active":"2023-11-18T20:37:58.168250+0000","last_became_peered":"2023-11-18T20:37:58.168250+0000","last_unstale":"2023-11-18T20:37:59.190088+0000","last_undegraded":"2023-11-18T20:37:59.190088+0000","last_fullsized":"2023-11-18T20:37:59.190088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:57.106725+0000","last_clean_scrub_stamp":"2023-11-18T20:37:57.106725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:21:59.658278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":74131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":664591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.962}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0819999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6930000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":74713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.633}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":664569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.633}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:38:14.503 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-18T20:38:14.503 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-18T20:38:14.503 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-18T20:38:14.503 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-18T20:38:14.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.748+0000 7fad2d197640 1 Processor -- start 2023-11-18T20:38:14.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.749+0000 7fad2d197640 1 -- start start 2023-11-18T20:38:14.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.750+0000 7fad2d197640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad2814e810 0x7fad281550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.750+0000 7fad2d197640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 0x7fad2806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.750+0000 7fad2d197640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad280bd8d0 con 0x7fad280c7e90 2023-11-18T20:38:14.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.750+0000 7fad2d197640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad280c6e60 con 0x7fad2814e810 2023-11-18T20:38:14.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.750+0000 7fad2d197640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad28155600 con 0x7fad2806b7d0 2023-11-18T20:38:14.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.750+0000 7fad26d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad2814e810 0x7fad281550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:14.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.750+0000 7fad2659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fad280c7e90 0x7fad280c4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48758/0 (socket says 172.21.15.132:48758) 2023-11-18T20:38:14.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.750+0000 7fad2659c640 1 -- 172.21.15.132:0/1932952050 learned_addr learned my addr 172.21.15.132:0/1932952050 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:14.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.751+0000 7fad2759e640 1 --2- 172.21.15.132:0/1932952050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 0x7fad2806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:14.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.751+0000 7fad26d9d640 1 -- 172.21.15.132:0/1932952050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 msgr2=0x7fad2806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:14.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.751+0000 7fad26d9d640 1 --2- 172.21.15.132:0/1932952050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 0x7fad2806bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.751+0000 7fad26d9d640 1 -- 172.21.15.132:0/1932952050 >> v1:172.21.15.132:6789/0 conn(0x7fad280c7e90 legacy=0x7fad280c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.751+0000 7fad26d9d640 1 -- 172.21.15.132:0/1932952050 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280c70d0 con 0x7fad2814e810 2023-11-18T20:38:14.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.751+0000 7fad25d9b640 1 -- 172.21.15.132:0/1932952050 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765440713 0 0) 0x7fad280bd8d0 con 0x7fad280c7e90 2023-11-18T20:38:14.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.752+0000 7fad26d9d640 1 --2- 172.21.15.132:0/1932952050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2814e810 0x7fad281550c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad18009d90 tx=0x7fad1802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6479fddbf82ca4e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:14.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.752+0000 7fad25d9b640 1 -- 172.21.15.132:0/1932952050 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1802cbd0 con 0x7fad2814e810 2023-11-18T20:38:14.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.752+0000 7fad25d9b640 1 -- 172.21.15.132:0/1932952050 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1802cd30 con 0x7fad2814e810 2023-11-18T20:38:14.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.752+0000 7fad25d9b640 1 -- 172.21.15.132:0/1932952050 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1802cea0 con 0x7fad2814e810 2023-11-18T20:38:14.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.753+0000 7fad2d197640 1 -- 172.21.15.132:0/1932952050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2814e810 msgr2=0x7fad281550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.753+0000 7fad2d197640 1 --2- 172.21.15.132:0/1932952050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2814e810 0x7fad281550c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad18009d90 tx=0x7fad1802be20 comp rx=0 tx=0).stop 2023-11-18T20:38:14.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.753+0000 7fad2d197640 1 -- 172.21.15.132:0/1932952050 shutdown_connections 2023-11-18T20:38:14.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.753+0000 7fad2d197640 1 --2- 172.21.15.132:0/1932952050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 0x7fad2806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.753+0000 7fad2d197640 1 --2- 172.21.15.132:0/1932952050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2814e810 0x7fad281550c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.753+0000 7fad2d197640 1 -- 172.21.15.132:0/1932952050 >> 172.21.15.132:0/1932952050 conn(0x7fad280ca170 msgr2=0x7fad280ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:14.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.753+0000 7fad2d197640 1 -- 172.21.15.132:0/1932952050 shutdown_connections 2023-11-18T20:38:14.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.753+0000 7fad2d197640 1 -- 172.21.15.132:0/1932952050 wait complete. 2023-11-18T20:38:14.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.755+0000 7fad2d197640 1 Processor -- start 2023-11-18T20:38:14.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.755+0000 7fad2d197640 1 -- start start 2023-11-18T20:38:14.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2d197640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 0x7fad281e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2d197640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad280c7e90 0x7fad28150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2d197640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad2814e810 0x7fad28151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2d197640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad281515c0 con 0x7fad280c7e90 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2d197640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2814ec90 con 0x7fad2814e810 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2d197640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad281ea9f0 con 0x7fad2806b7d0 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad280c7e90 0x7fad28150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad280c7e90 0x7fad28150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58056/0 (socket says 172.21.15.132:58056) 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2659c640 1 -- 172.21.15.132:0/2603008629 learned_addr learned my addr 172.21.15.132:0/2603008629 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2659c640 1 -- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 msgr2=0x7fad281e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2659c640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 0x7fad281e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2659c640 1 -- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad2814e810 msgr2=0x7fad28151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2659c640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad2814e810 0x7fad28151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.756+0000 7fad2659c640 1 -- 172.21.15.132:0/2603008629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18009a70 con 0x7fad280c7e90 2023-11-18T20:38:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.757+0000 7fad2659c640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad280c7e90 0x7fad28150b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fad1000c4b0 tx=0x7fad1000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:14.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.757+0000 7fad1f7fe640 1 -- 172.21.15.132:0/2603008629 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100074e0 con 0x7fad280c7e90 2023-11-18T20:38:14.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.757+0000 7fad1f7fe640 1 -- 172.21.15.132:0/2603008629 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10007660 con 0x7fad280c7e90 2023-11-18T20:38:14.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.757+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2814ef30 con 0x7fad280c7e90 2023-11-18T20:38:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.757+0000 7fad1f7fe640 1 -- 172.21.15.132:0/2603008629 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10004a20 con 0x7fad280c7e90 2023-11-18T20:38:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.757+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad280c3fb0 con 0x7fad280c7e90 2023-11-18T20:38:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.758+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2814f170 con 0x7fad280c7e90 2023-11-18T20:38:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.759+0000 7fad1f7fe640 1 -- 172.21.15.132:0/2603008629 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad10004b80 con 0x7fad280c7e90 2023-11-18T20:38:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.760+0000 7fad1f7fe640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad0806ae70 0x7fad0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:14.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.760+0000 7fad1f7fe640 1 -- 172.21.15.132:0/2603008629 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad10088b40 con 0x7fad280c7e90 2023-11-18T20:38:14.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.760+0000 7fad26d9d640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad0806ae70 0x7fad0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.761+0000 7fad26d9d640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad0806ae70 0x7fad0806d330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fad18036000 tx=0x7fad1802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:14.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.764+0000 7fad1f7fe640 1 -- 172.21.15.132:0/2603008629 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad2814f170 con 0x7fad280c7e90 2023-11-18T20:38:14.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.989+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fad2814f120 con 0x7fad280c7e90 2023-11-18T20:38:14.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.990+0000 7fad1f7fe640 1 -- 172.21.15.132:0/2603008629 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fad10018080 con 0x7fad280c7e90 2023-11-18T20:38:14.991 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:14.991 INFO:teuthology.orchestra.run.smithi132.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.992+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad0806ae70 msgr2=0x7fad0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.992+0000 7fad2d197640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad0806ae70 0x7fad0806d330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fad18036000 tx=0x7fad1802e000 comp rx=0 tx=0).stop 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.992+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad280c7e90 msgr2=0x7fad28150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.992+0000 7fad2d197640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad280c7e90 0x7fad28150b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fad1000c4b0 tx=0x7fad1000c970 comp rx=0 tx=0).stop 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.992+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 shutdown_connections 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.992+0000 7fad2d197640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad0806ae70 0x7fad0806d330 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.992+0000 7fad2d197640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad2814e810 0x7fad28151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.992+0000 7fad2d197640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad280c7e90 0x7fad28150b40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.993+0000 7fad2d197640 1 --2- 172.21.15.132:0/2603008629 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2806b7d0 0x7fad281e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:14.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.993+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 >> 172.21.15.132:0/2603008629 conn(0x7fad280ca170 msgr2=0x7fad280ab170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:14.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.993+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 shutdown_connections 2023-11-18T20:38:14.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:14.993+0000 7fad2d197640 1 -- 172.21.15.132:0/2603008629 wait complete. 2023-11-18T20:38:15.013 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-18T20:38:15.014 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:15.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.237+0000 7fbf4e91d640 1 Processor -- start 2023-11-18T20:38:15.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.237+0000 7fbf4e91d640 1 -- start start 2023-11-18T20:38:15.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.238+0000 7fbf4e91d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf4814fd30 0x7fbf48152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.238+0000 7fbf4e91d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480c64a0 con 0x7fbf4806d0a0 2023-11-18T20:38:15.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.238+0000 7fbf4e91d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480c5c00 con 0x7fbf480c3ea0 2023-11-18T20:38:15.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.238+0000 7fbf4e91d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480c5ee0 con 0x7fbf4814fd30 2023-11-18T20:38:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.238+0000 7fbf3ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbf4806d0a0 0x7fbf480a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48772/0 (socket says 172.21.15.132:48772) 2023-11-18T20:38:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.238+0000 7fbf3ffff640 1 -- 172.21.15.132:0/3206856200 learned_addr learned my addr 172.21.15.132:0/3206856200 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.238+0000 7fbf47fff640 1 --2- 172.21.15.132:0/3206856200 >> v2:172.21.15.132:3300/0 conn(0x7fbf4814fd30 0x7fbf48152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.239+0000 7fbf47fff640 1 -- 172.21.15.132:0/3206856200 >> v1:172.21.15.161:6789/0 conn(0x7fbf480c3ea0 legacy=0x7fbf480c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.239+0000 7fbf47fff640 1 -- 172.21.15.132:0/3206856200 >> v1:172.21.15.132:6789/0 conn(0x7fbf4806d0a0 legacy=0x7fbf480a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.239+0000 7fbf47fff640 1 -- 172.21.15.132:0/3206856200 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480c61c0 con 0x7fbf4814fd30 2023-11-18T20:38:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.240+0000 7fbf47fff640 1 --2- 172.21.15.132:0/3206856200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf4814fd30 0x7fbf48152f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097a0 tx=0x7fbf3802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81181f18a90dde5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.240+0000 7fbf477fe640 1 -- 172.21.15.132:0/3206856200 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38031830 con 0x7fbf4814fd30 2023-11-18T20:38:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.240+0000 7fbf477fe640 1 -- 172.21.15.132:0/3206856200 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38031990 con 0x7fbf4814fd30 2023-11-18T20:38:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.240+0000 7fbf477fe640 1 -- 172.21.15.132:0/3206856200 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38031d20 con 0x7fbf4814fd30 2023-11-18T20:38:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.241+0000 7fbf4e91d640 1 -- 172.21.15.132:0/3206856200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf4814fd30 msgr2=0x7fbf48152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.241+0000 7fbf4e91d640 1 --2- 172.21.15.132:0/3206856200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf4814fd30 0x7fbf48152f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097a0 tx=0x7fbf3802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.241+0000 7fbf4e91d640 1 -- 172.21.15.132:0/3206856200 shutdown_connections 2023-11-18T20:38:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.241+0000 7fbf4e91d640 1 --2- 172.21.15.132:0/3206856200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf4814fd30 0x7fbf48152f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.241+0000 7fbf4e91d640 1 -- 172.21.15.132:0/3206856200 >> 172.21.15.132:0/3206856200 conn(0x7fbf4806a500 msgr2=0x7fbf4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.241+0000 7fbf4e91d640 1 -- 172.21.15.132:0/3206856200 shutdown_connections 2023-11-18T20:38:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.241+0000 7fbf4e91d640 1 -- 172.21.15.132:0/3206856200 wait complete. 2023-11-18T20:38:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.243+0000 7fbf4e91d640 1 Processor -- start 2023-11-18T20:38:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.243+0000 7fbf4e91d640 1 -- start start 2023-11-18T20:38:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf4e91d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf4806d0a0 0x7fbf480a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf4e91d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf480c3ea0 0x7fbf480bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf4e91d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf4814fd30 0x7fbf481de5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf4e91d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf481df3e0 con 0x7fbf480c3ea0 2023-11-18T20:38:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf4e91d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf481dfbb0 con 0x7fbf4814fd30 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf4e91d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf481eae70 con 0x7fbf4806d0a0 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf480c3ea0 0x7fbf480bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf480c3ea0 0x7fbf480bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58072/0 (socket says 172.21.15.132:58072) 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf3ffff640 1 -- 172.21.15.132:0/2696130070 learned_addr learned my addr 172.21.15.132:0/2696130070 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf47fff640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf4806d0a0 0x7fbf480a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf3ffff640 1 -- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf4806d0a0 msgr2=0x7fbf480a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf4ceba640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf4814fd30 0x7fbf481de5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf3ffff640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf4806d0a0 0x7fbf480a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf3ffff640 1 -- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf4814fd30 msgr2=0x7fbf481de5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf3ffff640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf4814fd30 0x7fbf481de5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf3ffff640 1 -- 172.21.15.132:0/2696130070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38009400 con 0x7fbf480c3ea0 2023-11-18T20:38:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf47fff640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf4806d0a0 0x7fbf480a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.244+0000 7fbf4ceba640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf4814fd30 0x7fbf481de5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.245+0000 7fbf3ffff640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf480c3ea0 0x7fbf480bf360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c3c0 tx=0x7fbf3000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.245+0000 7fbf457fa640 1 -- 172.21.15.132:0/2696130070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30005ce0 con 0x7fbf480c3ea0 2023-11-18T20:38:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.245+0000 7fbf457fa640 1 -- 172.21.15.132:0/2696130070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30005e40 con 0x7fbf480c3ea0 2023-11-18T20:38:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.245+0000 7fbf457fa640 1 -- 172.21.15.132:0/2696130070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300072d0 con 0x7fbf480c3ea0 2023-11-18T20:38:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.245+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf481ddde0 con 0x7fbf480c3ea0 2023-11-18T20:38:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.245+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf480bf8a0 con 0x7fbf480c3ea0 2023-11-18T20:38:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.246+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf48068350 con 0x7fbf480c3ea0 2023-11-18T20:38:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.247+0000 7fbf457fa640 1 -- 172.21.15.132:0/2696130070 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf300074f0 con 0x7fbf480c3ea0 2023-11-18T20:38:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.248+0000 7fbf457fa640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf2806ae40 0x7fbf2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.248+0000 7fbf457fa640 1 -- 172.21.15.132:0/2696130070 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf30088a00 con 0x7fbf480c3ea0 2023-11-18T20:38:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.248+0000 7fbf47fff640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf2806ae40 0x7fbf2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.249+0000 7fbf47fff640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf2806ae40 0x7fbf2806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf38036000 tx=0x7fbf38008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:15.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.252+0000 7fbf457fa640 1 -- 172.21.15.132:0/2696130070 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf30053bf0 con 0x7fbf480c3ea0 2023-11-18T20:38:15.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.447+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf480c66d0 con 0x7fbf480c3ea0 2023-11-18T20:38:15.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.449+0000 7fbf457fa640 1 -- 172.21.15.132:0/2696130070 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fbf30017020 con 0x7fbf480c3ea0 2023-11-18T20:38:15.451 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:15.451 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:15.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf2806ae40 msgr2=0x7fbf2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf2806ae40 0x7fbf2806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf38036000 tx=0x7fbf38008030 comp rx=0 tx=0).stop 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf480c3ea0 msgr2=0x7fbf480bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf480c3ea0 0x7fbf480bf360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c3c0 tx=0x7fbf3000c880 comp rx=0 tx=0).stop 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 shutdown_connections 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf2806ae40 0x7fbf2806d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf4814fd30 0x7fbf481de5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf480c3ea0 0x7fbf480bf360 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 --2- 172.21.15.132:0/2696130070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf4806d0a0 0x7fbf480a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 >> 172.21.15.132:0/2696130070 conn(0x7fbf4806a500 msgr2=0x7fbf480a6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 shutdown_connections 2023-11-18T20:38:15.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.452+0000 7fbf4e91d640 1 -- 172.21.15.132:0/2696130070 wait complete. 2023-11-18T20:38:15.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:15.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:15.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.690+0000 7fa428947640 1 Processor -- start 2023-11-18T20:38:15.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.690+0000 7fa428947640 1 -- start start 2023-11-18T20:38:15.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.691+0000 7fa428947640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa42414e7f0 0x7fa4240c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.691+0000 7fa428947640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa4240c52e0 0x7fa42406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.691+0000 7fa428947640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa4241546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.691+0000 7fa428947640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4240a8380 con 0x7fa42414e7f0 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.691+0000 7fa428947640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4241510b0 con 0x7fa4240c52e0 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.691+0000 7fa428947640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42406bf60 con 0x7fa42406cd20 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa4237fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa42414e7f0 0x7fa4240c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa4237fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa42414e7f0 0x7fa4240c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58080/0 (socket says 172.21.15.132:58080) 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa4237fe640 1 -- 172.21.15.132:0/1142522435 learned_addr learned my addr 172.21.15.132:0/1142522435 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa423fff640 1 --2- 172.21.15.132:0/1142522435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa4241546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa41bfff640 1 --2- 172.21.15.132:0/1142522435 >> v2:172.21.15.161:3300/0 conn(0x7fa4240c52e0 0x7fa42406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa4237fe640 1 -- 172.21.15.132:0/1142522435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 msgr2=0x7fa4241546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa4237fe640 1 --2- 172.21.15.132:0/1142522435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa4241546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa4237fe640 1 -- 172.21.15.132:0/1142522435 >> v2:172.21.15.161:3300/0 conn(0x7fa4240c52e0 msgr2=0x7fa42406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:15.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa4237fe640 1 --2- 172.21.15.132:0/1142522435 >> v2:172.21.15.161:3300/0 conn(0x7fa4240c52e0 0x7fa42406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.692+0000 7fa4237fe640 1 -- 172.21.15.132:0/1142522435 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42406c240 con 0x7fa42414e7f0 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.693+0000 7fa4237fe640 1 --2- 172.21.15.132:0/1142522435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa42414e7f0 0x7fa4240c0440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa42406f680 tx=0x7fa41402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6544558c3d890e96 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.693+0000 7fa422ffd640 1 -- 172.21.15.132:0/1142522435 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140317e0 con 0x7fa42414e7f0 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.693+0000 7fa422ffd640 1 -- 172.21.15.132:0/1142522435 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414031940 con 0x7fa42414e7f0 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.693+0000 7fa422ffd640 1 -- 172.21.15.132:0/1142522435 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414031cd0 con 0x7fa42414e7f0 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 -- 172.21.15.132:0/1142522435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa42414e7f0 msgr2=0x7fa4240c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 --2- 172.21.15.132:0/1142522435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa42414e7f0 0x7fa4240c0440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa42406f680 tx=0x7fa41402b880 comp rx=0 tx=0).stop 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 -- 172.21.15.132:0/1142522435 shutdown_connections 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 --2- 172.21.15.132:0/1142522435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa4241546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 --2- 172.21.15.132:0/1142522435 >> v2:172.21.15.161:3300/0 conn(0x7fa4240c52e0 0x7fa42406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 --2- 172.21.15.132:0/1142522435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa42414e7f0 0x7fa4240c0440 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 -- 172.21.15.132:0/1142522435 >> 172.21.15.132:0/1142522435 conn(0x7fa4240a77f0 msgr2=0x7fa4240a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:15.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 -- 172.21.15.132:0/1142522435 shutdown_connections 2023-11-18T20:38:15.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.694+0000 7fa428947640 1 -- 172.21.15.132:0/1142522435 wait complete. 2023-11-18T20:38:15.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.696+0000 7fa428947640 1 Processor -- start 2023-11-18T20:38:15.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.696+0000 7fa428947640 1 -- start start 2023-11-18T20:38:15.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa428947640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa424072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa428947640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4240c52e0 0x7fa42414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa428947640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42414e7f0 0x7fa42414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa428947640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4241ea360 con 0x7fa4240c52e0 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa428947640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa424150b90 con 0x7fa42414e7f0 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa428947640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4241ea620 con 0x7fa42406cd20 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa41bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4240c52e0 0x7fa42414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa41bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4240c52e0 0x7fa42414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58088/0 (socket says 172.21.15.132:58088) 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.697+0000 7fa41bfff640 1 -- 172.21.15.132:0/386055826 learned_addr learned my addr 172.21.15.132:0/386055826 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa4237fe640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa424072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa423fff640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42414e7f0 0x7fa42414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa41bfff640 1 -- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 msgr2=0x7fa424072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa41bfff640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa424072310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa41bfff640 1 -- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42414e7f0 msgr2=0x7fa42414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa41bfff640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42414e7f0 0x7fa42414f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa41bfff640 1 -- 172.21.15.132:0/386055826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140094d0 con 0x7fa4240c52e0 2023-11-18T20:38:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa4237fe640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa424072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa41bfff640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4240c52e0 0x7fa42414ef20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00d800 tx=0x7fa40c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa420ff9640 1 -- 172.21.15.132:0/386055826 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c00b6c0 con 0x7fa4240c52e0 2023-11-18T20:38:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa420ff9640 1 -- 172.21.15.132:0/386055826 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c00b820 con 0x7fa4240c52e0 2023-11-18T20:38:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa420ff9640 1 -- 172.21.15.132:0/386055826 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c00bbb0 con 0x7fa4240c52e0 2023-11-18T20:38:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4241ea900 con 0x7fa4240c52e0 2023-11-18T20:38:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.698+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa424072850 con 0x7fa4240c52e0 2023-11-18T20:38:15.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.700+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42404e840 con 0x7fa4240c52e0 2023-11-18T20:38:15.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.700+0000 7fa420ff9640 1 -- 172.21.15.132:0/386055826 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa40c00bd10 con 0x7fa4240c52e0 2023-11-18T20:38:15.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.701+0000 7fa420ff9640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa40406ae40 0x7fa40406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:15.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.701+0000 7fa420ff9640 1 -- 172.21.15.132:0/386055826 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa40c089ae0 con 0x7fa4240c52e0 2023-11-18T20:38:15.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.702+0000 7fa4237fe640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa40406ae40 0x7fa40406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:15.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.703+0000 7fa4237fe640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa40406ae40 0x7fa40406d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa414036000 tx=0x7fa41403d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:15.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.705+0000 7fa420ff9640 1 -- 172.21.15.132:0/386055826 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa40c054c20 con 0x7fa4240c52e0 2023-11-18T20:38:15.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.896+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4241554d0 con 0x7fa4240c52e0 2023-11-18T20:38:15.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.897+0000 7fa420ff9640 1 -- 172.21.15.132:0/386055826 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa40c058240 con 0x7fa4240c52e0 2023-11-18T20:38:15.899 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:15.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa40406ae40 msgr2=0x7fa40406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa40406ae40 0x7fa40406d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa414036000 tx=0x7fa41403d040 comp rx=0 tx=0).stop 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4240c52e0 msgr2=0x7fa42414ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4240c52e0 0x7fa42414ef20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00d800 tx=0x7fa40c00dcc0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 shutdown_connections 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa40406ae40 0x7fa40406d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42414e7f0 0x7fa42414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4240c52e0 0x7fa42414ef20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 --2- 172.21.15.132:0/386055826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa42406cd20 0x7fa424072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 >> 172.21.15.132:0/386055826 conn(0x7fa4240a77f0 msgr2=0x7fa4240c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 shutdown_connections 2023-11-18T20:38:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:15.900+0000 7fa428947640 1 -- 172.21.15.132:0/386055826 wait complete. 2023-11-18T20:38:15.920 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:16.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.135+0000 7f65ceca2640 1 Processor -- start 2023-11-18T20:38:16.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.135+0000 7f65ceca2640 1 -- start start 2023-11-18T20:38:16.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.136+0000 7f65ceca2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65c8155490 0x7f65c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65ceca2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 0x7f65c80a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65ceca2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c80c06c0 con 0x7f65c80c4080 2023-11-18T20:38:16.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65ceca2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80a5820 con 0x7f65c8155490 2023-11-18T20:38:16.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65ceca2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80c1020 con 0x7f65c80c1500 2023-11-18T20:38:16.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65cca3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65c8155490 0x7f65c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65cca3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65c8155490 0x7f65c80a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58096/0 (socket says 172.21.15.132:58096) 2023-11-18T20:38:16.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65cca3e640 1 -- 172.21.15.132:0/705842074 learned_addr learned my addr 172.21.15.132:0/705842074 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:16.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65c7fff640 1 --2- 172.21.15.132:0/705842074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 0x7f65c80a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65cca3e640 1 -- 172.21.15.132:0/705842074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 msgr2=0x7f65c80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65cca3e640 1 --2- 172.21.15.132:0/705842074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 0x7f65c80a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65cca3e640 1 -- 172.21.15.132:0/705842074 >> v1:172.21.15.161:6789/0 conn(0x7f65c80c4080 legacy=0x7f65c80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65cca3e640 1 -- 172.21.15.132:0/705842074 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80c0910 con 0x7f65c8155490 2023-11-18T20:38:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.137+0000 7f65c7fff640 1 --2- 172.21.15.132:0/705842074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 0x7f65c80a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.138+0000 7f65cca3e640 1 --2- 172.21.15.132:0/705842074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c8155490 0x7f65c80a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009870 tx=0x7f65bc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519dd41d5b2bc358 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:16.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.139+0000 7f65c77fe640 1 -- 172.21.15.132:0/705842074 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0317c0 con 0x7f65c8155490 2023-11-18T20:38:16.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.139+0000 7f65c77fe640 1 -- 172.21.15.132:0/705842074 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc031920 con 0x7f65c8155490 2023-11-18T20:38:16.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.139+0000 7f65c77fe640 1 -- 172.21.15.132:0/705842074 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc031cb0 con 0x7f65c8155490 2023-11-18T20:38:16.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.139+0000 7f65ceca2640 1 -- 172.21.15.132:0/705842074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c8155490 msgr2=0x7f65c80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.139+0000 7f65ceca2640 1 --2- 172.21.15.132:0/705842074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c8155490 0x7f65c80a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009870 tx=0x7f65bc02b860 comp rx=0 tx=0).stop 2023-11-18T20:38:16.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.140+0000 7f65ceca2640 1 -- 172.21.15.132:0/705842074 shutdown_connections 2023-11-18T20:38:16.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.140+0000 7f65ceca2640 1 --2- 172.21.15.132:0/705842074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 0x7f65c80a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.140+0000 7f65ceca2640 1 --2- 172.21.15.132:0/705842074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c8155490 0x7f65c80a51b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.140+0000 7f65ceca2640 1 -- 172.21.15.132:0/705842074 >> 172.21.15.132:0/705842074 conn(0x7f65c806a500 msgr2=0x7f65c806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:16.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.140+0000 7f65ceca2640 1 -- 172.21.15.132:0/705842074 shutdown_connections 2023-11-18T20:38:16.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.140+0000 7f65ceca2640 1 -- 172.21.15.132:0/705842074 wait complete. 2023-11-18T20:38:16.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.141+0000 7f65ceca2640 1 Processor -- start 2023-11-18T20:38:16.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.141+0000 7f65ceca2640 1 -- start start 2023-11-18T20:38:16.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.142+0000 7f65ceca2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 0x7f65c81e9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.142+0000 7f65ceca2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c80c4080 0x7f65c814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.142+0000 7f65ceca2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8155490 0x7f65c8147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.142+0000 7f65ceca2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8071d00 con 0x7f65c80c4080 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.142+0000 7f65ceca2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c81e9a90 con 0x7f65c8155490 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.142+0000 7f65ceca2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8071fc0 con 0x7f65c80c1500 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c80c4080 0x7f65c814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c80c4080 0x7f65c814e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58102/0 (socket says 172.21.15.132:58102) 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 -- 172.21.15.132:0/1044930204 learned_addr learned my addr 172.21.15.132:0/1044930204 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 -- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 msgr2=0x7f65c81e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 0x7f65c81e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 -- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8155490 msgr2=0x7f65c8147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65cd23f640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8155490 0x7f65c8147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8155490 0x7f65c8147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 -- 172.21.15.132:0/1044930204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0094d0 con 0x7f65c80c4080 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65cd23f640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8155490 0x7f65c8147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c7fff640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c80c4080 0x7f65c814e290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f65b400c7f0 tx=0x7f65b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c57fa640 1 -- 172.21.15.132:0/1044930204 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4007a30 con 0x7f65c80c4080 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.143+0000 7f65c57fa640 1 -- 172.21.15.132:0/1044930204 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b4007b90 con 0x7f65c80c4080 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.144+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c8070aa0 con 0x7f65c80c4080 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.144+0000 7f65c57fa640 1 -- 172.21.15.132:0/1044930204 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400ce40 con 0x7f65c80c4080 2023-11-18T20:38:16.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.144+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c814dd20 con 0x7f65c80c4080 2023-11-18T20:38:16.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.145+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c8068350 con 0x7f65c80c4080 2023-11-18T20:38:16.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.146+0000 7f65c57fa640 1 -- 172.21.15.132:0/1044930204 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65b40113f0 con 0x7f65c80c4080 2023-11-18T20:38:16.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.146+0000 7f65c57fa640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f65ac06ae40 0x7f65ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.147+0000 7f65c57fa640 1 -- 172.21.15.132:0/1044930204 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65b4089810 con 0x7f65c80c4080 2023-11-18T20:38:16.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.147+0000 7f65cca3e640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f65ac06ae40 0x7f65ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.148+0000 7f65cca3e640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f65ac06ae40 0x7f65ac06d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65bc036000 tx=0x7f65bc030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:16.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.157+0000 7f65c57fa640 1 -- 172.21.15.132:0/1044930204 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65b40548b0 con 0x7f65c80c4080 2023-11-18T20:38:16.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.347+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65c80c3e60 con 0x7f65c80c4080 2023-11-18T20:38:16.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.348+0000 7f65c57fa640 1 -- 172.21.15.132:0/1044930204 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65b4057ed0 con 0x7f65c80c4080 2023-11-18T20:38:16.349 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:16.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f65ac06ae40 msgr2=0x7f65ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f65ac06ae40 0x7f65ac06d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65bc036000 tx=0x7f65bc030000 comp rx=0 tx=0).stop 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c80c4080 msgr2=0x7f65c814e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c80c4080 0x7f65c814e290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f65b400c7f0 tx=0x7f65b400cbf0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 shutdown_connections 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f65ac06ae40 0x7f65ac06d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8155490 0x7f65c8147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65c80c4080 0x7f65c814e290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 --2- 172.21.15.132:0/1044930204 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80c1500 0x7f65c81e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 >> 172.21.15.132:0/1044930204 conn(0x7f65c806a500 msgr2=0x7f65c80aad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 shutdown_connections 2023-11-18T20:38:16.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.351+0000 7f65ceca2640 1 -- 172.21.15.132:0/1044930204 wait complete. 2023-11-18T20:38:16.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:16.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.581+0000 7ff96f6e7640 1 Processor -- start 2023-11-18T20:38:16.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.582+0000 7ff96f6e7640 1 -- start start 2023-11-18T20:38:16.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.583+0000 7ff96f6e7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 0x7ff9680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.583+0000 7ff96f6e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff9680a9b40 0x7ff9680c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.583+0000 7ff96f6e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680c06c0 con 0x7ff9680c1500 2023-11-18T20:38:16.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.583+0000 7ff96f6e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680a5820 con 0x7ff9680a9b40 2023-11-18T20:38:16.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.583+0000 7ff96f6e7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680c1020 con 0x7ff968155490 2023-11-18T20:38:16.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.583+0000 7ff96cc82640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff9680c1500 0x7ff9680a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48784/0 (socket says 172.21.15.132:48784) 2023-11-18T20:38:16.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.583+0000 7ff96cc82640 1 -- 172.21.15.132:0/944154108 learned_addr learned my addr 172.21.15.132:0/944154108 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:16.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.583+0000 7ff96dc84640 1 --2- 172.21.15.132:0/944154108 >> v2:172.21.15.132:3300/0 conn(0x7ff9680a9b40 0x7ff9680c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.584+0000 7ff96d483640 1 --2- 172.21.15.132:0/944154108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 0x7ff9680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.584+0000 7ff96dc84640 1 -- 172.21.15.132:0/944154108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 msgr2=0x7ff9680a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:16.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.584+0000 7ff96dc84640 1 --2- 172.21.15.132:0/944154108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 0x7ff9680a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.584+0000 7ff95ffff640 1 -- 172.21.15.132:0/944154108 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955041581 0 0) 0x7ff9680c06c0 con 0x7ff9680c1500 2023-11-18T20:38:16.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.584+0000 7ff96dc84640 1 -- 172.21.15.132:0/944154108 >> v1:172.21.15.132:6789/0 conn(0x7ff9680c1500 legacy=0x7ff9680a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.584+0000 7ff96dc84640 1 -- 172.21.15.132:0/944154108 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680c0910 con 0x7ff9680a9b40 2023-11-18T20:38:16.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.585+0000 7ff96dc84640 1 --2- 172.21.15.132:0/944154108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680a9b40 0x7ff9680c24d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff960009d90 tx=0x7ff96002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20676559c6c0bce8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:16.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.585+0000 7ff95ffff640 1 -- 172.21.15.132:0/944154108 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96002cc60 con 0x7ff9680a9b40 2023-11-18T20:38:16.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.585+0000 7ff95ffff640 1 -- 172.21.15.132:0/944154108 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96002cdc0 con 0x7ff9680a9b40 2023-11-18T20:38:16.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.585+0000 7ff95ffff640 1 -- 172.21.15.132:0/944154108 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960034660 con 0x7ff9680a9b40 2023-11-18T20:38:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.586+0000 7ff96f6e7640 1 -- 172.21.15.132:0/944154108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680a9b40 msgr2=0x7ff9680c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.586+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/944154108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680a9b40 0x7ff9680c24d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff960009d90 tx=0x7ff96002beb0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.586+0000 7ff96f6e7640 1 -- 172.21.15.132:0/944154108 shutdown_connections 2023-11-18T20:38:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.586+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/944154108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680a9b40 0x7ff9680c24d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.586+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/944154108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 0x7ff9680a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.586+0000 7ff96f6e7640 1 -- 172.21.15.132:0/944154108 >> 172.21.15.132:0/944154108 conn(0x7ff96806a500 msgr2=0x7ff96806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:16.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.586+0000 7ff96f6e7640 1 -- 172.21.15.132:0/944154108 shutdown_connections 2023-11-18T20:38:16.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.586+0000 7ff96f6e7640 1 -- 172.21.15.132:0/944154108 wait complete. 2023-11-18T20:38:16.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.588+0000 7ff96f6e7640 1 Processor -- start 2023-11-18T20:38:16.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.588+0000 7ff96f6e7640 1 -- start start 2023-11-18T20:38:16.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96f6e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680c1500 0x7ff9681dc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96f6e7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 0x7ff9681506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96f6e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9681dcf10 0x7ff968150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96f6e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9681dea60 con 0x7ff9680c1500 2023-11-18T20:38:16.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96f6e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680a5570 con 0x7ff9681dcf10 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96f6e7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680a5290 con 0x7ff968155490 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96d483640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680c1500 0x7ff9681dc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96d483640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680c1500 0x7ff9681dc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58112/0 (socket says 172.21.15.132:58112) 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96d483640 1 -- 172.21.15.132:0/904200097 learned_addr learned my addr 172.21.15.132:0/904200097 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96d483640 1 -- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 msgr2=0x7ff9681506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96d483640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 0x7ff9681506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96d483640 1 -- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9681dcf10 msgr2=0x7ff968150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96d483640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9681dcf10 0x7ff968150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.589+0000 7ff96d483640 1 -- 172.21.15.132:0/904200097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff960009a70 con 0x7ff9680c1500 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.590+0000 7ff96d483640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680c1500 0x7ff9681dc9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff96400d5f0 tx=0x7ff96400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.590+0000 7ff95dffb640 1 -- 172.21.15.132:0/904200097 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9640125f0 con 0x7ff9680c1500 2023-11-18T20:38:16.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.590+0000 7ff95dffb640 1 -- 172.21.15.132:0/904200097 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964012750 con 0x7ff9680c1500 2023-11-18T20:38:16.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.590+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9681538d0 con 0x7ff9680c1500 2023-11-18T20:38:16.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.590+0000 7ff95dffb640 1 -- 172.21.15.132:0/904200097 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964012b00 con 0x7ff9680c1500 2023-11-18T20:38:16.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.590+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff968153e90 con 0x7ff9680c1500 2023-11-18T20:38:16.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.591+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff968154050 con 0x7ff9680c1500 2023-11-18T20:38:16.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.592+0000 7ff95dffb640 1 -- 172.21.15.132:0/904200097 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff964012c60 con 0x7ff9680c1500 2023-11-18T20:38:16.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.593+0000 7ff95dffb640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94c06ae70 0x7ff94c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:16.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.594+0000 7ff95dffb640 1 -- 172.21.15.132:0/904200097 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff964089a40 con 0x7ff9680c1500 2023-11-18T20:38:16.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.594+0000 7ff96cc82640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94c06ae70 0x7ff94c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:16.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.595+0000 7ff96cc82640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94c06ae70 0x7ff94c06d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff958007fd0 tx=0x7ff958007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:16.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.598+0000 7ff95dffb640 1 -- 172.21.15.132:0/904200097 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff96408be60 con 0x7ff9680c1500 2023-11-18T20:38:16.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.786+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff968068350 con 0x7ff9680c1500 2023-11-18T20:38:16.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.787+0000 7ff95dffb640 1 -- 172.21.15.132:0/904200097 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff964054b80 con 0x7ff9680c1500 2023-11-18T20:38:16.790 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94c06ae70 msgr2=0x7ff94c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94c06ae70 0x7ff94c06d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff958007fd0 tx=0x7ff958007920 comp rx=0 tx=0).stop 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680c1500 msgr2=0x7ff9681dc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680c1500 0x7ff9681dc9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff96400d5f0 tx=0x7ff96400dab0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 shutdown_connections 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94c06ae70 0x7ff94c06d330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9681dcf10 0x7ff968150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff968155490 0x7ff9681506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 --2- 172.21.15.132:0/904200097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680c1500 0x7ff9681dc9d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 >> 172.21.15.132:0/904200097 conn(0x7ff96806a500 msgr2=0x7ff9680aad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:16.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 shutdown_connections 2023-11-18T20:38:16.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:16.790+0000 7ff96f6e7640 1 -- 172.21.15.132:0/904200097 wait complete. 2023-11-18T20:38:16.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:38:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.011+0000 7f9983f47640 1 Processor -- start 2023-11-18T20:38:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.011+0000 7f9983f47640 1 -- start start 2023-11-18T20:38:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.012+0000 7f9983f47640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f997c06d0a0 0x7f997c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.012+0000 7f9983f47640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f997c0c3ea0 0x7f997c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.012+0000 7f9983f47640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997c0c64a0 con 0x7f997c14fd30 2023-11-18T20:38:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.012+0000 7f9983f47640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997c0c5c00 con 0x7f997c06d0a0 2023-11-18T20:38:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.012+0000 7f9983f47640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997c0c5ee0 con 0x7f997c0c3ea0 2023-11-18T20:38:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.013+0000 7f99814e2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f997c06d0a0 0x7f997c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.013+0000 7f99814e2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f997c06d0a0 0x7f997c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58114/0 (socket says 172.21.15.132:58114) 2023-11-18T20:38:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.013+0000 7f99814e2640 1 -- 172.21.15.132:0/3561421541 learned_addr learned my addr 172.21.15.132:0/3561421541 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.013+0000 7f99814e2640 1 -- 172.21.15.132:0/3561421541 >> v2:172.21.15.161:3300/0 conn(0x7f997c0c3ea0 msgr2=0x7f997c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.013+0000 7f99814e2640 1 --2- 172.21.15.132:0/3561421541 >> v2:172.21.15.161:3300/0 conn(0x7f997c0c3ea0 0x7f997c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.013+0000 7f99814e2640 1 -- 172.21.15.132:0/3561421541 >> v1:172.21.15.161:6789/0 conn(0x7f997c14fd30 legacy=0x7f997c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.013+0000 7f99814e2640 1 -- 172.21.15.132:0/3561421541 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c0c61c0 con 0x7f997c06d0a0 2023-11-18T20:38:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.014+0000 7f99814e2640 1 --2- 172.21.15.132:0/3561421541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c06d0a0 0x7f997c152f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f997c06e430 tx=0x7f996c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6e5715ce761f3c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.015+0000 7f9980ce1640 1 -- 172.21.15.132:0/3561421541 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c031870 con 0x7f997c06d0a0 2023-11-18T20:38:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.015+0000 7f9980ce1640 1 -- 172.21.15.132:0/3561421541 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c0319d0 con 0x7f997c06d0a0 2023-11-18T20:38:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.015+0000 7f9980ce1640 1 -- 172.21.15.132:0/3561421541 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c031d60 con 0x7f997c06d0a0 2023-11-18T20:38:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.015+0000 7f9983f47640 1 -- 172.21.15.132:0/3561421541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c06d0a0 msgr2=0x7f997c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.015+0000 7f9983f47640 1 --2- 172.21.15.132:0/3561421541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c06d0a0 0x7f997c152f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f997c06e430 tx=0x7f996c02b910 comp rx=0 tx=0).stop 2023-11-18T20:38:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.016+0000 7f9983f47640 1 -- 172.21.15.132:0/3561421541 shutdown_connections 2023-11-18T20:38:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.016+0000 7f9983f47640 1 --2- 172.21.15.132:0/3561421541 >> v2:172.21.15.161:3300/0 conn(0x7f997c0c3ea0 0x7f997c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.016+0000 7f9983f47640 1 --2- 172.21.15.132:0/3561421541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c06d0a0 0x7f997c152f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.016+0000 7f9983f47640 1 -- 172.21.15.132:0/3561421541 >> 172.21.15.132:0/3561421541 conn(0x7f997c06a500 msgr2=0x7f997c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.016+0000 7f9983f47640 1 -- 172.21.15.132:0/3561421541 shutdown_connections 2023-11-18T20:38:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.016+0000 7f9983f47640 1 -- 172.21.15.132:0/3561421541 wait complete. 2023-11-18T20:38:17.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.018+0000 7f9983f47640 1 Processor -- start 2023-11-18T20:38:17.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.018+0000 7f9983f47640 1 -- start start 2023-11-18T20:38:17.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f9983f47640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997c06d0a0 0x7f997c1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f9983f47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c0c3ea0 0x7f997c1eba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f9983f47640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f997c14fd30 0x7f997c155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f9983f47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c153c50 con 0x7f997c0c3ea0 2023-11-18T20:38:17.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f9983f47640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c14edd0 con 0x7f997c06d0a0 2023-11-18T20:38:17.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f9983f47640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997c14f2a0 con 0x7f997c14fd30 2023-11-18T20:38:17.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f99814e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c0c3ea0 0x7f997c1eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f99814e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c0c3ea0 0x7f997c1eba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58122/0 (socket says 172.21.15.132:58122) 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.019+0000 7f99814e2640 1 -- 172.21.15.132:0/930321955 learned_addr learned my addr 172.21.15.132:0/930321955 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f9981ce3640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997c06d0a0 0x7f997c1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99824e4640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f997c14fd30 0x7f997c155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99814e2640 1 -- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f997c14fd30 msgr2=0x7f997c155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99814e2640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f997c14fd30 0x7f997c155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99814e2640 1 -- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997c06d0a0 msgr2=0x7f997c1540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99814e2640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997c06d0a0 0x7f997c1540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99814e2640 1 -- 172.21.15.132:0/930321955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c0094d0 con 0x7f997c0c3ea0 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f9981ce3640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997c06d0a0 0x7f997c1540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:17.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99814e2640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c0c3ea0 0x7f997c1eba50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f996c000c00 tx=0x7f996c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99727fc640 1 -- 172.21.15.132:0/930321955 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c03ad10 con 0x7f997c0c3ea0 2023-11-18T20:38:17.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99727fc640 1 -- 172.21.15.132:0/930321955 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c03ae70 con 0x7f997c0c3ea0 2023-11-18T20:38:17.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f99727fc640 1 -- 172.21.15.132:0/930321955 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c044610 con 0x7f997c0c3ea0 2023-11-18T20:38:17.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.020+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997c14efc0 con 0x7f997c0c3ea0 2023-11-18T20:38:17.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.021+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c1ec570 con 0x7f997c0c3ea0 2023-11-18T20:38:17.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.022+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997c153dc0 con 0x7f997c0c3ea0 2023-11-18T20:38:17.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.023+0000 7f99727fc640 1 -- 172.21.15.132:0/930321955 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f996c04d450 con 0x7f997c0c3ea0 2023-11-18T20:38:17.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.024+0000 7f99727fc640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f996006ae40 0x7f996006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.024+0000 7f99727fc640 1 -- 172.21.15.132:0/930321955 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f996c02d040 con 0x7f997c0c3ea0 2023-11-18T20:38:17.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.025+0000 7f9981ce3640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f996006ae40 0x7f996006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.025+0000 7f9981ce3640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f996006ae40 0x7f996006d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9978003eb0 tx=0x7f9978009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.028+0000 7f99727fc640 1 -- 172.21.15.132:0/930321955 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f996c076d80 con 0x7f997c0c3ea0 2023-11-18T20:38:17.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.253+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f997c068350 con 0x7f997c0c3ea0 2023-11-18T20:38:17.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.254+0000 7f99727fc640 1 -- 172.21.15.132:0/930321955 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f996c07a3a0 con 0x7f997c0c3ea0 2023-11-18T20:38:17.256 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:17.256 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:37:58.599151+0000","modified":"2023-11-18T20:38:01.664198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T20:38:17.256 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.257+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f996006ae40 msgr2=0x7f996006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.257+0000 7f9983f47640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f996006ae40 0x7f996006d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9978003eb0 tx=0x7f9978009040 comp rx=0 tx=0).stop 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.257+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c0c3ea0 msgr2=0x7f997c1eba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.257+0000 7f9983f47640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c0c3ea0 0x7f997c1eba50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f996c000c00 tx=0x7f996c0046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.258+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 shutdown_connections 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.258+0000 7f9983f47640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f996006ae40 0x7f996006d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.258+0000 7f9983f47640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f997c14fd30 0x7f997c155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.258+0000 7f9983f47640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997c0c3ea0 0x7f997c1eba50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.258+0000 7f9983f47640 1 --2- 172.21.15.132:0/930321955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997c06d0a0 0x7f997c1540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.258+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 >> 172.21.15.132:0/930321955 conn(0x7f997c06a500 msgr2=0x7f997c0c2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:17.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.258+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 shutdown_connections 2023-11-18T20:38:17.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.258+0000 7f9983f47640 1 -- 172.21.15.132:0/930321955 wait complete. 2023-11-18T20:38:17.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:17.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.490+0000 7fe4ce1b3640 1 Processor -- start 2023-11-18T20:38:17.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.490+0000 7fe4ce1b3640 1 -- start start 2023-11-18T20:38:17.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.491+0000 7fe4ce1b3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c814c2e0 0x7fe4c80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.491+0000 7fe4ce1b3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe4c8072310 0x7fe4c80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.491+0000 7fe4ce1b3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c8071e80 con 0x7fe4c80c0440 2023-11-18T20:38:17.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.491+0000 7fe4ce1b3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c8071470 con 0x7fe4c8072310 2023-11-18T20:38:17.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.491+0000 7fe4ce1b3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c814c6c0 con 0x7fe4c814c2e0 2023-11-18T20:38:17.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4cd9b2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe4c8072310 0x7fe4c80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4cc9b0640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe4c80c0440 0x7fe4c8152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48786/0 (socket says 172.21.15.132:48786) 2023-11-18T20:38:17.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4cc9b0640 1 -- 172.21.15.132:0/1508437781 learned_addr learned my addr 172.21.15.132:0/1508437781 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:17.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4cd1b1640 1 --2- 172.21.15.132:0/1508437781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c814c2e0 0x7fe4c80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4cd9b2640 1 -- 172.21.15.132:0/1508437781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c814c2e0 msgr2=0x7fe4c80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:17.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4cd9b2640 1 --2- 172.21.15.132:0/1508437781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c814c2e0 0x7fe4c80c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4cd9b2640 1 -- 172.21.15.132:0/1508437781 >> v1:172.21.15.132:6789/0 conn(0x7fe4c80c0440 legacy=0x7fe4c8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4cd9b2640 1 -- 172.21.15.132:0/1508437781 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c806fdc0 con 0x7fe4c8072310 2023-11-18T20:38:17.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.492+0000 7fe4bffff640 1 -- 172.21.15.132:0/1508437781 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695201946 0 0) 0x7fe4c8071e80 con 0x7fe4c80c0440 2023-11-18T20:38:17.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.493+0000 7fe4cd9b2640 1 --2- 172.21.15.132:0/1508437781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80a4d20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009d90 tx=0x7fe4c002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c169903aed54f74a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.493+0000 7fe4bffff640 1 -- 172.21.15.132:0/1508437781 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c002cb30 con 0x7fe4c8072310 2023-11-18T20:38:17.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.493+0000 7fe4bffff640 1 -- 172.21.15.132:0/1508437781 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c002cc90 con 0x7fe4c8072310 2023-11-18T20:38:17.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4bffff640 1 -- 172.21.15.132:0/1508437781 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0034440 con 0x7fe4c8072310 2023-11-18T20:38:17.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/1508437781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 msgr2=0x7fe4c80a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/1508437781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80a4d20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009d90 tx=0x7fe4c002bd80 comp rx=0 tx=0).stop 2023-11-18T20:38:17.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/1508437781 shutdown_connections 2023-11-18T20:38:17.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/1508437781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80a4d20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/1508437781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c814c2e0 0x7fe4c80c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/1508437781 >> 172.21.15.132:0/1508437781 conn(0x7fe4c80a77f0 msgr2=0x7fe4c80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:17.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/1508437781 shutdown_connections 2023-11-18T20:38:17.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.494+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/1508437781 wait complete. 2023-11-18T20:38:17.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.496+0000 7fe4ce1b3640 1 Processor -- start 2023-11-18T20:38:17.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.496+0000 7fe4ce1b3640 1 -- start start 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4ce1b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4ce1b3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c80c0440 0x7fe4c81ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4ce1b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4c814c2e0 0x7fe4c81e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4ce1b3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c81e99e0 con 0x7fe4c8072310 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4ce1b3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c81e9bd0 con 0x7fe4c814c2e0 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4ce1b3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c806c9a0 con 0x7fe4c80c0440 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4cd1b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4cd1b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80bf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58132/0 (socket says 172.21.15.132:58132) 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.497+0000 7fe4cd1b1640 1 -- 172.21.15.132:0/418564537 learned_addr learned my addr 172.21.15.132:0/418564537 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4cd1b1640 1 -- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c80c0440 msgr2=0x7fe4c81ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4cd1b1640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c80c0440 0x7fe4c81ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4cd9b2640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4c814c2e0 0x7fe4c81e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4cd1b1640 1 -- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4c814c2e0 msgr2=0x7fe4c81e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4cd1b1640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4c814c2e0 0x7fe4c81e6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4cd1b1640 1 -- 172.21.15.132:0/418564537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0009a70 con 0x7fe4c8072310 2023-11-18T20:38:17.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4cd1b1640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80bf0e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c7f0 tx=0x7fe4c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4bdffb640 1 -- 172.21.15.132:0/418564537 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4004220 con 0x7fe4c8072310 2023-11-18T20:38:17.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4bdffb640 1 -- 172.21.15.132:0/418564537 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c4004380 con 0x7fe4c8072310 2023-11-18T20:38:17.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c806cc80 con 0x7fe4c8072310 2023-11-18T20:38:17.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4bdffb640 1 -- 172.21.15.132:0/418564537 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4007840 con 0x7fe4c8072310 2023-11-18T20:38:17.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.498+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c80bfa70 con 0x7fe4c8072310 2023-11-18T20:38:17.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.499+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c804e840 con 0x7fe4c8072310 2023-11-18T20:38:17.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.500+0000 7fe4bdffb640 1 -- 172.21.15.132:0/418564537 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4c4007bb0 con 0x7fe4c8072310 2023-11-18T20:38:17.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.501+0000 7fe4bdffb640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe4ac06ae40 0x7fe4ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.501+0000 7fe4bdffb640 1 -- 172.21.15.132:0/418564537 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4c40894e0 con 0x7fe4c8072310 2023-11-18T20:38:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.502+0000 7fe4cc9b0640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe4ac06ae40 0x7fe4ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.503+0000 7fe4cc9b0640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe4ac06ae40 0x7fe4ac06d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8007fd0 tx=0x7fe4b8007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.505+0000 7fe4bdffb640 1 -- 172.21.15.132:0/418564537 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4c4054620 con 0x7fe4c8072310 2023-11-18T20:38:17.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.698+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4c80c5380 con 0x7fe4c8072310 2023-11-18T20:38:17.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.701+0000 7fe4bdffb640 1 -- 172.21.15.132:0/418564537 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fe4c405e020 con 0x7fe4c8072310 2023-11-18T20:38:17.702 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:17.702 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:17.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe4ac06ae40 msgr2=0x7fe4ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe4ac06ae40 0x7fe4ac06d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8007fd0 tx=0x7fe4b8007920 comp rx=0 tx=0).stop 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 msgr2=0x7fe4c80bf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80bf0e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c7f0 tx=0x7fe4c400ccb0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 shutdown_connections 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe4ac06ae40 0x7fe4ac06d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4c814c2e0 0x7fe4c81e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4c80c0440 0x7fe4c81ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 --2- 172.21.15.132:0/418564537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c8072310 0x7fe4c80bf0e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 >> 172.21.15.132:0/418564537 conn(0x7fe4c80a77f0 msgr2=0x7fe4c80c44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 shutdown_connections 2023-11-18T20:38:17.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.703+0000 7fe4ce1b3640 1 -- 172.21.15.132:0/418564537 wait complete. 2023-11-18T20:38:17.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:17.725 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:17.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.928+0000 7fdb80e75640 1 Processor -- start 2023-11-18T20:38:17.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.928+0000 7fdb80e75640 1 -- start start 2023-11-18T20:38:17.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.929+0000 7fdb80e75640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 0x7fdb7c154500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.929+0000 7fdb80e75640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb7c0724f0 0x7fdb7c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.929+0000 7fdb80e75640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0aadc0 con 0x7fdb7c0a5240 2023-11-18T20:38:17.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.929+0000 7fdb80e75640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c151be0 con 0x7fdb7c0724f0 2023-11-18T20:38:17.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.929+0000 7fdb80e75640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0c4170 con 0x7fdb7c0c3bc0 2023-11-18T20:38:17.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.930+0000 7fdb7ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb7c0724f0 0x7fdb7c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.930+0000 7fdb7ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb7c0724f0 0x7fdb7c154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58138/0 (socket says 172.21.15.132:58138) 2023-11-18T20:38:17.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.930+0000 7fdb7ad9d640 1 -- 172.21.15.132:0/4279808544 learned_addr learned my addr 172.21.15.132:0/4279808544 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:17.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.930+0000 7fdb73fff640 1 --2- 172.21.15.132:0/4279808544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 0x7fdb7c154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.930+0000 7fdb7ad9d640 1 -- 172.21.15.132:0/4279808544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 msgr2=0x7fdb7c154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:17.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.930+0000 7fdb7ad9d640 1 --2- 172.21.15.132:0/4279808544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 0x7fdb7c154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.930+0000 7fdb7ad9d640 1 -- 172.21.15.132:0/4279808544 >> v1:172.21.15.161:6789/0 conn(0x7fdb7c0a5240 legacy=0x7fdb7c0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:17.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.930+0000 7fdb7ad9d640 1 -- 172.21.15.132:0/4279808544 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0c4450 con 0x7fdb7c0724f0 2023-11-18T20:38:17.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.931+0000 7fdb7ad9d640 1 --2- 172.21.15.132:0/4279808544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0724f0 0x7fdb7c154a40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009e50 tx=0x7fdb7402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9709f083c0b809 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb79d9b640 1 -- 172.21.15.132:0/4279808544 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7402c9f0 con 0x7fdb7c0724f0 2023-11-18T20:38:17.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb79d9b640 1 -- 172.21.15.132:0/4279808544 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7402cb50 con 0x7fdb7c0724f0 2023-11-18T20:38:17.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb79d9b640 1 -- 172.21.15.132:0/4279808544 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740343f0 con 0x7fdb7c0724f0 2023-11-18T20:38:17.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb80e75640 1 -- 172.21.15.132:0/4279808544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0724f0 msgr2=0x7fdb7c154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb80e75640 1 --2- 172.21.15.132:0/4279808544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0724f0 0x7fdb7c154a40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009e50 tx=0x7fdb7402be50 comp rx=0 tx=0).stop 2023-11-18T20:38:17.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb80e75640 1 -- 172.21.15.132:0/4279808544 shutdown_connections 2023-11-18T20:38:17.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb80e75640 1 --2- 172.21.15.132:0/4279808544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0724f0 0x7fdb7c154a40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb80e75640 1 --2- 172.21.15.132:0/4279808544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 0x7fdb7c154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb80e75640 1 -- 172.21.15.132:0/4279808544 >> 172.21.15.132:0/4279808544 conn(0x7fdb7c06a500 msgr2=0x7fdb7c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:17.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb80e75640 1 -- 172.21.15.132:0/4279808544 shutdown_connections 2023-11-18T20:38:17.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.932+0000 7fdb80e75640 1 -- 172.21.15.132:0/4279808544 wait complete. 2023-11-18T20:38:17.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.934+0000 7fdb80e75640 1 Processor -- start 2023-11-18T20:38:17.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.934+0000 7fdb80e75640 1 -- start start 2023-11-18T20:38:17.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.935+0000 7fdb80e75640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb7c0724f0 0x7fdb7c1ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.935+0000 7fdb80e75640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0a5240 0x7fdb7c1dba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.935+0000 7fdb80e75640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 0x7fdb7c1ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.935+0000 7fdb80e75640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c072170 con 0x7fdb7c0a5240 2023-11-18T20:38:17.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.935+0000 7fdb80e75640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0718d0 con 0x7fdb7c0724f0 2023-11-18T20:38:17.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.935+0000 7fdb80e75640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c071bb0 con 0x7fdb7c0c3bc0 2023-11-18T20:38:17.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.935+0000 7fdb73fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0a5240 0x7fdb7c1dba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb73fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0a5240 0x7fdb7c1dba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58154/0 (socket says 172.21.15.132:58154) 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb73fff640 1 -- 172.21.15.132:0/3291960984 learned_addr learned my addr 172.21.15.132:0/3291960984 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb7a59c640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb7c0724f0 0x7fdb7c1ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb7ad9d640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 0x7fdb7c1ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb73fff640 1 -- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 msgr2=0x7fdb7c1ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb73fff640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 0x7fdb7c1ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb73fff640 1 -- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb7c0724f0 msgr2=0x7fdb7c1ea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb73fff640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb7c0724f0 0x7fdb7c1ea5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:17.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb73fff640 1 -- 172.21.15.132:0/3291960984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74009b30 con 0x7fdb7c0a5240 2023-11-18T20:38:17.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.936+0000 7fdb73fff640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0a5240 0x7fdb7c1dba70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c7f0 tx=0x7fdb6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.937+0000 7fdb72ffd640 1 -- 172.21.15.132:0/3291960984 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64004220 con 0x7fdb7c0a5240 2023-11-18T20:38:17.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.937+0000 7fdb72ffd640 1 -- 172.21.15.132:0/3291960984 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64004380 con 0x7fdb7c0a5240 2023-11-18T20:38:17.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.937+0000 7fdb72ffd640 1 -- 172.21.15.132:0/3291960984 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64007840 con 0x7fdb7c0a5240 2023-11-18T20:38:17.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.937+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c071e90 con 0x7fdb7c0a5240 2023-11-18T20:38:17.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.937+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c0a77d0 con 0x7fdb7c0a5240 2023-11-18T20:38:17.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.938+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c1ed6d0 con 0x7fdb7c0a5240 2023-11-18T20:38:17.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.939+0000 7fdb72ffd640 1 -- 172.21.15.132:0/3291960984 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb64007bb0 con 0x7fdb7c0a5240 2023-11-18T20:38:17.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.940+0000 7fdb72ffd640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdb5c06ae40 0x7fdb5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:17.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.940+0000 7fdb72ffd640 1 -- 172.21.15.132:0/3291960984 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb64089470 con 0x7fdb7c0a5240 2023-11-18T20:38:17.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.941+0000 7fdb7a59c640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdb5c06ae40 0x7fdb5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:17.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.942+0000 7fdb7a59c640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdb5c06ae40 0x7fdb5c06d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c1e7c30 tx=0x7fdb6c007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:17.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:17.945+0000 7fdb72ffd640 1 -- 172.21.15.132:0/3291960984 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb7c1ed6d0 con 0x7fdb7c0a5240 2023-11-18T20:38:18.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.137+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb7c1ed6d0 con 0x7fdb7c0a5240 2023-11-18T20:38:18.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.138+0000 7fdb72ffd640 1 -- 172.21.15.132:0/3291960984 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb6401e020 con 0x7fdb7c0a5240 2023-11-18T20:38:18.139 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdb5c06ae40 msgr2=0x7fdb5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdb5c06ae40 0x7fdb5c06d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c1e7c30 tx=0x7fdb6c007e30 comp rx=0 tx=0).stop 2023-11-18T20:38:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0a5240 msgr2=0x7fdb7c1dba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0a5240 0x7fdb7c1dba70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c7f0 tx=0x7fdb6400ccb0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 shutdown_connections 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdb5c06ae40 0x7fdb5c06d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb7c0c3bc0 0x7fdb7c1ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c0a5240 0x7fdb7c1dba70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 --2- 172.21.15.132:0/3291960984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb7c0724f0 0x7fdb7c1ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 >> 172.21.15.132:0/3291960984 conn(0x7fdb7c06a500 msgr2=0x7fdb7c154400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 shutdown_connections 2023-11-18T20:38:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.141+0000 7fdb80e75640 1 -- 172.21.15.132:0/3291960984 wait complete. 2023-11-18T20:38:18.160 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:18.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.375+0000 7f32fc6cf640 1 Processor -- start 2023-11-18T20:38:18.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.376+0000 7f32fc6cf640 1 -- start start 2023-11-18T20:38:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.377+0000 7f32fc6cf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32f414fc20 0x7f32f40c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.377+0000 7f32fc6cf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.377+0000 7f32fc6cf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f4150000 con 0x7f32f4072320 2023-11-18T20:38:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.377+0000 7f32fc6cf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f4156800 con 0x7f32f414fc20 2023-11-18T20:38:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.377+0000 7f32fc6cf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4155bf0 con 0x7f32f4152560 2023-11-18T20:38:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.378+0000 7f32fac6c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.378+0000 7f32f9c6a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f32f4072320 0x7f32f406f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:55510/0 (socket says 172.21.15.132:55510) 2023-11-18T20:38:18.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.378+0000 7f32fac6c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:48460/0 (socket says 172.21.15.132:48460) 2023-11-18T20:38:18.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.378+0000 7f32f9c6a640 1 -- 172.21.15.132:0/1939598909 learned_addr learned my addr 172.21.15.132:0/1939598909 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:18.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.378+0000 7f32fa46b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32f414fc20 0x7f32f40c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.378+0000 7f32f9469640 1 -- 172.21.15.132:0/1939598909 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256091032 0 0) 0x7f32e0001110 con 0x7f32f4072320 2023-11-18T20:38:18.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.379+0000 7f32f9469640 1 -- 172.21.15.132:0/1939598909 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e4003520 con 0x7f32f4072320 2023-11-18T20:38:18.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.379+0000 7f32fa46b640 1 -- 172.21.15.132:0/1939598909 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 msgr2=0x7f32f41529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:18.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.379+0000 7f32fa46b640 1 --2- 172.21.15.132:0/1939598909 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.379+0000 7f32fa46b640 1 -- 172.21.15.132:0/1939598909 >> v1:172.21.15.161:6789/0 conn(0x7f32f4072320 legacy=0x7f32f406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.379+0000 7f32fa46b640 1 -- 172.21.15.132:0/1939598909 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4155ed0 con 0x7f32f414fc20 2023-11-18T20:38:18.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.379+0000 7f32fac6c640 1 --2- 172.21.15.132:0/1939598909 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:38:18.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.380+0000 7f32fa46b640 1 --2- 172.21.15.132:0/1939598909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 0x7f32f40c1970 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009d90 tx=0x7f32e802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a9e7e94ec978516 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.381+0000 7f32f9469640 1 -- 172.21.15.132:0/1939598909 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e802cbc0 con 0x7f32f414fc20 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.381+0000 7f32f9469640 1 -- 172.21.15.132:0/1939598909 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e802cd20 con 0x7f32f414fc20 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.381+0000 7f32f9469640 1 -- 172.21.15.132:0/1939598909 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8034660 con 0x7f32f414fc20 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.381+0000 7f32fc6cf640 1 -- 172.21.15.132:0/1939598909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 msgr2=0x7f32f40c1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.381+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/1939598909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 0x7f32f40c1970 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009d90 tx=0x7f32e802be10 comp rx=0 tx=0).stop 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.382+0000 7f32fc6cf640 1 -- 172.21.15.132:0/1939598909 shutdown_connections 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.382+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/1939598909 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.382+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/1939598909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 0x7f32f40c1970 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.382+0000 7f32fc6cf640 1 -- 172.21.15.132:0/1939598909 >> 172.21.15.132:0/1939598909 conn(0x7f32f40c39e0 msgr2=0x7f32f40c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:18.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.382+0000 7f32fc6cf640 1 -- 172.21.15.132:0/1939598909 shutdown_connections 2023-11-18T20:38:18.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.382+0000 7f32fc6cf640 1 -- 172.21.15.132:0/1939598909 wait complete. 2023-11-18T20:38:18.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.383+0000 7f32fc6cf640 1 Processor -- start 2023-11-18T20:38:18.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.383+0000 7f32fc6cf640 1 -- start start 2023-11-18T20:38:18.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.384+0000 7f32fc6cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32f4072320 0x7f32f414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.384+0000 7f32fc6cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 0x7f32f41e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.384+0000 7f32fc6cf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41ea460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.384+0000 7f32fc6cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f41edea0 con 0x7f32f4072320 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.384+0000 7f32fc6cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4153b60 con 0x7f32f414fc20 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.384+0000 7f32fc6cf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4153e40 con 0x7f32f4152560 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32f4072320 0x7f32f414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32f4072320 0x7f32f414ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58164/0 (socket says 172.21.15.132:58164) 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 -- 172.21.15.132:0/4264055189 learned_addr learned my addr 172.21.15.132:0/4264055189 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32f9c6a640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 0x7f32f41e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fac6c640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 -- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 msgr2=0x7f32f41ea460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41ea460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 -- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 msgr2=0x7f32f41e9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 0x7f32f41e9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 -- 172.21.15.132:0/4264055189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec009400 con 0x7f32f4072320 2023-11-18T20:38:18.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fac6c640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:18.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.385+0000 7f32fa46b640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32f4072320 0x7f32f414ca10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009d90 tx=0x7f32e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:18.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.386+0000 7f32f2ffd640 1 -- 172.21.15.132:0/4264055189 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8040650 con 0x7f32f4072320 2023-11-18T20:38:18.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.386+0000 7f32f2ffd640 1 -- 172.21.15.132:0/4264055189 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e802ce90 con 0x7f32f4072320 2023-11-18T20:38:18.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.386+0000 7f32f2ffd640 1 -- 172.21.15.132:0/4264055189 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e80409f0 con 0x7f32f4072320 2023-11-18T20:38:18.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.386+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e8009a70 con 0x7f32f4072320 2023-11-18T20:38:18.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.386+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f414cf50 con 0x7f32f4072320 2023-11-18T20:38:18.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.387+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f404e840 con 0x7f32f4072320 2023-11-18T20:38:18.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.388+0000 7f32f2ffd640 1 -- 172.21.15.132:0/4264055189 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32e8040b50 con 0x7f32f4072320 2023-11-18T20:38:18.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.389+0000 7f32f2ffd640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32d806ae40 0x7f32d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.389+0000 7f32f2ffd640 1 -- 172.21.15.132:0/4264055189 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32e80ac2d0 con 0x7f32f4072320 2023-11-18T20:38:18.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.390+0000 7f32f9c6a640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32d806ae40 0x7f32d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.391+0000 7f32f9c6a640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32d806ae40 0x7f32d806d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f32f40a9660 tx=0x7f32e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:18.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.394+0000 7f32f2ffd640 1 -- 172.21.15.132:0/4264055189 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32e80773a0 con 0x7f32f4072320 2023-11-18T20:38:18.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.585+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32f40c08b0 con 0x7f32f4072320 2023-11-18T20:38:18.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.586+0000 7f32f2ffd640 1 -- 172.21.15.132:0/4264055189 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32e8009450 con 0x7f32f4072320 2023-11-18T20:38:18.588 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:18.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32d806ae40 msgr2=0x7f32d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32d806ae40 0x7f32d806d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f32f40a9660 tx=0x7f32e0009040 comp rx=0 tx=0).stop 2023-11-18T20:38:18.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32f4072320 msgr2=0x7f32f414ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32f4072320 0x7f32f414ca10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009d90 tx=0x7f32e8004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 shutdown_connections 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32d806ae40 0x7f32d806d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32f4152560 0x7f32f41ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32f414fc20 0x7f32f41e9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 --2- 172.21.15.132:0/4264055189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32f4072320 0x7f32f414ca10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 >> 172.21.15.132:0/4264055189 conn(0x7f32f40c39e0 msgr2=0x7f32f40c3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 shutdown_connections 2023-11-18T20:38:18.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.589+0000 7f32fc6cf640 1 -- 172.21.15.132:0/4264055189 wait complete. 2023-11-18T20:38:18.608 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.822+0000 7f8242fe2640 1 Processor -- start 2023-11-18T20:38:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.822+0000 7f8242fe2640 1 -- start start 2023-11-18T20:38:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.824+0000 7f8242fe2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f823c152f20 0x7f823c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.824+0000 7f8242fe2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c0c64a0 con 0x7f823c06d0a0 2023-11-18T20:38:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.824+0000 7f8242fe2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c0c5c00 con 0x7f823c14fd30 2023-11-18T20:38:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.824+0000 7f8242fe2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c0c5ee0 con 0x7f823c152f20 2023-11-18T20:38:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.824+0000 7f824157f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f823c152f20 0x7f823c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.824+0000 7f823bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f823c06d0a0 0x7f823c0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54296/0 (socket says 172.21.15.132:54296) 2023-11-18T20:38:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.824+0000 7f823bfff640 1 -- 172.21.15.132:0/3693543817 learned_addr learned my addr 172.21.15.132:0/3693543817 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:18.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.825+0000 7f823b7fe640 1 -- 172.21.15.132:0/3693543817 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756252256 0 0) 0x7f823c0c64a0 con 0x7f823c06d0a0 2023-11-18T20:38:18.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.825+0000 7f824157f640 1 -- 172.21.15.132:0/3693543817 >> v1:172.21.15.161:6789/0 conn(0x7f823c14fd30 legacy=0x7f823c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.825+0000 7f824157f640 1 -- 172.21.15.132:0/3693543817 >> v1:172.21.15.132:6789/0 conn(0x7f823c06d0a0 legacy=0x7f823c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.825+0000 7f824157f640 1 -- 172.21.15.132:0/3693543817 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c0c61c0 con 0x7f823c152f20 2023-11-18T20:38:18.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.826+0000 7f824157f640 1 --2- 172.21.15.132:0/3693543817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c0c45b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8234009d90 tx=0x7f823402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ddf6c2dd71e415 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.826+0000 7f823b7fe640 1 -- 172.21.15.132:0/3693543817 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823402cd00 con 0x7f823c152f20 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.826+0000 7f823b7fe640 1 -- 172.21.15.132:0/3693543817 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823402ce60 con 0x7f823c152f20 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.826+0000 7f823b7fe640 1 -- 172.21.15.132:0/3693543817 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234034660 con 0x7f823c152f20 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.826+0000 7f8242fe2640 1 -- 172.21.15.132:0/3693543817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 msgr2=0x7f823c0c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.826+0000 7f8242fe2640 1 --2- 172.21.15.132:0/3693543817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c0c45b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8234009d90 tx=0x7f823402bf50 comp rx=0 tx=0).stop 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.827+0000 7f8242fe2640 1 -- 172.21.15.132:0/3693543817 shutdown_connections 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.827+0000 7f8242fe2640 1 --2- 172.21.15.132:0/3693543817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c0c45b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.827+0000 7f8242fe2640 1 -- 172.21.15.132:0/3693543817 >> 172.21.15.132:0/3693543817 conn(0x7f823c06a500 msgr2=0x7f823c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.827+0000 7f8242fe2640 1 -- 172.21.15.132:0/3693543817 shutdown_connections 2023-11-18T20:38:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.827+0000 7f8242fe2640 1 -- 172.21.15.132:0/3693543817 wait complete. 2023-11-18T20:38:18.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.828+0000 7f8242fe2640 1 Processor -- start 2023-11-18T20:38:18.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.829+0000 7f8242fe2640 1 -- start start 2023-11-18T20:38:18.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.829+0000 7f8242fe2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f823c06d0a0 0x7f823c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.829+0000 7f8242fe2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f823c14fd30 0x7f823c1ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.829+0000 7f8242fe2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.829+0000 7f8242fe2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0aa580 con 0x7f823c152f20 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.829+0000 7f8242fe2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c072060 con 0x7f823c14fd30 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.829+0000 7f8242fe2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c14ef80 con 0x7f823c06d0a0 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55768/0 (socket says 172.21.15.132:55768) 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 -- 172.21.15.132:0/1232868864 learned_addr learned my addr 172.21.15.132:0/1232868864 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f823bfff640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f823c14fd30 0x7f823c1ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 -- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f823c06d0a0 msgr2=0x7f823c14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f823c06d0a0 0x7f823c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 -- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f823c14fd30 msgr2=0x7f823c1ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f823c14fd30 0x7f823c1ea0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:18.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 -- 172.21.15.132:0/1232868864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8234009a70 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f823bfff640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f823c14fd30 0x7f823c1ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.830+0000 7f824157f640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c071190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8234009d90 tx=0x7f8234004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.831+0000 7f82397fa640 1 -- 172.21.15.132:0/1232868864 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823403d600 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.831+0000 7f82397fa640 1 -- 172.21.15.132:0/1232868864 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823403d780 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.831+0000 7f82397fa640 1 -- 172.21.15.132:0/1232868864 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823403db30 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.831+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c1eabc0 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.831+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c1ee110 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.832+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c068350 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.833+0000 7f82397fa640 1 -- 172.21.15.132:0/1232868864 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f823403b040 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.834+0000 7f82397fa640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f822806ae40 0x7f822806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.834+0000 7f82397fa640 1 -- 172.21.15.132:0/1232868864 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82340ab670 con 0x7f823c152f20 2023-11-18T20:38:18.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.834+0000 7f8240d7e640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f822806ae40 0x7f822806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:18.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.835+0000 7f8240d7e640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f822806ae40 0x7f822806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8230000f60 tx=0x7f82300079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:18.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:18.838+0000 7f82397fa640 1 -- 172.21.15.132:0/1232868864 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8234076710 con 0x7f823c152f20 2023-11-18T20:38:19.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.026+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f823c0c66d0 con 0x7f823c152f20 2023-11-18T20:38:19.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.027+0000 7f82397fa640 1 -- 172.21.15.132:0/1232868864 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8234079d30 con 0x7f823c152f20 2023-11-18T20:38:19.028 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:19.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f822806ae40 msgr2=0x7f822806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f822806ae40 0x7f822806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8230000f60 tx=0x7f82300079b0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 msgr2=0x7f823c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c071190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8234009d90 tx=0x7f8234004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 shutdown_connections 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f822806ae40 0x7f822806d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f823c152f20 0x7f823c071190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f823c14fd30 0x7f823c1ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 --2- 172.21.15.132:0/1232868864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f823c06d0a0 0x7f823c14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 >> 172.21.15.132:0/1232868864 conn(0x7f823c06a500 msgr2=0x7f823c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 shutdown_connections 2023-11-18T20:38:19.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.030+0000 7f8242fe2640 1 -- 172.21.15.132:0/1232868864 wait complete. 2023-11-18T20:38:19.051 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:38:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.263+0000 7f0d6af0a640 1 Processor -- start 2023-11-18T20:38:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.263+0000 7f0d6af0a640 1 -- start start 2023-11-18T20:38:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.264+0000 7f0d6af0a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 0x7f0d64152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d6af0a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0d6406d0a0 0x7f0d640a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d6af0a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d640c64a0 con 0x7f0d640a5260 2023-11-18T20:38:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d6af0a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d640c5c00 con 0x7f0d6406d0a0 2023-11-18T20:38:19.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d6af0a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640c5ee0 con 0x7f0d6414fd30 2023-11-18T20:38:19.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d694a7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0d640a5260 0x7f0d640c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54302/0 (socket says 172.21.15.132:54302) 2023-11-18T20:38:19.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d694a7640 1 -- 172.21.15.132:0/3499598262 learned_addr learned my addr 172.21.15.132:0/3499598262 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:19.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d63fff640 1 --2- 172.21.15.132:0/3499598262 >> v2:172.21.15.161:3300/0 conn(0x7f0d6406d0a0 0x7f0d640a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d68ca6640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 0x7f0d64152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643008249 0 0) 0x7f0d640c64a0 con 0x7f0d640a5260 2023-11-18T20:38:19.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.265+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d54003520 con 0x7f0d640a5260 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929561768 0 0) 0x7f0d54003520 con 0x7f0d640a5260 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 msgr2=0x7f0d64152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 0x7f0d64152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 >> v2:172.21.15.161:3300/0 conn(0x7f0d6406d0a0 msgr2=0x7f0d640a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 --2- 172.21.15.132:0/3499598262 >> v2:172.21.15.161:3300/0 conn(0x7f0d6406d0a0 0x7f0d640a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640c61c0 con 0x7f0d640a5260 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f0d5c0019f0 con 0x7f0d640a5260 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 >> v1:172.21.15.132:6789/0 conn(0x7f0d640a5260 legacy=0x7f0d640c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d540047c0 0x7f0d54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 0x7f0d54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640c5c00 con 0x7f0d54003970 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640c5ee0 con 0x7f0d540047c0 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5400b980 con 0x7f0d6414fd30 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d68ca6640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.266+0000 7f0d63fff640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d540047c0 0x7f0d54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.267+0000 7f0d694a7640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 0x7f0d54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.267+0000 7f0d68ca6640 1 -- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 msgr2=0x7f0d54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.267+0000 7f0d68ca6640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 0x7f0d54005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.267+0000 7f0d68ca6640 1 -- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d540047c0 msgr2=0x7f0d54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.267+0000 7f0d68ca6640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d540047c0 0x7f0d54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.267+0000 7f0d68ca6640 1 -- 172.21.15.132:0/3499598262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54003520 con 0x7f0d54003970 2023-11-18T20:38:19.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.267+0000 7f0d694a7640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d6414fd30 0x7f0d54005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.268+0000 7f0d68ca6640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d54003d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009ac0 tx=0x7f0d540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be571cc098e7e339 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.268+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5802c6b0 con 0x7f0d54003970 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.268+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5802c810 con 0x7f0d54003970 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.268+0000 7f0d637fe640 1 -- 172.21.15.132:0/3499598262 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5802cba0 con 0x7f0d54003970 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.269+0000 7f0d6af0a640 1 -- 172.21.15.132:0/3499598262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 msgr2=0x7f0d54003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.269+0000 7f0d6af0a640 1 --2- 172.21.15.132:0/3499598262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d54003d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009ac0 tx=0x7f0d540057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.269+0000 7f0d694a7640 1 -- 172.21.15.132:0/3499598262 reap_dead start 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.269+0000 7f0d6af0a640 1 -- 172.21.15.132:0/3499598262 shutdown_connections 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.269+0000 7f0d6af0a640 1 -- 172.21.15.132:0/3499598262 >> 172.21.15.132:0/3499598262 conn(0x7f0d6406a500 msgr2=0x7f0d6406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.269+0000 7f0d6af0a640 1 -- 172.21.15.132:0/3499598262 shutdown_connections 2023-11-18T20:38:19.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.269+0000 7f0d6af0a640 1 -- 172.21.15.132:0/3499598262 wait complete. 2023-11-18T20:38:19.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.271+0000 7f0d6af0a640 1 Processor -- start 2023-11-18T20:38:19.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.271+0000 7f0d6af0a640 1 -- start start 2023-11-18T20:38:19.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d6af0a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d640a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d6af0a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d641de660 0x7f0d6406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d6af0a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d6414d170 0x7f0d641dcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d6af0a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640724c0 con 0x7f0d54003970 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d6af0a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d641dbb70 con 0x7f0d6414d170 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d6af0a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d641dbe10 con 0x7f0d641de660 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d68ca6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d640a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d68ca6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d640a9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55794/0 (socket says 172.21.15.132:55794) 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d68ca6640 1 -- 172.21.15.132:0/96362631 learned_addr learned my addr 172.21.15.132:0/96362631 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d68ca6640 1 -- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d641de660 msgr2=0x7f0d6406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d68ca6640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d641de660 0x7f0d6406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d68ca6640 1 -- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d6414d170 msgr2=0x7f0d641dcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d68ca6640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d6414d170 0x7f0d641dcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.272+0000 7f0d68ca6640 1 -- 172.21.15.132:0/96362631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d641dc0f0 con 0x7f0d54003970 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.273+0000 7f0d68ca6640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d640a9bc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d5802c2b0 tx=0x7f0d58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.273+0000 7f0d617fa640 1 -- 172.21.15.132:0/96362631 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58003810 con 0x7f0d54003970 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.273+0000 7f0d617fa640 1 -- 172.21.15.132:0/96362631 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58003970 con 0x7f0d54003970 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.273+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d641dc3d0 con 0x7f0d54003970 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.273+0000 7f0d617fa640 1 -- 172.21.15.132:0/96362631 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58003d20 con 0x7f0d54003970 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.273+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d640702e0 con 0x7f0d54003970 2023-11-18T20:38:19.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.274+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d641dca20 con 0x7f0d54003970 2023-11-18T20:38:19.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.275+0000 7f0d617fa640 1 -- 172.21.15.132:0/96362631 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d58034440 con 0x7f0d54003970 2023-11-18T20:38:19.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.276+0000 7f0d617fa640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d4806ae40 0x7f0d4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.276+0000 7f0d617fa640 1 -- 172.21.15.132:0/96362631 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d580ab8f0 con 0x7f0d54003970 2023-11-18T20:38:19.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.277+0000 7f0d63fff640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d4806ae40 0x7f0d4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.278+0000 7f0d63fff640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d4806ae40 0x7f0d4806d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0d640c6660 tx=0x7f0d50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:19.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.281+0000 7f0d617fa640 1 -- 172.21.15.132:0/96362631 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d58076b60 con 0x7f0d54003970 2023-11-18T20:38:19.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.509+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d64068350 con 0x7f0d54003970 2023-11-18T20:38:19.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.510+0000 7f0d617fa640 1 -- 172.21.15.132:0/96362631 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f0d5804c090 con 0x7f0d54003970 2023-11-18T20:38:19.512 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:19.512 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:37:58.599151+0000","modified":"2023-11-18T20:38:01.664198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T20:38:19.512 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-11-18T20:38:19.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d4806ae40 msgr2=0x7f0d4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d4806ae40 0x7f0d4806d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0d640c6660 tx=0x7f0d50008040 comp rx=0 tx=0).stop 2023-11-18T20:38:19.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 msgr2=0x7f0d640a9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d640a9bc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d5802c2b0 tx=0x7f0d58004730 comp rx=0 tx=0).stop 2023-11-18T20:38:19.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 shutdown_connections 2023-11-18T20:38:19.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d4806ae40 0x7f0d4806d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d6414d170 0x7f0d641dcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d641de660 0x7f0d6406fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 --2- 172.21.15.132:0/96362631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d54003970 0x7f0d640a9bc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.513+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 >> 172.21.15.132:0/96362631 conn(0x7f0d6406a500 msgr2=0x7f0d6406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:19.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.514+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 shutdown_connections 2023-11-18T20:38:19.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.514+0000 7f0d6af0a640 1 -- 172.21.15.132:0/96362631 wait complete. 2023-11-18T20:38:19.533 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:19.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.745+0000 7fceb8965640 1 Processor -- start 2023-11-18T20:38:19.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.745+0000 7fceb8965640 1 -- start start 2023-11-18T20:38:19.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.746+0000 7fceb8965640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fceb4155fc0 0x7fceb4159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.746+0000 7fceb8965640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fceb40c1ca0 0x7fceb40c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb8965640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb406d580 con 0x7fceb4071e30 2023-11-18T20:38:19.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb8965640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb406dd60 con 0x7fceb4155fc0 2023-11-18T20:38:19.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb8965640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb40c6580 con 0x7fceb40c1ca0 2023-11-18T20:38:19.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fceb4155fc0 0x7fceb4159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb2d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fceb4071e30 0x7fceb415bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54314/0 (socket says 172.21.15.132:54314) 2023-11-18T20:38:19.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb2d9d640 1 -- 172.21.15.132:0/758419861 learned_addr learned my addr 172.21.15.132:0/758419861 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:19.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fcea9d9b640 1 --2- 172.21.15.132:0/758419861 >> v2:172.21.15.161:3300/0 conn(0x7fceb40c1ca0 0x7fceb40c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb1d9b640 1 -- 172.21.15.132:0/758419861 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803144482 0 0) 0x7fceb406d580 con 0x7fceb4071e30 2023-11-18T20:38:19.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb259c640 1 -- 172.21.15.132:0/758419861 >> v2:172.21.15.161:3300/0 conn(0x7fceb40c1ca0 msgr2=0x7fceb40c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:19.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb259c640 1 --2- 172.21.15.132:0/758419861 >> v2:172.21.15.161:3300/0 conn(0x7fceb40c1ca0 0x7fceb40c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb259c640 1 -- 172.21.15.132:0/758419861 >> v1:172.21.15.132:6789/0 conn(0x7fceb4071e30 legacy=0x7fceb415bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.747+0000 7fceb259c640 1 -- 172.21.15.132:0/758419861 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40726d0 con 0x7fceb4155fc0 2023-11-18T20:38:19.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.749+0000 7fceb259c640 1 --2- 172.21.15.132:0/758419861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4155fc0 0x7fceb4159470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fceb4067220 tx=0x7fcea402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf27d6e4447e7088 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:19.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.749+0000 7fceb1d9b640 1 -- 172.21.15.132:0/758419861 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea402f050 con 0x7fceb4155fc0 2023-11-18T20:38:19.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.749+0000 7fceb1d9b640 1 -- 172.21.15.132:0/758419861 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4031700 con 0x7fceb4155fc0 2023-11-18T20:38:19.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.749+0000 7fceb1d9b640 1 -- 172.21.15.132:0/758419861 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4031a90 con 0x7fceb4155fc0 2023-11-18T20:38:19.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.750+0000 7fceb8965640 1 -- 172.21.15.132:0/758419861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4155fc0 msgr2=0x7fceb4159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.750+0000 7fceb8965640 1 --2- 172.21.15.132:0/758419861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4155fc0 0x7fceb4159470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fceb4067220 tx=0x7fcea402b7a0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.750+0000 7fceb8965640 1 -- 172.21.15.132:0/758419861 shutdown_connections 2023-11-18T20:38:19.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.750+0000 7fceb8965640 1 --2- 172.21.15.132:0/758419861 >> v2:172.21.15.161:3300/0 conn(0x7fceb40c1ca0 0x7fceb40c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.750+0000 7fceb8965640 1 --2- 172.21.15.132:0/758419861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4155fc0 0x7fceb4159470 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.750+0000 7fceb8965640 1 -- 172.21.15.132:0/758419861 >> 172.21.15.132:0/758419861 conn(0x7fceb406a500 msgr2=0x7fceb406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:19.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.750+0000 7fceb8965640 1 -- 172.21.15.132:0/758419861 shutdown_connections 2023-11-18T20:38:19.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.750+0000 7fceb8965640 1 -- 172.21.15.132:0/758419861 wait complete. 2023-11-18T20:38:19.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.752+0000 7fceb8965640 1 Processor -- start 2023-11-18T20:38:19.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.752+0000 7fceb8965640 1 -- start start 2023-11-18T20:38:19.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb8965640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4071e30 0x7fceb41ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb8965640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb40c1ca0 0x7fceb415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb8965640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb4155fc0 0x7fceb4151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb8965640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40bb580 con 0x7fceb4071e30 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb8965640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb41eed90 con 0x7fceb4155fc0 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb8965640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40a56a0 con 0x7fceb40c1ca0 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4071e30 0x7fceb41ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4071e30 0x7fceb41ee850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55814/0 (socket says 172.21.15.132:55814) 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb259c640 1 -- 172.21.15.132:0/4180910051 learned_addr learned my addr 172.21.15.132:0/4180910051 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb259c640 1 -- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb40c1ca0 msgr2=0x7fceb415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb259c640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb40c1ca0 0x7fceb415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb259c640 1 -- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb4155fc0 msgr2=0x7fceb4151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb259c640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb4155fc0 0x7fceb4151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.753+0000 7fceb259c640 1 -- 172.21.15.132:0/4180910051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009400 con 0x7fceb4071e30 2023-11-18T20:38:19.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.754+0000 7fceb259c640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4071e30 0x7fceb41ee850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c00 tx=0x7fcea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:19.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.754+0000 7fceab7fe640 1 -- 172.21.15.132:0/4180910051 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004030 con 0x7fceb4071e30 2023-11-18T20:38:19.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.754+0000 7fceab7fe640 1 -- 172.21.15.132:0/4180910051 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4004190 con 0x7fceb4071e30 2023-11-18T20:38:19.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.754+0000 7fceab7fe640 1 -- 172.21.15.132:0/4180910051 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004520 con 0x7fceb4071e30 2023-11-18T20:38:19.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.754+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb40a50e0 con 0x7fceb4071e30 2023-11-18T20:38:19.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.754+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb40bad80 con 0x7fceb4071e30 2023-11-18T20:38:19.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.755+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4068350 con 0x7fceb4071e30 2023-11-18T20:38:19.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.756+0000 7fceab7fe640 1 -- 172.21.15.132:0/4180910051 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcea4033930 con 0x7fceb4071e30 2023-11-18T20:38:19.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.757+0000 7fceab7fe640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fce9406ae70 0x7fce9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:19.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.758+0000 7fceab7fe640 1 -- 172.21.15.132:0/4180910051 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcea40ab6f0 con 0x7fceb4071e30 2023-11-18T20:38:19.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.758+0000 7fcea9d9b640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fce9406ae70 0x7fce9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:19.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.759+0000 7fcea9d9b640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fce9406ae70 0x7fce9406d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fceb40c3e80 tx=0x7fce9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:19.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.762+0000 7fceab7fe640 1 -- 172.21.15.132:0/4180910051 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcea4076950 con 0x7fceb4071e30 2023-11-18T20:38:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.952+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fceb406d730 con 0x7fceb4071e30 2023-11-18T20:38:19.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.953+0000 7fceab7fe640 1 -- 172.21.15.132:0/4180910051 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fcea4038090 con 0x7fceb4071e30 2023-11-18T20:38:19.955 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:19.955 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fce9406ae70 msgr2=0x7fce9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fce9406ae70 0x7fce9406d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fceb40c3e80 tx=0x7fce9c008040 comp rx=0 tx=0).stop 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4071e30 msgr2=0x7fceb41ee850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4071e30 0x7fceb41ee850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c00 tx=0x7fcea40046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 shutdown_connections 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fce9406ae70 0x7fce9406d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb4155fc0 0x7fceb4151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb40c1ca0 0x7fceb415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 --2- 172.21.15.132:0/4180910051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb4071e30 0x7fceb41ee850 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.956+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 >> 172.21.15.132:0/4180910051 conn(0x7fceb406a500 msgr2=0x7fceb40c26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.957+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 shutdown_connections 2023-11-18T20:38:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:19.957+0000 7fceb8965640 1 -- 172.21.15.132:0/4180910051 wait complete. 2023-11-18T20:38:19.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:38:20.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.187+0000 7fb4f61e9640 1 Processor -- start 2023-11-18T20:38:20.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.188+0000 7fb4f61e9640 1 -- start start 2023-11-18T20:38:20.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.189+0000 7fb4f61e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0152f20 0x7fb4f00c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:20.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.189+0000 7fb4f61e9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f00c64a0 con 0x7fb4f014fd30 2023-11-18T20:38:20.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.189+0000 7fb4f61e9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f00c5c00 con 0x7fb4f006d0a0 2023-11-18T20:38:20.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.189+0000 7fb4f61e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00c5ee0 con 0x7fb4f0152f20 2023-11-18T20:38:20.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.189+0000 7fb4ef7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb4f014fd30 0x7fb4f00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54320/0 (socket says 172.21.15.132:54320) 2023-11-18T20:38:20.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.189+0000 7fb4ef7fe640 1 -- 172.21.15.132:0/626338059 learned_addr learned my addr 172.21.15.132:0/626338059 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:20.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844661712 0 0) 0x7fb4f00c64a0 con 0x7fb4f014fd30 2023-11-18T20:38:20.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4dc003520 con 0x7fb4f014fd30 2023-11-18T20:38:20.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4effff640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0152f20 0x7fb4f00c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2456855597 0 0) 0x7fb4dc003520 con 0x7fb4f014fd30 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0152f20 msgr2=0x7fb4f00c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0152f20 0x7fb4f00c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 >> v1:172.21.15.161:6789/0 conn(0x7fb4f006d0a0 legacy=0x7fb4f00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00c61c0 con 0x7fb4f014fd30 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fb4e0001670 con 0x7fb4f014fd30 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 >> v1:172.21.15.132:6789/0 conn(0x7fb4f014fd30 legacy=0x7fb4f00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0152f20 0x7fb4dc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4dc004d00 0x7fb4dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:20.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00c5ee0 con 0x7fb4dc003fd0 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc00bb40 con 0x7fb4dc004d00 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc00bd00 con 0x7fb4f0152f20 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.190+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.191+0000 7fb4ef7fe640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0152f20 0x7fb4dc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.191+0000 7fb4effff640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4dc004d00 0x7fb4dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.191+0000 7fb4e7fff640 1 -- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0152f20 msgr2=0x7fb4dc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.191+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0152f20 0x7fb4dc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.191+0000 7fb4e7fff640 1 -- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4dc004d00 msgr2=0x7fb4dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.191+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4dc004d00 0x7fb4dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.191+0000 7fb4e7fff640 1 -- 172.21.15.132:0/626338059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc003520 con 0x7fb4dc003fd0 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.192+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4dc0047c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8001720 tx=0x7fb4dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee5d37129a3aba9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:20.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.192+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80052d0 con 0x7fb4dc003fd0 2023-11-18T20:38:20.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.192+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d802e050 con 0x7fb4dc003fd0 2023-11-18T20:38:20.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.192+0000 7fb4eeffd640 1 -- 172.21.15.132:0/626338059 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8003830 con 0x7fb4dc003fd0 2023-11-18T20:38:20.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.193+0000 7fb4f61e9640 1 -- 172.21.15.132:0/626338059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 msgr2=0x7fb4dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:20.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.193+0000 7fb4f61e9640 1 --2- 172.21.15.132:0/626338059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4dc0047c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8001720 tx=0x7fb4dc0057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.193+0000 7fb4effff640 1 -- 172.21.15.132:0/626338059 reap_dead start 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.193+0000 7fb4f61e9640 1 -- 172.21.15.132:0/626338059 shutdown_connections 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.193+0000 7fb4f61e9640 1 -- 172.21.15.132:0/626338059 >> 172.21.15.132:0/626338059 conn(0x7fb4f006a500 msgr2=0x7fb4f006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.193+0000 7fb4f61e9640 1 -- 172.21.15.132:0/626338059 shutdown_connections 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.193+0000 7fb4f61e9640 1 -- 172.21.15.132:0/626338059 wait complete. 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.195+0000 7fb4f61e9640 1 Processor -- start 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.195+0000 7fb4f61e9640 1 -- start start 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4f61e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4f0071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4f61e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0153c50 0x7fb4f01e9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4f61e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f01e9ad0 0x7fb4f014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:20.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4f61e9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01e9f50 con 0x7fb4dc003fd0 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4f61e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01dc7d0 con 0x7fb4f01e9ad0 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4f61e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01513b0 con 0x7fb4f0153c50 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4f0071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4f0071730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55838/0 (socket says 172.21.15.132:55838) 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4ef7fe640 1 -- 172.21.15.132:0/695598896 learned_addr learned my addr 172.21.15.132:0/695598896 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4ef7fe640 1 -- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0153c50 msgr2=0x7fb4f01e9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4ef7fe640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0153c50 0x7fb4f01e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4ef7fe640 1 -- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f01e9ad0 msgr2=0x7fb4f014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4ef7fe640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f01e9ad0 0x7fb4f014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.196+0000 7fb4ef7fe640 1 -- 172.21.15.132:0/695598896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f01e8f60 con 0x7fb4dc003fd0 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.197+0000 7fb4ef7fe640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4f0071730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e7f0 tx=0x7fb4e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:20.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.197+0000 7fb4ecff9640 1 -- 172.21.15.132:0/695598896 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000eea0 con 0x7fb4dc003fd0 2023-11-18T20:38:20.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.197+0000 7fb4ecff9640 1 -- 172.21.15.132:0/695598896 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e000c870 con 0x7fb4dc003fd0 2023-11-18T20:38:20.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.197+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f0151650 con 0x7fb4dc003fd0 2023-11-18T20:38:20.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.197+0000 7fb4ecff9640 1 -- 172.21.15.132:0/695598896 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000cc00 con 0x7fb4dc003fd0 2023-11-18T20:38:20.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.197+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f0151c10 con 0x7fb4dc003fd0 2023-11-18T20:38:20.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.198+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f0068350 con 0x7fb4dc003fd0 2023-11-18T20:38:20.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.199+0000 7fb4ecff9640 1 -- 172.21.15.132:0/695598896 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4e001d460 con 0x7fb4dc003fd0 2023-11-18T20:38:20.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.200+0000 7fb4ecff9640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4d006ae40 0x7fb4d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:20.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.200+0000 7fb4ecff9640 1 -- 172.21.15.132:0/695598896 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e00895e0 con 0x7fb4dc003fd0 2023-11-18T20:38:20.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.201+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4d006ae40 0x7fb4d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:20.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.202+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4d006ae40 0x7fb4d006d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8033000 tx=0x7fb4d802f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:20.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.205+0000 7fb4ecff9640 1 -- 172.21.15.132:0/695598896 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4e0054680 con 0x7fb4dc003fd0 2023-11-18T20:38:20.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.427+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4f00c66d0 con 0x7fb4dc003fd0 2023-11-18T20:38:20.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.428+0000 7fb4ecff9640 1 -- 172.21.15.132:0/695598896 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fb4e0057ca0 con 0x7fb4dc003fd0 2023-11-18T20:38:20.430 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:20.430 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:37:58.599151+0000","modified":"2023-11-18T20:38:01.664198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T20:38:20.430 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-11-18T20:38:20.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4d006ae40 msgr2=0x7fb4d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:20.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4d006ae40 0x7fb4d006d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8033000 tx=0x7fb4d802f000 comp rx=0 tx=0).stop 2023-11-18T20:38:20.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 msgr2=0x7fb4f0071730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4f0071730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e7f0 tx=0x7fb4e000ecb0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 shutdown_connections 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4d006ae40 0x7fb4d006d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f01e9ad0 0x7fb4f014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4f0153c50 0x7fb4f01e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 --2- 172.21.15.132:0/695598896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4dc003fd0 0x7fb4f0071730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 >> 172.21.15.132:0/695598896 conn(0x7fb4f006a500 msgr2=0x7fb4f00c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 shutdown_connections 2023-11-18T20:38:20.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:20.431+0000 7fb4f61e9640 1 -- 172.21.15.132:0/695598896 wait complete. 2023-11-18T20:38:20.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T20:37:58.599151+0000', 'modified': '2023-11-18T20:38:01.664198+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6837/468126248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6836', 'nonce': 468126248}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 468126248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-18T20:38:20.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T20:38:20.851 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-18T20:38:21.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.072+0000 7f7ef0946640 1 Processor -- start 2023-11-18T20:38:21.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.072+0000 7f7ef0946640 1 -- start start 2023-11-18T20:38:21.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.074+0000 7f7ef0946640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7eec0ca450 0x7f7eec0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.074+0000 7f7ef0946640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec158a60 con 0x7f7eec14e7c0 2023-11-18T20:38:21.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.074+0000 7f7ef0946640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec0c4dd0 con 0x7f7eec154580 2023-11-18T20:38:21.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.074+0000 7f7ef0946640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0c5b10 con 0x7f7eec0ca450 2023-11-18T20:38:21.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.074+0000 7f7eea59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7eec0ca450 0x7f7eec0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.074+0000 7f7eead9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7eec14e7c0 0x7f7eec0c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54328/0 (socket says 172.21.15.132:54328) 2023-11-18T20:38:21.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.074+0000 7f7eead9d640 1 -- 172.21.15.132:0/1670129189 learned_addr learned my addr 172.21.15.132:0/1670129189 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:21.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.075+0000 7f7eea59c640 1 -- 172.21.15.132:0/1670129189 >> v1:172.21.15.161:6789/0 conn(0x7f7eec154580 legacy=0x7f7eec1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.075+0000 7f7eea59c640 1 -- 172.21.15.132:0/1670129189 >> v1:172.21.15.132:6789/0 conn(0x7f7eec14e7c0 legacy=0x7f7eec0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.075+0000 7f7eea59c640 1 -- 172.21.15.132:0/1670129189 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec157ca0 con 0x7f7eec0ca450 2023-11-18T20:38:21.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.075+0000 7f7ee9d9b640 1 -- 172.21.15.132:0/1670129189 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334869167 0 0) 0x7f7eec158a60 con 0x7f7eec14e7c0 2023-11-18T20:38:21.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.076+0000 7f7eea59c640 1 --2- 172.21.15.132:0/1670129189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec0ca8d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40097a0 tx=0x7f7ed402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835f7b1ad59a7775 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.076+0000 7f7ee9d9b640 1 -- 172.21.15.132:0/1670129189 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed402f050 con 0x7f7eec0ca450 2023-11-18T20:38:21.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.076+0000 7f7ee9d9b640 1 -- 172.21.15.132:0/1670129189 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4031700 con 0x7f7eec0ca450 2023-11-18T20:38:21.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.076+0000 7f7ee9d9b640 1 -- 172.21.15.132:0/1670129189 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4031a90 con 0x7f7eec0ca450 2023-11-18T20:38:21.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.077+0000 7f7ef0946640 1 -- 172.21.15.132:0/1670129189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 msgr2=0x7f7eec0ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.077+0000 7f7ef0946640 1 --2- 172.21.15.132:0/1670129189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec0ca8d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40097a0 tx=0x7f7ed402b7a0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.077+0000 7f7ef0946640 1 -- 172.21.15.132:0/1670129189 shutdown_connections 2023-11-18T20:38:21.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.077+0000 7f7ef0946640 1 --2- 172.21.15.132:0/1670129189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec0ca8d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.077+0000 7f7ef0946640 1 -- 172.21.15.132:0/1670129189 >> 172.21.15.132:0/1670129189 conn(0x7f7eec0abf00 msgr2=0x7f7eec0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:21.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.077+0000 7f7ef0946640 1 -- 172.21.15.132:0/1670129189 shutdown_connections 2023-11-18T20:38:21.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.077+0000 7f7ef0946640 1 -- 172.21.15.132:0/1670129189 wait complete. 2023-11-18T20:38:21.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.079+0000 7f7ef0946640 1 Processor -- start 2023-11-18T20:38:21.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.079+0000 7f7ef0946640 1 -- start start 2023-11-18T20:38:21.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7ef0946640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7ef0946640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7eec14e7c0 0x7f7eec1ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7ef0946640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7eec154580 0x7f7eec156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7ef0946640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec14f480 con 0x7f7eec0ca450 2023-11-18T20:38:21.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7ef0946640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec1ead50 con 0x7f7eec154580 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7ef0946640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec14b0a0 con 0x7f7eec14e7c0 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec14ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55870/0 (socket says 172.21.15.132:55870) 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 -- 172.21.15.132:0/2970399465 learned_addr learned my addr 172.21.15.132:0/2970399465 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 -- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7eec14e7c0 msgr2=0x7f7eec1ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7eec14e7c0 0x7f7eec1ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 -- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7eec154580 msgr2=0x7f7eec156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7eec154580 0x7f7eec156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 -- 172.21.15.132:0/2970399465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009400 con 0x7f7eec0ca450 2023-11-18T20:38:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.080+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec14ef40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c430 tx=0x7f7edc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.081+0000 7f7ee37fe640 1 -- 172.21.15.132:0/2970399465 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0074e0 con 0x7f7eec0ca450 2023-11-18T20:38:21.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.081+0000 7f7ee37fe640 1 -- 172.21.15.132:0/2970399465 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc007660 con 0x7f7eec0ca450 2023-11-18T20:38:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.081+0000 7f7ee37fe640 1 -- 172.21.15.132:0/2970399465 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004a20 con 0x7f7eec0ca450 2023-11-18T20:38:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.081+0000 7f7ef0946640 1 -- 172.21.15.132:0/2970399465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec14b380 con 0x7f7eec0ca450 2023-11-18T20:38:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.081+0000 7f7ef0946640 1 -- 172.21.15.132:0/2970399465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec1ed830 con 0x7f7eec0ca450 2023-11-18T20:38:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.084+0000 7f7ee37fe640 1 -- 172.21.15.132:0/2970399465 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7edc004b80 con 0x7f7eec0ca450 2023-11-18T20:38:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.085+0000 7f7ee37fe640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7ecc06ae40 0x7f7ecc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.085+0000 7f7ee37fe640 1 -- 172.21.15.132:0/2970399465 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7edc089450 con 0x7f7eec0ca450 2023-11-18T20:38:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.085+0000 7f7ef3dba740 1 Processor -- start 2023-11-18T20:38:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.085+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7ecc06ae40 0x7f7ecc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.085+0000 7f7ef3dba740 1 -- start start 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.086+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286863a70 0x565286863e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.086+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286866d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.086+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286867280 0x565286823cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.086+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x565286787880 con 0x565286867280 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.086+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7ecc06ae40 0x7f7ecc06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4035000 tx=0x7f7ed4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.086+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x565286796ae0 con 0x565286863a70 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.086+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652867941d0 con 0x56528682a7c0 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286867280 0x565286823cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286867280 0x565286823cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55884/0 (socket says 172.21.15.132:55884) 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 -- 172.21.15.132:0/2572219649 learned_addr learned my addr 172.21.15.132:0/2572219649 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:21.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286866d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286863a70 0x565286863e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 -- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 msgr2=0x565286866d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286866d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 -- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286863a70 msgr2=0x565286863e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286863a70 0x565286863e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 -- 172.21.15.132:0/2572219649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565286757860 con 0x565286867280 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286863a70 0x565286863e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.087+0000 7f7eeb59e640 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286867280 0x565286823cb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009cd0 tx=0x7f7ee400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f083f88e0e5a4be4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ee0ff9640 1 -- 172.21.15.132:0/2572219649 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4016070 con 0x565286867280 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ee0ff9640 1 -- 172.21.15.132:0/2572219649 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee400bd40 con 0x565286867280 2023-11-18T20:38:21.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ee0ff9640 1 -- 172.21.15.132:0/2572219649 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400e070 con 0x565286867280 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2572219649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286867280 msgr2=0x565286823cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286867280 0x565286823cb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009cd0 tx=0x7f7ee400b420 comp rx=0 tx=0).stop 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2572219649 shutdown_connections 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286867280 0x565286823cb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286866d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2572219649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286863a70 0x565286863e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2572219649 >> 172.21.15.132:0/2572219649 conn(0x5652867eabb0 msgr2=0x56528684a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.088+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2572219649 shutdown_connections 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.089+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2572219649 wait complete. 2023-11-18T20:38:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.089+0000 7f7ef3dba740 1 -- start start 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.089+0000 7f7ef3dba740 1 Processor -- start 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.090+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56528682a7c0 0x565286849bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.090+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x565286863a70 0x565286878920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.090+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868472e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.090+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528678fac0 con 0x56528682a7c0 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.090+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528672c2f0 con 0x565286867280 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.090+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x565286749c70 con 0x565286863a70 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.090+0000 7f7ef3dba740 10 client.0 _ll_register_callbacks cb 0x56528674e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56528682a7c0 0x565286849bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56528682a7c0 0x565286849bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55890/0 (socket says 172.21.15.132:55890) 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 -- 172.21.15.132:0/2277547655 learned_addr learned my addr 172.21.15.132:0/2277547655 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:21.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x565286863a70 0x565286878920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eeb59e640 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 -- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x565286863a70 msgr2=0x565286878920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x565286863a70 0x565286878920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 -- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 msgr2=0x5652868472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 -- 172.21.15.132:0/2277547655 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee4009980 con 0x56528682a7c0 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eeb59e640 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56528682a7c0 0x565286849bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7edc05ff80 tx=0x7f7edc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0c8b3a1ce2d0e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7ec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2277547655 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0892b0 con 0x56528682a7c0 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2277547655 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7edc05c300 con 0x56528682a7c0 2023-11-18T20:38:21.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.091+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2277547655 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565286788aa0 con 0x56528682a7c0 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2277547655 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7edc0604b0 con 0x56528682a7c0 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ef3dba740 10 client.4650 fetch_fsmap learned FSMap version 7 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2277547655 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56528678e140 con 0x56528682a7c0 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2277547655 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565286788aa0 con 0x56528682a7c0 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2277547655 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7edc01b060 con 0x56528682a7c0 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ef3dba740 10 client.4650 fetch_fsmap finished waiting for FSMap version 7 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ef3dba740 10 client.4650 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ef3dba740 20 client.4650 populate_metadata read hostname 'smithi132' 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] conn(0x565286869f80 0x56528686a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ef3dba740 4 client.4650 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.092+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2277547655 --> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652867887c0 con 0x565286869f80 2023-11-18T20:38:21.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.093+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] conn(0x565286869f80 0x56528686a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.093+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] conn(0x565286869f80 0x56528686a380 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e85da4a71656cdc2 server_cookie=2dee2f1c28f5a481 in_seq=0 out_seq=0 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.093+0000 7f7ec9ffb640 10 client.4650 ms_handle_connect on v2:172.21.15.161:6836/468126248 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2277547655 <== mds.0 v2:172.21.15.161:6836/468126248 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5652867887c0 con 0x565286869f80 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ec9ffb640 10 client.4650 handle_command_reply: tid=0 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 client.4650 shutdown 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2277547655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56528682a7c0 msgr2=0x565286849bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56528682a7c0 0x565286849bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7edc05ff80 tx=0x7f7edc004f90 comp rx=0 tx=0).stop 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2277547655 shutdown_connections 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] conn(0x565286869f80 0x56528686a380 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x565286863a70 0x565286878920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2277547655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56528682a7c0 0x565286849bd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ec9ffb640 0 client.4650 ms_handle_reset on v2:172.21.15.161:6836/468126248 2023-11-18T20:38:21.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2277547655 >> 172.21.15.132:0/2277547655 conn(0x5652867eabb0 msgr2=0x565286864940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:21.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2277547655 shutdown_connections 2023-11-18T20:38:21.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.096+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2277547655 wait complete. 2023-11-18T20:38:21.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.097+0000 7f7ef3dba740 20 client.4650 trim_cache size 0 max 16384 2023-11-18T20:38:21.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.113+0000 7f7ef3dba740 1 Processor -- start 2023-11-18T20:38:21.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.113+0000 7f7ef3dba740 1 -- start start 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286888170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x565286865e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652864f2f20 con 0x565286863a70 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652868794f0 con 0x565286867280 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x56528681f5f0 con 0x56528682a7c0 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7eea59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x565286865e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7eea59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x565286865e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55904/0 (socket says 172.21.15.132:55904) 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.114+0000 7f7eea59c640 1 -- 172.21.15.132:0/723138385 learned_addr learned my addr 172.21.15.132:0/723138385 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7eead9d640 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286888170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7eea59c640 1 -- 172.21.15.132:0/723138385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 msgr2=0x565286888170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7eeb59e640 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7eea59c640 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286888170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7eea59c640 1 -- 172.21.15.132:0/723138385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 msgr2=0x5652868663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7eea59c640 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7eea59c640 1 -- 172.21.15.132:0/723138385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56528672bb80 con 0x565286863a70 2023-11-18T20:38:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7eea59c640 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x565286865e60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4036040 tx=0x7f7ed4031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344f7956ca11511b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7ee17fa640 1 -- 172.21.15.132:0/723138385 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed403dc80 con 0x565286863a70 2023-11-18T20:38:21.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7ee17fa640 1 -- 172.21.15.132:0/723138385 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed403dde0 con 0x565286863a70 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.115+0000 7f7ee17fa640 1 -- 172.21.15.132:0/723138385 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed404b640 con 0x565286863a70 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 -- 172.21.15.132:0/723138385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 msgr2=0x565286865e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x565286865e60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4036040 tx=0x7f7ed4031000 comp rx=0 tx=0).stop 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 -- 172.21.15.132:0/723138385 shutdown_connections 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x565286865e60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/723138385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286888170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 -- 172.21.15.132:0/723138385 >> 172.21.15.132:0/723138385 conn(0x5652867eabb0 msgr2=0x5652868499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 -- 172.21.15.132:0/723138385 shutdown_connections 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 -- 172.21.15.132:0/723138385 wait complete. 2023-11-18T20:38:21.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.116+0000 7f7ef3dba740 1 -- start start 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.117+0000 7f7ef3dba740 1 Processor -- start 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.117+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286848a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.117+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x5652868723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7ef3dba740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x565286872900 con 0x565286863a70 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x565286860cf0 con 0x565286867280 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7ef3dba740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x565286872cf0 con 0x56528682a7c0 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7ef3dba740 10 client.0 _ll_register_callbacks cb 0x7f7edc058000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x5652868723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x5652868723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55910/0 (socket says 172.21.15.132:55910) 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 -- 172.21.15.132:0/2314691963 learned_addr learned my addr 172.21.15.132:0/2314691963 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:21.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 -- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 msgr2=0x565286848a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286848a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 -- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 msgr2=0x5652868cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 -- 172.21.15.132:0/2314691963 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec157ca0 con 0x565286863a70 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7eea59c640 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x5652868723c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4036040 tx=0x7f7ed4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1597d148ee36f20 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.118+0000 7f7ec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2314691963 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4060070 con 0x565286863a70 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2314691963 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ed404bb20 con 0x565286863a70 2023-11-18T20:38:21.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2314691963 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565286829cd0 con 0x565286863a70 2023-11-18T20:38:21.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2314691963 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ed404bce0 con 0x565286863a70 2023-11-18T20:38:21.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 10 client.4656 fetch_fsmap learned FSMap version 7 2023-11-18T20:38:21.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2314691963 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x565286751170 con 0x565286863a70 2023-11-18T20:38:21.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2314691963 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565286829cd0 con 0x565286863a70 2023-11-18T20:38:21.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2314691963 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7ed4063020 con 0x565286863a70 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 10 client.4656 fetch_fsmap finished waiting for FSMap version 7 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 10 client.4656 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 20 client.4656 populate_metadata read hostname 'smithi132' 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] conn(0x565286865e60 0x565286866240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 4 client.4656 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.119+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2314691963 --> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56528685bc70 con 0x565286865e60 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.120+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] conn(0x565286865e60 0x565286866240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7eead9d640 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] conn(0x565286865e60 0x565286866240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af5dcfc7b276362 server_cookie=e6fcf77137c218bc in_seq=0 out_seq=0 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ec9ffb640 10 client.4656 ms_handle_connect on v2:172.21.15.161:6836/468126248 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ec9ffb640 1 -- 172.21.15.132:0/2314691963 <== mds.0 v2:172.21.15.161:6836/468126248 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56528685bc70 con 0x565286865e60 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ec9ffb640 10 client.4656 handle_command_reply: tid=0 2023-11-18T20:38:21.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 client.4656 shutdown 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2314691963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 msgr2=0x5652868723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x5652868723c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4036040 tx=0x7f7ed4004730 comp rx=0 tx=0).stop 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2314691963 shutdown_connections 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:6836/468126248,v1:172.21.15.161:6837/468126248] conn(0x565286865e60 0x565286866240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x565286867280 0x5652868cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x565286863a70 0x5652868723c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ec9ffb640 0 client.4656 ms_handle_reset on v2:172.21.15.161:6836/468126248 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 --2- 172.21.15.132:0/2314691963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x56528682a7c0 0x565286848a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2314691963 >> 172.21.15.132:0/2314691963 conn(0x5652867eabb0 msgr2=0x565286888170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2314691963 shutdown_connections 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.121+0000 7f7ef3dba740 1 -- 172.21.15.132:0/2314691963 wait complete. 2023-11-18T20:38:21.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef3dba740 20 client.4656 trim_cache size 0 max 16384 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "95273225-bfbe-4b9a-893d-dfaf6292d673", 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4273, 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 21.961249673000001, 2023-11-18T20:38:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 7, 2023-11-18T20:38:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 21, 2023-11-18T20:38:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 21, 2023-11-18T20:38:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 29.241678194999999 2023-11-18T20:38:21.128 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:38:21.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 -- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7ecc06ae40 msgr2=0x7f7ecc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7ecc06ae40 0x7f7ecc06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4035000 tx=0x7f7ed4030000 comp rx=0 tx=0).stop 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 -- 172.21.15.132:0/2970399465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 msgr2=0x7f7eec14ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec14ef40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c430 tx=0x7f7edc00c8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 -- 172.21.15.132:0/2970399465 shutdown_connections 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7ecc06ae40 0x7f7ecc06d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7eec154580 0x7f7eec156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7eec14e7c0 0x7f7eec1ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 --2- 172.21.15.132:0/2970399465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec0ca450 0x7f7eec14ef40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 -- 172.21.15.132:0/2970399465 >> 172.21.15.132:0/2970399465 conn(0x7f7eec0abf00 msgr2=0x7f7eec0c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 -- 172.21.15.132:0/2970399465 shutdown_connections 2023-11-18T20:38:21.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.122+0000 7f7ef0946640 1 -- 172.21.15.132:0/2970399465 wait complete. 2023-11-18T20:38:21.139 INFO:teuthology.run_tasks:Running task kclient... 2023-11-18T20:38:21.163 INFO:tasks.kclient:Mounting kernel clients... 2023-11-18T20:38:21.164 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-11-18T20:38:21.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:21.164 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:38:21.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:21.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-11-18T20:38:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2023-11-18T20:38:21.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:38:21.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:21.324 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:38:21.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:21.387 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-11-18T20:38:21.477 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-11-18T20:38:21.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:38:21.481 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-18T20:38:21.481 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T20:38:21.481 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:38:21.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:38:21.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.706+0000 7f6abd1d5640 1 Processor -- start 2023-11-18T20:38:21.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.706+0000 7f6abd1d5640 1 -- start start 2023-11-18T20:38:21.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.707+0000 7f6abd1d5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ab806d0a0 0x7f6ab8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.707+0000 7f6abd1d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab80c3ea0 0x7f6ab80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.707+0000 7f6abd1d5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab80c64a0 con 0x7f6ab814fd30 2023-11-18T20:38:21.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.707+0000 7f6abd1d5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab80c5c00 con 0x7f6ab806d0a0 2023-11-18T20:38:21.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.707+0000 7f6abd1d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab80c5ee0 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.708+0000 7f6ab759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab80c3ea0 0x7f6ab80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.708+0000 7f6ab759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab80c3ea0 0x7f6ab80c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:44596/0 (socket says 172.21.15.132:44596) 2023-11-18T20:38:21.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.708+0000 7f6ab759e640 1 -- 172.21.15.132:0/3849779675 learned_addr learned my addr 172.21.15.132:0/3849779675 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:21.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.708+0000 7f6aaffff640 1 --2- 172.21.15.132:0/3849779675 >> v2:172.21.15.161:3300/0 conn(0x7f6ab806d0a0 0x7f6ab8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.709+0000 7f6ab759e640 1 -- 172.21.15.132:0/3849779675 >> v2:172.21.15.161:3300/0 conn(0x7f6ab806d0a0 msgr2=0x7f6ab8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:21.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.709+0000 7f6ab759e640 1 --2- 172.21.15.132:0/3849779675 >> v2:172.21.15.161:3300/0 conn(0x7f6ab806d0a0 0x7f6ab8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.709+0000 7f6ab759e640 1 -- 172.21.15.132:0/3849779675 >> v1:172.21.15.161:6789/0 conn(0x7f6ab814fd30 legacy=0x7f6ab80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.709+0000 7f6ab759e640 1 -- 172.21.15.132:0/3849779675 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab80c61c0 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.710+0000 7f6ab759e640 1 --2- 172.21.15.132:0/3849779675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab80c3ea0 0x7f6ab80c4330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009e50 tx=0x7f6ab002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4436e176cd3e1c52 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.711+0000 7f6ab659c640 1 -- 172.21.15.132:0/3849779675 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab002cb00 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.711+0000 7f6ab659c640 1 -- 172.21.15.132:0/3849779675 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab002cc60 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.711+0000 7f6ab659c640 1 -- 172.21.15.132:0/3849779675 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00343f0 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.711+0000 7f6abd1d5640 1 -- 172.21.15.132:0/3849779675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab80c3ea0 msgr2=0x7f6ab80c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.711+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/3849779675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab80c3ea0 0x7f6ab80c4330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009e50 tx=0x7f6ab002bf60 comp rx=0 tx=0).stop 2023-11-18T20:38:21.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.712+0000 7f6abd1d5640 1 -- 172.21.15.132:0/3849779675 shutdown_connections 2023-11-18T20:38:21.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.712+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/3849779675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab80c3ea0 0x7f6ab80c4330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.712+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/3849779675 >> v2:172.21.15.161:3300/0 conn(0x7f6ab806d0a0 0x7f6ab8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.712+0000 7f6abd1d5640 1 -- 172.21.15.132:0/3849779675 >> 172.21.15.132:0/3849779675 conn(0x7f6ab806a500 msgr2=0x7f6ab806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:21.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.712+0000 7f6abd1d5640 1 -- 172.21.15.132:0/3849779675 shutdown_connections 2023-11-18T20:38:21.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.712+0000 7f6abd1d5640 1 -- 172.21.15.132:0/3849779675 wait complete. 2023-11-18T20:38:21.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.714+0000 7f6abd1d5640 1 Processor -- start 2023-11-18T20:38:21.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.714+0000 7f6abd1d5640 1 -- start start 2023-11-18T20:38:21.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6abd1d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab806d0a0 0x7f6ab8151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6abd1d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab80c3ea0 0x7f6ab81dd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6abd1d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ab814fd30 0x7f6ab81dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6abd1d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab81ee180 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6abd1d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab81dbf00 con 0x7f6ab814fd30 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6abd1d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab80aae50 con 0x7f6ab806d0a0 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6aaffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab80c3ea0 0x7f6ab81dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6aaffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab80c3ea0 0x7f6ab81dd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55912/0 (socket says 172.21.15.132:55912) 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.715+0000 7f6aaffff640 1 -- 172.21.15.132:0/948005247 learned_addr learned my addr 172.21.15.132:0/948005247 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6ab6d9d640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab806d0a0 0x7f6ab8151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6ab759e640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ab814fd30 0x7f6ab81dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaffff640 1 -- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab806d0a0 msgr2=0x7f6ab8151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaffff640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab806d0a0 0x7f6ab8151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaffff640 1 -- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ab814fd30 msgr2=0x7f6ab81dd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaffff640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ab814fd30 0x7f6ab81dd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaffff640 1 -- 172.21.15.132:0/948005247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab0009b30 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaffff640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab80c3ea0 0x7f6ab81dd360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000e870 tx=0x7f6aa000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaf7fe640 1 -- 172.21.15.132:0/948005247 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00094f0 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaf7fe640 1 -- 172.21.15.132:0/948005247 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa000c940 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6aaf7fe640 1 -- 172.21.15.132:0/948005247 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000ccd0 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.716+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab8071fe0 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.717+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab81ed500 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.718+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab81dd080 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.719+0000 7f6aaf7fe640 1 -- 172.21.15.132:0/948005247 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6aa0013470 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.721+0000 7f6aaf7fe640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a9806ae70 0x7f6a9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:21.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.721+0000 7f6aaf7fe640 1 -- 172.21.15.132:0/948005247 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6aa0089680 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.721+0000 7f6ab6d9d640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a9806ae70 0x7f6a9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:21.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.722+0000 7f6ab6d9d640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a9806ae70 0x7f6a9806d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80a8ab0 tx=0x7f6aa8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:21.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.726+0000 7f6aaf7fe640 1 -- 172.21.15.132:0/948005247 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ab81dd080 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.956+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ab81dd080 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.957+0000 7f6aaf7fe640 1 -- 172.21.15.132:0/948005247 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6ab81dd080 con 0x7f6ab80c3ea0 2023-11-18T20:38:21.958 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:38:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a9806ae70 msgr2=0x7f6a9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a9806ae70 0x7f6a9806d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80a8ab0 tx=0x7f6aa8009040 comp rx=0 tx=0).stop 2023-11-18T20:38:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab80c3ea0 msgr2=0x7f6ab81dd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab80c3ea0 0x7f6ab81dd360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000e870 tx=0x7f6aa000ed30 comp rx=0 tx=0).stop 2023-11-18T20:38:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 shutdown_connections 2023-11-18T20:38:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a9806ae70 0x7f6a9806d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ab814fd30 0x7f6ab81dd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab80c3ea0 0x7f6ab81dd360 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 --2- 172.21.15.132:0/948005247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ab806d0a0 0x7f6ab8151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 >> 172.21.15.132:0/948005247 conn(0x7f6ab806a500 msgr2=0x7f6ab806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 shutdown_connections 2023-11-18T20:38:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:21.960+0000 7f6abd1d5640 1 -- 172.21.15.132:0/948005247 wait complete. 2023-11-18T20:38:21.980 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T20:38:21.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:38:21.981 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-18T20:38:21.981 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-18T20:38:21.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:38:21.981 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T20:38:21.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T20:38:21.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:38:21.981 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:38:21.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:21.981 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-18T20:38:22.033 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:38:22.033 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:38:22.033 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:38:22.033 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:38:22.033 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-18T20:38:22.033 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:38:22.033 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:38:22.033 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42409sec preferred_lft 42409sec 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-18T20:38:22.034 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:38:22.035 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T20:38:22.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:22.036 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:38:22.036 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:38:22.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2023-11-18T20:38:22.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2023-11-18T20:38:22.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2023-11-18T20:38:22.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T20:38:22.036 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:38:22.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:22.503 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:38:22.589 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-18T20:38:22.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:22.594 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-18T20:38:22.647 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-18T20:38:22.647 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:38:22.647 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:38:22.647 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:38:22.647 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:38:22.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:22.648 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:38:22.648 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:38:22.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:38:22.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:38:22.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:38:22.648 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:38:23.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:23.311 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:38:23.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:23.358 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-11-18T20:38:23.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:23.450 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:38:23.450 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:38:23.451 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T20:38:23.451 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-18T20:38:23.451 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:38:23.570 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-18T20:38:23.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:23.570 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:38:23.570 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:38:23.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-18T20:38:23.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T20:38:23.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-18T20:38:23.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-18T20:38:23.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-18T20:38:23.571 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:38:23.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:23.833 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:38:23.833 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:38:23.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-18T20:38:23.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T20:38:23.834 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:38:23.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:38:23.985 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T20:38:24.029 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:38:24.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:38:24.029 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:38:24.118 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:38:24.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:24.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:38:24.297 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:38:24.297 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:38:24.297 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:38:24.742 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:38:24.743 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:38:24.743 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:38:24.743 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:38:24.743 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:38:24.781 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:38:24.781 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:38:24.781 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:38:24.781 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:38:24.782 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:38:24.782 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:38:24.782 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:38:24.782 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:38:24.786 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-18T20:38:24.787 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:38:24.787 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:38:24.787 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:38:24.787 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:38:24.790 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:38:24.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:24.791 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:38:24.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:24.889 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:38:24.964 INFO:teuthology.orchestra.run.smithi132.stdout:client4662 2023-11-18T20:38:24.964 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:38:24.965 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:38:25.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:25.023 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:38:25.099 INFO:teuthology.orchestra.run.smithi132.stdout:client4662 2023-11-18T20:38:25.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:25.099 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:38:25.176 INFO:teuthology.orchestra.run.smithi132.stdout:client4662 2023-11-18T20:38:25.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:25.177 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/95273225-bfbe-4b9a-893d-dfaf6292d673.client4662/status') 2023-11-18T20:38:25.286 INFO:teuthology.orchestra.run.smithi132.stdout:instance: client.4662 (3)192.168.0.1:0/3311738698 2023-11-18T20:38:25.287 INFO:teuthology.orchestra.run.smithi132.stdout:blocklisted: false 2023-11-18T20:38:25.287 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2023-11-18T20:38:25.287 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2023-11-18T20:38:25.287 INFO:teuthology.orchestra.run.smithi132.stderr:69 bytes copied, 6.7149e-05 s, 1.0 MB/s 2023-11-18T20:38:25.290 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-18T20:38:25.291 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T20:38:25.291 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:38:25.291 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:38:25.298 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:38:25.342 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:38:25.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.490+0000 7fd22282e640 1 Processor -- start 2023-11-18T20:38:25.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.490+0000 7fd22282e640 1 -- start start 2023-11-18T20:38:25.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22282e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd21c14e7c0 0x7fd21c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:25.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22282e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:25.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22282e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c158a60 con 0x7fd21c0ca990 2023-11-18T20:38:25.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22282e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21c0c5b10 con 0x7fd21c14e7c0 2023-11-18T20:38:25.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22282e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c157ca0 con 0x7fd21c0c4c00 2023-11-18T20:38:25.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22202d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd21c0ca990 0x7fd21c154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54340/0 (socket says 172.21.15.132:54340) 2023-11-18T20:38:25.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22202d640 1 -- 172.21.15.132:0/1585785850 learned_addr learned my addr 172.21.15.132:0/1585785850 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:25.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22102b640 1 --2- 172.21.15.132:0/1585785850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:25.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.492+0000 7fd22182c640 1 --2- 172.21.15.132:0/1585785850 >> v2:172.21.15.161:3300/0 conn(0x7fd21c14e7c0 0x7fd21c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:25.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.493+0000 7fd22082a640 1 -- 172.21.15.132:0/1585785850 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462319157 0 0) 0x7fd21c158a60 con 0x7fd21c0ca990 2023-11-18T20:38:25.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.493+0000 7fd22082a640 1 -- 172.21.15.132:0/1585785850 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd208003520 con 0x7fd21c0ca990 2023-11-18T20:38:25.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.493+0000 7fd22102b640 1 -- 172.21.15.132:0/1585785850 >> v2:172.21.15.161:3300/0 conn(0x7fd21c14e7c0 msgr2=0x7fd21c0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:25.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.493+0000 7fd22102b640 1 --2- 172.21.15.132:0/1585785850 >> v2:172.21.15.161:3300/0 conn(0x7fd21c14e7c0 0x7fd21c0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.493+0000 7fd22102b640 1 -- 172.21.15.132:0/1585785850 >> v1:172.21.15.132:6789/0 conn(0x7fd21c0ca990 legacy=0x7fd21c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:25.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.493+0000 7fd22102b640 1 -- 172.21.15.132:0/1585785850 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c157f80 con 0x7fd21c0c4c00 2023-11-18T20:38:25.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.494+0000 7fd22102b640 1 --2- 172.21.15.132:0/1585785850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0ca450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0097a0 tx=0x7fd20c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb57cc4ab4ee8e1a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:25.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22082a640 1 -- 172.21.15.132:0/1585785850 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0316f0 con 0x7fd21c0c4c00 2023-11-18T20:38:25.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22082a640 1 -- 172.21.15.132:0/1585785850 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c031850 con 0x7fd21c0c4c00 2023-11-18T20:38:25.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22082a640 1 -- 172.21.15.132:0/1585785850 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c031be0 con 0x7fd21c0c4c00 2023-11-18T20:38:25.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22282e640 1 -- 172.21.15.132:0/1585785850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 msgr2=0x7fd21c0ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:25.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22282e640 1 --2- 172.21.15.132:0/1585785850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0ca450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0097a0 tx=0x7fd20c02b790 comp rx=0 tx=0).stop 2023-11-18T20:38:25.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22282e640 1 -- 172.21.15.132:0/1585785850 shutdown_connections 2023-11-18T20:38:25.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22282e640 1 --2- 172.21.15.132:0/1585785850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0ca450 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22282e640 1 --2- 172.21.15.132:0/1585785850 >> v2:172.21.15.161:3300/0 conn(0x7fd21c14e7c0 0x7fd21c0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.495+0000 7fd22282e640 1 -- 172.21.15.132:0/1585785850 >> 172.21.15.132:0/1585785850 conn(0x7fd21c0abf00 msgr2=0x7fd21c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:25.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.496+0000 7fd22282e640 1 -- 172.21.15.132:0/1585785850 shutdown_connections 2023-11-18T20:38:25.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.496+0000 7fd22282e640 1 -- 172.21.15.132:0/1585785850 wait complete. 2023-11-18T20:38:25.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.497+0000 7fd22282e640 1 Processor -- start 2023-11-18T20:38:25.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.497+0000 7fd22282e640 1 -- start start 2023-11-18T20:38:25.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.498+0000 7fd22282e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.498+0000 7fd22282e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0ca990 0x7fd21c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.498+0000 7fd22282e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21c14e7c0 0x7fd21c1ebb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.498+0000 7fd22282e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c1eb670 con 0x7fd21c14e7c0 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.498+0000 7fd22282e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0be620 con 0x7fd21c0ca990 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.498+0000 7fd22282e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c1ead40 con 0x7fd21c0c4c00 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21c14e7c0 0x7fd21c1ebb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21c14e7c0 0x7fd21c1ebb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55914/0 (socket says 172.21.15.132:55914) 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 -- 172.21.15.132:0/1427149021 learned_addr learned my addr 172.21.15.132:0/1427149021 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22182c640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:25.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22102b640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0ca990 0x7fd21c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 -- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 msgr2=0x7fd21c0bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0bdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 -- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0ca990 msgr2=0x7fd21c156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0ca990 0x7fd21c156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 -- 172.21.15.132:0/1427149021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c009400 con 0x7fd21c14e7c0 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22182c640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.499+0000 7fd22202d640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21c14e7c0 0x7fd21c1ebb00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd21400cb40 tx=0x7fd21400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.500+0000 7fd2127fc640 1 -- 172.21.15.132:0/1427149021 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400aca0 con 0x7fd21c14e7c0 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.500+0000 7fd2127fc640 1 -- 172.21.15.132:0/1427149021 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400ae00 con 0x7fd21c14e7c0 2023-11-18T20:38:25.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.500+0000 7fd2127fc640 1 -- 172.21.15.132:0/1427149021 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214012620 con 0x7fd21c14e7c0 2023-11-18T20:38:25.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.500+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c1eb020 con 0x7fd21c14e7c0 2023-11-18T20:38:25.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.500+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c1570b0 con 0x7fd21c14e7c0 2023-11-18T20:38:25.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.501+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c1eb820 con 0x7fd21c14e7c0 2023-11-18T20:38:25.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.502+0000 7fd2127fc640 1 -- 172.21.15.132:0/1427149021 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd214007070 con 0x7fd21c14e7c0 2023-11-18T20:38:25.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.503+0000 7fd2127fc640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd20006ae40 0x7fd20006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:25.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.503+0000 7fd2127fc640 1 -- 172.21.15.132:0/1427149021 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd214089670 con 0x7fd21c14e7c0 2023-11-18T20:38:25.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.504+0000 7fd22182c640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd20006ae40 0x7fd20006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:25.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.505+0000 7fd22182c640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd20006ae40 0x7fd20006d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd218009af0 tx=0x7fd218008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:25.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.508+0000 7fd2127fc640 1 -- 172.21.15.132:0/1427149021 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd21c1eb820 con 0x7fd21c14e7c0 2023-11-18T20:38:25.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.739+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd21c1eb820 con 0x7fd21c14e7c0 2023-11-18T20:38:25.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.740+0000 7fd2127fc640 1 -- 172.21.15.132:0/1427149021 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd21c1eb820 con 0x7fd21c14e7c0 2023-11-18T20:38:25.742 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:38:25.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.743+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd20006ae40 msgr2=0x7fd20006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:25.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.743+0000 7fd22282e640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd20006ae40 0x7fd20006d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd218009af0 tx=0x7fd218008040 comp rx=0 tx=0).stop 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.743+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21c14e7c0 msgr2=0x7fd21c1ebb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.743+0000 7fd22282e640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21c14e7c0 0x7fd21c1ebb00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd21400cb40 tx=0x7fd21400a060 comp rx=0 tx=0).stop 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.744+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 shutdown_connections 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.744+0000 7fd22282e640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd20006ae40 0x7fd20006d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.744+0000 7fd22282e640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21c14e7c0 0x7fd21c1ebb00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.744+0000 7fd22282e640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0ca990 0x7fd21c156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.744+0000 7fd22282e640 1 --2- 172.21.15.132:0/1427149021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd21c0c4c00 0x7fd21c0bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.744+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 >> 172.21.15.132:0/1427149021 conn(0x7fd21c0abf00 msgr2=0x7fd21c0662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.744+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 shutdown_connections 2023-11-18T20:38:25.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:25.744+0000 7fd22282e640 1 -- 172.21.15.132:0/1427149021 wait complete. 2023-11-18T20:38:25.763 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T20:38:25.763 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:38:25.763 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-18T20:38:25.763 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T20:38:25.764 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:38:25.764 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T20:38:25.764 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T20:38:25.764 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:38:25.764 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:38:25.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:25.765 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-18T20:38:25.826 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-18T20:38:25.827 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42404sec preferred_lft 42404sec 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-18T20:38:25.828 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:38:25.829 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T20:38:25.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:25.830 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:38:25.830 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:38:25.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2023-11-18T20:38:25.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2023-11-18T20:38:25.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2023-11-18T20:38:25.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T20:38:25.830 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:38:26.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:26.301 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:38:26.385 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:38:26.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:26.388 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-18T20:38:26.444 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-18T20:38:26.445 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:38:26.445 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:38:26.445 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:38:26.445 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:38:26.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:26.446 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:38:26.446 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:38:26.446 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:38:26.446 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:38:26.446 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:38:26.447 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:38:27.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:27.225 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:38:27.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:27.281 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-11-18T20:38:27.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:27.331 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:38:27.331 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:38:27.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:38:27.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-18T20:38:27.331 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:38:27.471 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-18T20:38:27.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:27.472 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:38:27.472 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:38:27.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-18T20:38:27.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T20:38:27.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-18T20:38:27.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-18T20:38:27.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-18T20:38:27.472 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:38:27.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:27.751 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:38:27.751 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:38:27.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-18T20:38:27.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T20:38:27.751 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:38:27.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:38:27.902 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T20:38:27.950 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:38:27.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:38:27.950 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:38:28.041 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:38:28.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:28.043 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:38:28.177 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:38:28.178 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:38:28.178 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:38:28.670 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:38:28.670 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:38:28.670 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:38:28.670 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:38:28.670 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:38:28.700 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:38:28.700 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:38:28.700 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:38:28.700 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:38:28.701 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:38:28.701 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:38:28.701 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:38:28.701 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:38:28.705 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T20:38:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:38:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:38:28.705 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:38:28.706 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:38:28.711 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:38:28.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:28.711 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:38:28.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:28.786 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:38:28.834 INFO:teuthology.orchestra.run.smithi161.stdout:client4454 2023-11-18T20:38:28.834 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:38:28.834 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:38:28.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:28.928 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:38:29.029 INFO:teuthology.orchestra.run.smithi161.stdout:client4454 2023-11-18T20:38:29.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:29.030 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:38:29.086 INFO:teuthology.orchestra.run.smithi161.stdout:client4454 2023-11-18T20:38:29.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:29.086 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/95273225-bfbe-4b9a-893d-dfaf6292d673.client4454/status') 2023-11-18T20:38:29.180 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4454 (3)192.168.0.1:0/3882202156 2023-11-18T20:38:29.180 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2023-11-18T20:38:29.180 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2023-11-18T20:38:29.180 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2023-11-18T20:38:29.180 INFO:teuthology.orchestra.run.smithi161.stderr:69 bytes copied, 6.6799e-05 s, 1.0 MB/s 2023-11-18T20:38:29.184 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-18T20:38:29.199 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:29.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.421+0000 7f6b1b4cf640 1 Processor -- start 2023-11-18T20:38:29.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.421+0000 7f6b1b4cf640 1 -- start start 2023-11-18T20:38:29.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b1b4cf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140c5ec0 0x7f6b140c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b1b4cf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b140721a0 0x7f6b140c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b1b4cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140bfdc0 con 0x7f6b140c45d0 2023-11-18T20:38:29.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b1b4cf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1406e390 con 0x7f6b140721a0 2023-11-18T20:38:29.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b1b4cf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1406ddd0 con 0x7f6b140c5ec0 2023-11-18T20:38:29.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b18a6a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6b140c45d0 0x7f6b14155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58704/0 (socket says 172.21.15.132:58704) 2023-11-18T20:38:29.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b18a6a640 1 -- 172.21.15.132:0/2374650613 learned_addr learned my addr 172.21.15.132:0/2374650613 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:29.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b19a6c640 1 --2- 172.21.15.132:0/2374650613 >> v2:172.21.15.132:3300/0 conn(0x7f6b140721a0 0x7f6b140c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.423+0000 7f6b1926b640 1 --2- 172.21.15.132:0/2374650613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140c5ec0 0x7f6b140c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.424+0000 7f6b19a6c640 1 -- 172.21.15.132:0/2374650613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140c5ec0 msgr2=0x7f6b140c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:29.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.424+0000 7f6b19a6c640 1 --2- 172.21.15.132:0/2374650613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140c5ec0 0x7f6b140c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.424+0000 7f6b19a6c640 1 -- 172.21.15.132:0/2374650613 >> v1:172.21.15.132:6789/0 conn(0x7f6b140c45d0 legacy=0x7f6b14155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.424+0000 7f6b19a6c640 1 -- 172.21.15.132:0/2374650613 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1406e0b0 con 0x7f6b140721a0 2023-11-18T20:38:29.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.424+0000 7f6b0bfff640 1 -- 172.21.15.132:0/2374650613 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991426299 0 0) 0x7f6b140bfdc0 con 0x7f6b140c45d0 2023-11-18T20:38:29.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.425+0000 7f6b19a6c640 1 --2- 172.21.15.132:0/2374650613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140721a0 0x7f6b140c3170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009d90 tx=0x7f6b0c02bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605b51a3152dad33 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:29.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.425+0000 7f6b0bfff640 1 -- 172.21.15.132:0/2374650613 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c02cb30 con 0x7f6b140721a0 2023-11-18T20:38:29.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.425+0000 7f6b0bfff640 1 -- 172.21.15.132:0/2374650613 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c02cc90 con 0x7f6b140721a0 2023-11-18T20:38:29.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.425+0000 7f6b0bfff640 1 -- 172.21.15.132:0/2374650613 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c034440 con 0x7f6b140721a0 2023-11-18T20:38:29.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.425+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/2374650613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140721a0 msgr2=0x7f6b140c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.425+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/2374650613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140721a0 0x7f6b140c3170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009d90 tx=0x7f6b0c02bd80 comp rx=0 tx=0).stop 2023-11-18T20:38:29.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.426+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/2374650613 shutdown_connections 2023-11-18T20:38:29.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.426+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/2374650613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140721a0 0x7f6b140c3170 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.426+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/2374650613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140c5ec0 0x7f6b140c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.426+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/2374650613 >> 172.21.15.132:0/2374650613 conn(0x7f6b1406a500 msgr2=0x7f6b1406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:29.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.426+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/2374650613 shutdown_connections 2023-11-18T20:38:29.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.426+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/2374650613 wait complete. 2023-11-18T20:38:29.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.427+0000 7f6b1b4cf640 1 Processor -- start 2023-11-18T20:38:29.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.427+0000 7f6b1b4cf640 1 -- start start 2023-11-18T20:38:29.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.428+0000 7f6b1b4cf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140721a0 0x7f6b140a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.428+0000 7f6b1b4cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b140c45d0 0x7f6b140a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.428+0000 7f6b1b4cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140c5ec0 0x7f6b140a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.428+0000 7f6b1b4cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1409c760 con 0x7f6b140c5ec0 2023-11-18T20:38:29.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.428+0000 7f6b1b4cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141ea510 con 0x7f6b140c45d0 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.428+0000 7f6b1b4cf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141eaa40 con 0x7f6b140721a0 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140c5ec0 0x7f6b140a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140c5ec0 0x7f6b140a7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40618/0 (socket says 172.21.15.132:40618) 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 -- 172.21.15.132:0/3808633214 learned_addr learned my addr 172.21.15.132:0/3808633214 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b18a6a640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b140c45d0 0x7f6b140a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b1926b640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140721a0 0x7f6b140a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 -- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140721a0 msgr2=0x7f6b140a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140721a0 0x7f6b140a8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 -- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b140c45d0 msgr2=0x7f6b140a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b140c45d0 0x7f6b140a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 -- 172.21.15.132:0/3808633214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c009a70 con 0x7f6b140c5ec0 2023-11-18T20:38:29.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b18a6a640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b140c45d0 0x7f6b140a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:29.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.429+0000 7f6b19a6c640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140c5ec0 0x7f6b140a7730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009eb0 tx=0x7f6b0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:29.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.430+0000 7f6b09ffb640 1 -- 172.21.15.132:0/3808633214 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c035e80 con 0x7f6b140c5ec0 2023-11-18T20:38:29.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.430+0000 7f6b09ffb640 1 -- 172.21.15.132:0/3808633214 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c009450 con 0x7f6b140c5ec0 2023-11-18T20:38:29.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.430+0000 7f6b09ffb640 1 -- 172.21.15.132:0/3808633214 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c003bb0 con 0x7f6b140c5ec0 2023-11-18T20:38:29.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.430+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b141ea760 con 0x7f6b140c5ec0 2023-11-18T20:38:29.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.430+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b140a6cd0 con 0x7f6b140c5ec0 2023-11-18T20:38:29.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.431+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b14068350 con 0x7f6b140c5ec0 2023-11-18T20:38:29.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.432+0000 7f6b09ffb640 1 -- 172.21.15.132:0/3808633214 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b0c03b050 con 0x7f6b140c5ec0 2023-11-18T20:38:29.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.433+0000 7f6b09ffb640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6af806ae40 0x7f6af806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.433+0000 7f6b09ffb640 1 -- 172.21.15.132:0/3808633214 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b0c0aba70 con 0x7f6b140c5ec0 2023-11-18T20:38:29.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.433+0000 7f6b1926b640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6af806ae40 0x7f6af806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.435+0000 7f6b1926b640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6af806ae40 0x7f6af806d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6b10006fd0 tx=0x7f6b10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:29.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.437+0000 7f6b09ffb640 1 -- 172.21.15.132:0/3808633214 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b0c076b10 con 0x7f6b140c5ec0 2023-11-18T20:38:29.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.632+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b140bfa00 con 0x7f6b140c5ec0 2023-11-18T20:38:29.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.634+0000 7f6b09ffb640 1 -- 172.21.15.132:0/3808633214 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f6b0c039090 con 0x7f6b140c5ec0 2023-11-18T20:38:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:29.636 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:29.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6af806ae40 msgr2=0x7f6af806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6af806ae40 0x7f6af806d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6b10006fd0 tx=0x7f6b10008040 comp rx=0 tx=0).stop 2023-11-18T20:38:29.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140c5ec0 msgr2=0x7f6b140a7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140c5ec0 0x7f6b140a7730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009eb0 tx=0x7f6b0c004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:29.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 shutdown_connections 2023-11-18T20:38:29.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6af806ae40 0x7f6af806d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b140c5ec0 0x7f6b140a7730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b140c45d0 0x7f6b140a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 --2- 172.21.15.132:0/3808633214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b140721a0 0x7f6b140a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 >> 172.21.15.132:0/3808633214 conn(0x7f6b1406a500 msgr2=0x7f6b140a9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 shutdown_connections 2023-11-18T20:38:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.637+0000 7f6b1b4cf640 1 -- 172.21.15.132:0/3808633214 wait complete. 2023-11-18T20:38:29.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:29.658 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:29.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.865+0000 7f45af59e640 1 Processor -- start 2023-11-18T20:38:29.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.865+0000 7f45af59e640 1 -- start start 2023-11-18T20:38:29.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45af59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b00c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45af59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45b00c52e0 0x7f45b006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45af59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b00a8380 con 0x7f45b006cd20 2023-11-18T20:38:29.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45af59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b01510b0 con 0x7f45b00c52e0 2023-11-18T20:38:29.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45af59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b006bf60 con 0x7f45b014e7f0 2023-11-18T20:38:29.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45a7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45b00c52e0 0x7f45b006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45a7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45b00c52e0 0x7f45b006d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40620/0 (socket says 172.21.15.132:40620) 2023-11-18T20:38:29.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45a7fff640 1 -- 172.21.15.132:0/2530061264 learned_addr learned my addr 172.21.15.132:0/2530061264 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:29.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.867+0000 7f45ae59c640 1 --2- 172.21.15.132:0/2530061264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b00c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.868+0000 7f45a7fff640 1 -- 172.21.15.132:0/2530061264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 msgr2=0x7f45b00c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:29.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.868+0000 7f45a7fff640 1 --2- 172.21.15.132:0/2530061264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b00c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.868+0000 7f45a7fff640 1 -- 172.21.15.132:0/2530061264 >> v1:172.21.15.161:6789/0 conn(0x7f45b006cd20 legacy=0x7f45b01546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:29.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.868+0000 7f45a7fff640 1 -- 172.21.15.132:0/2530061264 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b006c240 con 0x7f45b00c52e0 2023-11-18T20:38:29.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.868+0000 7f45ae59c640 1 --2- 172.21.15.132:0/2530061264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b00c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:29.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.869+0000 7f45a7fff640 1 --2- 172.21.15.132:0/2530061264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b006d1e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4598009870 tx=0x7f459802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e4cef3ec0cbeb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:29.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.869+0000 7f45add9b640 1 -- 172.21.15.132:0/2530061264 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980317c0 con 0x7f45b00c52e0 2023-11-18T20:38:29.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.869+0000 7f45add9b640 1 -- 172.21.15.132:0/2530061264 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598031920 con 0x7f45b00c52e0 2023-11-18T20:38:29.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.869+0000 7f45add9b640 1 -- 172.21.15.132:0/2530061264 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598031cb0 con 0x7f45b00c52e0 2023-11-18T20:38:29.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.870+0000 7f45af59e640 1 -- 172.21.15.132:0/2530061264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 msgr2=0x7f45b006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.870+0000 7f45af59e640 1 --2- 172.21.15.132:0/2530061264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b006d1e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4598009870 tx=0x7f459802b860 comp rx=0 tx=0).stop 2023-11-18T20:38:29.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.870+0000 7f45af59e640 1 -- 172.21.15.132:0/2530061264 shutdown_connections 2023-11-18T20:38:29.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.870+0000 7f45af59e640 1 --2- 172.21.15.132:0/2530061264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b006d1e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.870+0000 7f45af59e640 1 --2- 172.21.15.132:0/2530061264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b00c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.870+0000 7f45af59e640 1 -- 172.21.15.132:0/2530061264 >> 172.21.15.132:0/2530061264 conn(0x7f45b00a77f0 msgr2=0x7f45b00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:29.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.870+0000 7f45af59e640 1 -- 172.21.15.132:0/2530061264 shutdown_connections 2023-11-18T20:38:29.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.870+0000 7f45af59e640 1 -- 172.21.15.132:0/2530061264 wait complete. 2023-11-18T20:38:29.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.872+0000 7f45af59e640 1 Processor -- start 2023-11-18T20:38:29.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.872+0000 7f45af59e640 1 -- start start 2023-11-18T20:38:29.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45af59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45b006cd20 0x7f45b01e6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45af59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b0146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45af59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b0070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45af59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b01e5ca0 con 0x7f45b00c52e0 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45af59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0150af0 con 0x7f45b006cd20 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45af59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b01e5650 con 0x7f45b014e7f0 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b0146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b0146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40622/0 (socket says 172.21.15.132:40622) 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45a7fff640 1 -- 172.21.15.132:0/2103285249 learned_addr learned my addr 172.21.15.132:0/2103285249 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45aed9d640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b0070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45ae59c640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45b006cd20 0x7f45b01e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.873+0000 7f45a7fff640 1 -- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 msgr2=0x7f45b0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45a7fff640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b0070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45a7fff640 1 -- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45b006cd20 msgr2=0x7f45b01e6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:29.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45a7fff640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45b006cd20 0x7f45b01e6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:29.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45a7fff640 1 -- 172.21.15.132:0/2103285249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45980094d0 con 0x7f45b00c52e0 2023-11-18T20:38:29.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45a7fff640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b0146560 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4598009870 tx=0x7f45980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:29.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45a6ffd640 1 -- 172.21.15.132:0/2103285249 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598032960 con 0x7f45b00c52e0 2023-11-18T20:38:29.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45a6ffd640 1 -- 172.21.15.132:0/2103285249 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598032ac0 con 0x7f45b00c52e0 2023-11-18T20:38:29.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45a6ffd640 1 -- 172.21.15.132:0/2103285249 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598032e70 con 0x7f45b00c52e0 2023-11-18T20:38:29.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b01e5930 con 0x7f45b00c52e0 2023-11-18T20:38:29.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.874+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b0150dd0 con 0x7f45b00c52e0 2023-11-18T20:38:29.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.876+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b0074230 con 0x7f45b00c52e0 2023-11-18T20:38:29.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.876+0000 7f45a6ffd640 1 -- 172.21.15.132:0/2103285249 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f459804e450 con 0x7f45b00c52e0 2023-11-18T20:38:29.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.877+0000 7f45a6ffd640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f459006ae40 0x7f459006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:29.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.877+0000 7f45a6ffd640 1 -- 172.21.15.132:0/2103285249 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45980ab9e0 con 0x7f45b00c52e0 2023-11-18T20:38:29.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.878+0000 7f45ae59c640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f459006ae40 0x7f459006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:29.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.879+0000 7f45ae59c640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f459006ae40 0x7f459006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f45a000b840 tx=0x7f45a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:29.882+0000 7f45a6ffd640 1 -- 172.21.15.132:0/2103285249 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4598076a90 con 0x7f45b00c52e0 2023-11-18T20:38:30.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.070+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45b004e840 con 0x7f45b00c52e0 2023-11-18T20:38:30.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.071+0000 7f45a6ffd640 1 -- 172.21.15.132:0/2103285249 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f459807a0b0 con 0x7f45b00c52e0 2023-11-18T20:38:30.072 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:30.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.073+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f459006ae40 msgr2=0x7f459006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.073+0000 7f45af59e640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f459006ae40 0x7f459006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f45a000b840 tx=0x7f45a0008040 comp rx=0 tx=0).stop 2023-11-18T20:38:30.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.073+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 msgr2=0x7f45b0146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.073+0000 7f45af59e640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b0146560 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4598009870 tx=0x7f45980046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.074+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 shutdown_connections 2023-11-18T20:38:30.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.074+0000 7f45af59e640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f459006ae40 0x7f459006d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.074+0000 7f45af59e640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45b014e7f0 0x7f45b0070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.074+0000 7f45af59e640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45b00c52e0 0x7f45b0146560 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4598009870 tx=0x7f45980046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.074+0000 7f45af59e640 1 --2- 172.21.15.132:0/2103285249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45b006cd20 0x7f45b01e6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.074+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 >> 172.21.15.132:0/2103285249 conn(0x7f45b00a77f0 msgr2=0x7f45b00c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:30.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.074+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 shutdown_connections 2023-11-18T20:38:30.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.074+0000 7f45af59e640 1 -- 172.21.15.132:0/2103285249 wait complete. 2023-11-18T20:38:30.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.297+0000 7f4881ed7640 1 Processor -- start 2023-11-18T20:38:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.297+0000 7f4881ed7640 1 -- start start 2023-11-18T20:38:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.298+0000 7f4881ed7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f487c0bbb20 0x7f487c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.299+0000 7f4881ed7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c151b00 con 0x7f487c14ebe0 2023-11-18T20:38:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.299+0000 7f4881ed7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c155af0 con 0x7f487c14efc0 2023-11-18T20:38:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.299+0000 7f4881ed7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c1526a0 con 0x7f487c0bbb20 2023-11-18T20:38:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.299+0000 7f487b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f487c14ebe0 0x7f487c151f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58708/0 (socket says 172.21.15.132:58708) 2023-11-18T20:38:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.299+0000 7f487b7fe640 1 -- 172.21.15.132:0/4182873521 learned_addr learned my addr 172.21.15.132:0/4182873521 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.299+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042209391 0 0) 0x7f487c151b00 con 0x7f487c14ebe0 2023-11-18T20:38:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.299+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4864003520 con 0x7f487c14ebe0 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.299+0000 7f487bfff640 1 --2- 172.21.15.132:0/4182873521 >> v2:172.21.15.161:3300/0 conn(0x7f487c0bbb20 0x7f487c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 897819408 0 0) 0x7f4864003520 con 0x7f487c14ebe0 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 >> v2:172.21.15.161:3300/0 conn(0x7f487c0bbb20 msgr2=0x7f487c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 --2- 172.21.15.132:0/4182873521 >> v2:172.21.15.161:3300/0 conn(0x7f487c0bbb20 0x7f487c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 >> v1:172.21.15.161:6789/0 conn(0x7f487c14efc0 legacy=0x7f487c0c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c06e1f0 con 0x7f487c14ebe0 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f486c001670 con 0x7f487c14ebe0 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 >> v1:172.21.15.132:6789/0 conn(0x7f487c14ebe0 legacy=0x7f487c151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4864003970 0x7f4864003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f4864004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48640052a0 0x7f486400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1526a0 con 0x7f48640047c0 2023-11-18T20:38:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486400c150 con 0x7f48640052a0 2023-11-18T20:38:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486400e520 con 0x7f4864003970 2023-11-18T20:38:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487affd640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f4864004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487b7fe640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4864003970 0x7f4864003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487affd640 1 -- 172.21.15.132:0/4182873521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4864003970 msgr2=0x7f4864003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487affd640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4864003970 0x7f4864003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487affd640 1 -- 172.21.15.132:0/4182873521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48640052a0 msgr2=0x7f486400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487affd640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48640052a0 0x7f486400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487affd640 1 -- 172.21.15.132:0/4182873521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864003520 con 0x7f48640047c0 2023-11-18T20:38:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.300+0000 7f487bfff640 1 -- 172.21.15.132:0/4182873521 reap_dead start 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.301+0000 7f487affd640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f4864004c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4870003d80 tx=0x7f48640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ec714c4054424c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4870032600 con 0x7f48640047c0 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487002e050 con 0x7f48640047c0 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f487a7fc640 1 -- 172.21.15.132:0/4182873521 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700329e0 con 0x7f48640047c0 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f4881ed7640 1 -- 172.21.15.132:0/4182873521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 msgr2=0x7f4864004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f4881ed7640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f4864004c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4870003d80 tx=0x7f48640057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f4881ed7640 1 -- 172.21.15.132:0/4182873521 shutdown_connections 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f4881ed7640 1 --2- 172.21.15.132:0/4182873521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f4864004c40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f4881ed7640 1 -- 172.21.15.132:0/4182873521 >> 172.21.15.132:0/4182873521 conn(0x7f487c0a7970 msgr2=0x7f487c0a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f4881ed7640 1 -- 172.21.15.132:0/4182873521 shutdown_connections 2023-11-18T20:38:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.302+0000 7f4881ed7640 1 -- 172.21.15.132:0/4182873521 wait complete. 2023-11-18T20:38:30.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.304+0000 7f4881ed7640 1 Processor -- start 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.304+0000 7f4881ed7640 1 -- start start 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f4881ed7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f487c1422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f4881ed7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c150d00 0x7f487c0be170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f4881ed7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0bfac0 0x7f487c14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f4881ed7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c14f860 con 0x7f48640047c0 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f4881ed7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c151190 con 0x7f487c150d00 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f4881ed7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c14ca10 con 0x7f487c0bfac0 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f487c1422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f487c1422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40642/0 (socket says 172.21.15.132:40642) 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.305+0000 7f487b7fe640 1 -- 172.21.15.132:0/578665495 learned_addr learned my addr 172.21.15.132:0/578665495 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:30.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f487affd640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c150d00 0x7f487c0be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f487b7fe640 1 -- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0bfac0 msgr2=0x7f487c14fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f487b7fe640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0bfac0 0x7f487c14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f487b7fe640 1 -- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c150d00 msgr2=0x7f487c0be170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f487b7fe640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c150d00 0x7f487c0be170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f487b7fe640 1 -- 172.21.15.132:0/578665495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c1e9a00 con 0x7f48640047c0 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f487affd640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c150d00 0x7f487c0be170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f487b7fe640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f487c1422f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f486c001eb0 tx=0x7f486c00dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f4863fff640 1 -- 172.21.15.132:0/578665495 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0074e0 con 0x7f48640047c0 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f4863fff640 1 -- 172.21.15.132:0/578665495 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c007640 con 0x7f48640047c0 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f4863fff640 1 -- 172.21.15.132:0/578665495 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0049e0 con 0x7f48640047c0 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c1e9ce0 con 0x7f48640047c0 2023-11-18T20:38:30.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.306+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c150880 con 0x7f48640047c0 2023-11-18T20:38:30.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.307+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c072b80 con 0x7f48640047c0 2023-11-18T20:38:30.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.308+0000 7f4863fff640 1 -- 172.21.15.132:0/578665495 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f486c004b40 con 0x7f48640047c0 2023-11-18T20:38:30.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.309+0000 7f4863fff640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f486806ae40 0x7f486806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.309+0000 7f4863fff640 1 -- 172.21.15.132:0/578665495 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f486c088fc0 con 0x7f48640047c0 2023-11-18T20:38:30.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.310+0000 7f487affd640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f486806ae40 0x7f486806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.311+0000 7f487affd640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f486806ae40 0x7f486806d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4870034000 tx=0x7f4870009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:30.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.313+0000 7f4863fff640 1 -- 172.21.15.132:0/578665495 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f486c054060 con 0x7f48640047c0 2023-11-18T20:38:30.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.491+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f487c067e50 con 0x7f48640047c0 2023-11-18T20:38:30.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.492+0000 7f4863fff640 1 -- 172.21.15.132:0/578665495 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f486c019020 con 0x7f48640047c0 2023-11-18T20:38:30.494 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:30.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f486806ae40 msgr2=0x7f486806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f486806ae40 0x7f486806d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4870034000 tx=0x7f4870009030 comp rx=0 tx=0).stop 2023-11-18T20:38:30.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 msgr2=0x7f487c1422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f487c1422f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f486c001eb0 tx=0x7f486c00dc70 comp rx=0 tx=0).stop 2023-11-18T20:38:30.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 shutdown_connections 2023-11-18T20:38:30.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f486806ae40 0x7f486806d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0bfac0 0x7f487c14fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c150d00 0x7f487c0be170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 --2- 172.21.15.132:0/578665495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48640047c0 0x7f487c1422f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.495+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 >> 172.21.15.132:0/578665495 conn(0x7f487c0a7970 msgr2=0x7f487c0c42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:30.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.496+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 shutdown_connections 2023-11-18T20:38:30.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.496+0000 7f4881ed7640 1 -- 172.21.15.132:0/578665495 wait complete. 2023-11-18T20:38:30.515 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:30.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.731+0000 7f1fda705640 1 Processor -- start 2023-11-18T20:38:30.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.732+0000 7f1fda705640 1 -- start start 2023-11-18T20:38:30.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.733+0000 7f1fda705640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1fd40c7e90 0x7f1fd40c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.733+0000 7f1fda705640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd40bd8d0 con 0x7f1fd40c4e50 2023-11-18T20:38:30.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.733+0000 7f1fda705640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd40c6e60 con 0x7f1fd414e810 2023-11-18T20:38:30.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.733+0000 7f1fda705640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd40c70d0 con 0x7f1fd40c7e90 2023-11-18T20:38:30.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.733+0000 7f1fd37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1fd40c7e90 0x7f1fd40c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.733+0000 7f1fd37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1fd40c7e90 0x7f1fd40c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40650/0 (socket says 172.21.15.132:40650) 2023-11-18T20:38:30.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.733+0000 7f1fd37fe640 1 -- 172.21.15.132:0/2293398811 learned_addr learned my addr 172.21.15.132:0/2293398811 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:30.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.733+0000 7f1fd8ca2640 1 --1- 172.21.15.132:0/2293398811 >> v1:172.21.15.132:6789/0 conn(0x7f1fd40c4e50 0x7f1fd406b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58716/0 (socket says 172.21.15.132:58716) 2023-11-18T20:38:30.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.734+0000 7f1fd37fe640 1 -- 172.21.15.132:0/2293398811 >> v1:172.21.15.161:6789/0 conn(0x7f1fd414e810 legacy=0x7f1fd41550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.734+0000 7f1fd37fe640 1 -- 172.21.15.132:0/2293398811 >> v1:172.21.15.132:6789/0 conn(0x7f1fd40c4e50 legacy=0x7f1fd406b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.734+0000 7f1fd37fe640 1 -- 172.21.15.132:0/2293398811 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd40c73b0 con 0x7f1fd40c7e90 2023-11-18T20:38:30.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.735+0000 7f1fd37fe640 1 --2- 172.21.15.132:0/2293398811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd40c7e90 0x7f1fd40c4910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009870 tx=0x7f1fbc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2105d96789f54c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:30.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.735+0000 7f1fd2ffd640 1 -- 172.21.15.132:0/2293398811 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc030860 con 0x7f1fd40c7e90 2023-11-18T20:38:30.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.735+0000 7f1fd2ffd640 1 -- 172.21.15.132:0/2293398811 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc0309c0 con 0x7f1fd40c7e90 2023-11-18T20:38:30.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.735+0000 7f1fd2ffd640 1 -- 172.21.15.132:0/2293398811 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc030d50 con 0x7f1fd40c7e90 2023-11-18T20:38:30.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.736+0000 7f1fda705640 1 -- 172.21.15.132:0/2293398811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd40c7e90 msgr2=0x7f1fd40c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.736+0000 7f1fda705640 1 --2- 172.21.15.132:0/2293398811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd40c7e90 0x7f1fd40c4910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009870 tx=0x7f1fbc02b9a0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.736+0000 7f1fda705640 1 -- 172.21.15.132:0/2293398811 shutdown_connections 2023-11-18T20:38:30.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.736+0000 7f1fda705640 1 --2- 172.21.15.132:0/2293398811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd40c7e90 0x7f1fd40c4910 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.736+0000 7f1fda705640 1 -- 172.21.15.132:0/2293398811 >> 172.21.15.132:0/2293398811 conn(0x7f1fd40ca170 msgr2=0x7f1fd40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:30.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.736+0000 7f1fda705640 1 -- 172.21.15.132:0/2293398811 shutdown_connections 2023-11-18T20:38:30.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.736+0000 7f1fda705640 1 -- 172.21.15.132:0/2293398811 wait complete. 2023-11-18T20:38:30.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.737+0000 7f1fda705640 1 Processor -- start 2023-11-18T20:38:30.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.738+0000 7f1fda705640 1 -- start start 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.738+0000 7f1fda705640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fd40c4e50 0x7f1fd4146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.738+0000 7f1fda705640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fd40c7e90 0x7f1fd4156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.738+0000 7f1fda705640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd414e810 0x7f1fd41ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.738+0000 7f1fda705640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd41ea380 con 0x7f1fd414e810 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.738+0000 7f1fda705640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4147cf0 con 0x7f1fd40c4e50 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.738+0000 7f1fda705640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd40abec0 con 0x7f1fd40c7e90 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd414e810 0x7f1fd41ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd414e810 0x7f1fd41ea7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40666/0 (socket says 172.21.15.132:40666) 2023-11-18T20:38:30.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 -- 172.21.15.132:0/2343877354 learned_addr learned my addr 172.21.15.132:0/2343877354 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:30.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 -- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fd40c7e90 msgr2=0x7f1fd4156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fd40c7e90 0x7f1fd4156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 -- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fd40c4e50 msgr2=0x7f1fd4146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd3fff640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fd40c4e50 0x7f1fd4146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fd40c4e50 0x7f1fd4146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 -- 172.21.15.132:0/2343877354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0094d0 con 0x7f1fd414e810 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.739+0000 7f1fd8ca2640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd414e810 0x7f1fd41ea7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c390 tx=0x7f1fcc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.740+0000 7f1fd0ff9640 1 -- 172.21.15.132:0/2343877354 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0074e0 con 0x7f1fd414e810 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.740+0000 7f1fd0ff9640 1 -- 172.21.15.132:0/2343877354 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc007640 con 0x7f1fd414e810 2023-11-18T20:38:30.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.740+0000 7f1fd0ff9640 1 -- 172.21.15.132:0/2343877354 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0049e0 con 0x7f1fd414e810 2023-11-18T20:38:30.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.740+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd41ee220 con 0x7f1fd414e810 2023-11-18T20:38:30.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.740+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd40c11e0 con 0x7f1fd414e810 2023-11-18T20:38:30.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.741+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd41ea4c0 con 0x7f1fd414e810 2023-11-18T20:38:30.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.742+0000 7f1fd0ff9640 1 -- 172.21.15.132:0/2343877354 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1fcc004b40 con 0x7f1fd414e810 2023-11-18T20:38:30.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.743+0000 7f1fd0ff9640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1fb406ae40 0x7f1fb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:30.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.743+0000 7f1fd0ff9640 1 -- 172.21.15.132:0/2343877354 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fcc088ee0 con 0x7f1fd414e810 2023-11-18T20:38:30.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.744+0000 7f1fd3fff640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1fb406ae40 0x7f1fb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:30.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.745+0000 7f1fd3fff640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1fb406ae40 0x7f1fb406d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4007fd0 tx=0x7f1fc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.747+0000 7f1fd0ff9640 1 -- 172.21.15.132:0/2343877354 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1fd41ea4c0 con 0x7f1fd414e810 2023-11-18T20:38:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.937+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fd41ea4c0 con 0x7f1fd414e810 2023-11-18T20:38:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.937+0000 7f1fd0ff9640 1 -- 172.21.15.132:0/2343877354 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fd41ea4c0 con 0x7f1fd414e810 2023-11-18T20:38:30.939 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1fb406ae40 msgr2=0x7f1fb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1fb406ae40 0x7f1fb406d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4007fd0 tx=0x7f1fc4009040 comp rx=0 tx=0).stop 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd414e810 msgr2=0x7f1fd41ea7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd414e810 0x7f1fd41ea7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c390 tx=0x7f1fcc00c850 comp rx=0 tx=0).stop 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 shutdown_connections 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1fb406ae40 0x7f1fb406d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fd414e810 0x7f1fd41ea7a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fd40c7e90 0x7f1fd4156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 --2- 172.21.15.132:0/2343877354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fd40c4e50 0x7f1fd4146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 >> 172.21.15.132:0/2343877354 conn(0x7f1fd40ca170 msgr2=0x7f1fd40c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.940+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 shutdown_connections 2023-11-18T20:38:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:30.941+0000 7f1fda705640 1 -- 172.21.15.132:0/2343877354 wait complete. 2023-11-18T20:38:30.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:31.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.152+0000 7f0d86c1f640 1 Processor -- start 2023-11-18T20:38:31.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.152+0000 7f0d86c1f640 1 -- start start 2023-11-18T20:38:31.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d86c1f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d8014fd30 0x7f0d80152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d86c1f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 0x7f0d800a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d86c1f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800c64a0 con 0x7f0d800a5260 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d86c1f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d800c5c00 con 0x7f0d8014fd30 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d86c1f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800c5ee0 con 0x7f0d8006d0a0 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d849bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d8014fd30 0x7f0d80152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d849bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d8014fd30 0x7f0d80152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40674/0 (socket says 172.21.15.132:40674) 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d849bb640 1 -- 172.21.15.132:0/2213518330 learned_addr learned my addr 172.21.15.132:0/2213518330 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.154+0000 7f0d7ffff640 1 --2- 172.21.15.132:0/2213518330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 0x7f0d800a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.155+0000 7f0d849bb640 1 -- 172.21.15.132:0/2213518330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 msgr2=0x7f0d800a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.155+0000 7f0d849bb640 1 --2- 172.21.15.132:0/2213518330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 0x7f0d800a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.155+0000 7f0d849bb640 1 -- 172.21.15.132:0/2213518330 >> v1:172.21.15.161:6789/0 conn(0x7f0d800a5260 legacy=0x7f0d800c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:31.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.155+0000 7f0d849bb640 1 -- 172.21.15.132:0/2213518330 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800c61c0 con 0x7f0d8014fd30 2023-11-18T20:38:31.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.156+0000 7f0d849bb640 1 --2- 172.21.15.132:0/2213518330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8014fd30 0x7f0d80152f20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009870 tx=0x7f0d7402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36d1347ae67ee67 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:31.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.156+0000 7f0d7f7fe640 1 -- 172.21.15.132:0/2213518330 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74031640 con 0x7f0d8014fd30 2023-11-18T20:38:31.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.156+0000 7f0d7f7fe640 1 -- 172.21.15.132:0/2213518330 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d740317a0 con 0x7f0d8014fd30 2023-11-18T20:38:31.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.156+0000 7f0d7f7fe640 1 -- 172.21.15.132:0/2213518330 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74031b30 con 0x7f0d8014fd30 2023-11-18T20:38:31.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.157+0000 7f0d86c1f640 1 -- 172.21.15.132:0/2213518330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8014fd30 msgr2=0x7f0d80152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.157+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/2213518330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8014fd30 0x7f0d80152f20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009870 tx=0x7f0d7402b8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.157+0000 7f0d86c1f640 1 -- 172.21.15.132:0/2213518330 shutdown_connections 2023-11-18T20:38:31.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.157+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/2213518330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 0x7f0d800a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.157+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/2213518330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8014fd30 0x7f0d80152f20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.157+0000 7f0d86c1f640 1 -- 172.21.15.132:0/2213518330 >> 172.21.15.132:0/2213518330 conn(0x7f0d8006a500 msgr2=0x7f0d8006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:31.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.157+0000 7f0d86c1f640 1 -- 172.21.15.132:0/2213518330 shutdown_connections 2023-11-18T20:38:31.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.157+0000 7f0d86c1f640 1 -- 172.21.15.132:0/2213518330 wait complete. 2023-11-18T20:38:31.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.159+0000 7f0d86c1f640 1 Processor -- start 2023-11-18T20:38:31.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.159+0000 7f0d86c1f640 1 -- start start 2023-11-18T20:38:31.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d86c1f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 0x7f0d80156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d86c1f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d800a5260 0x7f0d801dc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d86c1f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d8014fd30 0x7f0d801ea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d86c1f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801ee6b0 con 0x7f0d800a5260 2023-11-18T20:38:31.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d86c1f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800c4a20 con 0x7f0d8014fd30 2023-11-18T20:38:31.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d86c1f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801edaa0 con 0x7f0d8006d0a0 2023-11-18T20:38:31.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d800a5260 0x7f0d801dc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d800a5260 0x7f0d801dc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40686/0 (socket says 172.21.15.132:40686) 2023-11-18T20:38:31.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d7ffff640 1 -- 172.21.15.132:0/1363705014 learned_addr learned my addr 172.21.15.132:0/1363705014 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:31.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d7ffff640 1 -- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 msgr2=0x7f0d80156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d7ffff640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 0x7f0d80156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d7ffff640 1 -- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d8014fd30 msgr2=0x7f0d801ea5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d7ffff640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d8014fd30 0x7f0d801ea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.161+0000 7f0d7ffff640 1 -- 172.21.15.132:0/1363705014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740094d0 con 0x7f0d800a5260 2023-11-18T20:38:31.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.162+0000 7f0d7ffff640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d800a5260 0x7f0d801dc350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d7d0 tx=0x7f0d6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:31.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.162+0000 7f0d7d7fa640 1 -- 172.21.15.132:0/1363705014 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00b6c0 con 0x7f0d800a5260 2023-11-18T20:38:31.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.162+0000 7f0d7d7fa640 1 -- 172.21.15.132:0/1363705014 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00b840 con 0x7f0d800a5260 2023-11-18T20:38:31.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.162+0000 7f0d7d7fa640 1 -- 172.21.15.132:0/1363705014 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00bbf0 con 0x7f0d800a5260 2023-11-18T20:38:31.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.162+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d801edd80 con 0x7f0d800a5260 2023-11-18T20:38:31.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.162+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d801ee340 con 0x7f0d800a5260 2023-11-18T20:38:31.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.163+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d80068350 con 0x7f0d800a5260 2023-11-18T20:38:31.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.164+0000 7f0d7d7fa640 1 -- 172.21.15.132:0/1363705014 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d6c00bd50 con 0x7f0d800a5260 2023-11-18T20:38:31.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.166+0000 7f0d7d7fa640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d6406ae40 0x7f0d6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.166+0000 7f0d7d7fa640 1 -- 172.21.15.132:0/1363705014 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d6c089b10 con 0x7f0d800a5260 2023-11-18T20:38:31.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.166+0000 7f0d849bb640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d6406ae40 0x7f0d6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.168+0000 7f0d849bb640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d6406ae40 0x7f0d6406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d74036000 tx=0x7f0d74030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:31.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.170+0000 7f0d7d7fa640 1 -- 172.21.15.132:0/1363705014 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d6c054c50 con 0x7f0d800a5260 2023-11-18T20:38:31.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.349+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d800c40c0 con 0x7f0d800a5260 2023-11-18T20:38:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.352+0000 7f0d7d7fa640 1 -- 172.21.15.132:0/1363705014 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f0d6c058270 con 0x7f0d800a5260 2023-11-18T20:38:31.353 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:31.353 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.355+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d6406ae40 msgr2=0x7f0d6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.355+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d6406ae40 0x7f0d6406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d74036000 tx=0x7f0d74030000 comp rx=0 tx=0).stop 2023-11-18T20:38:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d800a5260 msgr2=0x7f0d801dc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d800a5260 0x7f0d801dc350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d7d0 tx=0x7f0d6c00dc90 comp rx=0 tx=0).stop 2023-11-18T20:38:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 shutdown_connections 2023-11-18T20:38:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d6406ae40 0x7f0d6406d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d8014fd30 0x7f0d801ea5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d800a5260 0x7f0d801dc350 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 --2- 172.21.15.132:0/1363705014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d8006d0a0 0x7f0d80156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 >> 172.21.15.132:0/1363705014 conn(0x7f0d8006a500 msgr2=0x7f0d801521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 shutdown_connections 2023-11-18T20:38:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.356+0000 7f0d86c1f640 1 -- 172.21.15.132:0/1363705014 wait complete. 2023-11-18T20:38:31.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:31.375 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:31.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.586+0000 7f20542cf640 1 Processor -- start 2023-11-18T20:38:31.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.587+0000 7f20542cf640 1 -- start start 2023-11-18T20:38:31.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.588+0000 7f20542cf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.588+0000 7f20542cf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f204c0721a0 0x7f204c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.588+0000 7f20542cf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c0bfdc0 con 0x7f204c0c45d0 2023-11-18T20:38:31.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.588+0000 7f20542cf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c06e390 con 0x7f204c0721a0 2023-11-18T20:38:31.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.588+0000 7f20542cf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c06ddd0 con 0x7f204c0c5ec0 2023-11-18T20:38:31.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.589+0000 7f205206b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.589+0000 7f205206b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c0c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:60668/0 (socket says 172.21.15.132:60668) 2023-11-18T20:38:31.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.589+0000 7f205206b640 1 -- 172.21.15.132:0/4263480766 learned_addr learned my addr 172.21.15.132:0/4263480766 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:31.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.589+0000 7f205286c640 1 --2- 172.21.15.132:0/4263480766 >> v2:172.21.15.161:3300/0 conn(0x7f204c0721a0 0x7f204c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.590+0000 7f205206b640 1 -- 172.21.15.132:0/4263480766 >> v2:172.21.15.161:3300/0 conn(0x7f204c0721a0 msgr2=0x7f204c0c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:31.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.590+0000 7f205206b640 1 --2- 172.21.15.132:0/4263480766 >> v2:172.21.15.161:3300/0 conn(0x7f204c0721a0 0x7f204c0c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.590+0000 7f205206b640 1 -- 172.21.15.132:0/4263480766 >> v1:172.21.15.161:6789/0 conn(0x7f204c0c45d0 legacy=0x7f204c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.590+0000 7f205206b640 1 -- 172.21.15.132:0/4263480766 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c06e0b0 con 0x7f204c0c5ec0 2023-11-18T20:38:31.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.591+0000 7f205206b640 1 --2- 172.21.15.132:0/4263480766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c0c2c30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2048009870 tx=0x7f204802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b269887013558492 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:31.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.592+0000 7f2051069640 1 -- 172.21.15.132:0/4263480766 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20480317c0 con 0x7f204c0c5ec0 2023-11-18T20:38:31.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.592+0000 7f2051069640 1 -- 172.21.15.132:0/4263480766 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048031920 con 0x7f204c0c5ec0 2023-11-18T20:38:31.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.592+0000 7f2051069640 1 -- 172.21.15.132:0/4263480766 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048031cb0 con 0x7f204c0c5ec0 2023-11-18T20:38:31.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.592+0000 7f20542cf640 1 -- 172.21.15.132:0/4263480766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 msgr2=0x7f204c0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.592+0000 7f20542cf640 1 --2- 172.21.15.132:0/4263480766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c0c2c30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2048009870 tx=0x7f204802b860 comp rx=0 tx=0).stop 2023-11-18T20:38:31.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.592+0000 7f20542cf640 1 -- 172.21.15.132:0/4263480766 shutdown_connections 2023-11-18T20:38:31.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.592+0000 7f20542cf640 1 --2- 172.21.15.132:0/4263480766 >> v2:172.21.15.161:3300/0 conn(0x7f204c0721a0 0x7f204c0c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.592+0000 7f20542cf640 1 --2- 172.21.15.132:0/4263480766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c0c2c30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.593+0000 7f20542cf640 1 -- 172.21.15.132:0/4263480766 >> 172.21.15.132:0/4263480766 conn(0x7f204c06a500 msgr2=0x7f204c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:31.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.593+0000 7f20542cf640 1 -- 172.21.15.132:0/4263480766 shutdown_connections 2023-11-18T20:38:31.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.593+0000 7f20542cf640 1 -- 172.21.15.132:0/4263480766 wait complete. 2023-11-18T20:38:31.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.594+0000 7f20542cf640 1 Processor -- start 2023-11-18T20:38:31.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.595+0000 7f20542cf640 1 -- start start 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.595+0000 7f20542cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0721a0 0x7f204c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.595+0000 7f20542cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c45d0 0x7f204c155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.595+0000 7f20542cf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c1edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f20542cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0a8850 con 0x7f204c0c45d0 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f20542cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0a82d0 con 0x7f204c0721a0 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f20542cf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c157df0 con 0x7f204c0c5ec0 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205186a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c45d0 0x7f204c155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205186a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c45d0 0x7f204c155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40696/0 (socket says 172.21.15.132:40696) 2023-11-18T20:38:31.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205186a640 1 -- 172.21.15.132:0/147171861 learned_addr learned my addr 172.21.15.132:0/147171861 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:31.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205206b640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0721a0 0x7f204c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205286c640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c1edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205186a640 1 -- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 msgr2=0x7f204c1edd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205186a640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c1edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205186a640 1 -- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0721a0 msgr2=0x7f204c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205186a640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0721a0 0x7f204c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205186a640 1 -- 172.21.15.132:0/147171861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480094d0 con 0x7f204c0c45d0 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.596+0000 7f205206b640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0721a0 0x7f204c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.597+0000 7f205186a640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c45d0 0x7f204c155c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f203c00c450 tx=0x7f203c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.597+0000 7f2042ffd640 1 -- 172.21.15.132:0/147171861 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c0052d0 con 0x7f204c0c45d0 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.597+0000 7f2042ffd640 1 -- 172.21.15.132:0/147171861 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c005430 con 0x7f204c0c45d0 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.597+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c0a8570 con 0x7f204c0c45d0 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.597+0000 7f2042ffd640 1 -- 172.21.15.132:0/147171861 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c012870 con 0x7f204c0c45d0 2023-11-18T20:38:31.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.597+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c1ed870 con 0x7f204c0c45d0 2023-11-18T20:38:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.598+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c068350 con 0x7f204c0c45d0 2023-11-18T20:38:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.599+0000 7f2042ffd640 1 -- 172.21.15.132:0/147171861 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f203c0129d0 con 0x7f204c0c45d0 2023-11-18T20:38:31.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.600+0000 7f2042ffd640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203006ae40 0x7f203006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:31.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.600+0000 7f2042ffd640 1 -- 172.21.15.132:0/147171861 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f203c089150 con 0x7f204c0c45d0 2023-11-18T20:38:31.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.601+0000 7f205206b640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203006ae40 0x7f203006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:31.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.602+0000 7f205206b640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203006ae40 0x7f203006d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2048036000 tx=0x7f204803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:31.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.605+0000 7f2042ffd640 1 -- 172.21.15.132:0/147171861 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f203c0541f0 con 0x7f204c0c45d0 2023-11-18T20:38:31.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.796+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f204c06d240 con 0x7f204c0c45d0 2023-11-18T20:38:31.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.797+0000 7f2042ffd640 1 -- 172.21.15.132:0/147171861 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f203c057810 con 0x7f204c0c45d0 2023-11-18T20:38:31.798 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203006ae40 msgr2=0x7f203006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203006ae40 0x7f203006d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2048036000 tx=0x7f204803d040 comp rx=0 tx=0).stop 2023-11-18T20:38:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c45d0 msgr2=0x7f204c155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c45d0 0x7f204c155c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f203c00c450 tx=0x7f203c00c910 comp rx=0 tx=0).stop 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 shutdown_connections 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203006ae40 0x7f203006d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0c5ec0 0x7f204c1edd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c45d0 0x7f204c155c20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 --2- 172.21.15.132:0/147171861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0721a0 0x7f204c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 >> 172.21.15.132:0/147171861 conn(0x7f204c06a500 msgr2=0x7f204c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 shutdown_connections 2023-11-18T20:38:31.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:31.800+0000 7f20542cf640 1 -- 172.21.15.132:0/147171861 wait complete. 2023-11-18T20:38:31.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:32.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.033+0000 7fe8be53c640 1 Processor -- start 2023-11-18T20:38:32.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.033+0000 7fe8be53c640 1 -- start start 2023-11-18T20:38:32.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.034+0000 7fe8be53c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.034+0000 7fe8be53c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8b806cd20 0x7fe8b815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.034+0000 7fe8be53c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b80a8380 con 0x7fe8b80c52e0 2023-11-18T20:38:32.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.034+0000 7fe8be53c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b81510b0 con 0x7fe8b806cd20 2023-11-18T20:38:32.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.034+0000 7fe8be53c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b806bf60 con 0x7fe8b814e7f0 2023-11-18T20:38:32.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.034+0000 7fe8bdd3b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8b806cd20 0x7fe8b815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.034+0000 7fe8bdd3b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8b806cd20 0x7fe8b815ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40700/0 (socket says 172.21.15.132:40700) 2023-11-18T20:38:32.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.034+0000 7fe8bdd3b640 1 -- 172.21.15.132:0/953502882 learned_addr learned my addr 172.21.15.132:0/953502882 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:32.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.035+0000 7fe8bd53a640 1 --2- 172.21.15.132:0/953502882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.035+0000 7fe8bdd3b640 1 -- 172.21.15.132:0/953502882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 msgr2=0x7fe8b80c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:32.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.035+0000 7fe8bdd3b640 1 --2- 172.21.15.132:0/953502882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.035+0000 7fe8bdd3b640 1 -- 172.21.15.132:0/953502882 >> v1:172.21.15.161:6789/0 conn(0x7fe8b80c52e0 legacy=0x7fe8b806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:32.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.035+0000 7fe8bdd3b640 1 -- 172.21.15.132:0/953502882 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b806c240 con 0x7fe8b806cd20 2023-11-18T20:38:32.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.035+0000 7fe8bd53a640 1 --2- 172.21.15.132:0/953502882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:32.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.036+0000 7fe8bdd3b640 1 --2- 172.21.15.132:0/953502882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b815ba30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000d150 tx=0x7fe8b002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f298ae14414f1e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.036+0000 7fe8affff640 1 -- 172.21.15.132:0/953502882 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b002e9e0 con 0x7fe8b806cd20 2023-11-18T20:38:32.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.036+0000 7fe8affff640 1 -- 172.21.15.132:0/953502882 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b002eb40 con 0x7fe8b806cd20 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.036+0000 7fe8affff640 1 -- 172.21.15.132:0/953502882 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0009600 con 0x7fe8b806cd20 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.037+0000 7fe8be53c640 1 -- 172.21.15.132:0/953502882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 msgr2=0x7fe8b815ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.037+0000 7fe8be53c640 1 --2- 172.21.15.132:0/953502882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b815ba30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000d150 tx=0x7fe8b002e040 comp rx=0 tx=0).stop 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.037+0000 7fe8be53c640 1 -- 172.21.15.132:0/953502882 shutdown_connections 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.037+0000 7fe8be53c640 1 --2- 172.21.15.132:0/953502882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b815ba30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.037+0000 7fe8be53c640 1 --2- 172.21.15.132:0/953502882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.037+0000 7fe8be53c640 1 -- 172.21.15.132:0/953502882 >> 172.21.15.132:0/953502882 conn(0x7fe8b80a77f0 msgr2=0x7fe8b80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.037+0000 7fe8be53c640 1 -- 172.21.15.132:0/953502882 shutdown_connections 2023-11-18T20:38:32.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.037+0000 7fe8be53c640 1 -- 172.21.15.132:0/953502882 wait complete. 2023-11-18T20:38:32.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.039+0000 7fe8be53c640 1 Processor -- start 2023-11-18T20:38:32.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.039+0000 7fe8be53c640 1 -- start start 2023-11-18T20:38:32.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8be53c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b814d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8be53c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8b80c52e0 0x7fe8b814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8be53c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8be53c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81e9c30 con 0x7fe8b806cd20 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8be53c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80a72b0 con 0x7fe8b80c52e0 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8be53c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81466f0 con 0x7fe8b814e7f0 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bd53a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bd53a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b814d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40714/0 (socket says 172.21.15.132:40714) 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bd53a640 1 -- 172.21.15.132:0/4214659 learned_addr learned my addr 172.21.15.132:0/4214659 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:32.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bdd3b640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bd53a640 1 -- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 msgr2=0x7fe8b80a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bd53a640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80a51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bd53a640 1 -- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8b80c52e0 msgr2=0x7fe8b814bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bd53a640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8b80c52e0 0x7fe8b814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.040+0000 7fe8bd53a640 1 -- 172.21.15.132:0/4214659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b000bd40 con 0x7fe8b806cd20 2023-11-18T20:38:32.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.041+0000 7fe8bd53a640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b814d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c7f0 tx=0x7fe8b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.041+0000 7fe8adffb640 1 -- 172.21.15.132:0/4214659 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4007820 con 0x7fe8b806cd20 2023-11-18T20:38:32.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.041+0000 7fe8adffb640 1 -- 172.21.15.132:0/4214659 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4007980 con 0x7fe8b806cd20 2023-11-18T20:38:32.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.041+0000 7fe8adffb640 1 -- 172.21.15.132:0/4214659 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4007cf0 con 0x7fe8b806cd20 2023-11-18T20:38:32.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.041+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b81469d0 con 0x7fe8b806cd20 2023-11-18T20:38:32.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.041+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b8144270 con 0x7fe8b806cd20 2023-11-18T20:38:32.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.042+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b81444f0 con 0x7fe8b806cd20 2023-11-18T20:38:32.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.043+0000 7fe8adffb640 1 -- 172.21.15.132:0/4214659 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8b40113f0 con 0x7fe8b806cd20 2023-11-18T20:38:32.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.044+0000 7fe8adffb640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe89c06ae70 0x7fe89c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.044+0000 7fe8adffb640 1 -- 172.21.15.132:0/4214659 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8b4089820 con 0x7fe8b806cd20 2023-11-18T20:38:32.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.045+0000 7fe8bcd39640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe89c06ae70 0x7fe89c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.046+0000 7fe8bcd39640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe89c06ae70 0x7fe89c06d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80c0da0 tx=0x7fe8a80079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.048+0000 7fe8adffb640 1 -- 172.21.15.132:0/4214659 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe8b4054960 con 0x7fe8b806cd20 2023-11-18T20:38:32.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.237+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8b804e840 con 0x7fe8b806cd20 2023-11-18T20:38:32.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.237+0000 7fe8adffb640 1 -- 172.21.15.132:0/4214659 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8b401f020 con 0x7fe8b806cd20 2023-11-18T20:38:32.239 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:32.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe89c06ae70 msgr2=0x7fe89c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe89c06ae70 0x7fe89c06d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80c0da0 tx=0x7fe8a80079b0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 msgr2=0x7fe8b814d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b814d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c7f0 tx=0x7fe8b400ccb0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 shutdown_connections 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe89c06ae70 0x7fe89c06d330 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8b814e7f0 0x7fe8b80a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8b80c52e0 0x7fe8b814bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 --2- 172.21.15.132:0/4214659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b806cd20 0x7fe8b814d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 >> 172.21.15.132:0/4214659 conn(0x7fe8b80a77f0 msgr2=0x7fe8b806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.240+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 shutdown_connections 2023-11-18T20:38:32.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.241+0000 7fe8be53c640 1 -- 172.21.15.132:0/4214659 wait complete. 2023-11-18T20:38:32.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.461+0000 7fa59ddf0640 1 Processor -- start 2023-11-18T20:38:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.462+0000 7fa59ddf0640 1 -- start start 2023-11-18T20:38:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.463+0000 7fa59ddf0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa59814f9f0 0x7fa59806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.463+0000 7fa59ddf0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598152600 0x7fa598152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.463+0000 7fa59ddf0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5980a6de0 con 0x7fa5980c7540 2023-11-18T20:38:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.463+0000 7fa59ddf0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5980a7740 con 0x7fa59814f9f0 2023-11-18T20:38:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.463+0000 7fa59ddf0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980a7080 con 0x7fa598152600 2023-11-18T20:38:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.464+0000 7fa597fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598152600 0x7fa598152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.464+0000 7fa597fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598152600 0x7fa598152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:60722/0 (socket says 172.21.15.132:60722) 2023-11-18T20:38:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.464+0000 7fa597fff640 1 -- 172.21.15.132:0/1793989576 learned_addr learned my addr 172.21.15.132:0/1793989576 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.464+0000 7fa596ffd640 1 --1- 172.21.15.132:0/1793989576 >> v1:172.21.15.161:6789/0 conn(0x7fa5980c7540 0x7fa5980c47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:42642/0 (socket says 172.21.15.132:42642) 2023-11-18T20:38:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.464+0000 7fa5977fe640 1 --2- 172.21.15.132:0/1793989576 >> v2:172.21.15.161:3300/0 conn(0x7fa59814f9f0 0x7fa59806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.465+0000 7fa597fff640 1 -- 172.21.15.132:0/1793989576 >> v2:172.21.15.161:3300/0 conn(0x7fa59814f9f0 msgr2=0x7fa59806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:32.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.465+0000 7fa597fff640 1 --2- 172.21.15.132:0/1793989576 >> v2:172.21.15.161:3300/0 conn(0x7fa59814f9f0 0x7fa59806dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.465+0000 7fa597fff640 1 -- 172.21.15.132:0/1793989576 >> v1:172.21.15.161:6789/0 conn(0x7fa5980c7540 legacy=0x7fa5980c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.465+0000 7fa597fff640 1 -- 172.21.15.132:0/1793989576 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5980a7360 con 0x7fa598152600 2023-11-18T20:38:32.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.466+0000 7fa597fff640 1 --2- 172.21.15.132:0/1793989576 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598152600 0x7fa598152ab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa590009870 tx=0x7fa59002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3935368244474734 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.467+0000 7fa5967fc640 1 -- 172.21.15.132:0/1793989576 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590031640 con 0x7fa598152600 2023-11-18T20:38:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.467+0000 7fa5967fc640 1 -- 172.21.15.132:0/1793989576 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5900317a0 con 0x7fa598152600 2023-11-18T20:38:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.467+0000 7fa5967fc640 1 -- 172.21.15.132:0/1793989576 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590031b30 con 0x7fa598152600 2023-11-18T20:38:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.467+0000 7fa59ddf0640 1 -- 172.21.15.132:0/1793989576 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598152600 msgr2=0x7fa598152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.467+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/1793989576 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598152600 0x7fa598152ab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa590009870 tx=0x7fa59002b8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.468+0000 7fa59ddf0640 1 -- 172.21.15.132:0/1793989576 shutdown_connections 2023-11-18T20:38:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.468+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/1793989576 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598152600 0x7fa598152ab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.468+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/1793989576 >> v2:172.21.15.161:3300/0 conn(0x7fa59814f9f0 0x7fa59806dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.468+0000 7fa59ddf0640 1 -- 172.21.15.132:0/1793989576 >> 172.21.15.132:0/1793989576 conn(0x7fa5980c7dc0 msgr2=0x7fa5980c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.468+0000 7fa59ddf0640 1 -- 172.21.15.132:0/1793989576 shutdown_connections 2023-11-18T20:38:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.468+0000 7fa59ddf0640 1 -- 172.21.15.132:0/1793989576 wait complete. 2023-11-18T20:38:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.469+0000 7fa59ddf0640 1 Processor -- start 2023-11-18T20:38:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.469+0000 7fa59ddf0640 1 -- start start 2023-11-18T20:38:32.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.470+0000 7fa59ddf0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5980c7540 0x7fa5980c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.470+0000 7fa59ddf0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59814f9f0 0x7fa598153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.470+0000 7fa59ddf0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa598152600 0x7fa598154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.470+0000 7fa59ddf0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981553f0 con 0x7fa598152600 2023-11-18T20:38:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.470+0000 7fa59ddf0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59806c820 con 0x7fa59814f9f0 2023-11-18T20:38:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.470+0000 7fa59ddf0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981564d0 con 0x7fa5980c7540 2023-11-18T20:38:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa598152600 0x7fa598154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa598152600 0x7fa598154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40724/0 (socket says 172.21.15.132:40724) 2023-11-18T20:38:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 -- 172.21.15.132:0/2921093677 learned_addr learned my addr 172.21.15.132:0/2921093677 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:32.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa596ffd640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59814f9f0 0x7fa598153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa5977fe640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5980c7540 0x7fa5980c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 -- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5980c7540 msgr2=0x7fa5980c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5980c7540 0x7fa5980c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 -- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59814f9f0 msgr2=0x7fa598153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59814f9f0 0x7fa598153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 -- 172.21.15.132:0/2921093677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900094d0 con 0x7fa598152600 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa596ffd640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59814f9f0 0x7fa598153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.471+0000 7fa597fff640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa598152600 0x7fa598154030 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5900090b0 tx=0x7fa5900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.472+0000 7fa58ffff640 1 -- 172.21.15.132:0/2921093677 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59003a930 con 0x7fa598152600 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.472+0000 7fa58ffff640 1 -- 172.21.15.132:0/2921093677 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59003aad0 con 0x7fa598152600 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.472+0000 7fa58ffff640 1 -- 172.21.15.132:0/2921093677 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59003ae80 con 0x7fa598152600 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.472+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59806bef0 con 0x7fa598152600 2023-11-18T20:38:32.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.472+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59806c4b0 con 0x7fa598152600 2023-11-18T20:38:32.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.473+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa598068350 con 0x7fa598152600 2023-11-18T20:38:32.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.474+0000 7fa58ffff640 1 -- 172.21.15.132:0/2921093677 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa59002f050 con 0x7fa598152600 2023-11-18T20:38:32.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.475+0000 7fa58ffff640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57806ae40 0x7fa57806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.475+0000 7fa58ffff640 1 -- 172.21.15.132:0/2921093677 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5900ab4c0 con 0x7fa598152600 2023-11-18T20:38:32.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.475+0000 7fa5977fe640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57806ae40 0x7fa57806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.476+0000 7fa5977fe640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57806ae40 0x7fa57806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa588009fd0 tx=0x7fa58800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.479+0000 7fa58ffff640 1 -- 172.21.15.132:0/2921093677 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5900764d0 con 0x7fa598152600 2023-11-18T20:38:32.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.660+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa598153850 con 0x7fa598152600 2023-11-18T20:38:32.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.660+0000 7fa58ffff640 1 -- 172.21.15.132:0/2921093677 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa590079af0 con 0x7fa598152600 2023-11-18T20:38:32.662 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57806ae40 msgr2=0x7fa57806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57806ae40 0x7fa57806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa588009fd0 tx=0x7fa58800b040 comp rx=0 tx=0).stop 2023-11-18T20:38:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa598152600 msgr2=0x7fa598154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa598152600 0x7fa598154030 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5900090b0 tx=0x7fa5900046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 shutdown_connections 2023-11-18T20:38:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57806ae40 0x7fa57806d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa598152600 0x7fa598154030 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59814f9f0 0x7fa598153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 --2- 172.21.15.132:0/2921093677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5980c7540 0x7fa5980c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 >> 172.21.15.132:0/2921093677 conn(0x7fa5980c7dc0 msgr2=0x7fa5980c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:32.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 shutdown_connections 2023-11-18T20:38:32.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.664+0000 7fa59ddf0640 1 -- 172.21.15.132:0/2921093677 wait complete. 2023-11-18T20:38:32.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:32.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.893+0000 7f494c3d5640 1 Processor -- start 2023-11-18T20:38:32.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.893+0000 7f494c3d5640 1 -- start start 2023-11-18T20:38:32.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.894+0000 7f494c3d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f494406d0a0 0x7f4944152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.894+0000 7f494c3d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49440c64a0 con 0x7f49440c3ea0 2023-11-18T20:38:32.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.894+0000 7f494c3d5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49440c5c00 con 0x7f494414fd30 2023-11-18T20:38:32.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.894+0000 7f494c3d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c5ee0 con 0x7f494406d0a0 2023-11-18T20:38:32.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.895+0000 7f494a972640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f49440c3ea0 0x7f49440c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58728/0 (socket says 172.21.15.132:58728) 2023-11-18T20:38:32.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.895+0000 7f494a972640 1 -- 172.21.15.132:0/470717242 learned_addr learned my addr 172.21.15.132:0/470717242 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.895+0000 7f4949970640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f494406d0a0 0x7f4944152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.895+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217068354 0 0) 0x7f49440c64a0 con 0x7f49440c3ea0 2023-11-18T20:38:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.895+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4930003520 con 0x7f49440c3ea0 2023-11-18T20:38:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1716599929 0 0) 0x7f4930003520 con 0x7f49440c3ea0 2023-11-18T20:38:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f494406d0a0 msgr2=0x7f4944152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f494406d0a0 0x7f4944152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 >> v1:172.21.15.161:6789/0 conn(0x7f494414fd30 legacy=0x7f49440a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440c61c0 con 0x7f49440c3ea0 2023-11-18T20:38:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f493c0019f0 con 0x7f49440c3ea0 2023-11-18T20:38:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 >> v1:172.21.15.132:6789/0 conn(0x7f49440c3ea0 legacy=0x7f49440c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f494406d0a0 0x7f49300039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4930003f20 0x7f49300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930004d00 0x7f4930005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c5ee0 con 0x7f4930003f20 2023-11-18T20:38:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493000ba60 con 0x7f4930004d00 2023-11-18T20:38:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493000bc20 con 0x7f494406d0a0 2023-11-18T20:38:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f4949970640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4930003f20 0x7f49300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f4949970640 1 -- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f494406d0a0 msgr2=0x7f49300039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f4949970640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f494406d0a0 0x7f49300039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f4949970640 1 -- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930004d00 msgr2=0x7f4930005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:32.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f4949970640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930004d00 0x7f4930005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.896+0000 7f4949970640 1 -- 172.21.15.132:0/470717242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4930003520 con 0x7f4930003f20 2023-11-18T20:38:32.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f4949970640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4930003f20 0x7f49300047c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4934009a90 tx=0x7f49300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cdba1b5fb5ef8b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493402c6b0 con 0x7f4930003f20 2023-11-18T20:38:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493402c810 con 0x7f4930003f20 2023-11-18T20:38:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494916f640 1 -- 172.21.15.132:0/470717242 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493402cba0 con 0x7f4930003f20 2023-11-18T20:38:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494c3d5640 1 -- 172.21.15.132:0/470717242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4930003f20 msgr2=0x7f49300047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494c3d5640 1 --2- 172.21.15.132:0/470717242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4930003f20 0x7f49300047c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4934009a90 tx=0x7f49300057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494a972640 1 -- 172.21.15.132:0/470717242 reap_dead start 2023-11-18T20:38:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494c3d5640 1 -- 172.21.15.132:0/470717242 shutdown_connections 2023-11-18T20:38:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494c3d5640 1 -- 172.21.15.132:0/470717242 >> 172.21.15.132:0/470717242 conn(0x7f494406a500 msgr2=0x7f494406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494c3d5640 1 -- 172.21.15.132:0/470717242 shutdown_connections 2023-11-18T20:38:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.898+0000 7f494c3d5640 1 -- 172.21.15.132:0/470717242 wait complete. 2023-11-18T20:38:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.900+0000 7f494c3d5640 1 Processor -- start 2023-11-18T20:38:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.900+0000 7f494c3d5640 1 -- start start 2023-11-18T20:38:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.901+0000 7f494c3d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930003f20 0x7f4944155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.901+0000 7f494c3d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4944155fb0 0x7f4944156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.901+0000 7f494c3d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49440a9600 0x7f49440a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.901+0000 7f494c3d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4944154050 con 0x7f4944155fb0 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.901+0000 7f494c3d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440a9170 con 0x7f4930003f20 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.901+0000 7f494c3d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4944156970 con 0x7f49440a9600 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.901+0000 7f4949970640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4944155fb0 0x7f4944156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f4949970640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4944155fb0 0x7f4944156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40740/0 (socket says 172.21.15.132:40740) 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f4949970640 1 -- 172.21.15.132:0/3705897327 learned_addr learned my addr 172.21.15.132:0/3705897327 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f494a972640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49440a9600 0x7f49440a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f4949970640 1 -- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49440a9600 msgr2=0x7f49440a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f494a171640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930003f20 0x7f4944155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f4949970640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49440a9600 0x7f49440a9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f4949970640 1 -- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930003f20 msgr2=0x7f4944155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f4949970640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930003f20 0x7f4944155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f4949970640 1 -- 172.21.15.132:0/3705897327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440a9fc0 con 0x7f4944155fb0 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f494a972640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49440a9600 0x7f49440a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f494a171640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930003f20 0x7f4944155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f4949970640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4944155fb0 0x7f4944156430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f493402c250 tx=0x7f4934004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.902+0000 7f493affd640 1 -- 172.21.15.132:0/3705897327 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934003810 con 0x7f4944155fb0 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.903+0000 7f493affd640 1 -- 172.21.15.132:0/3705897327 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4934003970 con 0x7f4944155fb0 2023-11-18T20:38:32.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.903+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4944154050 con 0x7f4944155fb0 2023-11-18T20:38:32.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.903+0000 7f493affd640 1 -- 172.21.15.132:0/3705897327 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934003d00 con 0x7f4944155fb0 2023-11-18T20:38:32.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.903+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49441542a0 con 0x7f4944155fb0 2023-11-18T20:38:32.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.904+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4944068350 con 0x7f4944155fb0 2023-11-18T20:38:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.905+0000 7f493affd640 1 -- 172.21.15.132:0/3705897327 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4934047450 con 0x7f4944155fb0 2023-11-18T20:38:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.906+0000 7f493affd640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f492806ae40 0x7f492806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.906+0000 7f493affd640 1 -- 172.21.15.132:0/3705897327 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49340ab870 con 0x7f4944155fb0 2023-11-18T20:38:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.907+0000 7f494a171640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f492806ae40 0x7f492806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.908+0000 7f494a171640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f492806ae40 0x7f492806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49440c1b80 tx=0x7f4940009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:32.911+0000 7f493affd640 1 -- 172.21.15.132:0/3705897327 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f49340769c0 con 0x7f4944155fb0 2023-11-18T20:38:33.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.100+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49440c66d0 con 0x7f4944155fb0 2023-11-18T20:38:33.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.103+0000 7f493affd640 1 -- 172.21.15.132:0/3705897327 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f49340044e0 con 0x7f4944155fb0 2023-11-18T20:38:33.111 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:33.111 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:33.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f492806ae40 msgr2=0x7f492806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f492806ae40 0x7f492806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49440c1b80 tx=0x7f4940009040 comp rx=0 tx=0).stop 2023-11-18T20:38:33.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4944155fb0 msgr2=0x7f4944156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4944155fb0 0x7f4944156430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f493402c250 tx=0x7f4934004730 comp rx=0 tx=0).stop 2023-11-18T20:38:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 shutdown_connections 2023-11-18T20:38:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f492806ae40 0x7f492806d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49440a9600 0x7f49440a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4944155fb0 0x7f4944156430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 --2- 172.21.15.132:0/3705897327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4930003f20 0x7f4944155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.106+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 >> 172.21.15.132:0/3705897327 conn(0x7f494406a500 msgr2=0x7f494406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:33.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.107+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 shutdown_connections 2023-11-18T20:38:33.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.107+0000 7f494c3d5640 1 -- 172.21.15.132:0/3705897327 wait complete. 2023-11-18T20:38:33.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:33.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:33.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.342+0000 7f04ec960640 1 Processor -- start 2023-11-18T20:38:33.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.342+0000 7f04ec960640 1 -- start start 2023-11-18T20:38:33.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04ec960640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04e814e7c0 0x7f04e80c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04ec960640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f04e80c4c00 0x7f04e80ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04ec960640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e8158a60 con 0x7f04e80ca990 2023-11-18T20:38:33.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04ec960640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80c5b10 con 0x7f04e814e7c0 2023-11-18T20:38:33.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04ec960640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e8157ca0 con 0x7f04e80c4c00 2023-11-18T20:38:33.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04e6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04e814e7c0 0x7f04e80c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04e6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04e814e7c0 0x7f04e80c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40752/0 (socket says 172.21.15.132:40752) 2023-11-18T20:38:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04e6d9d640 1 -- 172.21.15.132:0/118965920 learned_addr learned my addr 172.21.15.132:0/118965920 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04e6d9d640 1 -- 172.21.15.132:0/118965920 >> v2:172.21.15.161:3300/0 conn(0x7f04e80c4c00 msgr2=0x7f04e80ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.344+0000 7f04e6d9d640 1 --2- 172.21.15.132:0/118965920 >> v2:172.21.15.161:3300/0 conn(0x7f04e80c4c00 0x7f04e80ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.345+0000 7f04e6d9d640 1 -- 172.21.15.132:0/118965920 >> v1:172.21.15.161:6789/0 conn(0x7f04e80ca990 legacy=0x7f04e8154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.345+0000 7f04e6d9d640 1 -- 172.21.15.132:0/118965920 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8157f80 con 0x7f04e814e7c0 2023-11-18T20:38:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.346+0000 7f04e6d9d640 1 --2- 172.21.15.132:0/118965920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e814e7c0 0x7f04e80c46c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04e80ac990 tx=0x7f04d802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3e3d330f51858f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.346+0000 7f04e5d9b640 1 -- 172.21.15.132:0/118965920 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8031750 con 0x7f04e814e7c0 2023-11-18T20:38:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.346+0000 7f04e5d9b640 1 -- 172.21.15.132:0/118965920 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d80318b0 con 0x7f04e814e7c0 2023-11-18T20:38:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.346+0000 7f04e5d9b640 1 -- 172.21.15.132:0/118965920 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8031c40 con 0x7f04e814e7c0 2023-11-18T20:38:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.347+0000 7f04ec960640 1 -- 172.21.15.132:0/118965920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e814e7c0 msgr2=0x7f04e80c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.347+0000 7f04ec960640 1 --2- 172.21.15.132:0/118965920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e814e7c0 0x7f04e80c46c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04e80ac990 tx=0x7f04d802b7f0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.347+0000 7f04ec960640 1 -- 172.21.15.132:0/118965920 shutdown_connections 2023-11-18T20:38:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.347+0000 7f04ec960640 1 --2- 172.21.15.132:0/118965920 >> v2:172.21.15.161:3300/0 conn(0x7f04e80c4c00 0x7f04e80ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.347+0000 7f04ec960640 1 --2- 172.21.15.132:0/118965920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e814e7c0 0x7f04e80c46c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.347+0000 7f04ec960640 1 -- 172.21.15.132:0/118965920 >> 172.21.15.132:0/118965920 conn(0x7f04e80abf00 msgr2=0x7f04e80c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.347+0000 7f04ec960640 1 -- 172.21.15.132:0/118965920 shutdown_connections 2023-11-18T20:38:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.347+0000 7f04ec960640 1 -- 172.21.15.132:0/118965920 wait complete. 2023-11-18T20:38:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.348+0000 7f04ec960640 1 Processor -- start 2023-11-18T20:38:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.349+0000 7f04ec960640 1 -- start start 2023-11-18T20:38:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.349+0000 7f04ec960640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e80c4c00 0x7f04e81ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.349+0000 7f04ec960640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e80ca990 0x7f04e81eb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04ec960640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e814e7c0 0x7f04e81eb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04ec960640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e81ee2d0 con 0x7f04e80ca990 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04ec960640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e8147d10 con 0x7f04e814e7c0 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04ec960640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e81edf60 con 0x7f04e80c4c00 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e80ca990 0x7f04e81eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e80ca990 0x7f04e81eb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40762/0 (socket says 172.21.15.132:40762) 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e659c640 1 -- 172.21.15.132:0/1623015163 learned_addr learned my addr 172.21.15.132:0/1623015163 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e6d9d640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e80c4c00 0x7f04e81ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e659c640 1 -- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e80c4c00 msgr2=0x7f04e81ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e659c640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e80c4c00 0x7f04e81ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e659c640 1 -- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e814e7c0 msgr2=0x7f04e81eb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e759e640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e814e7c0 0x7f04e81eb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e659c640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e814e7c0 0x7f04e81eb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e659c640 1 -- 172.21.15.132:0/1623015163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80094d0 con 0x7f04e80ca990 2023-11-18T20:38:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e6d9d640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e80c4c00 0x7f04e81ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.350+0000 7f04e759e640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e814e7c0 0x7f04e81eb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.351+0000 7f04e659c640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e80ca990 0x7f04e81eb240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00b4a0 tx=0x7f04dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.351+0000 7f04cf7fe640 1 -- 172.21.15.132:0/1623015163 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc010610 con 0x7f04e80ca990 2023-11-18T20:38:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.351+0000 7f04cf7fe640 1 -- 172.21.15.132:0/1623015163 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc010770 con 0x7f04e80ca990 2023-11-18T20:38:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.351+0000 7f04cf7fe640 1 -- 172.21.15.132:0/1623015163 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc010b20 con 0x7f04e80ca990 2023-11-18T20:38:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.351+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e80bf640 con 0x7f04e80ca990 2023-11-18T20:38:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.351+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e80c0570 con 0x7f04e80ca990 2023-11-18T20:38:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.352+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e80c5e90 con 0x7f04e80ca990 2023-11-18T20:38:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.353+0000 7f04cf7fe640 1 -- 172.21.15.132:0/1623015163 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04dc010c80 con 0x7f04e80ca990 2023-11-18T20:38:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.354+0000 7f04cf7fe640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f04d406ae70 0x7f04d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.355+0000 7f04cf7fe640 1 -- 172.21.15.132:0/1623015163 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04dc089270 con 0x7f04e80ca990 2023-11-18T20:38:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.355+0000 7f04e6d9d640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f04d406ae70 0x7f04d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.356+0000 7f04e6d9d640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f04d406ae70 0x7f04d406d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04d8035000 tx=0x7f04d8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.359+0000 7f04cf7fe640 1 -- 172.21.15.132:0/1623015163 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04dc054320 con 0x7f04e80ca990 2023-11-18T20:38:33.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.552+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04e81ee120 con 0x7f04e80ca990 2023-11-18T20:38:33.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.553+0000 7f04cf7fe640 1 -- 172.21.15.132:0/1623015163 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04dc057940 con 0x7f04e80ca990 2023-11-18T20:38:33.554 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:33.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f04d406ae70 msgr2=0x7f04d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f04d406ae70 0x7f04d406d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04d8035000 tx=0x7f04d8008030 comp rx=0 tx=0).stop 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e80ca990 msgr2=0x7f04e81eb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e80ca990 0x7f04e81eb240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00b4a0 tx=0x7f04dc00b960 comp rx=0 tx=0).stop 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 shutdown_connections 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f04d406ae70 0x7f04d406d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e814e7c0 0x7f04e81eb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04e80ca990 0x7f04e81eb240 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 --2- 172.21.15.132:0/1623015163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e80c4c00 0x7f04e81ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 >> 172.21.15.132:0/1623015163 conn(0x7f04e80abf00 msgr2=0x7f04e8149d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 shutdown_connections 2023-11-18T20:38:33.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.556+0000 7f04ec960640 1 -- 172.21.15.132:0/1623015163 wait complete. 2023-11-18T20:38:33.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:33.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.791+0000 7f1d507b0640 1 Processor -- start 2023-11-18T20:38:33.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.791+0000 7f1d507b0640 1 -- start start 2023-11-18T20:38:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.792+0000 7f1d507b0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d4814fd30 0x7f1d48152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.792+0000 7f1d507b0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d4806d0a0 0x7f1d480a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.792+0000 7f1d507b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1d480a5260 0x7f1d480c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.792+0000 7f1d507b0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d480c64a0 con 0x7f1d4806d0a0 2023-11-18T20:38:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.792+0000 7f1d507b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d480c5c00 con 0x7f1d480a5260 2023-11-18T20:38:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.792+0000 7f1d507b0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480c5ee0 con 0x7f1d4814fd30 2023-11-18T20:38:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4dd4b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d4806d0a0 0x7f1d480a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4dd4b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d4806d0a0 0x7f1d480a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40774/0 (socket says 172.21.15.132:40774) 2023-11-18T20:38:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4dd4b640 1 -- 172.21.15.132:0/3045951917 learned_addr learned my addr 172.21.15.132:0/3045951917 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4e54c640 1 --2- 172.21.15.132:0/3045951917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d4814fd30 0x7f1d48152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4dd4b640 1 -- 172.21.15.132:0/3045951917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d4814fd30 msgr2=0x7f1d48152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4dd4b640 1 --2- 172.21.15.132:0/3045951917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d4814fd30 0x7f1d48152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4ed4d640 1 --2- 172.21.15.132:0/3045951917 >> v2:172.21.15.161:3300/0 conn(0x7f1d480a5260 0x7f1d480c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4dd4b640 1 -- 172.21.15.132:0/3045951917 >> v2:172.21.15.161:3300/0 conn(0x7f1d480a5260 msgr2=0x7f1d480c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4dd4b640 1 --2- 172.21.15.132:0/3045951917 >> v2:172.21.15.161:3300/0 conn(0x7f1d480a5260 0x7f1d480c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.793+0000 7f1d4dd4b640 1 -- 172.21.15.132:0/3045951917 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d480c61c0 con 0x7f1d4806d0a0 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.794+0000 7f1d4dd4b640 1 --2- 172.21.15.132:0/3045951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d480a4d20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1d4806d990 tx=0x7f1d3802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eefbaec1df57c70 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.795+0000 7f1d4d54a640 1 -- 172.21.15.132:0/3045951917 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38031860 con 0x7f1d4806d0a0 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.795+0000 7f1d4d54a640 1 -- 172.21.15.132:0/3045951917 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d380319c0 con 0x7f1d4806d0a0 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.795+0000 7f1d4d54a640 1 -- 172.21.15.132:0/3045951917 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38031d50 con 0x7f1d4806d0a0 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 -- 172.21.15.132:0/3045951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 msgr2=0x7f1d480a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 --2- 172.21.15.132:0/3045951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d480a4d20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1d4806d990 tx=0x7f1d3802b900 comp rx=0 tx=0).stop 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 -- 172.21.15.132:0/3045951917 shutdown_connections 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 --2- 172.21.15.132:0/3045951917 >> v2:172.21.15.161:3300/0 conn(0x7f1d480a5260 0x7f1d480c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 --2- 172.21.15.132:0/3045951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d480a4d20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 --2- 172.21.15.132:0/3045951917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d4814fd30 0x7f1d48152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 -- 172.21.15.132:0/3045951917 >> 172.21.15.132:0/3045951917 conn(0x7f1d4806a500 msgr2=0x7f1d4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:33.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 -- 172.21.15.132:0/3045951917 shutdown_connections 2023-11-18T20:38:33.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.796+0000 7f1d507b0640 1 -- 172.21.15.132:0/3045951917 wait complete. 2023-11-18T20:38:33.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.798+0000 7f1d507b0640 1 Processor -- start 2023-11-18T20:38:33.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.798+0000 7f1d507b0640 1 -- start start 2023-11-18T20:38:33.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d507b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d481f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d507b0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d480a5260 0x7f1d48070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d507b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d4814fd30 0x7f1d4814c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d507b0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480a2860 con 0x7f1d4806d0a0 2023-11-18T20:38:33.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d507b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480a8e70 con 0x7f1d4814fd30 2023-11-18T20:38:33.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d507b0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d481f2420 con 0x7f1d480a5260 2023-11-18T20:38:33.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d4e54c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d481f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d4e54c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d481f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40776/0 (socket says 172.21.15.132:40776) 2023-11-18T20:38:33.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.799+0000 7f1d4e54c640 1 -- 172.21.15.132:0/695152403 learned_addr learned my addr 172.21.15.132:0/695152403 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:33.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d4e54c640 1 -- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d480a5260 msgr2=0x7f1d48070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d4e54c640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d480a5260 0x7f1d48070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d4e54c640 1 -- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d4814fd30 msgr2=0x7f1d4814c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:33.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d4e54c640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d4814fd30 0x7f1d4814c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:33.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d4e54c640 1 -- 172.21.15.132:0/695152403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380094d0 con 0x7f1d4806d0a0 2023-11-18T20:38:33.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d4e54c640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d481f1ee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c7f0 tx=0x7f1d4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:33.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d3effd640 1 -- 172.21.15.132:0/695152403 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44004220 con 0x7f1d4806d0a0 2023-11-18T20:38:33.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d3effd640 1 -- 172.21.15.132:0/695152403 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44004380 con 0x7f1d4806d0a0 2023-11-18T20:38:33.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d3effd640 1 -- 172.21.15.132:0/695152403 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44007840 con 0x7f1d4806d0a0 2023-11-18T20:38:33.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.800+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d480aa3a0 con 0x7f1d4806d0a0 2023-11-18T20:38:33.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.801+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d480aa960 con 0x7f1d4806d0a0 2023-11-18T20:38:33.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.802+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d48068350 con 0x7f1d4806d0a0 2023-11-18T20:38:33.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.803+0000 7f1d3effd640 1 -- 172.21.15.132:0/695152403 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d44007bb0 con 0x7f1d4806d0a0 2023-11-18T20:38:33.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.803+0000 7f1d3effd640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1d2c06ae70 0x7f1d2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:33.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.804+0000 7f1d3effd640 1 -- 172.21.15.132:0/695152403 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d440894a0 con 0x7f1d4806d0a0 2023-11-18T20:38:33.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.804+0000 7f1d4dd4b640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1d2c06ae70 0x7f1d2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:33.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.805+0000 7f1d4dd4b640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1d2c06ae70 0x7f1d2c06d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d38036000 tx=0x7f1d38030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:33.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.809+0000 7f1d3effd640 1 -- 172.21.15.132:0/695152403 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d440545e0 con 0x7f1d4806d0a0 2023-11-18T20:38:34.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:33.999+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d480c66d0 con 0x7f1d4806d0a0 2023-11-18T20:38:34.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.000+0000 7f1d3effd640 1 -- 172.21.15.132:0/695152403 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d44007e60 con 0x7f1d4806d0a0 2023-11-18T20:38:34.001 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:34.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1d2c06ae70 msgr2=0x7f1d2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1d2c06ae70 0x7f1d2c06d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d38036000 tx=0x7f1d38030000 comp rx=0 tx=0).stop 2023-11-18T20:38:34.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 msgr2=0x7f1d481f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d481f1ee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c7f0 tx=0x7f1d4400ccb0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 shutdown_connections 2023-11-18T20:38:34.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1d2c06ae70 0x7f1d2c06d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d4814fd30 0x7f1d4814c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d480a5260 0x7f1d48070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 --2- 172.21.15.132:0/695152403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806d0a0 0x7f1d481f1ee0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 >> 172.21.15.132:0/695152403 conn(0x7f1d4806a500 msgr2=0x7f1d4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:34.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 shutdown_connections 2023-11-18T20:38:34.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.003+0000 7f1d507b0640 1 -- 172.21.15.132:0/695152403 wait complete. 2023-11-18T20:38:34.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.229+0000 7f1e11809640 1 Processor -- start 2023-11-18T20:38:34.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.230+0000 7f1e11809640 1 -- start start 2023-11-18T20:38:34.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.231+0000 7f1e11809640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c14faf0 0x7f1e0c06e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.231+0000 7f1e11809640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e0c06b510 0x7f1e0c06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.231+0000 7f1e11809640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0c0aae20 con 0x7f1e0c0ab850 2023-11-18T20:38:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.231+0000 7f1e11809640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0c0c2fe0 con 0x7f1e0c06b510 2023-11-18T20:38:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.231+0000 7f1e11809640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0a99e0 con 0x7f1e0c14faf0 2023-11-18T20:38:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.232+0000 7f1e0affd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c14faf0 0x7f1e0c06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.232+0000 7f1e0affd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c14faf0 0x7f1e0c06e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:60796/0 (socket says 172.21.15.132:60796) 2023-11-18T20:38:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.232+0000 7f1e0affd640 1 -- 172.21.15.132:0/2581042385 learned_addr learned my addr 172.21.15.132:0/2581042385 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.232+0000 7f1e0b7fe640 1 --2- 172.21.15.132:0/2581042385 >> v2:172.21.15.161:3300/0 conn(0x7f1e0c06b510 0x7f1e0c06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.233+0000 7f1e0affd640 1 -- 172.21.15.132:0/2581042385 >> v2:172.21.15.161:3300/0 conn(0x7f1e0c06b510 msgr2=0x7f1e0c06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.233+0000 7f1e0affd640 1 --2- 172.21.15.132:0/2581042385 >> v2:172.21.15.161:3300/0 conn(0x7f1e0c06b510 0x7f1e0c06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.233+0000 7f1e0affd640 1 -- 172.21.15.132:0/2581042385 >> v1:172.21.15.161:6789/0 conn(0x7f1e0c0ab850 legacy=0x7f1e0c152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.233+0000 7f1e0affd640 1 -- 172.21.15.132:0/2581042385 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c0c2780 con 0x7f1e0c14faf0 2023-11-18T20:38:34.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.234+0000 7f1e0affd640 1 --2- 172.21.15.132:0/2581042385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c14faf0 0x7f1e0c06e950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009e50 tx=0x7f1dfc02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1cb73b72111a3f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:34.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.235+0000 7f1e09ffb640 1 -- 172.21.15.132:0/2581042385 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc02ca70 con 0x7f1e0c14faf0 2023-11-18T20:38:34.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.235+0000 7f1e09ffb640 1 -- 172.21.15.132:0/2581042385 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc02cbd0 con 0x7f1e0c14faf0 2023-11-18T20:38:34.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.235+0000 7f1e09ffb640 1 -- 172.21.15.132:0/2581042385 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0343f0 con 0x7f1e0c14faf0 2023-11-18T20:38:34.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.236+0000 7f1e11809640 1 -- 172.21.15.132:0/2581042385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c14faf0 msgr2=0x7f1e0c06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.236+0000 7f1e11809640 1 --2- 172.21.15.132:0/2581042385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c14faf0 0x7f1e0c06e950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009e50 tx=0x7f1dfc02bed0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.236+0000 7f1e11809640 1 -- 172.21.15.132:0/2581042385 shutdown_connections 2023-11-18T20:38:34.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.236+0000 7f1e11809640 1 --2- 172.21.15.132:0/2581042385 >> v2:172.21.15.161:3300/0 conn(0x7f1e0c06b510 0x7f1e0c06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.236+0000 7f1e11809640 1 --2- 172.21.15.132:0/2581042385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c14faf0 0x7f1e0c06e950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.236+0000 7f1e11809640 1 -- 172.21.15.132:0/2581042385 >> 172.21.15.132:0/2581042385 conn(0x7f1e0c0c3120 msgr2=0x7f1e0c0c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:34.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.236+0000 7f1e11809640 1 -- 172.21.15.132:0/2581042385 shutdown_connections 2023-11-18T20:38:34.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.236+0000 7f1e11809640 1 -- 172.21.15.132:0/2581042385 wait complete. 2023-11-18T20:38:34.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.237+0000 7f1e11809640 1 Processor -- start 2023-11-18T20:38:34.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.238+0000 7f1e11809640 1 -- start start 2023-11-18T20:38:34.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.238+0000 7f1e11809640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e0c06b510 0x7f1e0c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.238+0000 7f1e11809640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c0ab850 0x7f1e0c0bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.238+0000 7f1e11809640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e0c14faf0 0x7f1e0c1ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.238+0000 7f1e11809640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c14a9e0 con 0x7f1e0c06b510 2023-11-18T20:38:34.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.238+0000 7f1e11809640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c14c640 con 0x7f1e0c14faf0 2023-11-18T20:38:34.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.238+0000 7f1e11809640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c14c1b0 con 0x7f1e0c0ab850 2023-11-18T20:38:34.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e0c06b510 0x7f1e0c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e0c06b510 0x7f1e0c14c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40784/0 (socket says 172.21.15.132:40784) 2023-11-18T20:38:34.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0affd640 1 -- 172.21.15.132:0/823195056 learned_addr learned my addr 172.21.15.132:0/823195056 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:34.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0a7fc640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c0ab850 0x7f1e0c0bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0b7fe640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e0c14faf0 0x7f1e0c1ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0affd640 1 -- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c0ab850 msgr2=0x7f1e0c0bfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0affd640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c0ab850 0x7f1e0c0bfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0affd640 1 -- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e0c14faf0 msgr2=0x7f1e0c1ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0affd640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e0c14faf0 0x7f1e0c1ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0affd640 1 -- 172.21.15.132:0/823195056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc009b30 con 0x7f1e0c06b510 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.239+0000 7f1e0b7fe640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e0c14faf0 0x7f1e0c1ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.240+0000 7f1e0affd640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e0c06b510 0x7f1e0c14c9d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009f70 tx=0x7f1dfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.240+0000 7f1e03fff640 1 -- 172.21.15.132:0/823195056 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc040670 con 0x7f1e0c06b510 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.240+0000 7f1e03fff640 1 -- 172.21.15.132:0/823195056 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc040810 con 0x7f1e0c06b510 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.240+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c14a150 con 0x7f1e0c06b510 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.240+0000 7f1e03fff640 1 -- 172.21.15.132:0/823195056 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc040bc0 con 0x7f1e0c06b510 2023-11-18T20:38:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.240+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0c14be40 con 0x7f1e0c06b510 2023-11-18T20:38:34.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.241+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0c068350 con 0x7f1e0c06b510 2023-11-18T20:38:34.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.242+0000 7f1e03fff640 1 -- 172.21.15.132:0/823195056 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dfc040d20 con 0x7f1e0c06b510 2023-11-18T20:38:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.243+0000 7f1e03fff640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1dec06ae40 0x7f1dec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.243+0000 7f1e03fff640 1 -- 172.21.15.132:0/823195056 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dfc0ac5b0 con 0x7f1e0c06b510 2023-11-18T20:38:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.244+0000 7f1e0a7fc640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1dec06ae40 0x7f1dec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.245+0000 7f1e0a7fc640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1dec06ae40 0x7f1dec06d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c06e4b0 tx=0x7f1df4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:34.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.248+0000 7f1e03fff640 1 -- 172.21.15.132:0/823195056 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1dfc077780 con 0x7f1e0c06b510 2023-11-18T20:38:34.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.439+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e0c0738c0 con 0x7f1e0c06b510 2023-11-18T20:38:34.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.440+0000 7f1e03fff640 1 -- 172.21.15.132:0/823195056 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1dfc07ada0 con 0x7f1e0c06b510 2023-11-18T20:38:34.441 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:34.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1dec06ae40 msgr2=0x7f1dec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1dec06ae40 0x7f1dec06d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c06e4b0 tx=0x7f1df4009040 comp rx=0 tx=0).stop 2023-11-18T20:38:34.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e0c06b510 msgr2=0x7f1e0c14c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e0c06b510 0x7f1e0c14c9d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009f70 tx=0x7f1dfc004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:34.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 shutdown_connections 2023-11-18T20:38:34.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1dec06ae40 0x7f1dec06d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e0c14faf0 0x7f1e0c1ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e0c0ab850 0x7f1e0c0bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 --2- 172.21.15.132:0/823195056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e0c06b510 0x7f1e0c14c9d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 >> 172.21.15.132:0/823195056 conn(0x7f1e0c0c3120 msgr2=0x7f1e0c14d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:34.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 shutdown_connections 2023-11-18T20:38:34.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.443+0000 7f1e11809640 1 -- 172.21.15.132:0/823195056 wait complete. 2023-11-18T20:38:34.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:34.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.680+0000 7f5186b90640 1 Processor -- start 2023-11-18T20:38:34.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.680+0000 7f5186b90640 1 -- start start 2023-11-18T20:38:34.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.681+0000 7f5186b90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 0x7f5180152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.681+0000 7f5186b90640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51800c3ea0 0x7f51800c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.681+0000 7f5186b90640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51800c64a0 con 0x7f518006d0a0 2023-11-18T20:38:34.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.681+0000 7f5186b90640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800c5c00 con 0x7f51800c3ea0 2023-11-18T20:38:34.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.681+0000 7f5186b90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51800c5ee0 con 0x7f518014fd30 2023-11-18T20:38:34.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.682+0000 7f518512d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51800c3ea0 0x7f51800c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.682+0000 7f518512d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51800c3ea0 0x7f51800c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40794/0 (socket says 172.21.15.132:40794) 2023-11-18T20:38:34.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.682+0000 7f518512d640 1 -- 172.21.15.132:0/446750227 learned_addr learned my addr 172.21.15.132:0/446750227 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:34.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.682+0000 7f518492c640 1 --2- 172.21.15.132:0/446750227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 0x7f5180152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.682+0000 7f518512d640 1 -- 172.21.15.132:0/446750227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 msgr2=0x7f5180152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:34.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.682+0000 7f518512d640 1 --2- 172.21.15.132:0/446750227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 0x7f5180152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.682+0000 7f518512d640 1 -- 172.21.15.132:0/446750227 >> v1:172.21.15.161:6789/0 conn(0x7f518006d0a0 legacy=0x7f51800a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.683+0000 7f518512d640 1 -- 172.21.15.132:0/446750227 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51800c61c0 con 0x7f51800c3ea0 2023-11-18T20:38:34.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.684+0000 7f518512d640 1 --2- 172.21.15.132:0/446750227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800c4330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5178009e50 tx=0x7f517802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe25434588361b10 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:34.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.684+0000 7f517f7fe640 1 -- 172.21.15.132:0/446750227 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517802cb00 con 0x7f51800c3ea0 2023-11-18T20:38:34.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.684+0000 7f517f7fe640 1 -- 172.21.15.132:0/446750227 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517802cc60 con 0x7f51800c3ea0 2023-11-18T20:38:34.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.684+0000 7f517f7fe640 1 -- 172.21.15.132:0/446750227 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51780343f0 con 0x7f51800c3ea0 2023-11-18T20:38:34.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.685+0000 7f5186b90640 1 -- 172.21.15.132:0/446750227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 msgr2=0x7f51800c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.685+0000 7f5186b90640 1 --2- 172.21.15.132:0/446750227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800c4330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5178009e50 tx=0x7f517802bf60 comp rx=0 tx=0).stop 2023-11-18T20:38:34.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.685+0000 7f5186b90640 1 -- 172.21.15.132:0/446750227 shutdown_connections 2023-11-18T20:38:34.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.685+0000 7f5186b90640 1 --2- 172.21.15.132:0/446750227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800c4330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.685+0000 7f5186b90640 1 --2- 172.21.15.132:0/446750227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 0x7f5180152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.685+0000 7f5186b90640 1 -- 172.21.15.132:0/446750227 >> 172.21.15.132:0/446750227 conn(0x7f518006a500 msgr2=0x7f518006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:34.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.685+0000 7f5186b90640 1 -- 172.21.15.132:0/446750227 shutdown_connections 2023-11-18T20:38:34.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.685+0000 7f5186b90640 1 -- 172.21.15.132:0/446750227 wait complete. 2023-11-18T20:38:34.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.687+0000 7f5186b90640 1 Processor -- start 2023-11-18T20:38:34.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.687+0000 7f5186b90640 1 -- start start 2023-11-18T20:38:34.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f5186b90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f518006d0a0 0x7f5180156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f5186b90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f5186b90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 0x7f51800bf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f5186b90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51801e8cb0 con 0x7f51800c3ea0 2023-11-18T20:38:34.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f5186b90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51801e8f90 con 0x7f518006d0a0 2023-11-18T20:38:34.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f5186b90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51801dbc70 con 0x7f518014fd30 2023-11-18T20:38:34.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f517ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f517ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800bb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40800/0 (socket says 172.21.15.132:40800) 2023-11-18T20:38:34.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.688+0000 7f517ffff640 1 -- 172.21.15.132:0/2697359555 learned_addr learned my addr 172.21.15.132:0/2697359555 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:34.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f518512d640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 0x7f51800bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f518492c640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f518006d0a0 0x7f5180156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517ffff640 1 -- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 msgr2=0x7f51800bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517ffff640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 0x7f51800bf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517ffff640 1 -- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f518006d0a0 msgr2=0x7f5180156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517ffff640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f518006d0a0 0x7f5180156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517ffff640 1 -- 172.21.15.132:0/2697359555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178009b30 con 0x7f51800c3ea0 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517ffff640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800bb4d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c3c0 tx=0x7f516c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517d7fa640 1 -- 172.21.15.132:0/2697359555 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c0052d0 con 0x7f51800c3ea0 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517d7fa640 1 -- 172.21.15.132:0/2697359555 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c005450 con 0x7f51800c3ea0 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f517d7fa640 1 -- 172.21.15.132:0/2697359555 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c003830 con 0x7f51800c3ea0 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51801dbf50 con 0x7f51800c3ea0 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.689+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5180156780 con 0x7f51800c3ea0 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.690+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51801dbad0 con 0x7f51800c3ea0 2023-11-18T20:38:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.692+0000 7f517d7fa640 1 -- 172.21.15.132:0/2697359555 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f516c003990 con 0x7f51800c3ea0 2023-11-18T20:38:34.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.693+0000 7f517d7fa640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516406ae70 0x7f516406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:34.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.693+0000 7f517d7fa640 1 -- 172.21.15.132:0/2697359555 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f516c088b40 con 0x7f51800c3ea0 2023-11-18T20:38:34.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.693+0000 7f518492c640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516406ae70 0x7f516406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.694+0000 7f518492c640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516406ae70 0x7f516406d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5174006fd0 tx=0x7f5174008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:34.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.697+0000 7f517d7fa640 1 -- 172.21.15.132:0/2697359555 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51801dbad0 con 0x7f51800c3ea0 2023-11-18T20:38:34.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.891+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51801dbad0 con 0x7f51800c3ea0 2023-11-18T20:38:34.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.894+0000 7f517d7fa640 1 -- 172.21.15.132:0/2697359555 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f51801dbad0 con 0x7f51800c3ea0 2023-11-18T20:38:34.895 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:34.895 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:34.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516406ae70 msgr2=0x7f516406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516406ae70 0x7f516406d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5174006fd0 tx=0x7f5174008040 comp rx=0 tx=0).stop 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 msgr2=0x7f51800bb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800bb4d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c3c0 tx=0x7f516c00c880 comp rx=0 tx=0).stop 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 shutdown_connections 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516406ae70 0x7f516406d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518014fd30 0x7f51800bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51800c3ea0 0x7f51800bb4d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 --2- 172.21.15.132:0/2697359555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f518006d0a0 0x7f5180156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.896+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 >> 172.21.15.132:0/2697359555 conn(0x7f518006a500 msgr2=0x7f5180151d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:34.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.897+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 shutdown_connections 2023-11-18T20:38:34.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:34.897+0000 7f5186b90640 1 -- 172.21.15.132:0/2697359555 wait complete. 2023-11-18T20:38:34.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:34.918 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:35.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.123+0000 7f8e216cf640 1 Processor -- start 2023-11-18T20:38:35.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.123+0000 7f8e216cf640 1 -- start start 2023-11-18T20:38:35.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.125+0000 7f8e216cf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c155490 0x7f8e1c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.125+0000 7f8e216cf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8e1c0c1500 0x7f8e1c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.125+0000 7f8e216cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c0c06c0 con 0x7f8e1c0c4080 2023-11-18T20:38:35.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.125+0000 7f8e216cf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c0a5820 con 0x7f8e1c0c1500 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.125+0000 7f8e216cf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c1020 con 0x7f8e1c155490 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8e1c0c4080 0x7f8e1c0c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58736/0 (socket says 172.21.15.132:58736) 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1b7fe640 1 -- 172.21.15.132:0/3049785093 learned_addr learned my addr 172.21.15.132:0/3049785093 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1affd640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c155490 0x7f8e1c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e13fff640 1 --2- 172.21.15.132:0/3049785093 >> v2:172.21.15.161:3300/0 conn(0x7f8e1c0c1500 0x7f8e1c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162803108 0 0) 0x7f8e1c0c06c0 con 0x7f8e1c0c4080 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e08003520 con 0x7f8e1c0c4080 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 236876902 0 0) 0x7f8e08003520 con 0x7f8e1c0c4080 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c155490 msgr2=0x7f8e1c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c155490 0x7f8e1c0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 >> v2:172.21.15.161:3300/0 conn(0x7f8e1c0c1500 msgr2=0x7f8e1c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 --2- 172.21.15.132:0/3049785093 >> v2:172.21.15.161:3300/0 conn(0x7f8e1c0c1500 0x7f8e1c0a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0c0910 con 0x7f8e1c0c4080 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f8e140019f0 con 0x7f8e1c0c4080 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e13fff640 1 --2- 172.21.15.132:0/3049785093 >> v2:172.21.15.161:3300/0 conn(0x7f8e1c0c1500 0x7f8e1c0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.126+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 >> v1:172.21.15.132:6789/0 conn(0x7f8e1c0c4080 legacy=0x7f8e1c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1a7fc640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1a7fc640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c155490 0x7f8e080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1a7fc640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e08004d00 0x7f8e08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c1020 con 0x7f8e08003970 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0800dbc0 con 0x7f8e08004d00 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0800dd80 con 0x7f8e1c155490 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1affd640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e13fff640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c155490 0x7f8e080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1affd640 1 -- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c155490 msgr2=0x7f8e080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:35.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1affd640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c155490 0x7f8e080047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1affd640 1 -- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e08004d00 msgr2=0x7f8e08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:35.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1affd640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e08004d00 0x7f8e08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.127+0000 7f8e1affd640 1 -- 172.21.15.132:0/3049785093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08003520 con 0x7f8e08003970 2023-11-18T20:38:35.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.128+0000 7f8e1affd640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e08003d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009ac0 tx=0x7f8e080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b694d3e06f73e8de server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:35.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.128+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c02c6b0 con 0x7f8e08003970 2023-11-18T20:38:35.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c02c810 con 0x7f8e08003970 2023-11-18T20:38:35.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e1a7fc640 1 -- 172.21.15.132:0/3049785093 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c02cba0 con 0x7f8e08003970 2023-11-18T20:38:35.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e216cf640 1 -- 172.21.15.132:0/3049785093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 msgr2=0x7f8e08003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e216cf640 1 --2- 172.21.15.132:0/3049785093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e08003d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009ac0 tx=0x7f8e080057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e1b7fe640 1 -- 172.21.15.132:0/3049785093 reap_dead start 2023-11-18T20:38:35.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e216cf640 1 -- 172.21.15.132:0/3049785093 shutdown_connections 2023-11-18T20:38:35.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e216cf640 1 -- 172.21.15.132:0/3049785093 >> 172.21.15.132:0/3049785093 conn(0x7f8e1c06a500 msgr2=0x7f8e1c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:35.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e216cf640 1 -- 172.21.15.132:0/3049785093 shutdown_connections 2023-11-18T20:38:35.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.129+0000 7f8e216cf640 1 -- 172.21.15.132:0/3049785093 wait complete. 2023-11-18T20:38:35.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.131+0000 7f8e216cf640 1 Processor -- start 2023-11-18T20:38:35.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.131+0000 7f8e216cf640 1 -- start start 2023-11-18T20:38:35.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e216cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e1c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e216cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e1c14e910 0x7f8e1c142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e216cf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c1431f0 0x7f8e1c1e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e216cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0bcde0 con 0x7f8e08003970 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e216cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0713a0 con 0x7f8e1c14e910 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e216cf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0bad70 con 0x7f8e1c1431f0 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e1affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e1c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e1affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e1c1503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40818/0 (socket says 172.21.15.132:40818) 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e1affd640 1 -- 172.21.15.132:0/2362498040 learned_addr learned my addr 172.21.15.132:0/2362498040 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.132+0000 7f8e13fff640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e1c14e910 0x7f8e1c142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e1b7fe640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c1431f0 0x7f8e1c1e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e1affd640 1 -- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c1431f0 msgr2=0x7f8e1c1e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e1affd640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c1431f0 0x7f8e1c1e5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e1affd640 1 -- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e1c14e910 msgr2=0x7f8e1c142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e1affd640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e1c14e910 0x7f8e1c142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e1affd640 1 -- 172.21.15.132:0/2362498040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c1ea070 con 0x7f8e08003970 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e13fff640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e1c14e910 0x7f8e1c142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e1affd640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e1c1503a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c02c250 tx=0x7f8e0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e137fe640 1 -- 172.21.15.132:0/2362498040 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c003810 con 0x7f8e08003970 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e137fe640 1 -- 172.21.15.132:0/2362498040 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c003990 con 0x7f8e08003970 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e137fe640 1 -- 172.21.15.132:0/2362498040 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c003d40 con 0x7f8e08003970 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c071640 con 0x7f8e08003970 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.133+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c1508e0 con 0x7f8e08003970 2023-11-18T20:38:35.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.134+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c068350 con 0x7f8e08003970 2023-11-18T20:38:35.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.135+0000 7f8e137fe640 1 -- 172.21.15.132:0/2362498040 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e0c040450 con 0x7f8e08003970 2023-11-18T20:38:35.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.136+0000 7f8e137fe640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8dfc06ae40 0x7f8dfc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.136+0000 7f8e137fe640 1 -- 172.21.15.132:0/2362498040 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e0c0ab650 con 0x7f8e08003970 2023-11-18T20:38:35.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.137+0000 7f8e13fff640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8dfc06ae40 0x7f8dfc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.138+0000 7f8e13fff640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8dfc06ae40 0x7f8dfc06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0712d0 tx=0x7f8e04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:35.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.141+0000 7f8e137fe640 1 -- 172.21.15.132:0/2362498040 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e0c0766f0 con 0x7f8e08003970 2023-11-18T20:38:35.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.329+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e1c0c03a0 con 0x7f8e08003970 2023-11-18T20:38:35.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.330+0000 7f8e137fe640 1 -- 172.21.15.132:0/2362498040 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e0c079d10 con 0x7f8e08003970 2023-11-18T20:38:35.331 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.332+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8dfc06ae40 msgr2=0x7f8dfc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.332+0000 7f8e216cf640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8dfc06ae40 0x7f8dfc06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0712d0 tx=0x7f8e04008040 comp rx=0 tx=0).stop 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.332+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 msgr2=0x7f8e1c1503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.332+0000 7f8e216cf640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e1c1503a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c02c250 tx=0x7f8e0c004730 comp rx=0 tx=0).stop 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.333+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 shutdown_connections 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.333+0000 7f8e216cf640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8dfc06ae40 0x7f8dfc06d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.333+0000 7f8e216cf640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e1c1431f0 0x7f8e1c1e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.333+0000 7f8e216cf640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e1c14e910 0x7f8e1c142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.333+0000 7f8e216cf640 1 --2- 172.21.15.132:0/2362498040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e08003970 0x7f8e1c1503a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.333+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 >> 172.21.15.132:0/2362498040 conn(0x7f8e1c06a500 msgr2=0x7f8e1c0c51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:35.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.333+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 shutdown_connections 2023-11-18T20:38:35.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.333+0000 7f8e216cf640 1 -- 172.21.15.132:0/2362498040 wait complete. 2023-11-18T20:38:35.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:35.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.570+0000 7fa814283640 1 Processor -- start 2023-11-18T20:38:35.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.570+0000 7fa814283640 1 -- start start 2023-11-18T20:38:35.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.571+0000 7fa814283640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa80c155490 0x7fa80c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.571+0000 7fa814283640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa80c0c1500 0x7fa80c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa814283640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 0x7fa80c0a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa814283640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c0a5820 con 0x7fa80c155490 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa814283640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c0c06c0 con 0x7fa80c0c1500 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa814283640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0c1020 con 0x7fa80c0c4080 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81201f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa80c155490 0x7fa80c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81201f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa80c155490 0x7fa80c0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40832/0 (socket says 172.21.15.132:40832) 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81201f640 1 -- 172.21.15.132:0/369307490 learned_addr learned my addr 172.21.15.132:0/369307490 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa812820640 1 --2- 172.21.15.132:0/369307490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 0x7fa80c0a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81201f640 1 -- 172.21.15.132:0/369307490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 msgr2=0x7fa80c0a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:35.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81181e640 1 --2- 172.21.15.132:0/369307490 >> v2:172.21.15.161:3300/0 conn(0x7fa80c0c1500 0x7fa80c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81201f640 1 --2- 172.21.15.132:0/369307490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 0x7fa80c0a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81201f640 1 -- 172.21.15.132:0/369307490 >> v2:172.21.15.161:3300/0 conn(0x7fa80c0c1500 msgr2=0x7fa80c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:35.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81201f640 1 --2- 172.21.15.132:0/369307490 >> v2:172.21.15.161:3300/0 conn(0x7fa80c0c1500 0x7fa80c0a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.572+0000 7fa81201f640 1 -- 172.21.15.132:0/369307490 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c0c0910 con 0x7fa80c155490 2023-11-18T20:38:35.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.574+0000 7fa81201f640 1 --2- 172.21.15.132:0/369307490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c155490 0x7fa80c0a51b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0a5160 tx=0x7fa80802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e7f8f9d379534 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:35.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.574+0000 7fa81101d640 1 -- 172.21.15.132:0/369307490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8080317e0 con 0x7fa80c155490 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.574+0000 7fa81101d640 1 -- 172.21.15.132:0/369307490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808031940 con 0x7fa80c155490 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.574+0000 7fa81101d640 1 -- 172.21.15.132:0/369307490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808031cd0 con 0x7fa80c155490 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 -- 172.21.15.132:0/369307490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c155490 msgr2=0x7fa80c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 --2- 172.21.15.132:0/369307490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c155490 0x7fa80c0a51b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0a5160 tx=0x7fa80802b880 comp rx=0 tx=0).stop 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 -- 172.21.15.132:0/369307490 shutdown_connections 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 --2- 172.21.15.132:0/369307490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 0x7fa80c0a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 --2- 172.21.15.132:0/369307490 >> v2:172.21.15.161:3300/0 conn(0x7fa80c0c1500 0x7fa80c0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 --2- 172.21.15.132:0/369307490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c155490 0x7fa80c0a51b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 -- 172.21.15.132:0/369307490 >> 172.21.15.132:0/369307490 conn(0x7fa80c06a500 msgr2=0x7fa80c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 -- 172.21.15.132:0/369307490 shutdown_connections 2023-11-18T20:38:35.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.575+0000 7fa814283640 1 -- 172.21.15.132:0/369307490 wait complete. 2023-11-18T20:38:35.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.576+0000 7fa814283640 1 Processor -- start 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.577+0000 7fa814283640 1 -- start start 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.577+0000 7fa814283640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c0c1500 0x7fa80c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.577+0000 7fa814283640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 0x7fa80c1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa814283640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80c155490 0x7fa80c149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa814283640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c14c830 con 0x7fa80c0c1500 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa814283640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c150940 con 0x7fa80c155490 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa814283640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c14fef0 con 0x7fa80c0c4080 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81201f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c0c1500 0x7fa80c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81201f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c0c1500 0x7fa80c14ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40846/0 (socket says 172.21.15.132:40846) 2023-11-18T20:38:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81201f640 1 -- 172.21.15.132:0/1366678314 learned_addr learned my addr 172.21.15.132:0/1366678314 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81181e640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 0x7fa80c1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa812820640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80c155490 0x7fa80c149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81201f640 1 -- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 msgr2=0x7fa80c1491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81201f640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 0x7fa80c1491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81201f640 1 -- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80c155490 msgr2=0x7fa80c149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81201f640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80c155490 0x7fa80c149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.578+0000 7fa81201f640 1 -- 172.21.15.132:0/1366678314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080094d0 con 0x7fa80c0c1500 2023-11-18T20:38:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.579+0000 7fa81201f640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c0c1500 0x7fa80c14ace0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa80802b8c0 tx=0x7fa8080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:35.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.579+0000 7fa802ffd640 1 -- 172.21.15.132:0/1366678314 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808032900 con 0x7fa80c0c1500 2023-11-18T20:38:35.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.579+0000 7fa802ffd640 1 -- 172.21.15.132:0/1366678314 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808032a60 con 0x7fa80c0c1500 2023-11-18T20:38:35.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.579+0000 7fa802ffd640 1 -- 172.21.15.132:0/1366678314 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808032e10 con 0x7fa80c0c1500 2023-11-18T20:38:35.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.579+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c1504b0 con 0x7fa80c0c1500 2023-11-18T20:38:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.579+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c14df90 con 0x7fa80c0c1500 2023-11-18T20:38:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.580+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80c068350 con 0x7fa80c0c1500 2023-11-18T20:38:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.581+0000 7fa802ffd640 1 -- 172.21.15.132:0/1366678314 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8080453f0 con 0x7fa80c0c1500 2023-11-18T20:38:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.582+0000 7fa802ffd640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f006ae70 0x7fa7f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:35.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.582+0000 7fa802ffd640 1 -- 172.21.15.132:0/1366678314 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8080ab940 con 0x7fa80c0c1500 2023-11-18T20:38:35.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.583+0000 7fa81181e640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f006ae70 0x7fa7f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:35.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.584+0000 7fa81181e640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f006ae70 0x7fa7f006d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa80c14faa0 tx=0x7fa7fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:35.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.586+0000 7fa802ffd640 1 -- 172.21.15.132:0/1366678314 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8080769e0 con 0x7fa80c0c1500 2023-11-18T20:38:35.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.774+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa80c14ca40 con 0x7fa80c0c1500 2023-11-18T20:38:35.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.775+0000 7fa802ffd640 1 -- 172.21.15.132:0/1366678314 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa80807a000 con 0x7fa80c0c1500 2023-11-18T20:38:35.776 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:35.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f006ae70 msgr2=0x7fa7f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f006ae70 0x7fa7f006d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa80c14faa0 tx=0x7fa7fc008040 comp rx=0 tx=0).stop 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c0c1500 msgr2=0x7fa80c14ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c0c1500 0x7fa80c14ace0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa80802b8c0 tx=0x7fa8080046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 shutdown_connections 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa7f006ae70 0x7fa7f006d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80c155490 0x7fa80c149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa80c0c4080 0x7fa80c1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 --2- 172.21.15.132:0/1366678314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c0c1500 0x7fa80c14ace0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 >> 172.21.15.132:0/1366678314 conn(0x7fa80c06a500 msgr2=0x7fa80c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 shutdown_connections 2023-11-18T20:38:35.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:35.778+0000 7fa814283640 1 -- 172.21.15.132:0/1366678314 wait complete. 2023-11-18T20:38:35.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:36.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.017+0000 7fe9b344b640 1 Processor -- start 2023-11-18T20:38:36.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.017+0000 7fe9b344b640 1 -- start start 2023-11-18T20:38:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.018+0000 7fe9b344b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9ac06d0a0 0x7fe9ac152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.018+0000 7fe9b344b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe9ac0c3ea0 0x7fe9ac0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.018+0000 7fe9b344b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ac0c64a0 con 0x7fe9ac14fd30 2023-11-18T20:38:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.018+0000 7fe9b344b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ac0c5c00 con 0x7fe9ac06d0a0 2023-11-18T20:38:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.018+0000 7fe9b344b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ac0c5ee0 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b09e6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9ac06d0a0 0x7fe9ac152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b09e6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9ac06d0a0 0x7fe9ac152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40856/0 (socket says 172.21.15.132:40856) 2023-11-18T20:38:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b11e7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe9ac14fd30 0x7fe9ac0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58752/0 (socket says 172.21.15.132:58752) 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b09e6640 1 -- 172.21.15.132:0/3906545957 learned_addr learned my addr 172.21.15.132:0/3906545957 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b19e8640 1 --2- 172.21.15.132:0/3906545957 >> v2:172.21.15.161:3300/0 conn(0x7fe9ac0c3ea0 0x7fe9ac0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b09e6640 1 -- 172.21.15.132:0/3906545957 >> v2:172.21.15.161:3300/0 conn(0x7fe9ac0c3ea0 msgr2=0x7fe9ac0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b09e6640 1 --2- 172.21.15.132:0/3906545957 >> v2:172.21.15.161:3300/0 conn(0x7fe9ac0c3ea0 0x7fe9ac0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b09e6640 1 -- 172.21.15.132:0/3906545957 >> v1:172.21.15.132:6789/0 conn(0x7fe9ac14fd30 legacy=0x7fe9ac0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b09e6640 1 -- 172.21.15.132:0/3906545957 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac0c61c0 con 0x7fe9ac06d0a0 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.019+0000 7fe9b19e8640 1 --2- 172.21.15.132:0/3906545957 >> v2:172.21.15.161:3300/0 conn(0x7fe9ac0c3ea0 0x7fe9ac0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.020+0000 7fe9b09e6640 1 --2- 172.21.15.132:0/3906545957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac06d0a0 0x7fe9ac152f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac06e430 tx=0x7fe99c02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0dce850aac6499 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9a3fff640 1 -- 172.21.15.132:0/3906545957 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c030870 con 0x7fe9ac06d0a0 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9a3fff640 1 -- 172.21.15.132:0/3906545957 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c0309d0 con 0x7fe9ac06d0a0 2023-11-18T20:38:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9a3fff640 1 -- 172.21.15.132:0/3906545957 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c030d60 con 0x7fe9ac06d0a0 2023-11-18T20:38:36.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9b344b640 1 -- 172.21.15.132:0/3906545957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac06d0a0 msgr2=0x7fe9ac152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3906545957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac06d0a0 0x7fe9ac152f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac06e430 tx=0x7fe99c02b9b0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9b344b640 1 -- 172.21.15.132:0/3906545957 shutdown_connections 2023-11-18T20:38:36.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3906545957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac06d0a0 0x7fe9ac152f20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3906545957 >> v2:172.21.15.161:3300/0 conn(0x7fe9ac0c3ea0 0x7fe9ac0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9b344b640 1 -- 172.21.15.132:0/3906545957 >> 172.21.15.132:0/3906545957 conn(0x7fe9ac06a500 msgr2=0x7fe9ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:36.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9b344b640 1 -- 172.21.15.132:0/3906545957 shutdown_connections 2023-11-18T20:38:36.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.021+0000 7fe9b344b640 1 -- 172.21.15.132:0/3906545957 wait complete. 2023-11-18T20:38:36.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.023+0000 7fe9b344b640 1 Processor -- start 2023-11-18T20:38:36.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.023+0000 7fe9b344b640 1 -- start start 2023-11-18T20:38:36.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b344b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9ac06d0a0 0x7fe9ac1dbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b344b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac0c3ea0 0x7fe9ac1ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b344b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9ac14fd30 0x7fe9ac0a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b344b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac1eaa50 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b344b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac0bf8c0 con 0x7fe9ac06d0a0 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b344b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac1eaf40 con 0x7fe9ac14fd30 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b09e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac0c3ea0 0x7fe9ac1ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b09e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac0c3ea0 0x7fe9ac1ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40868/0 (socket says 172.21.15.132:40868) 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.024+0000 7fe9b09e6640 1 -- 172.21.15.132:0/3095437805 learned_addr learned my addr 172.21.15.132:0/3095437805 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b11e7640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9ac06d0a0 0x7fe9ac1dbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b19e8640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9ac14fd30 0x7fe9ac0a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b09e6640 1 -- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9ac14fd30 msgr2=0x7fe9ac0a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b09e6640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9ac14fd30 0x7fe9ac0a63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b09e6640 1 -- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9ac06d0a0 msgr2=0x7fe9ac1dbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b09e6640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9ac06d0a0 0x7fe9ac1dbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b09e6640 1 -- 172.21.15.132:0/3095437805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0094d0 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b19e8640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9ac14fd30 0x7fe9ac0a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.025+0000 7fe9b09e6640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac0c3ea0 0x7fe9ac1ed540 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe99c000c00 tx=0x7fe99c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.026+0000 7fe9a1ffb640 1 -- 172.21.15.132:0/3095437805 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c039b40 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.026+0000 7fe9a1ffb640 1 -- 172.21.15.132:0/3095437805 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c039ca0 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.026+0000 7fe9a1ffb640 1 -- 172.21.15.132:0/3095437805 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c043630 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.026+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac0bfb10 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.026+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac1eda80 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.027+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ac0bfca0 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.028+0000 7fe9a1ffb640 1 -- 172.21.15.132:0/3095437805 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe99c02f3c0 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.029+0000 7fe9a1ffb640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe99006ae40 0x7fe99006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.029+0000 7fe9a1ffb640 1 -- 172.21.15.132:0/3095437805 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe99c0aba30 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.029+0000 7fe9b11e7640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe99006ae40 0x7fe99006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.030+0000 7fe9b11e7640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe99006ae40 0x7fe99006d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8000f60 tx=0x7fe9a8007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.033+0000 7fe9a1ffb640 1 -- 172.21.15.132:0/3095437805 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe99c076ad0 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.220+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9ac068350 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.221+0000 7fe9a1ffb640 1 -- 172.21.15.132:0/3095437805 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe99c0480a0 con 0x7fe9ac0c3ea0 2023-11-18T20:38:36.223 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:36.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe99006ae40 msgr2=0x7fe99006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe99006ae40 0x7fe99006d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8000f60 tx=0x7fe9a8007ca0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac0c3ea0 msgr2=0x7fe9ac1ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac0c3ea0 0x7fe9ac1ed540 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe99c000c00 tx=0x7fe99c004730 comp rx=0 tx=0).stop 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 shutdown_connections 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe99006ae40 0x7fe99006d300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9ac14fd30 0x7fe9ac0a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9ac0c3ea0 0x7fe9ac1ed540 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 --2- 172.21.15.132:0/3095437805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9ac06d0a0 0x7fe9ac1dbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 >> 172.21.15.132:0/3095437805 conn(0x7fe9ac06a500 msgr2=0x7fe9ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 shutdown_connections 2023-11-18T20:38:36.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.224+0000 7fe9b344b640 1 -- 172.21.15.132:0/3095437805 wait complete. 2023-11-18T20:38:36.264 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-11-18T20:38:36.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:36.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.481+0000 7f6cf66e7640 1 Processor -- start 2023-11-18T20:38:36.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.481+0000 7f6cf66e7640 1 -- start start 2023-11-18T20:38:36.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.482+0000 7f6cf66e7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6cf014fd30 0x7f6cf0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.482+0000 7f6cf66e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6cf006d0a0 0x7f6cf00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.482+0000 7f6cf66e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf00c64a0 con 0x7f6cf00a5260 2023-11-18T20:38:36.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.482+0000 7f6cf66e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00c5c00 con 0x7f6cf006d0a0 2023-11-18T20:38:36.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.482+0000 7f6cf66e7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00c5ee0 con 0x7f6cf014fd30 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6ce7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6cf006d0a0 0x7f6cf00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6ce7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6cf006d0a0 0x7f6cf00a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40872/0 (socket says 172.21.15.132:40872) 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6ce7fff640 1 -- 172.21.15.132:0/3462986508 learned_addr learned my addr 172.21.15.132:0/3462986508 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6cf4c84640 1 --1- 172.21.15.132:0/3462986508 >> v1:172.21.15.132:6789/0 conn(0x7f6cf00a5260 0x7f6cf00c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58756/0 (socket says 172.21.15.132:58756) 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6ceffff640 1 --2- 172.21.15.132:0/3462986508 >> v2:172.21.15.161:3300/0 conn(0x7f6cf014fd30 0x7f6cf0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6ce7fff640 1 -- 172.21.15.132:0/3462986508 >> v2:172.21.15.161:3300/0 conn(0x7f6cf014fd30 msgr2=0x7f6cf0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6ce7fff640 1 --2- 172.21.15.132:0/3462986508 >> v2:172.21.15.161:3300/0 conn(0x7f6cf014fd30 0x7f6cf0152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6ce7fff640 1 -- 172.21.15.132:0/3462986508 >> v1:172.21.15.132:6789/0 conn(0x7f6cf00a5260 legacy=0x7f6cf00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.483+0000 7f6ce7fff640 1 -- 172.21.15.132:0/3462986508 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00c61c0 con 0x7f6cf006d0a0 2023-11-18T20:38:36.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.484+0000 7f6ce7fff640 1 --2- 172.21.15.132:0/3462986508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf00a4d20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6cf006b200 tx=0x7f6cd802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36945fe133f4d6f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cef7fe640 1 -- 172.21.15.132:0/3462986508 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8030870 con 0x7f6cf006d0a0 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cef7fe640 1 -- 172.21.15.132:0/3462986508 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd80309d0 con 0x7f6cf006d0a0 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cef7fe640 1 -- 172.21.15.132:0/3462986508 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8030d60 con 0x7f6cf006d0a0 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cf66e7640 1 -- 172.21.15.132:0/3462986508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 msgr2=0x7f6cf00a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/3462986508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf00a4d20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6cf006b200 tx=0x7f6cd802b9b0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cf66e7640 1 -- 172.21.15.132:0/3462986508 shutdown_connections 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/3462986508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf00a4d20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/3462986508 >> v2:172.21.15.161:3300/0 conn(0x7f6cf014fd30 0x7f6cf0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.485+0000 7f6cf66e7640 1 -- 172.21.15.132:0/3462986508 >> 172.21.15.132:0/3462986508 conn(0x7f6cf006a500 msgr2=0x7f6cf006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.486+0000 7f6cf66e7640 1 -- 172.21.15.132:0/3462986508 shutdown_connections 2023-11-18T20:38:36.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.486+0000 7f6cf66e7640 1 -- 172.21.15.132:0/3462986508 wait complete. 2023-11-18T20:38:36.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.487+0000 7f6cf66e7640 1 Processor -- start 2023-11-18T20:38:36.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.487+0000 7f6cf66e7640 1 -- start start 2023-11-18T20:38:36.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6cf66e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf0145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6cf66e7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cf00a5260 0x7f6cf014b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6cf66e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cf014fd30 0x7f6cf014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6cf66e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0151290 con 0x7f6cf006d0a0 2023-11-18T20:38:36.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6cf66e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0072240 con 0x7f6cf014fd30 2023-11-18T20:38:36.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6cf66e7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf01522e0 con 0x7f6cf00a5260 2023-11-18T20:38:36.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6ceffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf0145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6ceffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf0145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40876/0 (socket says 172.21.15.132:40876) 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.488+0000 7f6ceffff640 1 -- 172.21.15.132:0/192308095 learned_addr learned my addr 172.21.15.132:0/192308095 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6ceffff640 1 -- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cf00a5260 msgr2=0x7f6cf014b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6ceffff640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cf00a5260 0x7f6cf014b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6ceffff640 1 -- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cf014fd30 msgr2=0x7f6cf014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6cf4c84640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cf014fd30 0x7f6cf014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6ceffff640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cf014fd30 0x7f6cf014ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6ceffff640 1 -- 172.21.15.132:0/192308095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80094d0 con 0x7f6cf006d0a0 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6cf4c84640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cf014fd30 0x7f6cf014ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6ceffff640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf0145a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c7f0 tx=0x7f6ce000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.489+0000 7f6ced7fa640 1 -- 172.21.15.132:0/192308095 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0004220 con 0x7f6cf006d0a0 2023-11-18T20:38:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.490+0000 7f6ced7fa640 1 -- 172.21.15.132:0/192308095 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0004380 con 0x7f6cf006d0a0 2023-11-18T20:38:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.490+0000 7f6ced7fa640 1 -- 172.21.15.132:0/192308095 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0007840 con 0x7f6cf006d0a0 2023-11-18T20:38:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.490+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf01514e0 con 0x7f6cf006d0a0 2023-11-18T20:38:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.490+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf0150640 con 0x7f6cf006d0a0 2023-11-18T20:38:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.491+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf006dcf0 con 0x7f6cf006d0a0 2023-11-18T20:38:36.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.492+0000 7f6ced7fa640 1 -- 172.21.15.132:0/192308095 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ce0007bb0 con 0x7f6cf006d0a0 2023-11-18T20:38:36.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.493+0000 7f6ced7fa640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6cd006ae40 0x7f6cd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.493+0000 7f6ced7fa640 1 -- 172.21.15.132:0/192308095 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce0089490 con 0x7f6cf006d0a0 2023-11-18T20:38:36.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.493+0000 7f6ce7fff640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6cd006ae40 0x7f6cd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.494+0000 7f6ce7fff640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6cd006ae40 0x7f6cd006d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8036000 tx=0x7f6cd803b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.497+0000 7f6ced7fa640 1 -- 172.21.15.132:0/192308095 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ce00545d0 con 0x7f6cf006d0a0 2023-11-18T20:38:36.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.687+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cf0068350 con 0x7f6cf006d0a0 2023-11-18T20:38:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.689+0000 7f6ced7fa640 1 -- 172.21.15.132:0/192308095 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f6ce0007e60 con 0x7f6cf006d0a0 2023-11-18T20:38:36.690 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:36.690 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:36.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.691+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6cd006ae40 msgr2=0x7f6cd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.691+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6cd006ae40 0x7f6cd006d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8036000 tx=0x7f6cd803b040 comp rx=0 tx=0).stop 2023-11-18T20:38:36.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.691+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 msgr2=0x7f6cf0145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.691+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf0145a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c7f0 tx=0x7f6ce000ccb0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.692+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 shutdown_connections 2023-11-18T20:38:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.692+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6cd006ae40 0x7f6cd006d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.692+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cf014fd30 0x7f6cf014ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.692+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cf00a5260 0x7f6cf014b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.692+0000 7f6cf66e7640 1 --2- 172.21.15.132:0/192308095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cf006d0a0 0x7f6cf0145a20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.692+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 >> 172.21.15.132:0/192308095 conn(0x7f6cf006a500 msgr2=0x7f6cf00a71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.692+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 shutdown_connections 2023-11-18T20:38:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.692+0000 7f6cf66e7640 1 -- 172.21.15.132:0/192308095 wait complete. 2023-11-18T20:38:36.712 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:36.713 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:36.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.924+0000 7fc70022d640 1 Processor -- start 2023-11-18T20:38:36.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.924+0000 7fc70022d640 1 -- start start 2023-11-18T20:38:36.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.925+0000 7fc70022d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc6f814fd30 0x7fc6f8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.925+0000 7fc70022d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc6f806d0a0 0x7fc6f80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc70022d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80c64a0 con 0x7fc6f80a5260 2023-11-18T20:38:36.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc70022d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80c5c00 con 0x7fc6f814fd30 2023-11-18T20:38:36.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc70022d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80c5ee0 con 0x7fc6f806d0a0 2023-11-18T20:38:36.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc6fdfc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc6f814fd30 0x7fc6f8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc6fdfc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc6f814fd30 0x7fc6f8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40888/0 (socket says 172.21.15.132:40888) 2023-11-18T20:38:36.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc6fdfc9640 1 -- 172.21.15.132:0/4119580712 learned_addr learned my addr 172.21.15.132:0/4119580712 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:36.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc6fdfc9640 1 -- 172.21.15.132:0/4119580712 >> v2:172.21.15.161:3300/0 conn(0x7fc6f806d0a0 msgr2=0x7fc6f80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:36.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc6fdfc9640 1 --2- 172.21.15.132:0/4119580712 >> v2:172.21.15.161:3300/0 conn(0x7fc6f806d0a0 0x7fc6f80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc6fdfc9640 1 -- 172.21.15.132:0/4119580712 >> v1:172.21.15.161:6789/0 conn(0x7fc6f80a5260 legacy=0x7fc6f80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:36.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.926+0000 7fc6fdfc9640 1 -- 172.21.15.132:0/4119580712 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80c61c0 con 0x7fc6f814fd30 2023-11-18T20:38:36.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.927+0000 7fc6fdfc9640 1 --2- 172.21.15.132:0/4119580712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f8152f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6f806b460 tx=0x7fc6f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497259dc3f0adf87 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.928+0000 7fc6fcfc7640 1 -- 172.21.15.132:0/4119580712 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4031870 con 0x7fc6f814fd30 2023-11-18T20:38:36.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.928+0000 7fc6fcfc7640 1 -- 172.21.15.132:0/4119580712 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f40319d0 con 0x7fc6f814fd30 2023-11-18T20:38:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.928+0000 7fc6fcfc7640 1 -- 172.21.15.132:0/4119580712 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4031d60 con 0x7fc6f814fd30 2023-11-18T20:38:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.928+0000 7fc70022d640 1 -- 172.21.15.132:0/4119580712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 msgr2=0x7fc6f8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.928+0000 7fc70022d640 1 --2- 172.21.15.132:0/4119580712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f8152f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6f806b460 tx=0x7fc6f402b910 comp rx=0 tx=0).stop 2023-11-18T20:38:36.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.929+0000 7fc70022d640 1 -- 172.21.15.132:0/4119580712 shutdown_connections 2023-11-18T20:38:36.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.929+0000 7fc70022d640 1 --2- 172.21.15.132:0/4119580712 >> v2:172.21.15.161:3300/0 conn(0x7fc6f806d0a0 0x7fc6f80a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.929+0000 7fc70022d640 1 --2- 172.21.15.132:0/4119580712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f8152f20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.929+0000 7fc70022d640 1 -- 172.21.15.132:0/4119580712 >> 172.21.15.132:0/4119580712 conn(0x7fc6f806a500 msgr2=0x7fc6f806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:36.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.929+0000 7fc70022d640 1 -- 172.21.15.132:0/4119580712 shutdown_connections 2023-11-18T20:38:36.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.929+0000 7fc70022d640 1 -- 172.21.15.132:0/4119580712 wait complete. 2023-11-18T20:38:36.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.930+0000 7fc70022d640 1 Processor -- start 2023-11-18T20:38:36.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.931+0000 7fc70022d640 1 -- start start 2023-11-18T20:38:36.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.931+0000 7fc70022d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f806d0a0 0x7fc6f80aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.931+0000 7fc70022d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f80a5260 0x7fc6f814a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.931+0000 7fc70022d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f814ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.931+0000 7fc70022d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f814c8c0 con 0x7fc6f814fd30 2023-11-18T20:38:36.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.931+0000 7fc70022d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f814ea00 con 0x7fc6f80a5260 2023-11-18T20:38:36.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.931+0000 7fc70022d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f81ea440 con 0x7fc6f806d0a0 2023-11-18T20:38:36.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fe7ca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f814ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fe7ca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f814ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40898/0 (socket says 172.21.15.132:40898) 2023-11-18T20:38:36.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fe7ca640 1 -- 172.21.15.132:0/1905990181 learned_addr learned my addr 172.21.15.132:0/1905990181 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:36.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fdfc9640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f806d0a0 0x7fc6f80aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fd7c8640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f80a5260 0x7fc6f814a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fe7ca640 1 -- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f806d0a0 msgr2=0x7fc6f80aa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fe7ca640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f806d0a0 0x7fc6f80aa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fe7ca640 1 -- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f80a5260 msgr2=0x7fc6f814a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fe7ca640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f80a5260 0x7fc6f814a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.932+0000 7fc6fe7ca640 1 -- 172.21.15.132:0/1905990181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f40094d0 con 0x7fc6f814fd30 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.933+0000 7fc6fe7ca640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f814ae20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000c780 tx=0x7fc6f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.933+0000 7fc6ee7fc640 1 -- 172.21.15.132:0/1905990181 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0003d80 con 0x7fc6f814fd30 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.933+0000 7fc6ee7fc640 1 -- 172.21.15.132:0/1905990181 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f000ce90 con 0x7fc6f814fd30 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.933+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f81ea720 con 0x7fc6f814fd30 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.933+0000 7fc6ee7fc640 1 -- 172.21.15.132:0/1905990181 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00052b0 con 0x7fc6f814fd30 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.933+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f81eace0 con 0x7fc6f814fd30 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.934+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f8068350 con 0x7fc6f814fd30 2023-11-18T20:38:36.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.935+0000 7fc6ee7fc640 1 -- 172.21.15.132:0/1905990181 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6f0005410 con 0x7fc6f814fd30 2023-11-18T20:38:36.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.936+0000 7fc6ee7fc640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc6dc06ae40 0x7fc6dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:36.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.936+0000 7fc6ee7fc640 1 -- 172.21.15.132:0/1905990181 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6f0088e60 con 0x7fc6f814fd30 2023-11-18T20:38:36.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.937+0000 7fc6fdfc9640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc6dc06ae40 0x7fc6dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:36.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.938+0000 7fc6fdfc9640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc6dc06ae40 0x7fc6dc06d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4036000 tx=0x7fc6f403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:36.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:36.941+0000 7fc6ee7fc640 1 -- 172.21.15.132:0/1905990181 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6f0053f00 con 0x7fc6f814fd30 2023-11-18T20:38:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.130+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6f806d540 con 0x7fc6f814fd30 2023-11-18T20:38:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.131+0000 7fc6ee7fc640 1 -- 172.21.15.132:0/1905990181 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6f0017070 con 0x7fc6f814fd30 2023-11-18T20:38:37.133 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:37.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc6dc06ae40 msgr2=0x7fc6dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc6dc06ae40 0x7fc6dc06d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4036000 tx=0x7fc6f403c040 comp rx=0 tx=0).stop 2023-11-18T20:38:37.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 msgr2=0x7fc6f814ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f814ae20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000c780 tx=0x7fc6f000cc40 comp rx=0 tx=0).stop 2023-11-18T20:38:37.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 shutdown_connections 2023-11-18T20:38:37.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc6dc06ae40 0x7fc6dc06d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f814fd30 0x7fc6f814ae20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f80a5260 0x7fc6f814a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 --2- 172.21.15.132:0/1905990181 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f806d0a0 0x7fc6f80aa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 >> 172.21.15.132:0/1905990181 conn(0x7fc6f806a500 msgr2=0x7fc6f80c3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:37.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 shutdown_connections 2023-11-18T20:38:37.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.134+0000 7fc70022d640 1 -- 172.21.15.132:0/1905990181 wait complete. 2023-11-18T20:38:37.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:37.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.367+0000 7f7627a97640 1 Processor -- start 2023-11-18T20:38:37.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.368+0000 7f7627a97640 1 -- start start 2023-11-18T20:38:37.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.369+0000 7f7627a97640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f762014fd30 0x7f7620152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.369+0000 7f7627a97640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76200c3ea0 0x7f76200c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.369+0000 7f7627a97640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76200c64a0 con 0x7f762006d0a0 2023-11-18T20:38:37.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.369+0000 7f7627a97640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76200c5c00 con 0x7f76200c3ea0 2023-11-18T20:38:37.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.369+0000 7f7627a97640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76200c5ee0 con 0x7f762014fd30 2023-11-18T20:38:37.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.369+0000 7f7626034640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76200c3ea0 0x7f76200c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.370+0000 7f7626034640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76200c3ea0 0x7f76200c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40910/0 (socket says 172.21.15.132:40910) 2023-11-18T20:38:37.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.370+0000 7f7626034640 1 -- 172.21.15.132:0/776957151 learned_addr learned my addr 172.21.15.132:0/776957151 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:37.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.370+0000 7f7625833640 1 --2- 172.21.15.132:0/776957151 >> v2:172.21.15.161:3300/0 conn(0x7f762014fd30 0x7f7620152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.370+0000 7f7626034640 1 -- 172.21.15.132:0/776957151 >> v2:172.21.15.161:3300/0 conn(0x7f762014fd30 msgr2=0x7f7620152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:37.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.370+0000 7f7626034640 1 --2- 172.21.15.132:0/776957151 >> v2:172.21.15.161:3300/0 conn(0x7f762014fd30 0x7f7620152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.370+0000 7f7626034640 1 -- 172.21.15.132:0/776957151 >> v1:172.21.15.161:6789/0 conn(0x7f762006d0a0 legacy=0x7f76200a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:37.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.370+0000 7f7626034640 1 -- 172.21.15.132:0/776957151 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200c61c0 con 0x7f76200c3ea0 2023-11-18T20:38:37.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.371+0000 7f7626034640 1 --2- 172.21.15.132:0/776957151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76200c3ea0 0x7f76200c4330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f762006b200 tx=0x7f761802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848bfaf871e608d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:37.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.371+0000 7f7624831640 1 -- 172.21.15.132:0/776957151 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761802ca80 con 0x7f76200c3ea0 2023-11-18T20:38:37.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.371+0000 7f7624831640 1 -- 172.21.15.132:0/776957151 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761802cbe0 con 0x7f76200c3ea0 2023-11-18T20:38:37.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.371+0000 7f7624831640 1 -- 172.21.15.132:0/776957151 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76180343f0 con 0x7f76200c3ea0 2023-11-18T20:38:37.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.372+0000 7f7627a97640 1 -- 172.21.15.132:0/776957151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76200c3ea0 msgr2=0x7f76200c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.372+0000 7f7627a97640 1 --2- 172.21.15.132:0/776957151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76200c3ea0 0x7f76200c4330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f762006b200 tx=0x7f761802bee0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.372+0000 7f7627a97640 1 -- 172.21.15.132:0/776957151 shutdown_connections 2023-11-18T20:38:37.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.372+0000 7f7627a97640 1 --2- 172.21.15.132:0/776957151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76200c3ea0 0x7f76200c4330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.372+0000 7f7627a97640 1 --2- 172.21.15.132:0/776957151 >> v2:172.21.15.161:3300/0 conn(0x7f762014fd30 0x7f7620152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.372+0000 7f7627a97640 1 -- 172.21.15.132:0/776957151 >> 172.21.15.132:0/776957151 conn(0x7f762006a500 msgr2=0x7f762006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:37.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.373+0000 7f7627a97640 1 -- 172.21.15.132:0/776957151 shutdown_connections 2023-11-18T20:38:37.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.373+0000 7f7627a97640 1 -- 172.21.15.132:0/776957151 wait complete. 2023-11-18T20:38:37.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.374+0000 7f7627a97640 1 Processor -- start 2023-11-18T20:38:37.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.374+0000 7f7627a97640 1 -- start start 2023-11-18T20:38:37.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.375+0000 7f7627a97640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762006d0a0 0x7f7620154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.375+0000 7f7627a97640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76200c3ea0 0x7f76200aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.375+0000 7f7627a97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f762014fd30 0x7f76201ea400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.375+0000 7f7627a97640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76201ee380 con 0x7f762014fd30 2023-11-18T20:38:37.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.375+0000 7f7627a97640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76201dbb60 con 0x7f76200c3ea0 2023-11-18T20:38:37.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.375+0000 7f7627a97640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76201ee870 con 0x7f762006d0a0 2023-11-18T20:38:37.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f762014fd30 0x7f76201ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f762014fd30 0x7f76201ea400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40918/0 (socket says 172.21.15.132:40918) 2023-11-18T20:38:37.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 -- 172.21.15.132:0/1792323297 learned_addr learned my addr 172.21.15.132:0/1792323297 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:37.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7625833640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762006d0a0 0x7f7620154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 -- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762006d0a0 msgr2=0x7f7620154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762006d0a0 0x7f7620154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 -- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76200c3ea0 msgr2=0x7f76200aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76200c3ea0 0x7f76200aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 -- 172.21.15.132:0/1792323297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618009b30 con 0x7f762014fd30 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.376+0000 7f7626034640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f762014fd30 0x7f76201ea400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7618036040 tx=0x7f7618004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.377+0000 7f76167fc640 1 -- 172.21.15.132:0/1792323297 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618009510 con 0x7f762014fd30 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.377+0000 7f76167fc640 1 -- 172.21.15.132:0/1792323297 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761803e450 con 0x7f762014fd30 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.377+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7620154ff0 con 0x7f762014fd30 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.377+0000 7f76167fc640 1 -- 172.21.15.132:0/1792323297 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761803e7e0 con 0x7f762014fd30 2023-11-18T20:38:37.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.377+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7620155290 con 0x7f762014fd30 2023-11-18T20:38:37.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.378+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76201dbcf0 con 0x7f762014fd30 2023-11-18T20:38:37.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.379+0000 7f76167fc640 1 -- 172.21.15.132:0/1792323297 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f761802cd50 con 0x7f762014fd30 2023-11-18T20:38:37.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.380+0000 7f76167fc640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f760406ae40 0x7f760406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.380+0000 7f76167fc640 1 -- 172.21.15.132:0/1792323297 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76180ac1a0 con 0x7f762014fd30 2023-11-18T20:38:37.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.381+0000 7f7625833640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f760406ae40 0x7f760406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.382+0000 7f7625833640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f760406ae40 0x7f760406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f761c006fd0 tx=0x7f761c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:37.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.384+0000 7f76167fc640 1 -- 172.21.15.132:0/1792323297 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7618077240 con 0x7f762014fd30 2023-11-18T20:38:37.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.574+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76200c1b70 con 0x7f762014fd30 2023-11-18T20:38:37.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.575+0000 7f76167fc640 1 -- 172.21.15.132:0/1792323297 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f761807a860 con 0x7f762014fd30 2023-11-18T20:38:37.577 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:37.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f760406ae40 msgr2=0x7f760406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f760406ae40 0x7f760406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f761c006fd0 tx=0x7f761c008040 comp rx=0 tx=0).stop 2023-11-18T20:38:37.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f762014fd30 msgr2=0x7f76201ea400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f762014fd30 0x7f76201ea400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7618036040 tx=0x7f7618004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 shutdown_connections 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f760406ae40 0x7f760406d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f762014fd30 0x7f76201ea400 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76200c3ea0 0x7f76200aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 --2- 172.21.15.132:0/1792323297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762006d0a0 0x7f7620154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 >> 172.21.15.132:0/1792323297 conn(0x7f762006a500 msgr2=0x7f76200a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 shutdown_connections 2023-11-18T20:38:37.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.578+0000 7f7627a97640 1 -- 172.21.15.132:0/1792323297 wait complete. 2023-11-18T20:38:37.600 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:37.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.811+0000 7f751491d640 1 Processor -- start 2023-11-18T20:38:37.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.811+0000 7f751491d640 1 -- start start 2023-11-18T20:38:37.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f751491d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7510151cc0 0x7f7510155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f751491d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75100c4940 0x7f75100c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f751491d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75101556d0 con 0x7f75100c7ec0 2023-11-18T20:38:37.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f751491d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7510154740 con 0x7f75100c4940 2023-11-18T20:38:37.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f751491d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751006c760 con 0x7f7510151cc0 2023-11-18T20:38:37.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f750ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75100c4940 0x7f75100c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f750dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f75100c7ec0 0x7f7510157d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58768/0 (socket says 172.21.15.132:58768) 2023-11-18T20:38:37.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f750dd9b640 1 -- 172.21.15.132:0/1116926001 learned_addr learned my addr 172.21.15.132:0/1116926001 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:37.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.812+0000 7f750ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75100c4940 0x7f75100c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40920/0 (socket says 172.21.15.132:40920) 2023-11-18T20:38:37.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.813+0000 7f750e59c640 1 --2- 172.21.15.132:0/1116926001 >> v2:172.21.15.161:3300/0 conn(0x7f7510151cc0 0x7f7510155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.813+0000 7f750d59a640 1 -- 172.21.15.132:0/1116926001 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737150016 0 0) 0x7f7504001110 con 0x7f75100c7ec0 2023-11-18T20:38:37.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.813+0000 7f750ed9d640 1 -- 172.21.15.132:0/1116926001 >> v2:172.21.15.161:3300/0 conn(0x7f7510151cc0 msgr2=0x7f7510155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:37.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.813+0000 7f750ed9d640 1 --2- 172.21.15.132:0/1116926001 >> v2:172.21.15.161:3300/0 conn(0x7f7510151cc0 0x7f7510155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.813+0000 7f750ed9d640 1 -- 172.21.15.132:0/1116926001 >> v1:172.21.15.132:6789/0 conn(0x7f75100c7ec0 legacy=0x7f7510157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.813+0000 7f750ed9d640 1 -- 172.21.15.132:0/1116926001 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100c8470 con 0x7f75100c4940 2023-11-18T20:38:37.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.814+0000 7f750ed9d640 1 --2- 172.21.15.132:0/1116926001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c4940 0x7f75100c4d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75100cb030 tx=0x7f750802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9b67875ee7ab4f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:37.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.814+0000 7f750d59a640 1 -- 172.21.15.132:0/1116926001 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750802cc80 con 0x7f75100c4940 2023-11-18T20:38:37.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.814+0000 7f750d59a640 1 -- 172.21.15.132:0/1116926001 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750802cde0 con 0x7f75100c4940 2023-11-18T20:38:37.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.814+0000 7f750d59a640 1 -- 172.21.15.132:0/1116926001 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508034660 con 0x7f75100c4940 2023-11-18T20:38:37.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.815+0000 7f751491d640 1 -- 172.21.15.132:0/1116926001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c4940 msgr2=0x7f75100c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.815+0000 7f751491d640 1 --2- 172.21.15.132:0/1116926001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c4940 0x7f75100c4d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75100cb030 tx=0x7f750802bed0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.815+0000 7f751491d640 1 -- 172.21.15.132:0/1116926001 shutdown_connections 2023-11-18T20:38:37.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.815+0000 7f751491d640 1 --2- 172.21.15.132:0/1116926001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c4940 0x7f75100c4d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.815+0000 7f751491d640 1 --2- 172.21.15.132:0/1116926001 >> v2:172.21.15.161:3300/0 conn(0x7f7510151cc0 0x7f7510155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.815+0000 7f751491d640 1 -- 172.21.15.132:0/1116926001 >> 172.21.15.132:0/1116926001 conn(0x7f7510071e10 msgr2=0x7f7510072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:37.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.815+0000 7f751491d640 1 -- 172.21.15.132:0/1116926001 shutdown_connections 2023-11-18T20:38:37.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.815+0000 7f751491d640 1 -- 172.21.15.132:0/1116926001 wait complete. 2023-11-18T20:38:37.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.817+0000 7f751491d640 1 Processor -- start 2023-11-18T20:38:37.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.817+0000 7f751491d640 1 -- start start 2023-11-18T20:38:37.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f751491d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75100c4940 0x7f7510150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f751491d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c7ec0 0x7f75100aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f751491d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7510151cc0 0x7f751014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f751491d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100ab300 con 0x7f75100c7ec0 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f751491d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75101ead00 con 0x7f75100c4940 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f751491d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75101ea440 con 0x7f7510151cc0 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c7ec0 0x7f75100aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c7ec0 0x7f75100aa550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40926/0 (socket says 172.21.15.132:40926) 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 -- 172.21.15.132:0/3359475641 learned_addr learned my addr 172.21.15.132:0/3359475641 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 -- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7510151cc0 msgr2=0x7f751014f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7510151cc0 0x7f751014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 -- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75100c4940 msgr2=0x7f7510150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75100c4940 0x7f7510150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 -- 172.21.15.132:0/3359475641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508009a70 con 0x7f75100c7ec0 2023-11-18T20:38:37.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.818+0000 7f750dd9b640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c7ec0 0x7f75100aa550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f750400c7b0 tx=0x7f750400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:37.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.819+0000 7f74feffd640 1 -- 172.21.15.132:0/3359475641 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75040072d0 con 0x7f75100c7ec0 2023-11-18T20:38:37.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.819+0000 7f74feffd640 1 -- 172.21.15.132:0/3359475641 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504007450 con 0x7f75100c7ec0 2023-11-18T20:38:37.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.819+0000 7f74feffd640 1 -- 172.21.15.132:0/3359475641 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504001d10 con 0x7f75100c7ec0 2023-11-18T20:38:37.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.819+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7510150e40 con 0x7f75100c7ec0 2023-11-18T20:38:37.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.819+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75101ea990 con 0x7f75100c7ec0 2023-11-18T20:38:37.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.820+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7510067d50 con 0x7f75100c7ec0 2023-11-18T20:38:37.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.821+0000 7f74feffd640 1 -- 172.21.15.132:0/3359475641 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75040047e0 con 0x7f75100c7ec0 2023-11-18T20:38:37.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.822+0000 7f74feffd640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f74f006ae70 0x7f74f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:37.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.823+0000 7f74feffd640 1 -- 172.21.15.132:0/3359475641 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7504088610 con 0x7f75100c7ec0 2023-11-18T20:38:37.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.823+0000 7f750e59c640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f74f006ae70 0x7f74f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:37.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.824+0000 7f750e59c640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f74f006ae70 0x7f74f006d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7500006fd0 tx=0x7f7500008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:37.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:37.827+0000 7f74feffd640 1 -- 172.21.15.132:0/3359475641 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75040536b0 con 0x7f75100c7ec0 2023-11-18T20:38:38.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.015+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75101556d0 con 0x7f75100c7ec0 2023-11-18T20:38:38.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.016+0000 7f74feffd640 1 -- 172.21.15.132:0/3359475641 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75101556d0 con 0x7f75100c7ec0 2023-11-18T20:38:38.019 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:38.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f74f006ae70 msgr2=0x7f74f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:38.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f74f006ae70 0x7f74f006d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7500006fd0 tx=0x7f7500008040 comp rx=0 tx=0).stop 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c7ec0 msgr2=0x7f75100aa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c7ec0 0x7f75100aa550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f750400c7b0 tx=0x7f750400cc70 comp rx=0 tx=0).stop 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 shutdown_connections 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f74f006ae70 0x7f74f006d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7510151cc0 0x7f751014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100c7ec0 0x7f75100aa550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 --2- 172.21.15.132:0/3359475641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75100c4940 0x7f7510150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 >> 172.21.15.132:0/3359475641 conn(0x7f7510071e10 msgr2=0x7f751014c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.019+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 shutdown_connections 2023-11-18T20:38:38.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.020+0000 7f751491d640 1 -- 172.21.15.132:0/3359475641 wait complete. 2023-11-18T20:38:38.041 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-11-18T20:38:38.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.233+0000 7f2d95246640 1 Processor -- start 2023-11-18T20:38:38.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.233+0000 7f2d95246640 1 -- start start 2023-11-18T20:38:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.235+0000 7f2d95246640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d9014fbe0 0x7f2d900c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.235+0000 7f2d95246640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2d90070710 0x7f2d900acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.235+0000 7f2d95246640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d900c7a00 con 0x7f2d900c4080 2023-11-18T20:38:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.235+0000 7f2d95246640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d900c5cc0 con 0x7f2d90070710 2023-11-18T20:38:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.235+0000 7f2d95246640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900c6df0 con 0x7f2d9014fbe0 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.235+0000 7f2d8ed9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d9014fbe0 0x7f2d900c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.236+0000 7f2d8ed9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d9014fbe0 0x7f2d900c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:60924/0 (socket says 172.21.15.132:60924) 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.236+0000 7f2d8ed9d640 1 -- 172.21.15.132:0/4137690741 learned_addr learned my addr 172.21.15.132:0/4137690741 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.236+0000 7f2d8f59e640 1 --2- 172.21.15.132:0/4137690741 >> v2:172.21.15.161:3300/0 conn(0x7f2d90070710 0x7f2d900acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.236+0000 7f2d8dd9b640 1 -- 172.21.15.132:0/4137690741 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721640735 0 0) 0x7f2d900c7a00 con 0x7f2d900c4080 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.236+0000 7f2d8dd9b640 1 -- 172.21.15.132:0/4137690741 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d7c003520 con 0x7f2d900c4080 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.237+0000 7f2d8f59e640 1 -- 172.21.15.132:0/4137690741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d9014fbe0 msgr2=0x7f2d900c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.237+0000 7f2d8f59e640 1 --2- 172.21.15.132:0/4137690741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d9014fbe0 0x7f2d900c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.237+0000 7f2d8f59e640 1 -- 172.21.15.132:0/4137690741 >> v1:172.21.15.161:6789/0 conn(0x7f2d900c4080 legacy=0x7f2d900ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.237+0000 7f2d8f59e640 1 -- 172.21.15.132:0/4137690741 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d900c70d0 con 0x7f2d90070710 2023-11-18T20:38:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.237+0000 7f2d8ed9d640 1 --2- 172.21.15.132:0/4137690741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d9014fbe0 0x7f2d900c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:38:38.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.238+0000 7f2d8f59e640 1 --2- 172.21.15.132:0/4137690741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d90070710 0x7f2d900acf20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d880097a0 tx=0x7f2d8802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e77d03c5e32f0f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:38.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.238+0000 7f2d8dd9b640 1 -- 172.21.15.132:0/4137690741 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8802d040 con 0x7f2d90070710 2023-11-18T20:38:38.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.238+0000 7f2d8dd9b640 1 -- 172.21.15.132:0/4137690741 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d88031810 con 0x7f2d90070710 2023-11-18T20:38:38.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.238+0000 7f2d8dd9b640 1 -- 172.21.15.132:0/4137690741 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88031b80 con 0x7f2d90070710 2023-11-18T20:38:38.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.239+0000 7f2d95246640 1 -- 172.21.15.132:0/4137690741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d90070710 msgr2=0x7f2d900acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:38.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.239+0000 7f2d95246640 1 --2- 172.21.15.132:0/4137690741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d90070710 0x7f2d900acf20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d880097a0 tx=0x7f2d8802b8b0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.239+0000 7f2d95246640 1 -- 172.21.15.132:0/4137690741 shutdown_connections 2023-11-18T20:38:38.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.239+0000 7f2d95246640 1 --2- 172.21.15.132:0/4137690741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d90070710 0x7f2d900acf20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.239+0000 7f2d95246640 1 --2- 172.21.15.132:0/4137690741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d9014fbe0 0x7f2d900c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.239+0000 7f2d95246640 1 -- 172.21.15.132:0/4137690741 >> 172.21.15.132:0/4137690741 conn(0x7f2d900a9b70 msgr2=0x7f2d900a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:38.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.239+0000 7f2d95246640 1 -- 172.21.15.132:0/4137690741 shutdown_connections 2023-11-18T20:38:38.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.239+0000 7f2d95246640 1 -- 172.21.15.132:0/4137690741 wait complete. 2023-11-18T20:38:38.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.241+0000 7f2d95246640 1 Processor -- start 2023-11-18T20:38:38.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.241+0000 7f2d95246640 1 -- start start 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.242+0000 7f2d95246640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d90070710 0x7f2d900bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.242+0000 7f2d95246640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d900c4080 0x7f2d901eb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.242+0000 7f2d95246640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d9014fbe0 0x7f2d9014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d95246640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900bd700 con 0x7f2d9014fbe0 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d95246640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90153cc0 con 0x7f2d900c4080 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d95246640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900c2430 con 0x7f2d90070710 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d9014fbe0 0x7f2d9014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d9014fbe0 0x7f2d9014ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40940/0 (socket says 172.21.15.132:40940) 2023-11-18T20:38:38.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8f59e640 1 -- 172.21.15.132:0/874080888 learned_addr learned my addr 172.21.15.132:0/874080888 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8ed9d640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d90070710 0x7f2d900bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8e59c640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d900c4080 0x7f2d901eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8f59e640 1 -- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d90070710 msgr2=0x7f2d900bd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8f59e640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d90070710 0x7f2d900bd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8f59e640 1 -- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d900c4080 msgr2=0x7f2d901eb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8f59e640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d900c4080 0x7f2d901eb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.243+0000 7f2d8f59e640 1 -- 172.21.15.132:0/874080888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80009b30 con 0x7f2d9014fbe0 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.244+0000 7f2d8f59e640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d9014fbe0 0x7f2d9014ab90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d880098c0 tx=0x7f2d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.244+0000 7f2d877fe640 1 -- 172.21.15.132:0/874080888 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880044c0 con 0x7f2d9014fbe0 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.244+0000 7f2d877fe640 1 -- 172.21.15.132:0/874080888 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8803f070 con 0x7f2d9014fbe0 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.244+0000 7f2d877fe640 1 -- 172.21.15.132:0/874080888 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88003a40 con 0x7f2d9014fbe0 2023-11-18T20:38:38.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.244+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d88009400 con 0x7f2d9014fbe0 2023-11-18T20:38:38.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.244+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d90151340 con 0x7f2d9014fbe0 2023-11-18T20:38:38.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.245+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d90155b20 con 0x7f2d9014fbe0 2023-11-18T20:38:38.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.246+0000 7f2d877fe640 1 -- 172.21.15.132:0/874080888 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d88003ba0 con 0x7f2d9014fbe0 2023-11-18T20:38:38.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.247+0000 7f2d877fe640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d7006ae70 0x7f2d7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:38.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.247+0000 7f2d877fe640 1 -- 172.21.15.132:0/874080888 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d88041070 con 0x7f2d9014fbe0 2023-11-18T20:38:38.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.248+0000 7f2d8ed9d640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d7006ae70 0x7f2d7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:38.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.249+0000 7f2d8ed9d640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d7006ae70 0x7f2d7006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009240 tx=0x7f2d8000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:38.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.251+0000 7f2d877fe640 1 -- 172.21.15.132:0/874080888 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d90155b20 con 0x7f2d9014fbe0 2023-11-18T20:38:38.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:38.491+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f2d90155b20 con 0x7f2d9014fbe0 2023-11-18T20:38:39.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.465+0000 7f2d877fe640 1 -- 172.21.15.132:0/874080888 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v53) v1 ==== 162+0+0 (secure 0 0 0) 0x7f2d90155b20 con 0x7f2d9014fbe0 2023-11-18T20:38:39.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d7006ae70 msgr2=0x7f2d7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:39.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d7006ae70 0x7f2d7006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009240 tx=0x7f2d8000b040 comp rx=0 tx=0).stop 2023-11-18T20:38:39.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d9014fbe0 msgr2=0x7f2d9014ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:39.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d9014fbe0 0x7f2d9014ab90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d880098c0 tx=0x7f2d880046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 shutdown_connections 2023-11-18T20:38:39.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d7006ae70 0x7f2d7006d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d9014fbe0 0x7f2d9014ab90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d900c4080 0x7f2d901eb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 --2- 172.21.15.132:0/874080888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d90070710 0x7f2d900bd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 >> 172.21.15.132:0/874080888 conn(0x7f2d900a9b70 msgr2=0x7f2d900c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:39.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 shutdown_connections 2023-11-18T20:38:39.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.469+0000 7f2d95246640 1 -- 172.21.15.132:0/874080888 wait complete. 2023-11-18T20:38:39.490 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-18T20:38:39.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.711+0000 7f99edaec640 1 Processor -- start 2023-11-18T20:38:39.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.712+0000 7f99edaec640 1 -- start start 2023-11-18T20:38:39.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99edaec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99e80c7ec0 0x7f99e8155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:39.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99edaec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e80c4940 0x7f99e80c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:39.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99edaec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e81556d0 con 0x7f99e8151cc0 2023-11-18T20:38:39.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99edaec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e8154740 con 0x7f99e80c7ec0 2023-11-18T20:38:39.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99edaec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e806c760 con 0x7f99e80c4940 2023-11-18T20:38:39.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99e77fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f99e8151cc0 0x7f99e8157d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:37302/0 (socket says 172.21.15.132:37302) 2023-11-18T20:38:39.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99e77fe640 1 -- 172.21.15.132:0/3840423817 learned_addr learned my addr 172.21.15.132:0/3840423817 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:39.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99e7fff640 1 --2- 172.21.15.132:0/3840423817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e80c4940 0x7f99e80c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:39.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99e6ffd640 1 --2- 172.21.15.132:0/3840423817 >> v2:172.21.15.161:3300/0 conn(0x7f99e80c7ec0 0x7f99e8155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:39.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99e7fff640 1 -- 172.21.15.132:0/3840423817 >> v2:172.21.15.161:3300/0 conn(0x7f99e80c7ec0 msgr2=0x7f99e8155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:39.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.714+0000 7f99e7fff640 1 --2- 172.21.15.132:0/3840423817 >> v2:172.21.15.161:3300/0 conn(0x7f99e80c7ec0 0x7f99e8155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.715+0000 7f99e7fff640 1 -- 172.21.15.132:0/3840423817 >> v1:172.21.15.161:6789/0 conn(0x7f99e8151cc0 legacy=0x7f99e8157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:39.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.715+0000 7f99e7fff640 1 -- 172.21.15.132:0/3840423817 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80c8470 con 0x7f99e80c4940 2023-11-18T20:38:39.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.715+0000 7f99e67fc640 1 -- 172.21.15.132:0/3840423817 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289095977 0 0) 0x7f99d8001490 con 0x7f99e8151cc0 2023-11-18T20:38:39.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.716+0000 7f99e7fff640 1 --2- 172.21.15.132:0/3840423817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e80c4940 0x7f99e80c4d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99e00097a0 tx=0x7f99e002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd87d3554a6f02e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:39.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.716+0000 7f99e67fc640 1 -- 172.21.15.132:0/3840423817 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0031830 con 0x7f99e80c4940 2023-11-18T20:38:39.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.716+0000 7f99e67fc640 1 -- 172.21.15.132:0/3840423817 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e0031990 con 0x7f99e80c4940 2023-11-18T20:38:39.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.716+0000 7f99e67fc640 1 -- 172.21.15.132:0/3840423817 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0031d20 con 0x7f99e80c4940 2023-11-18T20:38:39.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.717+0000 7f99edaec640 1 -- 172.21.15.132:0/3840423817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e80c4940 msgr2=0x7f99e80c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:39.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.717+0000 7f99edaec640 1 --2- 172.21.15.132:0/3840423817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e80c4940 0x7f99e80c4d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99e00097a0 tx=0x7f99e002b8d0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.717+0000 7f99edaec640 1 -- 172.21.15.132:0/3840423817 shutdown_connections 2023-11-18T20:38:39.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.717+0000 7f99edaec640 1 --2- 172.21.15.132:0/3840423817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e80c4940 0x7f99e80c4d60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.717+0000 7f99edaec640 1 --2- 172.21.15.132:0/3840423817 >> v2:172.21.15.161:3300/0 conn(0x7f99e80c7ec0 0x7f99e8155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.717+0000 7f99edaec640 1 -- 172.21.15.132:0/3840423817 >> 172.21.15.132:0/3840423817 conn(0x7f99e8071e10 msgr2=0x7f99e8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:39.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.717+0000 7f99edaec640 1 -- 172.21.15.132:0/3840423817 shutdown_connections 2023-11-18T20:38:39.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.717+0000 7f99edaec640 1 -- 172.21.15.132:0/3840423817 wait complete. 2023-11-18T20:38:39.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.719+0000 7f99edaec640 1 Processor -- start 2023-11-18T20:38:39.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.719+0000 7f99edaec640 1 -- start start 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.719+0000 7f99edaec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e80c4940 0x7f99e80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99edaec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e80c7ec0 0x7f99e81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99edaec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e8151cc0 0x7f99e8150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99edaec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e814f4e0 con 0x7f99e80c7ec0 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99edaec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e814fd40 con 0x7f99e80c4940 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99edaec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8148ed0 con 0x7f99e8151cc0 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e80c7ec0 0x7f99e81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e80c7ec0 0x7f99e81501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56794/0 (socket says 172.21.15.132:56794) 2023-11-18T20:38:39.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e6ffd640 1 -- 172.21.15.132:0/1165010869 learned_addr learned my addr 172.21.15.132:0/1165010869 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e77fe640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e80c4940 0x7f99e80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e7fff640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e8151cc0 0x7f99e8150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e6ffd640 1 -- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e8151cc0 msgr2=0x7f99e8150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e6ffd640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e8151cc0 0x7f99e8150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e6ffd640 1 -- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e80c4940 msgr2=0x7f99e80aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e6ffd640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e80c4940 0x7f99e80aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e6ffd640 1 -- 172.21.15.132:0/1165010869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0009400 con 0x7f99e80c7ec0 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.720+0000 7f99e77fe640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e80c4940 0x7f99e80aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.721+0000 7f99e6ffd640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e80c7ec0 0x7f99e81501d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99d000e980 tx=0x7f99d000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.721+0000 7f99dffff640 1 -- 172.21.15.132:0/1165010869 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0009670 con 0x7f99e80c7ec0 2023-11-18T20:38:39.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.721+0000 7f99dffff640 1 -- 172.21.15.132:0/1165010869 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d000ca00 con 0x7f99e80c7ec0 2023-11-18T20:38:39.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.721+0000 7f99dffff640 1 -- 172.21.15.132:0/1165010869 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d000cd90 con 0x7f99e80c7ec0 2023-11-18T20:38:39.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.721+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e81eaf90 con 0x7f99e80c7ec0 2023-11-18T20:38:39.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.721+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e814f9d0 con 0x7f99e80c7ec0 2023-11-18T20:38:39.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.722+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e8155870 con 0x7f99e80c7ec0 2023-11-18T20:38:39.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.723+0000 7f99dffff640 1 -- 172.21.15.132:0/1165010869 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99d0013470 con 0x7f99e80c7ec0 2023-11-18T20:38:39.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.724+0000 7f99dffff640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99c806ae40 0x7f99c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:39.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.724+0000 7f99dffff640 1 -- 172.21.15.132:0/1165010869 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99d0089860 con 0x7f99e80c7ec0 2023-11-18T20:38:39.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.725+0000 7f99e77fe640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99c806ae40 0x7f99c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:39.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.726+0000 7f99e77fe640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99c806ae40 0x7f99c806d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fd0 tx=0x7f99d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:39.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.730+0000 7f99dffff640 1 -- 172.21.15.132:0/1165010869 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f99d0054900 con 0x7f99e80c7ec0 2023-11-18T20:38:39.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.920+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f99e8068350 con 0x7f99e80c7ec0 2023-11-18T20:38:39.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.925+0000 7f99dffff640 1 -- 172.21.15.132:0/1165010869 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f99d0057f20 con 0x7f99e80c7ec0 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99c806ae40 msgr2=0x7f99c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99c806ae40 0x7f99c806d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fd0 tx=0x7f99d8009040 comp rx=0 tx=0).stop 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e80c7ec0 msgr2=0x7f99e81501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e80c7ec0 0x7f99e81501d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99d000e980 tx=0x7f99d000ee40 comp rx=0 tx=0).stop 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 shutdown_connections 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99c806ae40 0x7f99c806d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e8151cc0 0x7f99e8150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e80c7ec0 0x7f99e81501d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 --2- 172.21.15.132:0/1165010869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e80c4940 0x7f99e80aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:39.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.928+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 >> 172.21.15.132:0/1165010869 conn(0x7f99e8071e10 msgr2=0x7f99e814c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:39.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.929+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 shutdown_connections 2023-11-18T20:38:39.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:39.929+0000 7f99edaec640 1 -- 172.21.15.132:0/1165010869 wait complete. 2023-11-18T20:38:39.950 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-18T20:38:39.951 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:38:40.064 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:38:40.201 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-18T20:38:40.201 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:38:40.201 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:38:40.261 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:38:40.261 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:38:40.314 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:38:40.314 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:38:40.369 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:40.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.580+0000 7f8b7f644640 1 Processor -- start 2023-11-18T20:38:40.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.581+0000 7f8b7f644640 1 -- start start 2023-11-18T20:38:40.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.582+0000 7f8b7f644640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b780c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:40.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.582+0000 7f8b7f644640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b780c17a0 0x7f8b7815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:40.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.582+0000 7f8b7f644640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b78155ac0 con 0x7f8b781556e0 2023-11-18T20:38:40.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.582+0000 7f8b7f644640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b780c4060 con 0x7f8b780c17a0 2023-11-18T20:38:40.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.582+0000 7f8b7f644640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780c31f0 con 0x7f8b780a6d70 2023-11-18T20:38:40.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.583+0000 7f8b7d3e0640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8b781556e0 0x7f8b780c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:37310/0 (socket says 172.21.15.132:37310) 2023-11-18T20:38:40.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.583+0000 7f8b7d3e0640 1 -- 172.21.15.132:0/1937528433 learned_addr learned my addr 172.21.15.132:0/1937528433 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.583+0000 7f8b7cbdf640 1 --2- 172.21.15.132:0/1937528433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b780c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.583+0000 7f8b7dbe1640 1 --2- 172.21.15.132:0/1937528433 >> v2:172.21.15.161:3300/0 conn(0x7f8b780c17a0 0x7f8b7815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.583+0000 7f8b77fff640 1 -- 172.21.15.132:0/1937528433 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271508421 0 0) 0x7f8b78155ac0 con 0x7f8b781556e0 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.583+0000 7f8b77fff640 1 -- 172.21.15.132:0/1937528433 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b68003520 con 0x7f8b781556e0 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.583+0000 7f8b7cbdf640 1 -- 172.21.15.132:0/1937528433 >> v2:172.21.15.161:3300/0 conn(0x7f8b780c17a0 msgr2=0x7f8b7815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.583+0000 7f8b7cbdf640 1 --2- 172.21.15.132:0/1937528433 >> v2:172.21.15.161:3300/0 conn(0x7f8b780c17a0 0x7f8b7815f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.584+0000 7f8b7cbdf640 1 -- 172.21.15.132:0/1937528433 >> v1:172.21.15.161:6789/0 conn(0x7f8b781556e0 legacy=0x7f8b780c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.584+0000 7f8b7cbdf640 1 -- 172.21.15.132:0/1937528433 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b780c2830 con 0x7f8b780a6d70 2023-11-18T20:38:40.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.585+0000 7f8b7cbdf640 1 --2- 172.21.15.132:0/1937528433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b780c1260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b640097a0 tx=0x7f8b6402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e4223813749f909 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:40.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.585+0000 7f8b77fff640 1 -- 172.21.15.132:0/1937528433 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6402f050 con 0x7f8b780a6d70 2023-11-18T20:38:40.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.585+0000 7f8b77fff640 1 -- 172.21.15.132:0/1937528433 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b64031700 con 0x7f8b780a6d70 2023-11-18T20:38:40.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.585+0000 7f8b77fff640 1 -- 172.21.15.132:0/1937528433 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64031a70 con 0x7f8b780a6d70 2023-11-18T20:38:40.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.586+0000 7f8b7f644640 1 -- 172.21.15.132:0/1937528433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 msgr2=0x7f8b780c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:40.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.586+0000 7f8b7f644640 1 --2- 172.21.15.132:0/1937528433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b780c1260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b640097a0 tx=0x7f8b6402b7a0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.586+0000 7f8b7f644640 1 -- 172.21.15.132:0/1937528433 shutdown_connections 2023-11-18T20:38:40.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.586+0000 7f8b7f644640 1 --2- 172.21.15.132:0/1937528433 >> v2:172.21.15.161:3300/0 conn(0x7f8b780c17a0 0x7f8b7815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.586+0000 7f8b7f644640 1 --2- 172.21.15.132:0/1937528433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b780c1260 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.586+0000 7f8b7f644640 1 -- 172.21.15.132:0/1937528433 >> 172.21.15.132:0/1937528433 conn(0x7f8b780c7e30 msgr2=0x7f8b780c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:40.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.586+0000 7f8b7f644640 1 -- 172.21.15.132:0/1937528433 shutdown_connections 2023-11-18T20:38:40.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.586+0000 7f8b7f644640 1 -- 172.21.15.132:0/1937528433 wait complete. 2023-11-18T20:38:40.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.588+0000 7f8b7f644640 1 Processor -- start 2023-11-18T20:38:40.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.588+0000 7f8b7f644640 1 -- start start 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7f644640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b781ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7f644640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b780c17a0 0x7f8b781ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7f644640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b781556e0 0x7f8b780a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7f644640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78158c10 con 0x7f8b780c17a0 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7f644640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780aad70 con 0x7f8b781556e0 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7f644640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b781edde0 con 0x7f8b780a6d70 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7cbdf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b780c17a0 0x7f8b781ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7cbdf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b780c17a0 0x7f8b781ed8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56802/0 (socket says 172.21.15.132:56802) 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7cbdf640 1 -- 172.21.15.132:0/2937311402 learned_addr learned my addr 172.21.15.132:0/2937311402 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.589+0000 7f8b7d3e0640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b781ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:40.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7dbe1640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b781556e0 0x7f8b780a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:40.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7cbdf640 1 -- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 msgr2=0x7f8b781ed360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:40.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7cbdf640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b781ed360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7cbdf640 1 -- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b781556e0 msgr2=0x7f8b780a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:40.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7cbdf640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b781556e0 0x7f8b780a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7cbdf640 1 -- 172.21.15.132:0/2937311402 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b64009400 con 0x7f8b780c17a0 2023-11-18T20:38:40.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7dbe1640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b781556e0 0x7f8b780a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:40.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7cbdf640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b780c17a0 0x7f8b781ed8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8b6402b7e0 tx=0x7f8b640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:40.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b75ffb640 1 -- 172.21.15.132:0/2937311402 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64031ef0 con 0x7f8b780c17a0 2023-11-18T20:38:40.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b75ffb640 1 -- 172.21.15.132:0/2937311402 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b640044a0 con 0x7f8b780c17a0 2023-11-18T20:38:40.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b780ab010 con 0x7f8b780c17a0 2023-11-18T20:38:40.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.590+0000 7f8b75ffb640 1 -- 172.21.15.132:0/2937311402 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64003820 con 0x7f8b780c17a0 2023-11-18T20:38:40.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.591+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7806ec20 con 0x7f8b780c17a0 2023-11-18T20:38:40.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.592+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b78158d80 con 0x7f8b780c17a0 2023-11-18T20:38:40.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.593+0000 7f8b75ffb640 1 -- 172.21.15.132:0/2937311402 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b6403a070 con 0x7f8b780c17a0 2023-11-18T20:38:40.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.593+0000 7f8b75ffb640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b5c06ae40 0x7f8b5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:40.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.594+0000 7f8b75ffb640 1 -- 172.21.15.132:0/2937311402 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b640aae70 con 0x7f8b780c17a0 2023-11-18T20:38:40.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.594+0000 7f8b7d3e0640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b5c06ae40 0x7f8b5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:40.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.595+0000 7f8b7d3e0640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b5c06ae40 0x7f8b5c06d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c005c00 tx=0x7f8b6c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:40.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.598+0000 7f8b75ffb640 1 -- 172.21.15.132:0/2937311402 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b64075f20 con 0x7f8b780c17a0 2023-11-18T20:38:40.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.788+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b780ab220 con 0x7f8b780c17a0 2023-11-18T20:38:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.791+0000 7f8b75ffb640 1 -- 172.21.15.132:0/2937311402 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f8b64079540 con 0x7f8b780c17a0 2023-11-18T20:38:40.793 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:40.793 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b5c06ae40 msgr2=0x7f8b5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b5c06ae40 0x7f8b5c06d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c005c00 tx=0x7f8b6c009040 comp rx=0 tx=0).stop 2023-11-18T20:38:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b780c17a0 msgr2=0x7f8b781ed8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b780c17a0 0x7f8b781ed8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8b6402b7e0 tx=0x7f8b640046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 shutdown_connections 2023-11-18T20:38:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b5c06ae40 0x7f8b5c06d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b781556e0 0x7f8b780a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b780c17a0 0x7f8b781ed8a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 --2- 172.21.15.132:0/2937311402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b780a6d70 0x7f8b781ed360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 >> 172.21.15.132:0/2937311402 conn(0x7f8b780c7e30 msgr2=0x7f8b780c1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 shutdown_connections 2023-11-18T20:38:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:40.794+0000 7f8b7f644640 1 -- 172.21.15.132:0/2937311402 wait complete. 2023-11-18T20:38:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:40.815 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:41.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.026+0000 7fe3727d5640 1 Processor -- start 2023-11-18T20:38:41.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.026+0000 7fe3727d5640 1 -- start start 2023-11-18T20:38:41.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.027+0000 7fe3727d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c0c3340 0x7fe36c156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.027+0000 7fe3727d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c0bfdc0 con 0x7fe36c0c45d0 2023-11-18T20:38:41.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.027+0000 7fe3727d5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c156a80 con 0x7fe36c0c5ec0 2023-11-18T20:38:41.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.027+0000 7fe3727d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c06e390 con 0x7fe36c0c3340 2023-11-18T20:38:41.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.028+0000 7fe363fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe36c0c45d0 0x7fe36c155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40798/0 (socket says 172.21.15.132:40798) 2023-11-18T20:38:41.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.028+0000 7fe363fff640 1 -- 172.21.15.132:0/154800497 learned_addr learned my addr 172.21.15.132:0/154800497 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:41.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.028+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247441659 0 0) 0x7fe36c0bfdc0 con 0x7fe36c0c45d0 2023-11-18T20:38:41.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.028+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe358003520 con 0x7fe36c0c45d0 2023-11-18T20:38:41.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.028+0000 7fe370d72640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c0c3340 0x7fe36c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 26790465 0 0) 0x7fe358003520 con 0x7fe36c0c45d0 2023-11-18T20:38:41.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c0c3340 msgr2=0x7fe36c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:41.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c0c3340 0x7fe36c156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 >> v1:172.21.15.161:6789/0 conn(0x7fe36c0c5ec0 legacy=0x7fe36c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c06ddd0 con 0x7fe36c0c45d0 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fe354001670 con 0x7fe36c0c45d0 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 >> v1:172.21.15.132:6789/0 conn(0x7fe36c0c45d0 legacy=0x7fe36c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c0c3340 0x7fe3580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe358004020 0x7fe3580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004e20 0x7fe35800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c06e390 con 0x7fe358004020 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe358005640 con 0x7fe358004e20 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35800bec0 con 0x7fe36c0c3340 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe363fff640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe358004020 0x7fe3580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe370d72640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004e20 0x7fe35800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe363fff640 1 -- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c0c3340 msgr2=0x7fe3580039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe36bfff640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c0c3340 0x7fe3580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe363fff640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c0c3340 0x7fe3580039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe363fff640 1 -- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004e20 msgr2=0x7fe35800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe363fff640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004e20 0x7fe35800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.029+0000 7fe363fff640 1 -- 172.21.15.132:0/154800497 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358003520 con 0x7fe358004020 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.031+0000 7fe363fff640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe358004020 0x7fe3580047c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0c49e0 tx=0x7fe3580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a7e99b0d174687 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.031+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354005ad0 con 0x7fe358004020 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.031+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354005c30 con 0x7fe358004020 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.031+0000 7fe36b7fe640 1 -- 172.21.15.132:0/154800497 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35402c9f0 con 0x7fe358004020 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.031+0000 7fe3727d5640 1 -- 172.21.15.132:0/154800497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe358004020 msgr2=0x7fe3580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.031+0000 7fe3727d5640 1 --2- 172.21.15.132:0/154800497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe358004020 0x7fe3580047c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0c49e0 tx=0x7fe3580057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.031+0000 7fe370d72640 1 -- 172.21.15.132:0/154800497 reap_dead start 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.032+0000 7fe3727d5640 1 -- 172.21.15.132:0/154800497 shutdown_connections 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.032+0000 7fe3727d5640 1 -- 172.21.15.132:0/154800497 >> 172.21.15.132:0/154800497 conn(0x7fe36c06a500 msgr2=0x7fe36c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.032+0000 7fe3727d5640 1 -- 172.21.15.132:0/154800497 shutdown_connections 2023-11-18T20:38:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.032+0000 7fe3727d5640 1 -- 172.21.15.132:0/154800497 wait complete. 2023-11-18T20:38:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.033+0000 7fe3727d5640 1 Processor -- start 2023-11-18T20:38:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.033+0000 7fe3727d5640 1 -- start start 2023-11-18T20:38:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.034+0000 7fe3727d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004020 0x7fe36c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.034+0000 7fe3727d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe36c0aab70 0x7fe36c1e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.034+0000 7fe3727d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c150980 0x7fe36c1e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.034+0000 7fe3727d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c149d20 con 0x7fe36c0aab70 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.034+0000 7fe3727d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c0960 con 0x7fe358004020 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.034+0000 7fe3727d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1ea800 con 0x7fe36c150980 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe36c0aab70 0x7fe36c1e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe36c0aab70 0x7fe36c1e6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56810/0 (socket says 172.21.15.132:56810) 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 -- 172.21.15.132:0/1408815756 learned_addr learned my addr 172.21.15.132:0/1408815756 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe36bfff640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004020 0x7fe36c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe370d72640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c150980 0x7fe36c1e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 -- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c150980 msgr2=0x7fe36c1e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c150980 0x7fe36c1e74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 -- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004020 msgr2=0x7fe36c157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004020 0x7fe36c157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 -- 172.21.15.132:0/1408815756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c1e79e0 con 0x7fe36c0aab70 2023-11-18T20:38:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe36bfff640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004020 0x7fe36c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.035+0000 7fe363fff640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe36c0aab70 0x7fe36c1e6f60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe35402c3b0 tx=0x7fe354001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.036+0000 7fe3697fa640 1 -- 172.21.15.132:0/1408815756 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35403c040 con 0x7fe36c0aab70 2023-11-18T20:38:41.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.036+0000 7fe3697fa640 1 -- 172.21.15.132:0/1408815756 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35402cbc0 con 0x7fe36c0aab70 2023-11-18T20:38:41.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.036+0000 7fe3697fa640 1 -- 172.21.15.132:0/1408815756 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354007070 con 0x7fe36c0aab70 2023-11-18T20:38:41.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.036+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c1eacc0 con 0x7fe36c0aab70 2023-11-18T20:38:41.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.036+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c1ea9e0 con 0x7fe36c0aab70 2023-11-18T20:38:41.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.037+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c0c0aa0 con 0x7fe36c0aab70 2023-11-18T20:38:41.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.038+0000 7fe3697fa640 1 -- 172.21.15.132:0/1408815756 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe354032070 con 0x7fe36c0aab70 2023-11-18T20:38:41.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.039+0000 7fe3697fa640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe34c06ae40 0x7fe34c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.039+0000 7fe3697fa640 1 -- 172.21.15.132:0/1408815756 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3540aaad0 con 0x7fe36c0aab70 2023-11-18T20:38:41.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.039+0000 7fe36bfff640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe34c06ae40 0x7fe34c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.040+0000 7fe36bfff640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe34c06ae40 0x7fe34c06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe35c001630 tx=0x7fe35c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.043+0000 7fe3697fa640 1 -- 172.21.15.132:0/1408815756 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe36c0c0aa0 con 0x7fe36c0aab70 2023-11-18T20:38:41.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.233+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe36c0c0aa0 con 0x7fe36c0aab70 2023-11-18T20:38:41.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.234+0000 7fe3697fa640 1 -- 172.21.15.132:0/1408815756 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe36c0c0aa0 con 0x7fe36c0aab70 2023-11-18T20:38:41.235 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:41.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe34c06ae40 msgr2=0x7fe34c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe34c06ae40 0x7fe34c06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe35c001630 tx=0x7fe35c009040 comp rx=0 tx=0).stop 2023-11-18T20:38:41.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe36c0aab70 msgr2=0x7fe36c1e6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe36c0aab70 0x7fe36c1e6f60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe35402c3b0 tx=0x7fe354001930 comp rx=0 tx=0).stop 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 shutdown_connections 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe34c06ae40 0x7fe34c06d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe36c150980 0x7fe36c1e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe36c0aab70 0x7fe36c1e6f60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 --2- 172.21.15.132:0/1408815756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe358004020 0x7fe36c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.236+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 >> 172.21.15.132:0/1408815756 conn(0x7fe36c06a500 msgr2=0x7fe36c0c3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.237+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 shutdown_connections 2023-11-18T20:38:41.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.237+0000 7fe3727d5640 1 -- 172.21.15.132:0/1408815756 wait complete. 2023-11-18T20:38:41.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:41.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.469+0000 7fdbf2c56640 1 Processor -- start 2023-11-18T20:38:41.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.469+0000 7fdbf2c56640 1 -- start start 2023-11-18T20:38:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.471+0000 7fdbf2c56640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 0x7fdbec1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.471+0000 7fdbf2c56640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec0c3180 con 0x7fdbec0a6da0 2023-11-18T20:38:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.471+0000 7fdbf2c56640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec0c33d0 con 0x7fdbec0c7100 2023-11-18T20:38:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.471+0000 7fdbf2c56640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0c36b0 con 0x7fdbec0c4fa0 2023-11-18T20:38:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.471+0000 7fdbebfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdbec0a6da0 0x7fdbec157ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40810/0 (socket says 172.21.15.132:40810) 2023-11-18T20:38:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.471+0000 7fdbebfff640 1 -- 172.21.15.132:0/2865214055 learned_addr learned my addr 172.21.15.132:0/2865214055 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.471+0000 7fdbf11f3640 1 --2- 172.21.15.132:0/2865214055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 0x7fdbec1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.472+0000 7fdbf11f3640 1 -- 172.21.15.132:0/2865214055 >> v1:172.21.15.161:6789/0 conn(0x7fdbec0c7100 legacy=0x7fdbec155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.472+0000 7fdbf11f3640 1 -- 172.21.15.132:0/2865214055 >> v1:172.21.15.132:6789/0 conn(0x7fdbec0a6da0 legacy=0x7fdbec157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.472+0000 7fdbeb7fe640 1 -- 172.21.15.132:0/2865214055 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576120833 0 0) 0x7fdbec0c3180 con 0x7fdbec0a6da0 2023-11-18T20:38:41.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.472+0000 7fdbf11f3640 1 -- 172.21.15.132:0/2865214055 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0c27c0 con 0x7fdbec0c4fa0 2023-11-18T20:38:41.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.474+0000 7fdbf11f3640 1 --2- 172.21.15.132:0/2865214055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 0x7fdbec1585d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009dc0 tx=0x7fdbe402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f499a17952c6cd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.476+0000 7fdbeb7fe640 1 -- 172.21.15.132:0/2865214055 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe402cc40 con 0x7fdbec0c4fa0 2023-11-18T20:38:41.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.476+0000 7fdbeb7fe640 1 -- 172.21.15.132:0/2865214055 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe402cda0 con 0x7fdbec0c4fa0 2023-11-18T20:38:41.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.476+0000 7fdbeb7fe640 1 -- 172.21.15.132:0/2865214055 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4034660 con 0x7fdbec0c4fa0 2023-11-18T20:38:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.477+0000 7fdbf2c56640 1 -- 172.21.15.132:0/2865214055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 msgr2=0x7fdbec1585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.477+0000 7fdbf2c56640 1 --2- 172.21.15.132:0/2865214055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 0x7fdbec1585d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009dc0 tx=0x7fdbe402be90 comp rx=0 tx=0).stop 2023-11-18T20:38:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.477+0000 7fdbf2c56640 1 -- 172.21.15.132:0/2865214055 shutdown_connections 2023-11-18T20:38:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.477+0000 7fdbf2c56640 1 --2- 172.21.15.132:0/2865214055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 0x7fdbec1585d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.477+0000 7fdbf2c56640 1 -- 172.21.15.132:0/2865214055 >> 172.21.15.132:0/2865214055 conn(0x7fdbec0c7dc0 msgr2=0x7fdbec0c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.477+0000 7fdbf2c56640 1 -- 172.21.15.132:0/2865214055 shutdown_connections 2023-11-18T20:38:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.477+0000 7fdbf2c56640 1 -- 172.21.15.132:0/2865214055 wait complete. 2023-11-18T20:38:41.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.479+0000 7fdbf2c56640 1 Processor -- start 2023-11-18T20:38:41.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.479+0000 7fdbf2c56640 1 -- start start 2023-11-18T20:38:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.480+0000 7fdbf2c56640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbec0a6da0 0x7fdbec156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.480+0000 7fdbf2c56640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 0x7fdbec0ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.480+0000 7fdbf2c56640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbec0c7100 0x7fdbec1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.480+0000 7fdbf2c56640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec157380 con 0x7fdbec0c7100 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.480+0000 7fdbf2c56640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec09b130 con 0x7fdbec0a6da0 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.480+0000 7fdbf2c56640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec09a0c0 con 0x7fdbec0c4fa0 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf11f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbec0c7100 0x7fdbec1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf11f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbec0c7100 0x7fdbec1512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56824/0 (socket says 172.21.15.132:56824) 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf11f3640 1 -- 172.21.15.132:0/1352827589 learned_addr learned my addr 172.21.15.132:0/1352827589 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf09f2640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbec0a6da0 0x7fdbec156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf11f3640 1 -- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 msgr2=0x7fdbec0ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf11f3640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 0x7fdbec0ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf11f3640 1 -- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbec0a6da0 msgr2=0x7fdbec156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf11f3640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbec0a6da0 0x7fdbec156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.481+0000 7fdbf11f3640 1 -- 172.21.15.132:0/1352827589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4009a70 con 0x7fdbec0c7100 2023-11-18T20:38:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.482+0000 7fdbf11f3640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbec0c7100 0x7fdbec1512e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009ee0 tx=0x7fdbe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.482+0000 7fdbe97fa640 1 -- 172.21.15.132:0/1352827589 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe403e610 con 0x7fdbec0c7100 2023-11-18T20:38:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.482+0000 7fdbe97fa640 1 -- 172.21.15.132:0/1352827589 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe403e770 con 0x7fdbec0c7100 2023-11-18T20:38:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.482+0000 7fdbe97fa640 1 -- 172.21.15.132:0/1352827589 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe403eb20 con 0x7fdbec0c7100 2023-11-18T20:38:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.482+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec1eabd0 con 0x7fdbec0c7100 2023-11-18T20:38:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.482+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec099de0 con 0x7fdbec0c7100 2023-11-18T20:38:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.484+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec157530 con 0x7fdbec0c7100 2023-11-18T20:38:41.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.484+0000 7fdbe97fa640 1 -- 172.21.15.132:0/1352827589 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbe403b050 con 0x7fdbec0c7100 2023-11-18T20:38:41.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.485+0000 7fdbe97fa640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdbd006ae70 0x7fdbd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.485+0000 7fdbe97fa640 1 -- 172.21.15.132:0/1352827589 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbe40abf10 con 0x7fdbec0c7100 2023-11-18T20:38:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.486+0000 7fdbf09f2640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdbd006ae70 0x7fdbd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.487+0000 7fdbf09f2640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdbd006ae70 0x7fdbd006d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbec1e7b00 tx=0x7fdbe0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.490+0000 7fdbe97fa640 1 -- 172.21.15.132:0/1352827589 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdbec157530 con 0x7fdbec0c7100 2023-11-18T20:38:41.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.679+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbec068350 con 0x7fdbec0c7100 2023-11-18T20:38:41.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.680+0000 7fdbe97fa640 1 -- 172.21.15.132:0/1352827589 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbe4039020 con 0x7fdbec0c7100 2023-11-18T20:38:41.681 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:41.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.682+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdbd006ae70 msgr2=0x7fdbd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.682+0000 7fdbf2c56640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdbd006ae70 0x7fdbd006d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbec1e7b00 tx=0x7fdbe0009040 comp rx=0 tx=0).stop 2023-11-18T20:38:41.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.682+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbec0c7100 msgr2=0x7fdbec1512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.682+0000 7fdbf2c56640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbec0c7100 0x7fdbec1512e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009ee0 tx=0x7fdbe4004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:41.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.683+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 shutdown_connections 2023-11-18T20:38:41.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.683+0000 7fdbf2c56640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdbd006ae70 0x7fdbd006d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.683+0000 7fdbf2c56640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbec0c7100 0x7fdbec1512e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.683+0000 7fdbf2c56640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdbec0c4fa0 0x7fdbec0ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.683+0000 7fdbf2c56640 1 --2- 172.21.15.132:0/1352827589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbec0a6da0 0x7fdbec156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.683+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 >> 172.21.15.132:0/1352827589 conn(0x7fdbec0c7dc0 msgr2=0x7fdbec0c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:41.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.683+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 shutdown_connections 2023-11-18T20:38:41.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.683+0000 7fdbf2c56640 1 -- 172.21.15.132:0/1352827589 wait complete. 2023-11-18T20:38:41.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:41.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.921+0000 7fed5ad68640 1 Processor -- start 2023-11-18T20:38:41.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.921+0000 7fed5ad68640 1 -- start start 2023-11-18T20:38:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed5ad68640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed540a9b40 0x7fed540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed5ad68640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed540c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed5ad68640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed540c06c0 con 0x7fed54155490 2023-11-18T20:38:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed5ad68640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540a5820 con 0x7fed540a9b40 2023-11-18T20:38:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed5ad68640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540c1020 con 0x7fed540c1500 2023-11-18T20:38:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed53fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed540a9b40 0x7fed540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed53fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed540a9b40 0x7fed540a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56840/0 (socket says 172.21.15.132:56840) 2023-11-18T20:38:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed53fff640 1 -- 172.21.15.132:0/4207662521 learned_addr learned my addr 172.21.15.132:0/4207662521 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed59305640 1 --2- 172.21.15.132:0/4207662521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed540c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed53fff640 1 -- 172.21.15.132:0/4207662521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 msgr2=0x7fed540c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed53fff640 1 --2- 172.21.15.132:0/4207662521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed540c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed53fff640 1 -- 172.21.15.132:0/4207662521 >> v1:172.21.15.161:6789/0 conn(0x7fed54155490 legacy=0x7fed540a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed53fff640 1 -- 172.21.15.132:0/4207662521 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540c0910 con 0x7fed540a9b40 2023-11-18T20:38:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.923+0000 7fed59305640 1 --2- 172.21.15.132:0/4207662521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed540c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:41.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.925+0000 7fed53fff640 1 --2- 172.21.15.132:0/4207662521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed540a9b40 0x7fed540a51b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed4002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395d7a28ea8908fe server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.925+0000 7fed537fe640 1 -- 172.21.15.132:0/4207662521 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40031640 con 0x7fed540a9b40 2023-11-18T20:38:41.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.925+0000 7fed537fe640 1 -- 172.21.15.132:0/4207662521 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed400317a0 con 0x7fed540a9b40 2023-11-18T20:38:41.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.925+0000 7fed537fe640 1 -- 172.21.15.132:0/4207662521 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40031b30 con 0x7fed540a9b40 2023-11-18T20:38:41.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.926+0000 7fed5ad68640 1 -- 172.21.15.132:0/4207662521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed540a9b40 msgr2=0x7fed540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.926+0000 7fed5ad68640 1 --2- 172.21.15.132:0/4207662521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed540a9b40 0x7fed540a51b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed4002b8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.926+0000 7fed5ad68640 1 -- 172.21.15.132:0/4207662521 shutdown_connections 2023-11-18T20:38:41.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.926+0000 7fed5ad68640 1 --2- 172.21.15.132:0/4207662521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed540c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.926+0000 7fed5ad68640 1 --2- 172.21.15.132:0/4207662521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed540a9b40 0x7fed540a51b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.926+0000 7fed5ad68640 1 -- 172.21.15.132:0/4207662521 >> 172.21.15.132:0/4207662521 conn(0x7fed5406a500 msgr2=0x7fed5406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:41.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.926+0000 7fed5ad68640 1 -- 172.21.15.132:0/4207662521 shutdown_connections 2023-11-18T20:38:41.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.926+0000 7fed5ad68640 1 -- 172.21.15.132:0/4207662521 wait complete. 2023-11-18T20:38:41.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.928+0000 7fed5ad68640 1 Processor -- start 2023-11-18T20:38:41.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.928+0000 7fed5ad68640 1 -- start start 2023-11-18T20:38:41.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed5ad68640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed541514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed5ad68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54155490 0x7fed5414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed5ad68640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5414fd30 0x7fed541e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed5ad68640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54151090 con 0x7fed54155490 2023-11-18T20:38:41.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed5ad68640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54151a20 con 0x7fed5414fd30 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed5ad68640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5414c0d0 con 0x7fed540c1500 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed53fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54155490 0x7fed5414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed53fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54155490 0x7fed5414cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56850/0 (socket says 172.21.15.132:56850) 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed53fff640 1 -- 172.21.15.132:0/1195100901 learned_addr learned my addr 172.21.15.132:0/1195100901 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed53fff640 1 -- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 msgr2=0x7fed541514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed59305640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5414fd30 0x7fed541e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed58b04640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed541514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed53fff640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed541514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed53fff640 1 -- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5414fd30 msgr2=0x7fed541e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.929+0000 7fed53fff640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5414fd30 0x7fed541e9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed53fff640 1 -- 172.21.15.132:0/1195100901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400094d0 con 0x7fed54155490 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed58b04640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed541514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:41.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed59305640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5414fd30 0x7fed541e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:41.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed53fff640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54155490 0x7fed5414cfd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed517fa640 1 -- 172.21.15.132:0/1195100901 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4003ac60 con 0x7fed54155490 2023-11-18T20:38:41.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed517fa640 1 -- 172.21.15.132:0/1195100901 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4003adc0 con 0x7fed54155490 2023-11-18T20:38:41.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed517fa640 1 -- 172.21.15.132:0/1195100901 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40044630 con 0x7fed54155490 2023-11-18T20:38:41.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5414c370 con 0x7fed54155490 2023-11-18T20:38:41.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.930+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5414d510 con 0x7fed54155490 2023-11-18T20:38:41.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.931+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed54151200 con 0x7fed54155490 2023-11-18T20:38:41.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.932+0000 7fed517fa640 1 -- 172.21.15.132:0/1195100901 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed4002f050 con 0x7fed54155490 2023-11-18T20:38:41.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.933+0000 7fed517fa640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed3806ae70 0x7fed3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:41.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.933+0000 7fed517fa640 1 -- 172.21.15.132:0/1195100901 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed400ab600 con 0x7fed54155490 2023-11-18T20:38:41.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.934+0000 7fed58b04640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed3806ae70 0x7fed3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:41.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.935+0000 7fed58b04640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed3806ae70 0x7fed3806d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed4800a830 tx=0x7fed48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:41.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:41.938+0000 7fed517fa640 1 -- 172.21.15.132:0/1195100901 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed54151200 con 0x7fed54155490 2023-11-18T20:38:42.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.127+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed541511d0 con 0x7fed54155490 2023-11-18T20:38:42.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.128+0000 7fed517fa640 1 -- 172.21.15.132:0/1195100901 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed400766a0 con 0x7fed54155490 2023-11-18T20:38:42.129 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:42.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.130+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed3806ae70 msgr2=0x7fed3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:42.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.130+0000 7fed5ad68640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed3806ae70 0x7fed3806d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed4800a830 tx=0x7fed48008040 comp rx=0 tx=0).stop 2023-11-18T20:38:42.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.130+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54155490 msgr2=0x7fed5414cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:42.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.130+0000 7fed5ad68640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54155490 0x7fed5414cfd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed400046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.131+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 shutdown_connections 2023-11-18T20:38:42.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.131+0000 7fed5ad68640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed3806ae70 0x7fed3806d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.131+0000 7fed5ad68640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5414fd30 0x7fed541e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.131+0000 7fed5ad68640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54155490 0x7fed5414cfd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.131+0000 7fed5ad68640 1 --2- 172.21.15.132:0/1195100901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed540c1500 0x7fed541514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.131+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 >> 172.21.15.132:0/1195100901 conn(0x7fed5406a500 msgr2=0x7fed540a9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:42.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.131+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 shutdown_connections 2023-11-18T20:38:42.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.131+0000 7fed5ad68640 1 -- 172.21.15.132:0/1195100901 wait complete. 2023-11-18T20:38:42.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:38:42.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.362+0000 7f772d933640 1 Processor -- start 2023-11-18T20:38:42.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.363+0000 7f772d933640 1 -- start start 2023-11-18T20:38:42.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.364+0000 7f772d933640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c5f30 0x7f7728155d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:42.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.364+0000 7f772d933640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77280c31b0 0x7f77280c7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:42.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.364+0000 7f772d933640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f77280c1a90 0x7f77280a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:42.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.364+0000 7f772d933640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280c1600 con 0x7f77280c1a90 2023-11-18T20:38:42.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.364+0000 7f772d933640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280c8090 con 0x7f77280c31b0 2023-11-18T20:38:42.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.364+0000 7f772d933640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77280c8370 con 0x7f77280c5f30 2023-11-18T20:38:42.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77277fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f77280c1a90 0x7f77280a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:42.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77277fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f77280c1a90 0x7f77280a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56860/0 (socket says 172.21.15.132:56860) 2023-11-18T20:38:42.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77277fe640 1 -- 172.21.15.132:0/55723447 learned_addr learned my addr 172.21.15.132:0/55723447 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:42.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77267fc640 1 --2- 172.21.15.132:0/55723447 >> v2:172.21.15.161:3300/0 conn(0x7f77280c31b0 0x7f77280c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:42.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f7726ffd640 1 --2- 172.21.15.132:0/55723447 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c5f30 0x7f7728155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:42.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77277fe640 1 -- 172.21.15.132:0/55723447 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c5f30 msgr2=0x7f7728155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:42.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77277fe640 1 --2- 172.21.15.132:0/55723447 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c5f30 0x7f7728155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77277fe640 1 -- 172.21.15.132:0/55723447 >> v2:172.21.15.161:3300/0 conn(0x7f77280c31b0 msgr2=0x7f77280c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:42.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77277fe640 1 --2- 172.21.15.132:0/55723447 >> v2:172.21.15.161:3300/0 conn(0x7f77280c31b0 0x7f77280c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.365+0000 7f77277fe640 1 -- 172.21.15.132:0/55723447 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280c8650 con 0x7f77280c1a90 2023-11-18T20:38:42.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.366+0000 7f77277fe640 1 --2- 172.21.15.132:0/55723447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c1a90 0x7f77280a6df0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f772806b4c0 tx=0x7f772002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bef4702c482d73d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:42.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.366+0000 7f7725ffb640 1 -- 172.21.15.132:0/55723447 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720031870 con 0x7f77280c1a90 2023-11-18T20:38:42.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.366+0000 7f7725ffb640 1 -- 172.21.15.132:0/55723447 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77200319d0 con 0x7f77280c1a90 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.366+0000 7f7725ffb640 1 -- 172.21.15.132:0/55723447 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720031d60 con 0x7f77280c1a90 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 -- 172.21.15.132:0/55723447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c1a90 msgr2=0x7f77280a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 --2- 172.21.15.132:0/55723447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c1a90 0x7f77280a6df0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f772806b4c0 tx=0x7f772002b910 comp rx=0 tx=0).stop 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 -- 172.21.15.132:0/55723447 shutdown_connections 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 --2- 172.21.15.132:0/55723447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c1a90 0x7f77280a6df0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 --2- 172.21.15.132:0/55723447 >> v2:172.21.15.161:3300/0 conn(0x7f77280c31b0 0x7f77280c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 --2- 172.21.15.132:0/55723447 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c5f30 0x7f7728155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 -- 172.21.15.132:0/55723447 >> 172.21.15.132:0/55723447 conn(0x7f77280a9b70 msgr2=0x7f77280a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 -- 172.21.15.132:0/55723447 shutdown_connections 2023-11-18T20:38:42.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.367+0000 7f772d933640 1 -- 172.21.15.132:0/55723447 wait complete. 2023-11-18T20:38:42.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.369+0000 7f772d933640 1 Processor -- start 2023-11-18T20:38:42.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.370+0000 7f772d933640 1 -- start start 2023-11-18T20:38:42.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f772d933640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c1a90 0x7f77280abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:42.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f772d933640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77280c31b0 0x7f7728154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:42.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f772d933640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c5f30 0x7f77281dc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:42.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f772d933640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77280a6580 con 0x7f77280c5f30 2023-11-18T20:38:42.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f772d933640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77280ab210 con 0x7f77280c31b0 2023-11-18T20:38:42.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f772d933640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772806f990 con 0x7f77280c1a90 2023-11-18T20:38:42.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f77277fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c5f30 0x7f77281dc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:42.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f77277fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c5f30 0x7f77281dc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56870/0 (socket says 172.21.15.132:56870) 2023-11-18T20:38:42.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f77277fe640 1 -- 172.21.15.132:0/791664565 learned_addr learned my addr 172.21.15.132:0/791664565 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:42.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f7726ffd640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c1a90 0x7f77280abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:42.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.371+0000 7f77277fe640 1 -- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c1a90 msgr2=0x7f77280abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f77267fc640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77280c31b0 0x7f7728154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f77277fe640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c1a90 0x7f77280abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f77277fe640 1 -- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77280c31b0 msgr2=0x7f7728154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f77277fe640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77280c31b0 0x7f7728154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f77277fe640 1 -- 172.21.15.132:0/791664565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200094d0 con 0x7f77280c5f30 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f7726ffd640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c1a90 0x7f77280abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f77267fc640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77280c31b0 0x7f7728154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f77277fe640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c5f30 0x7f77281dc020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f772002b950 tx=0x7f77200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f771ffff640 1 -- 172.21.15.132:0/791664565 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772003ac60 con 0x7f77280c5f30 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f771ffff640 1 -- 172.21.15.132:0/791664565 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772003adc0 con 0x7f77280c5f30 2023-11-18T20:38:42.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77280a67d0 con 0x7f77280c5f30 2023-11-18T20:38:42.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f771ffff640 1 -- 172.21.15.132:0/791664565 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720045690 con 0x7f77280c5f30 2023-11-18T20:38:42.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.372+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77280ab740 con 0x7f77280c5f30 2023-11-18T20:38:42.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.373+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7728068350 con 0x7f77280c5f30 2023-11-18T20:38:42.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.374+0000 7f771ffff640 1 -- 172.21.15.132:0/791664565 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77200457f0 con 0x7f77280c5f30 2023-11-18T20:38:42.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.375+0000 7f771ffff640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f770806ae40 0x7f770806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:42.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.375+0000 7f771ffff640 1 -- 172.21.15.132:0/791664565 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f772002d040 con 0x7f77280c5f30 2023-11-18T20:38:42.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.376+0000 7f7726ffd640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f770806ae40 0x7f770806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:42.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.377+0000 7f7726ffd640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f770806ae40 0x7f770806d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f77280a6340 tx=0x7f771800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:42.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.379+0000 7f771ffff640 1 -- 172.21.15.132:0/791664565 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7720076ed0 con 0x7f77280c5f30 2023-11-18T20:38:42.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.584+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7728066fb0 con 0x7f77280c5f30 2023-11-18T20:38:42.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.585+0000 7f771ffff640 1 -- 172.21.15.132:0/791664565 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7720035070 con 0x7f77280c5f30 2023-11-18T20:38:42.586 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f770806ae40 msgr2=0x7f770806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f770806ae40 0x7f770806d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f77280a6340 tx=0x7f771800b040 comp rx=0 tx=0).stop 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c5f30 msgr2=0x7f77281dc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c5f30 0x7f77281dc020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f772002b950 tx=0x7f77200046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 shutdown_connections 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f770806ae40 0x7f770806d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77280c5f30 0x7f77281dc020 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77280c31b0 0x7f7728154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 --2- 172.21.15.132:0/791664565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77280c1a90 0x7f77280abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:42.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 >> 172.21.15.132:0/791664565 conn(0x7f77280a9b70 msgr2=0x7f77281e0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:42.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 shutdown_connections 2023-11-18T20:38:42.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:42.588+0000 7f772d933640 1 -- 172.21.15.132:0/791664565 wait complete. 2023-11-18T20:38:42.607 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-18T20:38:42.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:42.608 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-18T20:38:42.706 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:38:42.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:42.706 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-18T20:38:42.766 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:38:42.766 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:38:42.829 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:38:42.829 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:38:42.882 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:38:42.883 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:38:42.937 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:43.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.158+0000 7ff708c67640 1 Processor -- start 2023-11-18T20:38:43.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.158+0000 7ff708c67640 1 -- start start 2023-11-18T20:38:43.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.159+0000 7ff708c67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff70414e7f0 0x7ff7040c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.159+0000 7ff708c67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70406cd20 0x7ff70415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.159+0000 7ff708c67640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040a8380 con 0x7ff7040c52e0 2023-11-18T20:38:43.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.159+0000 7ff708c67640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7041510b0 con 0x7ff70414e7f0 2023-11-18T20:38:43.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.159+0000 7ff708c67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70406bf60 con 0x7ff70406cd20 2023-11-18T20:38:43.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.160+0000 7ff703fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70406cd20 0x7ff70415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.160+0000 7ff703fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70406cd20 0x7ff70415ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:43768/0 (socket says 172.21.15.132:43768) 2023-11-18T20:38:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.160+0000 7ff703fff640 1 -- 172.21.15.132:0/1870082255 learned_addr learned my addr 172.21.15.132:0/1870082255 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.160+0000 7ff7037fe640 1 --2- 172.21.15.132:0/1870082255 >> v2:172.21.15.161:3300/0 conn(0x7ff70414e7f0 0x7ff7040c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.161+0000 7ff703fff640 1 -- 172.21.15.132:0/1870082255 >> v2:172.21.15.161:3300/0 conn(0x7ff70414e7f0 msgr2=0x7ff7040c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.161+0000 7ff703fff640 1 --2- 172.21.15.132:0/1870082255 >> v2:172.21.15.161:3300/0 conn(0x7ff70414e7f0 0x7ff7040c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.161+0000 7ff703fff640 1 -- 172.21.15.132:0/1870082255 >> v1:172.21.15.161:6789/0 conn(0x7ff7040c52e0 legacy=0x7ff70406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.161+0000 7ff703fff640 1 -- 172.21.15.132:0/1870082255 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70406c240 con 0x7ff70406cd20 2023-11-18T20:38:43.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.162+0000 7ff703fff640 1 --2- 172.21.15.132:0/1870082255 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70406cd20 0x7ff70415ba30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009e50 tx=0x7ff6fc02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17ff3aa80acb46d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:43.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.163+0000 7ff702ffd640 1 -- 172.21.15.132:0/1870082255 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc02ca70 con 0x7ff70406cd20 2023-11-18T20:38:43.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.163+0000 7ff702ffd640 1 -- 172.21.15.132:0/1870082255 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc02cbd0 con 0x7ff70406cd20 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.163+0000 7ff702ffd640 1 -- 172.21.15.132:0/1870082255 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0343f0 con 0x7ff70406cd20 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.163+0000 7ff708c67640 1 -- 172.21.15.132:0/1870082255 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70406cd20 msgr2=0x7ff70415ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.163+0000 7ff708c67640 1 --2- 172.21.15.132:0/1870082255 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70406cd20 0x7ff70415ba30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009e50 tx=0x7ff6fc02bed0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.164+0000 7ff708c67640 1 -- 172.21.15.132:0/1870082255 shutdown_connections 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.164+0000 7ff708c67640 1 --2- 172.21.15.132:0/1870082255 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70406cd20 0x7ff70415ba30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.164+0000 7ff708c67640 1 --2- 172.21.15.132:0/1870082255 >> v2:172.21.15.161:3300/0 conn(0x7ff70414e7f0 0x7ff7040c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.164+0000 7ff708c67640 1 -- 172.21.15.132:0/1870082255 >> 172.21.15.132:0/1870082255 conn(0x7ff7040a77f0 msgr2=0x7ff7040a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.164+0000 7ff708c67640 1 -- 172.21.15.132:0/1870082255 shutdown_connections 2023-11-18T20:38:43.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.164+0000 7ff708c67640 1 -- 172.21.15.132:0/1870082255 wait complete. 2023-11-18T20:38:43.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.166+0000 7ff708c67640 1 Processor -- start 2023-11-18T20:38:43.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.166+0000 7ff708c67640 1 -- start start 2023-11-18T20:38:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff708c67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff70406cd20 0x7ff70414b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff708c67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7040c52e0 0x7ff704149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff708c67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70414e7f0 0x7ff704147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff708c67640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff704149180 con 0x7ff7040c52e0 2023-11-18T20:38:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff708c67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7041eaa70 con 0x7ff70406cd20 2023-11-18T20:38:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff708c67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7041eafa0 con 0x7ff70414e7f0 2023-11-18T20:38:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff6fbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7040c52e0 0x7ff704149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff6fbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7040c52e0 0x7ff704149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56886/0 (socket says 172.21.15.132:56886) 2023-11-18T20:38:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.167+0000 7ff6fbfff640 1 -- 172.21.15.132:0/2289289720 learned_addr learned my addr 172.21.15.132:0/2289289720 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff7037fe640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff70406cd20 0x7ff70414b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff703fff640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70414e7f0 0x7ff704147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff6fbfff640 1 -- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70414e7f0 msgr2=0x7ff704147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff6fbfff640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70414e7f0 0x7ff704147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff6fbfff640 1 -- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff70406cd20 msgr2=0x7ff70414b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff6fbfff640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff70406cd20 0x7ff70414b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff6fbfff640 1 -- 172.21.15.132:0/2289289720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc009b30 con 0x7ff7040c52e0 2023-11-18T20:38:43.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff6fbfff640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7040c52e0 0x7ff704149b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c450 tx=0x7ff6ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:43.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff700ff9640 1 -- 172.21.15.132:0/2289289720 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0052d0 con 0x7ff7040c52e0 2023-11-18T20:38:43.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.168+0000 7ff700ff9640 1 -- 172.21.15.132:0/2289289720 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec005430 con 0x7ff7040c52e0 2023-11-18T20:38:43.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.169+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7041eacc0 con 0x7ff7040c52e0 2023-11-18T20:38:43.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.169+0000 7ff700ff9640 1 -- 172.21.15.132:0/2289289720 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec012870 con 0x7ff7040c52e0 2023-11-18T20:38:43.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.169+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff704148ea0 con 0x7ff7040c52e0 2023-11-18T20:38:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.170+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70404e840 con 0x7ff7040c52e0 2023-11-18T20:38:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.171+0000 7ff700ff9640 1 -- 172.21.15.132:0/2289289720 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6ec0129d0 con 0x7ff7040c52e0 2023-11-18T20:38:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.172+0000 7ff700ff9640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff6e406ae40 0x7ff6e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.172+0000 7ff700ff9640 1 -- 172.21.15.132:0/2289289720 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6ec0891d0 con 0x7ff7040c52e0 2023-11-18T20:38:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.173+0000 7ff7037fe640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff6e406ae40 0x7ff6e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.174+0000 7ff7037fe640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff6e406ae40 0x7ff6e406d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff7040a7240 tx=0x7ff6f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:43.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.177+0000 7ff700ff9640 1 -- 172.21.15.132:0/2289289720 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6ec0541f0 con 0x7ff7040c52e0 2023-11-18T20:38:43.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.367+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff70406d8c0 con 0x7ff7040c52e0 2023-11-18T20:38:43.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.369+0000 7ff700ff9640 1 -- 172.21.15.132:0/2289289720 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7ff6ec057810 con 0x7ff7040c52e0 2023-11-18T20:38:43.371 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:43.371 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:00.157565+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff6e406ae40 msgr2=0x7ff6e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff6e406ae40 0x7ff6e406d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff7040a7240 tx=0x7ff6f4008040 comp rx=0 tx=0).stop 2023-11-18T20:38:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7040c52e0 msgr2=0x7ff704149b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7040c52e0 0x7ff704149b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c450 tx=0x7ff6ec00c910 comp rx=0 tx=0).stop 2023-11-18T20:38:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 shutdown_connections 2023-11-18T20:38:43.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff6e406ae40 0x7ff6e406d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff70414e7f0 0x7ff704147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7040c52e0 0x7ff704149b90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 --2- 172.21.15.132:0/2289289720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff70406cd20 0x7ff70414b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 >> 172.21.15.132:0/2289289720 conn(0x7ff7040a77f0 msgr2=0x7ff7040c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:43.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 shutdown_connections 2023-11-18T20:38:43.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.372+0000 7ff708c67640 1 -- 172.21.15.132:0/2289289720 wait complete. 2023-11-18T20:38:43.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:43.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:43.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.604+0000 7fcf23240640 1 Processor -- start 2023-11-18T20:38:43.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.604+0000 7fcf23240640 1 -- start start 2023-11-18T20:38:43.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf23240640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcf1c14c2e0 0x7fcf1c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf23240640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c0c0440 0x7fcf1c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf23240640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf1c072310 0x7fcf1c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf23240640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c071470 con 0x7fcf1c072310 2023-11-18T20:38:43.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf23240640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c071e80 con 0x7fcf1c14c2e0 2023-11-18T20:38:43.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf23240640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c14c6c0 con 0x7fcf1c0c0440 2023-11-18T20:38:43.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf22a3f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf1c072310 0x7fcf1c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf22a3f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf1c072310 0x7fcf1c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56892/0 (socket says 172.21.15.132:56892) 2023-11-18T20:38:43.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf22a3f640 1 -- 172.21.15.132:0/3207730210 learned_addr learned my addr 172.21.15.132:0/3207730210 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:43.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf21a3d640 1 --2- 172.21.15.132:0/3207730210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c0c0440 0x7fcf1c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.606+0000 7fcf2223e640 1 --2- 172.21.15.132:0/3207730210 >> v2:172.21.15.161:3300/0 conn(0x7fcf1c14c2e0 0x7fcf1c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.607+0000 7fcf22a3f640 1 -- 172.21.15.132:0/3207730210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c0c0440 msgr2=0x7fcf1c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:43.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.607+0000 7fcf22a3f640 1 --2- 172.21.15.132:0/3207730210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c0c0440 0x7fcf1c152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.607+0000 7fcf22a3f640 1 -- 172.21.15.132:0/3207730210 >> v2:172.21.15.161:3300/0 conn(0x7fcf1c14c2e0 msgr2=0x7fcf1c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:43.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.607+0000 7fcf22a3f640 1 --2- 172.21.15.132:0/3207730210 >> v2:172.21.15.161:3300/0 conn(0x7fcf1c14c2e0 0x7fcf1c0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.607+0000 7fcf22a3f640 1 -- 172.21.15.132:0/3207730210 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c153180 con 0x7fcf1c072310 2023-11-18T20:38:43.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.608+0000 7fcf22a3f640 1 --2- 172.21.15.132:0/3207730210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c0a4d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c067940 tx=0x7fcf1402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34d0694fea58f4d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:43.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.608+0000 7fcf2123c640 1 -- 172.21.15.132:0/3207730210 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1402c950 con 0x7fcf1c072310 2023-11-18T20:38:43.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.608+0000 7fcf2123c640 1 -- 172.21.15.132:0/3207730210 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1402cab0 con 0x7fcf1c072310 2023-11-18T20:38:43.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.608+0000 7fcf2123c640 1 -- 172.21.15.132:0/3207730210 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1402ce40 con 0x7fcf1c072310 2023-11-18T20:38:43.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 -- 172.21.15.132:0/3207730210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 msgr2=0x7fcf1c0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 --2- 172.21.15.132:0/3207730210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c0a4d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c067940 tx=0x7fcf1402bdb0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 -- 172.21.15.132:0/3207730210 shutdown_connections 2023-11-18T20:38:43.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 --2- 172.21.15.132:0/3207730210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c0a4d20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 --2- 172.21.15.132:0/3207730210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c0c0440 0x7fcf1c152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 --2- 172.21.15.132:0/3207730210 >> v2:172.21.15.161:3300/0 conn(0x7fcf1c14c2e0 0x7fcf1c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 -- 172.21.15.132:0/3207730210 >> 172.21.15.132:0/3207730210 conn(0x7fcf1c0a77f0 msgr2=0x7fcf1c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:43.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 -- 172.21.15.132:0/3207730210 shutdown_connections 2023-11-18T20:38:43.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.609+0000 7fcf23240640 1 -- 172.21.15.132:0/3207730210 wait complete. 2023-11-18T20:38:43.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.611+0000 7fcf23240640 1 Processor -- start 2023-11-18T20:38:43.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.611+0000 7fcf23240640 1 -- start start 2023-11-18T20:38:43.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.612+0000 7fcf23240640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.612+0000 7fcf23240640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf1c0c0440 0x7fcf1c1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.612+0000 7fcf23240640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c14c2e0 0x7fcf1c152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.612+0000 7fcf23240640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c14d660 con 0x7fcf1c072310 2023-11-18T20:38:43.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.612+0000 7fcf23240640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c14ce50 con 0x7fcf1c0c0440 2023-11-18T20:38:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.612+0000 7fcf23240640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c152470 con 0x7fcf1c14c2e0 2023-11-18T20:38:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.612+0000 7fcf2223e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.612+0000 7fcf2223e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c14fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56896/0 (socket says 172.21.15.132:56896) 2023-11-18T20:38:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf2223e640 1 -- 172.21.15.132:0/613618490 learned_addr learned my addr 172.21.15.132:0/613618490 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf22a3f640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c14c2e0 0x7fcf1c152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf21a3d640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf1c0c0440 0x7fcf1c1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf2223e640 1 -- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c14c2e0 msgr2=0x7fcf1c152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf2223e640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c14c2e0 0x7fcf1c152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf2223e640 1 -- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf1c0c0440 msgr2=0x7fcf1c1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf2223e640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf1c0c0440 0x7fcf1c1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf2223e640 1 -- 172.21.15.132:0/613618490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009b30 con 0x7fcf1c072310 2023-11-18T20:38:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf2223e640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c14fce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800d5f0 tx=0x7fcf1800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf12ffd640 1 -- 172.21.15.132:0/613618490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180125f0 con 0x7fcf1c072310 2023-11-18T20:38:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.613+0000 7fcf12ffd640 1 -- 172.21.15.132:0/613618490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18012750 con 0x7fcf1c072310 2023-11-18T20:38:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.614+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c1510a0 con 0x7fcf1c072310 2023-11-18T20:38:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.614+0000 7fcf12ffd640 1 -- 172.21.15.132:0/613618490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18012b00 con 0x7fcf1c072310 2023-11-18T20:38:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.614+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c154b20 con 0x7fcf1c072310 2023-11-18T20:38:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.615+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c04e840 con 0x7fcf1c072310 2023-11-18T20:38:43.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.616+0000 7fcf12ffd640 1 -- 172.21.15.132:0/613618490 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf18012c60 con 0x7fcf1c072310 2023-11-18T20:38:43.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.617+0000 7fcf12ffd640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcf0006ae40 0x7fcf0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:43.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.617+0000 7fcf12ffd640 1 -- 172.21.15.132:0/613618490 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf18089a60 con 0x7fcf1c072310 2023-11-18T20:38:43.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.618+0000 7fcf21a3d640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcf0006ae40 0x7fcf0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:43.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.619+0000 7fcf21a3d640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcf0006ae40 0x7fcf0006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0a6ce0 tx=0x7fcf0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.622+0000 7fcf12ffd640 1 -- 172.21.15.132:0/613618490 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf18054b00 con 0x7fcf1c072310 2023-11-18T20:38:43.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.811+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf1c0c5380 con 0x7fcf1c072310 2023-11-18T20:38:43.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.812+0000 7fcf12ffd640 1 -- 172.21.15.132:0/613618490 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf18058120 con 0x7fcf1c072310 2023-11-18T20:38:43.814 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:43.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.814+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcf0006ae40 msgr2=0x7fcf0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcf0006ae40 0x7fcf0006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0a6ce0 tx=0x7fcf0c008040 comp rx=0 tx=0).stop 2023-11-18T20:38:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 msgr2=0x7fcf1c14fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c14fce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800d5f0 tx=0x7fcf1800dab0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 shutdown_connections 2023-11-18T20:38:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcf0006ae40 0x7fcf0006d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1c14c2e0 0x7fcf1c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf1c0c0440 0x7fcf1c1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 --2- 172.21.15.132:0/613618490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c072310 0x7fcf1c14fce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 >> 172.21.15.132:0/613618490 conn(0x7fcf1c0a77f0 msgr2=0x7fcf1c14a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 shutdown_connections 2023-11-18T20:38:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:43.815+0000 7fcf23240640 1 -- 172.21.15.132:0/613618490 wait complete. 2023-11-18T20:38:43.835 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.051+0000 7fbf9de00640 1 Processor -- start 2023-11-18T20:38:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.051+0000 7fbf9de00640 1 -- start start 2023-11-18T20:38:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.052+0000 7fbf9de00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf98073a00 0x7fbf9806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.052+0000 7fbf9de00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbf98158030 0x7fbf98158460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.052+0000 7fbf9de00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9806aa40 con 0x7fbf98157c50 2023-11-18T20:38:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.052+0000 7fbf9de00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf981589a0 con 0x7fbf98073a00 2023-11-18T20:38:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.052+0000 7fbf9de00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf980c00d0 con 0x7fbf98158030 2023-11-18T20:38:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.053+0000 7fbf96ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf98073a00 0x7fbf9806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.053+0000 7fbf96ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf98073a00 0x7fbf9806a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56912/0 (socket says 172.21.15.132:56912) 2023-11-18T20:38:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.053+0000 7fbf96ffd640 1 -- 172.21.15.132:0/1417255781 learned_addr learned my addr 172.21.15.132:0/1417255781 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.053+0000 7fbf96ffd640 1 -- 172.21.15.132:0/1417255781 >> v2:172.21.15.161:3300/0 conn(0x7fbf98158030 msgr2=0x7fbf98158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.053+0000 7fbf96ffd640 1 --2- 172.21.15.132:0/1417255781 >> v2:172.21.15.161:3300/0 conn(0x7fbf98158030 0x7fbf98158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.053+0000 7fbf96ffd640 1 -- 172.21.15.132:0/1417255781 >> v1:172.21.15.161:6789/0 conn(0x7fbf98157c50 legacy=0x7fbf980c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.053+0000 7fbf96ffd640 1 -- 172.21.15.132:0/1417255781 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf980c1e00 con 0x7fbf98073a00 2023-11-18T20:38:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.054+0000 7fbf96ffd640 1 --2- 172.21.15.132:0/1417255781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98073a00 0x7fbf9806a500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf980c4150 tx=0x7fbf8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b831b8902fd41566 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.054+0000 7fbf967fc640 1 -- 172.21.15.132:0/1417255781 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c031870 con 0x7fbf98073a00 2023-11-18T20:38:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf967fc640 1 -- 172.21.15.132:0/1417255781 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c0319d0 con 0x7fbf98073a00 2023-11-18T20:38:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf967fc640 1 -- 172.21.15.132:0/1417255781 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c031d60 con 0x7fbf98073a00 2023-11-18T20:38:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf9de00640 1 -- 172.21.15.132:0/1417255781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98073a00 msgr2=0x7fbf9806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1417255781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98073a00 0x7fbf9806a500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf980c4150 tx=0x7fbf8c02b910 comp rx=0 tx=0).stop 2023-11-18T20:38:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf9de00640 1 -- 172.21.15.132:0/1417255781 shutdown_connections 2023-11-18T20:38:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1417255781 >> v2:172.21.15.161:3300/0 conn(0x7fbf98158030 0x7fbf98158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1417255781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98073a00 0x7fbf9806a500 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf9de00640 1 -- 172.21.15.132:0/1417255781 >> 172.21.15.132:0/1417255781 conn(0x7fbf980c30b0 msgr2=0x7fbf980c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf9de00640 1 -- 172.21.15.132:0/1417255781 shutdown_connections 2023-11-18T20:38:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.055+0000 7fbf9de00640 1 -- 172.21.15.132:0/1417255781 wait complete. 2023-11-18T20:38:44.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.057+0000 7fbf9de00640 1 Processor -- start 2023-11-18T20:38:44.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.057+0000 7fbf9de00640 1 -- start start 2023-11-18T20:38:44.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf9de00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf98073a00 0x7fbf981ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf9de00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf98157c50 0x7fbf981ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf9de00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98158030 0x7fbf980a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf9de00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf98143300 con 0x7fbf98158030 2023-11-18T20:38:44.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf9de00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf98151530 con 0x7fbf98157c50 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf9de00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf981edf30 con 0x7fbf98073a00 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf97fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98158030 0x7fbf980a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf97fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98158030 0x7fbf980a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56926/0 (socket says 172.21.15.132:56926) 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.058+0000 7fbf97fff640 1 -- 172.21.15.132:0/1505812580 learned_addr learned my addr 172.21.15.132:0/1505812580 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf977fe640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf98073a00 0x7fbf981ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf96ffd640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf98157c50 0x7fbf981ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf97fff640 1 -- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf98073a00 msgr2=0x7fbf981ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf97fff640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf98073a00 0x7fbf981ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf97fff640 1 -- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf98157c50 msgr2=0x7fbf981ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf97fff640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf98157c50 0x7fbf981ed9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf97fff640 1 -- 172.21.15.132:0/1505812580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0094d0 con 0x7fbf98158030 2023-11-18T20:38:44.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf97fff640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98158030 0x7fbf980a9530 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000b970 tx=0x7fbf9000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.059+0000 7fbf7ffff640 1 -- 172.21.15.132:0/1505812580 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000cb40 con 0x7fbf98158030 2023-11-18T20:38:44.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.060+0000 7fbf7ffff640 1 -- 172.21.15.132:0/1505812580 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9000ccc0 con 0x7fbf98158030 2023-11-18T20:38:44.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.060+0000 7fbf7ffff640 1 -- 172.21.15.132:0/1505812580 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90014680 con 0x7fbf98158030 2023-11-18T20:38:44.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.060+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf98151780 con 0x7fbf98158030 2023-11-18T20:38:44.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.060+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf98150950 con 0x7fbf98158030 2023-11-18T20:38:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.061+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf98066b40 con 0x7fbf98158030 2023-11-18T20:38:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.062+0000 7fbf7ffff640 1 -- 172.21.15.132:0/1505812580 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf9001d3b0 con 0x7fbf98158030 2023-11-18T20:38:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.063+0000 7fbf7ffff640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf8406ae40 0x7fbf8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.063+0000 7fbf7ffff640 1 -- 172.21.15.132:0/1505812580 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf900894e0 con 0x7fbf98158030 2023-11-18T20:38:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.063+0000 7fbf977fe640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf8406ae40 0x7fbf8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.064+0000 7fbf977fe640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf8406ae40 0x7fbf8406d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbf98151de0 tx=0x7fbf88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.067+0000 7fbf7ffff640 1 -- 172.21.15.132:0/1505812580 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf90054630 con 0x7fbf98158030 2023-11-18T20:38:44.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.257+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf98068350 con 0x7fbf98158030 2023-11-18T20:38:44.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.258+0000 7fbf7ffff640 1 -- 172.21.15.132:0/1505812580 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf90057c50 con 0x7fbf98158030 2023-11-18T20:38:44.259 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf8406ae40 msgr2=0x7fbf8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf8406ae40 0x7fbf8406d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbf98151de0 tx=0x7fbf88009040 comp rx=0 tx=0).stop 2023-11-18T20:38:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98158030 msgr2=0x7fbf980a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98158030 0x7fbf980a9530 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000b970 tx=0x7fbf9000be30 comp rx=0 tx=0).stop 2023-11-18T20:38:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 shutdown_connections 2023-11-18T20:38:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf8406ae40 0x7fbf8406d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf98158030 0x7fbf980a9530 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf98157c50 0x7fbf981ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 --2- 172.21.15.132:0/1505812580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf98073a00 0x7fbf981ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 >> 172.21.15.132:0/1505812580 conn(0x7fbf980c30b0 msgr2=0x7fbf981574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 shutdown_connections 2023-11-18T20:38:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.261+0000 7fbf9de00640 1 -- 172.21.15.132:0/1505812580 wait complete. 2023-11-18T20:38:44.283 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.493+0000 7fed3a256640 1 Processor -- start 2023-11-18T20:38:44.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.493+0000 7fed3a256640 1 -- start start 2023-11-18T20:38:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.494+0000 7fed3a256640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed3414fd30 0x7fed34152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.494+0000 7fed3a256640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed340c3ea0 0x7fed340c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed3a256640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed340c64a0 con 0x7fed3406d0a0 2023-11-18T20:38:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed3a256640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed340c5c00 con 0x7fed3414fd30 2023-11-18T20:38:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed3a256640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340c5ee0 con 0x7fed340c3ea0 2023-11-18T20:38:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed3414fd30 0x7fed34152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed3414fd30 0x7fed34152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56936/0 (socket says 172.21.15.132:56936) 2023-11-18T20:38:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed337fe640 1 -- 172.21.15.132:0/21896322 learned_addr learned my addr 172.21.15.132:0/21896322 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed33fff640 1 --2- 172.21.15.132:0/21896322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed340c3ea0 0x7fed340c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed337fe640 1 -- 172.21.15.132:0/21896322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed340c3ea0 msgr2=0x7fed340c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed337fe640 1 --2- 172.21.15.132:0/21896322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed340c3ea0 0x7fed340c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed337fe640 1 -- 172.21.15.132:0/21896322 >> v1:172.21.15.161:6789/0 conn(0x7fed3406d0a0 legacy=0x7fed340a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed337fe640 1 -- 172.21.15.132:0/21896322 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340c61c0 con 0x7fed3414fd30 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.495+0000 7fed33fff640 1 --2- 172.21.15.132:0/21896322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed340c3ea0 0x7fed340c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.497+0000 7fed337fe640 1 --2- 172.21.15.132:0/21896322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3414fd30 0x7fed34152f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fed24009870 tx=0x7fed2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51f2d124f174c6b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.497+0000 7fed32ffd640 1 -- 172.21.15.132:0/21896322 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24031640 con 0x7fed3414fd30 2023-11-18T20:38:44.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.497+0000 7fed32ffd640 1 -- 172.21.15.132:0/21896322 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed240317a0 con 0x7fed3414fd30 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.497+0000 7fed32ffd640 1 -- 172.21.15.132:0/21896322 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24031b30 con 0x7fed3414fd30 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.498+0000 7fed3a256640 1 -- 172.21.15.132:0/21896322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3414fd30 msgr2=0x7fed34152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.498+0000 7fed3a256640 1 --2- 172.21.15.132:0/21896322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3414fd30 0x7fed34152f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fed24009870 tx=0x7fed2402b8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.498+0000 7fed3a256640 1 -- 172.21.15.132:0/21896322 shutdown_connections 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.498+0000 7fed3a256640 1 --2- 172.21.15.132:0/21896322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed340c3ea0 0x7fed340c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.498+0000 7fed3a256640 1 --2- 172.21.15.132:0/21896322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3414fd30 0x7fed34152f20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.498+0000 7fed3a256640 1 -- 172.21.15.132:0/21896322 >> 172.21.15.132:0/21896322 conn(0x7fed3406a500 msgr2=0x7fed3406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.498+0000 7fed3a256640 1 -- 172.21.15.132:0/21896322 shutdown_connections 2023-11-18T20:38:44.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.498+0000 7fed3a256640 1 -- 172.21.15.132:0/21896322 wait complete. 2023-11-18T20:38:44.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.500+0000 7fed3a256640 1 Processor -- start 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.500+0000 7fed3a256640 1 -- start start 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed3a256640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3406d0a0 0x7fed34150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed3a256640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed340c3ea0 0x7fed3414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed3a256640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed3414fd30 0x7fed341ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed3a256640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340a97d0 con 0x7fed3406d0a0 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed3a256640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34150770 con 0x7fed340c3ea0 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed3a256640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340aa520 con 0x7fed3414fd30 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3406d0a0 0x7fed34150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3406d0a0 0x7fed34150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56940/0 (socket says 172.21.15.132:56940) 2023-11-18T20:38:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed337fe640 1 -- 172.21.15.132:0/1324625922 learned_addr learned my addr 172.21.15.132:0/1324625922 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed337fe640 1 -- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed3414fd30 msgr2=0x7fed341ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed337fe640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed3414fd30 0x7fed341ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed337fe640 1 -- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed340c3ea0 msgr2=0x7fed3414cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed337fe640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed340c3ea0 0x7fed3414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.501+0000 7fed337fe640 1 -- 172.21.15.132:0/1324625922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240094d0 con 0x7fed3406d0a0 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.502+0000 7fed337fe640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3406d0a0 0x7fed34150c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed24009870 tx=0x7fed240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.502+0000 7fed30ff9640 1 -- 172.21.15.132:0/1324625922 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2403ac60 con 0x7fed3406d0a0 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.502+0000 7fed30ff9640 1 -- 172.21.15.132:0/1324625922 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2403adc0 con 0x7fed3406d0a0 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.502+0000 7fed30ff9640 1 -- 172.21.15.132:0/1324625922 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24044630 con 0x7fed3406d0a0 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.502+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed34151f40 con 0x7fed3406d0a0 2023-11-18T20:38:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.502+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed34152500 con 0x7fed3406d0a0 2023-11-18T20:38:44.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.504+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed34068350 con 0x7fed3406d0a0 2023-11-18T20:38:44.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.505+0000 7fed30ff9640 1 -- 172.21.15.132:0/1324625922 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed2402f050 con 0x7fed3406d0a0 2023-11-18T20:38:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.506+0000 7fed30ff9640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed1406ae70 0x7fed1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.506+0000 7fed30ff9640 1 -- 172.21.15.132:0/1324625922 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed240ab6f0 con 0x7fed3406d0a0 2023-11-18T20:38:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.507+0000 7fed2bfff640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed1406ae70 0x7fed1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.508+0000 7fed2bfff640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed1406ae70 0x7fed1406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fed1c006fd0 tx=0x7fed1c006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.511+0000 7fed30ff9640 1 -- 172.21.15.132:0/1324625922 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed240768f0 con 0x7fed3406d0a0 2023-11-18T20:38:44.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.702+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed3406d540 con 0x7fed3406d0a0 2023-11-18T20:38:44.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.703+0000 7fed30ff9640 1 -- 172.21.15.132:0/1324625922 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed2404d450 con 0x7fed3406d0a0 2023-11-18T20:38:44.704 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:44.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed1406ae70 msgr2=0x7fed1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed1406ae70 0x7fed1406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fed1c006fd0 tx=0x7fed1c006bc0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3406d0a0 msgr2=0x7fed34150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3406d0a0 0x7fed34150c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed24009870 tx=0x7fed240046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 shutdown_connections 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed1406ae70 0x7fed1406d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed3414fd30 0x7fed341ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed340c3ea0 0x7fed3414cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 --2- 172.21.15.132:0/1324625922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed3406d0a0 0x7fed34150c00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 >> 172.21.15.132:0/1324625922 conn(0x7fed3406a500 msgr2=0x7fed340c1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 shutdown_connections 2023-11-18T20:38:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.706+0000 7fed3a256640 1 -- 172.21.15.132:0/1324625922 wait complete. 2023-11-18T20:38:44.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:38:44.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.940+0000 7fafab02d640 1 Processor -- start 2023-11-18T20:38:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.940+0000 7fafab02d640 1 -- start start 2023-11-18T20:38:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.942+0000 7fafab02d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa40c5ec0 0x7fafa40c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.942+0000 7fafab02d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40bfdc0 con 0x7fafa40c45d0 2023-11-18T20:38:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.942+0000 7fafab02d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa406ddd0 con 0x7fafa40721a0 2023-11-18T20:38:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.942+0000 7fafab02d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa406e390 con 0x7fafa40c5ec0 2023-11-18T20:38:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.942+0000 7fafa3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fafa40c45d0 0x7fafa4155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40820/0 (socket says 172.21.15.132:40820) 2023-11-18T20:38:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.942+0000 7fafa3fff640 1 -- 172.21.15.132:0/3076663381 learned_addr learned my addr 172.21.15.132:0/3076663381 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa8dc9640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa40c5ec0 0x7fafa40c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402550439 0 0) 0x7fafa40bfdc0 con 0x7fafa40c45d0 2023-11-18T20:38:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf94003520 con 0x7fafa40c45d0 2023-11-18T20:38:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2336802751 0 0) 0x7faf94003520 con 0x7fafa40c45d0 2023-11-18T20:38:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa40c5ec0 msgr2=0x7fafa40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa40c5ec0 0x7fafa40c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 >> v1:172.21.15.161:6789/0 conn(0x7fafa40721a0 legacy=0x7fafa4156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa406e0b0 con 0x7fafa40c45d0 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7faf90001670 con 0x7fafa40c45d0 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.943+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 >> v1:172.21.15.132:6789/0 conn(0x7fafa40c45d0 legacy=0x7fafa4155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa37fe640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7faf94003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa37fe640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa40c5ec0 0x7faf940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa37fe640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94004d00 0x7faf94005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa406e390 con 0x7faf940039a0 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9400bb90 con 0x7faf94004d00 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9400bd50 con 0x7fafa40c5ec0 2023-11-18T20:38:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa8dc9640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7faf94003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa3fff640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa40c5ec0 0x7faf940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa8dc9640 1 -- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa40c5ec0 msgr2=0x7faf940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa8dc9640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa40c5ec0 0x7faf940047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa8dc9640 1 -- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94004d00 msgr2=0x7faf94005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa95ca640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94004d00 0x7faf94005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa8dc9640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94004d00 0x7faf94005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa8dc9640 1 -- 172.21.15.132:0/3076663381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94003520 con 0x7faf940039a0 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.944+0000 7fafa95ca640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94004d00 0x7faf94005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.945+0000 7fafa8dc9640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7faf94003dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf98009ac0 tx=0x7faf940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09b7061f773129d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9802c6b0 con 0x7faf940039a0 2023-11-18T20:38:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9802c810 con 0x7faf940039a0 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafa37fe640 1 -- 172.21.15.132:0/3076663381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9802cba0 con 0x7faf940039a0 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafab02d640 1 -- 172.21.15.132:0/3076663381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 msgr2=0x7faf94003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafab02d640 1 --2- 172.21.15.132:0/3076663381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7faf94003dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf98009ac0 tx=0x7faf940057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafa95ca640 1 -- 172.21.15.132:0/3076663381 reap_dead start 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafab02d640 1 -- 172.21.15.132:0/3076663381 shutdown_connections 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafab02d640 1 -- 172.21.15.132:0/3076663381 >> 172.21.15.132:0/3076663381 conn(0x7fafa406a500 msgr2=0x7fafa406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafab02d640 1 -- 172.21.15.132:0/3076663381 shutdown_connections 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.946+0000 7fafab02d640 1 -- 172.21.15.132:0/3076663381 wait complete. 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.948+0000 7fafab02d640 1 Processor -- start 2023-11-18T20:38:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.948+0000 7fafab02d640 1 -- start start 2023-11-18T20:38:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafab02d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7fafa40a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafab02d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa4158800 0x7fafa40a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafab02d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafa41ed560 0x7fafa41ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafab02d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4099ee0 con 0x7faf940039a0 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafab02d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa409ca90 con 0x7fafa41ed560 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafab02d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41ee270 con 0x7fafa4158800 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafa8dc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7fafa40a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafa8dc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7fafa40a3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56958/0 (socket says 172.21.15.132:56958) 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.949+0000 7fafa8dc9640 1 -- 172.21.15.132:0/2713869548 learned_addr learned my addr 172.21.15.132:0/2713869548 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa3fff640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa4158800 0x7fafa40a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa8dc9640 1 -- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa4158800 msgr2=0x7fafa40a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa95ca640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafa41ed560 0x7fafa41ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa8dc9640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa4158800 0x7fafa40a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa8dc9640 1 -- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafa41ed560 msgr2=0x7fafa41ed9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa8dc9640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafa41ed560 0x7fafa41ed9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa8dc9640 1 -- 172.21.15.132:0/2713869548 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40a4ea0 con 0x7faf940039a0 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa95ca640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafa41ed560 0x7fafa41ed9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa8dc9640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7fafa40a3cc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf98037040 tx=0x7faf98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.950+0000 7fafa17fa640 1 -- 172.21.15.132:0/2713869548 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98003810 con 0x7faf940039a0 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.951+0000 7fafa17fa640 1 -- 172.21.15.132:0/2713869548 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98003970 con 0x7faf940039a0 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.951+0000 7fafa17fa640 1 -- 172.21.15.132:0/2713869548 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98003ce0 con 0x7faf940039a0 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.951+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa4099b00 con 0x7faf940039a0 2023-11-18T20:38:44.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.951+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa41edf20 con 0x7faf940039a0 2023-11-18T20:38:44.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.952+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa4068350 con 0x7faf940039a0 2023-11-18T20:38:44.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.953+0000 7fafa17fa640 1 -- 172.21.15.132:0/2713869548 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf98034440 con 0x7faf940039a0 2023-11-18T20:38:44.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.954+0000 7fafa17fa640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf8806ae40 0x7faf8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:44.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.954+0000 7fafa17fa640 1 -- 172.21.15.132:0/2713869548 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf980ab640 con 0x7faf940039a0 2023-11-18T20:38:44.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.954+0000 7fafa3fff640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf8806ae40 0x7faf8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:44.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.955+0000 7fafa3fff640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf8806ae40 0x7faf8806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafa40a74d0 tx=0x7faf90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:44.958+0000 7fafa17fa640 1 -- 172.21.15.132:0/2713869548 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf98076820 con 0x7faf940039a0 2023-11-18T20:38:45.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.161+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fafa40bfa00 con 0x7faf940039a0 2023-11-18T20:38:45.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.162+0000 7fafa17fa640 1 -- 172.21.15.132:0/2713869548 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf980044e0 con 0x7faf940039a0 2023-11-18T20:38:45.163 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.164+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf8806ae40 msgr2=0x7faf8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.164+0000 7fafab02d640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf8806ae40 0x7faf8806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafa40a74d0 tx=0x7faf90009040 comp rx=0 tx=0).stop 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.164+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 msgr2=0x7fafa40a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.164+0000 7fafab02d640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7fafa40a3cc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf98037040 tx=0x7faf98004730 comp rx=0 tx=0).stop 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.165+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 shutdown_connections 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.165+0000 7fafab02d640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf8806ae40 0x7faf8806d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.165+0000 7fafab02d640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafa41ed560 0x7fafa41ed9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.165+0000 7fafab02d640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafa4158800 0x7fafa40a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.165+0000 7fafab02d640 1 --2- 172.21.15.132:0/2713869548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf940039a0 0x7fafa40a3cc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.165+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 >> 172.21.15.132:0/2713869548 conn(0x7fafa406a500 msgr2=0x7fafa4153da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:45.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.165+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 shutdown_connections 2023-11-18T20:38:45.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.165+0000 7fafab02d640 1 -- 172.21.15.132:0/2713869548 wait complete. 2023-11-18T20:38:45.184 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-18T20:38:45.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:45.185 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-18T20:38:45.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:38:45.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:38:45.296 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T20:38:45.366 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-18T20:38:45.366 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:38:45.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.600+0000 7fd80bc61640 1 Processor -- start 2023-11-18T20:38:45.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.600+0000 7fd80bc61640 1 -- start start 2023-11-18T20:38:45.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.601+0000 7fd80bc61640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8040c5390 0x7fd804155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:45.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.601+0000 7fd80bc61640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040c2280 con 0x7fd8040a4f40 2023-11-18T20:38:45.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.601+0000 7fd80bc61640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040c2fb0 con 0x7fd80406ce20 2023-11-18T20:38:45.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.601+0000 7fd80bc61640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040a54b0 con 0x7fd8040c5390 2023-11-18T20:38:45.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.602+0000 7fd8099fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8040c5390 0x7fd804155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:45.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.602+0000 7fd8091fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd8040a4f40 0x7fd804156140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40826/0 (socket says 172.21.15.132:40826) 2023-11-18T20:38:45.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.602+0000 7fd8091fc640 1 -- 172.21.15.132:0/4231835784 learned_addr learned my addr 172.21.15.132:0/4231835784 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:45.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.602+0000 7fd8099fd640 1 -- 172.21.15.132:0/4231835784 >> v1:172.21.15.161:6789/0 conn(0x7fd80406ce20 legacy=0x7fd80406d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:45.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.602+0000 7fd8099fd640 1 -- 172.21.15.132:0/4231835784 >> v1:172.21.15.132:6789/0 conn(0x7fd8040a4f40 legacy=0x7fd804156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:45.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.602+0000 7fd8099fd640 1 -- 172.21.15.132:0/4231835784 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040c24d0 con 0x7fd8040c5390 2023-11-18T20:38:45.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.602+0000 7fd8089fb640 1 -- 172.21.15.132:0/4231835784 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453727701 0 0) 0x7fd8040c2280 con 0x7fd8040a4f40 2023-11-18T20:38:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.603+0000 7fd8099fd640 1 --2- 172.21.15.132:0/4231835784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804155c00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd8000097a0 tx=0x7fd80002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd42c117de1eeedb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd8089fb640 1 -- 172.21.15.132:0/4231835784 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800031830 con 0x7fd8040c5390 2023-11-18T20:38:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd8089fb640 1 -- 172.21.15.132:0/4231835784 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800031990 con 0x7fd8040c5390 2023-11-18T20:38:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd8089fb640 1 -- 172.21.15.132:0/4231835784 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800031d20 con 0x7fd8040c5390 2023-11-18T20:38:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd80bc61640 1 -- 172.21.15.132:0/4231835784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 msgr2=0x7fd804155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd80bc61640 1 --2- 172.21.15.132:0/4231835784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804155c00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd8000097a0 tx=0x7fd80002b8d0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd80bc61640 1 -- 172.21.15.132:0/4231835784 shutdown_connections 2023-11-18T20:38:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd80bc61640 1 --2- 172.21.15.132:0/4231835784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804155c00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd80bc61640 1 -- 172.21.15.132:0/4231835784 >> 172.21.15.132:0/4231835784 conn(0x7fd8040c5cc0 msgr2=0x7fd8040c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:45.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd80bc61640 1 -- 172.21.15.132:0/4231835784 shutdown_connections 2023-11-18T20:38:45.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.604+0000 7fd80bc61640 1 -- 172.21.15.132:0/4231835784 wait complete. 2023-11-18T20:38:45.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.606+0000 7fd80bc61640 1 Processor -- start 2023-11-18T20:38:45.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.606+0000 7fd80bc61640 1 -- start start 2023-11-18T20:38:45.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80bc61640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd80406ce20 0x7fd8041edde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:45.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80bc61640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8040a4f40 0x7fd8040bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:45.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80bc61640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:45.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80bc61640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804154730 con 0x7fd8040c5390 2023-11-18T20:38:45.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80bc61640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040a9d00 con 0x7fd8040a4f40 2023-11-18T20:38:45.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80bc61640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041554c0 con 0x7fd80406ce20 2023-11-18T20:38:45.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80a1fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:45.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80a1fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56976/0 (socket says 172.21.15.132:56976) 2023-11-18T20:38:45.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.607+0000 7fd80a1fe640 1 -- 172.21.15.132:0/2053221762 learned_addr learned my addr 172.21.15.132:0/2053221762 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd80a1fe640 1 -- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd80406ce20 msgr2=0x7fd8041edde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd80a1fe640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd80406ce20 0x7fd8041edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd80a1fe640 1 -- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8040a4f40 msgr2=0x7fd8040bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd80a1fe640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8040a4f40 0x7fd8040bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd80a1fe640 1 -- 172.21.15.132:0/2053221762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009400 con 0x7fd8040c5390 2023-11-18T20:38:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd80a1fe640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804145570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c6b0 tx=0x7fd7fc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd7f67fc640 1 -- 172.21.15.132:0/2053221762 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc003b70 con 0x7fd8040c5390 2023-11-18T20:38:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd7f67fc640 1 -- 172.21.15.132:0/2053221762 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc003cf0 con 0x7fd8040c5390 2023-11-18T20:38:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd7f67fc640 1 -- 172.21.15.132:0/2053221762 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc003ea0 con 0x7fd8040c5390 2023-11-18T20:38:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd804154940 con 0x7fd8040c5390 2023-11-18T20:38:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.608+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd804154f00 con 0x7fd8040c5390 2023-11-18T20:38:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.609+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd804068350 con 0x7fd8040c5390 2023-11-18T20:38:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.610+0000 7fd7f67fc640 1 -- 172.21.15.132:0/2053221762 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7fc005310 con 0x7fd8040c5390 2023-11-18T20:38:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.611+0000 7fd7f67fc640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd7e806ae40 0x7fd7e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.611+0000 7fd7f67fc640 1 -- 172.21.15.132:0/2053221762 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd7fc0893e0 con 0x7fd8040c5390 2023-11-18T20:38:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.612+0000 7fd8099fd640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd7e806ae40 0x7fd7e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:45.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.613+0000 7fd8099fd640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd7e806ae40 0x7fd7e806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd800036000 tx=0x7fd800030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:45.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.615+0000 7fd7f67fc640 1 -- 172.21.15.132:0/2053221762 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7fc054460 con 0x7fd8040c5390 2023-11-18T20:38:45.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.843+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8040a4b10 con 0x7fd8040c5390 2023-11-18T20:38:45.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.844+0000 7fd7f67fc640 1 -- 172.21.15.132:0/2053221762 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fd7fc057a80 con 0x7fd8040c5390 2023-11-18T20:38:45.845 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:45.845 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:37:58.599151+0000","modified":"2023-11-18T20:38:01.664198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T20:38:45.845 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-11-18T20:38:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd7e806ae40 msgr2=0x7fd7e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd7e806ae40 0x7fd7e806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd800036000 tx=0x7fd800030000 comp rx=0 tx=0).stop 2023-11-18T20:38:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 msgr2=0x7fd804145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804145570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c6b0 tx=0x7fd7fc00cb70 comp rx=0 tx=0).stop 2023-11-18T20:38:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 shutdown_connections 2023-11-18T20:38:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd7e806ae40 0x7fd7e806d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8040c5390 0x7fd804145570 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8040a4f40 0x7fd8040bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 --2- 172.21.15.132:0/2053221762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd80406ce20 0x7fd8041edde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.846+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 >> 172.21.15.132:0/2053221762 conn(0x7fd8040c5cc0 msgr2=0x7fd8040a8740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.847+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 shutdown_connections 2023-11-18T20:38:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:45.847+0000 7fd80bc61640 1 -- 172.21.15.132:0/2053221762 wait complete. 2023-11-18T20:38:45.865 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:46.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.081+0000 7f9fad267640 1 Processor -- start 2023-11-18T20:38:46.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.082+0000 7f9fad267640 1 -- start start 2023-11-18T20:38:46.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.083+0000 7f9fad267640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa814e7c0 0x7f9fa80c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.083+0000 7f9fad267640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9fa8154580 0x7f9fa8154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.083+0000 7f9fad267640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa8158a60 con 0x7f9fa80c4c00 2023-11-18T20:38:46.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.083+0000 7f9fad267640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80c5b10 con 0x7f9fa8154580 2023-11-18T20:38:46.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.083+0000 7f9fad267640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8157ca0 con 0x7f9fa814e7c0 2023-11-18T20:38:46.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.083+0000 7f9faca66640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9fa8154580 0x7f9fa8154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.084+0000 7f9faca66640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9fa8154580 0x7f9fa8154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56978/0 (socket says 172.21.15.132:56978) 2023-11-18T20:38:46.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.084+0000 7f9faca66640 1 -- 172.21.15.132:0/3155596061 learned_addr learned my addr 172.21.15.132:0/3155596061 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:46.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.084+0000 7f9fa7fff640 1 --2- 172.21.15.132:0/3155596061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa814e7c0 0x7f9fa80c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.084+0000 7f9faca66640 1 -- 172.21.15.132:0/3155596061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa814e7c0 msgr2=0x7f9fa80c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.084+0000 7f9faca66640 1 --2- 172.21.15.132:0/3155596061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa814e7c0 0x7f9fa80c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.084+0000 7f9faca66640 1 -- 172.21.15.132:0/3155596061 >> v1:172.21.15.161:6789/0 conn(0x7f9fa80c4c00 legacy=0x7f9fa80ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.084+0000 7f9faca66640 1 -- 172.21.15.132:0/3155596061 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8157f80 con 0x7f9fa8154580 2023-11-18T20:38:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.085+0000 7f9faca66640 1 --2- 172.21.15.132:0/3155596061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa8154a10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009870 tx=0x7f9fa002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de03bae915bcf838 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fa6ffd640 1 -- 172.21.15.132:0/3155596061 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00317c0 con 0x7f9fa8154580 2023-11-18T20:38:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fa6ffd640 1 -- 172.21.15.132:0/3155596061 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0031920 con 0x7f9fa8154580 2023-11-18T20:38:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fa6ffd640 1 -- 172.21.15.132:0/3155596061 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0031cb0 con 0x7f9fa8154580 2023-11-18T20:38:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fad267640 1 -- 172.21.15.132:0/3155596061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 msgr2=0x7f9fa8154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fad267640 1 --2- 172.21.15.132:0/3155596061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa8154a10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009870 tx=0x7f9fa002b860 comp rx=0 tx=0).stop 2023-11-18T20:38:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fad267640 1 -- 172.21.15.132:0/3155596061 shutdown_connections 2023-11-18T20:38:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fad267640 1 --2- 172.21.15.132:0/3155596061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa8154a10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fad267640 1 --2- 172.21.15.132:0/3155596061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa814e7c0 0x7f9fa80c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fad267640 1 -- 172.21.15.132:0/3155596061 >> 172.21.15.132:0/3155596061 conn(0x7f9fa80abf00 msgr2=0x7f9fa80c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fad267640 1 -- 172.21.15.132:0/3155596061 shutdown_connections 2023-11-18T20:38:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.086+0000 7f9fad267640 1 -- 172.21.15.132:0/3155596061 wait complete. 2023-11-18T20:38:46.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.088+0000 7f9fad267640 1 Processor -- start 2023-11-18T20:38:46.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.088+0000 7f9fad267640 1 -- start start 2023-11-18T20:38:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.089+0000 7f9fad267640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa80c4c00 0x7f9fa81eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.089+0000 7f9fad267640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa814e7c0 0x7f9fa80aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.089+0000 7f9fad267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa814d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.089+0000 7f9fad267640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81eab50 con 0x7f9fa8154580 2023-11-18T20:38:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.089+0000 7f9fad267640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81edc40 con 0x7f9fa814e7c0 2023-11-18T20:38:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.089+0000 7f9fad267640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81ed960 con 0x7f9fa80c4c00 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9faca66640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa814d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9faca66640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa814d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56980/0 (socket says 172.21.15.132:56980) 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9faca66640 1 -- 172.21.15.132:0/2410479012 learned_addr learned my addr 172.21.15.132:0/2410479012 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9fa7fff640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa80c4c00 0x7f9fa81eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9fa77fe640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa814e7c0 0x7f9fa80aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9faca66640 1 -- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa80c4c00 msgr2=0x7f9fa81eafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9faca66640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa80c4c00 0x7f9fa81eafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9faca66640 1 -- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa814e7c0 msgr2=0x7f9fa80aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9faca66640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa814e7c0 0x7f9fa80aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.090+0000 7f9faca66640 1 -- 172.21.15.132:0/2410479012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00094d0 con 0x7f9fa8154580 2023-11-18T20:38:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.091+0000 7f9faca66640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa814d030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00090b0 tx=0x7f9fa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.091+0000 7f9fa4ff9640 1 -- 172.21.15.132:0/2410479012 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0032860 con 0x7f9fa8154580 2023-11-18T20:38:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.091+0000 7f9fa4ff9640 1 -- 172.21.15.132:0/2410479012 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0031f00 con 0x7f9fa8154580 2023-11-18T20:38:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.091+0000 7f9fa4ff9640 1 -- 172.21.15.132:0/2410479012 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0032c00 con 0x7f9fa8154580 2023-11-18T20:38:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.091+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa81ea500 con 0x7f9fa8154580 2023-11-18T20:38:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.091+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa80ab050 con 0x7f9fa8154580 2023-11-18T20:38:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.092+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa804e840 con 0x7f9fa8154580 2023-11-18T20:38:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.093+0000 7f9fa4ff9640 1 -- 172.21.15.132:0/2410479012 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fa004e450 con 0x7f9fa8154580 2023-11-18T20:38:46.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.094+0000 7f9fa4ff9640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9f8806ae70 0x7f9f8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.094+0000 7f9fa4ff9640 1 -- 172.21.15.132:0/2410479012 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9fa00ab640 con 0x7f9fa8154580 2023-11-18T20:38:46.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.095+0000 7f9fa7fff640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9f8806ae70 0x7f9f8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.096+0000 7f9fa7fff640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9f8806ae70 0x7f9f8806d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f98007440 tx=0x7f9f9800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.098+0000 7f9fa4ff9640 1 -- 172.21.15.132:0/2410479012 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9fa0076810 con 0x7f9fa8154580 2023-11-18T20:38:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.291+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fa814a9f0 con 0x7f9fa8154580 2023-11-18T20:38:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.293+0000 7f9fa4ff9640 1 -- 172.21.15.132:0/2410479012 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f9fa0079e30 con 0x7f9fa8154580 2023-11-18T20:38:46.294 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:46.294 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":22,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:45.495137+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9f8806ae70 msgr2=0x7f9f8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9f8806ae70 0x7f9f8806d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f98007440 tx=0x7f9f9800b040 comp rx=0 tx=0).stop 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 msgr2=0x7f9fa814d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa814d030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00090b0 tx=0x7f9fa00046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 shutdown_connections 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9f8806ae70 0x7f9f8806d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa8154580 0x7f9fa814d030 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa814e7c0 0x7f9fa80aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 --2- 172.21.15.132:0/2410479012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fa80c4c00 0x7f9fa81eafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.295+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 >> 172.21.15.132:0/2410479012 conn(0x7f9fa80abf00 msgr2=0x7f9fa80c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.296+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 shutdown_connections 2023-11-18T20:38:46.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.296+0000 7f9fad267640 1 -- 172.21.15.132:0/2410479012 wait complete. 2023-11-18T20:38:46.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:37:56.866103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:37:57.601186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:46.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:46.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.527+0000 7f8bae16c640 1 Processor -- start 2023-11-18T20:38:46.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.528+0000 7f8bae16c640 1 -- start start 2023-11-18T20:38:46.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.529+0000 7f8bae16c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 0x7f8ba80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.529+0000 7f8bae16c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8ba80c1450 0x7f8ba815ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.529+0000 7f8bae16c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba8157ad0 con 0x7f8ba80a4d20 2023-11-18T20:38:46.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.529+0000 7f8bae16c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba8158890 con 0x7f8ba80c1450 2023-11-18T20:38:46.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.529+0000 7f8bae16c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba8154fa0 con 0x7f8ba8154b40 2023-11-18T20:38:46.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.529+0000 7f8bad16a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8ba80a4d20 0x7f8ba8154430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40838/0 (socket says 172.21.15.132:40838) 2023-11-18T20:38:46.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.529+0000 7f8bad16a640 1 -- 172.21.15.132:0/876329941 learned_addr learned my addr 172.21.15.132:0/876329941 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:46.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.529+0000 7f8bad96b640 1 --2- 172.21.15.132:0/876329941 >> v2:172.21.15.132:3300/0 conn(0x7f8ba80c1450 0x7f8ba815ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.530+0000 7f8b9ffff640 1 -- 172.21.15.132:0/876329941 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434798981 0 0) 0x7f8ba8157ad0 con 0x7f8ba80a4d20 2023-11-18T20:38:46.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.530+0000 7f8b9ffff640 1 -- 172.21.15.132:0/876329941 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b94003520 con 0x7f8ba80a4d20 2023-11-18T20:38:46.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.530+0000 7f8bad96b640 1 -- 172.21.15.132:0/876329941 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 msgr2=0x7f8ba80a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:46.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.530+0000 7f8bad96b640 1 --2- 172.21.15.132:0/876329941 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 0x7f8ba80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.530+0000 7f8bad96b640 1 -- 172.21.15.132:0/876329941 >> v1:172.21.15.132:6789/0 conn(0x7f8ba80a4d20 legacy=0x7f8ba8154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.530+0000 7f8bad96b640 1 -- 172.21.15.132:0/876329941 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8157db0 con 0x7f8ba80c1450 2023-11-18T20:38:46.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.531+0000 7f8bad96b640 1 --2- 172.21.15.132:0/876329941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba815ecd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009d90 tx=0x7f8ba002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e4b377d1f3023e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.531+0000 7f8b9ffff640 1 -- 172.21.15.132:0/876329941 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba002cbd0 con 0x7f8ba80c1450 2023-11-18T20:38:46.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.531+0000 7f8b9ffff640 1 -- 172.21.15.132:0/876329941 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba002cd30 con 0x7f8ba80c1450 2023-11-18T20:38:46.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.531+0000 7f8b9ffff640 1 -- 172.21.15.132:0/876329941 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba002cea0 con 0x7f8ba80c1450 2023-11-18T20:38:46.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.532+0000 7f8bae16c640 1 -- 172.21.15.132:0/876329941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 msgr2=0x7f8ba815ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.532+0000 7f8bae16c640 1 --2- 172.21.15.132:0/876329941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba815ecd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009d90 tx=0x7f8ba002be20 comp rx=0 tx=0).stop 2023-11-18T20:38:46.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.532+0000 7f8bae16c640 1 -- 172.21.15.132:0/876329941 shutdown_connections 2023-11-18T20:38:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.532+0000 7f8bae16c640 1 --2- 172.21.15.132:0/876329941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba815ecd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.532+0000 7f8bae16c640 1 --2- 172.21.15.132:0/876329941 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 0x7f8ba80a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.532+0000 7f8bae16c640 1 -- 172.21.15.132:0/876329941 >> 172.21.15.132:0/876329941 conn(0x7f8ba80a77f0 msgr2=0x7f8ba80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.532+0000 7f8bae16c640 1 -- 172.21.15.132:0/876329941 shutdown_connections 2023-11-18T20:38:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.532+0000 7f8bae16c640 1 -- 172.21.15.132:0/876329941 wait complete. 2023-11-18T20:38:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.534+0000 7f8bae16c640 1 Processor -- start 2023-11-18T20:38:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.534+0000 7f8bae16c640 1 -- start start 2023-11-18T20:38:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.535+0000 7f8bae16c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ba80a4d20 0x7f8ba814b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.535+0000 7f8bae16c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba81ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.535+0000 7f8bae16c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 0x7f8ba8070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.535+0000 7f8bae16c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba81eaa60 con 0x7f8ba80c1450 2023-11-18T20:38:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.535+0000 7f8bae16c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80a64e0 con 0x7f8ba80a4d20 2023-11-18T20:38:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.535+0000 7f8bae16c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80a67c0 con 0x7f8ba8154b40 2023-11-18T20:38:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bac969640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba81ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bac969640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba81ea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56992/0 (socket says 172.21.15.132:56992) 2023-11-18T20:38:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bac969640 1 -- 172.21.15.132:0/2285573425 learned_addr learned my addr 172.21.15.132:0/2285573425 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bad16a640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ba80a4d20 0x7f8ba814b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bad96b640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 0x7f8ba8070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bac969640 1 -- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 msgr2=0x7f8ba8070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bac969640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 0x7f8ba8070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bac969640 1 -- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ba80a4d20 msgr2=0x7f8ba814b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bac969640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ba80a4d20 0x7f8ba814b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.536+0000 7f8bac969640 1 -- 172.21.15.132:0/2285573425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba0009a70 con 0x7f8ba80c1450 2023-11-18T20:38:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.537+0000 7f8bac969640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba81ea520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800b410 tx=0x7f8b9800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.537+0000 7f8b9dffb640 1 -- 172.21.15.132:0/2285573425 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98011830 con 0x7f8ba80c1450 2023-11-18T20:38:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.537+0000 7f8b9dffb640 1 -- 172.21.15.132:0/2285573425 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b980119b0 con 0x7f8ba80c1450 2023-11-18T20:38:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.537+0000 7f8b9dffb640 1 -- 172.21.15.132:0/2285573425 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98011d60 con 0x7f8ba80c1450 2023-11-18T20:38:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.537+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba80a51a0 con 0x7f8ba80c1450 2023-11-18T20:38:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.537+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba8071020 con 0x7f8ba80c1450 2023-11-18T20:38:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.538+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba80a56c0 con 0x7f8ba80c1450 2023-11-18T20:38:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.539+0000 7f8b9dffb640 1 -- 172.21.15.132:0/2285573425 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b9801a400 con 0x7f8ba80c1450 2023-11-18T20:38:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.540+0000 7f8b9dffb640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b8c06ae40 0x7f8b8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.540+0000 7f8b9dffb640 1 -- 172.21.15.132:0/2285573425 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8b980897c0 con 0x7f8ba80c1450 2023-11-18T20:38:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.540+0000 7f8bad16a640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b8c06ae40 0x7f8b8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.542+0000 7f8bad16a640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b8c06ae40 0x7f8b8c06d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40011e0 tx=0x7f8ba4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.544+0000 7f8b9dffb640 1 -- 172.21.15.132:0/2285573425 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ba80a56c0 con 0x7f8ba80c1450 2023-11-18T20:38:46.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.735+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ba80a56c0 con 0x7f8ba80c1450 2023-11-18T20:38:46.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.736+0000 7f8b9dffb640 1 -- 172.21.15.132:0/2285573425 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ba80a56c0 con 0x7f8ba80c1450 2023-11-18T20:38:46.737 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b8c06ae40 msgr2=0x7f8b8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b8c06ae40 0x7f8b8c06d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40011e0 tx=0x7f8ba4009040 comp rx=0 tx=0).stop 2023-11-18T20:38:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 msgr2=0x7f8ba81ea520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba81ea520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800b410 tx=0x7f8b9800b8d0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 shutdown_connections 2023-11-18T20:38:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8b8c06ae40 0x7f8b8c06d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ba8154b40 0x7f8ba8070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba80c1450 0x7f8ba81ea520 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 --2- 172.21.15.132:0/2285573425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ba80a4d20 0x7f8ba814b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 >> 172.21.15.132:0/2285573425 conn(0x7f8ba80a77f0 msgr2=0x7f8ba80a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:46.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 shutdown_connections 2023-11-18T20:38:46.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.739+0000 7f8bae16c640 1 -- 172.21.15.132:0/2285573425 wait complete. 2023-11-18T20:38:46.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:38:46.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.971+0000 7f759f061640 1 Processor -- start 2023-11-18T20:38:46.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.971+0000 7f759f061640 1 -- start start 2023-11-18T20:38:46.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.972+0000 7f759f061640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7598155fc0 0x7f7598159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.973+0000 7f759f061640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759806d580 con 0x7f75980c1ca0 2023-11-18T20:38:46.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.973+0000 7f759f061640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75980726d0 con 0x7f75980c2e60 2023-11-18T20:38:46.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.973+0000 7f759f061640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759806dd60 con 0x7f7598155fc0 2023-11-18T20:38:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.973+0000 7f7597fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f75980c1ca0 0x7f75980c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40846/0 (socket says 172.21.15.132:40846) 2023-11-18T20:38:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.973+0000 7f759cdfd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7598155fc0 0x7f7598159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.973+0000 7f7597fff640 1 -- 172.21.15.132:0/3601527687 learned_addr learned my addr 172.21.15.132:0/3601527687 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.973+0000 7f75977fe640 1 -- 172.21.15.132:0/3601527687 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632453139 0 0) 0x7f759806d580 con 0x7f75980c1ca0 2023-11-18T20:38:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.974+0000 7f75977fe640 1 -- 172.21.15.132:0/3601527687 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7588003520 con 0x7f75980c1ca0 2023-11-18T20:38:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.974+0000 7f759cdfd640 1 -- 172.21.15.132:0/3601527687 >> v1:172.21.15.161:6789/0 conn(0x7f75980c2e60 legacy=0x7f7598163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.974+0000 7f759cdfd640 1 -- 172.21.15.132:0/3601527687 >> v1:172.21.15.132:6789/0 conn(0x7f75980c1ca0 legacy=0x7f75980c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.974+0000 7f759cdfd640 1 -- 172.21.15.132:0/3601527687 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75981599b0 con 0x7f7598155fc0 2023-11-18T20:38:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.975+0000 7f759cdfd640 1 --2- 172.21.15.132:0/3601527687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598155fc0 0x7f7598159470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f758c0097d0 tx=0x7f758c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2876ddf686ba41 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.975+0000 7f75977fe640 1 -- 172.21.15.132:0/3601527687 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c02e070 con 0x7f7598155fc0 2023-11-18T20:38:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.975+0000 7f75977fe640 1 -- 172.21.15.132:0/3601527687 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c0315a0 con 0x7f7598155fc0 2023-11-18T20:38:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.975+0000 7f75977fe640 1 -- 172.21.15.132:0/3601527687 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c031930 con 0x7f7598155fc0 2023-11-18T20:38:46.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.976+0000 7f759f061640 1 -- 172.21.15.132:0/3601527687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598155fc0 msgr2=0x7f7598159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.976+0000 7f759f061640 1 --2- 172.21.15.132:0/3601527687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598155fc0 0x7f7598159470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f758c0097d0 tx=0x7f758c02b840 comp rx=0 tx=0).stop 2023-11-18T20:38:46.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.976+0000 7f759f061640 1 -- 172.21.15.132:0/3601527687 shutdown_connections 2023-11-18T20:38:46.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.976+0000 7f759f061640 1 --2- 172.21.15.132:0/3601527687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598155fc0 0x7f7598159470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.976+0000 7f759f061640 1 -- 172.21.15.132:0/3601527687 >> 172.21.15.132:0/3601527687 conn(0x7f759806a500 msgr2=0x7f759806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:46.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.976+0000 7f759f061640 1 -- 172.21.15.132:0/3601527687 shutdown_connections 2023-11-18T20:38:46.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.976+0000 7f759f061640 1 -- 172.21.15.132:0/3601527687 wait complete. 2023-11-18T20:38:46.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.978+0000 7f759f061640 1 Processor -- start 2023-11-18T20:38:46.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.978+0000 7f759f061640 1 -- start start 2023-11-18T20:38:46.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f759f061640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75980c1ca0 0x7f75980a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f759f061640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75980c2e60 0x7f7598152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f759f061640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7598155fc0 0x7f7598152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f759f061640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75980a6810 con 0x7f75980c2e60 2023-11-18T20:38:46.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f759f061640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759815bdd0 con 0x7f7598155fc0 2023-11-18T20:38:46.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f759f061640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759815c0b0 con 0x7f75980c1ca0 2023-11-18T20:38:46.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f7597fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75980c2e60 0x7f7598152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f7597fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75980c2e60 0x7f7598152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57002/0 (socket says 172.21.15.132:57002) 2023-11-18T20:38:46.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.979+0000 7f7597fff640 1 -- 172.21.15.132:0/87468140 learned_addr learned my addr 172.21.15.132:0/87468140 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f7597fff640 1 -- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75980c1ca0 msgr2=0x7f75980a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f7597fff640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75980c1ca0 0x7f75980a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f7597fff640 1 -- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7598155fc0 msgr2=0x7f7598152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f759d5fe640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7598155fc0 0x7f7598152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f7597fff640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7598155fc0 0x7f7598152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f7597fff640 1 -- 172.21.15.132:0/87468140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009400 con 0x7f75980c2e60 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f759d5fe640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7598155fc0 0x7f7598152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f7597fff640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75980c2e60 0x7f7598152030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f758400c500 tx=0x7f758400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f75957fa640 1 -- 172.21.15.132:0/87468140 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584005ce0 con 0x7f75980c2e60 2023-11-18T20:38:46.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f75957fa640 1 -- 172.21.15.132:0/87468140 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584005e40 con 0x7f75980c2e60 2023-11-18T20:38:46.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f75957fa640 1 -- 172.21.15.132:0/87468140 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584007330 con 0x7f75980c2e60 2023-11-18T20:38:46.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75980a5970 con 0x7f75980c2e60 2023-11-18T20:38:46.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.980+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75980a4bf0 con 0x7f75980c2e60 2023-11-18T20:38:46.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.982+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759815bc30 con 0x7f75980c2e60 2023-11-18T20:38:46.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.983+0000 7f75957fa640 1 -- 172.21.15.132:0/87468140 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7584007550 con 0x7f75980c2e60 2023-11-18T20:38:46.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.983+0000 7f75957fa640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f757c06ae40 0x7f757c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:46.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.984+0000 7f75957fa640 1 -- 172.21.15.132:0/87468140 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7584088d40 con 0x7f75980c2e60 2023-11-18T20:38:46.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.984+0000 7f759cdfd640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f757c06ae40 0x7f757c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:46.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.985+0000 7f759cdfd640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f757c06ae40 0x7f757c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f758c036000 tx=0x7f758c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:46.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:46.989+0000 7f75957fa640 1 -- 172.21.15.132:0/87468140 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f759815bc30 con 0x7f75980c2e60 2023-11-18T20:38:47.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.180+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f759815bf10 con 0x7f75980c2e60 2023-11-18T20:38:47.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.181+0000 7f75957fa640 1 -- 172.21.15.132:0/87468140 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f759815bf10 con 0x7f75980c2e60 2023-11-18T20:38:47.182 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:38:47.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.183+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f757c06ae40 msgr2=0x7f757c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.183+0000 7f759f061640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f757c06ae40 0x7f757c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f758c036000 tx=0x7f758c030000 comp rx=0 tx=0).stop 2023-11-18T20:38:47.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.183+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75980c2e60 msgr2=0x7f7598152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.183+0000 7f759f061640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75980c2e60 0x7f7598152030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f758400c500 tx=0x7f758400c9c0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.184+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 shutdown_connections 2023-11-18T20:38:47.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.184+0000 7f759f061640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f757c06ae40 0x7f757c06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.184+0000 7f759f061640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7598155fc0 0x7f7598152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.184+0000 7f759f061640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75980c2e60 0x7f7598152030 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.184+0000 7f759f061640 1 --2- 172.21.15.132:0/87468140 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75980c1ca0 0x7f75980a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.184+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 >> 172.21.15.132:0/87468140 conn(0x7f759806a500 msgr2=0x7f7598070920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:47.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.184+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 shutdown_connections 2023-11-18T20:38:47.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.184+0000 7f759f061640 1 -- 172.21.15.132:0/87468140 wait complete. 2023-11-18T20:38:47.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:38:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.412+0000 7fc22b1d5640 1 Processor -- start 2023-11-18T20:38:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.412+0000 7fc22b1d5640 1 -- start start 2023-11-18T20:38:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.413+0000 7fc22b1d5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2240c45d0 0x7fc224155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.413+0000 7fc22b1d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc2240c3340 0x7fc224156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.413+0000 7fc22b1d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2240bfdc0 con 0x7fc2240c5ec0 2023-11-18T20:38:47.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.413+0000 7fc22b1d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22406e390 con 0x7fc2240c3340 2023-11-18T20:38:47.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.413+0000 7fc22b1d5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22406ddd0 con 0x7fc2240c45d0 2023-11-18T20:38:47.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc228f71640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc2240c5ec0 0x7fc2240c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40858/0 (socket says 172.21.15.132:40858) 2023-11-18T20:38:47.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc228f71640 1 -- 172.21.15.132:0/4082191696 learned_addr learned my addr 172.21.15.132:0/4082191696 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:47.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc229772640 1 --2- 172.21.15.132:0/4082191696 >> v2:172.21.15.132:3300/0 conn(0x7fc2240c3340 0x7fc224156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc2237fe640 1 -- 172.21.15.132:0/4082191696 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453112199 0 0) 0x7fc2240bfdc0 con 0x7fc2240c5ec0 2023-11-18T20:38:47.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc2237fe640 1 -- 172.21.15.132:0/4082191696 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc214003520 con 0x7fc2240c5ec0 2023-11-18T20:38:47.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc223fff640 1 --2- 172.21.15.132:0/4082191696 >> v2:172.21.15.161:3300/0 conn(0x7fc2240c45d0 0x7fc224155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc229772640 1 -- 172.21.15.132:0/4082191696 >> v2:172.21.15.161:3300/0 conn(0x7fc2240c45d0 msgr2=0x7fc224155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:47.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc229772640 1 --2- 172.21.15.132:0/4082191696 >> v2:172.21.15.161:3300/0 conn(0x7fc2240c45d0 0x7fc224155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc229772640 1 -- 172.21.15.132:0/4082191696 >> v1:172.21.15.132:6789/0 conn(0x7fc2240c5ec0 legacy=0x7fc2240c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.414+0000 7fc229772640 1 -- 172.21.15.132:0/4082191696 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22406e0b0 con 0x7fc2240c3340 2023-11-18T20:38:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.416+0000 7fc229772640 1 --2- 172.21.15.132:0/4082191696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c3340 0x7fc224156370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009d90 tx=0x7fc21c02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ae7ed6275bf5e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.416+0000 7fc2237fe640 1 -- 172.21.15.132:0/4082191696 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c02cb40 con 0x7fc2240c3340 2023-11-18T20:38:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.416+0000 7fc2237fe640 1 -- 172.21.15.132:0/4082191696 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c02cca0 con 0x7fc2240c3340 2023-11-18T20:38:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.416+0000 7fc2237fe640 1 -- 172.21.15.132:0/4082191696 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c034660 con 0x7fc2240c3340 2023-11-18T20:38:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.416+0000 7fc22b1d5640 1 -- 172.21.15.132:0/4082191696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c3340 msgr2=0x7fc224156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.416+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/4082191696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c3340 0x7fc224156370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009d90 tx=0x7fc21c02bd90 comp rx=0 tx=0).stop 2023-11-18T20:38:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.417+0000 7fc22b1d5640 1 -- 172.21.15.132:0/4082191696 shutdown_connections 2023-11-18T20:38:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.417+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/4082191696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c3340 0x7fc224156370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.417+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/4082191696 >> v2:172.21.15.161:3300/0 conn(0x7fc2240c45d0 0x7fc224155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.417+0000 7fc22b1d5640 1 -- 172.21.15.132:0/4082191696 >> 172.21.15.132:0/4082191696 conn(0x7fc22406a500 msgr2=0x7fc22406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:47.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.417+0000 7fc22b1d5640 1 -- 172.21.15.132:0/4082191696 shutdown_connections 2023-11-18T20:38:47.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.417+0000 7fc22b1d5640 1 -- 172.21.15.132:0/4082191696 wait complete. 2023-11-18T20:38:47.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.418+0000 7fc22b1d5640 1 Processor -- start 2023-11-18T20:38:47.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.419+0000 7fc22b1d5640 1 -- start start 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc22b1d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2240c3340 0x7fc2240aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc22b1d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c45d0 0x7fc2240a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc22b1d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2240c5ec0 0x7fc2240a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc22b1d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241edd60 con 0x7fc2240c45d0 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc22b1d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241ed800 con 0x7fc2240c3340 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc22b1d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241eda80 con 0x7fc2240c5ec0 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc223fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c45d0 0x7fc2240a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc223fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c45d0 0x7fc2240a6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57020/0 (socket says 172.21.15.132:57020) 2023-11-18T20:38:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc223fff640 1 -- 172.21.15.132:0/1397378929 learned_addr learned my addr 172.21.15.132:0/1397378929 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc223fff640 1 -- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2240c5ec0 msgr2=0x7fc2240a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc223fff640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2240c5ec0 0x7fc2240a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc223fff640 1 -- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2240c3340 msgr2=0x7fc2240aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc223fff640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2240c3340 0x7fc2240aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.420+0000 7fc223fff640 1 -- 172.21.15.132:0/1397378929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009a70 con 0x7fc2240c45d0 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.421+0000 7fc223fff640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c45d0 0x7fc2240a6b40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc21000d800 tx=0x7fc21000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.421+0000 7fc2217fa640 1 -- 172.21.15.132:0/1397378929 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000b6c0 con 0x7fc2240c45d0 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.421+0000 7fc2217fa640 1 -- 172.21.15.132:0/1397378929 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21000b820 con 0x7fc2240c45d0 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.421+0000 7fc2217fa640 1 -- 172.21.15.132:0/1397378929 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000bbb0 con 0x7fc2240c45d0 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.421+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2241e9a50 con 0x7fc2240c45d0 2023-11-18T20:38:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.421+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2241ea010 con 0x7fc2240c45d0 2023-11-18T20:38:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.422+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2241ea1d0 con 0x7fc2240c45d0 2023-11-18T20:38:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.423+0000 7fc2217fa640 1 -- 172.21.15.132:0/1397378929 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc21000bd10 con 0x7fc2240c45d0 2023-11-18T20:38:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.424+0000 7fc2217fa640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc20806ae40 0x7fc20806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.424+0000 7fc2217fa640 1 -- 172.21.15.132:0/1397378929 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc210089b20 con 0x7fc2240c45d0 2023-11-18T20:38:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.425+0000 7fc228f71640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc20806ae40 0x7fc20806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.426+0000 7fc228f71640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc20806ae40 0x7fc20806d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc22414eba0 tx=0x7fc218007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:47.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.428+0000 7fc2217fa640 1 -- 172.21.15.132:0/1397378929 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc210054c40 con 0x7fc2240c45d0 2023-11-18T20:38:47.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.618+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2241e98b0 con 0x7fc2240c45d0 2023-11-18T20:38:47.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.619+0000 7fc2217fa640 1 -- 172.21.15.132:0/1397378929 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2241e98b0 con 0x7fc2240c45d0 2023-11-18T20:38:47.620 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:38:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc20806ae40 msgr2=0x7fc20806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc20806ae40 0x7fc20806d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc22414eba0 tx=0x7fc218007930 comp rx=0 tx=0).stop 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c45d0 msgr2=0x7fc2240a6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c45d0 0x7fc2240a6b40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc21000d800 tx=0x7fc21000dcc0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 shutdown_connections 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc20806ae40 0x7fc20806d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2240c5ec0 0x7fc2240a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2240c45d0 0x7fc2240a6b40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 --2- 172.21.15.132:0/1397378929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2240c3340 0x7fc2240aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 >> 172.21.15.132:0/1397378929 conn(0x7fc22406a500 msgr2=0x7fc22406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.621+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 shutdown_connections 2023-11-18T20:38:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.622+0000 7fc22b1d5640 1 -- 172.21.15.132:0/1397378929 wait complete. 2023-11-18T20:38:47.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:38:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.851+0000 7feadffff640 1 Processor -- start 2023-11-18T20:38:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.851+0000 7feadffff640 1 -- start start 2023-11-18T20:38:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.852+0000 7feadffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feae00a4d20 0x7feae00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.852+0000 7feadffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae0154430 0x7feae0154890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.852+0000 7feadffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feae00c0440 0x7feae00c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.852+0000 7feadffff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae0158890 con 0x7feae00c0440 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.852+0000 7feadffff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae0157ad0 con 0x7feae00a4d20 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.852+0000 7feadffff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae0157db0 con 0x7feae0154430 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadf7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feae00c0440 0x7feae00c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadf7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feae00c0440 0x7feae00c08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57022/0 (socket says 172.21.15.132:57022) 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadf7fe640 1 -- 172.21.15.132:0/727957000 learned_addr learned my addr 172.21.15.132:0/727957000 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadeffd640 1 --2- 172.21.15.132:0/727957000 >> v2:172.21.15.161:3300/0 conn(0x7feae00a4d20 0x7feae00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7fead67fc640 1 --2- 172.21.15.132:0/727957000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae0154430 0x7feae0154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadf7fe640 1 -- 172.21.15.132:0/727957000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae0154430 msgr2=0x7feae0154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadf7fe640 1 --2- 172.21.15.132:0/727957000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae0154430 0x7feae0154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadf7fe640 1 -- 172.21.15.132:0/727957000 >> v2:172.21.15.161:3300/0 conn(0x7feae00a4d20 msgr2=0x7feae00a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadf7fe640 1 --2- 172.21.15.132:0/727957000 >> v2:172.21.15.161:3300/0 conn(0x7feae00a4d20 0x7feae00a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7feadf7fe640 1 -- 172.21.15.132:0/727957000 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0158090 con 0x7feae00c0440 2023-11-18T20:38:47.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.853+0000 7fead67fc640 1 --2- 172.21.15.132:0/727957000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae0154430 0x7feae0154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.854+0000 7feadf7fe640 1 --2- 172.21.15.132:0/727957000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae00c0440 0x7feae00c08d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feae0067910 tx=0x7fead802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75944ba5df9590d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feade7fc640 1 -- 172.21.15.132:0/727957000 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead802c9f0 con 0x7feae00c0440 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feade7fc640 1 -- 172.21.15.132:0/727957000 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead802cb50 con 0x7feae00c0440 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feade7fc640 1 -- 172.21.15.132:0/727957000 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80343f0 con 0x7feae00c0440 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feadffff640 1 -- 172.21.15.132:0/727957000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae00c0440 msgr2=0x7feae00c08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feadffff640 1 --2- 172.21.15.132:0/727957000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae00c0440 0x7feae00c08d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feae0067910 tx=0x7fead802be50 comp rx=0 tx=0).stop 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feadffff640 1 -- 172.21.15.132:0/727957000 shutdown_connections 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feadffff640 1 --2- 172.21.15.132:0/727957000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae00c0440 0x7feae00c08d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feadffff640 1 --2- 172.21.15.132:0/727957000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae0154430 0x7feae0154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feadffff640 1 --2- 172.21.15.132:0/727957000 >> v2:172.21.15.161:3300/0 conn(0x7feae00a4d20 0x7feae00a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.855+0000 7feadffff640 1 -- 172.21.15.132:0/727957000 >> 172.21.15.132:0/727957000 conn(0x7feae00a77f0 msgr2=0x7feae00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.856+0000 7feadffff640 1 -- 172.21.15.132:0/727957000 shutdown_connections 2023-11-18T20:38:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.856+0000 7feadffff640 1 -- 172.21.15.132:0/727957000 wait complete. 2023-11-18T20:38:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.857+0000 7feadffff640 1 Processor -- start 2023-11-18T20:38:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.857+0000 7feadffff640 1 -- start start 2023-11-18T20:38:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae00a4d20 0x7feae0155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae00c0440 0x7feae00a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae0154430 0x7feae01560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadffff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae01ea550 con 0x7feae0154430 2023-11-18T20:38:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadffff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae01eaa80 con 0x7feae00a4d20 2023-11-18T20:38:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadffff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae00a6f90 con 0x7feae00c0440 2023-11-18T20:38:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae0154430 0x7feae01560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae0154430 0x7feae01560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57034/0 (socket says 172.21.15.132:57034) 2023-11-18T20:38:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.858+0000 7feadf7fe640 1 -- 172.21.15.132:0/3808614831 learned_addr learned my addr 172.21.15.132:0/3808614831 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadeffd640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae00a4d20 0x7feae0155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadf7fe640 1 -- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae00c0440 msgr2=0x7feae00a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadf7fe640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae00c0440 0x7feae00a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadf7fe640 1 -- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae00a4d20 msgr2=0x7feae0155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadf7fe640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae00a4d20 0x7feae0155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadf7fe640 1 -- 172.21.15.132:0/3808614831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009b30 con 0x7feae0154430 2023-11-18T20:38:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadf7fe640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae0154430 0x7feae01560d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fead8009f40 tx=0x7fead8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadcff9640 1 -- 172.21.15.132:0/3808614831 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead803e450 con 0x7feae0154430 2023-11-18T20:38:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadcff9640 1 -- 172.21.15.132:0/3808614831 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead803e5d0 con 0x7feae0154430 2023-11-18T20:38:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadcff9640 1 -- 172.21.15.132:0/3808614831 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead803e980 con 0x7feae0154430 2023-11-18T20:38:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.859+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae01ea7a0 con 0x7feae0154430 2023-11-18T20:38:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.860+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae0155bb0 con 0x7feae0154430 2023-11-18T20:38:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.861+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae004e840 con 0x7feae0154430 2023-11-18T20:38:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.862+0000 7feadcff9640 1 -- 172.21.15.132:0/3808614831 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fead803eae0 con 0x7feae0154430 2023-11-18T20:38:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.862+0000 7feadcff9640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac006ae70 0x7feac006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.863+0000 7feadcff9640 1 -- 172.21.15.132:0/3808614831 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fead80ac3f0 con 0x7feae0154430 2023-11-18T20:38:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.863+0000 7feadeffd640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac006ae70 0x7feac006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:47.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.864+0000 7feadeffd640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac006ae70 0x7feac006d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fead0006fd0 tx=0x7fead0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:47.867+0000 7feadcff9640 1 -- 172.21.15.132:0/3808614831 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fead8077470 con 0x7feae0154430 2023-11-18T20:38:48.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.094+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feae0155d70 con 0x7feae0154430 2023-11-18T20:38:48.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.095+0000 7feadcff9640 1 -- 172.21.15.132:0/3808614831 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fead8033e80 con 0x7feae0154430 2023-11-18T20:38:48.097 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:48.097 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:37:58.599151+0000","modified":"2023-11-18T20:38:01.664198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T20:38:48.097 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-11-18T20:38:48.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac006ae70 msgr2=0x7feac006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac006ae70 0x7feac006d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fead0006fd0 tx=0x7fead0008040 comp rx=0 tx=0).stop 2023-11-18T20:38:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae0154430 msgr2=0x7feae01560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae0154430 0x7feae01560d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fead8009f40 tx=0x7fead8004a40 comp rx=0 tx=0).stop 2023-11-18T20:38:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 shutdown_connections 2023-11-18T20:38:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feac006ae70 0x7feac006d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae0154430 0x7feae01560d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feae00c0440 0x7feae00a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 --2- 172.21.15.132:0/3808614831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feae00a4d20 0x7feae0155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 >> 172.21.15.132:0/3808614831 conn(0x7feae00a77f0 msgr2=0x7feae00c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:48.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 shutdown_connections 2023-11-18T20:38:48.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.098+0000 7feadffff640 1 -- 172.21.15.132:0/3808614831 wait complete. 2023-11-18T20:38:48.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.328+0000 7fe74aa89640 1 Processor -- start 2023-11-18T20:38:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.328+0000 7fe74aa89640 1 -- start start 2023-11-18T20:38:48.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.330+0000 7fe74aa89640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe74414fd30 0x7fe744152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.330+0000 7fe74aa89640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe74406d0a0 0x7fe7440a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.330+0000 7fe74aa89640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440c64a0 con 0x7fe7440a5260 2023-11-18T20:38:48.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.330+0000 7fe74aa89640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7440c5c00 con 0x7fe74414fd30 2023-11-18T20:38:48.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.330+0000 7fe74aa89640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7440c5ee0 con 0x7fe74406d0a0 2023-11-18T20:38:48.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.330+0000 7fe748825640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe74414fd30 0x7fe744152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.330+0000 7fe748825640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe74414fd30 0x7fe744152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57050/0 (socket says 172.21.15.132:57050) 2023-11-18T20:38:48.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.330+0000 7fe748825640 1 -- 172.21.15.132:0/3321300898 learned_addr learned my addr 172.21.15.132:0/3321300898 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:48.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.331+0000 7fe748825640 1 -- 172.21.15.132:0/3321300898 >> v2:172.21.15.161:3300/0 conn(0x7fe74406d0a0 msgr2=0x7fe7440a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:48.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.331+0000 7fe748825640 1 --2- 172.21.15.132:0/3321300898 >> v2:172.21.15.161:3300/0 conn(0x7fe74406d0a0 0x7fe7440a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.331+0000 7fe748825640 1 -- 172.21.15.132:0/3321300898 >> v1:172.21.15.161:6789/0 conn(0x7fe7440a5260 legacy=0x7fe7440c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:48.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.331+0000 7fe748825640 1 -- 172.21.15.132:0/3321300898 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440c61c0 con 0x7fe74414fd30 2023-11-18T20:38:48.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.332+0000 7fe748825640 1 --2- 172.21.15.132:0/3321300898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74414fd30 0x7fe744152f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe74406b460 tx=0x7fe73802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b183de004abb30ec server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:48.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.332+0000 7fe7437fe640 1 -- 172.21.15.132:0/3321300898 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738031870 con 0x7fe74414fd30 2023-11-18T20:38:48.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.332+0000 7fe7437fe640 1 -- 172.21.15.132:0/3321300898 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7380319d0 con 0x7fe74414fd30 2023-11-18T20:38:48.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.332+0000 7fe7437fe640 1 -- 172.21.15.132:0/3321300898 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738031d60 con 0x7fe74414fd30 2023-11-18T20:38:48.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.333+0000 7fe74aa89640 1 -- 172.21.15.132:0/3321300898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74414fd30 msgr2=0x7fe744152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.333+0000 7fe74aa89640 1 --2- 172.21.15.132:0/3321300898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74414fd30 0x7fe744152f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe74406b460 tx=0x7fe73802b910 comp rx=0 tx=0).stop 2023-11-18T20:38:48.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.333+0000 7fe74aa89640 1 -- 172.21.15.132:0/3321300898 shutdown_connections 2023-11-18T20:38:48.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.333+0000 7fe74aa89640 1 --2- 172.21.15.132:0/3321300898 >> v2:172.21.15.161:3300/0 conn(0x7fe74406d0a0 0x7fe7440a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.333+0000 7fe74aa89640 1 --2- 172.21.15.132:0/3321300898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74414fd30 0x7fe744152f20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.333+0000 7fe74aa89640 1 -- 172.21.15.132:0/3321300898 >> 172.21.15.132:0/3321300898 conn(0x7fe74406a500 msgr2=0x7fe74406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:48.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.333+0000 7fe74aa89640 1 -- 172.21.15.132:0/3321300898 shutdown_connections 2023-11-18T20:38:48.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.333+0000 7fe74aa89640 1 -- 172.21.15.132:0/3321300898 wait complete. 2023-11-18T20:38:48.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.335+0000 7fe74aa89640 1 Processor -- start 2023-11-18T20:38:48.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.335+0000 7fe74aa89640 1 -- start start 2023-11-18T20:38:48.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.335+0000 7fe74aa89640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe74406d0a0 0x7fe7440bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.335+0000 7fe74aa89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440a5260 0x7fe74414ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe74aa89640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe74414fd30 0x7fe74414f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe74aa89640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440aac30 con 0x7fe7440a5260 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe74aa89640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441eb210 con 0x7fe74406d0a0 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe74aa89640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441eb4f0 con 0x7fe74414fd30 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe743fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440a5260 0x7fe74414ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe743fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440a5260 0x7fe74414ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57056/0 (socket says 172.21.15.132:57056) 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe743fff640 1 -- 172.21.15.132:0/4022510082 learned_addr learned my addr 172.21.15.132:0/4022510082 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe748825640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe74406d0a0 0x7fe7440bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe743fff640 1 -- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe74414fd30 msgr2=0x7fe74414f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe743fff640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe74414fd30 0x7fe74414f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe743fff640 1 -- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe74406d0a0 msgr2=0x7fe7440bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe743fff640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe74406d0a0 0x7fe7440bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.336+0000 7fe743fff640 1 -- 172.21.15.132:0/4022510082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380094d0 con 0x7fe7440a5260 2023-11-18T20:38:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.337+0000 7fe743fff640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440a5260 0x7fe74414ece0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe73000b450 tx=0x7fe73000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.337+0000 7fe7417fa640 1 -- 172.21.15.132:0/4022510082 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730011890 con 0x7fe7440a5260 2023-11-18T20:38:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.337+0000 7fe7417fa640 1 -- 172.21.15.132:0/4022510082 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7300119f0 con 0x7fe7440a5260 2023-11-18T20:38:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.337+0000 7fe7417fa640 1 -- 172.21.15.132:0/4022510082 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730011da0 con 0x7fe7440a5260 2023-11-18T20:38:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.337+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe744150a50 con 0x7fe7440a5260 2023-11-18T20:38:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.337+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7440a4fd0 con 0x7fe7440a5260 2023-11-18T20:38:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.338+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe744150f70 con 0x7fe7440a5260 2023-11-18T20:38:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.339+0000 7fe7417fa640 1 -- 172.21.15.132:0/4022510082 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe73001a400 con 0x7fe7440a5260 2023-11-18T20:38:48.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.340+0000 7fe7417fa640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe72806ae70 0x7fe72806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.340+0000 7fe7417fa640 1 -- 172.21.15.132:0/4022510082 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe730089990 con 0x7fe7440a5260 2023-11-18T20:38:48.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.340+0000 7fe748825640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe72806ae70 0x7fe72806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.342+0000 7fe748825640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe72806ae70 0x7fe72806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe738036000 tx=0x7fe73803c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:48.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.345+0000 7fe7417fa640 1 -- 172.21.15.132:0/4022510082 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe744150f70 con 0x7fe7440a5260 2023-11-18T20:38:48.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.525+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe744150f70 con 0x7fe7440a5260 2023-11-18T20:38:48.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.527+0000 7fe7417fa640 1 -- 172.21.15.132:0/4022510082 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16594 (secure 0 0 0) 0x7fe744150f70 con 0x7fe7440a5260 2023-11-18T20:38:48.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:48.528 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":23,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:46.507131+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:48.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.529+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe72806ae70 msgr2=0x7fe72806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.529+0000 7fe74aa89640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe72806ae70 0x7fe72806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe738036000 tx=0x7fe73803c040 comp rx=0 tx=0).stop 2023-11-18T20:38:48.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.529+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440a5260 msgr2=0x7fe74414ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.529+0000 7fe74aa89640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440a5260 0x7fe74414ece0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe73000b450 tx=0x7fe73000b910 comp rx=0 tx=0).stop 2023-11-18T20:38:48.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.530+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 shutdown_connections 2023-11-18T20:38:48.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.530+0000 7fe74aa89640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe72806ae70 0x7fe72806d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.530+0000 7fe74aa89640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe74414fd30 0x7fe74414f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.530+0000 7fe74aa89640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440a5260 0x7fe74414ece0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.530+0000 7fe74aa89640 1 --2- 172.21.15.132:0/4022510082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe74406d0a0 0x7fe7440bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.530+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 >> 172.21.15.132:0/4022510082 conn(0x7fe74406a500 msgr2=0x7fe74406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:48.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.530+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 shutdown_connections 2023-11-18T20:38:48.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.530+0000 7fe74aa89640 1 -- 172.21.15.132:0/4022510082 wait complete. 2023-11-18T20:38:48.549 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-18T20:38:48.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:38:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.758+0000 7f5bb2ecf640 1 Processor -- start 2023-11-18T20:38:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.758+0000 7f5bb2ecf640 1 -- start start 2023-11-18T20:38:48.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.759+0000 7f5bb2ecf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5bac0c5ec0 0x7f5bac0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.760+0000 7f5bb2ecf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac0bfdc0 con 0x7f5bac0c45d0 2023-11-18T20:38:48.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.760+0000 7f5bb2ecf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac06ddd0 con 0x7f5bac0721a0 2023-11-18T20:38:48.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.760+0000 7f5bb2ecf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bac06e390 con 0x7f5bac0c5ec0 2023-11-18T20:38:48.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.760+0000 7f5babfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5bac0c45d0 0x7f5bac155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52844/0 (socket says 172.21.15.132:52844) 2023-11-18T20:38:48.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.760+0000 7f5babfff640 1 -- 172.21.15.132:0/2802194817 learned_addr learned my addr 172.21.15.132:0/2802194817 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.760+0000 7f5bb0c6b640 1 --2- 172.21.15.132:0/2802194817 >> v2:172.21.15.161:3300/0 conn(0x7f5bac0c5ec0 0x7f5bac0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.760+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733451991 0 0) 0x7f5bac0bfdc0 con 0x7f5bac0c45d0 2023-11-18T20:38:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b9c003520 con 0x7f5bac0c45d0 2023-11-18T20:38:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1922159038 0 0) 0x7f5b9c003520 con 0x7f5bac0c45d0 2023-11-18T20:38:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 >> v2:172.21.15.161:3300/0 conn(0x7f5bac0c5ec0 msgr2=0x7f5bac0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 --2- 172.21.15.132:0/2802194817 >> v2:172.21.15.161:3300/0 conn(0x7f5bac0c5ec0 0x7f5bac0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 >> v1:172.21.15.161:6789/0 conn(0x7f5bac0721a0 legacy=0x7f5bac156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac06e0b0 con 0x7f5bac0c45d0 2023-11-18T20:38:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f5b98001670 con 0x7f5bac0c45d0 2023-11-18T20:38:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 >> v1:172.21.15.132:6789/0 conn(0x7f5bac0c45d0 legacy=0x7f5bac155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b9c003970 0x7f5b9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b9c0047c0 0x7f5b9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b9c0052a0 0x7f5b9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac06e390 con 0x7f5b9c0047c0 2023-11-18T20:38:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c00c170 con 0x7f5b9c0052a0 2023-11-18T20:38:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c00c330 con 0x7f5b9c003970 2023-11-18T20:38:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.761+0000 7f5babfff640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b9c0047c0 0x7f5b9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.762+0000 7f5babfff640 1 -- 172.21.15.132:0/2802194817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b9c003970 msgr2=0x7f5b9c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.762+0000 7f5babfff640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b9c003970 0x7f5b9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.762+0000 7f5babfff640 1 -- 172.21.15.132:0/2802194817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b9c0052a0 msgr2=0x7f5b9c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.762+0000 7f5babfff640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b9c0052a0 0x7f5b9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.762+0000 7f5babfff640 1 -- 172.21.15.132:0/2802194817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c003520 con 0x7f5b9c0047c0 2023-11-18T20:38:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.762+0000 7f5bb146c640 1 -- 172.21.15.132:0/2802194817 reap_dead start 2023-11-18T20:38:48.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.763+0000 7f5babfff640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b9c0047c0 0x7f5b9c004c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0c49e0 tx=0x7f5b9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1843b85dcfe85 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:48.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.763+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98005ad0 con 0x7f5b9c0047c0 2023-11-18T20:38:48.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.763+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98005c30 con 0x7f5b9c0047c0 2023-11-18T20:38:48.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.763+0000 7f5bab7fe640 1 -- 172.21.15.132:0/2802194817 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9802ca90 con 0x7f5b9c0047c0 2023-11-18T20:38:48.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.764+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2802194817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b9c0047c0 msgr2=0x7f5b9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.764+0000 7f5bb2ecf640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b9c0047c0 0x7f5b9c004c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0c49e0 tx=0x7f5b9c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.764+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2802194817 shutdown_connections 2023-11-18T20:38:48.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.764+0000 7f5bb2ecf640 1 --2- 172.21.15.132:0/2802194817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b9c0047c0 0x7f5b9c004c40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.764+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2802194817 >> 172.21.15.132:0/2802194817 conn(0x7f5bac06a500 msgr2=0x7f5bac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:48.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.764+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2802194817 shutdown_connections 2023-11-18T20:38:48.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.764+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2802194817 wait complete. 2023-11-18T20:38:48.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.766+0000 7f5bb2ecf640 1 Processor -- start 2023-11-18T20:38:48.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.766+0000 7f5bb2ecf640 1 -- start start 2023-11-18T20:38:48.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.766+0000 7f5bb2ecf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b9c0047c0 0x7f5bac150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb2ecf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bac0aa710 0x7f5bac0a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb2ecf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bac0a6d10 0x7f5bac14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb2ecf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0ab160 con 0x7f5bac0a6d10 2023-11-18T20:38:48.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb2ecf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0a6340 con 0x7f5bac0aa710 2023-11-18T20:38:48.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb2ecf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0a5a10 con 0x7f5b9c0047c0 2023-11-18T20:38:48.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb146c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bac0a6d10 0x7f5bac14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb146c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bac0a6d10 0x7f5bac14e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54182/0 (socket says 172.21.15.132:54182) 2023-11-18T20:38:48.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb146c640 1 -- 172.21.15.132:0/2904000312 learned_addr learned my addr 172.21.15.132:0/2904000312 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:48.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5babfff640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bac0aa710 0x7f5bac0a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb146c640 1 -- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b9c0047c0 msgr2=0x7f5bac150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb146c640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b9c0047c0 0x7f5bac150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb146c640 1 -- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bac0aa710 msgr2=0x7f5bac0a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb146c640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bac0aa710 0x7f5bac0a67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.767+0000 7f5bb146c640 1 -- 172.21.15.132:0/2904000312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac0a5cf0 con 0x7f5bac0a6d10 2023-11-18T20:38:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.768+0000 7f5bb146c640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bac0a6d10 0x7f5bac14e120 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5bac06b200 tx=0x7f5ba400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.768+0000 7f5ba97fa640 1 -- 172.21.15.132:0/2904000312 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4005d40 con 0x7f5bac0a6d10 2023-11-18T20:38:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.768+0000 7f5ba97fa640 1 -- 172.21.15.132:0/2904000312 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba400ced0 con 0x7f5bac0a6d10 2023-11-18T20:38:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.768+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac0a5fd0 con 0x7f5bac0a6d10 2023-11-18T20:38:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.768+0000 7f5ba97fa640 1 -- 172.21.15.132:0/2904000312 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4005ea0 con 0x7f5bac0a6d10 2023-11-18T20:38:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.768+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac0a7760 con 0x7f5bac0a6d10 2023-11-18T20:38:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.769+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac068350 con 0x7f5bac0a6d10 2023-11-18T20:38:48.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.770+0000 7f5ba97fa640 1 -- 172.21.15.132:0/2904000312 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ba400a820 con 0x7f5bac0a6d10 2023-11-18T20:38:48.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.771+0000 7f5ba97fa640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b9006ae70 0x7f5b9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:48.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.771+0000 7f5ba97fa640 1 -- 172.21.15.132:0/2904000312 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5ba4088b60 con 0x7f5bac0a6d10 2023-11-18T20:38:48.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.771+0000 7f5bb0c6b640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b9006ae70 0x7f5b9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:48.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.773+0000 7f5bb0c6b640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b9006ae70 0x7f5b9006d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0006a90 tx=0x7f5ba0006a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:48.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:48.775+0000 7f5ba97fa640 1 -- 172.21.15.132:0/2904000312 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ba4053b50 con 0x7f5bac0a6d10 2023-11-18T20:38:49.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.001+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bac0bfa00 con 0x7f5bac0a6d10 2023-11-18T20:38:49.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.002+0000 7f5ba97fa640 1 -- 172.21.15.132:0/2904000312 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f5ba4017020 con 0x7f5bac0a6d10 2023-11-18T20:38:49.003 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:49.003 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:37:58.599151+0000","modified":"2023-11-18T20:38:01.664198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T20:38:49.003 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-11-18T20:38:49.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b9006ae70 msgr2=0x7f5b9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b9006ae70 0x7f5b9006d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0006a90 tx=0x7f5ba0006a20 comp rx=0 tx=0).stop 2023-11-18T20:38:49.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bac0a6d10 msgr2=0x7f5bac14e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bac0a6d10 0x7f5bac14e120 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5bac06b200 tx=0x7f5ba400cb90 comp rx=0 tx=0).stop 2023-11-18T20:38:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 shutdown_connections 2023-11-18T20:38:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b9006ae70 0x7f5b9006d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bac0a6d10 0x7f5bac14e120 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bac0aa710 0x7f5bac0a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 --2- 172.21.15.132:0/2904000312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b9c0047c0 0x7f5bac150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.004+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 >> 172.21.15.132:0/2904000312 conn(0x7f5bac06a500 msgr2=0x7f5bac071590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.005+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 shutdown_connections 2023-11-18T20:38:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.005+0000 7f5bb2ecf640 1 -- 172.21.15.132:0/2904000312 wait complete. 2023-11-18T20:38:49.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:38:49.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.231+0000 7f31bfc0e640 1 Processor -- start 2023-11-18T20:38:49.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.231+0000 7f31bfc0e640 1 -- start start 2023-11-18T20:38:49.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.232+0000 7f31bfc0e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b814fd30 0x7f31b8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.232+0000 7f31bfc0e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f31b806d0a0 0x7f31b80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.232+0000 7f31bfc0e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31b80a5260 0x7f31b80c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.232+0000 7f31bfc0e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b80c64a0 con 0x7f31b80a5260 2023-11-18T20:38:49.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.232+0000 7f31bfc0e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b80c5c00 con 0x7f31b806d0a0 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.232+0000 7f31bfc0e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80c5ee0 con 0x7f31b814fd30 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31be1ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31b80a5260 0x7f31b80c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31be1ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31b80a5260 0x7f31b80c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54196/0 (socket says 172.21.15.132:54196) 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31be1ab640 1 -- 172.21.15.132:0/1323885194 learned_addr learned my addr 172.21.15.132:0/1323885194 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31bd1a9640 1 --2- 172.21.15.132:0/1323885194 >> v2:172.21.15.161:3300/0 conn(0x7f31b806d0a0 0x7f31b80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31bd9aa640 1 --2- 172.21.15.132:0/1323885194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b814fd30 0x7f31b8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31be1ab640 1 -- 172.21.15.132:0/1323885194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b814fd30 msgr2=0x7f31b8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31be1ab640 1 --2- 172.21.15.132:0/1323885194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b814fd30 0x7f31b8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31be1ab640 1 -- 172.21.15.132:0/1323885194 >> v2:172.21.15.161:3300/0 conn(0x7f31b806d0a0 msgr2=0x7f31b80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31be1ab640 1 --2- 172.21.15.132:0/1323885194 >> v2:172.21.15.161:3300/0 conn(0x7f31b806d0a0 0x7f31b80a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.233+0000 7f31be1ab640 1 -- 172.21.15.132:0/1323885194 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b80c61c0 con 0x7f31b80a5260 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.234+0000 7f31be1ab640 1 --2- 172.21.15.132:0/1323885194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b80a5260 0x7f31b80c3ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31b806b280 tx=0x7f31b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0a6f35d1ef22cd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.234+0000 7f31bc9a8640 1 -- 172.21.15.132:0/1323885194 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b002ca70 con 0x7f31b80a5260 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bc9a8640 1 -- 172.21.15.132:0/1323885194 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b002cbd0 con 0x7f31b80a5260 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bc9a8640 1 -- 172.21.15.132:0/1323885194 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00343f0 con 0x7f31b80a5260 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 -- 172.21.15.132:0/1323885194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b80a5260 msgr2=0x7f31b80c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/1323885194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b80a5260 0x7f31b80c3ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31b806b280 tx=0x7f31b002bed0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 -- 172.21.15.132:0/1323885194 shutdown_connections 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/1323885194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b80a5260 0x7f31b80c3ea0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/1323885194 >> v2:172.21.15.161:3300/0 conn(0x7f31b806d0a0 0x7f31b80a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/1323885194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b814fd30 0x7f31b8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 -- 172.21.15.132:0/1323885194 >> 172.21.15.132:0/1323885194 conn(0x7f31b806a500 msgr2=0x7f31b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:49.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 -- 172.21.15.132:0/1323885194 shutdown_connections 2023-11-18T20:38:49.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.235+0000 7f31bfc0e640 1 -- 172.21.15.132:0/1323885194 wait complete. 2023-11-18T20:38:49.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.237+0000 7f31bfc0e640 1 Processor -- start 2023-11-18T20:38:49.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.237+0000 7f31bfc0e640 1 -- start start 2023-11-18T20:38:49.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bfc0e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b806d0a0 0x7f31b81e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bfc0e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b80a5260 0x7f31b81ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bfc0e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b814fd30 0x7f31b81e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bfc0e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b81e8550 con 0x7f31b806d0a0 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bfc0e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b81ddf10 con 0x7f31b814fd30 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bfc0e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8153860 con 0x7f31b80a5260 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bd9aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b806d0a0 0x7f31b81e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bd9aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b806d0a0 0x7f31b81e61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54202/0 (socket says 172.21.15.132:54202) 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bd9aa640 1 -- 172.21.15.132:0/488604585 learned_addr learned my addr 172.21.15.132:0/488604585 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bd9aa640 1 -- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b80a5260 msgr2=0x7f31b81ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bd9aa640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b80a5260 0x7f31b81ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bd9aa640 1 -- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b814fd30 msgr2=0x7f31b81e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bd9aa640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b814fd30 0x7f31b81e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.238+0000 7f31bd9aa640 1 -- 172.21.15.132:0/488604585 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009b30 con 0x7f31b806d0a0 2023-11-18T20:38:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.239+0000 7f31bd9aa640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b806d0a0 0x7f31b81e61e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f31b400d5f0 tx=0x7f31b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.239+0000 7f31ae7fc640 1 -- 172.21.15.132:0/488604585 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40125f0 con 0x7f31b806d0a0 2023-11-18T20:38:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.239+0000 7f31ae7fc640 1 -- 172.21.15.132:0/488604585 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4012750 con 0x7f31b806d0a0 2023-11-18T20:38:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.239+0000 7f31ae7fc640 1 -- 172.21.15.132:0/488604585 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4012b00 con 0x7f31b806d0a0 2023-11-18T20:38:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.239+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b8153b40 con 0x7f31b806d0a0 2023-11-18T20:38:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.239+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b81e81a0 con 0x7f31b806d0a0 2023-11-18T20:38:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.240+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b81e8360 con 0x7f31b806d0a0 2023-11-18T20:38:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.241+0000 7f31ae7fc640 1 -- 172.21.15.132:0/488604585 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31b4012c60 con 0x7f31b806d0a0 2023-11-18T20:38:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.242+0000 7f31ae7fc640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f319c06ae40 0x7f319c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.242+0000 7f31ae7fc640 1 -- 172.21.15.132:0/488604585 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f31b4089ad0 con 0x7f31b806d0a0 2023-11-18T20:38:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.242+0000 7f31bd1a9640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f319c06ae40 0x7f319c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.243+0000 7f31bd1a9640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f319c06ae40 0x7f319c06d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31b8072880 tx=0x7f31a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:49.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.246+0000 7f31ae7fc640 1 -- 172.21.15.132:0/488604585 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31b4054b50 con 0x7f31b806d0a0 2023-11-18T20:38:49.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.455+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31b8068350 con 0x7f31b806d0a0 2023-11-18T20:38:49.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.456+0000 7f31ae7fc640 1 -- 172.21.15.132:0/488604585 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f31b4058170 con 0x7f31b806d0a0 2023-11-18T20:38:49.458 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:49.458 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1370429154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1370429154},{"type":"v1","addr":"172.21.15.161:6835","nonce":1370429154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2526576077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2526576077},{"type":"v1","addr":"172.21.15.132:6833","nonce":2526576077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3432416300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3432416300},{"type":"v1","addr":"172.21.15.132:6835","nonce":3432416300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:37:58.599151+0000","modified":"2023-11-18T20:38:01.664198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/468126248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":468126248},{"type":"v1","addr":"172.21.15.161:6837","nonce":468126248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T20:38:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-11-18T20:38:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f319c06ae40 msgr2=0x7f319c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f319c06ae40 0x7f319c06d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31b8072880 tx=0x7f31a8008040 comp rx=0 tx=0).stop 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b806d0a0 msgr2=0x7f31b81e61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b806d0a0 0x7f31b81e61e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f31b400d5f0 tx=0x7f31b400dab0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 shutdown_connections 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f319c06ae40 0x7f319c06d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b814fd30 0x7f31b81e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31b80a5260 0x7f31b81ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 --2- 172.21.15.132:0/488604585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b806d0a0 0x7f31b81e61e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 >> 172.21.15.132:0/488604585 conn(0x7f31b806a500 msgr2=0x7f31b80c2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 shutdown_connections 2023-11-18T20:38:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.459+0000 7f31bfc0e640 1 -- 172.21.15.132:0/488604585 wait complete. 2023-11-18T20:38:49.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:49.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.686+0000 7f4d772bb640 1 Processor -- start 2023-11-18T20:38:49.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.687+0000 7f4d772bb640 1 -- start start 2023-11-18T20:38:49.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.688+0000 7f4d772bb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d7006d0a0 0x7f4d70152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.688+0000 7f4d772bb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d700c3ea0 0x7f4d700c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.688+0000 7f4d772bb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700c64a0 con 0x7f4d7014fd30 2023-11-18T20:38:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.688+0000 7f4d772bb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700c5c00 con 0x7f4d7006d0a0 2023-11-18T20:38:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.688+0000 7f4d772bb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700c5ee0 con 0x7f4d700c3ea0 2023-11-18T20:38:49.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.689+0000 7f4d75057640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4d7014fd30 0x7f4d700a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:49842/0 (socket says 172.21.15.132:49842) 2023-11-18T20:38:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.689+0000 7f4d75858640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d700c3ea0 0x7f4d700c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.689+0000 7f4d75057640 1 -- 172.21.15.132:0/4201886899 learned_addr learned my addr 172.21.15.132:0/4201886899 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.689+0000 7f4d74856640 1 --2- 172.21.15.132:0/4201886899 >> v2:172.21.15.161:3300/0 conn(0x7f4d7006d0a0 0x7f4d70152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.690+0000 7f4d6ffff640 1 -- 172.21.15.132:0/4201886899 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26021672 0 0) 0x7f4d700c64a0 con 0x7f4d7014fd30 2023-11-18T20:38:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.690+0000 7f4d6ffff640 1 -- 172.21.15.132:0/4201886899 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d58003520 con 0x7f4d7014fd30 2023-11-18T20:38:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.690+0000 7f4d74856640 1 -- 172.21.15.132:0/4201886899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d700c3ea0 msgr2=0x7f4d700c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.690+0000 7f4d74856640 1 --2- 172.21.15.132:0/4201886899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d700c3ea0 0x7f4d700c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.690+0000 7f4d74856640 1 -- 172.21.15.132:0/4201886899 >> v1:172.21.15.161:6789/0 conn(0x7f4d7014fd30 legacy=0x7f4d700a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.690+0000 7f4d74856640 1 -- 172.21.15.132:0/4201886899 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700c61c0 con 0x7f4d7006d0a0 2023-11-18T20:38:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.690+0000 7f4d75858640 1 --2- 172.21.15.132:0/4201886899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d700c3ea0 0x7f4d700c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:38:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.691+0000 7f4d74856640 1 --2- 172.21.15.132:0/4201886899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 0x7f4d70152f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4d640097a0 tx=0x7f4d6402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70fa4ffcbf4b5244 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.692+0000 7f4d6ffff640 1 -- 172.21.15.132:0/4201886899 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6402d040 con 0x7f4d7006d0a0 2023-11-18T20:38:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.692+0000 7f4d6ffff640 1 -- 172.21.15.132:0/4201886899 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64031810 con 0x7f4d7006d0a0 2023-11-18T20:38:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.692+0000 7f4d6ffff640 1 -- 172.21.15.132:0/4201886899 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64031ba0 con 0x7f4d7006d0a0 2023-11-18T20:38:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.693+0000 7f4d772bb640 1 -- 172.21.15.132:0/4201886899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 msgr2=0x7f4d70152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.693+0000 7f4d772bb640 1 --2- 172.21.15.132:0/4201886899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 0x7f4d70152f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4d640097a0 tx=0x7f4d6402b8b0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.693+0000 7f4d772bb640 1 -- 172.21.15.132:0/4201886899 shutdown_connections 2023-11-18T20:38:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.693+0000 7f4d772bb640 1 --2- 172.21.15.132:0/4201886899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d700c3ea0 0x7f4d700c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.693+0000 7f4d772bb640 1 --2- 172.21.15.132:0/4201886899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 0x7f4d70152f20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.693+0000 7f4d772bb640 1 -- 172.21.15.132:0/4201886899 >> 172.21.15.132:0/4201886899 conn(0x7f4d7006a500 msgr2=0x7f4d7006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.693+0000 7f4d772bb640 1 -- 172.21.15.132:0/4201886899 shutdown_connections 2023-11-18T20:38:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.693+0000 7f4d772bb640 1 -- 172.21.15.132:0/4201886899 wait complete. 2023-11-18T20:38:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.695+0000 7f4d772bb640 1 Processor -- start 2023-11-18T20:38:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.695+0000 7f4d772bb640 1 -- start start 2023-11-18T20:38:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d772bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 0x7f4d70151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d772bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d700c3ea0 0x7f4d7014c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d772bb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d7014fd30 0x7f4d7014c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d772bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70152230 con 0x7f4d700c3ea0 2023-11-18T20:38:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d772bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701dc470 con 0x7f4d7006d0a0 2023-11-18T20:38:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d772bb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701dc750 con 0x7f4d7014fd30 2023-11-18T20:38:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d74856640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d700c3ea0 0x7f4d7014c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d74856640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d700c3ea0 0x7f4d7014c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54212/0 (socket says 172.21.15.132:54212) 2023-11-18T20:38:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d74856640 1 -- 172.21.15.132:0/2316533935 learned_addr learned my addr 172.21.15.132:0/2316533935 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.696+0000 7f4d75057640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 0x7f4d70151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d75858640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d7014fd30 0x7f4d7014c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d74856640 1 -- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d7014fd30 msgr2=0x7f4d7014c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d74856640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d7014fd30 0x7f4d7014c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d74856640 1 -- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 msgr2=0x7f4d70151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d74856640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 0x7f4d70151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d74856640 1 -- 172.21.15.132:0/2316533935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d68009400 con 0x7f4d700c3ea0 2023-11-18T20:38:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d74856640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d700c3ea0 0x7f4d7014c100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4d640098c0 tx=0x7f4d640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d6dffb640 1 -- 172.21.15.132:0/2316533935 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64031610 con 0x7f4d700c3ea0 2023-11-18T20:38:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d6dffb640 1 -- 172.21.15.132:0/2316533935 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6403ad60 con 0x7f4d700c3ea0 2023-11-18T20:38:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d6dffb640 1 -- 172.21.15.132:0/2316533935 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64042630 con 0x7f4d700c3ea0 2023-11-18T20:38:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d64009400 con 0x7f4d700c3ea0 2023-11-18T20:38:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.697+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d701e8d90 con 0x7f4d700c3ea0 2023-11-18T20:38:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.698+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d700c3290 con 0x7f4d700c3ea0 2023-11-18T20:38:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.699+0000 7f4d6dffb640 1 -- 172.21.15.132:0/2316533935 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d640393b0 con 0x7f4d700c3ea0 2023-11-18T20:38:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.700+0000 7f4d6dffb640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4d5c06ae40 0x7f4d5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.700+0000 7f4d6dffb640 1 -- 172.21.15.132:0/2316533935 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4d640ab080 con 0x7f4d700c3ea0 2023-11-18T20:38:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.701+0000 7f4d75057640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4d5c06ae40 0x7f4d5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.702+0000 7f4d75057640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4d5c06ae40 0x7f4d5c06d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4d60001560 tx=0x7f4d60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.705+0000 7f4d6dffb640 1 -- 172.21.15.132:0/2316533935 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d640761a0 con 0x7f4d700c3ea0 2023-11-18T20:38:49.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.893+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d70068350 con 0x7f4d700c3ea0 2023-11-18T20:38:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.896+0000 7f4d6dffb640 1 -- 172.21.15.132:0/2316533935 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f4d640797c0 con 0x7f4d700c3ea0 2023-11-18T20:38:49.898 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:49.898 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":23,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:46.507131+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:37:56.866103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:37:57.601186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4d5c06ae40 msgr2=0x7f4d5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4d5c06ae40 0x7f4d5c06d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4d60001560 tx=0x7f4d60009040 comp rx=0 tx=0).stop 2023-11-18T20:38:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d700c3ea0 msgr2=0x7f4d7014c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d700c3ea0 0x7f4d7014c100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4d640098c0 tx=0x7f4d640046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 shutdown_connections 2023-11-18T20:38:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4d5c06ae40 0x7f4d5c06d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d7014fd30 0x7f4d7014c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d700c3ea0 0x7f4d7014c100 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 --2- 172.21.15.132:0/2316533935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d7006d0a0 0x7f4d70151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.899+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 >> 172.21.15.132:0/2316533935 conn(0x7f4d7006a500 msgr2=0x7f4d700c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.900+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 shutdown_connections 2023-11-18T20:38:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:49.900+0000 7f4d772bb640 1 -- 172.21.15.132:0/2316533935 wait complete. 2023-11-18T20:38:49.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-18T20:38:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.131+0000 7feccc9a4640 1 Processor -- start 2023-11-18T20:38:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.131+0000 7feccc9a4640 1 -- start start 2023-11-18T20:38:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.133+0000 7feccc9a4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc814c2e0 0x7fecc80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.133+0000 7feccc9a4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fecc80c0440 0x7fecc8152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.133+0000 7feccc9a4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc8071e80 con 0x7fecc8072310 2023-11-18T20:38:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.133+0000 7feccc9a4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc8071470 con 0x7fecc80c0440 2023-11-18T20:38:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.133+0000 7feccc9a4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc814c6c0 con 0x7fecc814c2e0 2023-11-18T20:38:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.133+0000 7fecc759e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fecc8072310 0x7fecc80a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52856/0 (socket says 172.21.15.132:52856) 2023-11-18T20:38:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.133+0000 7fecc759e640 1 -- 172.21.15.132:0/1848343562 learned_addr learned my addr 172.21.15.132:0/1848343562 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecbe59c640 1 --2- 172.21.15.132:0/1848343562 >> v2:172.21.15.161:3300/0 conn(0x7fecc80c0440 0x7fecc8152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc6d9d640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc814c2e0 0x7fecc80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843832869 0 0) 0x7fecc8071e80 con 0x7fecc8072310 2023-11-18T20:38:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb4003520 con 0x7fecc8072310 2023-11-18T20:38:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2804885726 0 0) 0x7fecb4003520 con 0x7fecc8072310 2023-11-18T20:38:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc814c2e0 msgr2=0x7fecc80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc814c2e0 0x7fecc80c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 >> v2:172.21.15.161:3300/0 conn(0x7fecc80c0440 msgr2=0x7fecc8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 --2- 172.21.15.132:0/1848343562 >> v2:172.21.15.161:3300/0 conn(0x7fecc80c0440 0x7fecc8152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8153180 con 0x7fecc8072310 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fecc00019f0 con 0x7fecc8072310 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 >> v1:172.21.15.132:6789/0 conn(0x7fecc8072310 legacy=0x7fecc80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4003970 0x7fecb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc814c2e0 0x7fecb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4004d00 0x7fecb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc814c6c0 con 0x7fecb4003970 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb400fd90 con 0x7fecb4004d00 2023-11-18T20:38:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.134+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb400ff50 con 0x7fecc814c2e0 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecc6d9d640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4003970 0x7fecb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecbe59c640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc814c2e0 0x7fecb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecc759e640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4004d00 0x7fecb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecc6d9d640 1 -- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc814c2e0 msgr2=0x7fecb40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecc6d9d640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc814c2e0 0x7fecb40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecc6d9d640 1 -- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4004d00 msgr2=0x7fecb4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecc6d9d640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4004d00 0x7fecb4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecc6d9d640 1 -- 172.21.15.132:0/1848343562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4003520 con 0x7fecb4003970 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.135+0000 7fecc759e640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4004d00 0x7fecb4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.137+0000 7fecc6d9d640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4003970 0x7fecb4003d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009ac0 tx=0x7fecb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff63a131ce5db1c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.137+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb802c6d0 con 0x7fecb4003970 2023-11-18T20:38:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.137+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb802c830 con 0x7fecb4003970 2023-11-18T20:38:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.137+0000 7fecc659c640 1 -- 172.21.15.132:0/1848343562 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb802cbc0 con 0x7fecb4003970 2023-11-18T20:38:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.137+0000 7feccc9a4640 1 -- 172.21.15.132:0/1848343562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4003970 msgr2=0x7fecb4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.137+0000 7feccc9a4640 1 --2- 172.21.15.132:0/1848343562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4003970 0x7fecb4003d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009ac0 tx=0x7fecb40057f0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.138+0000 7fecc759e640 1 -- 172.21.15.132:0/1848343562 reap_dead start 2023-11-18T20:38:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.138+0000 7feccc9a4640 1 -- 172.21.15.132:0/1848343562 shutdown_connections 2023-11-18T20:38:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.138+0000 7feccc9a4640 1 -- 172.21.15.132:0/1848343562 >> 172.21.15.132:0/1848343562 conn(0x7fecc80a77f0 msgr2=0x7fecc80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.138+0000 7feccc9a4640 1 -- 172.21.15.132:0/1848343562 shutdown_connections 2023-11-18T20:38:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.138+0000 7feccc9a4640 1 -- 172.21.15.132:0/1848343562 wait complete. 2023-11-18T20:38:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.139+0000 7feccc9a4640 1 Processor -- start 2023-11-18T20:38:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.140+0000 7feccc9a4640 1 -- start start 2023-11-18T20:38:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.140+0000 7feccc9a4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4003970 0x7fecc806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.140+0000 7feccc9a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc8153450 0x7fecc8155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.140+0000 7feccc9a4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc8143d90 0x7fecc8144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.140+0000 7feccc9a4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc81e99c0 con 0x7fecc8153450 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.140+0000 7feccc9a4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc806dc10 con 0x7fecb4003970 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.140+0000 7feccc9a4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc806def0 con 0x7fecc8143d90 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc8153450 0x7fecc8155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc8153450 0x7fecc8155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54228/0 (socket says 172.21.15.132:54228) 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 -- 172.21.15.132:0/2402400900 learned_addr learned my addr 172.21.15.132:0/2402400900 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecc6d9d640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4003970 0x7fecc806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 -- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc8143d90 msgr2=0x7fecc8144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc8143d90 0x7fecc8144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 -- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4003970 msgr2=0x7fecc806bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4003970 0x7fecc806bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 -- 172.21.15.132:0/2402400900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8155a20 con 0x7fecc8153450 2023-11-18T20:38:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.141+0000 7fecbe59c640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc8153450 0x7fecc8155f40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fecb0011630 tx=0x7fecb0011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.142+0000 7fecbffff640 1 -- 172.21.15.132:0/2402400900 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000f920 con 0x7fecc8153450 2023-11-18T20:38:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.142+0000 7fecbffff640 1 -- 172.21.15.132:0/2402400900 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb000fa80 con 0x7fecc8153450 2023-11-18T20:38:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.142+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc8149550 con 0x7fecc8153450 2023-11-18T20:38:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.142+0000 7fecbffff640 1 -- 172.21.15.132:0/2402400900 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000fe30 con 0x7fecc8153450 2023-11-18T20:38:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.142+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc8156660 con 0x7fecc8153450 2023-11-18T20:38:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.143+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc8155bb0 con 0x7fecc8153450 2023-11-18T20:38:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.144+0000 7fecbffff640 1 -- 172.21.15.132:0/2402400900 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecb0015460 con 0x7fecc8153450 2023-11-18T20:38:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.145+0000 7fecbffff640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca806aec0 0x7feca806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.145+0000 7fecbffff640 1 -- 172.21.15.132:0/2402400900 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fecb0089ce0 con 0x7fecc8153450 2023-11-18T20:38:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.145+0000 7fecc6d9d640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca806aec0 0x7feca806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.146+0000 7fecc6d9d640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca806aec0 0x7feca806d380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fecb8036000 tx=0x7fecb8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.149+0000 7fecbffff640 1 -- 172.21.15.132:0/2402400900 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecb0054d50 con 0x7fecc8153450 2023-11-18T20:38:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.378+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fecc8155850 con 0x7fecc8153450 2023-11-18T20:38:50.380 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-11-18T20:38:50.380+0000 7feee5f07640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-18T20:38:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.383+0000 7fecbffff640 1 -- 172.21.15.132:0/2402400900 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fecb0058370 con 0x7fecc8153450 2023-11-18T20:38:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T20:38:50.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca806aec0 msgr2=0x7feca806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca806aec0 0x7feca806d380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fecb8036000 tx=0x7fecb8030000 comp rx=0 tx=0).stop 2023-11-18T20:38:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc8153450 msgr2=0x7fecc8155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc8153450 0x7fecc8155f40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fecb0011630 tx=0x7fecb0011af0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 shutdown_connections 2023-11-18T20:38:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca806aec0 0x7feca806d380 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc8143d90 0x7fecc8144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc8153450 0x7fecc8155f40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 --2- 172.21.15.132:0/2402400900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb4003970 0x7fecc806bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 >> 172.21.15.132:0/2402400900 conn(0x7fecc80a77f0 msgr2=0x7fecc80c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 shutdown_connections 2023-11-18T20:38:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.386+0000 7feccc9a4640 1 -- 172.21.15.132:0/2402400900 wait complete. 2023-11-18T20:38:50.406 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-18T20:38:50.421 INFO:tasks.ceph.mds.d.smithi161.stderr: -5906> 2023-11-18T20:38:02.898+0000 7f337ff55640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:38:50.506 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-11-18T20:38:50.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.609+0000 7fdac21a5640 1 Processor -- start 2023-11-18T20:38:50.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.609+0000 7fdac21a5640 1 -- start start 2023-11-18T20:38:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac21a5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdabc14ae70 0x7fdabc154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac21a5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdabc06b890 0x7fdabc06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac21a5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc1554a0 con 0x7fdabc0bd530 2023-11-18T20:38:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac21a5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc0c6840 con 0x7fdabc14ae70 2023-11-18T20:38:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac21a5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc06b120 con 0x7fdabc06b890 2023-11-18T20:38:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac11a3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdabc14ae70 0x7fdabc154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac09a2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdabc0bd530 0x7fdabc0c47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52868/0 (socket says 172.21.15.132:52868) 2023-11-18T20:38:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac09a2640 1 -- 172.21.15.132:0/1433834277 learned_addr learned my addr 172.21.15.132:0/1433834277 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.611+0000 7fdac19a4640 1 --2- 172.21.15.132:0/1433834277 >> v2:172.21.15.161:3300/0 conn(0x7fdabc06b890 0x7fdabc06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.612+0000 7fdac11a3640 1 -- 172.21.15.132:0/1433834277 >> v2:172.21.15.161:3300/0 conn(0x7fdabc06b890 msgr2=0x7fdabc06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.612+0000 7fdac11a3640 1 --2- 172.21.15.132:0/1433834277 >> v2:172.21.15.161:3300/0 conn(0x7fdabc06b890 0x7fdabc06bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.612+0000 7fdac11a3640 1 -- 172.21.15.132:0/1433834277 >> v1:172.21.15.132:6789/0 conn(0x7fdabc0bd530 legacy=0x7fdabc0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.612+0000 7fdac11a3640 1 -- 172.21.15.132:0/1433834277 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0c6a90 con 0x7fdabc14ae70 2023-11-18T20:38:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.612+0000 7fdab3fff640 1 -- 172.21.15.132:0/1433834277 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143860359 0 0) 0x7fdaac001110 con 0x7fdabc0bd530 2023-11-18T20:38:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.613+0000 7fdac11a3640 1 --2- 172.21.15.132:0/1433834277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc14ae70 0x7fdabc154f60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0c0e90 tx=0x7fdab802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ebe3aaf9b157f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.613+0000 7fdab3fff640 1 -- 172.21.15.132:0/1433834277 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab802e070 con 0x7fdabc14ae70 2023-11-18T20:38:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdab3fff640 1 -- 172.21.15.132:0/1433834277 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab80315a0 con 0x7fdabc14ae70 2023-11-18T20:38:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdab3fff640 1 -- 172.21.15.132:0/1433834277 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8031930 con 0x7fdabc14ae70 2023-11-18T20:38:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdac21a5640 1 -- 172.21.15.132:0/1433834277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc14ae70 msgr2=0x7fdabc154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdac21a5640 1 --2- 172.21.15.132:0/1433834277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc14ae70 0x7fdabc154f60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0c0e90 tx=0x7fdab802b840 comp rx=0 tx=0).stop 2023-11-18T20:38:50.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdac21a5640 1 -- 172.21.15.132:0/1433834277 shutdown_connections 2023-11-18T20:38:50.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdac21a5640 1 --2- 172.21.15.132:0/1433834277 >> v2:172.21.15.161:3300/0 conn(0x7fdabc06b890 0x7fdabc06bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdac21a5640 1 --2- 172.21.15.132:0/1433834277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc14ae70 0x7fdabc154f60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdac21a5640 1 -- 172.21.15.132:0/1433834277 >> 172.21.15.132:0/1433834277 conn(0x7fdabc0ab9e0 msgr2=0x7fdabc0abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdac21a5640 1 -- 172.21.15.132:0/1433834277 shutdown_connections 2023-11-18T20:38:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.614+0000 7fdac21a5640 1 -- 172.21.15.132:0/1433834277 wait complete. 2023-11-18T20:38:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.616+0000 7fdac21a5640 1 Processor -- start 2023-11-18T20:38:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.616+0000 7fdac21a5640 1 -- start start 2023-11-18T20:38:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac21a5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdabc06b890 0x7fdabc1e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac21a5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc0bd530 0x7fdabc0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac21a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdabc14ae70 0x7fdabc1e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac21a5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc14c170 con 0x7fdabc0bd530 2023-11-18T20:38:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac21a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc14b560 con 0x7fdabc14ae70 2023-11-18T20:38:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac21a5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc14b840 con 0x7fdabc06b890 2023-11-18T20:38:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac09a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc0bd530 0x7fdabc0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac09a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc0bd530 0x7fdabc0aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54240/0 (socket says 172.21.15.132:54240) 2023-11-18T20:38:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.617+0000 7fdac09a2640 1 -- 172.21.15.132:0/720817654 learned_addr learned my addr 172.21.15.132:0/720817654 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac11a3640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdabc06b890 0x7fdabc1e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac19a4640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdabc14ae70 0x7fdabc1e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac09a2640 1 -- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdabc06b890 msgr2=0x7fdabc1e9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac09a2640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdabc06b890 0x7fdabc1e9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac09a2640 1 -- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdabc14ae70 msgr2=0x7fdabc1e6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac09a2640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdabc14ae70 0x7fdabc1e6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac09a2640 1 -- 172.21.15.132:0/720817654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8009400 con 0x7fdabc0bd530 2023-11-18T20:38:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac09a2640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc0bd530 0x7fdabc0aead0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00c780 tx=0x7fdaac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdab1ffb640 1 -- 172.21.15.132:0/720817654 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac0072d0 con 0x7fdabc0bd530 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdab1ffb640 1 -- 172.21.15.132:0/720817654 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac007450 con 0x7fdabc0bd530 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdab1ffb640 1 -- 172.21.15.132:0/720817654 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac0047e0 con 0x7fdabc0bd530 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.618+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc14bb20 con 0x7fdabc0bd530 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.619+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc158400 con 0x7fdabc0bd530 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.620+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc14cda0 con 0x7fdabc0bd530 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.621+0000 7fdab1ffb640 1 -- 172.21.15.132:0/720817654 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdaac004960 con 0x7fdabc0bd530 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.622+0000 7fdab1ffb640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdaa006ae40 0x7fdaa006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.622+0000 7fdab1ffb640 1 -- 172.21.15.132:0/720817654 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fdaac088790 con 0x7fdabc0bd530 2023-11-18T20:38:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.623+0000 7fdac11a3640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdaa006ae40 0x7fdaa006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.624+0000 7fdac11a3640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdaa006ae40 0x7fdaa006d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdab8036000 tx=0x7fdab8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.626+0000 7fdab1ffb640 1 -- 172.21.15.132:0/720817654 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdaac0537e0 con 0x7fdabc0bd530 2023-11-18T20:38:50.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:50.856+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdabc1554a0 con 0x7fdabc0bd530 2023-11-18T20:38:51.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.387+0000 7fdab1ffb640 1 -- 172.21.15.132:0/720817654 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdabc1554a0 con 0x7fdabc0bd530 2023-11-18T20:38:51.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdaa006ae40 msgr2=0x7fdaa006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:51.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdaa006ae40 0x7fdaa006d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdab8036000 tx=0x7fdab8008030 comp rx=0 tx=0).stop 2023-11-18T20:38:51.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc0bd530 msgr2=0x7fdabc0aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc0bd530 0x7fdabc0aead0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00c780 tx=0x7fdaac00cc40 comp rx=0 tx=0).stop 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 shutdown_connections 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdaa006ae40 0x7fdaa006d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdabc14ae70 0x7fdabc1e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdabc0bd530 0x7fdabc0aead0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 --2- 172.21.15.132:0/720817654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdabc06b890 0x7fdabc1e9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 >> 172.21.15.132:0/720817654 conn(0x7fdabc0ab9e0 msgr2=0x7fdabc1526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 shutdown_connections 2023-11-18T20:38:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.391+0000 7fdac21a5640 1 -- 172.21.15.132:0/720817654 wait complete. 2023-11-18T20:38:51.413 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-18T20:38:51.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.632+0000 7fd0b97f4640 1 Processor -- start 2023-11-18T20:38:51.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.632+0000 7fd0b97f4640 1 -- start start 2023-11-18T20:38:51.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.633+0000 7fd0b97f4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0b40c2df0 0x7fd0b40c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:51.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b97f4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd0b4152d30 0x7fd0b4071f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:51.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b97f4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b40c3c50 con 0x7fd0b40724c0 2023-11-18T20:38:51.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b97f4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b4153280 con 0x7fd0b4152d30 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b97f4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b406cee0 con 0x7fd0b40c2df0 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd0b4152d30 0x7fd0b4071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b8ff3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd0b40724c0 0x7fd0b40c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52878/0 (socket says 172.21.15.132:52878) 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b8ff3640 1 -- 172.21.15.132:0/4264726528 learned_addr learned my addr 172.21.15.132:0/4264726528 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b3fff640 1 --2- 172.21.15.132:0/4264726528 >> v2:172.21.15.161:3300/0 conn(0x7fd0b40c2df0 0x7fd0b40c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b37fe640 1 -- 172.21.15.132:0/4264726528 >> v2:172.21.15.161:3300/0 conn(0x7fd0b40c2df0 msgr2=0x7fd0b40c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b37fe640 1 --2- 172.21.15.132:0/4264726528 >> v2:172.21.15.161:3300/0 conn(0x7fd0b40c2df0 0x7fd0b40c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b37fe640 1 -- 172.21.15.132:0/4264726528 >> v1:172.21.15.132:6789/0 conn(0x7fd0b40724c0 legacy=0x7fd0b40c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b37fe640 1 -- 172.21.15.132:0/4264726528 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b406d180 con 0x7fd0b4152d30 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b3fff640 1 --2- 172.21.15.132:0/4264726528 >> v2:172.21.15.161:3300/0 conn(0x7fd0b40c2df0 0x7fd0b40c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:51.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.634+0000 7fd0b2ffd640 1 -- 172.21.15.132:0/4264726528 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109452536 0 0) 0x7fd0b40c3c50 con 0x7fd0b40724c0 2023-11-18T20:38:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.635+0000 7fd0b37fe640 1 --2- 172.21.15.132:0/4264726528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b4152d30 0x7fd0b4071f80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40c3830 tx=0x7fd0a802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f461aac8a07a97 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b2ffd640 1 -- 172.21.15.132:0/4264726528 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8031710 con 0x7fd0b4152d30 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b2ffd640 1 -- 172.21.15.132:0/4264726528 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a802f050 con 0x7fd0b4152d30 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b2ffd640 1 -- 172.21.15.132:0/4264726528 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8031a90 con 0x7fd0b4152d30 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b97f4640 1 -- 172.21.15.132:0/4264726528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b4152d30 msgr2=0x7fd0b4071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/4264726528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b4152d30 0x7fd0b4071f80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40c3830 tx=0x7fd0a802b7b0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b97f4640 1 -- 172.21.15.132:0/4264726528 shutdown_connections 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/4264726528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b4152d30 0x7fd0b4071f80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/4264726528 >> v2:172.21.15.161:3300/0 conn(0x7fd0b40c2df0 0x7fd0b40c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.636+0000 7fd0b97f4640 1 -- 172.21.15.132:0/4264726528 >> 172.21.15.132:0/4264726528 conn(0x7fd0b40c5cc0 msgr2=0x7fd0b40c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.637+0000 7fd0b97f4640 1 -- 172.21.15.132:0/4264726528 shutdown_connections 2023-11-18T20:38:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.637+0000 7fd0b97f4640 1 -- 172.21.15.132:0/4264726528 wait complete. 2023-11-18T20:38:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.638+0000 7fd0b97f4640 1 Processor -- start 2023-11-18T20:38:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.638+0000 7fd0b97f4640 1 -- start start 2023-11-18T20:38:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.639+0000 7fd0b97f4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b40724c0 0x7fd0b40aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.639+0000 7fd0b97f4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0b40c2df0 0x7fd0b41ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.639+0000 7fd0b97f4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0b4152d30 0x7fd0b40aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.639+0000 7fd0b97f4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b41549b0 con 0x7fd0b40724c0 2023-11-18T20:38:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.639+0000 7fd0b97f4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40a7680 con 0x7fd0b40c2df0 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.639+0000 7fd0b97f4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40aa5b0 con 0x7fd0b4152d30 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b40724c0 0x7fd0b40aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b40724c0 0x7fd0b40aa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54272/0 (socket says 172.21.15.132:54272) 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 -- 172.21.15.132:0/516951085 learned_addr learned my addr 172.21.15.132:0/516951085 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 -- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0b4152d30 msgr2=0x7fd0b40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0b4152d30 0x7fd0b40aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 -- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0b40c2df0 msgr2=0x7fd0b41ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0b40c2df0 0x7fd0b41ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 -- 172.21.15.132:0/516951085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8009400 con 0x7fd0b40724c0 2023-11-18T20:38:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b3fff640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b40724c0 0x7fd0b40aa070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400c820 tx=0x7fd0a400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:51.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b0ff9640 1 -- 172.21.15.132:0/516951085 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a40079d0 con 0x7fd0b40724c0 2023-11-18T20:38:51.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b0ff9640 1 -- 172.21.15.132:0/516951085 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a4007b30 con 0x7fd0b40724c0 2023-11-18T20:38:51.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b0ff9640 1 -- 172.21.15.132:0/516951085 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4007ea0 con 0x7fd0b40724c0 2023-11-18T20:38:51.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.640+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b40abd00 con 0x7fd0b40724c0 2023-11-18T20:38:51.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.641+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b40ab6b0 con 0x7fd0b40724c0 2023-11-18T20:38:51.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.642+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b4067fd0 con 0x7fd0b40724c0 2023-11-18T20:38:51.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.643+0000 7fd0b0ff9640 1 -- 172.21.15.132:0/516951085 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0a40113f0 con 0x7fd0b40724c0 2023-11-18T20:38:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.644+0000 7fd0b0ff9640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0a006ae40 0x7fd0a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.644+0000 7fd0b0ff9640 1 -- 172.21.15.132:0/516951085 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd0a40895a0 con 0x7fd0b40724c0 2023-11-18T20:38:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.645+0000 7fd0b37fe640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0a006ae40 0x7fd0a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:51.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.646+0000 7fd0b37fe640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0a006ae40 0x7fd0a006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8035000 tx=0x7fd0a8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:51.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.649+0000 7fd0b0ff9640 1 -- 172.21.15.132:0/516951085 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0a4054670 con 0x7fd0b40724c0 2023-11-18T20:38:51.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:51.839+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0b40abd00 con 0x7fd0b40724c0 2023-11-18T20:38:52.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.574+0000 7fd0b0ff9640 1 -- 172.21.15.132:0/516951085 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd0b40abd00 con 0x7fd0b40724c0 2023-11-18T20:38:52.575 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-11-18T20:38:52.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.578+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0a006ae40 msgr2=0x7fd0a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:52.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.578+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0a006ae40 0x7fd0a006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8035000 tx=0x7fd0a8030000 comp rx=0 tx=0).stop 2023-11-18T20:38:52.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.578+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b40724c0 msgr2=0x7fd0b40aa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:52.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.578+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b40724c0 0x7fd0b40aa070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400c820 tx=0x7fd0a400cc20 comp rx=0 tx=0).stop 2023-11-18T20:38:52.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.580+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 shutdown_connections 2023-11-18T20:38:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.580+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0a006ae40 0x7fd0a006d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.580+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0b4152d30 0x7fd0b40aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.580+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0b40c2df0 0x7fd0b41ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.580+0000 7fd0b97f4640 1 --2- 172.21.15.132:0/516951085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b40724c0 0x7fd0b40aa070 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.580+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 >> 172.21.15.132:0/516951085 conn(0x7fd0b40c5cc0 msgr2=0x7fd0b40c4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:52.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.583+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 shutdown_connections 2023-11-18T20:38:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.583+0000 7fd0b97f4640 1 -- 172.21.15.132:0/516951085 wait complete. 2023-11-18T20:38:52.609 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-18T20:38:52.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.808+0000 7fed44c26640 1 Processor -- start 2023-11-18T20:38:52.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.809+0000 7fed44c26640 1 -- start start 2023-11-18T20:38:52.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.810+0000 7fed44c26640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed4006ae20 0x7fed40160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:52.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.810+0000 7fed44c26640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4006b270 con 0x7fed400c8ba0 2023-11-18T20:38:52.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.810+0000 7fed44c26640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4006cc60 con 0x7fed4006aa40 2023-11-18T20:38:52.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.810+0000 7fed44c26640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4006c130 con 0x7fed4006ae20 2023-11-18T20:38:52.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.811+0000 7fed3dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fed400c8ba0 0x7fed4006c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52880/0 (socket says 172.21.15.132:52880) 2023-11-18T20:38:52.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.811+0000 7fed3dd9b640 1 -- 172.21.15.132:0/4055677352 learned_addr learned my addr 172.21.15.132:0/4055677352 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:52.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.811+0000 7fed3ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed4006ae20 0x7fed40160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:52.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.811+0000 7fed3ed9d640 1 -- 172.21.15.132:0/4055677352 >> v1:172.21.15.161:6789/0 conn(0x7fed4006aa40 legacy=0x7fed40155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:52.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.811+0000 7fed3ed9d640 1 -- 172.21.15.132:0/4055677352 >> v1:172.21.15.132:6789/0 conn(0x7fed400c8ba0 legacy=0x7fed4006c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:52.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.811+0000 7fed3ed9d640 1 -- 172.21.15.132:0/4055677352 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400c4ca0 con 0x7fed4006ae20 2023-11-18T20:38:52.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.811+0000 7fed3d59a640 1 -- 172.21.15.132:0/4055677352 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810480446 0 0) 0x7fed4006b270 con 0x7fed400c8ba0 2023-11-18T20:38:52.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.812+0000 7fed3ed9d640 1 --2- 172.21.15.132:0/4055677352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006ae20 0x7fed40160140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fed380097a0 tx=0x7fed3802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48636ec0ce6bd5fe server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:52.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.812+0000 7fed3d59a640 1 -- 172.21.15.132:0/4055677352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38031830 con 0x7fed4006ae20 2023-11-18T20:38:52.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed3d59a640 1 -- 172.21.15.132:0/4055677352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38031990 con 0x7fed4006ae20 2023-11-18T20:38:52.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed3d59a640 1 -- 172.21.15.132:0/4055677352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38031d20 con 0x7fed4006ae20 2023-11-18T20:38:52.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed44c26640 1 -- 172.21.15.132:0/4055677352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006ae20 msgr2=0x7fed40160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:52.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed44c26640 1 --2- 172.21.15.132:0/4055677352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006ae20 0x7fed40160140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fed380097a0 tx=0x7fed3802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:38:52.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed44c26640 1 -- 172.21.15.132:0/4055677352 shutdown_connections 2023-11-18T20:38:52.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed44c26640 1 --2- 172.21.15.132:0/4055677352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006ae20 0x7fed40160140 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:52.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed44c26640 1 -- 172.21.15.132:0/4055677352 >> 172.21.15.132:0/4055677352 conn(0x7fed400abdc0 msgr2=0x7fed400ac1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:52.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed44c26640 1 -- 172.21.15.132:0/4055677352 shutdown_connections 2023-11-18T20:38:52.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.813+0000 7fed44c26640 1 -- 172.21.15.132:0/4055677352 wait complete. 2023-11-18T20:38:52.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.815+0000 7fed44c26640 1 Processor -- start 2023-11-18T20:38:52.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.815+0000 7fed44c26640 1 -- start start 2023-11-18T20:38:52.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed44c26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006aa40 0x7fed40153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:52.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed44c26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed4006ae20 0x7fed401564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:52.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed44c26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed400c8ba0 0x7fed401569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:52.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed44c26640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed40158d00 con 0x7fed4006aa40 2023-11-18T20:38:52.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed44c26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed400c20d0 con 0x7fed400c8ba0 2023-11-18T20:38:52.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed44c26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed40155db0 con 0x7fed4006ae20 2023-11-18T20:38:52.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed3e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006aa40 0x7fed40153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:52.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed3e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006aa40 0x7fed40153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54288/0 (socket says 172.21.15.132:54288) 2023-11-18T20:38:52.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.816+0000 7fed3e59c640 1 -- 172.21.15.132:0/4268815097 learned_addr learned my addr 172.21.15.132:0/4268815097 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:52.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.817+0000 7fed3e59c640 1 -- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed4006ae20 msgr2=0x7fed401564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:52.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.817+0000 7fed3e59c640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed4006ae20 0x7fed401564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:52.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.817+0000 7fed3ed9d640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed400c8ba0 0x7fed401569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:52.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.817+0000 7fed3e59c640 1 -- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed400c8ba0 msgr2=0x7fed401569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:52.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.817+0000 7fed3e59c640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed400c8ba0 0x7fed401569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:52.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.817+0000 7fed3e59c640 1 -- 172.21.15.132:0/4268815097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed38009400 con 0x7fed4006aa40 2023-11-18T20:38:52.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.817+0000 7fed3e59c640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006aa40 0x7fed40153ae0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c730 tx=0x7fed3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.817+0000 7fed36ffd640 1 -- 172.21.15.132:0/4268815097 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30003b70 con 0x7fed4006aa40 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.818+0000 7fed36ffd640 1 -- 172.21.15.132:0/4268815097 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed30003cf0 con 0x7fed4006aa40 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.818+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed40156000 con 0x7fed4006aa40 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.818+0000 7fed36ffd640 1 -- 172.21.15.132:0/4268815097 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3000aa90 con 0x7fed4006aa40 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.818+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed400c25c0 con 0x7fed4006aa40 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.819+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed40067900 con 0x7fed4006aa40 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.820+0000 7fed36ffd640 1 -- 172.21.15.132:0/4268815097 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed3000abf0 con 0x7fed4006aa40 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.820+0000 7fed36ffd640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2006ae40 0x7fed2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.821+0000 7fed36ffd640 1 -- 172.21.15.132:0/4268815097 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5386+0+0 (secure 0 0 0) 0x7fed30089330 con 0x7fed4006aa40 2023-11-18T20:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.821+0000 7fed3dd9b640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2006ae40 0x7fed2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:52.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.822+0000 7fed3dd9b640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2006ae40 0x7fed2006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed28000c00 tx=0x7fed280079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:52.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:52.825+0000 7fed36ffd640 1 -- 172.21.15.132:0/4268815097 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed30054510 con 0x7fed4006aa40 2023-11-18T20:38:53.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.021+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed40068350 con 0x7fed4006aa40 2023-11-18T20:38:53.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.584+0000 7fed36ffd640 1 -- 172.21.15.132:0/4268815097 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fed30003e60 con 0x7fed4006aa40 2023-11-18T20:38:53.586 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-11-18T20:38:53.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2006ae40 msgr2=0x7fed2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:53.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2006ae40 0x7fed2006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed28000c00 tx=0x7fed280079c0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006aa40 msgr2=0x7fed40153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:53.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006aa40 0x7fed40153ae0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c730 tx=0x7fed3000cbf0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 shutdown_connections 2023-11-18T20:38:53.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2006ae40 0x7fed2006d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed400c8ba0 0x7fed401569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed4006ae20 0x7fed401564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 --2- 172.21.15.132:0/4268815097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4006aa40 0x7fed40153ae0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 >> 172.21.15.132:0/4268815097 conn(0x7fed400abdc0 msgr2=0x7fed400ac1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:53.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 shutdown_connections 2023-11-18T20:38:53.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.588+0000 7fed44c26640 1 -- 172.21.15.132:0/4268815097 wait complete. 2023-11-18T20:38:53.615 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-18T20:38:53.615 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-18T20:38:53.616 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-18T20:38:53.616 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:38:53.616 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-18T20:38:53.616 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-18T20:38:53.616 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-18T20:38:53.616 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:38:53.617 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-18T20:38:53.617 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-18T20:38:53.617 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-18T20:38:53.617 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:38:53.617 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-18T20:38:53.617 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-18T20:38:53.617 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-18T20:38:53.618 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:38:53.634 INFO:tasks.ceph.mds.a:Stopped 2023-11-18T20:38:53.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-18T20:38:53.635 INFO:tasks.ceph.mds.c:Stopped 2023-11-18T20:38:53.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-18T20:38:53.637 INFO:tasks.ceph.mds.b:Stopped 2023-11-18T20:38:53.637 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-18T20:38:53.641 INFO:tasks.ceph.mds.d:Stopped 2023-11-18T20:38:53.641 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-18T20:38:53.684 INFO:tasks.ceph.mds.a:Started 2023-11-18T20:38:53.684 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:53.687 INFO:tasks.ceph.mds.b:Started 2023-11-18T20:38:53.688 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:53.692 INFO:tasks.ceph.mds.c:Started 2023-11-18T20:38:53.692 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:53.695 INFO:tasks.ceph.mds.d:Started 2023-11-18T20:38:53.695 DEBUG:teuthology.parallel:result is None 2023-11-18T20:38:53.696 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-18T20:38:53.843 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-11-18T20:38:53.846 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-11-18T20:38:53.850 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-11-18T20:38:53.856 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-11-18T20:38:53.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.884+0000 7fae3a5c0640 1 Processor -- start 2023-11-18T20:38:53.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.884+0000 7fae3a5c0640 1 -- start start 2023-11-18T20:38:53.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.885+0000 7fae3a5c0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae3414fd30 0x7fae34152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:53.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.885+0000 7fae3a5c0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fae340c3ea0 0x7fae340c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:53.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae3a5c0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340c64a0 con 0x7fae3406d0a0 2023-11-18T20:38:53.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae3a5c0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340c5c00 con 0x7fae3414fd30 2023-11-18T20:38:53.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae3a5c0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340c5ee0 con 0x7fae340c3ea0 2023-11-18T20:38:53.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae33fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae3414fd30 0x7fae34152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:53.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae2bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fae3406d0a0 0x7fae340a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52900/0 (socket says 172.21.15.132:52900) 2023-11-18T20:38:53.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae2bfff640 1 -- 172.21.15.132:0/1934205514 learned_addr learned my addr 172.21.15.132:0/1934205514 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:53.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae33fff640 1 -- 172.21.15.132:0/1934205514 >> v2:172.21.15.161:3300/0 conn(0x7fae340c3ea0 msgr2=0x7fae340c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:53.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae33fff640 1 --2- 172.21.15.132:0/1934205514 >> v2:172.21.15.161:3300/0 conn(0x7fae340c3ea0 0x7fae340c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae33fff640 1 -- 172.21.15.132:0/1934205514 >> v1:172.21.15.132:6789/0 conn(0x7fae3406d0a0 legacy=0x7fae340a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:53.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae33fff640 1 -- 172.21.15.132:0/1934205514 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340c61c0 con 0x7fae3414fd30 2023-11-18T20:38:53.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.886+0000 7fae337fe640 1 -- 172.21.15.132:0/1934205514 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665436680 0 0) 0x7fae340c64a0 con 0x7fae3406d0a0 2023-11-18T20:38:53.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.887+0000 7fae33fff640 1 --2- 172.21.15.132:0/1934205514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae34152f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fae3406e430 tx=0x7fae2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76647471a0d5cf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:53.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae337fe640 1 -- 172.21.15.132:0/1934205514 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24031830 con 0x7fae3414fd30 2023-11-18T20:38:53.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae337fe640 1 -- 172.21.15.132:0/1934205514 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae24031990 con 0x7fae3414fd30 2023-11-18T20:38:53.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae337fe640 1 -- 172.21.15.132:0/1934205514 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24031d20 con 0x7fae3414fd30 2023-11-18T20:38:53.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae3a5c0640 1 -- 172.21.15.132:0/1934205514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 msgr2=0x7fae34152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:53.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/1934205514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae34152f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fae3406e430 tx=0x7fae2402b8d0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae3a5c0640 1 -- 172.21.15.132:0/1934205514 shutdown_connections 2023-11-18T20:38:53.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/1934205514 >> v2:172.21.15.161:3300/0 conn(0x7fae340c3ea0 0x7fae340c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/1934205514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae34152f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae3a5c0640 1 -- 172.21.15.132:0/1934205514 >> 172.21.15.132:0/1934205514 conn(0x7fae3406a500 msgr2=0x7fae3406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:53.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae3a5c0640 1 -- 172.21.15.132:0/1934205514 shutdown_connections 2023-11-18T20:38:53.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.888+0000 7fae3a5c0640 1 -- 172.21.15.132:0/1934205514 wait complete. 2023-11-18T20:38:53.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.890+0000 7fae3a5c0640 1 Processor -- start 2023-11-18T20:38:53.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.890+0000 7fae3a5c0640 1 -- start start 2023-11-18T20:38:53.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae3a5c0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3406d0a0 0x7fae340a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:53.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae3a5c0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340c3ea0 0x7fae340bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:53.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae3a5c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae340a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae3a5c0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341ea3a0 con 0x7fae3414fd30 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae3a5c0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341ea640 con 0x7fae340c3ea0 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae3a5c0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae341ea920 con 0x7fae3406d0a0 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae38b5d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae340a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae38b5d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae340a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54338/0 (socket says 172.21.15.132:54338) 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.891+0000 7fae38b5d640 1 -- 172.21.15.132:0/2809214843 learned_addr learned my addr 172.21.15.132:0/2809214843 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae2bfff640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340c3ea0 0x7fae340bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae33fff640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3406d0a0 0x7fae340a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae38b5d640 1 -- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3406d0a0 msgr2=0x7fae340a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae38b5d640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3406d0a0 0x7fae340a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae38b5d640 1 -- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340c3ea0 msgr2=0x7fae340bf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:53.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae38b5d640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340c3ea0 0x7fae340bf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae38b5d640 1 -- 172.21.15.132:0/2809214843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009400 con 0x7fae3414fd30 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae33fff640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3406d0a0 0x7fae340a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae2bfff640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340c3ea0 0x7fae340bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae38b5d640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae340a9e30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00b970 tx=0x7fae2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae317fa640 1 -- 172.21.15.132:0/2809214843 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00cb40 con 0x7fae3414fd30 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae317fa640 1 -- 172.21.15.132:0/2809214843 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c00ccc0 con 0x7fae3414fd30 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae317fa640 1 -- 172.21.15.132:0/2809214843 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c014680 con 0x7fae3414fd30 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.892+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae341eac00 con 0x7fae3414fd30 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.893+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae341eb120 con 0x7fae3414fd30 2023-11-18T20:38:53.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.894+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae341eae40 con 0x7fae3414fd30 2023-11-18T20:38:53.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.895+0000 7fae317fa640 1 -- 172.21.15.132:0/2809214843 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae2c01d3b0 con 0x7fae3414fd30 2023-11-18T20:38:53.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.895+0000 7fae317fa640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fae1406ae40 0x7fae1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:53.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.896+0000 7fae317fa640 1 -- 172.21.15.132:0/2809214843 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fae2c089290 con 0x7fae3414fd30 2023-11-18T20:38:53.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.896+0000 7fae33fff640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fae1406ae40 0x7fae1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:53.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.897+0000 7fae33fff640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fae1406ae40 0x7fae1406d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fae24036000 tx=0x7fae24008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:53.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:53.900+0000 7fae317fa640 1 -- 172.21.15.132:0/2809214843 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae341eae40 con 0x7fae3414fd30 2023-11-18T20:38:54.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:54.100+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fae341eae40 con 0x7fae3414fd30 2023-11-18T20:38:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.322+0000 7fae317fa640 1 -- 172.21.15.132:0/2809214843 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7fae341eae40 con 0x7fae3414fd30 2023-11-18T20:38:55.324 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-11-18T20:38:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fae1406ae40 msgr2=0x7fae1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fae1406ae40 0x7fae1406d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fae24036000 tx=0x7fae24008030 comp rx=0 tx=0).stop 2023-11-18T20:38:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 msgr2=0x7fae340a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae340a9e30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00b970 tx=0x7fae2c00be30 comp rx=0 tx=0).stop 2023-11-18T20:38:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 shutdown_connections 2023-11-18T20:38:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fae1406ae40 0x7fae1406d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3414fd30 0x7fae340a9e30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340c3ea0 0x7fae340bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 --2- 172.21.15.132:0/2809214843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae3406d0a0 0x7fae340a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 >> 172.21.15.132:0/2809214843 conn(0x7fae3406a500 msgr2=0x7fae34152b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 shutdown_connections 2023-11-18T20:38:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.326+0000 7fae3a5c0640 1 -- 172.21.15.132:0/2809214843 wait complete. 2023-11-18T20:38:55.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-18T20:38:55.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:38:55.487 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:38:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.551+0000 7f3623261640 1 Processor -- start 2023-11-18T20:38:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.551+0000 7f3623261640 1 -- start start 2023-11-18T20:38:55.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.552+0000 7f3623261640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f361c14fd30 0x7f361c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:55.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.552+0000 7f3623261640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0c64a0 con 0x7f361c0c3ea0 2023-11-18T20:38:55.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.552+0000 7f3623261640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0c5c00 con 0x7f361c06d0a0 2023-11-18T20:38:55.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.552+0000 7f3623261640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c0c5ee0 con 0x7f361c14fd30 2023-11-18T20:38:55.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.552+0000 7f36217fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f361c0c3ea0 0x7f361c0c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52906/0 (socket says 172.21.15.132:52906) 2023-11-18T20:38:55.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f36217fe640 1 -- 172.21.15.132:0/2138011449 learned_addr learned my addr 172.21.15.132:0/2138011449 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:55.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f3620ffd640 1 --2- 172.21.15.132:0/2138011449 >> v2:172.21.15.161:3300/0 conn(0x7f361c14fd30 0x7f361c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f361b7fe640 1 -- 172.21.15.132:0/2138011449 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397088052 0 0) 0x7f361c0c64a0 con 0x7f361c0c3ea0 2023-11-18T20:38:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f361b7fe640 1 -- 172.21.15.132:0/2138011449 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f360c003520 con 0x7f361c0c3ea0 2023-11-18T20:38:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f361b7fe640 1 -- 172.21.15.132:0/2138011449 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781980612 0 0) 0x7f361c0c5c00 con 0x7f361c06d0a0 2023-11-18T20:38:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f361b7fe640 1 -- 172.21.15.132:0/2138011449 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f361c0c64a0 con 0x7f361c06d0a0 2023-11-18T20:38:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f3620ffd640 1 -- 172.21.15.132:0/2138011449 >> v1:172.21.15.161:6789/0 conn(0x7f361c06d0a0 legacy=0x7f361c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f3620ffd640 1 -- 172.21.15.132:0/2138011449 >> v1:172.21.15.132:6789/0 conn(0x7f361c0c3ea0 legacy=0x7f361c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f361b7fe640 1 -- 172.21.15.132:0/2138011449 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1582822048 0 0) 0x7f360c003520 con 0x7f361c0c3ea0 2023-11-18T20:38:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.553+0000 7f3620ffd640 1 -- 172.21.15.132:0/2138011449 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0c61c0 con 0x7f361c14fd30 2023-11-18T20:38:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.555+0000 7f3620ffd640 1 --2- 172.21.15.132:0/2138011449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c14fd30 0x7f361c152f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f36100097a0 tx=0x7f361002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f11b41c3248b94d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.555+0000 7f361b7fe640 1 -- 172.21.15.132:0/2138011449 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361002f050 con 0x7f361c14fd30 2023-11-18T20:38:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.555+0000 7f361b7fe640 1 -- 172.21.15.132:0/2138011449 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3610031500 con 0x7f361c14fd30 2023-11-18T20:38:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.555+0000 7f361b7fe640 1 -- 172.21.15.132:0/2138011449 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140019f0 con 0x7f361c14fd30 2023-11-18T20:38:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.556+0000 7f3623261640 1 -- 172.21.15.132:0/2138011449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c14fd30 msgr2=0x7f361c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.556+0000 7f3623261640 1 --2- 172.21.15.132:0/2138011449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c14fd30 0x7f361c152f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f36100097a0 tx=0x7f361002b820 comp rx=0 tx=0).stop 2023-11-18T20:38:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.556+0000 7f3623261640 1 -- 172.21.15.132:0/2138011449 shutdown_connections 2023-11-18T20:38:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.556+0000 7f3623261640 1 --2- 172.21.15.132:0/2138011449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c14fd30 0x7f361c152f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.556+0000 7f3623261640 1 -- 172.21.15.132:0/2138011449 >> 172.21.15.132:0/2138011449 conn(0x7f361c06a500 msgr2=0x7f361c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.556+0000 7f3623261640 1 -- 172.21.15.132:0/2138011449 shutdown_connections 2023-11-18T20:38:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.556+0000 7f3623261640 1 -- 172.21.15.132:0/2138011449 wait complete. 2023-11-18T20:38:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.558+0000 7f3623261640 1 Processor -- start 2023-11-18T20:38:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.558+0000 7f3623261640 1 -- start start 2023-11-18T20:38:55.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f3623261640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f361c06d0a0 0x7f361c14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:55.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f3623261640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c0c3ea0 0x7f361c0bf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:55.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f3623261640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f361c14fd30 0x7f361c155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:55.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f3623261640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1e9160 con 0x7f361c14fd30 2023-11-18T20:38:55.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f3623261640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1e83a0 con 0x7f361c0c3ea0 2023-11-18T20:38:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f3623261640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1e8680 con 0x7f361c06d0a0 2023-11-18T20:38:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f36217fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f361c14fd30 0x7f361c155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f36217fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f361c14fd30 0x7f361c155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54350/0 (socket says 172.21.15.132:54350) 2023-11-18T20:38:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f36217fe640 1 -- 172.21.15.132:0/429153864 learned_addr learned my addr 172.21.15.132:0/429153864 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f3620ffd640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f361c06d0a0 0x7f361c14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.559+0000 7f361bfff640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c0c3ea0 0x7f361c0bf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36217fe640 1 -- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f361c06d0a0 msgr2=0x7f361c14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36217fe640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f361c06d0a0 0x7f361c14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36217fe640 1 -- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c0c3ea0 msgr2=0x7f361c0bf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36217fe640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c0c3ea0 0x7f361c0bf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36217fe640 1 -- 172.21.15.132:0/429153864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610009400 con 0x7f361c14fd30 2023-11-18T20:38:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36217fe640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f361c14fd30 0x7f361c155a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3614001f40 tx=0x7f361400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36197fa640 1 -- 172.21.15.132:0/429153864 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614012400 con 0x7f361c14fd30 2023-11-18T20:38:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36197fa640 1 -- 172.21.15.132:0/429153864 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614012580 con 0x7f361c14fd30 2023-11-18T20:38:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f36197fa640 1 -- 172.21.15.132:0/429153864 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614012930 con 0x7f361c14fd30 2023-11-18T20:38:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c1e8960 con 0x7f361c14fd30 2023-11-18T20:38:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.560+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c14f100 con 0x7f361c14fd30 2023-11-18T20:38:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.562+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c1e8e80 con 0x7f361c14fd30 2023-11-18T20:38:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.563+0000 7f36197fa640 1 -- 172.21.15.132:0/429153864 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3614012a90 con 0x7f361c14fd30 2023-11-18T20:38:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.564+0000 7f36197fa640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f360006ae40 0x7f360006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.564+0000 7f36197fa640 1 -- 172.21.15.132:0/429153864 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3614089950 con 0x7f361c14fd30 2023-11-18T20:38:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.564+0000 7f3620ffd640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f360006ae40 0x7f360006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.565+0000 7f3620ffd640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f360006ae40 0x7f360006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3610035000 tx=0x7f3610008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:55.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.568+0000 7f36197fa640 1 -- 172.21.15.132:0/429153864 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f361c1e8e80 con 0x7f361c14fd30 2023-11-18T20:38:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.831+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f361c1e8e80 con 0x7f361c14fd30 2023-11-18T20:38:55.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.833+0000 7f36197fa640 1 -- 172.21.15.132:0/429153864 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f361c1e8e80 con 0x7f361c14fd30 2023-11-18T20:38:55.834 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:55.834 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:38:55.834 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-11-18T20:38:55.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.834 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-11-18T20:38:55.834 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFll67UuNhAAzMjJzHfHuMEnOrySo5rWkg==", 2023-11-18T20:38:55.834 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.834 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllppoxHBAAFb6gynzzJK+cDc3jFhAACg==", 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:38:55.835 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllLcurChAAvi5HiMzmlupLAkYw675TeQ==", 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllGen8LBAAHV9S4/oQnKEkxUg+grOguA==", 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-11-18T20:38:55.837 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBwIFlloVfzAhAAR8uyp9rDYiQV+BhFjIuJvA==", 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBzIFlloNl8DhAAkyClLe7G9fDXgg+zgwNkWw==", 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:38:55.838 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB2IFllDcRbJhAA6+fYI8hcxWhHNSpkw9vg0g==", 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB5IFllOnBaMRAAvOwUIZn1Jt2tAoDiRC6Gqw==", 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCAIFll5itZMBAASs5GAbUqVH0Xlrlqktz9xw==", 2023-11-18T20:38:55.840 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCEIFll5uYKDxAANaYuUAsrCvw1xO9CoKqd/A==", 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCHIFllEZPyGRAASXuTF7aswO1KQfUH3BStpw==", 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.842 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCKIFllDT/tMRAAh3c/95I9x0FMZGXZ//TuWw==", 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllsbdTOxAAP60vfd0AqFNopXTOFb78Tw==", 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.843 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBsIFllrycwCxAAI7OVXj40YLGlQ4/hWY+mTA==", 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-11-18T20:38:55.844 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBpIFllbT/WKBAAWaMN0vZkyb+SLPB29x0inw==", 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mds", 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCTIFllmHE5HRAA+PuOZkqKWoMZFGzGazTLlw==", 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mds" 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mgr", 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCTIFlloZI5HRAAUjQkcT4y54a5aCrEeBGLbw==", 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-18T20:38:55.846 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-osd", 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCTIFllNqs5HRAA/lUyEP+uunJB5DREuF2M6Q==", 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-osd" 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd", 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCTIFllT8M5HRAABMrbNY1E5zzC8cQej2FHNQ==", 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.847 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCTIFll1Ns5HRAA1BjYgBKLbQdL7Bvlopbgeg==", 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rgw", 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCTIFllRfQ5HRAAh/ayDiLI3n7AYjpP941NoQ==", 2023-11-18T20:38:55.848 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFllWW9dKhAAdaq1Wp1/FeVlv9IGXn6EhQ==", 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:38:55.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFllBY6bHRAApFJ5PvprGpoejUSSP7+hHw==", 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-11-18T20:38:55.850 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:38:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.835+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f360006ae40 msgr2=0x7f360006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.835+0000 7f3623261640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f360006ae40 0x7f360006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3610035000 tx=0x7f3610008030 comp rx=0 tx=0).stop 2023-11-18T20:38:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.835+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f361c14fd30 msgr2=0x7f361c155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.835+0000 7f3623261640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f361c14fd30 0x7f361c155a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3614001f40 tx=0x7f361400a430 comp rx=0 tx=0).stop 2023-11-18T20:38:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.836+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 shutdown_connections 2023-11-18T20:38:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.836+0000 7f3623261640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f360006ae40 0x7f360006d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.836+0000 7f3623261640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f361c14fd30 0x7f361c155a30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.836+0000 7f3623261640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f361c0c3ea0 0x7f361c0bf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.836+0000 7f3623261640 1 --2- 172.21.15.132:0/429153864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f361c06d0a0 0x7f361c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.836+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 >> 172.21.15.132:0/429153864 conn(0x7f361c06a500 msgr2=0x7f361c0c2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.836+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 shutdown_connections 2023-11-18T20:38:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:55.836+0000 7f3623261640 1 -- 172.21.15.132:0/429153864 wait complete. 2023-11-18T20:38:55.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-18T20:38:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.065+0000 7fea1f30f640 1 Processor -- start 2023-11-18T20:38:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.066+0000 7fea1f30f640 1 -- start start 2023-11-18T20:38:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1f30f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180c5ec0 0x7fea180c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1f30f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fea180c45d0 0x7fea180c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1f30f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fea180721a0 0x7fea18155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1f30f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1806e390 con 0x7fea180c45d0 2023-11-18T20:38:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1f30f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180bfdc0 con 0x7fea180721a0 2023-11-18T20:38:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1f30f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1806ddd0 con 0x7fea180c5ec0 2023-11-18T20:38:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1c8aa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fea180c45d0 0x7fea180c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1c8aa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fea180c45d0 0x7fea180c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54362/0 (socket says 172.21.15.132:54362) 2023-11-18T20:38:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.067+0000 7fea1c8aa640 1 -- 172.21.15.132:0/2214596556 learned_addr learned my addr 172.21.15.132:0/2214596556 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1d0ab640 1 --2- 172.21.15.132:0/2214596556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180c5ec0 0x7fea180c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1d8ac640 1 --2- 172.21.15.132:0/2214596556 >> v2:172.21.15.161:3300/0 conn(0x7fea180721a0 0x7fea18155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1c8aa640 1 -- 172.21.15.132:0/2214596556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180c5ec0 msgr2=0x7fea180c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1c8aa640 1 --2- 172.21.15.132:0/2214596556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180c5ec0 0x7fea180c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1c8aa640 1 -- 172.21.15.132:0/2214596556 >> v2:172.21.15.161:3300/0 conn(0x7fea180721a0 msgr2=0x7fea18155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1c8aa640 1 --2- 172.21.15.132:0/2214596556 >> v2:172.21.15.161:3300/0 conn(0x7fea180721a0 0x7fea18155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1c8aa640 1 -- 172.21.15.132:0/2214596556 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1806e0b0 con 0x7fea180c45d0 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1d8ac640 1 --2- 172.21.15.132:0/2214596556 >> v2:172.21.15.161:3300/0 conn(0x7fea180721a0 0x7fea18155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.068+0000 7fea1d0ab640 1 --2- 172.21.15.132:0/2214596556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180c5ec0 0x7fea180c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.069+0000 7fea1c8aa640 1 --2- 172.21.15.132:0/2214596556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c45d0 0x7fea180c3170 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fea08009870 tx=0x7fea0802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bff3f55d532014a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.069+0000 7fea0ffff640 1 -- 172.21.15.132:0/2214596556 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08031740 con 0x7fea180c45d0 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.069+0000 7fea0ffff640 1 -- 172.21.15.132:0/2214596556 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea080318a0 con 0x7fea180c45d0 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.069+0000 7fea0ffff640 1 -- 172.21.15.132:0/2214596556 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08031c30 con 0x7fea180c45d0 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 -- 172.21.15.132:0/2214596556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c45d0 msgr2=0x7fea180c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 --2- 172.21.15.132:0/2214596556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c45d0 0x7fea180c3170 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fea08009870 tx=0x7fea0802b7e0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 -- 172.21.15.132:0/2214596556 shutdown_connections 2023-11-18T20:38:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 --2- 172.21.15.132:0/2214596556 >> v2:172.21.15.161:3300/0 conn(0x7fea180721a0 0x7fea18155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 --2- 172.21.15.132:0/2214596556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c45d0 0x7fea180c3170 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 --2- 172.21.15.132:0/2214596556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180c5ec0 0x7fea180c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 -- 172.21.15.132:0/2214596556 >> 172.21.15.132:0/2214596556 conn(0x7fea1806a500 msgr2=0x7fea1806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 -- 172.21.15.132:0/2214596556 shutdown_connections 2023-11-18T20:38:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.070+0000 7fea1f30f640 1 -- 172.21.15.132:0/2214596556 wait complete. 2023-11-18T20:38:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.072+0000 7fea1f30f640 1 Processor -- start 2023-11-18T20:38:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.072+0000 7fea1f30f640 1 -- start start 2023-11-18T20:38:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1f30f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180721a0 0x7fea180a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1f30f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea180c45d0 0x7fea181ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1f30f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c5ec0 0x7fea181ed280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1f30f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180a6250 con 0x7fea180c5ec0 2023-11-18T20:38:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1f30f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1814e640 con 0x7fea180c45d0 2023-11-18T20:38:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1f30f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea181582c0 con 0x7fea180721a0 2023-11-18T20:38:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1d8ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c5ec0 0x7fea181ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1d8ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c5ec0 0x7fea181ed280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54370/0 (socket says 172.21.15.132:54370) 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.073+0000 7fea1d8ac640 1 -- 172.21.15.132:0/844505789 learned_addr learned my addr 172.21.15.132:0/844505789 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1d0ab640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180721a0 0x7fea180a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1c8aa640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea180c45d0 0x7fea181ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1d8ac640 1 -- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180721a0 msgr2=0x7fea180a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1d8ac640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180721a0 0x7fea180a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1d8ac640 1 -- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea180c45d0 msgr2=0x7fea181ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1d8ac640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea180c45d0 0x7fea181ecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1d8ac640 1 -- 172.21.15.132:0/844505789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080094d0 con 0x7fea180c5ec0 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1c8aa640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea180c45d0 0x7fea181ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1d8ac640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c5ec0 0x7fea181ed280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fea1000cd10 tx=0x7fea1000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea0dffb640 1 -- 172.21.15.132:0/844505789 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000f680 con 0x7fea180c5ec0 2023-11-18T20:38:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea0dffb640 1 -- 172.21.15.132:0/844505789 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000f800 con 0x7fea180c5ec0 2023-11-18T20:38:56.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea0dffb640 1 -- 172.21.15.132:0/844505789 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000fbb0 con 0x7fea180c5ec0 2023-11-18T20:38:56.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.074+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180a7af0 con 0x7fea180c5ec0 2023-11-18T20:38:56.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.075+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea180a7d40 con 0x7fea180c5ec0 2023-11-18T20:38:56.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.075+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea180c1e80 con 0x7fea180c5ec0 2023-11-18T20:38:56.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.076+0000 7fea0dffb640 1 -- 172.21.15.132:0/844505789 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea1000b040 con 0x7fea180c5ec0 2023-11-18T20:38:56.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.077+0000 7fea0dffb640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe9fc06ae40 0x7fe9fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.077+0000 7fea0dffb640 1 -- 172.21.15.132:0/844505789 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea10089c90 con 0x7fea180c5ec0 2023-11-18T20:38:56.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.078+0000 7fea1d0ab640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe9fc06ae40 0x7fe9fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.079+0000 7fea1d0ab640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe9fc06ae40 0x7fe9fc06d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea181ede00 tx=0x7fea14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.081+0000 7fea0dffb640 1 -- 172.21.15.132:0/844505789 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea10055080 con 0x7fea180c5ec0 2023-11-18T20:38:56.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.319+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fea18158470 con 0x7fea180c5ec0 2023-11-18T20:38:56.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.322+0000 7fea0dffb640 1 -- 172.21.15.132:0/844505789 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fea18158470 con 0x7fea180c5ec0 2023-11-18T20:38:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe9fc06ae40 msgr2=0x7fe9fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe9fc06ae40 0x7fe9fc06d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea181ede00 tx=0x7fea14008040 comp rx=0 tx=0).stop 2023-11-18T20:38:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c5ec0 msgr2=0x7fea181ed280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c5ec0 0x7fea181ed280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fea1000cd10 tx=0x7fea1000a650 comp rx=0 tx=0).stop 2023-11-18T20:38:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 shutdown_connections 2023-11-18T20:38:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe9fc06ae40 0x7fe9fc06d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea180c5ec0 0x7fea181ed280 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea180c45d0 0x7fea181ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 --2- 172.21.15.132:0/844505789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea180721a0 0x7fea180a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 >> 172.21.15.132:0/844505789 conn(0x7fea1806a500 msgr2=0x7fea180c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 shutdown_connections 2023-11-18T20:38:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.325+0000 7fea1f30f640 1 -- 172.21.15.132:0/844505789 wait complete. 2023-11-18T20:38:56.343 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-18T20:38:56.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.550+0000 7f33856b4640 1 Processor -- start 2023-11-18T20:38:56.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.550+0000 7f33856b4640 1 -- start start 2023-11-18T20:38:56.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f33856b4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33800c5ec0 0x7f33800c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f33856b4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800c45d0 0x7f33800c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f33856b4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33800bfdc0 con 0x7f33800721a0 2023-11-18T20:38:56.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f33856b4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338006e390 con 0x7f33800c5ec0 2023-11-18T20:38:56.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f33856b4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338006ddd0 con 0x7f33800c45d0 2023-11-18T20:38:56.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f337effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33800c5ec0 0x7f33800c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f337effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33800c5ec0 0x7f33800c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54376/0 (socket says 172.21.15.132:54376) 2023-11-18T20:38:56.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f337f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f33800721a0 0x7f3380155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52912/0 (socket says 172.21.15.132:52912) 2023-11-18T20:38:56.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.552+0000 7f337effd640 1 -- 172.21.15.132:0/1852992341 learned_addr learned my addr 172.21.15.132:0/1852992341 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:56.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.553+0000 7f337effd640 1 -- 172.21.15.132:0/1852992341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800c45d0 msgr2=0x7f33800c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:56.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.553+0000 7f337effd640 1 --2- 172.21.15.132:0/1852992341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800c45d0 0x7f33800c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.553+0000 7f337effd640 1 -- 172.21.15.132:0/1852992341 >> v1:172.21.15.132:6789/0 conn(0x7f33800721a0 legacy=0x7f3380155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.553+0000 7f337effd640 1 -- 172.21.15.132:0/1852992341 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338006e0b0 con 0x7f33800c5ec0 2023-11-18T20:38:56.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.554+0000 7f337effd640 1 --2- 172.21.15.132:0/1852992341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f33800c2c30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3370009870 tx=0x7f337002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89018dc16628e19 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:56.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.554+0000 7f337e7fc640 1 -- 172.21.15.132:0/1852992341 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33700317c0 con 0x7f33800c5ec0 2023-11-18T20:38:56.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.554+0000 7f337e7fc640 1 -- 172.21.15.132:0/1852992341 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3370031920 con 0x7f33800c5ec0 2023-11-18T20:38:56.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.554+0000 7f337e7fc640 1 -- 172.21.15.132:0/1852992341 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370031cb0 con 0x7f33800c5ec0 2023-11-18T20:38:56.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.555+0000 7f33856b4640 1 -- 172.21.15.132:0/1852992341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 msgr2=0x7f33800c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.555+0000 7f33856b4640 1 --2- 172.21.15.132:0/1852992341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f33800c2c30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3370009870 tx=0x7f337002b860 comp rx=0 tx=0).stop 2023-11-18T20:38:56.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.555+0000 7f33856b4640 1 -- 172.21.15.132:0/1852992341 shutdown_connections 2023-11-18T20:38:56.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.555+0000 7f33856b4640 1 --2- 172.21.15.132:0/1852992341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800c45d0 0x7f33800c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.555+0000 7f33856b4640 1 --2- 172.21.15.132:0/1852992341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f33800c2c30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.555+0000 7f33856b4640 1 -- 172.21.15.132:0/1852992341 >> 172.21.15.132:0/1852992341 conn(0x7f338006a500 msgr2=0x7f338006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:56.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.555+0000 7f33856b4640 1 -- 172.21.15.132:0/1852992341 shutdown_connections 2023-11-18T20:38:56.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.555+0000 7f33856b4640 1 -- 172.21.15.132:0/1852992341 wait complete. 2023-11-18T20:38:56.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.556+0000 7f33856b4640 1 Processor -- start 2023-11-18T20:38:56.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.557+0000 7f33856b4640 1 -- start start 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.557+0000 7f33856b4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800721a0 0x7f33801eb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.557+0000 7f33856b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33800c45d0 0x7f33801eb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.557+0000 7f33856b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f3380149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.557+0000 7f33856b4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338014b2a0 con 0x7f33800c5ec0 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.557+0000 7f33856b4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33801560b0 con 0x7f33800c45d0 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.557+0000 7f33856b4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33800a7650 con 0x7f33800721a0 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f3380149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f3380149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54378/0 (socket says 172.21.15.132:54378) 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 -- 172.21.15.132:0/2995618905 learned_addr learned my addr 172.21.15.132:0/2995618905 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:56.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337effd640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800721a0 0x7f33801eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f3377fff640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33800c45d0 0x7f33801eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 -- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800721a0 msgr2=0x7f33801eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800721a0 0x7f33801eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 -- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33800c45d0 msgr2=0x7f33801eb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33800c45d0 0x7f33801eb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 -- 172.21.15.132:0/2995618905 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700094d0 con 0x7f33800c5ec0 2023-11-18T20:38:56.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.558+0000 7f337f7fe640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f3380149fb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f337800c7b0 tx=0x7f337800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:56.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.559+0000 7f33777fe640 1 -- 172.21.15.132:0/2995618905 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800a640 con 0x7f33800c5ec0 2023-11-18T20:38:56.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.559+0000 7f33777fe640 1 -- 172.21.15.132:0/2995618905 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337800a7a0 con 0x7f33800c5ec0 2023-11-18T20:38:56.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.559+0000 7f33777fe640 1 -- 172.21.15.132:0/2995618905 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800ab10 con 0x7f33800c5ec0 2023-11-18T20:38:56.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.559+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3380155dd0 con 0x7f33800c5ec0 2023-11-18T20:38:56.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.559+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33800a7bd0 con 0x7f33800c5ec0 2023-11-18T20:38:56.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.560+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33800a74b0 con 0x7f33800c5ec0 2023-11-18T20:38:56.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.561+0000 7f33777fe640 1 -- 172.21.15.132:0/2995618905 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f337800ac70 con 0x7f33800c5ec0 2023-11-18T20:38:56.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.562+0000 7f33777fe640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f336006ae40 0x7f336006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:56.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.562+0000 7f33777fe640 1 -- 172.21.15.132:0/2995618905 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33780889b0 con 0x7f33800c5ec0 2023-11-18T20:38:56.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.563+0000 7f337effd640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f336006ae40 0x7f336006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:56.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.564+0000 7f337effd640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f336006ae40 0x7f336006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3370036000 tx=0x7f337003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:56.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.566+0000 7f33777fe640 1 -- 172.21.15.132:0/2995618905 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33800a74b0 con 0x7f33800c5ec0 2023-11-18T20:38:56.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.828+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f33800a74b0 con 0x7f33800c5ec0 2023-11-18T20:38:56.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.833+0000 7f33777fe640 1 -- 172.21.15.132:0/2995618905 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f33800a74b0 con 0x7f33800c5ec0 2023-11-18T20:38:56.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f336006ae40 msgr2=0x7f336006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f336006ae40 0x7f336006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3370036000 tx=0x7f337003d040 comp rx=0 tx=0).stop 2023-11-18T20:38:56.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 msgr2=0x7f3380149fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:56.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f3380149fb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f337800c7b0 tx=0x7f337800cc70 comp rx=0 tx=0).stop 2023-11-18T20:38:56.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 shutdown_connections 2023-11-18T20:38:56.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f336006ae40 0x7f336006d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33800c5ec0 0x7f3380149fb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33800c45d0 0x7f33801eb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 --2- 172.21.15.132:0/2995618905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33800721a0 0x7f33801eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:56.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 >> 172.21.15.132:0/2995618905 conn(0x7f338006a500 msgr2=0x7f3380070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:56.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 shutdown_connections 2023-11-18T20:38:56.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:56.836+0000 7f33856b4640 1 -- 172.21.15.132:0/2995618905 wait complete. 2023-11-18T20:38:56.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-18T20:38:57.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.051+0000 7f749f1a5640 1 Processor -- start 2023-11-18T20:38:57.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.051+0000 7f749f1a5640 1 -- start start 2023-11-18T20:38:57.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.052+0000 7f749f1a5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f749814fd30 0x7f7498152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.052+0000 7f749f1a5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74980c64a0 con 0x7f749806d0a0 2023-11-18T20:38:57.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.052+0000 7f749f1a5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74980c5c00 con 0x7f74980c3ea0 2023-11-18T20:38:57.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.052+0000 7f749f1a5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74980c5ee0 con 0x7f749814fd30 2023-11-18T20:38:57.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.053+0000 7f7497fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f749806d0a0 0x7f74980a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52926/0 (socket says 172.21.15.132:52926) 2023-11-18T20:38:57.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.053+0000 7f7497fff640 1 -- 172.21.15.132:0/3591291049 learned_addr learned my addr 172.21.15.132:0/3591291049 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:57.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.053+0000 7f749cf41640 1 --2- 172.21.15.132:0/3591291049 >> v2:172.21.15.132:3300/0 conn(0x7f749814fd30 0x7f7498152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:57.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.053+0000 7f74977fe640 1 -- 172.21.15.132:0/3591291049 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299014336 0 0) 0x7f74980c64a0 con 0x7f749806d0a0 2023-11-18T20:38:57.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.053+0000 7f74977fe640 1 -- 172.21.15.132:0/3591291049 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7488003520 con 0x7f749806d0a0 2023-11-18T20:38:57.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.053+0000 7f749cf41640 1 -- 172.21.15.132:0/3591291049 >> v1:172.21.15.161:6789/0 conn(0x7f74980c3ea0 legacy=0x7f74980c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:57.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.053+0000 7f749cf41640 1 -- 172.21.15.132:0/3591291049 >> v1:172.21.15.132:6789/0 conn(0x7f749806d0a0 legacy=0x7f74980a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.053+0000 7f749cf41640 1 -- 172.21.15.132:0/3591291049 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74980c61c0 con 0x7f749814fd30 2023-11-18T20:38:57.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.055+0000 7f749cf41640 1 --2- 172.21.15.132:0/3591291049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f7498152f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f748c0097a0 tx=0x7f748c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21e00e0b722dc78 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:57.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.055+0000 7f74977fe640 1 -- 172.21.15.132:0/3591291049 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c031830 con 0x7f749814fd30 2023-11-18T20:38:57.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.055+0000 7f74977fe640 1 -- 172.21.15.132:0/3591291049 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c031990 con 0x7f749814fd30 2023-11-18T20:38:57.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.055+0000 7f74977fe640 1 -- 172.21.15.132:0/3591291049 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c031d20 con 0x7f749814fd30 2023-11-18T20:38:57.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.056+0000 7f749f1a5640 1 -- 172.21.15.132:0/3591291049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 msgr2=0x7f7498152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.056+0000 7f749f1a5640 1 --2- 172.21.15.132:0/3591291049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f7498152f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f748c0097a0 tx=0x7f748c02b8d0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.056+0000 7f749f1a5640 1 -- 172.21.15.132:0/3591291049 shutdown_connections 2023-11-18T20:38:57.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.056+0000 7f749f1a5640 1 --2- 172.21.15.132:0/3591291049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f7498152f20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.056+0000 7f749f1a5640 1 -- 172.21.15.132:0/3591291049 >> 172.21.15.132:0/3591291049 conn(0x7f749806a500 msgr2=0x7f749806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:57.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.056+0000 7f749f1a5640 1 -- 172.21.15.132:0/3591291049 shutdown_connections 2023-11-18T20:38:57.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.056+0000 7f749f1a5640 1 -- 172.21.15.132:0/3591291049 wait complete. 2023-11-18T20:38:57.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.058+0000 7f749f1a5640 1 Processor -- start 2023-11-18T20:38:57.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.058+0000 7f749f1a5640 1 -- start start 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749f1a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f749806d0a0 0x7f74980a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749f1a5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74980c3ea0 0x7f74981dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749f1a5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f74981dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749f1a5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7498150360 con 0x7f749814fd30 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749f1a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74981505b0 con 0x7f749806d0a0 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749f1a5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7498150890 con 0x7f74980c3ea0 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749d742640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f74981dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749d742640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f74981dd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54390/0 (socket says 172.21.15.132:54390) 2023-11-18T20:38:57.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749d742640 1 -- 172.21.15.132:0/2332379212 learned_addr learned my addr 172.21.15.132:0/2332379212 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:57.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749d742640 1 -- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74980c3ea0 msgr2=0x7f74981dd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749d742640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74980c3ea0 0x7f74981dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749d742640 1 -- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f749806d0a0 msgr2=0x7f74980a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749d742640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f749806d0a0 0x7f74980a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.059+0000 7f749d742640 1 -- 172.21.15.132:0/2332379212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c009400 con 0x7f749814fd30 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.060+0000 7f749d742640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f74981dd7f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f749000c780 tx=0x7f749000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.060+0000 7f74957fa640 1 -- 172.21.15.132:0/2332379212 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490004b60 con 0x7f749814fd30 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.060+0000 7f74957fa640 1 -- 172.21.15.132:0/2332379212 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000ce90 con 0x7f749814fd30 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.060+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7498150b70 con 0x7f749814fd30 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.060+0000 7f74957fa640 1 -- 172.21.15.132:0/2332379212 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000a850 con 0x7f749814fd30 2023-11-18T20:38:57.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.060+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7498151130 con 0x7f749814fd30 2023-11-18T20:38:57.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.061+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7498151350 con 0x7f749814fd30 2023-11-18T20:38:57.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.062+0000 7f74957fa640 1 -- 172.21.15.132:0/2332379212 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f749000a9b0 con 0x7f749814fd30 2023-11-18T20:38:57.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.063+0000 7f74957fa640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f747c06ae70 0x7f747c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.063+0000 7f74957fa640 1 -- 172.21.15.132:0/2332379212 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7490089400 con 0x7f749814fd30 2023-11-18T20:38:57.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.063+0000 7f749cf41640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f747c06ae70 0x7f747c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:57.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.064+0000 7f749cf41640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f747c06ae70 0x7f747c06d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f748c036000 tx=0x7f748c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:57.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.067+0000 7f74957fa640 1 -- 172.21.15.132:0/2332379212 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74900547f0 con 0x7f749814fd30 2023-11-18T20:38:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.309+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7498068350 con 0x7f749814fd30 2023-11-18T20:38:57.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.313+0000 7f74957fa640 1 -- 172.21.15.132:0/2332379212 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7490057e10 con 0x7f749814fd30 2023-11-18T20:38:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.315+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f747c06ae70 msgr2=0x7f747c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.315+0000 7f749f1a5640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f747c06ae70 0x7f747c06d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f748c036000 tx=0x7f748c030000 comp rx=0 tx=0).stop 2023-11-18T20:38:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.315+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 msgr2=0x7f74981dd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.315+0000 7f749f1a5640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f74981dd7f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f749000c780 tx=0x7f749000cc40 comp rx=0 tx=0).stop 2023-11-18T20:38:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.316+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 shutdown_connections 2023-11-18T20:38:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.316+0000 7f749f1a5640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f747c06ae70 0x7f747c06d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.316+0000 7f749f1a5640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f749814fd30 0x7f74981dd7f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.316+0000 7f749f1a5640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74980c3ea0 0x7f74981dd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.316+0000 7f749f1a5640 1 --2- 172.21.15.132:0/2332379212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f749806d0a0 0x7f74980a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.316+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 >> 172.21.15.132:0/2332379212 conn(0x7f749806a500 msgr2=0x7f749806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:57.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.316+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 shutdown_connections 2023-11-18T20:38:57.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.316+0000 7f749f1a5640 1 -- 172.21.15.132:0/2332379212 wait complete. 2023-11-18T20:38:57.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-18T20:38:57.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.545+0000 7fb8d6bfb640 1 Processor -- start 2023-11-18T20:38:57.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.545+0000 7fb8d6bfb640 1 -- start start 2023-11-18T20:38:57.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.546+0000 7fb8d6bfb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8d014fd30 0x7fb8d0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.546+0000 7fb8d6bfb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 0x7fb8d00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.546+0000 7fb8d6bfb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d00c64a0 con 0x7fb8d006d0a0 2023-11-18T20:38:57.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.546+0000 7fb8d6bfb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d00c5c00 con 0x7fb8d014fd30 2023-11-18T20:38:57.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.546+0000 7fb8d6bfb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00c5ee0 con 0x7fb8d00c3ea0 2023-11-18T20:38:57.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.547+0000 7fb8d4997640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8d014fd30 0x7fb8d0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:57.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.547+0000 7fb8d4997640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8d014fd30 0x7fb8d0152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54396/0 (socket says 172.21.15.132:54396) 2023-11-18T20:38:57.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.547+0000 7fb8d4997640 1 -- 172.21.15.132:0/2809032375 learned_addr learned my addr 172.21.15.132:0/2809032375 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:57.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.547+0000 7fb8d4997640 1 -- 172.21.15.132:0/2809032375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 msgr2=0x7fb8d00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:57.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.547+0000 7fb8d4997640 1 --2- 172.21.15.132:0/2809032375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 0x7fb8d00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.547+0000 7fb8d4997640 1 -- 172.21.15.132:0/2809032375 >> v1:172.21.15.161:6789/0 conn(0x7fb8d006d0a0 legacy=0x7fb8d00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:57.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.547+0000 7fb8d4997640 1 -- 172.21.15.132:0/2809032375 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00c61c0 con 0x7fb8d014fd30 2023-11-18T20:38:57.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.548+0000 7fb8d4997640 1 --2- 172.21.15.132:0/2809032375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d014fd30 0x7fb8d0152f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009870 tx=0x7fb8c402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72db76cd8179c30 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:57.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.548+0000 7fb8cf7fe640 1 -- 172.21.15.132:0/2809032375 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4031640 con 0x7fb8d014fd30 2023-11-18T20:38:57.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8cf7fe640 1 -- 172.21.15.132:0/2809032375 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c40317a0 con 0x7fb8d014fd30 2023-11-18T20:38:57.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8cf7fe640 1 -- 172.21.15.132:0/2809032375 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4031b30 con 0x7fb8d014fd30 2023-11-18T20:38:57.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2809032375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d014fd30 msgr2=0x7fb8d0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2809032375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d014fd30 0x7fb8d0152f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009870 tx=0x7fb8c402b8f0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2809032375 shutdown_connections 2023-11-18T20:38:57.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2809032375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 0x7fb8d00c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2809032375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d014fd30 0x7fb8d0152f20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2809032375 >> 172.21.15.132:0/2809032375 conn(0x7fb8d006a500 msgr2=0x7fb8d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:57.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2809032375 shutdown_connections 2023-11-18T20:38:57.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.549+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2809032375 wait complete. 2023-11-18T20:38:57.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.551+0000 7fb8d6bfb640 1 Processor -- start 2023-11-18T20:38:57.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.551+0000 7fb8d6bfb640 1 -- start start 2023-11-18T20:38:57.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d6bfb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d006d0a0 0x7fb8d00aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d6bfb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 0x7fb8d01ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d6bfb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8d014fd30 0x7fb8d00bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d6bfb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d0154cb0 con 0x7fb8d006d0a0 2023-11-18T20:38:57.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d6bfb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d01eaca0 con 0x7fb8d014fd30 2023-11-18T20:38:57.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d6bfb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d01560a0 con 0x7fb8d00c3ea0 2023-11-18T20:38:57.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d4997640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d006d0a0 0x7fb8d00aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:57.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d4997640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d006d0a0 0x7fb8d00aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54408/0 (socket says 172.21.15.132:54408) 2023-11-18T20:38:57.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.552+0000 7fb8d4997640 1 -- 172.21.15.132:0/2602967460 learned_addr learned my addr 172.21.15.132:0/2602967460 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:57.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8d5198640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8d014fd30 0x7fb8d00bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:57.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8cffff640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 0x7fb8d01ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8d4997640 1 -- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 msgr2=0x7fb8d01ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8d4997640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 0x7fb8d01ea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8d4997640 1 -- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8d014fd30 msgr2=0x7fb8d00bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8d4997640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8d014fd30 0x7fb8d00bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8d4997640 1 -- 172.21.15.132:0/2602967460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40094d0 con 0x7fb8d006d0a0 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8d5198640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8d014fd30 0x7fb8d00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8d4997640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d006d0a0 0x7fb8d00aa800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4000c00 tx=0x7fb8c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.553+0000 7fb8cd7fa640 1 -- 172.21.15.132:0/2602967460 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c403ac60 con 0x7fb8d006d0a0 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.554+0000 7fb8cd7fa640 1 -- 172.21.15.132:0/2602967460 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c403adc0 con 0x7fb8d006d0a0 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.554+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d0156380 con 0x7fb8d006d0a0 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.554+0000 7fb8cd7fa640 1 -- 172.21.15.132:0/2602967460 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4044630 con 0x7fb8d006d0a0 2023-11-18T20:38:57.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.554+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d01edd70 con 0x7fb8d006d0a0 2023-11-18T20:38:57.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.555+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d0068350 con 0x7fb8d006d0a0 2023-11-18T20:38:57.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.556+0000 7fb8cd7fa640 1 -- 172.21.15.132:0/2602967460 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8c402f050 con 0x7fb8d006d0a0 2023-11-18T20:38:57.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.556+0000 7fb8cd7fa640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b406ae40 0x7fb8b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:57.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.557+0000 7fb8cd7fa640 1 -- 172.21.15.132:0/2602967460 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb8c40ab2b0 con 0x7fb8d006d0a0 2023-11-18T20:38:57.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.557+0000 7fb8cffff640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b406ae40 0x7fb8b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:57.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.558+0000 7fb8cffff640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b406ae40 0x7fb8b406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00727a0 tx=0x7fb8bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:57.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.560+0000 7fb8cd7fa640 1 -- 172.21.15.132:0/2602967460 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8c40766a0 con 0x7fb8d006d0a0 2023-11-18T20:38:57.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.820+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb8d00c66d0 con 0x7fb8d006d0a0 2023-11-18T20:38:57.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.825+0000 7fb8cd7fa640 1 -- 172.21.15.132:0/2602967460 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb8c4031e60 con 0x7fb8d006d0a0 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b406ae40 msgr2=0x7fb8b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b406ae40 0x7fb8b406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00727a0 tx=0x7fb8bc008040 comp rx=0 tx=0).stop 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d006d0a0 msgr2=0x7fb8d00aa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d006d0a0 0x7fb8d00aa800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4000c00 tx=0x7fb8c40046c0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 shutdown_connections 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b406ae40 0x7fb8b406d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8d014fd30 0x7fb8d00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8d00c3ea0 0x7fb8d01ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 --2- 172.21.15.132:0/2602967460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d006d0a0 0x7fb8d00aa800 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:57.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.827+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 >> 172.21.15.132:0/2602967460 conn(0x7fb8d006a500 msgr2=0x7fb8d00c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:57.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.828+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 shutdown_connections 2023-11-18T20:38:57.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:57.828+0000 7fb8d6bfb640 1 -- 172.21.15.132:0/2602967460 wait complete. 2023-11-18T20:38:57.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-18T20:38:58.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.056+0000 7f693359e640 1 Processor -- start 2023-11-18T20:38:58.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.056+0000 7f693359e640 1 -- start start 2023-11-18T20:38:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.058+0000 7f693359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69340c0440 0x7f69340c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.058+0000 7f693359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 0x7f69340a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.058+0000 7f693359e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6934071e80 con 0x7f693414c2e0 2023-11-18T20:38:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.058+0000 7f693359e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6934071470 con 0x7f69340c0440 2023-11-18T20:38:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.058+0000 7f693359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693414c6c0 con 0x7f6934072310 2023-11-18T20:38:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.058+0000 7f6929d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69340c0440 0x7f69340c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.058+0000 7f6929d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69340c0440 0x7f69340c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54424/0 (socket says 172.21.15.132:54424) 2023-11-18T20:38:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.058+0000 7f6929d9b640 1 -- 172.21.15.132:0/2608482991 learned_addr learned my addr 172.21.15.132:0/2608482991 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.059+0000 7f6932d9d640 1 --2- 172.21.15.132:0/2608482991 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 0x7f69340a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.059+0000 7f6929d9b640 1 -- 172.21.15.132:0/2608482991 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 msgr2=0x7f69340a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.059+0000 7f6929d9b640 1 --2- 172.21.15.132:0/2608482991 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 0x7f69340a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.059+0000 7f6929d9b640 1 -- 172.21.15.132:0/2608482991 >> v1:172.21.15.161:6789/0 conn(0x7f693414c2e0 legacy=0x7f6934152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:58.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.059+0000 7f6929d9b640 1 -- 172.21.15.132:0/2608482991 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693406fdc0 con 0x7f69340c0440 2023-11-18T20:38:58.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.060+0000 7f6929d9b640 1 --2- 172.21.15.132:0/2608482991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69340c0440 0x7f69340c0c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f691c009870 tx=0x7f691c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bef0d7866feeca3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:58.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.060+0000 7f6931d9b640 1 -- 172.21.15.132:0/2608482991 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c031740 con 0x7f69340c0440 2023-11-18T20:38:58.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.060+0000 7f6931d9b640 1 -- 172.21.15.132:0/2608482991 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c0318a0 con 0x7f69340c0440 2023-11-18T20:38:58.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.060+0000 7f6931d9b640 1 -- 172.21.15.132:0/2608482991 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c031c30 con 0x7f69340c0440 2023-11-18T20:38:58.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.061+0000 7f693359e640 1 -- 172.21.15.132:0/2608482991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69340c0440 msgr2=0x7f69340c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.061+0000 7f693359e640 1 --2- 172.21.15.132:0/2608482991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69340c0440 0x7f69340c0c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f691c009870 tx=0x7f691c02b7e0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.061+0000 7f693359e640 1 -- 172.21.15.132:0/2608482991 shutdown_connections 2023-11-18T20:38:58.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.061+0000 7f693359e640 1 --2- 172.21.15.132:0/2608482991 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 0x7f69340a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.061+0000 7f693359e640 1 --2- 172.21.15.132:0/2608482991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69340c0440 0x7f69340c0c80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.061+0000 7f693359e640 1 -- 172.21.15.132:0/2608482991 >> 172.21.15.132:0/2608482991 conn(0x7f69340a77f0 msgr2=0x7f69340a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.061+0000 7f693359e640 1 -- 172.21.15.132:0/2608482991 shutdown_connections 2023-11-18T20:38:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.061+0000 7f693359e640 1 -- 172.21.15.132:0/2608482991 wait complete. 2023-11-18T20:38:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.063+0000 7f693359e640 1 Processor -- start 2023-11-18T20:38:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.063+0000 7f693359e640 1 -- start start 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.064+0000 7f693359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 0x7f6934149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.064+0000 7f693359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69340c0440 0x7f69340aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.064+0000 7f693359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f693414c2e0 0x7f69341e8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.064+0000 7f693359e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693414fad0 con 0x7f693414c2e0 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.064+0000 7f693359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6934149670 con 0x7f69340c0440 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.064+0000 7f693359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6934152e30 con 0x7f6934072310 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f693414c2e0 0x7f69341e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f693414c2e0 0x7f69341e8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54438/0 (socket says 172.21.15.132:54438) 2023-11-18T20:38:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 -- 172.21.15.132:0/3410210466 learned_addr learned my addr 172.21.15.132:0/3410210466 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:58.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f693259c640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 0x7f6934149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6929d9b640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69340c0440 0x7f69340aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 -- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 msgr2=0x7f6934149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 0x7f6934149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 -- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69340c0440 msgr2=0x7f69340aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69340c0440 0x7f69340aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 -- 172.21.15.132:0/3410210466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0094d0 con 0x7f693414c2e0 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.065+0000 7f6932d9d640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f693414c2e0 0x7f69341e8180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f692c00cda0 tx=0x7f692c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.066+0000 7f692b7fe640 1 -- 172.21.15.132:0/3410210466 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c003b90 con 0x7f693414c2e0 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.066+0000 7f692b7fe640 1 -- 172.21.15.132:0/3410210466 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c003cf0 con 0x7f693414c2e0 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.066+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693414fd20 con 0x7f693414c2e0 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.066+0000 7f692b7fe640 1 -- 172.21.15.132:0/3410210466 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c004240 con 0x7f693414c2e0 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.066+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69341502e0 con 0x7f693414c2e0 2023-11-18T20:38:58.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.067+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69341504d0 con 0x7f693414c2e0 2023-11-18T20:38:58.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.068+0000 7f692b7fe640 1 -- 172.21.15.132:0/3410210466 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f692c0043a0 con 0x7f693414c2e0 2023-11-18T20:38:58.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.069+0000 7f692b7fe640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f691406ae40 0x7f691406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.070+0000 7f692b7fe640 1 -- 172.21.15.132:0/3410210466 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f692c012070 con 0x7f693414c2e0 2023-11-18T20:38:58.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.070+0000 7f693259c640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f691406ae40 0x7f691406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.071+0000 7f693259c640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f691406ae40 0x7f691406d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6924006fd0 tx=0x7f6924008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:58.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.073+0000 7f692b7fe640 1 -- 172.21.15.132:0/3410210466 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f692c055080 con 0x7f693414c2e0 2023-11-18T20:38:58.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.328+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f693404e840 con 0x7f693414c2e0 2023-11-18T20:38:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.333+0000 7f692b7fe640 1 -- 172.21.15.132:0/3410210466 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f692c0586a0 con 0x7f693414c2e0 2023-11-18T20:38:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f691406ae40 msgr2=0x7f691406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f691406ae40 0x7f691406d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6924006fd0 tx=0x7f6924008040 comp rx=0 tx=0).stop 2023-11-18T20:38:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f693414c2e0 msgr2=0x7f69341e8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f693414c2e0 0x7f69341e8180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f692c00cda0 tx=0x7f692c00a660 comp rx=0 tx=0).stop 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 shutdown_connections 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f691406ae40 0x7f691406d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f693414c2e0 0x7f69341e8180 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69340c0440 0x7f69340aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 --2- 172.21.15.132:0/3410210466 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6934072310 0x7f6934149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 >> 172.21.15.132:0/3410210466 conn(0x7f69340a77f0 msgr2=0x7f693414a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 shutdown_connections 2023-11-18T20:38:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.336+0000 7f693359e640 1 -- 172.21.15.132:0/3410210466 wait complete. 2023-11-18T20:38:58.354 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-18T20:38:58.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.556+0000 7f0099197640 1 Processor -- start 2023-11-18T20:38:58.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.557+0000 7f0099197640 1 -- start start 2023-11-18T20:38:58.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.558+0000 7f0099197640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00940c45d0 0x7f0094155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.558+0000 7f0099197640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c3340 0x7f0094156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.558+0000 7f0099197640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940bfdc0 con 0x7f00940c5ec0 2023-11-18T20:38:58.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.558+0000 7f0099197640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009406e390 con 0x7f00940c45d0 2023-11-18T20:38:58.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.558+0000 7f0099197640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009406ddd0 con 0x7f00940c3340 2023-11-18T20:38:58.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.559+0000 7f008bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00940c45d0 0x7f0094155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.559+0000 7f009359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c3340 0x7f0094156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.559+0000 7f009359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c3340 0x7f0094156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:44570/0 (socket says 172.21.15.132:44570) 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.559+0000 7f008bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00940c45d0 0x7f0094155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:53346/0 (socket says 172.21.15.132:53346) 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.559+0000 7f009359e640 1 -- 172.21.15.132:0/4066729381 learned_addr learned my addr 172.21.15.132:0/4066729381 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.559+0000 7f009359e640 1 -- 172.21.15.132:0/4066729381 >> v2:172.21.15.161:3300/0 conn(0x7f00940c45d0 msgr2=0x7f0094155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.559+0000 7f009359e640 1 --2- 172.21.15.132:0/4066729381 >> v2:172.21.15.161:3300/0 conn(0x7f00940c45d0 0x7f0094155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.560+0000 7f009359e640 1 -- 172.21.15.132:0/4066729381 >> v1:172.21.15.161:6789/0 conn(0x7f00940c5ec0 legacy=0x7f00940c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.560+0000 7f009359e640 1 -- 172.21.15.132:0/4066729381 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009406e0b0 con 0x7f00940c3340 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.560+0000 7f008bfff640 1 --2- 172.21.15.132:0/4066729381 >> v2:172.21.15.161:3300/0 conn(0x7f00940c45d0 0x7f0094155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:38:58.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.561+0000 7f009359e640 1 --2- 172.21.15.132:0/4066729381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c3340 0x7f0094156370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f008c009e80 tx=0x7f008c02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aadd6715afc2892b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:58.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.561+0000 7f009259c640 1 -- 172.21.15.132:0/4066729381 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c02c9c0 con 0x7f00940c3340 2023-11-18T20:38:58.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f009259c640 1 -- 172.21.15.132:0/4066729381 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c02cb20 con 0x7f00940c3340 2023-11-18T20:38:58.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f009259c640 1 -- 172.21.15.132:0/4066729381 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c0343f0 con 0x7f00940c3340 2023-11-18T20:38:58.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f0099197640 1 -- 172.21.15.132:0/4066729381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c3340 msgr2=0x7f0094156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f0099197640 1 --2- 172.21.15.132:0/4066729381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c3340 0x7f0094156370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f008c009e80 tx=0x7f008c02be20 comp rx=0 tx=0).stop 2023-11-18T20:38:58.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f0099197640 1 -- 172.21.15.132:0/4066729381 shutdown_connections 2023-11-18T20:38:58.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f0099197640 1 --2- 172.21.15.132:0/4066729381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c3340 0x7f0094156370 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f0099197640 1 --2- 172.21.15.132:0/4066729381 >> v2:172.21.15.161:3300/0 conn(0x7f00940c45d0 0x7f0094155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f0099197640 1 -- 172.21.15.132:0/4066729381 >> 172.21.15.132:0/4066729381 conn(0x7f009406a500 msgr2=0x7f009406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f0099197640 1 -- 172.21.15.132:0/4066729381 shutdown_connections 2023-11-18T20:38:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.562+0000 7f0099197640 1 -- 172.21.15.132:0/4066729381 wait complete. 2023-11-18T20:38:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.564+0000 7f0099197640 1 Processor -- start 2023-11-18T20:38:58.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.565+0000 7f0099197640 1 -- start start 2023-11-18T20:38:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0099197640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00940c3340 0x7f00941eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0099197640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00940c45d0 0x7f00940a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0099197640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c5ec0 0x7f00941e7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0099197640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009414b860 con 0x7f00940c3340 2023-11-18T20:38:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0099197640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00940a76a0 con 0x7f00940c45d0 2023-11-18T20:38:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0099197640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00941eb730 con 0x7f00940c5ec0 2023-11-18T20:38:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0092d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00940c3340 0x7f00941eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0092d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00940c3340 0x7f00941eb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54446/0 (socket says 172.21.15.132:54446) 2023-11-18T20:38:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f0092d9d640 1 -- 172.21.15.132:0/2455108902 learned_addr learned my addr 172.21.15.132:0/2455108902 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:58.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.566+0000 7f008bfff640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00940c45d0 0x7f00940a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f0092d9d640 1 -- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c5ec0 msgr2=0x7f00941e7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f0092d9d640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c5ec0 0x7f00941e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f0092d9d640 1 -- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00940c45d0 msgr2=0x7f00940a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f0092d9d640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00940c45d0 0x7f00940a7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f0092d9d640 1 -- 172.21.15.132:0/2455108902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c009400 con 0x7f00940c3340 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f0092d9d640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00940c3340 0x7f00941eb1f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f008400c400 tx=0x7f008400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f008b7fe640 1 -- 172.21.15.132:0/2455108902 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840052d0 con 0x7f00940c3340 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f008b7fe640 1 -- 172.21.15.132:0/2455108902 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0084005430 con 0x7f00940c3340 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f008b7fe640 1 -- 172.21.15.132:0/2455108902 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084003830 con 0x7f00940c3340 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c009b30 con 0x7f00940c3340 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.567+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00940a84f0 con 0x7f00940c3340 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.568+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0094068350 con 0x7f00940c3340 2023-11-18T20:38:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.569+0000 7f008b7fe640 1 -- 172.21.15.132:0/2455108902 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0084003990 con 0x7f00940c3340 2023-11-18T20:38:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.571+0000 7f008b7fe640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f007406ae40 0x7f007406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.571+0000 7f008b7fe640 1 -- 172.21.15.132:0/2455108902 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f00840887e0 con 0x7f00940c3340 2023-11-18T20:38:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.571+0000 7f008bfff640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f007406ae40 0x7f007406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.572+0000 7f008bfff640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f007406ae40 0x7f007406d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00940c44e0 tx=0x7f007c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:58.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.575+0000 7f008b7fe640 1 -- 172.21.15.132:0/2455108902 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0084053bd0 con 0x7f00940c3340 2023-11-18T20:38:58.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.817+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f00940bfa00 con 0x7f00940c3340 2023-11-18T20:38:58.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.822+0000 7f008b7fe640 1 -- 172.21.15.132:0/2455108902 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f00840571f0 con 0x7f00940c3340 2023-11-18T20:38:58.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f007406ae40 msgr2=0x7f007406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f007406ae40 0x7f007406d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00940c44e0 tx=0x7f007c008040 comp rx=0 tx=0).stop 2023-11-18T20:38:58.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00940c3340 msgr2=0x7f00941eb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:58.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00940c3340 0x7f00941eb1f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f008400c400 tx=0x7f008400c8c0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 shutdown_connections 2023-11-18T20:38:58.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f007406ae40 0x7f007406d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00940c5ec0 0x7f00941e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00940c45d0 0x7f00940a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 --2- 172.21.15.132:0/2455108902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00940c3340 0x7f00941eb1f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:58.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 >> 172.21.15.132:0/2455108902 conn(0x7f009406a500 msgr2=0x7f00940c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:58.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 shutdown_connections 2023-11-18T20:38:58.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:58.824+0000 7f0099197640 1 -- 172.21.15.132:0/2455108902 wait complete. 2023-11-18T20:38:58.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:38:59.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.049+0000 7fdf142e7640 1 Processor -- start 2023-11-18T20:38:59.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.050+0000 7fdf142e7640 1 -- start start 2023-11-18T20:38:59.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.051+0000 7fdf142e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdf0c14fd30 0x7fdf0c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.051+0000 7fdf142e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0c64a0 con 0x7fdf0c0c3ea0 2023-11-18T20:38:59.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.051+0000 7fdf142e7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0c5c00 con 0x7fdf0c06d0a0 2023-11-18T20:38:59.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.051+0000 7fdf142e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c0c5ee0 con 0x7fdf0c14fd30 2023-11-18T20:38:59.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.051+0000 7fdf12083640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdf0c14fd30 0x7fdf0c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.051+0000 7fdf12884640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdf0c0c3ea0 0x7fdf0c0c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37336/0 (socket says 172.21.15.132:37336) 2023-11-18T20:38:59.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.052+0000 7fdf12884640 1 -- 172.21.15.132:0/2621216842 learned_addr learned my addr 172.21.15.132:0/2621216842 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:59.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.052+0000 7fdf12083640 1 -- 172.21.15.132:0/2621216842 >> v1:172.21.15.161:6789/0 conn(0x7fdf0c06d0a0 legacy=0x7fdf0c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:59.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.052+0000 7fdf12083640 1 -- 172.21.15.132:0/2621216842 >> v1:172.21.15.132:6789/0 conn(0x7fdf0c0c3ea0 legacy=0x7fdf0c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.052+0000 7fdf11081640 1 -- 172.21.15.132:0/2621216842 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682861235 0 0) 0x7fdf0c0c64a0 con 0x7fdf0c0c3ea0 2023-11-18T20:38:59.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.052+0000 7fdf12083640 1 -- 172.21.15.132:0/2621216842 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0c61c0 con 0x7fdf0c14fd30 2023-11-18T20:38:59.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.053+0000 7fdf12083640 1 --2- 172.21.15.132:0/2621216842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c152f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdf080097a0 tx=0x7fdf0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b1398e61b0f1bb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.053+0000 7fdf11081640 1 -- 172.21.15.132:0/2621216842 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08031830 con 0x7fdf0c14fd30 2023-11-18T20:38:59.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf11081640 1 -- 172.21.15.132:0/2621216842 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf08031990 con 0x7fdf0c14fd30 2023-11-18T20:38:59.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf11081640 1 -- 172.21.15.132:0/2621216842 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08031d20 con 0x7fdf0c14fd30 2023-11-18T20:38:59.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf142e7640 1 -- 172.21.15.132:0/2621216842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 msgr2=0x7fdf0c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf142e7640 1 --2- 172.21.15.132:0/2621216842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c152f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdf080097a0 tx=0x7fdf0802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf142e7640 1 -- 172.21.15.132:0/2621216842 shutdown_connections 2023-11-18T20:38:59.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf142e7640 1 --2- 172.21.15.132:0/2621216842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c152f20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf142e7640 1 -- 172.21.15.132:0/2621216842 >> 172.21.15.132:0/2621216842 conn(0x7fdf0c06a500 msgr2=0x7fdf0c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:59.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf142e7640 1 -- 172.21.15.132:0/2621216842 shutdown_connections 2023-11-18T20:38:59.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.054+0000 7fdf142e7640 1 -- 172.21.15.132:0/2621216842 wait complete. 2023-11-18T20:38:59.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.056+0000 7fdf142e7640 1 Processor -- start 2023-11-18T20:38:59.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.056+0000 7fdf142e7640 1 -- start start 2023-11-18T20:38:59.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf142e7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf0c06d0a0 0x7fdf0c1eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf142e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0c0c3ea0 0x7fdf0c070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf142e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf142e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1517e0 con 0x7fdf0c14fd30 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf142e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c151ac0 con 0x7fdf0c0c3ea0 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf142e7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c150400 con 0x7fdf0c06d0a0 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf12884640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf12884640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33150/0 (socket says 172.21.15.132:33150) 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf12884640 1 -- 172.21.15.132:0/2084090773 learned_addr learned my addr 172.21.15.132:0/2084090773 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf12884640 1 -- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf0c06d0a0 msgr2=0x7fdf0c1eac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf12884640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf0c06d0a0 0x7fdf0c1eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf12884640 1 -- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0c0c3ea0 msgr2=0x7fdf0c070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf12884640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0c0c3ea0 0x7fdf0c070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.057+0000 7fdf12884640 1 -- 172.21.15.132:0/2084090773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08009400 con 0x7fdf0c14fd30 2023-11-18T20:38:59.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.058+0000 7fdf12884640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c150920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400c7a0 tx=0x7fdf0400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.058+0000 7fdf02ffd640 1 -- 172.21.15.132:0/2084090773 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400a640 con 0x7fdf0c14fd30 2023-11-18T20:38:59.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.058+0000 7fdf02ffd640 1 -- 172.21.15.132:0/2084090773 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0400a7a0 con 0x7fdf0c14fd30 2023-11-18T20:38:59.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.058+0000 7fdf02ffd640 1 -- 172.21.15.132:0/2084090773 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400abd0 con 0x7fdf0c14fd30 2023-11-18T20:38:59.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.058+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c070dc0 con 0x7fdf0c14fd30 2023-11-18T20:38:59.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.058+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1eb620 con 0x7fdf0c14fd30 2023-11-18T20:38:59.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.059+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c151920 con 0x7fdf0c14fd30 2023-11-18T20:38:59.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.060+0000 7fdf02ffd640 1 -- 172.21.15.132:0/2084090773 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf0400ad30 con 0x7fdf0c14fd30 2023-11-18T20:38:59.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.061+0000 7fdf02ffd640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdef006ae40 0x7fdef006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.061+0000 7fdf02ffd640 1 -- 172.21.15.132:0/2084090773 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf04088850 con 0x7fdf0c14fd30 2023-11-18T20:38:59.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.062+0000 7fdf12083640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdef006ae40 0x7fdef006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.063+0000 7fdf12083640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdef006ae40 0x7fdef006d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf08036000 tx=0x7fdf08030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.065+0000 7fdf02ffd640 1 -- 172.21.15.132:0/2084090773 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf0c151920 con 0x7fdf0c14fd30 2023-11-18T20:38:59.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.260+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf0c151920 con 0x7fdf0c14fd30 2023-11-18T20:38:59.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.262+0000 7fdf02ffd640 1 -- 172.21.15.132:0/2084090773 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12893 (secure 0 0 0) 0x7fdf0c151920 con 0x7fdf0c14fd30 2023-11-18T20:38:59.263 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:38:59.263 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":31,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:38:55.319808+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:38:59.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.264+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdef006ae40 msgr2=0x7fdef006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.264+0000 7fdf142e7640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdef006ae40 0x7fdef006d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf08036000 tx=0x7fdf08030000 comp rx=0 tx=0).stop 2023-11-18T20:38:59.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.264+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 msgr2=0x7fdf0c150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.264+0000 7fdf142e7640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c150920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400c7a0 tx=0x7fdf0400cc60 comp rx=0 tx=0).stop 2023-11-18T20:38:59.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.265+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 shutdown_connections 2023-11-18T20:38:59.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.265+0000 7fdf142e7640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdef006ae40 0x7fdef006d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.265+0000 7fdf142e7640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf0c14fd30 0x7fdf0c150920 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.265+0000 7fdf142e7640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0c0c3ea0 0x7fdf0c070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.265+0000 7fdf142e7640 1 --2- 172.21.15.132:0/2084090773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf0c06d0a0 0x7fdf0c1eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.265+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 >> 172.21.15.132:0/2084090773 conn(0x7fdf0c06a500 msgr2=0x7fdf0c06fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:59.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.265+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 shutdown_connections 2023-11-18T20:38:59.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.265+0000 7fdf142e7640 1 -- 172.21.15.132:0/2084090773 wait complete. 2023-11-18T20:38:59.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:38:59.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:38:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.503+0000 7fea31a90640 1 Processor -- start 2023-11-18T20:38:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.503+0000 7fea31a90640 1 -- start start 2023-11-18T20:38:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.505+0000 7fea31a90640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fea2c0c5ec0 0x7fea2c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.505+0000 7fea31a90640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2c0bfdc0 con 0x7fea2c0721a0 2023-11-18T20:38:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.505+0000 7fea31a90640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2c06ddd0 con 0x7fea2c0c45d0 2023-11-18T20:38:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.505+0000 7fea31a90640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2c06e390 con 0x7fea2c0c5ec0 2023-11-18T20:38:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.505+0000 7fea2b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fea2c0c5ec0 0x7fea2c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.505+0000 7fea2bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fea2c0721a0 0x7fea2c156540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37350/0 (socket says 172.21.15.132:37350) 2023-11-18T20:38:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.505+0000 7fea2bfff640 1 -- 172.21.15.132:0/1258352432 learned_addr learned my addr 172.21.15.132:0/1258352432 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:38:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.505+0000 7fea2a7fc640 1 -- 172.21.15.132:0/1258352432 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568698429 0 0) 0x7fea2c0bfdc0 con 0x7fea2c0721a0 2023-11-18T20:38:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.506+0000 7fea2a7fc640 1 -- 172.21.15.132:0/1258352432 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea14003520 con 0x7fea2c0721a0 2023-11-18T20:38:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.506+0000 7fea2b7fe640 1 -- 172.21.15.132:0/1258352432 >> v1:172.21.15.161:6789/0 conn(0x7fea2c0c45d0 legacy=0x7fea2c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.506+0000 7fea2b7fe640 1 -- 172.21.15.132:0/1258352432 >> v1:172.21.15.132:6789/0 conn(0x7fea2c0721a0 legacy=0x7fea2c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.506+0000 7fea2b7fe640 1 -- 172.21.15.132:0/1258352432 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c06e0b0 con 0x7fea2c0c5ec0 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.507+0000 7fea2b7fe640 1 --2- 172.21.15.132:0/1258352432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c5ec0 0x7fea2c0c2c30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009dc0 tx=0x7fea1c02bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99da8d9f4fa7f7f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.507+0000 7fea2a7fc640 1 -- 172.21.15.132:0/1258352432 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c02cb20 con 0x7fea2c0c5ec0 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.507+0000 7fea2a7fc640 1 -- 172.21.15.132:0/1258352432 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c02cc80 con 0x7fea2c0c5ec0 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.507+0000 7fea2a7fc640 1 -- 172.21.15.132:0/1258352432 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c034440 con 0x7fea2c0c5ec0 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.508+0000 7fea31a90640 1 -- 172.21.15.132:0/1258352432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c5ec0 msgr2=0x7fea2c0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.508+0000 7fea31a90640 1 --2- 172.21.15.132:0/1258352432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c5ec0 0x7fea2c0c2c30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009dc0 tx=0x7fea1c02bd70 comp rx=0 tx=0).stop 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.508+0000 7fea31a90640 1 -- 172.21.15.132:0/1258352432 shutdown_connections 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.508+0000 7fea31a90640 1 --2- 172.21.15.132:0/1258352432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c5ec0 0x7fea2c0c2c30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.508+0000 7fea31a90640 1 -- 172.21.15.132:0/1258352432 >> 172.21.15.132:0/1258352432 conn(0x7fea2c06a500 msgr2=0x7fea2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.508+0000 7fea31a90640 1 -- 172.21.15.132:0/1258352432 shutdown_connections 2023-11-18T20:38:59.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.508+0000 7fea31a90640 1 -- 172.21.15.132:0/1258352432 wait complete. 2023-11-18T20:38:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.510+0000 7fea31a90640 1 Processor -- start 2023-11-18T20:38:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.510+0000 7fea31a90640 1 -- start start 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea31a90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea2c0721a0 0x7fea2c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea31a90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c45d0 0x7fea2c0a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea31a90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea2c0c5ec0 0x7fea2c1ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea31a90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c14e3b0 con 0x7fea2c0c45d0 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea31a90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c1ee3a0 con 0x7fea2c0721a0 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea31a90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c1ee680 con 0x7fea2c0c5ec0 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea2affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c45d0 0x7fea2c0a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea2affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c45d0 0x7fea2c0a72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33172/0 (socket says 172.21.15.132:33172) 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.511+0000 7fea2affd640 1 -- 172.21.15.132:0/2706281279 learned_addr learned my addr 172.21.15.132:0/2706281279 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2b7fe640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea2c0721a0 0x7fea2c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2affd640 1 -- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea2c0c5ec0 msgr2=0x7fea2c1ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2bfff640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea2c0c5ec0 0x7fea2c1ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2affd640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea2c0c5ec0 0x7fea2c1ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2affd640 1 -- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea2c0721a0 msgr2=0x7fea2c14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2affd640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea2c0721a0 0x7fea2c14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2affd640 1 -- 172.21.15.132:0/2706281279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c009a70 con 0x7fea2c0c45d0 2023-11-18T20:38:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2b7fe640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea2c0721a0 0x7fea2c14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2bfff640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea2c0c5ec0 0x7fea2c1ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:38:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea2affd640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c45d0 0x7fea2c0a72d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c400 tx=0x7fea2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea13fff640 1 -- 172.21.15.132:0/2706281279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20011790 con 0x7fea2c0c45d0 2023-11-18T20:38:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea13fff640 1 -- 172.21.15.132:0/2706281279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea20011930 con 0x7fea2c0c45d0 2023-11-18T20:38:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea13fff640 1 -- 172.21.15.132:0/2706281279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20011ce0 con 0x7fea2c0c45d0 2023-11-18T20:38:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.512+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c0a8e60 con 0x7fea2c0c45d0 2023-11-18T20:38:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.513+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2c0a79f0 con 0x7fea2c0c45d0 2023-11-18T20:38:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.514+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2c0c2c30 con 0x7fea2c0c45d0 2023-11-18T20:38:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.514+0000 7fea13fff640 1 -- 172.21.15.132:0/2706281279 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea2001c460 con 0x7fea2c0c45d0 2023-11-18T20:38:59.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.516+0000 7fea13fff640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea1806ae40 0x7fea1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.516+0000 7fea13fff640 1 -- 172.21.15.132:0/2706281279 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea20089020 con 0x7fea2c0c45d0 2023-11-18T20:38:59.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.517+0000 7fea2b7fe640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea1806ae40 0x7fea1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.518+0000 7fea2b7fe640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea1806ae40 0x7fea1806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea1c036000 tx=0x7fea1c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.521+0000 7fea13fff640 1 -- 172.21.15.132:0/2706281279 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea200544b0 con 0x7fea2c0c45d0 2023-11-18T20:38:59.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.717+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea2c0a79f0 con 0x7fea2c0c45d0 2023-11-18T20:38:59.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.718+0000 7fea13fff640 1 -- 172.21.15.132:0/2706281279 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea2c0a79f0 con 0x7fea2c0c45d0 2023-11-18T20:38:59.719 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:38:59.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea1806ae40 msgr2=0x7fea1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea1806ae40 0x7fea1806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea1c036000 tx=0x7fea1c030000 comp rx=0 tx=0).stop 2023-11-18T20:38:59.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c45d0 msgr2=0x7fea2c0a72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c45d0 0x7fea2c0a72d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c400 tx=0x7fea2000c8c0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 shutdown_connections 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fea1806ae40 0x7fea1806d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea2c0c5ec0 0x7fea2c1ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea2c0c45d0 0x7fea2c0a72d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 --2- 172.21.15.132:0/2706281279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea2c0721a0 0x7fea2c14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 >> 172.21.15.132:0/2706281279 conn(0x7fea2c06a500 msgr2=0x7fea2c070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 shutdown_connections 2023-11-18T20:38:59.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.721+0000 7fea31a90640 1 -- 172.21.15.132:0/2706281279 wait complete. 2023-11-18T20:38:59.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T20:38:59.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.945+0000 7fdd5f690640 1 Processor -- start 2023-11-18T20:38:59.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.945+0000 7fdd5f690640 1 -- start start 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.946+0000 7fdd5f690640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5814fd30 0x7fdd58152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.946+0000 7fdd5f690640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5806d0a0 0x7fdd580a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.946+0000 7fdd5f690640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd580c64a0 con 0x7fdd580a5260 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.946+0000 7fdd5f690640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd580c5c00 con 0x7fdd5806d0a0 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.946+0000 7fdd5f690640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580c5ee0 con 0x7fdd5814fd30 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5cc2b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5806d0a0 0x7fdd580a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5cc2b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5806d0a0 0x7fdd580a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33174/0 (socket says 172.21.15.132:33174) 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5cc2b640 1 -- 172.21.15.132:0/1012150675 learned_addr learned my addr 172.21.15.132:0/1012150675 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:59.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5d42c640 1 --2- 172.21.15.132:0/1012150675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5814fd30 0x7fdd58152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5cc2b640 1 -- 172.21.15.132:0/1012150675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5814fd30 msgr2=0x7fdd58152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:38:59.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5cc2b640 1 --2- 172.21.15.132:0/1012150675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5814fd30 0x7fdd58152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5cc2b640 1 -- 172.21.15.132:0/1012150675 >> v1:172.21.15.132:6789/0 conn(0x7fdd580a5260 legacy=0x7fdd580c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd4ffff640 1 -- 172.21.15.132:0/1012150675 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448780668 0 0) 0x7fdd580c64a0 con 0x7fdd580a5260 2023-11-18T20:38:59.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5cc2b640 1 -- 172.21.15.132:0/1012150675 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd580c61c0 con 0x7fdd5806d0a0 2023-11-18T20:38:59.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.947+0000 7fdd5d42c640 1 --2- 172.21.15.132:0/1012150675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5814fd30 0x7fdd58152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.949+0000 7fdd5cc2b640 1 --2- 172.21.15.132:0/1012150675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5806d0a0 0x7fdd580a4d20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009870 tx=0x7fdd4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb28efec6c9f2337 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.949+0000 7fdd4ffff640 1 -- 172.21.15.132:0/1012150675 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48030840 con 0x7fdd5806d0a0 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.949+0000 7fdd4ffff640 1 -- 172.21.15.132:0/1012150675 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd480309a0 con 0x7fdd5806d0a0 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.949+0000 7fdd4ffff640 1 -- 172.21.15.132:0/1012150675 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48030d30 con 0x7fdd5806d0a0 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.950+0000 7fdd5f690640 1 -- 172.21.15.132:0/1012150675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5806d0a0 msgr2=0x7fdd580a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.950+0000 7fdd5f690640 1 --2- 172.21.15.132:0/1012150675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5806d0a0 0x7fdd580a4d20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009870 tx=0x7fdd4802b980 comp rx=0 tx=0).stop 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.950+0000 7fdd5f690640 1 -- 172.21.15.132:0/1012150675 shutdown_connections 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.950+0000 7fdd5f690640 1 --2- 172.21.15.132:0/1012150675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5806d0a0 0x7fdd580a4d20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.950+0000 7fdd5f690640 1 --2- 172.21.15.132:0/1012150675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5814fd30 0x7fdd58152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.950+0000 7fdd5f690640 1 -- 172.21.15.132:0/1012150675 >> 172.21.15.132:0/1012150675 conn(0x7fdd5806a500 msgr2=0x7fdd5806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:38:59.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.950+0000 7fdd5f690640 1 -- 172.21.15.132:0/1012150675 shutdown_connections 2023-11-18T20:38:59.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.950+0000 7fdd5f690640 1 -- 172.21.15.132:0/1012150675 wait complete. 2023-11-18T20:38:59.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.952+0000 7fdd5f690640 1 Processor -- start 2023-11-18T20:38:59.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.952+0000 7fdd5f690640 1 -- start start 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5f690640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5806d0a0 0x7fdd581eab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5f690640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580a5260 0x7fdd58151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5f690640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5814fd30 0x7fdd581eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5f690640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5814ebd0 con 0x7fdd580a5260 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5f690640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581ed5b0 con 0x7fdd5814fd30 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5f690640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581ed7c0 con 0x7fdd5806d0a0 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5cc2b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580a5260 0x7fdd58151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5cc2b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580a5260 0x7fdd58151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33182/0 (socket says 172.21.15.132:33182) 2023-11-18T20:38:59.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5cc2b640 1 -- 172.21.15.132:0/2919854983 learned_addr learned my addr 172.21.15.132:0/2919854983 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:38:59.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5cc2b640 1 -- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5806d0a0 msgr2=0x7fdd581eab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5cc2b640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5806d0a0 0x7fdd581eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5cc2b640 1 -- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5814fd30 msgr2=0x7fdd581eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5cc2b640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5814fd30 0x7fdd581eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.953+0000 7fdd5cc2b640 1 -- 172.21.15.132:0/2919854983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480094d0 con 0x7fdd580a5260 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.954+0000 7fdd5cc2b640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580a5260 0x7fdd58151c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdd48000c00 tx=0x7fdd48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.954+0000 7fdd4dffb640 1 -- 172.21.15.132:0/2919854983 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48039c90 con 0x7fdd580a5260 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.954+0000 7fdd4dffb640 1 -- 172.21.15.132:0/2919854983 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48039df0 con 0x7fdd580a5260 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.954+0000 7fdd4dffb640 1 -- 172.21.15.132:0/2919854983 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48043640 con 0x7fdd580a5260 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.954+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd581ea370 con 0x7fdd580a5260 2023-11-18T20:38:59.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.954+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd58152160 con 0x7fdd580a5260 2023-11-18T20:38:59.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.955+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd581ea890 con 0x7fdd580a5260 2023-11-18T20:38:59.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.956+0000 7fdd4dffb640 1 -- 172.21.15.132:0/2919854983 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd480437a0 con 0x7fdd580a5260 2023-11-18T20:38:59.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.957+0000 7fdd4dffb640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd3c06ae40 0x7fdd3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:38:59.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.957+0000 7fdd4dffb640 1 -- 172.21.15.132:0/2919854983 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdd4803e070 con 0x7fdd580a5260 2023-11-18T20:38:59.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.958+0000 7fdd5d42c640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd3c06ae40 0x7fdd3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:38:59.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.959+0000 7fdd5d42c640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd3c06ae40 0x7fdd3c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd54006fd0 tx=0x7fdd54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:38:59.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:38:59.961+0000 7fdd4dffb640 1 -- 172.21.15.132:0/2919854983 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd581ea890 con 0x7fdd580a5260 2023-11-18T20:39:00.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.151+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdd581ea890 con 0x7fdd580a5260 2023-11-18T20:39:00.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.152+0000 7fdd4dffb640 1 -- 172.21.15.132:0/2919854983 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdd581ea890 con 0x7fdd580a5260 2023-11-18T20:39:00.154 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:00.154 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-11-18T20:39:00.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:39:00.154 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-11-18T20:39:00.154 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-11-18T20:39:00.154 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:39:00.154 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-11-18T20:39:00.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd3c06ae40 msgr2=0x7fdd3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd3c06ae40 0x7fdd3c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd54006fd0 tx=0x7fdd54008040 comp rx=0 tx=0).stop 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580a5260 msgr2=0x7fdd58151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580a5260 0x7fdd58151c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdd48000c00 tx=0x7fdd48004730 comp rx=0 tx=0).stop 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 shutdown_connections 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd3c06ae40 0x7fdd3c06d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5814fd30 0x7fdd581eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580a5260 0x7fdd58151c20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 --2- 172.21.15.132:0/2919854983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd5806d0a0 0x7fdd581eab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.155+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 >> 172.21.15.132:0/2919854983 conn(0x7fdd5806a500 msgr2=0x7fdd580c2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.156+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 shutdown_connections 2023-11-18T20:39:00.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.156+0000 7fdd5f690640 1 -- 172.21.15.132:0/2919854983 wait complete. 2023-11-18T20:39:00.175 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-18T20:39:00.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-18T20:39:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.390+0000 7f9e574bb640 1 Processor -- start 2023-11-18T20:39:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.391+0000 7f9e574bb640 1 -- start start 2023-11-18T20:39:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.392+0000 7f9e574bb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9e500a5370 0x7f9e500c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.392+0000 7f9e574bb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e500a5750 con 0x7f9e500c5110 2023-11-18T20:39:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.392+0000 7f9e574bb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e500c3380 con 0x7f9e500a8c70 2023-11-18T20:39:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.392+0000 7f9e574bb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5006c570 con 0x7f9e500a5370 2023-11-18T20:39:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.392+0000 7f9e54a56640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9e500c5110 0x7f9e5006d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37370/0 (socket says 172.21.15.132:37370) 2023-11-18T20:39:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.392+0000 7f9e54a56640 1 -- 172.21.15.132:0/3112847319 learned_addr learned my addr 172.21.15.132:0/3112847319 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.392+0000 7f9e55257640 1 --2- 172.21.15.132:0/3112847319 >> v2:172.21.15.161:3300/0 conn(0x7f9e500a5370 0x7f9e500c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856179873 0 0) 0x7f9e500a5750 con 0x7f9e500c5110 2023-11-18T20:39:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e38005730 con 0x7f9e500c5110 2023-11-18T20:39:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196815701 0 0) 0x7f9e38005730 con 0x7f9e500c5110 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 >> v2:172.21.15.161:3300/0 conn(0x7f9e500a5370 msgr2=0x7f9e500c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 --2- 172.21.15.132:0/3112847319 >> v2:172.21.15.161:3300/0 conn(0x7f9e500a5370 0x7f9e500c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 >> v1:172.21.15.161:6789/0 conn(0x7f9e500a8c70 legacy=0x7f9e5006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5006c850 con 0x7f9e500c5110 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f9e44001670 con 0x7f9e500c5110 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 >> v1:172.21.15.132:6789/0 conn(0x7f9e500c5110 legacy=0x7f9e5006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e38005bd0 0x7f9e38005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e38006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e380073e0 0x7f9e3800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5006c570 con 0x7f9e380069d0 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3800e330 con 0x7f9e380073e0 2023-11-18T20:39:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3800e4f0 con 0x7f9e38005bd0 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.393+0000 7f9e54a56640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e38006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.394+0000 7f9e55257640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e38005bd0 0x7f9e38005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.394+0000 7f9e54a56640 1 -- 172.21.15.132:0/3112847319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e38005bd0 msgr2=0x7f9e38005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.394+0000 7f9e54a56640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e38005bd0 0x7f9e38005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.394+0000 7f9e55a58640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e380073e0 0x7f9e3800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.394+0000 7f9e54a56640 1 -- 172.21.15.132:0/3112847319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e380073e0 msgr2=0x7f9e3800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.394+0000 7f9e54a56640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e380073e0 0x7f9e3800db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.394+0000 7f9e54a56640 1 -- 172.21.15.132:0/3112847319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38005730 con 0x7f9e380069d0 2023-11-18T20:39:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.394+0000 7f9e55a58640 1 -- 172.21.15.132:0/3112847319 reap_dead start 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.395+0000 7f9e54a56640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e38006e50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9e44001eb0 tx=0x7f9e38007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8d6b277eb9923a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.395+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44005ad0 con 0x7f9e380069d0 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.395+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e44005c30 con 0x7f9e380069d0 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.395+0000 7f9e4ffff640 1 -- 172.21.15.132:0/3112847319 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4402ca00 con 0x7f9e380069d0 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.396+0000 7f9e574bb640 1 -- 172.21.15.132:0/3112847319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 msgr2=0x7f9e38006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.396+0000 7f9e574bb640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e38006e50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9e44001eb0 tx=0x7f9e38007a00 comp rx=0 tx=0).stop 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.396+0000 7f9e574bb640 1 -- 172.21.15.132:0/3112847319 shutdown_connections 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.396+0000 7f9e574bb640 1 --2- 172.21.15.132:0/3112847319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e38006e50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.396+0000 7f9e574bb640 1 -- 172.21.15.132:0/3112847319 >> 172.21.15.132:0/3112847319 conn(0x7f9e500c5bc0 msgr2=0x7f9e500c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.396+0000 7f9e574bb640 1 -- 172.21.15.132:0/3112847319 shutdown_connections 2023-11-18T20:39:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.396+0000 7f9e574bb640 1 -- 172.21.15.132:0/3112847319 wait complete. 2023-11-18T20:39:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.398+0000 7f9e574bb640 1 Processor -- start 2023-11-18T20:39:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.398+0000 7f9e574bb640 1 -- start start 2023-11-18T20:39:00.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e574bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e50151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e574bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e501dbfe0 0x7f9e50071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e574bb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e50150ee0 0x7f9e501daa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e574bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500703f0 con 0x7f9e380069d0 2023-11-18T20:39:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e574bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e501ee160 con 0x7f9e501dbfe0 2023-11-18T20:39:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e574bb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50070080 con 0x7f9e50150ee0 2023-11-18T20:39:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e55257640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e50151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e55257640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e50151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33192/0 (socket says 172.21.15.132:33192) 2023-11-18T20:39:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e55257640 1 -- 172.21.15.132:0/1848741100 learned_addr learned my addr 172.21.15.132:0/1848741100 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e55257640 1 -- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e50150ee0 msgr2=0x7f9e501daa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e55257640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e50150ee0 0x7f9e501daa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e55257640 1 -- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e501dbfe0 msgr2=0x7f9e50071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e55257640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e501dbfe0 0x7f9e50071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.399+0000 7f9e55257640 1 -- 172.21.15.132:0/1848741100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e501daf80 con 0x7f9e380069d0 2023-11-18T20:39:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.400+0000 7f9e55257640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e50151410 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e40007f30 tx=0x7f9e40011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.400+0000 7f9e4dffb640 1 -- 172.21.15.132:0/1848741100 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000e030 con 0x7f9e380069d0 2023-11-18T20:39:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.400+0000 7f9e4dffb640 1 -- 172.21.15.132:0/1848741100 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e40016470 con 0x7f9e380069d0 2023-11-18T20:39:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.400+0000 7f9e4dffb640 1 -- 172.21.15.132:0/1848741100 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40016820 con 0x7f9e380069d0 2023-11-18T20:39:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.400+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e501ed6e0 con 0x7f9e380069d0 2023-11-18T20:39:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.400+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e501edb70 con 0x7f9e380069d0 2023-11-18T20:39:00.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.401+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e50070240 con 0x7f9e380069d0 2023-11-18T20:39:00.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.402+0000 7f9e4dffb640 1 -- 172.21.15.132:0/1848741100 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e40016980 con 0x7f9e380069d0 2023-11-18T20:39:00.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.403+0000 7f9e4dffb640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9e3c06ae40 0x7f9e3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.403+0000 7f9e4dffb640 1 -- 172.21.15.132:0/1848741100 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e4000f070 con 0x7f9e380069d0 2023-11-18T20:39:00.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.404+0000 7f9e54a56640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9e3c06ae40 0x7f9e3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.405+0000 7f9e54a56640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9e3c06ae40 0x7f9e3c06d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9e44034000 tx=0x7f9e44039040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:00.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.408+0000 7f9e4dffb640 1 -- 172.21.15.132:0/1848741100 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e40055720 con 0x7f9e380069d0 2023-11-18T20:39:00.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.599+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9e50072b80 con 0x7f9e380069d0 2023-11-18T20:39:00.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.710+0000 7f9e4dffb640 1 -- 172.21.15.132:0/1848741100 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9e40058d40 con 0x7f9e380069d0 2023-11-18T20:39:00.711 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-11-18T20:39:00.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9e3c06ae40 msgr2=0x7f9e3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9e3c06ae40 0x7f9e3c06d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9e44034000 tx=0x7f9e44039040 comp rx=0 tx=0).stop 2023-11-18T20:39:00.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 msgr2=0x7f9e50151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e50151410 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e40007f30 tx=0x7f9e40011660 comp rx=0 tx=0).stop 2023-11-18T20:39:00.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 shutdown_connections 2023-11-18T20:39:00.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9e3c06ae40 0x7f9e3c06d300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e50150ee0 0x7f9e501daa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e501dbfe0 0x7f9e50071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 --2- 172.21.15.132:0/1848741100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e380069d0 0x7f9e50151410 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.713+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 >> 172.21.15.132:0/1848741100 conn(0x7f9e500c5bc0 msgr2=0x7f9e500a5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.714+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 shutdown_connections 2023-11-18T20:39:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.714+0000 7f9e574bb640 1 -- 172.21.15.132:0/1848741100 wait complete. 2023-11-18T20:39:00.738 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T20:39:00.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.947+0000 7f26fb051640 1 Processor -- start 2023-11-18T20:39:00.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.948+0000 7f26fb051640 1 -- start start 2023-11-18T20:39:00.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.949+0000 7f26fb051640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26f40c7ec0 0x7f26f4155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.949+0000 7f26fb051640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f26f40c4940 0x7f26f40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.949+0000 7f26fb051640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f41556d0 con 0x7f26f4151cc0 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.949+0000 7f26fb051640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f4154740 con 0x7f26f40c7ec0 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.949+0000 7f26fb051640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f406c760 con 0x7f26f40c4940 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.949+0000 7f26f3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26f40c7ec0 0x7f26f4155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.949+0000 7f26f3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26f40c7ec0 0x7f26f4155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33206/0 (socket says 172.21.15.132:33206) 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.949+0000 7f26f3fff640 1 -- 172.21.15.132:0/1002180110 learned_addr learned my addr 172.21.15.132:0/1002180110 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.950+0000 7f26f95ee640 1 --2- 172.21.15.132:0/1002180110 >> v2:172.21.15.161:3300/0 conn(0x7f26f40c4940 0x7f26f40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.950+0000 7f26f3fff640 1 -- 172.21.15.132:0/1002180110 >> v2:172.21.15.161:3300/0 conn(0x7f26f40c4940 msgr2=0x7f26f40c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.950+0000 7f26f3fff640 1 --2- 172.21.15.132:0/1002180110 >> v2:172.21.15.161:3300/0 conn(0x7f26f40c4940 0x7f26f40c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.950+0000 7f26f3fff640 1 -- 172.21.15.132:0/1002180110 >> v1:172.21.15.161:6789/0 conn(0x7f26f4151cc0 legacy=0x7f26f4157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.950+0000 7f26f3fff640 1 -- 172.21.15.132:0/1002180110 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40c8470 con 0x7f26f40c7ec0 2023-11-18T20:39:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.950+0000 7f26f95ee640 1 --2- 172.21.15.132:0/1002180110 >> v2:172.21.15.161:3300/0 conn(0x7f26f40c4940 0x7f26f40c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.951+0000 7f26f3fff640 1 --2- 172.21.15.132:0/1002180110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c7ec0 0x7f26f4155190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f26f40c67b0 tx=0x7f26e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7740e4faadf06420 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.951+0000 7f26f37fe640 1 -- 172.21.15.132:0/1002180110 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8031870 con 0x7f26f40c7ec0 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.951+0000 7f26f37fe640 1 -- 172.21.15.132:0/1002180110 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e80319d0 con 0x7f26f40c7ec0 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.951+0000 7f26f37fe640 1 -- 172.21.15.132:0/1002180110 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8031d60 con 0x7f26f40c7ec0 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.952+0000 7f26fb051640 1 -- 172.21.15.132:0/1002180110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c7ec0 msgr2=0x7f26f4155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.952+0000 7f26fb051640 1 --2- 172.21.15.132:0/1002180110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c7ec0 0x7f26f4155190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f26f40c67b0 tx=0x7f26e802b910 comp rx=0 tx=0).stop 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.952+0000 7f26fb051640 1 -- 172.21.15.132:0/1002180110 shutdown_connections 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.952+0000 7f26fb051640 1 --2- 172.21.15.132:0/1002180110 >> v2:172.21.15.161:3300/0 conn(0x7f26f40c4940 0x7f26f40c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.952+0000 7f26fb051640 1 --2- 172.21.15.132:0/1002180110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c7ec0 0x7f26f4155190 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.952+0000 7f26fb051640 1 -- 172.21.15.132:0/1002180110 >> 172.21.15.132:0/1002180110 conn(0x7f26f4071e10 msgr2=0x7f26f4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:00.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.952+0000 7f26fb051640 1 -- 172.21.15.132:0/1002180110 shutdown_connections 2023-11-18T20:39:00.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.952+0000 7f26fb051640 1 -- 172.21.15.132:0/1002180110 wait complete. 2023-11-18T20:39:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.954+0000 7f26fb051640 1 Processor -- start 2023-11-18T20:39:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.954+0000 7f26fb051640 1 -- start start 2023-11-18T20:39:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26fb051640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c4940 0x7f26f40c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26fb051640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26f40c7ec0 0x7f26f40acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26fb051640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26f4151cc0 0x7f26f4148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26fb051640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f41ea1b0 con 0x7f26f40c4940 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26fb051640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40ae960 con 0x7f26f4151cc0 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26fb051640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f41edb40 con 0x7f26f40c7ec0 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26f8ded640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c4940 0x7f26f40c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26f8ded640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c4940 0x7f26f40c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33222/0 (socket says 172.21.15.132:33222) 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26f8ded640 1 -- 172.21.15.132:0/2964326101 learned_addr learned my addr 172.21.15.132:0/2964326101 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26f8ded640 1 -- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26f40c7ec0 msgr2=0x7f26f40acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26f8ded640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26f40c7ec0 0x7f26f40acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26f8ded640 1 -- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26f4151cc0 msgr2=0x7f26f4148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26f8ded640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26f4151cc0 0x7f26f4148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.955+0000 7f26f8ded640 1 -- 172.21.15.132:0/2964326101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e80094d0 con 0x7f26f40c4940 2023-11-18T20:39:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.956+0000 7f26f8ded640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c4940 0x7f26f40c7150 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f26e400ba50 tx=0x7f26e400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.956+0000 7f26f17fa640 1 -- 172.21.15.132:0/2964326101 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400cc10 con 0x7f26f40c4940 2023-11-18T20:39:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.956+0000 7f26f17fa640 1 -- 172.21.15.132:0/2964326101 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400cd70 con 0x7f26f40c4940 2023-11-18T20:39:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.956+0000 7f26f17fa640 1 -- 172.21.15.132:0/2964326101 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4014680 con 0x7f26f40c4940 2023-11-18T20:39:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.956+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f41e9ed0 con 0x7f26f40c4940 2023-11-18T20:39:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.956+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f41ed7d0 con 0x7f26f40c4940 2023-11-18T20:39:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.957+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f41ed350 con 0x7f26f40c4940 2023-11-18T20:39:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.958+0000 7f26f17fa640 1 -- 172.21.15.132:0/2964326101 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26e4007370 con 0x7f26f40c4940 2023-11-18T20:39:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.959+0000 7f26f17fa640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f26e006ae70 0x7f26e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.959+0000 7f26f17fa640 1 -- 172.21.15.132:0/2964326101 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f26e4088f10 con 0x7f26f40c4940 2023-11-18T20:39:00.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.960+0000 7f26f3fff640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f26e006ae70 0x7f26e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.961+0000 7f26f3fff640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f26e006ae70 0x7f26e006d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f26e8036000 tx=0x7f26e8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:00.964+0000 7f26f17fa640 1 -- 172.21.15.132:0/2964326101 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26f41ed350 con 0x7f26f40c4940 2023-11-18T20:39:01.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.157+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f26f41ed350 con 0x7f26f40c4940 2023-11-18T20:39:01.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.715+0000 7f26f17fa640 1 -- 172.21.15.132:0/2964326101 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f26f41ed350 con 0x7f26f40c4940 2023-11-18T20:39:01.717 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-11-18T20:39:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f26e006ae70 msgr2=0x7f26e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f26e006ae70 0x7f26e006d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f26e8036000 tx=0x7f26e8030000 comp rx=0 tx=0).stop 2023-11-18T20:39:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c4940 msgr2=0x7f26f40c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c4940 0x7f26f40c7150 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f26e400ba50 tx=0x7f26e400bf10 comp rx=0 tx=0).stop 2023-11-18T20:39:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 shutdown_connections 2023-11-18T20:39:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f26e006ae70 0x7f26e006d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26f4151cc0 0x7f26f4148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26f40c7ec0 0x7f26f40acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 --2- 172.21.15.132:0/2964326101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f40c4940 0x7f26f40c7150 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.721+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 >> 172.21.15.132:0/2964326101 conn(0x7f26f4071e10 msgr2=0x7f26f406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.722+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 shutdown_connections 2023-11-18T20:39:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.722+0000 7f26fb051640 1 -- 172.21.15.132:0/2964326101 wait complete. 2023-11-18T20:39:01.756 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-18T20:39:01.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.939+0000 7fcb48e0d640 1 Processor -- start 2023-11-18T20:39:01.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.939+0000 7fcb48e0d640 1 -- start start 2023-11-18T20:39:01.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb48e0d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb4414c2e0 0x7fcb440c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb48e0d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb44072310 0x7fcb440a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb48e0d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb44071e80 con 0x7fcb440c0440 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb48e0d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb44071470 con 0x7fcb4414c2e0 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb48e0d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4414c6c0 con 0x7fcb44072310 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb437fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb4414c2e0 0x7fcb440c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb437fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb4414c2e0 0x7fcb440c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33230/0 (socket says 172.21.15.132:33230) 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb437fe640 1 -- 172.21.15.132:0/1450900541 learned_addr learned my addr 172.21.15.132:0/1450900541 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.941+0000 7fcb3bfff640 1 --1- 172.21.15.132:0/1450900541 >> v1:172.21.15.132:6789/0 conn(0x7fcb440c0440 0x7fcb44152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37380/0 (socket says 172.21.15.132:37380) 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.942+0000 7fcb437fe640 1 -- 172.21.15.132:0/1450900541 >> v2:172.21.15.161:3300/0 conn(0x7fcb44072310 msgr2=0x7fcb440a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.942+0000 7fcb437fe640 1 --2- 172.21.15.132:0/1450900541 >> v2:172.21.15.161:3300/0 conn(0x7fcb44072310 0x7fcb440a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.942+0000 7fcb437fe640 1 -- 172.21.15.132:0/1450900541 >> v1:172.21.15.132:6789/0 conn(0x7fcb440c0440 legacy=0x7fcb44152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:01.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.942+0000 7fcb437fe640 1 -- 172.21.15.132:0/1450900541 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4406fdc0 con 0x7fcb4414c2e0 2023-11-18T20:39:01.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.942+0000 7fcb42ffd640 1 -- 172.21.15.132:0/1450900541 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785854232 0 0) 0x7fcb44071e80 con 0x7fcb440c0440 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.943+0000 7fcb437fe640 1 --2- 172.21.15.132:0/1450900541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4414c2e0 0x7fcb440c0c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb4406b720 tx=0x7fcb3402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0b36974e3121f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.943+0000 7fcb42ffd640 1 -- 172.21.15.132:0/1450900541 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34031800 con 0x7fcb4414c2e0 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.943+0000 7fcb42ffd640 1 -- 172.21.15.132:0/1450900541 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb34031960 con 0x7fcb4414c2e0 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.943+0000 7fcb42ffd640 1 -- 172.21.15.132:0/1450900541 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34031cf0 con 0x7fcb4414c2e0 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.944+0000 7fcb48e0d640 1 -- 172.21.15.132:0/1450900541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4414c2e0 msgr2=0x7fcb440c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.944+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/1450900541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4414c2e0 0x7fcb440c0c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb4406b720 tx=0x7fcb3402b8a0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.944+0000 7fcb48e0d640 1 -- 172.21.15.132:0/1450900541 shutdown_connections 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.944+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/1450900541 >> v2:172.21.15.161:3300/0 conn(0x7fcb44072310 0x7fcb440a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.944+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/1450900541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4414c2e0 0x7fcb440c0c80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.944+0000 7fcb48e0d640 1 -- 172.21.15.132:0/1450900541 >> 172.21.15.132:0/1450900541 conn(0x7fcb440a77f0 msgr2=0x7fcb440a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:01.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.944+0000 7fcb48e0d640 1 -- 172.21.15.132:0/1450900541 shutdown_connections 2023-11-18T20:39:01.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.944+0000 7fcb48e0d640 1 -- 172.21.15.132:0/1450900541 wait complete. 2023-11-18T20:39:01.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.945+0000 7fcb48e0d640 1 Processor -- start 2023-11-18T20:39:01.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.946+0000 7fcb48e0d640 1 -- start start 2023-11-18T20:39:01.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.946+0000 7fcb48e0d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb44072310 0x7fcb440a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:01.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.946+0000 7fcb48e0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb440c0440 0x7fcb440a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:01.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.946+0000 7fcb48e0d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb4414c2e0 0x7fcb441eb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:01.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.946+0000 7fcb48e0d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb440a8fa0 con 0x7fcb440c0440 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.946+0000 7fcb48e0d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb440a8cc0 con 0x7fcb4414c2e0 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.946+0000 7fcb48e0d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44151b80 con 0x7fcb44072310 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb440c0440 0x7fcb440a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb440c0440 0x7fcb440a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33234/0 (socket says 172.21.15.132:33234) 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 -- 172.21.15.132:0/2671560662 learned_addr learned my addr 172.21.15.132:0/2671560662 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb437fe640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb44072310 0x7fcb440a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb43fff640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb4414c2e0 0x7fcb441eb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 -- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb44072310 msgr2=0x7fcb440a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb44072310 0x7fcb440a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 -- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb4414c2e0 msgr2=0x7fcb441eb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb4414c2e0 0x7fcb441eb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:01.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 -- 172.21.15.132:0/2671560662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb340094d0 con 0x7fcb440c0440 2023-11-18T20:39:01.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.947+0000 7fcb3bfff640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb440c0440 0x7fcb440a9e50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00c4d0 tx=0x7fcb2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:01.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.948+0000 7fcb40ff9640 1 -- 172.21.15.132:0/2671560662 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0074e0 con 0x7fcb440c0440 2023-11-18T20:39:01.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.948+0000 7fcb40ff9640 1 -- 172.21.15.132:0/2671560662 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c007660 con 0x7fcb440c0440 2023-11-18T20:39:01.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.948+0000 7fcb40ff9640 1 -- 172.21.15.132:0/2671560662 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c004a20 con 0x7fcb440c0440 2023-11-18T20:39:01.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.948+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb44151e60 con 0x7fcb440c0440 2023-11-18T20:39:01.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.948+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb440bb090 con 0x7fcb440c0440 2023-11-18T20:39:01.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.949+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb44152380 con 0x7fcb440c0440 2023-11-18T20:39:01.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.950+0000 7fcb40ff9640 1 -- 172.21.15.132:0/2671560662 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb2c01b360 con 0x7fcb440c0440 2023-11-18T20:39:01.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.951+0000 7fcb40ff9640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb2406ae40 0x7fcb2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:01.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.951+0000 7fcb40ff9640 1 -- 172.21.15.132:0/2671560662 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcb2c0889b0 con 0x7fcb440c0440 2023-11-18T20:39:01.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.952+0000 7fcb437fe640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb2406ae40 0x7fcb2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:01.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.953+0000 7fcb437fe640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb2406ae40 0x7fcb2406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb34036000 tx=0x7fcb3403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:01.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:01.955+0000 7fcb40ff9640 1 -- 172.21.15.132:0/2671560662 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb2c053c30 con 0x7fcb440c0440 2023-11-18T20:39:02.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.179+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcb4404e840 con 0x7fcb440c0440 2023-11-18T20:39:02.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.742+0000 7fcb40ff9640 1 -- 172.21.15.132:0/2671560662 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcb2c018020 con 0x7fcb440c0440 2023-11-18T20:39:02.743 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 4 and data pool 5 2023-11-18T20:39:02.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.751+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb2406ae40 msgr2=0x7fcb2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:02.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.751+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb2406ae40 0x7fcb2406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb34036000 tx=0x7fcb3403c040 comp rx=0 tx=0).stop 2023-11-18T20:39:02.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.751+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb440c0440 msgr2=0x7fcb440a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:02.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.751+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb440c0440 0x7fcb440a9e50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00c4d0 tx=0x7fcb2c00c990 comp rx=0 tx=0).stop 2023-11-18T20:39:02.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.752+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 shutdown_connections 2023-11-18T20:39:02.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.752+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb2406ae40 0x7fcb2406d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.752+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb4414c2e0 0x7fcb441eb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.752+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb440c0440 0x7fcb440a9e50 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00c4d0 tx=0x7fcb2c00c990 comp rx=0 tx=0).stop 2023-11-18T20:39:02.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.752+0000 7fcb48e0d640 1 --2- 172.21.15.132:0/2671560662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb44072310 0x7fcb440a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.752+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 >> 172.21.15.132:0/2671560662 conn(0x7fcb440a77f0 msgr2=0x7fcb44153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.753+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 shutdown_connections 2023-11-18T20:39:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.754+0000 7fcb48e0d640 1 -- 172.21.15.132:0/2671560662 wait complete. 2023-11-18T20:39:02.784 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:02.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.962+0000 7fa51bfff640 1 Processor -- start 2023-11-18T20:39:02.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.962+0000 7fa51bfff640 1 -- start start 2023-11-18T20:39:02.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.964+0000 7fa51bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa51c0c0c80 0x7fa51c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:02.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.964+0000 7fa51bfff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c071e80 con 0x7fa51c0c0440 2023-11-18T20:39:02.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.964+0000 7fa51bfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c072a20 con 0x7fa51c14c2e0 2023-11-18T20:39:02.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.964+0000 7fa51bfff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c071470 con 0x7fa51c0c0c80 2023-11-18T20:39:02.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.964+0000 7fa5127fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa51c0c0440 0x7fa51c072310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37386/0 (socket says 172.21.15.132:37386) 2023-11-18T20:39:02.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.964+0000 7fa5127fc640 1 -- 172.21.15.132:0/3321113583 learned_addr learned my addr 172.21.15.132:0/3321113583 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:02.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.964+0000 7fa51b7fe640 1 --2- 172.21.15.132:0/3321113583 >> v2:172.21.15.161:3300/0 conn(0x7fa51c0c0c80 0x7fa51c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:02.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.964+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756700710 0 0) 0x7fa51c071e80 con 0x7fa51c0c0440 2023-11-18T20:39:02.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa508003520 con 0x7fa51c0c0440 2023-11-18T20:39:02.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116629706 0 0) 0x7fa508003520 con 0x7fa51c0c0440 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 >> v2:172.21.15.161:3300/0 conn(0x7fa51c0c0c80 msgr2=0x7fa51c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 --2- 172.21.15.132:0/3321113583 >> v2:172.21.15.161:3300/0 conn(0x7fa51c0c0c80 0x7fa51c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 >> v1:172.21.15.161:6789/0 conn(0x7fa51c14c2e0 legacy=0x7fa51c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c14c6c0 con 0x7fa51c0c0440 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fa504001670 con 0x7fa51c0c0440 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 >> v1:172.21.15.132:6789/0 conn(0x7fa51c0c0440 legacy=0x7fa51c072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080039c0 0x7fa508003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5080047c0 0x7fa508004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:02.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5080052a0 0x7fa50800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50800c170 con 0x7fa5080047c0 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50800c2e0 con 0x7fa5080052a0 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50800c4a0 con 0x7fa5080039c0 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.965+0000 7fa5127fc640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5080047c0 0x7fa508004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa51affd640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080039c0 0x7fa508003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa51b7fe640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5080052a0 0x7fa50800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa5127fc640 1 -- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080039c0 msgr2=0x7fa508003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa5127fc640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080039c0 0x7fa508003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa5127fc640 1 -- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5080052a0 msgr2=0x7fa50800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa5127fc640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5080052a0 0x7fa50800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa5127fc640 1 -- 172.21.15.132:0/3321113583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508003520 con 0x7fa5080047c0 2023-11-18T20:39:02.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa51b7fe640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5080052a0 0x7fa50800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:02.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.966+0000 7fa51b7fe640 1 -- 172.21.15.132:0/3321113583 reap_dead start 2023-11-18T20:39:02.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.967+0000 7fa5127fc640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5080047c0 0x7fa508004c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa504007fc0 tx=0x7fa5080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a85c95b40b77ad0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:02.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.967+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504005ad0 con 0x7fa5080047c0 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.967+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504005c30 con 0x7fa5080047c0 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.967+0000 7fa51a7fc640 1 -- 172.21.15.132:0/3321113583 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50402c7c0 con 0x7fa5080047c0 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.968+0000 7fa51bfff640 1 -- 172.21.15.132:0/3321113583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5080047c0 msgr2=0x7fa508004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.968+0000 7fa51bfff640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5080047c0 0x7fa508004c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa504007fc0 tx=0x7fa5080057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.968+0000 7fa51bfff640 1 -- 172.21.15.132:0/3321113583 shutdown_connections 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.968+0000 7fa51bfff640 1 --2- 172.21.15.132:0/3321113583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5080047c0 0x7fa508004c40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.968+0000 7fa51bfff640 1 -- 172.21.15.132:0/3321113583 >> 172.21.15.132:0/3321113583 conn(0x7fa51c0a77f0 msgr2=0x7fa51c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.968+0000 7fa51bfff640 1 -- 172.21.15.132:0/3321113583 shutdown_connections 2023-11-18T20:39:02.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.968+0000 7fa51bfff640 1 -- 172.21.15.132:0/3321113583 wait complete. 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.970+0000 7fa51bfff640 1 Processor -- start 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.970+0000 7fa51bfff640 1 -- start start 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.970+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080047c0 0x7fa51c14ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.970+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa51c0a8750 0x7fa51c1e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa51c1ea050 0x7fa51c1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa51bfff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c150190 con 0x7fa51c0a8750 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa51bfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1ea4d0 con 0x7fa51c1ea050 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa51bfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0a9060 con 0x7fa5080047c0 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa5127fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa51c0a8750 0x7fa51c1e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:02.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa5127fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa51c0a8750 0x7fa51c1e9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33264/0 (socket says 172.21.15.132:33264) 2023-11-18T20:39:02.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa5127fc640 1 -- 172.21.15.132:0/1277616189 learned_addr learned my addr 172.21.15.132:0/1277616189 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:02.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa51affd640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080047c0 0x7fa51c14ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:02.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa5127fc640 1 -- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080047c0 msgr2=0x7fa51c14ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:02.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa5127fc640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080047c0 0x7fa51c14ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa5127fc640 1 -- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa51c1ea050 msgr2=0x7fa51c1533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:02.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa5127fc640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa51c1ea050 0x7fa51c1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:02.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.971+0000 7fa5127fc640 1 -- 172.21.15.132:0/1277616189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0a9340 con 0x7fa51c0a8750 2023-11-18T20:39:02.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.972+0000 7fa5127fc640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa51c0a8750 0x7fa51c1e9b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa50402c360 tx=0x7fa51c1521c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:02.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.972+0000 7fa518ff9640 1 -- 172.21.15.132:0/1277616189 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50403c070 con 0x7fa51c0a8750 2023-11-18T20:39:02.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.972+0000 7fa518ff9640 1 -- 172.21.15.132:0/1277616189 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504001b20 con 0x7fa51c0a8750 2023-11-18T20:39:02.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.972+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c0a9620 con 0x7fa51c0a8750 2023-11-18T20:39:02.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.972+0000 7fa518ff9640 1 -- 172.21.15.132:0/1277616189 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50402cbf0 con 0x7fa51c0a8750 2023-11-18T20:39:02.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.972+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c14b260 con 0x7fa51c0a8750 2023-11-18T20:39:02.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.973+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c04e840 con 0x7fa51c0a8750 2023-11-18T20:39:02.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.974+0000 7fa518ff9640 1 -- 172.21.15.132:0/1277616189 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa504032070 con 0x7fa51c0a8750 2023-11-18T20:39:02.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.975+0000 7fa518ff9640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa4fc06ae70 0x7fa4fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:02.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.975+0000 7fa518ff9640 1 -- 172.21.15.132:0/1277616189 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5040aa350 con 0x7fa51c0a8750 2023-11-18T20:39:02.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.975+0000 7fa51affd640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa4fc06ae70 0x7fa4fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:02.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.977+0000 7fa51affd640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa4fc06ae70 0x7fa4fc06d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa50c001510 tx=0x7fa50c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:02.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:02.979+0000 7fa518ff9640 1 -- 172.21.15.132:0/1277616189 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5040755b0 con 0x7fa51c0a8750 2023-11-18T20:39:03.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.169+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa51c0c5380 con 0x7fa51c0a8750 2023-11-18T20:39:03.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.172+0000 7fa518ff9640 1 -- 172.21.15.132:0/1277616189 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16558 (secure 0 0 0) 0x7fa504045090 con 0x7fa51c0a8750 2023-11-18T20:39:03.174 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:03.174 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":34,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:02.181094+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:03.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa4fc06ae70 msgr2=0x7fa4fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa4fc06ae70 0x7fa4fc06d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa50c001510 tx=0x7fa50c009040 comp rx=0 tx=0).stop 2023-11-18T20:39:03.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa51c0a8750 msgr2=0x7fa51c1e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa51c0a8750 0x7fa51c1e9b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa50402c360 tx=0x7fa51c1521c0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 shutdown_connections 2023-11-18T20:39:03.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa4fc06ae70 0x7fa4fc06d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa51c1ea050 0x7fa51c1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa51c0a8750 0x7fa51c1e9b10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 --2- 172.21.15.132:0/1277616189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5080047c0 0x7fa51c14ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 >> 172.21.15.132:0/1277616189 conn(0x7fa51c0a77f0 msgr2=0x7fa51c1518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:03.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.175+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 shutdown_connections 2023-11-18T20:39:03.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.176+0000 7fa51bfff640 1 -- 172.21.15.132:0/1277616189 wait complete. 2023-11-18T20:39:03.194 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:03.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.397+0000 7f2cb4fa0640 1 Processor -- start 2023-11-18T20:39:03.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.397+0000 7f2cb4fa0640 1 -- start start 2023-11-18T20:39:03.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.398+0000 7f2cb4fa0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb00a4eb0 0x7f2cb0154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.398+0000 7f2cb4fa0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2cb006bec0 0x7f2cb00c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.398+0000 7f2cb4fa0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb00c1d30 con 0x7f2cb014e170 2023-11-18T20:39:03.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.398+0000 7f2cb4fa0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb01519e0 con 0x7f2cb006bec0 2023-11-18T20:39:03.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.398+0000 7f2cb4fa0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb006c350 con 0x7f2cb00a4eb0 2023-11-18T20:39:03.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.399+0000 7f2caffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2cb006bec0 0x7f2cb00c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.399+0000 7f2ca7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb00a4eb0 0x7f2cb0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.399+0000 7f2caffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2cb006bec0 0x7f2cb00c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:46394/0 (socket says 172.21.15.132:46394) 2023-11-18T20:39:03.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.399+0000 7f2caffff640 1 -- 172.21.15.132:0/613149504 learned_addr learned my addr 172.21.15.132:0/613149504 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:03.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.399+0000 7f2caf7fe640 1 --1- 172.21.15.132:0/613149504 >> v1:172.21.15.161:6789/0 conn(0x7f2cb014e170 0x7f2cb01512d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:37894/0 (socket says 172.21.15.132:37894) 2023-11-18T20:39:03.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.400+0000 7f2ca7fff640 1 -- 172.21.15.132:0/613149504 >> v2:172.21.15.161:3300/0 conn(0x7f2cb006bec0 msgr2=0x7f2cb00c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:03.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.400+0000 7f2ca7fff640 1 --2- 172.21.15.132:0/613149504 >> v2:172.21.15.161:3300/0 conn(0x7f2cb006bec0 0x7f2cb00c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.400+0000 7f2ca7fff640 1 -- 172.21.15.132:0/613149504 >> v1:172.21.15.161:6789/0 conn(0x7f2cb014e170 legacy=0x7f2cb01512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.400+0000 7f2ca7fff640 1 -- 172.21.15.132:0/613149504 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00c51f0 con 0x7f2cb00a4eb0 2023-11-18T20:39:03.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.400+0000 7f2caffff640 1 --2- 172.21.15.132:0/613149504 >> v2:172.21.15.161:3300/0 conn(0x7f2cb006bec0 0x7f2cb00c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:39:03.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.401+0000 7f2ca7fff640 1 --2- 172.21.15.132:0/613149504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb00a4eb0 0x7f2cb0154910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c980097a0 tx=0x7f2c9802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8efd9cc01c87edb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:03.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.402+0000 7f2caeffd640 1 -- 172.21.15.132:0/613149504 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98031780 con 0x7f2cb00a4eb0 2023-11-18T20:39:03.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.402+0000 7f2caeffd640 1 -- 172.21.15.132:0/613149504 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c980318e0 con 0x7f2cb00a4eb0 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.402+0000 7f2caeffd640 1 -- 172.21.15.132:0/613149504 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98031c70 con 0x7f2cb00a4eb0 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.402+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/613149504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb00a4eb0 msgr2=0x7f2cb0154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.403+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/613149504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb00a4eb0 0x7f2cb0154910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c980097a0 tx=0x7f2c9802b820 comp rx=0 tx=0).stop 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.403+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/613149504 shutdown_connections 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.403+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/613149504 >> v2:172.21.15.161:3300/0 conn(0x7f2cb006bec0 0x7f2cb00c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.403+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/613149504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb00a4eb0 0x7f2cb0154910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.403+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/613149504 >> 172.21.15.132:0/613149504 conn(0x7f2cb00a77f0 msgr2=0x7f2cb00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.403+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/613149504 shutdown_connections 2023-11-18T20:39:03.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.403+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/613149504 wait complete. 2023-11-18T20:39:03.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.405+0000 7f2cb4fa0640 1 Processor -- start 2023-11-18T20:39:03.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.405+0000 7f2cb4fa0640 1 -- start start 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2cb4fa0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb006bec0 0x7f2cb00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2cb4fa0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cb00a4eb0 0x7f2cb01ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2cb4fa0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cb014e170 0x7f2cb01edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2cb4fa0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb00a5650 con 0x7f2cb014e170 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2cb4fa0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb00a6c40 con 0x7f2cb00a4eb0 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2cb4fa0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb01ee0c0 con 0x7f2cb006bec0 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2caffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cb014e170 0x7f2cb01edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2caffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cb014e170 0x7f2cb01edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33280/0 (socket says 172.21.15.132:33280) 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.406+0000 7f2caffff640 1 -- 172.21.15.132:0/3796835908 learned_addr learned my addr 172.21.15.132:0/3796835908 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:03.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2ca7fff640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cb00a4eb0 0x7f2cb01ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2caf7fe640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb006bec0 0x7f2cb00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2caffff640 1 -- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb006bec0 msgr2=0x7f2cb00a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2caffff640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb006bec0 0x7f2cb00a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2caffff640 1 -- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cb00a4eb0 msgr2=0x7f2cb01ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2caffff640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cb00a4eb0 0x7f2cb01ed640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2caffff640 1 -- 172.21.15.132:0/3796835908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca800bd40 con 0x7f2cb014e170 2023-11-18T20:39:03.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2caffff640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cb014e170 0x7f2cb01edb80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800bfd0 tx=0x7f2ca800e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:03.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2cacff9640 1 -- 172.21.15.132:0/3796835908 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8010040 con 0x7f2cb014e170 2023-11-18T20:39:03.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2cacff9640 1 -- 172.21.15.132:0/3796835908 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca800ed20 con 0x7f2cb014e170 2023-11-18T20:39:03.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2cacff9640 1 -- 172.21.15.132:0/3796835908 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8003bb0 con 0x7f2cb014e170 2023-11-18T20:39:03.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.407+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c98009400 con 0x7f2cb014e170 2023-11-18T20:39:03.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.408+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb0151e60 con 0x7f2cb014e170 2023-11-18T20:39:03.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.409+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb00c00b0 con 0x7f2cb014e170 2023-11-18T20:39:03.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.410+0000 7f2cacff9640 1 -- 172.21.15.132:0/3796835908 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ca8003d10 con 0x7f2cb014e170 2023-11-18T20:39:03.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.411+0000 7f2cacff9640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2c9006ae70 0x7f2c9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.411+0000 7f2cacff9640 1 -- 172.21.15.132:0/3796835908 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ca8089560 con 0x7f2cb014e170 2023-11-18T20:39:03.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.411+0000 7f2caf7fe640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2c9006ae70 0x7f2c9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.412+0000 7f2caf7fe640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2c9006ae70 0x7f2c9006d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0000f60 tx=0x7f2ca0007c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:03.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.415+0000 7f2cacff9640 1 -- 172.21.15.132:0/3796835908 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ca8054600 con 0x7f2cb014e170 2023-11-18T20:39:03.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.594+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cb004e840 con 0x7f2cb014e170 2023-11-18T20:39:03.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.596+0000 7f2cacff9640 1 -- 172.21.15.132:0/3796835908 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f2ca8057c20 con 0x7f2cb014e170 2023-11-18T20:39:03.598 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:03.598 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":34,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:02.181094+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:03.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2c9006ae70 msgr2=0x7f2c9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2c9006ae70 0x7f2c9006d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0000f60 tx=0x7f2ca0007c80 comp rx=0 tx=0).stop 2023-11-18T20:39:03.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cb014e170 msgr2=0x7f2cb01edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cb014e170 0x7f2cb01edb80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800bfd0 tx=0x7f2ca800e490 comp rx=0 tx=0).stop 2023-11-18T20:39:03.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 shutdown_connections 2023-11-18T20:39:03.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2c9006ae70 0x7f2c9006d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cb014e170 0x7f2cb01edb80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cb00a4eb0 0x7f2cb01ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 --2- 172.21.15.132:0/3796835908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2cb006bec0 0x7f2cb00a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 >> 172.21.15.132:0/3796835908 conn(0x7f2cb00a77f0 msgr2=0x7f2cb00c0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:03.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 shutdown_connections 2023-11-18T20:39:03.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.599+0000 7f2cb4fa0640 1 -- 172.21.15.132:0/3796835908 wait complete. 2023-11-18T20:39:03.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-18T20:39:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.834+0000 7f80ce6da640 1 Processor -- start 2023-11-18T20:39:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.834+0000 7f80ce6da640 1 -- start start 2023-11-18T20:39:03.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.835+0000 7f80ce6da640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c814fd30 0x7f80c8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.835+0000 7f80ce6da640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f80c806d0a0 0x7f80c80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.835+0000 7f80ce6da640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c80c64a0 con 0x7f80c80a5260 2023-11-18T20:39:03.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.835+0000 7f80ce6da640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c80c5c00 con 0x7f80c806d0a0 2023-11-18T20:39:03.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.835+0000 7f80ce6da640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80c5ee0 con 0x7f80c814fd30 2023-11-18T20:39:03.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80bffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f80c806d0a0 0x7f80c80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80bffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f80c806d0a0 0x7f80c80a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33296/0 (socket says 172.21.15.132:33296) 2023-11-18T20:39:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80bffff640 1 -- 172.21.15.132:0/3914359919 learned_addr learned my addr 172.21.15.132:0/3914359919 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80c7fff640 1 --2- 172.21.15.132:0/3914359919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c814fd30 0x7f80c8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80bffff640 1 -- 172.21.15.132:0/3914359919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c814fd30 msgr2=0x7f80c8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80bffff640 1 --2- 172.21.15.132:0/3914359919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c814fd30 0x7f80c8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80bffff640 1 -- 172.21.15.132:0/3914359919 >> v1:172.21.15.161:6789/0 conn(0x7f80c80a5260 legacy=0x7f80c80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80bffff640 1 -- 172.21.15.132:0/3914359919 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c80c61c0 con 0x7f80c806d0a0 2023-11-18T20:39:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.836+0000 7f80c7fff640 1 --2- 172.21.15.132:0/3914359919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c814fd30 0x7f80c8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.837+0000 7f80bffff640 1 --2- 172.21.15.132:0/3914359919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c806d0a0 0x7f80c80a4d20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009870 tx=0x7f80b002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33c827446421838 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80c77fe640 1 -- 172.21.15.132:0/3914359919 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0031640 con 0x7f80c806d0a0 2023-11-18T20:39:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80c77fe640 1 -- 172.21.15.132:0/3914359919 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b00317a0 con 0x7f80c806d0a0 2023-11-18T20:39:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80c77fe640 1 -- 172.21.15.132:0/3914359919 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0031b30 con 0x7f80c806d0a0 2023-11-18T20:39:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80ce6da640 1 -- 172.21.15.132:0/3914359919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c806d0a0 msgr2=0x7f80c80a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3914359919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c806d0a0 0x7f80c80a4d20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009870 tx=0x7f80b002b8f0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80ce6da640 1 -- 172.21.15.132:0/3914359919 shutdown_connections 2023-11-18T20:39:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3914359919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c806d0a0 0x7f80c80a4d20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3914359919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c814fd30 0x7f80c8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80ce6da640 1 -- 172.21.15.132:0/3914359919 >> 172.21.15.132:0/3914359919 conn(0x7f80c806a500 msgr2=0x7f80c806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80ce6da640 1 -- 172.21.15.132:0/3914359919 shutdown_connections 2023-11-18T20:39:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.838+0000 7f80ce6da640 1 -- 172.21.15.132:0/3914359919 wait complete. 2023-11-18T20:39:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.840+0000 7f80ce6da640 1 Processor -- start 2023-11-18T20:39:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.840+0000 7f80ce6da640 1 -- start start 2023-11-18T20:39:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80ce6da640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c806d0a0 0x7f80c81ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80ce6da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c80a5260 0x7f80c8152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80ce6da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80c814fd30 0x7f80c81edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80ce6da640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80aa850 con 0x7f80c80a5260 2023-11-18T20:39:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80ce6da640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c81dc880 con 0x7f80c814fd30 2023-11-18T20:39:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80ce6da640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80aaaa0 con 0x7f80c806d0a0 2023-11-18T20:39:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80bffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c80a5260 0x7f80c8152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80bffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c80a5260 0x7f80c8152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33306/0 (socket says 172.21.15.132:33306) 2023-11-18T20:39:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80bffff640 1 -- 172.21.15.132:0/3781499409 learned_addr learned my addr 172.21.15.132:0/3781499409 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.841+0000 7f80c7fff640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c806d0a0 0x7f80c81ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80bffff640 1 -- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c806d0a0 msgr2=0x7f80c81ea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80ccc77640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80c814fd30 0x7f80c81edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80bffff640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c806d0a0 0x7f80c81ea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80bffff640 1 -- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80c814fd30 msgr2=0x7f80c81edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80bffff640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80c814fd30 0x7f80c81edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80bffff640 1 -- 172.21.15.132:0/3781499409 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b00094d0 con 0x7f80c80a5260 2023-11-18T20:39:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80c7fff640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c806d0a0 0x7f80c81ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80ccc77640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80c814fd30 0x7f80c81edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80bffff640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c80a5260 0x7f80c8152340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009870 tx=0x7f80b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80c57fa640 1 -- 172.21.15.132:0/3781499409 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b003ac60 con 0x7f80c80a5260 2023-11-18T20:39:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80c57fa640 1 -- 172.21.15.132:0/3781499409 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b003ade0 con 0x7f80c80a5260 2023-11-18T20:39:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80c57fa640 1 -- 172.21.15.132:0/3781499409 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0044630 con 0x7f80c80a5260 2023-11-18T20:39:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.842+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c81ed750 con 0x7f80c80a5260 2023-11-18T20:39:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.843+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8152880 con 0x7f80c80a5260 2023-11-18T20:39:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.843+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c8068350 con 0x7f80c80a5260 2023-11-18T20:39:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.844+0000 7f80c57fa640 1 -- 172.21.15.132:0/3781499409 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80b002f050 con 0x7f80c80a5260 2023-11-18T20:39:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.845+0000 7f80c57fa640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f80a806ae40 0x7f80a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.845+0000 7f80c57fa640 1 -- 172.21.15.132:0/3781499409 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80b00ab830 con 0x7f80c80a5260 2023-11-18T20:39:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.846+0000 7f80c7fff640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f80a806ae40 0x7f80a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.847+0000 7f80c7fff640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f80a806ae40 0x7f80a806d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f80b8006fd0 tx=0x7f80b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:03.849+0000 7f80c57fa640 1 -- 172.21.15.132:0/3781499409 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80b0076840 con 0x7f80c80a5260 2023-11-18T20:39:04.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.076+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f80c806d540 con 0x7f80c80a5260 2023-11-18T20:39:04.604 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-11-18T20:39:04.603+0000 7f9cddaf5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:39:04.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.769+0000 7f80c57fa640 1 -- 172.21.15.132:0/3781499409 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f80b0079e60 con 0x7f80c80a5260 2023-11-18T20:39:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.772+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f80a806ae40 msgr2=0x7f80a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.772+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f80a806ae40 0x7f80a806d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f80b8006fd0 tx=0x7f80b8008040 comp rx=0 tx=0).stop 2023-11-18T20:39:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.772+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c80a5260 msgr2=0x7f80c8152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.772+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c80a5260 0x7f80c8152340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009870 tx=0x7f80b00046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.773+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 shutdown_connections 2023-11-18T20:39:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.773+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f80a806ae40 0x7f80a806d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.773+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80c814fd30 0x7f80c81edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.773+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c80a5260 0x7f80c8152340 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:04.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.773+0000 7f80ce6da640 1 --2- 172.21.15.132:0/3781499409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80c806d0a0 0x7f80c81ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:04.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.773+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 >> 172.21.15.132:0/3781499409 conn(0x7f80c806a500 msgr2=0x7f80c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:04.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.773+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 shutdown_connections 2023-11-18T20:39:04.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:04.773+0000 7f80ce6da640 1 -- 172.21.15.132:0/3781499409 wait complete. 2023-11-18T20:39:04.793 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T20:39:04.793 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-18T20:39:05.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.012+0000 7ff29ebdc640 1 Processor -- start 2023-11-18T20:39:05.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.012+0000 7ff29ebdc640 1 -- start start 2023-11-18T20:39:05.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.014+0000 7ff29ebdc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff29806d0a0 0x7ff298152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:05.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.014+0000 7ff29ebdc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980c64a0 con 0x7ff29814fd30 2023-11-18T20:39:05.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.014+0000 7ff29ebdc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980c5c00 con 0x7ff2980c3ea0 2023-11-18T20:39:05.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.014+0000 7ff29ebdc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980c5ee0 con 0x7ff29806d0a0 2023-11-18T20:39:05.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.014+0000 7ff29c978640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff29814fd30 0x7ff2980a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37392/0 (socket says 172.21.15.132:37392) 2023-11-18T20:39:05.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.014+0000 7ff29c978640 1 -- 172.21.15.132:0/2137720222 learned_addr learned my addr 172.21.15.132:0/2137720222 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:05.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.014+0000 7ff297fff640 1 --2- 172.21.15.132:0/2137720222 >> v2:172.21.15.161:3300/0 conn(0x7ff29806d0a0 0x7ff298152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:05.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957894806 0 0) 0x7ff2980c64a0 con 0x7ff29814fd30 2023-11-18T20:39:05.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff288003520 con 0x7ff29814fd30 2023-11-18T20:39:05.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3538461369 0 0) 0x7ff288003520 con 0x7ff29814fd30 2023-11-18T20:39:05.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 >> v2:172.21.15.161:3300/0 conn(0x7ff29806d0a0 msgr2=0x7ff298152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:05.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 --2- 172.21.15.132:0/2137720222 >> v2:172.21.15.161:3300/0 conn(0x7ff29806d0a0 0x7ff298152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 >> v1:172.21.15.161:6789/0 conn(0x7ff2980c3ea0 legacy=0x7ff2980c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:05.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980c61c0 con 0x7ff29814fd30 2023-11-18T20:39:05.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7ff28c001670 con 0x7ff29814fd30 2023-11-18T20:39:05.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 >> v1:172.21.15.132:6789/0 conn(0x7ff29814fd30 legacy=0x7ff2980a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:05.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff288003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:05.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2880047c0 0x7ff288004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:05.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff288005180 0x7ff28800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:05.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c5ee0 con 0x7ff288003970 2023-11-18T20:39:05.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28800c020 con 0x7ff2880047c0 2023-11-18T20:39:05.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.015+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28800c1e0 con 0x7ff288005180 2023-11-18T20:39:05.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.016+0000 7ff29c978640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff288003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:05.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.016+0000 7ff297fff640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2880047c0 0x7ff288004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:05.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.016+0000 7ff29c978640 1 -- 172.21.15.132:0/2137720222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff288005180 msgr2=0x7ff28800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:05.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.016+0000 7ff29c978640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff288005180 0x7ff28800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.016+0000 7ff29c978640 1 -- 172.21.15.132:0/2137720222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2880047c0 msgr2=0x7ff288004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:05.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.016+0000 7ff29c978640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2880047c0 0x7ff288004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.016+0000 7ff29c978640 1 -- 172.21.15.132:0/2137720222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288003520 con 0x7ff288003970 2023-11-18T20:39:05.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.016+0000 7ff29d179640 1 -- 172.21.15.132:0/2137720222 reap_dead start 2023-11-18T20:39:05.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.017+0000 7ff29c978640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff288003d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00c240 tx=0x7ff2880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d507401849fa2d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:05.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.017+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c005ad0 con 0x7ff288003970 2023-11-18T20:39:05.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.017+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c005c50 con 0x7ff288003970 2023-11-18T20:39:05.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.017+0000 7ff2977fe640 1 -- 172.21.15.132:0/2137720222 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c02c8b0 con 0x7ff288003970 2023-11-18T20:39:05.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.018+0000 7ff29ebdc640 1 -- 172.21.15.132:0/2137720222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 msgr2=0x7ff288003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:05.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.018+0000 7ff29ebdc640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff288003d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00c240 tx=0x7ff2880057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.018+0000 7ff29ebdc640 1 -- 172.21.15.132:0/2137720222 shutdown_connections 2023-11-18T20:39:05.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.018+0000 7ff29ebdc640 1 --2- 172.21.15.132:0/2137720222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff288003d90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.018+0000 7ff29ebdc640 1 -- 172.21.15.132:0/2137720222 >> 172.21.15.132:0/2137720222 conn(0x7ff29806a500 msgr2=0x7ff29806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:05.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.018+0000 7ff29ebdc640 1 -- 172.21.15.132:0/2137720222 shutdown_connections 2023-11-18T20:39:05.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.018+0000 7ff29ebdc640 1 -- 172.21.15.132:0/2137720222 wait complete. 2023-11-18T20:39:05.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.020+0000 7ff29ebdc640 1 Processor -- start 2023-11-18T20:39:05.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.020+0000 7ff29ebdc640 1 -- start start 2023-11-18T20:39:05.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29ebdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff2980a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:05.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29ebdc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29814f1e0 0x7ff2981dc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:05.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29ebdc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2981dc780 0x7ff2981eb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:05.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29ebdc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980baf90 con 0x7ff288003970 2023-11-18T20:39:05.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29ebdc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981dbad0 con 0x7ff29814f1e0 2023-11-18T20:39:05.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29ebdc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981dbdb0 con 0x7ff2981dc780 2023-11-18T20:39:05.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29c978640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff2980a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:05.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29c978640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff2980a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33320/0 (socket says 172.21.15.132:33320) 2023-11-18T20:39:05.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.021+0000 7ff29c978640 1 -- 172.21.15.132:0/3855784157 learned_addr learned my addr 172.21.15.132:0/3855784157 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:05.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff29c978640 1 -- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2981dc780 msgr2=0x7ff2981eb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:05.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff29c978640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2981dc780 0x7ff2981eb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff297fff640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29814f1e0 0x7ff2981dc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:05.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff29c978640 1 -- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29814f1e0 msgr2=0x7ff2981dc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:05.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff29c978640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29814f1e0 0x7ff2981dc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff29c978640 1 -- 172.21.15.132:0/3855784157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29814ef90 con 0x7ff288003970 2023-11-18T20:39:05.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff29c978640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff2980a6c30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff28c02c450 tx=0x7ff28c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:05.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff2957fa640 1 -- 172.21.15.132:0/3855784157 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c03c040 con 0x7ff288003970 2023-11-18T20:39:05.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff2957fa640 1 -- 172.21.15.132:0/3855784157 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c02cd80 con 0x7ff288003970 2023-11-18T20:39:05.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29814ecb0 con 0x7ff288003970 2023-11-18T20:39:05.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.022+0000 7ff2957fa640 1 -- 172.21.15.132:0/3855784157 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c007290 con 0x7ff288003970 2023-11-18T20:39:05.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.023+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2981e8c80 con 0x7ff288003970 2023-11-18T20:39:05.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.024+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2981e8e10 con 0x7ff288003970 2023-11-18T20:39:05.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.025+0000 7ff2957fa640 1 -- 172.21.15.132:0/3855784157 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff28c032070 con 0x7ff288003970 2023-11-18T20:39:05.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.026+0000 7ff2957fa640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff27c06ae40 0x7ff27c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:05.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.026+0000 7ff2957fa640 1 -- 172.21.15.132:0/3855784157 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff28c0aa440 con 0x7ff288003970 2023-11-18T20:39:05.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.026+0000 7ff297fff640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff27c06ae40 0x7ff27c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:05.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.027+0000 7ff297fff640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff27c06ae40 0x7ff27c06d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2980a4dd0 tx=0x7ff284008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:05.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.030+0000 7ff2957fa640 1 -- 172.21.15.132:0/3855784157 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff28c0754e0 con 0x7ff288003970 2023-11-18T20:39:05.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.260+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff298068350 con 0x7ff288003970 2023-11-18T20:39:05.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.772+0000 7ff2957fa640 1 -- 172.21.15.132:0/3855784157 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff28c078b00 con 0x7ff288003970 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff27c06ae40 msgr2=0x7ff27c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff27c06ae40 0x7ff27c06d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2980a4dd0 tx=0x7ff284008040 comp rx=0 tx=0).stop 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 msgr2=0x7ff2980a6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff2980a6c30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff28c02c450 tx=0x7ff28c02e070 comp rx=0 tx=0).stop 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 shutdown_connections 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff27c06ae40 0x7ff27c06d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2981dc780 0x7ff2981eb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29814f1e0 0x7ff2981dc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 --2- 172.21.15.132:0/3855784157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288003970 0x7ff2980a6c30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.776+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 >> 172.21.15.132:0/3855784157 conn(0x7ff29806a500 msgr2=0x7ff2980c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.777+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 shutdown_connections 2023-11-18T20:39:05.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:05.777+0000 7ff29ebdc640 1 -- 172.21.15.132:0/3855784157 wait complete. 2023-11-18T20:39:05.801 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-18T20:39:05.802 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:39:06.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.015+0000 7fa85e80e640 1 Processor -- start 2023-11-18T20:39:06.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.015+0000 7fa85e80e640 1 -- start start 2023-11-18T20:39:06.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.016+0000 7fa85e80e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa85814fd30 0x7fa858152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.016+0000 7fa85e80e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa85806d0a0 0x7fa8580a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.016+0000 7fa85e80e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580c64a0 con 0x7fa8580a5260 2023-11-18T20:39:06.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.016+0000 7fa85e80e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8580c5c00 con 0x7fa85806d0a0 2023-11-18T20:39:06.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.016+0000 7fa85e80e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580c5ee0 con 0x7fa85814fd30 2023-11-18T20:39:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.017+0000 7fa84ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa85806d0a0 0x7fa8580a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.017+0000 7fa857fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa85814fd30 0x7fa858152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.017+0000 7fa84ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa85806d0a0 0x7fa8580a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:46444/0 (socket says 172.21.15.132:46444) 2023-11-18T20:39:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.017+0000 7fa84ffff640 1 -- 172.21.15.132:0/3069242050 learned_addr learned my addr 172.21.15.132:0/3069242050 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.018+0000 7fa84ffff640 1 -- 172.21.15.132:0/3069242050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa85814fd30 msgr2=0x7fa858152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.018+0000 7fa84ffff640 1 --2- 172.21.15.132:0/3069242050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa85814fd30 0x7fa858152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.018+0000 7fa84ffff640 1 -- 172.21.15.132:0/3069242050 >> v1:172.21.15.161:6789/0 conn(0x7fa8580a5260 legacy=0x7fa8580c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.018+0000 7fa84ffff640 1 -- 172.21.15.132:0/3069242050 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580c61c0 con 0x7fa85806d0a0 2023-11-18T20:39:06.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.020+0000 7fa84ffff640 1 --2- 172.21.15.132:0/3069242050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85806d0a0 0x7fa8580a4d20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa840009870 tx=0x7fa84002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b8c1769c67b778e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.020+0000 7fa8577fe640 1 -- 172.21.15.132:0/3069242050 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840030840 con 0x7fa85806d0a0 2023-11-18T20:39:06.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.020+0000 7fa8577fe640 1 -- 172.21.15.132:0/3069242050 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8400309a0 con 0x7fa85806d0a0 2023-11-18T20:39:06.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.020+0000 7fa8577fe640 1 -- 172.21.15.132:0/3069242050 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840030d30 con 0x7fa85806d0a0 2023-11-18T20:39:06.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.021+0000 7fa85e80e640 1 -- 172.21.15.132:0/3069242050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85806d0a0 msgr2=0x7fa8580a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.021+0000 7fa85e80e640 1 --2- 172.21.15.132:0/3069242050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85806d0a0 0x7fa8580a4d20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa840009870 tx=0x7fa84002b980 comp rx=0 tx=0).stop 2023-11-18T20:39:06.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.021+0000 7fa85e80e640 1 -- 172.21.15.132:0/3069242050 shutdown_connections 2023-11-18T20:39:06.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.021+0000 7fa85e80e640 1 --2- 172.21.15.132:0/3069242050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85806d0a0 0x7fa8580a4d20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.021+0000 7fa85e80e640 1 --2- 172.21.15.132:0/3069242050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa85814fd30 0x7fa858152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.021+0000 7fa85e80e640 1 -- 172.21.15.132:0/3069242050 >> 172.21.15.132:0/3069242050 conn(0x7fa85806a500 msgr2=0x7fa85806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:06.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.021+0000 7fa85e80e640 1 -- 172.21.15.132:0/3069242050 shutdown_connections 2023-11-18T20:39:06.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.021+0000 7fa85e80e640 1 -- 172.21.15.132:0/3069242050 wait complete. 2023-11-18T20:39:06.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.023+0000 7fa85e80e640 1 Processor -- start 2023-11-18T20:39:06.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.023+0000 7fa85e80e640 1 -- start start 2023-11-18T20:39:06.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.024+0000 7fa85e80e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa85806d0a0 0x7fa85814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.024+0000 7fa85e80e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8580a5260 0x7fa858155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.024+0000 7fa85e80e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85814fd30 0x7fa8581e8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.024+0000 7fa85e80e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8581ec430 con 0x7fa85806d0a0 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.024+0000 7fa85e80e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580bae20 con 0x7fa85814fd30 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.024+0000 7fa85e80e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8581dcca0 con 0x7fa8580a5260 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa857fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa85806d0a0 0x7fa85814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa857fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa85806d0a0 0x7fa85814eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33330/0 (socket says 172.21.15.132:33330) 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa857fff640 1 -- 172.21.15.132:0/2185129942 learned_addr learned my addr 172.21.15.132:0/2185129942 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa85cdab640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85814fd30 0x7fa8581e8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa84ffff640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8580a5260 0x7fa858155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa857fff640 1 -- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8580a5260 msgr2=0x7fa858155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa857fff640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8580a5260 0x7fa858155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa857fff640 1 -- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85814fd30 msgr2=0x7fa8581e8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa857fff640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85814fd30 0x7fa8581e8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa857fff640 1 -- 172.21.15.132:0/2185129942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8400094d0 con 0x7fa85806d0a0 2023-11-18T20:39:06.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.025+0000 7fa84ffff640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8580a5260 0x7fa858155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:06.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.026+0000 7fa857fff640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa85806d0a0 0x7fa85814eab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa84800e870 tx=0x7fa84800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.026+0000 7fa8557fa640 1 -- 172.21.15.132:0/2185129942 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480094f0 con 0x7fa85806d0a0 2023-11-18T20:39:06.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.026+0000 7fa8557fa640 1 -- 172.21.15.132:0/2185129942 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84800c940 con 0x7fa85806d0a0 2023-11-18T20:39:06.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.026+0000 7fa8557fa640 1 -- 172.21.15.132:0/2185129942 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800ccf0 con 0x7fa85806d0a0 2023-11-18T20:39:06.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.026+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8581dcf80 con 0x7fa85806d0a0 2023-11-18T20:39:06.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.026+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8581ddd30 con 0x7fa85806d0a0 2023-11-18T20:39:06.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.027+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa858068350 con 0x7fa85806d0a0 2023-11-18T20:39:06.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.028+0000 7fa8557fa640 1 -- 172.21.15.132:0/2185129942 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa848013470 con 0x7fa85806d0a0 2023-11-18T20:39:06.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.029+0000 7fa8557fa640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa83806ae40 0x7fa83806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.030+0000 7fa8557fa640 1 -- 172.21.15.132:0/2185129942 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa848089740 con 0x7fa85806d0a0 2023-11-18T20:39:06.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.030+0000 7fa84ffff640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa83806ae40 0x7fa83806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.031+0000 7fa84ffff640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa83806ae40 0x7fa83806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa840036000 tx=0x7fa84003b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.034+0000 7fa8557fa640 1 -- 172.21.15.132:0/2185129942 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8480547e0 con 0x7fa85806d0a0 2023-11-18T20:39:06.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.266+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa85806d540 con 0x7fa85806d0a0 2023-11-18T20:39:06.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.268+0000 7fa8557fa640 1 -- 172.21.15.132:0/2185129942 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fa848057e00 con 0x7fa85806d0a0 2023-11-18T20:39:06.269 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:06.269 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:02.182181+0000","modified":"2023-11-18T20:39:05.261751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6834/4266315561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4266315561},{"type":"v1","addr":"172.21.15.132:6834","nonce":4266315561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-18T20:39:06.269 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 15 2023-11-18T20:39:06.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa83806ae40 msgr2=0x7fa83806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa83806ae40 0x7fa83806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa840036000 tx=0x7fa84003b040 comp rx=0 tx=0).stop 2023-11-18T20:39:06.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa85806d0a0 msgr2=0x7fa85814eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa85806d0a0 0x7fa85814eab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa84800e870 tx=0x7fa84800ed30 comp rx=0 tx=0).stop 2023-11-18T20:39:06.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 shutdown_connections 2023-11-18T20:39:06.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa83806ae40 0x7fa83806d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa85814fd30 0x7fa8581e8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8580a5260 0x7fa858155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.270+0000 7fa85e80e640 1 --2- 172.21.15.132:0/2185129942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa85806d0a0 0x7fa85814eab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.271+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 >> 172.21.15.132:0/2185129942 conn(0x7fa85806a500 msgr2=0x7fa85806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:06.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.271+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 shutdown_connections 2023-11-18T20:39:06.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.271+0000 7fa85e80e640 1 -- 172.21.15.132:0/2185129942 wait complete. 2023-11-18T20:39:06.291 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:06.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.494+0000 7f2051f1d640 1 Processor -- start 2023-11-18T20:39:06.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.494+0000 7f2051f1d640 1 -- start start 2023-11-18T20:39:06.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f2051f1d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f204c155490 0x7f204c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f2051f1d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f204c0c1500 0x7f204c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f2051f1d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c0c06c0 con 0x7f204c0c4080 2023-11-18T20:39:06.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f2051f1d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c0a5820 con 0x7f204c155490 2023-11-18T20:39:06.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f2051f1d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c0c1020 con 0x7f204c0c1500 2023-11-18T20:39:06.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f204b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f204c155490 0x7f204c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f204b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f204c155490 0x7f204c0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33344/0 (socket says 172.21.15.132:33344) 2023-11-18T20:39:06.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f204b7fe640 1 -- 172.21.15.132:0/3467626168 learned_addr learned my addr 172.21.15.132:0/3467626168 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:06.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f204b7fe640 1 -- 172.21.15.132:0/3467626168 >> v2:172.21.15.161:3300/0 conn(0x7f204c0c1500 msgr2=0x7f204c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:06.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f204b7fe640 1 --2- 172.21.15.132:0/3467626168 >> v2:172.21.15.161:3300/0 conn(0x7f204c0c1500 0x7f204c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f204b7fe640 1 -- 172.21.15.132:0/3467626168 >> v1:172.21.15.161:6789/0 conn(0x7f204c0c4080 legacy=0x7f204c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:06.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.496+0000 7f204b7fe640 1 -- 172.21.15.132:0/3467626168 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0c0910 con 0x7f204c155490 2023-11-18T20:39:06.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.498+0000 7f204b7fe640 1 --2- 172.21.15.132:0/3467626168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c155490 0x7f204c0a51b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f204c0a5160 tx=0x7f203c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3865123a858bf18e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.498+0000 7f204a7fc640 1 -- 172.21.15.132:0/3467626168 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c031870 con 0x7f204c155490 2023-11-18T20:39:06.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.498+0000 7f204a7fc640 1 -- 172.21.15.132:0/3467626168 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c0319d0 con 0x7f204c155490 2023-11-18T20:39:06.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.498+0000 7f204a7fc640 1 -- 172.21.15.132:0/3467626168 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c031d60 con 0x7f204c155490 2023-11-18T20:39:06.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.498+0000 7f2051f1d640 1 -- 172.21.15.132:0/3467626168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c155490 msgr2=0x7f204c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.498+0000 7f2051f1d640 1 --2- 172.21.15.132:0/3467626168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c155490 0x7f204c0a51b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f204c0a5160 tx=0x7f203c02b910 comp rx=0 tx=0).stop 2023-11-18T20:39:06.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.499+0000 7f2051f1d640 1 -- 172.21.15.132:0/3467626168 shutdown_connections 2023-11-18T20:39:06.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.499+0000 7f2051f1d640 1 --2- 172.21.15.132:0/3467626168 >> v2:172.21.15.161:3300/0 conn(0x7f204c0c1500 0x7f204c0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.499+0000 7f2051f1d640 1 --2- 172.21.15.132:0/3467626168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c155490 0x7f204c0a51b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.499+0000 7f2051f1d640 1 -- 172.21.15.132:0/3467626168 >> 172.21.15.132:0/3467626168 conn(0x7f204c06a500 msgr2=0x7f204c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:06.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.499+0000 7f2051f1d640 1 -- 172.21.15.132:0/3467626168 shutdown_connections 2023-11-18T20:39:06.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.499+0000 7f2051f1d640 1 -- 172.21.15.132:0/3467626168 wait complete. 2023-11-18T20:39:06.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.500+0000 7f2051f1d640 1 Processor -- start 2023-11-18T20:39:06.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.501+0000 7f2051f1d640 1 -- start start 2023-11-18T20:39:06.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f2051f1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0c1500 0x7f204c14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f2051f1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c4080 0x7f204c14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f2051f1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c155490 0x7f204c071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f2051f1d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c14a190 con 0x7f204c0c4080 2023-11-18T20:39:06.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f2051f1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c14b120 con 0x7f204c0c1500 2023-11-18T20:39:06.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f2051f1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c14cfa0 con 0x7f204c155490 2023-11-18T20:39:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f204affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c4080 0x7f204c14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f204affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c4080 0x7f204c14ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33354/0 (socket says 172.21.15.132:33354) 2023-11-18T20:39:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f204affd640 1 -- 172.21.15.132:0/1838900033 learned_addr learned my addr 172.21.15.132:0/1838900033 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f204affd640 1 -- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c155490 msgr2=0x7f204c071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f204affd640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c155490 0x7f204c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f204affd640 1 -- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0c1500 msgr2=0x7f204c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f204affd640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0c1500 0x7f204c14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.502+0000 7f204affd640 1 -- 172.21.15.132:0/1838900033 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c0094d0 con 0x7f204c0c4080 2023-11-18T20:39:06.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.503+0000 7f204affd640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c4080 0x7f204c14ca60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f204000b4a0 tx=0x7f204000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.503+0000 7f2033fff640 1 -- 172.21.15.132:0/1838900033 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040010610 con 0x7f204c0c4080 2023-11-18T20:39:06.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.503+0000 7f2033fff640 1 -- 172.21.15.132:0/1838900033 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040010770 con 0x7f204c0c4080 2023-11-18T20:39:06.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.503+0000 7f2033fff640 1 -- 172.21.15.132:0/1838900033 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040010b20 con 0x7f204c0c4080 2023-11-18T20:39:06.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.503+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c1ef080 con 0x7f204c0c4080 2023-11-18T20:39:06.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.503+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c14a3e0 con 0x7f204c0c4080 2023-11-18T20:39:06.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.504+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c066af0 con 0x7f204c0c4080 2023-11-18T20:39:06.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.505+0000 7f2033fff640 1 -- 172.21.15.132:0/1838900033 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2040010c80 con 0x7f204c0c4080 2023-11-18T20:39:06.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.506+0000 7f2033fff640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203806ae40 0x7f203806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.506+0000 7f2033fff640 1 -- 172.21.15.132:0/1838900033 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2040089290 con 0x7f204c0c4080 2023-11-18T20:39:06.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.507+0000 7f204b7fe640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203806ae40 0x7f203806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.508+0000 7f204b7fe640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203806ae40 0x7f203806d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f203c036000 tx=0x7f203c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.510+0000 7f2033fff640 1 -- 172.21.15.132:0/1838900033 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f204c066af0 con 0x7f204c0c4080 2023-11-18T20:39:06.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.703+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f204c066af0 con 0x7f204c0c4080 2023-11-18T20:39:06.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.705+0000 7f2033fff640 1 -- 172.21.15.132:0/1838900033 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f204c066af0 con 0x7f204c0c4080 2023-11-18T20:39:06.706 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:06.707 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:03.740412+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:06.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203806ae40 msgr2=0x7f203806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203806ae40 0x7f203806d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f203c036000 tx=0x7f203c030000 comp rx=0 tx=0).stop 2023-11-18T20:39:06.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c4080 msgr2=0x7f204c14ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c4080 0x7f204c14ca60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f204000b4a0 tx=0x7f204000b960 comp rx=0 tx=0).stop 2023-11-18T20:39:06.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 shutdown_connections 2023-11-18T20:39:06.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f203806ae40 0x7f203806d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c155490 0x7f204c071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f204c0c4080 0x7f204c14ca60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 --2- 172.21.15.132:0/1838900033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c0c1500 0x7f204c14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 >> 172.21.15.132:0/1838900033 conn(0x7f204c06a500 msgr2=0x7f204c152b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:06.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 shutdown_connections 2023-11-18T20:39:06.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.708+0000 7f2051f1d640 1 -- 172.21.15.132:0/1838900033 wait complete. 2023-11-18T20:39:06.728 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T20:39:06.729 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:06.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.939+0000 7f40a38c6640 1 Processor -- start 2023-11-18T20:39:06.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.940+0000 7f40a38c6640 1 -- start start 2023-11-18T20:39:06.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.941+0000 7f40a38c6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f409c155fc0 0x7f409c159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.941+0000 7f40a38c6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f409c0c1ca0 0x7f409c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.941+0000 7f40a38c6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409c06d580 con 0x7f409c071e30 2023-11-18T20:39:06.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.941+0000 7f40a38c6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409c06dd60 con 0x7f409c155fc0 2023-11-18T20:39:06.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.941+0000 7f40a38c6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409c0c6580 con 0x7f409c0c1ca0 2023-11-18T20:39:06.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.941+0000 7f40a1662640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f409c155fc0 0x7f409c159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.942+0000 7f40a1662640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f409c155fc0 0x7f409c159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33356/0 (socket says 172.21.15.132:33356) 2023-11-18T20:39:06.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.942+0000 7f40a1662640 1 -- 172.21.15.132:0/2992441617 learned_addr learned my addr 172.21.15.132:0/2992441617 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:06.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.942+0000 7f40a0e61640 1 --2- 172.21.15.132:0/2992441617 >> v2:172.21.15.161:3300/0 conn(0x7f409c0c1ca0 0x7f409c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.942+0000 7f40a1662640 1 -- 172.21.15.132:0/2992441617 >> v2:172.21.15.161:3300/0 conn(0x7f409c0c1ca0 msgr2=0x7f409c0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:06.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.942+0000 7f40a1662640 1 --2- 172.21.15.132:0/2992441617 >> v2:172.21.15.161:3300/0 conn(0x7f409c0c1ca0 0x7f409c0c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.942+0000 7f40a1662640 1 -- 172.21.15.132:0/2992441617 >> v1:172.21.15.132:6789/0 conn(0x7f409c071e30 legacy=0x7f409c15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.942+0000 7f40a1662640 1 -- 172.21.15.132:0/2992441617 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c0726d0 con 0x7f409c155fc0 2023-11-18T20:39:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.942+0000 7f4093fff640 1 -- 172.21.15.132:0/2992441617 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525059812 0 0) 0x7f409c06d580 con 0x7f409c071e30 2023-11-18T20:39:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.943+0000 7f40a1662640 1 --2- 172.21.15.132:0/2992441617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c155fc0 0x7f409c159470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f409c067220 tx=0x7f409802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34a2e58892c184d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f4093fff640 1 -- 172.21.15.132:0/2992441617 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980317d0 con 0x7f409c155fc0 2023-11-18T20:39:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f4093fff640 1 -- 172.21.15.132:0/2992441617 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098031930 con 0x7f409c155fc0 2023-11-18T20:39:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f4093fff640 1 -- 172.21.15.132:0/2992441617 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098031cc0 con 0x7f409c155fc0 2023-11-18T20:39:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f40a38c6640 1 -- 172.21.15.132:0/2992441617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c155fc0 msgr2=0x7f409c159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f40a38c6640 1 --2- 172.21.15.132:0/2992441617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c155fc0 0x7f409c159470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f409c067220 tx=0x7f409802b870 comp rx=0 tx=0).stop 2023-11-18T20:39:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f40a38c6640 1 -- 172.21.15.132:0/2992441617 shutdown_connections 2023-11-18T20:39:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f40a38c6640 1 --2- 172.21.15.132:0/2992441617 >> v2:172.21.15.161:3300/0 conn(0x7f409c0c1ca0 0x7f409c0c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f40a38c6640 1 --2- 172.21.15.132:0/2992441617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c155fc0 0x7f409c159470 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.944+0000 7f40a38c6640 1 -- 172.21.15.132:0/2992441617 >> 172.21.15.132:0/2992441617 conn(0x7f409c06a500 msgr2=0x7f409c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.945+0000 7f40a38c6640 1 -- 172.21.15.132:0/2992441617 shutdown_connections 2023-11-18T20:39:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.945+0000 7f40a38c6640 1 -- 172.21.15.132:0/2992441617 wait complete. 2023-11-18T20:39:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.946+0000 7f40a38c6640 1 Processor -- start 2023-11-18T20:39:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.946+0000 7f40a38c6640 1 -- start start 2023-11-18T20:39:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.947+0000 7f40a38c6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c071e30 0x7f409c1ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.947+0000 7f40a38c6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f409c0c1ca0 0x7f409c15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.947+0000 7f40a38c6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409c155fc0 0x7f409c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.947+0000 7f40a38c6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0bb580 con 0x7f409c071e30 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.947+0000 7f40a38c6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c1eed90 con 0x7f409c155fc0 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.947+0000 7f40a38c6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0a56a0 con 0x7f409c0c1ca0 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c071e30 0x7f409c1ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c071e30 0x7f409c1ee850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33368/0 (socket says 172.21.15.132:33368) 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 -- 172.21.15.132:0/1303647124 learned_addr learned my addr 172.21.15.132:0/1303647124 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1e63640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409c155fc0 0x7f409c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 -- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f409c0c1ca0 msgr2=0x7f409c15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f409c0c1ca0 0x7f409c15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 -- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409c155fc0 msgr2=0x7f409c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409c155fc0 0x7f409c151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 -- 172.21.15.132:0/1303647124 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980094d0 con 0x7f409c071e30 2023-11-18T20:39:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.948+0000 7f40a1662640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c071e30 0x7f409c1ee850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f409802b8b0 tx=0x7f40980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.949+0000 7f4091ffb640 1 -- 172.21.15.132:0/1303647124 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098032870 con 0x7f409c071e30 2023-11-18T20:39:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.949+0000 7f4091ffb640 1 -- 172.21.15.132:0/1303647124 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40980329d0 con 0x7f409c071e30 2023-11-18T20:39:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.949+0000 7f4091ffb640 1 -- 172.21.15.132:0/1303647124 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098032d80 con 0x7f409c071e30 2023-11-18T20:39:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.949+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c0a50e0 con 0x7f409c071e30 2023-11-18T20:39:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.949+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409c0bad80 con 0x7f409c071e30 2023-11-18T20:39:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.950+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409c068350 con 0x7f409c071e30 2023-11-18T20:39:06.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.951+0000 7f4091ffb640 1 -- 172.21.15.132:0/1303647124 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4098030070 con 0x7f409c071e30 2023-11-18T20:39:06.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.951+0000 7f4091ffb640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f408006ae70 0x7f408006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:06.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.952+0000 7f4091ffb640 1 -- 172.21.15.132:0/1303647124 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40980ab4a0 con 0x7f409c071e30 2023-11-18T20:39:06.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.952+0000 7f40a0e61640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f408006ae70 0x7f408006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:06.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.953+0000 7f40a0e61640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f408006ae70 0x7f408006d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f409c0c3e80 tx=0x7f408c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:06.956+0000 7f4091ffb640 1 -- 172.21.15.132:0/1303647124 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4098076690 con 0x7f409c071e30 2023-11-18T20:39:07.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.143+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f409c0c3300 con 0x7f408006ae70 2023-11-18T20:39:07.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.169+0000 7f4091ffb640 1 -- 172.21.15.132:0/1303647124 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281226 (secure 0 0 0) 0x7f408c009e40 con 0x7f408006ae70 2023-11-18T20:39:07.175 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f408006ae70 msgr2=0x7f408006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f408006ae70 0x7f408006d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f409c0c3e80 tx=0x7f408c008040 comp rx=0 tx=0).stop 2023-11-18T20:39:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c071e30 msgr2=0x7f409c1ee850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c071e30 0x7f409c1ee850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f409802b8b0 tx=0x7f40980046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 shutdown_connections 2023-11-18T20:39:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f408006ae70 0x7f408006d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409c155fc0 0x7f409c151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f409c0c1ca0 0x7f409c15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 --2- 172.21.15.132:0/1303647124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f409c071e30 0x7f409c1ee850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 >> 172.21.15.132:0/1303647124 conn(0x7f409c06a500 msgr2=0x7f409c0c26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:07.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 shutdown_connections 2023-11-18T20:39:07.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.175+0000 7f40a38c6640 1 -- 172.21.15.132:0/1303647124 wait complete. 2023-11-18T20:39:07.195 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-11-18T20:39:06.653973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220188,"kb_used_data":4016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754532,"statfs":{"total":773094113280,"available":772868640768,"internally_reserved":0,"allocated":4112384,"data_stored":2300658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.939563"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736567+0000","last_change":"2023-11-18T20:39:01.736567+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736567+0000","last_undegraded":"2023-11-18T20:39:01.736567+0000","last_fullsized":"2023-11-18T20:39:01.736567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727207+0000","last_change":"2023-11-18T20:39:01.727207+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727207+0000","last_undegraded":"2023-11-18T20:39:01.727207+0000","last_fullsized":"2023-11-18T20:39:01.727207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727435+0000","last_change":"2023-11-18T20:39:01.727435+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727435+0000","last_undegraded":"2023-11-18T20:39:01.727435+0000","last_fullsized":"2023-11-18T20:39:01.727435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740148+0000","last_change":"2023-11-18T20:39:01.740148+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740148+0000","last_undegraded":"2023-11-18T20:39:01.740148+0000","last_fullsized":"2023-11-18T20:39:01.740148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.728875+0000","last_change":"2023-11-18T20:39:01.728875+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.728875+0000","last_undegraded":"2023-11-18T20:39:01.728875+0000","last_fullsized":"2023-11-18T20:39:01.728875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740629+0000","last_change":"2023-11-18T20:39:01.740629+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740629+0000","last_undegraded":"2023-11-18T20:39:01.740629+0000","last_fullsized":"2023-11-18T20:39:01.740629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735536+0000","last_change":"2023-11-18T20:39:01.735536+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735536+0000","last_undegraded":"2023-11-18T20:39:01.735536+0000","last_fullsized":"2023-11-18T20:39:01.735536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730543+0000","last_change":"2023-11-18T20:39:01.730543+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730543+0000","last_undegraded":"2023-11-18T20:39:01.730543+0000","last_fullsized":"2023-11-18T20:39:01.730543+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729312+0000","last_change":"2023-11-18T20:39:01.729312+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729312+0000","last_undegraded":"2023-11-18T20:39:01.729312+0000","last_fullsized":"2023-11-18T20:39:01.729312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740999+0000","last_change":"2023-11-18T20:39:01.740999+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740999+0000","last_undegraded":"2023-11-18T20:39:01.740999+0000","last_fullsized":"2023-11-18T20:39:01.740999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737579+0000","last_change":"2023-11-18T20:39:01.737579+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737579+0000","last_undegraded":"2023-11-18T20:39:01.737579+0000","last_fullsized":"2023-11-18T20:39:01.737579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726158+0000","last_change":"2023-11-18T20:39:01.726158+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726158+0000","last_undegraded":"2023-11-18T20:39:01.726158+0000","last_fullsized":"2023-11-18T20:39:01.726158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.732419+0000","last_change":"2023-11-18T20:39:01.732419+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.732419+0000","last_undegraded":"2023-11-18T20:39:01.732419+0000","last_fullsized":"2023-11-18T20:39:01.732419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736349+0000","last_change":"2023-11-18T20:39:01.736349+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736349+0000","last_undegraded":"2023-11-18T20:39:01.736349+0000","last_fullsized":"2023-11-18T20:39:01.736349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727596+0000","last_change":"2023-11-18T20:39:01.727596+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727596+0000","last_undegraded":"2023-11-18T20:39:01.727596+0000","last_fullsized":"2023-11-18T20:39:01.727596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727597+0000","last_change":"2023-11-18T20:39:01.727597+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727597+0000","last_undegraded":"2023-11-18T20:39:01.727597+0000","last_fullsized":"2023-11-18T20:39:01.727597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740320+0000","last_change":"2023-11-18T20:39:01.740320+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740320+0000","last_undegraded":"2023-11-18T20:39:01.740320+0000","last_fullsized":"2023-11-18T20:39:01.740320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.744644+0000","last_change":"2023-11-18T20:39:01.744644+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.744644+0000","last_undegraded":"2023-11-18T20:39:01.744644+0000","last_fullsized":"2023-11-18T20:39:01.744644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.745493+0000","last_change":"2023-11-18T20:39:01.745493+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.745493+0000","last_undegraded":"2023-11-18T20:39:01.745493+0000","last_fullsized":"2023-11-18T20:39:01.745493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735773+0000","last_change":"2023-11-18T20:39:01.735773+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735773+0000","last_undegraded":"2023-11-18T20:39:01.735773+0000","last_fullsized":"2023-11-18T20:39:01.735773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729099+0000","last_change":"2023-11-18T20:39:01.729099+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729099+0000","last_undegraded":"2023-11-18T20:39:01.729099+0000","last_fullsized":"2023-11-18T20:39:01.729099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736589+0000","last_change":"2023-11-18T20:39:01.736589+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736589+0000","last_undegraded":"2023-11-18T20:39:01.736589+0000","last_fullsized":"2023-11-18T20:39:01.736589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.728426+0000","last_change":"2023-11-18T20:39:01.728426+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.728426+0000","last_undegraded":"2023-11-18T20:39:01.728426+0000","last_fullsized":"2023-11-18T20:39:01.728426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730071+0000","last_change":"2023-11-18T20:39:01.730071+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730071+0000","last_undegraded":"2023-11-18T20:39:01.730071+0000","last_fullsized":"2023-11-18T20:39:01.730071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740360+0000","last_change":"2023-11-18T20:39:01.740360+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740360+0000","last_undegraded":"2023-11-18T20:39:01.740360+0000","last_fullsized":"2023-11-18T20:39:01.740360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739182+0000","last_change":"2023-11-18T20:39:01.739182+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739182+0000","last_undegraded":"2023-11-18T20:39:01.739182+0000","last_fullsized":"2023-11-18T20:39:01.739182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730864+0000","last_change":"2023-11-18T20:39:01.730864+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730864+0000","last_undegraded":"2023-11-18T20:39:01.730864+0000","last_fullsized":"2023-11-18T20:39:01.730864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.732054+0000","last_change":"2023-11-18T20:39:01.732054+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.732054+0000","last_undegraded":"2023-11-18T20:39:01.732054+0000","last_fullsized":"2023-11-18T20:39:01.732054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729718+0000","last_change":"2023-11-18T20:39:01.729718+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729718+0000","last_undegraded":"2023-11-18T20:39:01.729718+0000","last_fullsized":"2023-11-18T20:39:01.729718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730086+0000","last_change":"2023-11-18T20:39:01.730086+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730086+0000","last_undegraded":"2023-11-18T20:39:01.730086+0000","last_fullsized":"2023-11-18T20:39:01.730086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730414+0000","last_change":"2023-11-18T20:39:01.730414+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730414+0000","last_undegraded":"2023-11-18T20:39:01.730414+0000","last_fullsized":"2023-11-18T20:39:01.730414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737376+0000","last_change":"2023-11-18T20:39:01.737376+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737376+0000","last_undegraded":"2023-11-18T20:39:01.737376+0000","last_fullsized":"2023-11-18T20:39:01.737376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.731277+0000","last_change":"2023-11-18T20:39:01.731277+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.731277+0000","last_undegraded":"2023-11-18T20:39:01.731277+0000","last_fullsized":"2023-11-18T20:39:01.731277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752468+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:01.752468+0000","last_peered":"2023-11-18T20:39:01.752468+0000","last_clean":"2023-11-18T20:39:01.752468+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:01.752468+0000","last_undegraded":"2023-11-18T20:39:01.752468+0000","last_fullsized":"2023-11-18T20:39:01.752468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:38.916216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735851+0000","last_change":"2023-11-18T20:39:01.735851+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735851+0000","last_undegraded":"2023-11-18T20:39:01.735851+0000","last_fullsized":"2023-11-18T20:39:01.735851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758091+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:01.758091+0000","last_peered":"2023-11-18T20:39:01.758091+0000","last_clean":"2023-11-18T20:39:01.758091+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:01.758091+0000","last_undegraded":"2023-11-18T20:39:01.758091+0000","last_fullsized":"2023-11-18T20:39:01.758091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.731409+0000","last_change":"2023-11-18T20:39:01.731409+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.731409+0000","last_undegraded":"2023-11-18T20:39:01.731409+0000","last_fullsized":"2023-11-18T20:39:01.731409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758077+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:01.758077+0000","last_peered":"2023-11-18T20:39:01.758077+0000","last_clean":"2023-11-18T20:39:01.758077+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:01.758077+0000","last_undegraded":"2023-11-18T20:39:01.758077+0000","last_fullsized":"2023-11-18T20:39:01.758077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:30.395754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737147+0000","last_change":"2023-11-18T20:39:01.737147+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737147+0000","last_undegraded":"2023-11-18T20:39:01.737147+0000","last_fullsized":"2023-11-18T20:39:01.737147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757532+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:01.757532+0000","last_peered":"2023-11-18T20:39:01.757532+0000","last_clean":"2023-11-18T20:39:01.757532+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:01.757532+0000","last_undegraded":"2023-11-18T20:39:01.757532+0000","last_fullsized":"2023-11-18T20:39:01.757532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:11.799576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725990+0000","last_change":"2023-11-18T20:39:01.725990+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725990+0000","last_undegraded":"2023-11-18T20:39:01.725990+0000","last_fullsized":"2023-11-18T20:39:01.725990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752417+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:01.752417+0000","last_peered":"2023-11-18T20:39:01.752417+0000","last_clean":"2023-11-18T20:39:01.752417+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:01.752417+0000","last_undegraded":"2023-11-18T20:39:01.752417+0000","last_fullsized":"2023-11-18T20:39:01.752417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.733840+0000","last_change":"2023-11-18T20:39:01.733840+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.733840+0000","last_undegraded":"2023-11-18T20:39:01.733840+0000","last_fullsized":"2023-11-18T20:39:01.733840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752094+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:01.752094+0000","last_peered":"2023-11-18T20:39:01.752094+0000","last_clean":"2023-11-18T20:39:01.752094+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:01.752094+0000","last_undegraded":"2023-11-18T20:39:01.752094+0000","last_fullsized":"2023-11-18T20:39:01.752094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:12.391708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725359+0000","last_change":"2023-11-18T20:39:01.725359+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725359+0000","last_undegraded":"2023-11-18T20:39:01.725359+0000","last_fullsized":"2023-11-18T20:39:01.725359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757313+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:01.757313+0000","last_peered":"2023-11-18T20:39:01.757313+0000","last_clean":"2023-11-18T20:39:01.757313+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:01.757313+0000","last_undegraded":"2023-11-18T20:39:01.757313+0000","last_fullsized":"2023-11-18T20:39:01.757313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:54:05.972580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.733733+0000","last_change":"2023-11-18T20:39:01.733733+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.733733+0000","last_undegraded":"2023-11-18T20:39:01.733733+0000","last_fullsized":"2023-11-18T20:39:01.733733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753602+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:01.753602+0000","last_peered":"2023-11-18T20:39:01.753602+0000","last_clean":"2023-11-18T20:39:01.753602+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:01.753602+0000","last_undegraded":"2023-11-18T20:39:01.753602+0000","last_fullsized":"2023-11-18T20:39:01.753602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740817+0000","last_change":"2023-11-18T20:39:01.740817+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740817+0000","last_undegraded":"2023-11-18T20:39:01.740817+0000","last_fullsized":"2023-11-18T20:39:01.740817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.746334+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:01.746334+0000","last_peered":"2023-11-18T20:39:01.746334+0000","last_clean":"2023-11-18T20:39:01.746334+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:01.746334+0000","last_undegraded":"2023-11-18T20:39:01.746334+0000","last_fullsized":"2023-11-18T20:39:01.746334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:10:52.835152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739512+0000","last_change":"2023-11-18T20:39:01.739512+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739512+0000","last_undegraded":"2023-11-18T20:39:01.739512+0000","last_fullsized":"2023-11-18T20:39:01.739512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754696+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:01.754696+0000","last_peered":"2023-11-18T20:39:01.754696+0000","last_clean":"2023-11-18T20:39:01.754696+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:01.754696+0000","last_undegraded":"2023-11-18T20:39:01.754696+0000","last_fullsized":"2023-11-18T20:39:01.754696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.738047+0000","last_change":"2023-11-18T20:39:01.738047+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.738047+0000","last_undegraded":"2023-11-18T20:39:01.738047+0000","last_fullsized":"2023-11-18T20:39:01.738047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754748+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:01.754748+0000","last_peered":"2023-11-18T20:39:01.754748+0000","last_clean":"2023-11-18T20:39:01.754748+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:01.754748+0000","last_undegraded":"2023-11-18T20:39:01.754748+0000","last_fullsized":"2023-11-18T20:39:01.754748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:24:41.889891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.742357+0000","last_change":"2023-11-18T20:39:01.742357+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.742357+0000","last_undegraded":"2023-11-18T20:39:01.742357+0000","last_fullsized":"2023-11-18T20:39:01.742357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757289+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:01.757289+0000","last_peered":"2023-11-18T20:39:01.757289+0000","last_clean":"2023-11-18T20:39:01.757289+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:01.757289+0000","last_undegraded":"2023-11-18T20:39:01.757289+0000","last_fullsized":"2023-11-18T20:39:01.757289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:26:40.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736904+0000","last_change":"2023-11-18T20:39:01.736904+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736904+0000","last_undegraded":"2023-11-18T20:39:01.736904+0000","last_fullsized":"2023-11-18T20:39:01.736904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753361+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:01.753361+0000","last_peered":"2023-11-18T20:39:01.753361+0000","last_clean":"2023-11-18T20:39:01.753361+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:01.753361+0000","last_undegraded":"2023-11-18T20:39:01.753361+0000","last_fullsized":"2023-11-18T20:39:01.753361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:02.510547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737205+0000","last_change":"2023-11-18T20:39:01.737205+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737205+0000","last_undegraded":"2023-11-18T20:39:01.737205+0000","last_fullsized":"2023-11-18T20:39:01.737205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758146+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:01.758146+0000","last_peered":"2023-11-18T20:39:01.758146+0000","last_clean":"2023-11-18T20:39:01.758146+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:01.758146+0000","last_undegraded":"2023-11-18T20:39:01.758146+0000","last_fullsized":"2023-11-18T20:39:01.758146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729483+0000","last_change":"2023-11-18T20:39:01.729483+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729483+0000","last_undegraded":"2023-11-18T20:39:01.729483+0000","last_fullsized":"2023-11-18T20:39:01.729483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752979+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:01.752979+0000","last_peered":"2023-11-18T20:39:01.752979+0000","last_clean":"2023-11-18T20:39:01.752979+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:01.752979+0000","last_undegraded":"2023-11-18T20:39:01.752979+0000","last_fullsized":"2023-11-18T20:39:01.752979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:13.456432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.741695+0000","last_change":"2023-11-18T20:39:01.741695+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.741695+0000","last_undegraded":"2023-11-18T20:39:01.741695+0000","last_fullsized":"2023-11-18T20:39:01.741695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753166+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:01.753166+0000","last_peered":"2023-11-18T20:39:01.753166+0000","last_clean":"2023-11-18T20:39:01.753166+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:01.753166+0000","last_undegraded":"2023-11-18T20:39:01.753166+0000","last_fullsized":"2023-11-18T20:39:01.753166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:59.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740348+0000","last_change":"2023-11-18T20:39:01.740348+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740348+0000","last_undegraded":"2023-11-18T20:39:01.740348+0000","last_fullsized":"2023-11-18T20:39:01.740348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.756810+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:01.756810+0000","last_peered":"2023-11-18T20:39:01.756810+0000","last_clean":"2023-11-18T20:39:01.756810+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:01.756810+0000","last_undegraded":"2023-11-18T20:39:01.756810+0000","last_fullsized":"2023-11-18T20:39:01.756810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:33:29.342499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726472+0000","last_change":"2023-11-18T20:39:01.726472+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726472+0000","last_undegraded":"2023-11-18T20:39:01.726472+0000","last_fullsized":"2023-11-18T20:39:01.726472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753727+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:01.753727+0000","last_peered":"2023-11-18T20:39:01.753727+0000","last_clean":"2023-11-18T20:39:01.753727+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:01.753727+0000","last_undegraded":"2023-11-18T20:39:01.753727+0000","last_fullsized":"2023-11-18T20:39:01.753727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725581+0000","last_change":"2023-11-18T20:39:01.725581+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725581+0000","last_undegraded":"2023-11-18T20:39:01.725581+0000","last_fullsized":"2023-11-18T20:39:01.725581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752908+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:01.752908+0000","last_peered":"2023-11-18T20:39:01.752908+0000","last_clean":"2023-11-18T20:39:01.752908+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:01.752908+0000","last_undegraded":"2023-11-18T20:39:01.752908+0000","last_fullsized":"2023-11-18T20:39:01.752908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:17:42.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.742732+0000","last_change":"2023-11-18T20:39:01.742732+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.742732+0000","last_undegraded":"2023-11-18T20:39:01.742732+0000","last_fullsized":"2023-11-18T20:39:01.742732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750482+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:01.750482+0000","last_peered":"2023-11-18T20:39:01.750482+0000","last_clean":"2023-11-18T20:39:01.750482+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:01.750482+0000","last_undegraded":"2023-11-18T20:39:01.750482+0000","last_fullsized":"2023-11-18T20:39:01.750482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736236+0000","last_change":"2023-11-18T20:39:01.736236+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736236+0000","last_undegraded":"2023-11-18T20:39:01.736236+0000","last_fullsized":"2023-11-18T20:39:01.736236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750645+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:01.750645+0000","last_peered":"2023-11-18T20:39:01.750645+0000","last_clean":"2023-11-18T20:39:01.750645+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:01.750645+0000","last_undegraded":"2023-11-18T20:39:01.750645+0000","last_fullsized":"2023-11-18T20:39:01.750645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726073+0000","last_change":"2023-11-18T20:39:01.726073+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726073+0000","last_undegraded":"2023-11-18T20:39:01.726073+0000","last_fullsized":"2023-11-18T20:39:01.726073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753568+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:01.753568+0000","last_peered":"2023-11-18T20:39:01.753568+0000","last_clean":"2023-11-18T20:39:01.753568+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:01.753568+0000","last_undegraded":"2023-11-18T20:39:01.753568+0000","last_fullsized":"2023-11-18T20:39:01.753568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:49:29.015695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727785+0000","last_change":"2023-11-18T20:39:01.727785+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727785+0000","last_undegraded":"2023-11-18T20:39:01.727785+0000","last_fullsized":"2023-11-18T20:39:01.727785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752218+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:01.752218+0000","last_peered":"2023-11-18T20:39:01.752218+0000","last_clean":"2023-11-18T20:39:01.752218+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:01.752218+0000","last_undegraded":"2023-11-18T20:39:01.752218+0000","last_fullsized":"2023-11-18T20:39:01.752218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:59.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725551+0000","last_change":"2023-11-18T20:39:01.725551+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725551+0000","last_undegraded":"2023-11-18T20:39:01.725551+0000","last_fullsized":"2023-11-18T20:39:01.725551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.747318+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:01.747318+0000","last_peered":"2023-11-18T20:39:01.747318+0000","last_clean":"2023-11-18T20:39:01.747318+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:01.747318+0000","last_undegraded":"2023-11-18T20:39:01.747318+0000","last_fullsized":"2023-11-18T20:39:01.747318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:59:41.767445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.744133+0000","last_change":"2023-11-18T20:39:01.744133+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.744133+0000","last_undegraded":"2023-11-18T20:39:01.744133+0000","last_fullsized":"2023-11-18T20:39:01.744133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750469+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:01.750469+0000","last_peered":"2023-11-18T20:39:01.750469+0000","last_clean":"2023-11-18T20:39:01.750469+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:01.750469+0000","last_undegraded":"2023-11-18T20:39:01.750469+0000","last_fullsized":"2023-11-18T20:39:01.750469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:14:43.750184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739864+0000","last_change":"2023-11-18T20:39:01.739864+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739864+0000","last_undegraded":"2023-11-18T20:39:01.739864+0000","last_fullsized":"2023-11-18T20:39:01.739864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754715+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:01.754715+0000","last_peered":"2023-11-18T20:39:01.754715+0000","last_clean":"2023-11-18T20:39:01.754715+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:01.754715+0000","last_undegraded":"2023-11-18T20:39:01.754715+0000","last_fullsized":"2023-11-18T20:39:01.754715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.741417+0000","last_change":"2023-11-18T20:39:01.741417+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.741417+0000","last_undegraded":"2023-11-18T20:39:01.741417+0000","last_fullsized":"2023-11-18T20:39:01.741417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753063+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:01.753063+0000","last_peered":"2023-11-18T20:39:01.753063+0000","last_clean":"2023-11-18T20:39:01.753063+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:01.753063+0000","last_undegraded":"2023-11-18T20:39:01.753063+0000","last_fullsized":"2023-11-18T20:39:01.753063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:29:30.952653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727725+0000","last_change":"2023-11-18T20:39:01.727725+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727725+0000","last_undegraded":"2023-11-18T20:39:01.727725+0000","last_fullsized":"2023-11-18T20:39:01.727725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.749666+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:01.749666+0000","last_peered":"2023-11-18T20:39:01.749666+0000","last_clean":"2023-11-18T20:39:01.749666+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:01.749666+0000","last_undegraded":"2023-11-18T20:39:01.749666+0000","last_fullsized":"2023-11-18T20:39:01.749666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:46.938148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736379+0000","last_change":"2023-11-18T20:39:01.736379+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736379+0000","last_undegraded":"2023-11-18T20:39:01.736379+0000","last_fullsized":"2023-11-18T20:39:01.736379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752157+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:01.752157+0000","last_peered":"2023-11-18T20:39:01.752157+0000","last_clean":"2023-11-18T20:39:01.752157+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:01.752157+0000","last_undegraded":"2023-11-18T20:39:01.752157+0000","last_fullsized":"2023-11-18T20:39:01.752157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:01.329628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735586+0000","last_change":"2023-11-18T20:39:01.735586+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735586+0000","last_undegraded":"2023-11-18T20:39:01.735586+0000","last_fullsized":"2023-11-18T20:39:01.735586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753665+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:01.753665+0000","last_peered":"2023-11-18T20:39:01.753665+0000","last_clean":"2023-11-18T20:39:01.753665+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:01.753665+0000","last_undegraded":"2023-11-18T20:39:01.753665+0000","last_fullsized":"2023-11-18T20:39:01.753665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737588+0000","last_change":"2023-11-18T20:39:01.737588+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737588+0000","last_undegraded":"2023-11-18T20:39:01.737588+0000","last_fullsized":"2023-11-18T20:39:01.737588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757568+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:01.757568+0000","last_peered":"2023-11-18T20:39:01.757568+0000","last_clean":"2023-11-18T20:39:01.757568+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:01.757568+0000","last_undegraded":"2023-11-18T20:39:01.757568+0000","last_fullsized":"2023-11-18T20:39:01.757568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:45.317633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729839+0000","last_change":"2023-11-18T20:39:01.729839+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729839+0000","last_undegraded":"2023-11-18T20:39:01.729839+0000","last_fullsized":"2023-11-18T20:39:01.729839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752941+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:01.752941+0000","last_peered":"2023-11-18T20:39:01.752941+0000","last_clean":"2023-11-18T20:39:01.752941+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:01.752941+0000","last_undegraded":"2023-11-18T20:39:01.752941+0000","last_fullsized":"2023-11-18T20:39:01.752941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:26.685337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T20:39:00.714710+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:00.714710+0000","last_peered":"2023-11-18T20:39:00.714710+0000","last_clean":"2023-11-18T20:39:00.714710+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:00.714710+0000","last_undegraded":"2023-11-18T20:39:00.714710+0000","last_fullsized":"2023-11-18T20:39:00.714710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.877},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0149999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92500000000000004}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.216}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.349}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":2.0750000000000002},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.7370000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":2.1640000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.2290000000000001},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.833}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.1319999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1759999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.282},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.3220000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4379999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.847},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3819999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.8009999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":2.1579999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":731927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.141},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84399999999999997}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.0800000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.351},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.1120000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5329999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.645}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.6970000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.2},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.03}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.444},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.089}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.137},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.304},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.248}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.5149999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.704}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.018}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.85099999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.97799999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.1000000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.216},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.4830000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.569},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5209999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.734},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.764}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.079},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.1859999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.999}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.121},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.2190000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.155},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.3700000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.3400000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":950272,"data_stored":725652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.2569999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.2210000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.85099999999999998}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.05},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.876}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.82599999999999996}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.014},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.4690000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.7210000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.508},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.2989999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:07.200 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:07.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.455+0000 7feba85c9640 1 Processor -- start 2023-11-18T20:39:07.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.455+0000 7feba85c9640 1 -- start start 2023-11-18T20:39:07.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba85c9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 0x7feba0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba85c9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feba006d0a0 0x7feba00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba85c9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00c64a0 con 0x7feba00a5260 2023-11-18T20:39:07.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba85c9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba00c5c00 con 0x7feba006d0a0 2023-11-18T20:39:07.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba85c9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c5ee0 con 0x7feba014fd30 2023-11-18T20:39:07.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba5b64640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feba006d0a0 0x7feba00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba6365640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 0x7feba0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba5b64640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feba006d0a0 0x7feba00a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:46486/0 (socket says 172.21.15.132:46486) 2023-11-18T20:39:07.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.457+0000 7feba5b64640 1 -- 172.21.15.132:0/1835553967 learned_addr learned my addr 172.21.15.132:0/1835553967 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:07.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.458+0000 7feba5b64640 1 -- 172.21.15.132:0/1835553967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 msgr2=0x7feba0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:07.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.458+0000 7feba5b64640 1 --2- 172.21.15.132:0/1835553967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 0x7feba0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.458+0000 7feba5b64640 1 -- 172.21.15.132:0/1835553967 >> v1:172.21.15.161:6789/0 conn(0x7feba00a5260 legacy=0x7feba00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.458+0000 7feba5b64640 1 -- 172.21.15.132:0/1835553967 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00c61c0 con 0x7feba006d0a0 2023-11-18T20:39:07.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.459+0000 7feba5b64640 1 --2- 172.21.15.132:0/1835553967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 0x7feba00a4d20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb90009870 tx=0x7feb9002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a908a23c479ce50 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:07.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.460+0000 7feba5363640 1 -- 172.21.15.132:0/1835553967 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90030840 con 0x7feba006d0a0 2023-11-18T20:39:07.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.460+0000 7feba5363640 1 -- 172.21.15.132:0/1835553967 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb900309a0 con 0x7feba006d0a0 2023-11-18T20:39:07.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.460+0000 7feba5363640 1 -- 172.21.15.132:0/1835553967 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90030d30 con 0x7feba006d0a0 2023-11-18T20:39:07.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.461+0000 7feba85c9640 1 -- 172.21.15.132:0/1835553967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 msgr2=0x7feba00a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.461+0000 7feba85c9640 1 --2- 172.21.15.132:0/1835553967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 0x7feba00a4d20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb90009870 tx=0x7feb9002b980 comp rx=0 tx=0).stop 2023-11-18T20:39:07.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.461+0000 7feba85c9640 1 -- 172.21.15.132:0/1835553967 shutdown_connections 2023-11-18T20:39:07.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.461+0000 7feba85c9640 1 --2- 172.21.15.132:0/1835553967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 0x7feba00a4d20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.461+0000 7feba85c9640 1 --2- 172.21.15.132:0/1835553967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 0x7feba0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.461+0000 7feba85c9640 1 -- 172.21.15.132:0/1835553967 >> 172.21.15.132:0/1835553967 conn(0x7feba006a500 msgr2=0x7feba006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:07.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.461+0000 7feba85c9640 1 -- 172.21.15.132:0/1835553967 shutdown_connections 2023-11-18T20:39:07.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.461+0000 7feba85c9640 1 -- 172.21.15.132:0/1835553967 wait complete. 2023-11-18T20:39:07.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.463+0000 7feba85c9640 1 Processor -- start 2023-11-18T20:39:07.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.463+0000 7feba85c9640 1 -- start start 2023-11-18T20:39:07.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.464+0000 7feba85c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 0x7feba01dc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba85c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba00a5260 0x7feba0155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba85c9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 0x7feba014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba85c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01dd4e0 con 0x7feba00a5260 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba85c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01de190 con 0x7feba006d0a0 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba85c9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba01dca20 con 0x7feba014fd30 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba5b64640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba00a5260 0x7feba0155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba5b64640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba00a5260 0x7feba0155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33372/0 (socket says 172.21.15.132:33372) 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba5b64640 1 -- 172.21.15.132:0/2427076883 learned_addr learned my addr 172.21.15.132:0/2427076883 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba6365640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 0x7feba01dc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba6b66640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 0x7feba014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba5b64640 1 -- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 msgr2=0x7feba014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba5b64640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 0x7feba014ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba5b64640 1 -- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 msgr2=0x7feba01dc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba5b64640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 0x7feba01dc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba5b64640 1 -- 172.21.15.132:0/2427076883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900094d0 con 0x7feba00a5260 2023-11-18T20:39:07.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.465+0000 7feba6365640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 0x7feba01dc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:07.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.466+0000 7feba5b64640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba00a5260 0x7feba0155ca0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb9002b9c0 tx=0x7feb90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:07.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.466+0000 7feb96ffd640 1 -- 172.21.15.132:0/2427076883 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90039c90 con 0x7feba00a5260 2023-11-18T20:39:07.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.466+0000 7feb96ffd640 1 -- 172.21.15.132:0/2427076883 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90039df0 con 0x7feba00a5260 2023-11-18T20:39:07.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.466+0000 7feb96ffd640 1 -- 172.21.15.132:0/2427076883 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900446c0 con 0x7feba00a5260 2023-11-18T20:39:07.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.466+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00a7140 con 0x7feba00a5260 2023-11-18T20:39:07.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.466+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba01dcf20 con 0x7feba00a5260 2023-11-18T20:39:07.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.468+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba01ddcc0 con 0x7feba00a5260 2023-11-18T20:39:07.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.468+0000 7feb96ffd640 1 -- 172.21.15.132:0/2427076883 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb9004d3b0 con 0x7feba00a5260 2023-11-18T20:39:07.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.469+0000 7feb96ffd640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb8406ae70 0x7feb8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.469+0000 7feb96ffd640 1 -- 172.21.15.132:0/2427076883 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb9003e070 con 0x7feba00a5260 2023-11-18T20:39:07.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.470+0000 7feba6365640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb8406ae70 0x7feb8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.471+0000 7feba6365640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb8406ae70 0x7feb8406d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009a20 tx=0x7feb9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:07.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.475+0000 7feb96ffd640 1 -- 172.21.15.132:0/2427076883 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feba01ddcc0 con 0x7feba00a5260 2023-11-18T20:39:07.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.661+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feba00c45b0 con 0x7feb8406ae70 2023-11-18T20:39:07.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.687+0000 7feb96ffd640 1 -- 172.21.15.132:0/2427076883 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281226 (secure 0 0 0) 0x7feb9c004030 con 0x7feb8406ae70 2023-11-18T20:39:07.693 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:07.694 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:07.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.692+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb8406ae70 msgr2=0x7feb8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb8406ae70 0x7feb8406d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009a20 tx=0x7feb9c008040 comp rx=0 tx=0).stop 2023-11-18T20:39:07.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba00a5260 msgr2=0x7feba0155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba00a5260 0x7feba0155ca0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb9002b9c0 tx=0x7feb90004730 comp rx=0 tx=0).stop 2023-11-18T20:39:07.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 shutdown_connections 2023-11-18T20:39:07.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb8406ae70 0x7feb8406d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feba014fd30 0x7feba014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba00a5260 0x7feba0155ca0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 --2- 172.21.15.132:0/2427076883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feba006d0a0 0x7feba01dc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 >> 172.21.15.132:0/2427076883 conn(0x7feba006a500 msgr2=0x7feba006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:07.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 shutdown_connections 2023-11-18T20:39:07.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.693+0000 7feba85c9640 1 -- 172.21.15.132:0/2427076883 wait complete. 2023-11-18T20:39:07.715 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-11-18T20:39:06.653973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220188,"kb_used_data":4016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754532,"statfs":{"total":773094113280,"available":772868640768,"internally_reserved":0,"allocated":4112384,"data_stored":2300658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.939563"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736567+0000","last_change":"2023-11-18T20:39:01.736567+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736567+0000","last_undegraded":"2023-11-18T20:39:01.736567+0000","last_fullsized":"2023-11-18T20:39:01.736567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727207+0000","last_change":"2023-11-18T20:39:01.727207+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727207+0000","last_undegraded":"2023-11-18T20:39:01.727207+0000","last_fullsized":"2023-11-18T20:39:01.727207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727435+0000","last_change":"2023-11-18T20:39:01.727435+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727435+0000","last_undegraded":"2023-11-18T20:39:01.727435+0000","last_fullsized":"2023-11-18T20:39:01.727435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740148+0000","last_change":"2023-11-18T20:39:01.740148+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740148+0000","last_undegraded":"2023-11-18T20:39:01.740148+0000","last_fullsized":"2023-11-18T20:39:01.740148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.728875+0000","last_change":"2023-11-18T20:39:01.728875+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.728875+0000","last_undegraded":"2023-11-18T20:39:01.728875+0000","last_fullsized":"2023-11-18T20:39:01.728875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740629+0000","last_change":"2023-11-18T20:39:01.740629+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740629+0000","last_undegraded":"2023-11-18T20:39:01.740629+0000","last_fullsized":"2023-11-18T20:39:01.740629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735536+0000","last_change":"2023-11-18T20:39:01.735536+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735536+0000","last_undegraded":"2023-11-18T20:39:01.735536+0000","last_fullsized":"2023-11-18T20:39:01.735536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730543+0000","last_change":"2023-11-18T20:39:01.730543+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730543+0000","last_undegraded":"2023-11-18T20:39:01.730543+0000","last_fullsized":"2023-11-18T20:39:01.730543+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729312+0000","last_change":"2023-11-18T20:39:01.729312+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729312+0000","last_undegraded":"2023-11-18T20:39:01.729312+0000","last_fullsized":"2023-11-18T20:39:01.729312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740999+0000","last_change":"2023-11-18T20:39:01.740999+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740999+0000","last_undegraded":"2023-11-18T20:39:01.740999+0000","last_fullsized":"2023-11-18T20:39:01.740999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737579+0000","last_change":"2023-11-18T20:39:01.737579+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737579+0000","last_undegraded":"2023-11-18T20:39:01.737579+0000","last_fullsized":"2023-11-18T20:39:01.737579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726158+0000","last_change":"2023-11-18T20:39:01.726158+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726158+0000","last_undegraded":"2023-11-18T20:39:01.726158+0000","last_fullsized":"2023-11-18T20:39:01.726158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.732419+0000","last_change":"2023-11-18T20:39:01.732419+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.732419+0000","last_undegraded":"2023-11-18T20:39:01.732419+0000","last_fullsized":"2023-11-18T20:39:01.732419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736349+0000","last_change":"2023-11-18T20:39:01.736349+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736349+0000","last_undegraded":"2023-11-18T20:39:01.736349+0000","last_fullsized":"2023-11-18T20:39:01.736349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727596+0000","last_change":"2023-11-18T20:39:01.727596+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727596+0000","last_undegraded":"2023-11-18T20:39:01.727596+0000","last_fullsized":"2023-11-18T20:39:01.727596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727597+0000","last_change":"2023-11-18T20:39:01.727597+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727597+0000","last_undegraded":"2023-11-18T20:39:01.727597+0000","last_fullsized":"2023-11-18T20:39:01.727597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740320+0000","last_change":"2023-11-18T20:39:01.740320+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740320+0000","last_undegraded":"2023-11-18T20:39:01.740320+0000","last_fullsized":"2023-11-18T20:39:01.740320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.744644+0000","last_change":"2023-11-18T20:39:01.744644+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.744644+0000","last_undegraded":"2023-11-18T20:39:01.744644+0000","last_fullsized":"2023-11-18T20:39:01.744644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.745493+0000","last_change":"2023-11-18T20:39:01.745493+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.745493+0000","last_undegraded":"2023-11-18T20:39:01.745493+0000","last_fullsized":"2023-11-18T20:39:01.745493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735773+0000","last_change":"2023-11-18T20:39:01.735773+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735773+0000","last_undegraded":"2023-11-18T20:39:01.735773+0000","last_fullsized":"2023-11-18T20:39:01.735773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729099+0000","last_change":"2023-11-18T20:39:01.729099+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729099+0000","last_undegraded":"2023-11-18T20:39:01.729099+0000","last_fullsized":"2023-11-18T20:39:01.729099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736589+0000","last_change":"2023-11-18T20:39:01.736589+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736589+0000","last_undegraded":"2023-11-18T20:39:01.736589+0000","last_fullsized":"2023-11-18T20:39:01.736589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.728426+0000","last_change":"2023-11-18T20:39:01.728426+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.728426+0000","last_undegraded":"2023-11-18T20:39:01.728426+0000","last_fullsized":"2023-11-18T20:39:01.728426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730071+0000","last_change":"2023-11-18T20:39:01.730071+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730071+0000","last_undegraded":"2023-11-18T20:39:01.730071+0000","last_fullsized":"2023-11-18T20:39:01.730071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740360+0000","last_change":"2023-11-18T20:39:01.740360+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740360+0000","last_undegraded":"2023-11-18T20:39:01.740360+0000","last_fullsized":"2023-11-18T20:39:01.740360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739182+0000","last_change":"2023-11-18T20:39:01.739182+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739182+0000","last_undegraded":"2023-11-18T20:39:01.739182+0000","last_fullsized":"2023-11-18T20:39:01.739182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730864+0000","last_change":"2023-11-18T20:39:01.730864+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730864+0000","last_undegraded":"2023-11-18T20:39:01.730864+0000","last_fullsized":"2023-11-18T20:39:01.730864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.732054+0000","last_change":"2023-11-18T20:39:01.732054+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.732054+0000","last_undegraded":"2023-11-18T20:39:01.732054+0000","last_fullsized":"2023-11-18T20:39:01.732054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729718+0000","last_change":"2023-11-18T20:39:01.729718+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729718+0000","last_undegraded":"2023-11-18T20:39:01.729718+0000","last_fullsized":"2023-11-18T20:39:01.729718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730086+0000","last_change":"2023-11-18T20:39:01.730086+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730086+0000","last_undegraded":"2023-11-18T20:39:01.730086+0000","last_fullsized":"2023-11-18T20:39:01.730086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730414+0000","last_change":"2023-11-18T20:39:01.730414+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730414+0000","last_undegraded":"2023-11-18T20:39:01.730414+0000","last_fullsized":"2023-11-18T20:39:01.730414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737376+0000","last_change":"2023-11-18T20:39:01.737376+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737376+0000","last_undegraded":"2023-11-18T20:39:01.737376+0000","last_fullsized":"2023-11-18T20:39:01.737376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.731277+0000","last_change":"2023-11-18T20:39:01.731277+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.731277+0000","last_undegraded":"2023-11-18T20:39:01.731277+0000","last_fullsized":"2023-11-18T20:39:01.731277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752468+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:01.752468+0000","last_peered":"2023-11-18T20:39:01.752468+0000","last_clean":"2023-11-18T20:39:01.752468+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:01.752468+0000","last_undegraded":"2023-11-18T20:39:01.752468+0000","last_fullsized":"2023-11-18T20:39:01.752468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:38.916216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735851+0000","last_change":"2023-11-18T20:39:01.735851+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735851+0000","last_undegraded":"2023-11-18T20:39:01.735851+0000","last_fullsized":"2023-11-18T20:39:01.735851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758091+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:01.758091+0000","last_peered":"2023-11-18T20:39:01.758091+0000","last_clean":"2023-11-18T20:39:01.758091+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:01.758091+0000","last_undegraded":"2023-11-18T20:39:01.758091+0000","last_fullsized":"2023-11-18T20:39:01.758091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.731409+0000","last_change":"2023-11-18T20:39:01.731409+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.731409+0000","last_undegraded":"2023-11-18T20:39:01.731409+0000","last_fullsized":"2023-11-18T20:39:01.731409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758077+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:01.758077+0000","last_peered":"2023-11-18T20:39:01.758077+0000","last_clean":"2023-11-18T20:39:01.758077+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:01.758077+0000","last_undegraded":"2023-11-18T20:39:01.758077+0000","last_fullsized":"2023-11-18T20:39:01.758077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:30.395754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737147+0000","last_change":"2023-11-18T20:39:01.737147+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737147+0000","last_undegraded":"2023-11-18T20:39:01.737147+0000","last_fullsized":"2023-11-18T20:39:01.737147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757532+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:01.757532+0000","last_peered":"2023-11-18T20:39:01.757532+0000","last_clean":"2023-11-18T20:39:01.757532+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:01.757532+0000","last_undegraded":"2023-11-18T20:39:01.757532+0000","last_fullsized":"2023-11-18T20:39:01.757532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:11.799576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725990+0000","last_change":"2023-11-18T20:39:01.725990+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725990+0000","last_undegraded":"2023-11-18T20:39:01.725990+0000","last_fullsized":"2023-11-18T20:39:01.725990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752417+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:01.752417+0000","last_peered":"2023-11-18T20:39:01.752417+0000","last_clean":"2023-11-18T20:39:01.752417+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:01.752417+0000","last_undegraded":"2023-11-18T20:39:01.752417+0000","last_fullsized":"2023-11-18T20:39:01.752417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.733840+0000","last_change":"2023-11-18T20:39:01.733840+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.733840+0000","last_undegraded":"2023-11-18T20:39:01.733840+0000","last_fullsized":"2023-11-18T20:39:01.733840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752094+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:01.752094+0000","last_peered":"2023-11-18T20:39:01.752094+0000","last_clean":"2023-11-18T20:39:01.752094+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:01.752094+0000","last_undegraded":"2023-11-18T20:39:01.752094+0000","last_fullsized":"2023-11-18T20:39:01.752094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:12.391708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725359+0000","last_change":"2023-11-18T20:39:01.725359+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725359+0000","last_undegraded":"2023-11-18T20:39:01.725359+0000","last_fullsized":"2023-11-18T20:39:01.725359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757313+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:01.757313+0000","last_peered":"2023-11-18T20:39:01.757313+0000","last_clean":"2023-11-18T20:39:01.757313+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:01.757313+0000","last_undegraded":"2023-11-18T20:39:01.757313+0000","last_fullsized":"2023-11-18T20:39:01.757313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:54:05.972580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.733733+0000","last_change":"2023-11-18T20:39:01.733733+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.733733+0000","last_undegraded":"2023-11-18T20:39:01.733733+0000","last_fullsized":"2023-11-18T20:39:01.733733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753602+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:01.753602+0000","last_peered":"2023-11-18T20:39:01.753602+0000","last_clean":"2023-11-18T20:39:01.753602+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:01.753602+0000","last_undegraded":"2023-11-18T20:39:01.753602+0000","last_fullsized":"2023-11-18T20:39:01.753602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740817+0000","last_change":"2023-11-18T20:39:01.740817+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740817+0000","last_undegraded":"2023-11-18T20:39:01.740817+0000","last_fullsized":"2023-11-18T20:39:01.740817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.746334+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:01.746334+0000","last_peered":"2023-11-18T20:39:01.746334+0000","last_clean":"2023-11-18T20:39:01.746334+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:01.746334+0000","last_undegraded":"2023-11-18T20:39:01.746334+0000","last_fullsized":"2023-11-18T20:39:01.746334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:10:52.835152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739512+0000","last_change":"2023-11-18T20:39:01.739512+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739512+0000","last_undegraded":"2023-11-18T20:39:01.739512+0000","last_fullsized":"2023-11-18T20:39:01.739512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754696+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:01.754696+0000","last_peered":"2023-11-18T20:39:01.754696+0000","last_clean":"2023-11-18T20:39:01.754696+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:01.754696+0000","last_undegraded":"2023-11-18T20:39:01.754696+0000","last_fullsized":"2023-11-18T20:39:01.754696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.738047+0000","last_change":"2023-11-18T20:39:01.738047+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.738047+0000","last_undegraded":"2023-11-18T20:39:01.738047+0000","last_fullsized":"2023-11-18T20:39:01.738047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754748+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:01.754748+0000","last_peered":"2023-11-18T20:39:01.754748+0000","last_clean":"2023-11-18T20:39:01.754748+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:01.754748+0000","last_undegraded":"2023-11-18T20:39:01.754748+0000","last_fullsized":"2023-11-18T20:39:01.754748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:24:41.889891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.742357+0000","last_change":"2023-11-18T20:39:01.742357+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.742357+0000","last_undegraded":"2023-11-18T20:39:01.742357+0000","last_fullsized":"2023-11-18T20:39:01.742357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757289+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:01.757289+0000","last_peered":"2023-11-18T20:39:01.757289+0000","last_clean":"2023-11-18T20:39:01.757289+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:01.757289+0000","last_undegraded":"2023-11-18T20:39:01.757289+0000","last_fullsized":"2023-11-18T20:39:01.757289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:26:40.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736904+0000","last_change":"2023-11-18T20:39:01.736904+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736904+0000","last_undegraded":"2023-11-18T20:39:01.736904+0000","last_fullsized":"2023-11-18T20:39:01.736904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753361+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:01.753361+0000","last_peered":"2023-11-18T20:39:01.753361+0000","last_clean":"2023-11-18T20:39:01.753361+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:01.753361+0000","last_undegraded":"2023-11-18T20:39:01.753361+0000","last_fullsized":"2023-11-18T20:39:01.753361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:02.510547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737205+0000","last_change":"2023-11-18T20:39:01.737205+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737205+0000","last_undegraded":"2023-11-18T20:39:01.737205+0000","last_fullsized":"2023-11-18T20:39:01.737205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758146+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:01.758146+0000","last_peered":"2023-11-18T20:39:01.758146+0000","last_clean":"2023-11-18T20:39:01.758146+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:01.758146+0000","last_undegraded":"2023-11-18T20:39:01.758146+0000","last_fullsized":"2023-11-18T20:39:01.758146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729483+0000","last_change":"2023-11-18T20:39:01.729483+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729483+0000","last_undegraded":"2023-11-18T20:39:01.729483+0000","last_fullsized":"2023-11-18T20:39:01.729483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752979+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:01.752979+0000","last_peered":"2023-11-18T20:39:01.752979+0000","last_clean":"2023-11-18T20:39:01.752979+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:01.752979+0000","last_undegraded":"2023-11-18T20:39:01.752979+0000","last_fullsized":"2023-11-18T20:39:01.752979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:13.456432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.741695+0000","last_change":"2023-11-18T20:39:01.741695+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.741695+0000","last_undegraded":"2023-11-18T20:39:01.741695+0000","last_fullsized":"2023-11-18T20:39:01.741695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753166+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:01.753166+0000","last_peered":"2023-11-18T20:39:01.753166+0000","last_clean":"2023-11-18T20:39:01.753166+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:01.753166+0000","last_undegraded":"2023-11-18T20:39:01.753166+0000","last_fullsized":"2023-11-18T20:39:01.753166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:59.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740348+0000","last_change":"2023-11-18T20:39:01.740348+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740348+0000","last_undegraded":"2023-11-18T20:39:01.740348+0000","last_fullsized":"2023-11-18T20:39:01.740348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.756810+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:01.756810+0000","last_peered":"2023-11-18T20:39:01.756810+0000","last_clean":"2023-11-18T20:39:01.756810+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:01.756810+0000","last_undegraded":"2023-11-18T20:39:01.756810+0000","last_fullsized":"2023-11-18T20:39:01.756810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:33:29.342499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726472+0000","last_change":"2023-11-18T20:39:01.726472+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726472+0000","last_undegraded":"2023-11-18T20:39:01.726472+0000","last_fullsized":"2023-11-18T20:39:01.726472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753727+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:01.753727+0000","last_peered":"2023-11-18T20:39:01.753727+0000","last_clean":"2023-11-18T20:39:01.753727+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:01.753727+0000","last_undegraded":"2023-11-18T20:39:01.753727+0000","last_fullsized":"2023-11-18T20:39:01.753727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725581+0000","last_change":"2023-11-18T20:39:01.725581+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725581+0000","last_undegraded":"2023-11-18T20:39:01.725581+0000","last_fullsized":"2023-11-18T20:39:01.725581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752908+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:01.752908+0000","last_peered":"2023-11-18T20:39:01.752908+0000","last_clean":"2023-11-18T20:39:01.752908+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:01.752908+0000","last_undegraded":"2023-11-18T20:39:01.752908+0000","last_fullsized":"2023-11-18T20:39:01.752908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:17:42.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.742732+0000","last_change":"2023-11-18T20:39:01.742732+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.742732+0000","last_undegraded":"2023-11-18T20:39:01.742732+0000","last_fullsized":"2023-11-18T20:39:01.742732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750482+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:01.750482+0000","last_peered":"2023-11-18T20:39:01.750482+0000","last_clean":"2023-11-18T20:39:01.750482+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:01.750482+0000","last_undegraded":"2023-11-18T20:39:01.750482+0000","last_fullsized":"2023-11-18T20:39:01.750482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736236+0000","last_change":"2023-11-18T20:39:01.736236+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736236+0000","last_undegraded":"2023-11-18T20:39:01.736236+0000","last_fullsized":"2023-11-18T20:39:01.736236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750645+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:01.750645+0000","last_peered":"2023-11-18T20:39:01.750645+0000","last_clean":"2023-11-18T20:39:01.750645+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:01.750645+0000","last_undegraded":"2023-11-18T20:39:01.750645+0000","last_fullsized":"2023-11-18T20:39:01.750645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726073+0000","last_change":"2023-11-18T20:39:01.726073+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726073+0000","last_undegraded":"2023-11-18T20:39:01.726073+0000","last_fullsized":"2023-11-18T20:39:01.726073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753568+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:01.753568+0000","last_peered":"2023-11-18T20:39:01.753568+0000","last_clean":"2023-11-18T20:39:01.753568+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:01.753568+0000","last_undegraded":"2023-11-18T20:39:01.753568+0000","last_fullsized":"2023-11-18T20:39:01.753568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:49:29.015695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727785+0000","last_change":"2023-11-18T20:39:01.727785+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727785+0000","last_undegraded":"2023-11-18T20:39:01.727785+0000","last_fullsized":"2023-11-18T20:39:01.727785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752218+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:01.752218+0000","last_peered":"2023-11-18T20:39:01.752218+0000","last_clean":"2023-11-18T20:39:01.752218+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:01.752218+0000","last_undegraded":"2023-11-18T20:39:01.752218+0000","last_fullsized":"2023-11-18T20:39:01.752218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:59.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725551+0000","last_change":"2023-11-18T20:39:01.725551+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725551+0000","last_undegraded":"2023-11-18T20:39:01.725551+0000","last_fullsized":"2023-11-18T20:39:01.725551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.747318+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:01.747318+0000","last_peered":"2023-11-18T20:39:01.747318+0000","last_clean":"2023-11-18T20:39:01.747318+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:01.747318+0000","last_undegraded":"2023-11-18T20:39:01.747318+0000","last_fullsized":"2023-11-18T20:39:01.747318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:59:41.767445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.744133+0000","last_change":"2023-11-18T20:39:01.744133+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.744133+0000","last_undegraded":"2023-11-18T20:39:01.744133+0000","last_fullsized":"2023-11-18T20:39:01.744133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750469+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:01.750469+0000","last_peered":"2023-11-18T20:39:01.750469+0000","last_clean":"2023-11-18T20:39:01.750469+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:01.750469+0000","last_undegraded":"2023-11-18T20:39:01.750469+0000","last_fullsized":"2023-11-18T20:39:01.750469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:14:43.750184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739864+0000","last_change":"2023-11-18T20:39:01.739864+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739864+0000","last_undegraded":"2023-11-18T20:39:01.739864+0000","last_fullsized":"2023-11-18T20:39:01.739864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754715+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:01.754715+0000","last_peered":"2023-11-18T20:39:01.754715+0000","last_clean":"2023-11-18T20:39:01.754715+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:01.754715+0000","last_undegraded":"2023-11-18T20:39:01.754715+0000","last_fullsized":"2023-11-18T20:39:01.754715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.741417+0000","last_change":"2023-11-18T20:39:01.741417+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.741417+0000","last_undegraded":"2023-11-18T20:39:01.741417+0000","last_fullsized":"2023-11-18T20:39:01.741417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753063+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:01.753063+0000","last_peered":"2023-11-18T20:39:01.753063+0000","last_clean":"2023-11-18T20:39:01.753063+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:01.753063+0000","last_undegraded":"2023-11-18T20:39:01.753063+0000","last_fullsized":"2023-11-18T20:39:01.753063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:29:30.952653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727725+0000","last_change":"2023-11-18T20:39:01.727725+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727725+0000","last_undegraded":"2023-11-18T20:39:01.727725+0000","last_fullsized":"2023-11-18T20:39:01.727725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.749666+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:01.749666+0000","last_peered":"2023-11-18T20:39:01.749666+0000","last_clean":"2023-11-18T20:39:01.749666+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:01.749666+0000","last_undegraded":"2023-11-18T20:39:01.749666+0000","last_fullsized":"2023-11-18T20:39:01.749666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:46.938148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736379+0000","last_change":"2023-11-18T20:39:01.736379+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736379+0000","last_undegraded":"2023-11-18T20:39:01.736379+0000","last_fullsized":"2023-11-18T20:39:01.736379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752157+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:01.752157+0000","last_peered":"2023-11-18T20:39:01.752157+0000","last_clean":"2023-11-18T20:39:01.752157+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:01.752157+0000","last_undegraded":"2023-11-18T20:39:01.752157+0000","last_fullsized":"2023-11-18T20:39:01.752157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:01.329628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735586+0000","last_change":"2023-11-18T20:39:01.735586+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735586+0000","last_undegraded":"2023-11-18T20:39:01.735586+0000","last_fullsized":"2023-11-18T20:39:01.735586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753665+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:01.753665+0000","last_peered":"2023-11-18T20:39:01.753665+0000","last_clean":"2023-11-18T20:39:01.753665+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:01.753665+0000","last_undegraded":"2023-11-18T20:39:01.753665+0000","last_fullsized":"2023-11-18T20:39:01.753665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737588+0000","last_change":"2023-11-18T20:39:01.737588+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737588+0000","last_undegraded":"2023-11-18T20:39:01.737588+0000","last_fullsized":"2023-11-18T20:39:01.737588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757568+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:01.757568+0000","last_peered":"2023-11-18T20:39:01.757568+0000","last_clean":"2023-11-18T20:39:01.757568+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:01.757568+0000","last_undegraded":"2023-11-18T20:39:01.757568+0000","last_fullsized":"2023-11-18T20:39:01.757568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:45.317633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729839+0000","last_change":"2023-11-18T20:39:01.729839+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729839+0000","last_undegraded":"2023-11-18T20:39:01.729839+0000","last_fullsized":"2023-11-18T20:39:01.729839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752941+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:01.752941+0000","last_peered":"2023-11-18T20:39:01.752941+0000","last_clean":"2023-11-18T20:39:01.752941+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:01.752941+0000","last_undegraded":"2023-11-18T20:39:01.752941+0000","last_fullsized":"2023-11-18T20:39:01.752941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:26.685337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T20:39:00.714710+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:00.714710+0000","last_peered":"2023-11-18T20:39:00.714710+0000","last_clean":"2023-11-18T20:39:00.714710+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:00.714710+0000","last_undegraded":"2023-11-18T20:39:00.714710+0000","last_fullsized":"2023-11-18T20:39:00.714710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.877},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0149999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92500000000000004}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.216}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.349}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":2.0750000000000002},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.7370000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":2.1640000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.2290000000000001},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.833}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.1319999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1759999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.282},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.3220000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4379999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.847},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3819999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.8009999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":2.1579999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":731927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.141},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84399999999999997}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.0800000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.351},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.1120000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5329999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.645}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.6970000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.2},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.03}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.444},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.089}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.137},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.304},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.248}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.5149999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.704}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.018}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.85099999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.97799999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.1000000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.216},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.4830000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.569},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5209999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.734},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.764}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.079},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.1859999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.999}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.121},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.2190000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.155},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.3700000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.3400000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":950272,"data_stored":725652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.2569999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.2210000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.85099999999999998}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.05},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.876}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.82599999999999996}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.014},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.4690000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.7210000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.508},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.2989999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:07.720 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.969+0000 7f473bfb0640 1 Processor -- start 2023-11-18T20:39:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.969+0000 7f473bfb0640 1 -- start start 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.970+0000 7f473bfb0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f47340c5ec0 0x7f47340c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.970+0000 7f473bfb0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f47340721a0 0x7f47340c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.970+0000 7f473bfb0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340bfdc0 con 0x7f47340c45d0 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.970+0000 7f473bfb0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473406e390 con 0x7f47340c5ec0 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.970+0000 7f473bfb0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473406ddd0 con 0x7f47340721a0 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f4739d4c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f47340c5ec0 0x7f47340c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f473954b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f47340c45d0 0x7f4734155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37410/0 (socket says 172.21.15.132:37410) 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f473954b640 1 -- 172.21.15.132:0/4023598146 learned_addr learned my addr 172.21.15.132:0/4023598146 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f4739d4c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f47340c5ec0 0x7f47340c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33388/0 (socket says 172.21.15.132:33388) 2023-11-18T20:39:07.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f4739d4c640 1 -- 172.21.15.132:0/4023598146 >> v2:172.21.15.161:3300/0 conn(0x7f47340721a0 msgr2=0x7f47340c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f4739d4c640 1 --2- 172.21.15.132:0/4023598146 >> v2:172.21.15.161:3300/0 conn(0x7f47340721a0 0x7f47340c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f4739d4c640 1 -- 172.21.15.132:0/4023598146 >> v1:172.21.15.132:6789/0 conn(0x7f47340c45d0 legacy=0x7f4734155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f4739d4c640 1 -- 172.21.15.132:0/4023598146 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473406e0b0 con 0x7f47340c5ec0 2023-11-18T20:39:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.971+0000 7f4738d4a640 1 -- 172.21.15.132:0/4023598146 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412161317 0 0) 0x7f47340bfdc0 con 0x7f47340c45d0 2023-11-18T20:39:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.972+0000 7f4739d4c640 1 --2- 172.21.15.132:0/4023598146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c5ec0 0x7f47340c2c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f47300097a0 tx=0x7f473002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326e3a5ffbbcb6c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.972+0000 7f4738d4a640 1 -- 172.21.15.132:0/4023598146 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473002f050 con 0x7f47340c5ec0 2023-11-18T20:39:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f4738d4a640 1 -- 172.21.15.132:0/4023598146 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730031700 con 0x7f47340c5ec0 2023-11-18T20:39:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f4738d4a640 1 -- 172.21.15.132:0/4023598146 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730031a90 con 0x7f47340c5ec0 2023-11-18T20:39:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f473bfb0640 1 -- 172.21.15.132:0/4023598146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c5ec0 msgr2=0x7f47340c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f473bfb0640 1 --2- 172.21.15.132:0/4023598146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c5ec0 0x7f47340c2c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f47300097a0 tx=0x7f473002b7a0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f473bfb0640 1 -- 172.21.15.132:0/4023598146 shutdown_connections 2023-11-18T20:39:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f473bfb0640 1 --2- 172.21.15.132:0/4023598146 >> v2:172.21.15.161:3300/0 conn(0x7f47340721a0 0x7f47340c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f473bfb0640 1 --2- 172.21.15.132:0/4023598146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c5ec0 0x7f47340c2c30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f473bfb0640 1 -- 172.21.15.132:0/4023598146 >> 172.21.15.132:0/4023598146 conn(0x7f473406a500 msgr2=0x7f473406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f473bfb0640 1 -- 172.21.15.132:0/4023598146 shutdown_connections 2023-11-18T20:39:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.973+0000 7f473bfb0640 1 -- 172.21.15.132:0/4023598146 wait complete. 2023-11-18T20:39:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.975+0000 7f473bfb0640 1 Processor -- start 2023-11-18T20:39:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.975+0000 7f473bfb0640 1 -- start start 2023-11-18T20:39:07.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473bfb0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47340721a0 0x7f473414e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473bfb0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c45d0 0x7f47341502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473bfb0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47340c5ec0 0x7f4734150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473bfb0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47341eb170 con 0x7f47340c45d0 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473bfb0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473414bd90 con 0x7f47340c5ec0 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473bfb0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473414b7d0 con 0x7f47340721a0 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473954b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c45d0 0x7f47341502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473954b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c45d0 0x7f47341502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33400/0 (socket says 172.21.15.132:33400) 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.976+0000 7f473954b640 1 -- 172.21.15.132:0/863252328 learned_addr learned my addr 172.21.15.132:0/863252328 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f4739d4c640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47340721a0 0x7f473414e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473a54d640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47340c5ec0 0x7f4734150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473954b640 1 -- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47340721a0 msgr2=0x7f473414e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473954b640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47340721a0 0x7f473414e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473954b640 1 -- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47340c5ec0 msgr2=0x7f4734150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473954b640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47340c5ec0 0x7f4734150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473954b640 1 -- 172.21.15.132:0/863252328 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4730009400 con 0x7f47340c45d0 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473a54d640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47340c5ec0 0x7f4734150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473954b640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c45d0 0x7f47341502e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f472400c4b0 tx=0x7f472400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f472a7fc640 1 -- 172.21.15.132:0/863252328 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47240074e0 con 0x7f47340c45d0 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f472a7fc640 1 -- 172.21.15.132:0/863252328 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724007660 con 0x7f47340c45d0 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473414bab0 con 0x7f47340c45d0 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.977+0000 7f472a7fc640 1 -- 172.21.15.132:0/863252328 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724004a20 con 0x7f47340c45d0 2023-11-18T20:39:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.978+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47340a8630 con 0x7f47340c45d0 2023-11-18T20:39:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.979+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473414fc00 con 0x7f47340c45d0 2023-11-18T20:39:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.980+0000 7f472a7fc640 1 -- 172.21.15.132:0/863252328 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4724004b80 con 0x7f47340c45d0 2023-11-18T20:39:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.981+0000 7f472a7fc640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f471806ae40 0x7f471806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.981+0000 7f472a7fc640 1 -- 172.21.15.132:0/863252328 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4724088a40 con 0x7f47340c45d0 2023-11-18T20:39:07.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.982+0000 7f4739d4c640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f471806ae40 0x7f471806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:07.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.983+0000 7f4739d4c640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f471806ae40 0x7f471806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4730035000 tx=0x7f4730008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:07.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:07.985+0000 7f472a7fc640 1 -- 172.21.15.132:0/863252328 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f472408ae60 con 0x7f47340c45d0 2023-11-18T20:39:08.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.172+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47340c62a0 con 0x7f471806ae40 2023-11-18T20:39:08.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.194+0000 7f472a7fc640 1 -- 172.21.15.132:0/863252328 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281226 (secure 0 0 0) 0x7f4730041070 con 0x7f471806ae40 2023-11-18T20:39:08.198 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.199+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f471806ae40 msgr2=0x7f471806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.199+0000 7f473bfb0640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f471806ae40 0x7f471806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4730035000 tx=0x7f4730008030 comp rx=0 tx=0).stop 2023-11-18T20:39:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.199+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c45d0 msgr2=0x7f47341502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.199+0000 7f473bfb0640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c45d0 0x7f47341502e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f472400c4b0 tx=0x7f472400c970 comp rx=0 tx=0).stop 2023-11-18T20:39:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.200+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 shutdown_connections 2023-11-18T20:39:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.200+0000 7f473bfb0640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f471806ae40 0x7f471806d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.200+0000 7f473bfb0640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47340c5ec0 0x7f4734150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.200+0000 7f473bfb0640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47340c45d0 0x7f47341502e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.200+0000 7f473bfb0640 1 --2- 172.21.15.132:0/863252328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47340721a0 0x7f473414e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.200+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 >> 172.21.15.132:0/863252328 conn(0x7f473406a500 msgr2=0x7f47340c14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.200+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 shutdown_connections 2023-11-18T20:39:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.200+0000 7f473bfb0640 1 -- 172.21.15.132:0/863252328 wait complete. 2023-11-18T20:39:08.219 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-11-18T20:39:06.653973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220188,"kb_used_data":4016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754532,"statfs":{"total":773094113280,"available":772868640768,"internally_reserved":0,"allocated":4112384,"data_stored":2300658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.939563"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736567+0000","last_change":"2023-11-18T20:39:01.736567+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736567+0000","last_undegraded":"2023-11-18T20:39:01.736567+0000","last_fullsized":"2023-11-18T20:39:01.736567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727207+0000","last_change":"2023-11-18T20:39:01.727207+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727207+0000","last_undegraded":"2023-11-18T20:39:01.727207+0000","last_fullsized":"2023-11-18T20:39:01.727207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727435+0000","last_change":"2023-11-18T20:39:01.727435+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727435+0000","last_undegraded":"2023-11-18T20:39:01.727435+0000","last_fullsized":"2023-11-18T20:39:01.727435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740148+0000","last_change":"2023-11-18T20:39:01.740148+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740148+0000","last_undegraded":"2023-11-18T20:39:01.740148+0000","last_fullsized":"2023-11-18T20:39:01.740148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.728875+0000","last_change":"2023-11-18T20:39:01.728875+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.728875+0000","last_undegraded":"2023-11-18T20:39:01.728875+0000","last_fullsized":"2023-11-18T20:39:01.728875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740629+0000","last_change":"2023-11-18T20:39:01.740629+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740629+0000","last_undegraded":"2023-11-18T20:39:01.740629+0000","last_fullsized":"2023-11-18T20:39:01.740629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735536+0000","last_change":"2023-11-18T20:39:01.735536+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735536+0000","last_undegraded":"2023-11-18T20:39:01.735536+0000","last_fullsized":"2023-11-18T20:39:01.735536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730543+0000","last_change":"2023-11-18T20:39:01.730543+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730543+0000","last_undegraded":"2023-11-18T20:39:01.730543+0000","last_fullsized":"2023-11-18T20:39:01.730543+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729312+0000","last_change":"2023-11-18T20:39:01.729312+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729312+0000","last_undegraded":"2023-11-18T20:39:01.729312+0000","last_fullsized":"2023-11-18T20:39:01.729312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740999+0000","last_change":"2023-11-18T20:39:01.740999+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740999+0000","last_undegraded":"2023-11-18T20:39:01.740999+0000","last_fullsized":"2023-11-18T20:39:01.740999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737579+0000","last_change":"2023-11-18T20:39:01.737579+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737579+0000","last_undegraded":"2023-11-18T20:39:01.737579+0000","last_fullsized":"2023-11-18T20:39:01.737579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726158+0000","last_change":"2023-11-18T20:39:01.726158+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726158+0000","last_undegraded":"2023-11-18T20:39:01.726158+0000","last_fullsized":"2023-11-18T20:39:01.726158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.732419+0000","last_change":"2023-11-18T20:39:01.732419+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.732419+0000","last_undegraded":"2023-11-18T20:39:01.732419+0000","last_fullsized":"2023-11-18T20:39:01.732419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736349+0000","last_change":"2023-11-18T20:39:01.736349+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736349+0000","last_undegraded":"2023-11-18T20:39:01.736349+0000","last_fullsized":"2023-11-18T20:39:01.736349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727596+0000","last_change":"2023-11-18T20:39:01.727596+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727596+0000","last_undegraded":"2023-11-18T20:39:01.727596+0000","last_fullsized":"2023-11-18T20:39:01.727596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727597+0000","last_change":"2023-11-18T20:39:01.727597+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727597+0000","last_undegraded":"2023-11-18T20:39:01.727597+0000","last_fullsized":"2023-11-18T20:39:01.727597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740320+0000","last_change":"2023-11-18T20:39:01.740320+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740320+0000","last_undegraded":"2023-11-18T20:39:01.740320+0000","last_fullsized":"2023-11-18T20:39:01.740320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.744644+0000","last_change":"2023-11-18T20:39:01.744644+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.744644+0000","last_undegraded":"2023-11-18T20:39:01.744644+0000","last_fullsized":"2023-11-18T20:39:01.744644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.745493+0000","last_change":"2023-11-18T20:39:01.745493+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.745493+0000","last_undegraded":"2023-11-18T20:39:01.745493+0000","last_fullsized":"2023-11-18T20:39:01.745493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735773+0000","last_change":"2023-11-18T20:39:01.735773+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735773+0000","last_undegraded":"2023-11-18T20:39:01.735773+0000","last_fullsized":"2023-11-18T20:39:01.735773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729099+0000","last_change":"2023-11-18T20:39:01.729099+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729099+0000","last_undegraded":"2023-11-18T20:39:01.729099+0000","last_fullsized":"2023-11-18T20:39:01.729099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736589+0000","last_change":"2023-11-18T20:39:01.736589+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736589+0000","last_undegraded":"2023-11-18T20:39:01.736589+0000","last_fullsized":"2023-11-18T20:39:01.736589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.728426+0000","last_change":"2023-11-18T20:39:01.728426+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.728426+0000","last_undegraded":"2023-11-18T20:39:01.728426+0000","last_fullsized":"2023-11-18T20:39:01.728426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730071+0000","last_change":"2023-11-18T20:39:01.730071+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730071+0000","last_undegraded":"2023-11-18T20:39:01.730071+0000","last_fullsized":"2023-11-18T20:39:01.730071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740360+0000","last_change":"2023-11-18T20:39:01.740360+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740360+0000","last_undegraded":"2023-11-18T20:39:01.740360+0000","last_fullsized":"2023-11-18T20:39:01.740360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739182+0000","last_change":"2023-11-18T20:39:01.739182+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739182+0000","last_undegraded":"2023-11-18T20:39:01.739182+0000","last_fullsized":"2023-11-18T20:39:01.739182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730864+0000","last_change":"2023-11-18T20:39:01.730864+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730864+0000","last_undegraded":"2023-11-18T20:39:01.730864+0000","last_fullsized":"2023-11-18T20:39:01.730864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.732054+0000","last_change":"2023-11-18T20:39:01.732054+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.732054+0000","last_undegraded":"2023-11-18T20:39:01.732054+0000","last_fullsized":"2023-11-18T20:39:01.732054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729718+0000","last_change":"2023-11-18T20:39:01.729718+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729718+0000","last_undegraded":"2023-11-18T20:39:01.729718+0000","last_fullsized":"2023-11-18T20:39:01.729718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730086+0000","last_change":"2023-11-18T20:39:01.730086+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730086+0000","last_undegraded":"2023-11-18T20:39:01.730086+0000","last_fullsized":"2023-11-18T20:39:01.730086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.730414+0000","last_change":"2023-11-18T20:39:01.730414+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.730414+0000","last_undegraded":"2023-11-18T20:39:01.730414+0000","last_fullsized":"2023-11-18T20:39:01.730414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737376+0000","last_change":"2023-11-18T20:39:01.737376+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737376+0000","last_undegraded":"2023-11-18T20:39:01.737376+0000","last_fullsized":"2023-11-18T20:39:01.737376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.731277+0000","last_change":"2023-11-18T20:39:01.731277+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.731277+0000","last_undegraded":"2023-11-18T20:39:01.731277+0000","last_fullsized":"2023-11-18T20:39:01.731277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752468+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:01.752468+0000","last_peered":"2023-11-18T20:39:01.752468+0000","last_clean":"2023-11-18T20:39:01.752468+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:01.752468+0000","last_undegraded":"2023-11-18T20:39:01.752468+0000","last_fullsized":"2023-11-18T20:39:01.752468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:38.916216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735851+0000","last_change":"2023-11-18T20:39:01.735851+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735851+0000","last_undegraded":"2023-11-18T20:39:01.735851+0000","last_fullsized":"2023-11-18T20:39:01.735851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758091+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:01.758091+0000","last_peered":"2023-11-18T20:39:01.758091+0000","last_clean":"2023-11-18T20:39:01.758091+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:01.758091+0000","last_undegraded":"2023-11-18T20:39:01.758091+0000","last_fullsized":"2023-11-18T20:39:01.758091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.731409+0000","last_change":"2023-11-18T20:39:01.731409+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.731409+0000","last_undegraded":"2023-11-18T20:39:01.731409+0000","last_fullsized":"2023-11-18T20:39:01.731409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758077+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:01.758077+0000","last_peered":"2023-11-18T20:39:01.758077+0000","last_clean":"2023-11-18T20:39:01.758077+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:01.758077+0000","last_undegraded":"2023-11-18T20:39:01.758077+0000","last_fullsized":"2023-11-18T20:39:01.758077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:30.395754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737147+0000","last_change":"2023-11-18T20:39:01.737147+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737147+0000","last_undegraded":"2023-11-18T20:39:01.737147+0000","last_fullsized":"2023-11-18T20:39:01.737147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757532+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:01.757532+0000","last_peered":"2023-11-18T20:39:01.757532+0000","last_clean":"2023-11-18T20:39:01.757532+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:01.757532+0000","last_undegraded":"2023-11-18T20:39:01.757532+0000","last_fullsized":"2023-11-18T20:39:01.757532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:11.799576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725990+0000","last_change":"2023-11-18T20:39:01.725990+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725990+0000","last_undegraded":"2023-11-18T20:39:01.725990+0000","last_fullsized":"2023-11-18T20:39:01.725990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752417+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:01.752417+0000","last_peered":"2023-11-18T20:39:01.752417+0000","last_clean":"2023-11-18T20:39:01.752417+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:01.752417+0000","last_undegraded":"2023-11-18T20:39:01.752417+0000","last_fullsized":"2023-11-18T20:39:01.752417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.733840+0000","last_change":"2023-11-18T20:39:01.733840+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.733840+0000","last_undegraded":"2023-11-18T20:39:01.733840+0000","last_fullsized":"2023-11-18T20:39:01.733840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752094+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:01.752094+0000","last_peered":"2023-11-18T20:39:01.752094+0000","last_clean":"2023-11-18T20:39:01.752094+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:01.752094+0000","last_undegraded":"2023-11-18T20:39:01.752094+0000","last_fullsized":"2023-11-18T20:39:01.752094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:12.391708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725359+0000","last_change":"2023-11-18T20:39:01.725359+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725359+0000","last_undegraded":"2023-11-18T20:39:01.725359+0000","last_fullsized":"2023-11-18T20:39:01.725359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757313+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:01.757313+0000","last_peered":"2023-11-18T20:39:01.757313+0000","last_clean":"2023-11-18T20:39:01.757313+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:01.757313+0000","last_undegraded":"2023-11-18T20:39:01.757313+0000","last_fullsized":"2023-11-18T20:39:01.757313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:54:05.972580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.733733+0000","last_change":"2023-11-18T20:39:01.733733+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.733733+0000","last_undegraded":"2023-11-18T20:39:01.733733+0000","last_fullsized":"2023-11-18T20:39:01.733733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753602+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:01.753602+0000","last_peered":"2023-11-18T20:39:01.753602+0000","last_clean":"2023-11-18T20:39:01.753602+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:01.753602+0000","last_undegraded":"2023-11-18T20:39:01.753602+0000","last_fullsized":"2023-11-18T20:39:01.753602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740817+0000","last_change":"2023-11-18T20:39:01.740817+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740817+0000","last_undegraded":"2023-11-18T20:39:01.740817+0000","last_fullsized":"2023-11-18T20:39:01.740817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.746334+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:01.746334+0000","last_peered":"2023-11-18T20:39:01.746334+0000","last_clean":"2023-11-18T20:39:01.746334+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:01.746334+0000","last_undegraded":"2023-11-18T20:39:01.746334+0000","last_fullsized":"2023-11-18T20:39:01.746334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:10:52.835152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739512+0000","last_change":"2023-11-18T20:39:01.739512+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739512+0000","last_undegraded":"2023-11-18T20:39:01.739512+0000","last_fullsized":"2023-11-18T20:39:01.739512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754696+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:01.754696+0000","last_peered":"2023-11-18T20:39:01.754696+0000","last_clean":"2023-11-18T20:39:01.754696+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:01.754696+0000","last_undegraded":"2023-11-18T20:39:01.754696+0000","last_fullsized":"2023-11-18T20:39:01.754696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.738047+0000","last_change":"2023-11-18T20:39:01.738047+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.738047+0000","last_undegraded":"2023-11-18T20:39:01.738047+0000","last_fullsized":"2023-11-18T20:39:01.738047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754748+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:01.754748+0000","last_peered":"2023-11-18T20:39:01.754748+0000","last_clean":"2023-11-18T20:39:01.754748+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:01.754748+0000","last_undegraded":"2023-11-18T20:39:01.754748+0000","last_fullsized":"2023-11-18T20:39:01.754748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:24:41.889891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.742357+0000","last_change":"2023-11-18T20:39:01.742357+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.742357+0000","last_undegraded":"2023-11-18T20:39:01.742357+0000","last_fullsized":"2023-11-18T20:39:01.742357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757289+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:01.757289+0000","last_peered":"2023-11-18T20:39:01.757289+0000","last_clean":"2023-11-18T20:39:01.757289+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:01.757289+0000","last_undegraded":"2023-11-18T20:39:01.757289+0000","last_fullsized":"2023-11-18T20:39:01.757289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:26:40.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736904+0000","last_change":"2023-11-18T20:39:01.736904+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736904+0000","last_undegraded":"2023-11-18T20:39:01.736904+0000","last_fullsized":"2023-11-18T20:39:01.736904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753361+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:01.753361+0000","last_peered":"2023-11-18T20:39:01.753361+0000","last_clean":"2023-11-18T20:39:01.753361+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:01.753361+0000","last_undegraded":"2023-11-18T20:39:01.753361+0000","last_fullsized":"2023-11-18T20:39:01.753361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:02.510547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737205+0000","last_change":"2023-11-18T20:39:01.737205+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737205+0000","last_undegraded":"2023-11-18T20:39:01.737205+0000","last_fullsized":"2023-11-18T20:39:01.737205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.758146+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:01.758146+0000","last_peered":"2023-11-18T20:39:01.758146+0000","last_clean":"2023-11-18T20:39:01.758146+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:01.758146+0000","last_undegraded":"2023-11-18T20:39:01.758146+0000","last_fullsized":"2023-11-18T20:39:01.758146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729483+0000","last_change":"2023-11-18T20:39:01.729483+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729483+0000","last_undegraded":"2023-11-18T20:39:01.729483+0000","last_fullsized":"2023-11-18T20:39:01.729483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752979+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:01.752979+0000","last_peered":"2023-11-18T20:39:01.752979+0000","last_clean":"2023-11-18T20:39:01.752979+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:01.752979+0000","last_undegraded":"2023-11-18T20:39:01.752979+0000","last_fullsized":"2023-11-18T20:39:01.752979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:13.456432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.741695+0000","last_change":"2023-11-18T20:39:01.741695+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.741695+0000","last_undegraded":"2023-11-18T20:39:01.741695+0000","last_fullsized":"2023-11-18T20:39:01.741695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753166+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:01.753166+0000","last_peered":"2023-11-18T20:39:01.753166+0000","last_clean":"2023-11-18T20:39:01.753166+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:01.753166+0000","last_undegraded":"2023-11-18T20:39:01.753166+0000","last_fullsized":"2023-11-18T20:39:01.753166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:59.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.740348+0000","last_change":"2023-11-18T20:39:01.740348+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.740348+0000","last_undegraded":"2023-11-18T20:39:01.740348+0000","last_fullsized":"2023-11-18T20:39:01.740348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.756810+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:01.756810+0000","last_peered":"2023-11-18T20:39:01.756810+0000","last_clean":"2023-11-18T20:39:01.756810+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:01.756810+0000","last_undegraded":"2023-11-18T20:39:01.756810+0000","last_fullsized":"2023-11-18T20:39:01.756810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:33:29.342499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726472+0000","last_change":"2023-11-18T20:39:01.726472+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726472+0000","last_undegraded":"2023-11-18T20:39:01.726472+0000","last_fullsized":"2023-11-18T20:39:01.726472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753727+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:01.753727+0000","last_peered":"2023-11-18T20:39:01.753727+0000","last_clean":"2023-11-18T20:39:01.753727+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:01.753727+0000","last_undegraded":"2023-11-18T20:39:01.753727+0000","last_fullsized":"2023-11-18T20:39:01.753727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725581+0000","last_change":"2023-11-18T20:39:01.725581+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725581+0000","last_undegraded":"2023-11-18T20:39:01.725581+0000","last_fullsized":"2023-11-18T20:39:01.725581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752908+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:01.752908+0000","last_peered":"2023-11-18T20:39:01.752908+0000","last_clean":"2023-11-18T20:39:01.752908+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:01.752908+0000","last_undegraded":"2023-11-18T20:39:01.752908+0000","last_fullsized":"2023-11-18T20:39:01.752908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:17:42.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.742732+0000","last_change":"2023-11-18T20:39:01.742732+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.742732+0000","last_undegraded":"2023-11-18T20:39:01.742732+0000","last_fullsized":"2023-11-18T20:39:01.742732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750482+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:01.750482+0000","last_peered":"2023-11-18T20:39:01.750482+0000","last_clean":"2023-11-18T20:39:01.750482+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:01.750482+0000","last_undegraded":"2023-11-18T20:39:01.750482+0000","last_fullsized":"2023-11-18T20:39:01.750482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736236+0000","last_change":"2023-11-18T20:39:01.736236+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736236+0000","last_undegraded":"2023-11-18T20:39:01.736236+0000","last_fullsized":"2023-11-18T20:39:01.736236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750645+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:01.750645+0000","last_peered":"2023-11-18T20:39:01.750645+0000","last_clean":"2023-11-18T20:39:01.750645+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:01.750645+0000","last_undegraded":"2023-11-18T20:39:01.750645+0000","last_fullsized":"2023-11-18T20:39:01.750645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.726073+0000","last_change":"2023-11-18T20:39:01.726073+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.726073+0000","last_undegraded":"2023-11-18T20:39:01.726073+0000","last_fullsized":"2023-11-18T20:39:01.726073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753568+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:01.753568+0000","last_peered":"2023-11-18T20:39:01.753568+0000","last_clean":"2023-11-18T20:39:01.753568+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:01.753568+0000","last_undegraded":"2023-11-18T20:39:01.753568+0000","last_fullsized":"2023-11-18T20:39:01.753568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:49:29.015695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727785+0000","last_change":"2023-11-18T20:39:01.727785+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727785+0000","last_undegraded":"2023-11-18T20:39:01.727785+0000","last_fullsized":"2023-11-18T20:39:01.727785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752218+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:01.752218+0000","last_peered":"2023-11-18T20:39:01.752218+0000","last_clean":"2023-11-18T20:39:01.752218+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:01.752218+0000","last_undegraded":"2023-11-18T20:39:01.752218+0000","last_fullsized":"2023-11-18T20:39:01.752218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:59.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.725551+0000","last_change":"2023-11-18T20:39:01.725551+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.725551+0000","last_undegraded":"2023-11-18T20:39:01.725551+0000","last_fullsized":"2023-11-18T20:39:01.725551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.747318+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:01.747318+0000","last_peered":"2023-11-18T20:39:01.747318+0000","last_clean":"2023-11-18T20:39:01.747318+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:01.747318+0000","last_undegraded":"2023-11-18T20:39:01.747318+0000","last_fullsized":"2023-11-18T20:39:01.747318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:59:41.767445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.744133+0000","last_change":"2023-11-18T20:39:01.744133+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.744133+0000","last_undegraded":"2023-11-18T20:39:01.744133+0000","last_fullsized":"2023-11-18T20:39:01.744133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.750469+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:01.750469+0000","last_peered":"2023-11-18T20:39:01.750469+0000","last_clean":"2023-11-18T20:39:01.750469+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:01.750469+0000","last_undegraded":"2023-11-18T20:39:01.750469+0000","last_fullsized":"2023-11-18T20:39:01.750469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:14:43.750184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.739864+0000","last_change":"2023-11-18T20:39:01.739864+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.739864+0000","last_undegraded":"2023-11-18T20:39:01.739864+0000","last_fullsized":"2023-11-18T20:39:01.739864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.754715+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:01.754715+0000","last_peered":"2023-11-18T20:39:01.754715+0000","last_clean":"2023-11-18T20:39:01.754715+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:01.754715+0000","last_undegraded":"2023-11-18T20:39:01.754715+0000","last_fullsized":"2023-11-18T20:39:01.754715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.741417+0000","last_change":"2023-11-18T20:39:01.741417+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.741417+0000","last_undegraded":"2023-11-18T20:39:01.741417+0000","last_fullsized":"2023-11-18T20:39:01.741417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753063+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:01.753063+0000","last_peered":"2023-11-18T20:39:01.753063+0000","last_clean":"2023-11-18T20:39:01.753063+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:01.753063+0000","last_undegraded":"2023-11-18T20:39:01.753063+0000","last_fullsized":"2023-11-18T20:39:01.753063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:29:30.952653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.727725+0000","last_change":"2023-11-18T20:39:01.727725+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.727725+0000","last_undegraded":"2023-11-18T20:39:01.727725+0000","last_fullsized":"2023-11-18T20:39:01.727725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.749666+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:01.749666+0000","last_peered":"2023-11-18T20:39:01.749666+0000","last_clean":"2023-11-18T20:39:01.749666+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:01.749666+0000","last_undegraded":"2023-11-18T20:39:01.749666+0000","last_fullsized":"2023-11-18T20:39:01.749666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:46.938148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.736379+0000","last_change":"2023-11-18T20:39:01.736379+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.736379+0000","last_undegraded":"2023-11-18T20:39:01.736379+0000","last_fullsized":"2023-11-18T20:39:01.736379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752157+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:01.752157+0000","last_peered":"2023-11-18T20:39:01.752157+0000","last_clean":"2023-11-18T20:39:01.752157+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:01.752157+0000","last_undegraded":"2023-11-18T20:39:01.752157+0000","last_fullsized":"2023-11-18T20:39:01.752157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:01.329628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.735586+0000","last_change":"2023-11-18T20:39:01.735586+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.735586+0000","last_undegraded":"2023-11-18T20:39:01.735586+0000","last_fullsized":"2023-11-18T20:39:01.735586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.753665+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:01.753665+0000","last_peered":"2023-11-18T20:39:01.753665+0000","last_clean":"2023-11-18T20:39:01.753665+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:01.753665+0000","last_undegraded":"2023-11-18T20:39:01.753665+0000","last_fullsized":"2023-11-18T20:39:01.753665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.737588+0000","last_change":"2023-11-18T20:39:01.737588+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.737588+0000","last_undegraded":"2023-11-18T20:39:01.737588+0000","last_fullsized":"2023-11-18T20:39:01.737588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.757568+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:01.757568+0000","last_peered":"2023-11-18T20:39:01.757568+0000","last_clean":"2023-11-18T20:39:01.757568+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:01.757568+0000","last_undegraded":"2023-11-18T20:39:01.757568+0000","last_fullsized":"2023-11-18T20:39:01.757568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:45.317633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-11-18T20:39:01.729839+0000","last_change":"2023-11-18T20:39:01.729839+0000","last_active":"2023-11-18T20:39:01.710473+0000","last_peered":"2023-11-18T20:39:01.710473+0000","last_clean":"2023-11-18T20:39:01.710473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:01.729839+0000","last_undegraded":"2023-11-18T20:39:01.729839+0000","last_fullsized":"2023-11-18T20:39:01.729839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T20:39:01.752941+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:01.752941+0000","last_peered":"2023-11-18T20:39:01.752941+0000","last_clean":"2023-11-18T20:39:01.752941+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:01.752941+0000","last_undegraded":"2023-11-18T20:39:01.752941+0000","last_fullsized":"2023-11-18T20:39:01.752941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:26.685337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T20:39:00.714710+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:00.714710+0000","last_peered":"2023-11-18T20:39:00.714710+0000","last_clean":"2023-11-18T20:39:00.714710+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:00.714710+0000","last_undegraded":"2023-11-18T20:39:00.714710+0000","last_fullsized":"2023-11-18T20:39:00.714710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.877},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0149999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92500000000000004}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.216}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.349}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":2.0750000000000002},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.7370000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":2.1640000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.2290000000000001},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.833}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.1319999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1759999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.282},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.3220000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4379999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.847},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3819999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.8009999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":2.1579999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":731927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.141},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84399999999999997}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.0800000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.351},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.1120000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5329999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.645}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.6970000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.2},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.03}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.444},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.089}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.137},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.304},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.248}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.5149999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.704}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.018}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.85099999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.97799999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.1000000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.216},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.4830000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.569},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5209999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.734},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.764}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.079},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.1859999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.999}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.121},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.2190000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.155},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.3700000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.3400000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":950272,"data_stored":725652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.2569999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.2210000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.85099999999999998}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.05},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.876}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.82599999999999996}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.014},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.4690000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.7210000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.508},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.2989999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:08.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-18T20:39:08.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.736567+0000', 'last_change': '2023-11-18T20:39:01.736567+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.736567+0000', 'last_undegraded': '2023-11-18T20:39:01.736567+0000', 'last_fullsized': '2023-11-18T20:39:01.736567+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-18T20:39:08.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.727207+0000', 'last_change': '2023-11-18T20:39:01.727207+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.727207+0000', 'last_undegraded': '2023-11-18T20:39:01.727207+0000', 'last_fullsized': '2023-11-18T20:39:01.727207+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.727435+0000', 'last_change': '2023-11-18T20:39:01.727435+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.727435+0000', 'last_undegraded': '2023-11-18T20:39:01.727435+0000', 'last_fullsized': '2023-11-18T20:39:01.727435+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.740148+0000', 'last_change': '2023-11-18T20:39:01.740148+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.740148+0000', 'last_undegraded': '2023-11-18T20:39:01.740148+0000', 'last_fullsized': '2023-11-18T20:39:01.740148+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.728875+0000', 'last_change': '2023-11-18T20:39:01.728875+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.728875+0000', 'last_undegraded': '2023-11-18T20:39:01.728875+0000', 'last_fullsized': '2023-11-18T20:39:01.728875+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.740629+0000', 'last_change': '2023-11-18T20:39:01.740629+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.740629+0000', 'last_undegraded': '2023-11-18T20:39:01.740629+0000', 'last_fullsized': '2023-11-18T20:39:01.740629+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-18T20:39:08.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.735536+0000', 'last_change': '2023-11-18T20:39:01.735536+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.735536+0000', 'last_undegraded': '2023-11-18T20:39:01.735536+0000', 'last_fullsized': '2023-11-18T20:39:01.735536+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.730543+0000', 'last_change': '2023-11-18T20:39:01.730543+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.730543+0000', 'last_undegraded': '2023-11-18T20:39:01.730543+0000', 'last_fullsized': '2023-11-18T20:39:01.730543+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.729312+0000', 'last_change': '2023-11-18T20:39:01.729312+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.729312+0000', 'last_undegraded': '2023-11-18T20:39:01.729312+0000', 'last_fullsized': '2023-11-18T20:39:01.729312+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.740999+0000', 'last_change': '2023-11-18T20:39:01.740999+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.740999+0000', 'last_undegraded': '2023-11-18T20:39:01.740999+0000', 'last_fullsized': '2023-11-18T20:39:01.740999+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.737579+0000', 'last_change': '2023-11-18T20:39:01.737579+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.737579+0000', 'last_undegraded': '2023-11-18T20:39:01.737579+0000', 'last_fullsized': '2023-11-18T20:39:01.737579+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-18T20:39:08.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.726158+0000', 'last_change': '2023-11-18T20:39:01.726158+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.726158+0000', 'last_undegraded': '2023-11-18T20:39:01.726158+0000', 'last_fullsized': '2023-11-18T20:39:01.726158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.732419+0000', 'last_change': '2023-11-18T20:39:01.732419+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.732419+0000', 'last_undegraded': '2023-11-18T20:39:01.732419+0000', 'last_fullsized': '2023-11-18T20:39:01.732419+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.736349+0000', 'last_change': '2023-11-18T20:39:01.736349+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.736349+0000', 'last_undegraded': '2023-11-18T20:39:01.736349+0000', 'last_fullsized': '2023-11-18T20:39:01.736349+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.727596+0000', 'last_change': '2023-11-18T20:39:01.727596+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.727596+0000', 'last_undegraded': '2023-11-18T20:39:01.727596+0000', 'last_fullsized': '2023-11-18T20:39:01.727596+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.727597+0000', 'last_change': '2023-11-18T20:39:01.727597+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.727597+0000', 'last_undegraded': '2023-11-18T20:39:01.727597+0000', 'last_fullsized': '2023-11-18T20:39:01.727597+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-18T20:39:08.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.740320+0000', 'last_change': '2023-11-18T20:39:01.740320+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.740320+0000', 'last_undegraded': '2023-11-18T20:39:01.740320+0000', 'last_fullsized': '2023-11-18T20:39:01.740320+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.744644+0000', 'last_change': '2023-11-18T20:39:01.744644+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.744644+0000', 'last_undegraded': '2023-11-18T20:39:01.744644+0000', 'last_fullsized': '2023-11-18T20:39:01.744644+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.745493+0000', 'last_change': '2023-11-18T20:39:01.745493+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.745493+0000', 'last_undegraded': '2023-11-18T20:39:01.745493+0000', 'last_fullsized': '2023-11-18T20:39:01.745493+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.735773+0000', 'last_change': '2023-11-18T20:39:01.735773+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.735773+0000', 'last_undegraded': '2023-11-18T20:39:01.735773+0000', 'last_fullsized': '2023-11-18T20:39:01.735773+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.729099+0000', 'last_change': '2023-11-18T20:39:01.729099+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.729099+0000', 'last_undegraded': '2023-11-18T20:39:01.729099+0000', 'last_fullsized': '2023-11-18T20:39:01.729099+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-18T20:39:08.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.736589+0000', 'last_change': '2023-11-18T20:39:01.736589+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.736589+0000', 'last_undegraded': '2023-11-18T20:39:01.736589+0000', 'last_fullsized': '2023-11-18T20:39:01.736589+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.728426+0000', 'last_change': '2023-11-18T20:39:01.728426+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.728426+0000', 'last_undegraded': '2023-11-18T20:39:01.728426+0000', 'last_fullsized': '2023-11-18T20:39:01.728426+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.730071+0000', 'last_change': '2023-11-18T20:39:01.730071+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.730071+0000', 'last_undegraded': '2023-11-18T20:39:01.730071+0000', 'last_fullsized': '2023-11-18T20:39:01.730071+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.740360+0000', 'last_change': '2023-11-18T20:39:01.740360+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.740360+0000', 'last_undegraded': '2023-11-18T20:39:01.740360+0000', 'last_fullsized': '2023-11-18T20:39:01.740360+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.739182+0000', 'last_change': '2023-11-18T20:39:01.739182+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.739182+0000', 'last_undegraded': '2023-11-18T20:39:01.739182+0000', 'last_fullsized': '2023-11-18T20:39:01.739182+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-18T20:39:08.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.730864+0000', 'last_change': '2023-11-18T20:39:01.730864+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.730864+0000', 'last_undegraded': '2023-11-18T20:39:01.730864+0000', 'last_fullsized': '2023-11-18T20:39:01.730864+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.732054+0000', 'last_change': '2023-11-18T20:39:01.732054+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.732054+0000', 'last_undegraded': '2023-11-18T20:39:01.732054+0000', 'last_fullsized': '2023-11-18T20:39:01.732054+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.729718+0000', 'last_change': '2023-11-18T20:39:01.729718+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.729718+0000', 'last_undegraded': '2023-11-18T20:39:01.729718+0000', 'last_fullsized': '2023-11-18T20:39:01.729718+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.730086+0000', 'last_change': '2023-11-18T20:39:01.730086+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.730086+0000', 'last_undegraded': '2023-11-18T20:39:01.730086+0000', 'last_fullsized': '2023-11-18T20:39:01.730086+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.730414+0000', 'last_change': '2023-11-18T20:39:01.730414+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.730414+0000', 'last_undegraded': '2023-11-18T20:39:01.730414+0000', 'last_fullsized': '2023-11-18T20:39:01.730414+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-18T20:39:08.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.737376+0000', 'last_change': '2023-11-18T20:39:01.737376+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.737376+0000', 'last_undegraded': '2023-11-18T20:39:01.737376+0000', 'last_fullsized': '2023-11-18T20:39:01.737376+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.731277+0000', 'last_change': '2023-11-18T20:39:01.731277+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.731277+0000', 'last_undegraded': '2023-11-18T20:39:01.731277+0000', 'last_fullsized': '2023-11-18T20:39:01.731277+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.735851+0000', 'last_change': '2023-11-18T20:39:01.735851+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.735851+0000', 'last_undegraded': '2023-11-18T20:39:01.735851+0000', 'last_fullsized': '2023-11-18T20:39:01.735851+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.731409+0000', 'last_change': '2023-11-18T20:39:01.731409+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.731409+0000', 'last_undegraded': '2023-11-18T20:39:01.731409+0000', 'last_fullsized': '2023-11-18T20:39:01.731409+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.737147+0000', 'last_change': '2023-11-18T20:39:01.737147+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.737147+0000', 'last_undegraded': '2023-11-18T20:39:01.737147+0000', 'last_fullsized': '2023-11-18T20:39:01.737147+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.725990+0000', 'last_change': '2023-11-18T20:39:01.725990+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.725990+0000', 'last_undegraded': '2023-11-18T20:39:01.725990+0000', 'last_fullsized': '2023-11-18T20:39:01.725990+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T20:39:08.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.733840+0000', 'last_change': '2023-11-18T20:39:01.733840+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.733840+0000', 'last_undegraded': '2023-11-18T20:39:01.733840+0000', 'last_fullsized': '2023-11-18T20:39:01.733840+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.725359+0000', 'last_change': '2023-11-18T20:39:01.725359+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.725359+0000', 'last_undegraded': '2023-11-18T20:39:01.725359+0000', 'last_fullsized': '2023-11-18T20:39:01.725359+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.733733+0000', 'last_change': '2023-11-18T20:39:01.733733+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.733733+0000', 'last_undegraded': '2023-11-18T20:39:01.733733+0000', 'last_fullsized': '2023-11-18T20:39:01.733733+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.740817+0000', 'last_change': '2023-11-18T20:39:01.740817+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.740817+0000', 'last_undegraded': '2023-11-18T20:39:01.740817+0000', 'last_fullsized': '2023-11-18T20:39:01.740817+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.739512+0000', 'last_change': '2023-11-18T20:39:01.739512+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.739512+0000', 'last_undegraded': '2023-11-18T20:39:01.739512+0000', 'last_fullsized': '2023-11-18T20:39:01.739512+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-18T20:39:08.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.738047+0000', 'last_change': '2023-11-18T20:39:01.738047+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.738047+0000', 'last_undegraded': '2023-11-18T20:39:01.738047+0000', 'last_fullsized': '2023-11-18T20:39:01.738047+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.742357+0000', 'last_change': '2023-11-18T20:39:01.742357+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.742357+0000', 'last_undegraded': '2023-11-18T20:39:01.742357+0000', 'last_fullsized': '2023-11-18T20:39:01.742357+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.736904+0000', 'last_change': '2023-11-18T20:39:01.736904+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.736904+0000', 'last_undegraded': '2023-11-18T20:39:01.736904+0000', 'last_fullsized': '2023-11-18T20:39:01.736904+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.737205+0000', 'last_change': '2023-11-18T20:39:01.737205+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.737205+0000', 'last_undegraded': '2023-11-18T20:39:01.737205+0000', 'last_fullsized': '2023-11-18T20:39:01.737205+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.729483+0000', 'last_change': '2023-11-18T20:39:01.729483+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.729483+0000', 'last_undegraded': '2023-11-18T20:39:01.729483+0000', 'last_fullsized': '2023-11-18T20:39:01.729483+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-18T20:39:08.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.741695+0000', 'last_change': '2023-11-18T20:39:01.741695+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.741695+0000', 'last_undegraded': '2023-11-18T20:39:01.741695+0000', 'last_fullsized': '2023-11-18T20:39:01.741695+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.740348+0000', 'last_change': '2023-11-18T20:39:01.740348+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.740348+0000', 'last_undegraded': '2023-11-18T20:39:01.740348+0000', 'last_fullsized': '2023-11-18T20:39:01.740348+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.726472+0000', 'last_change': '2023-11-18T20:39:01.726472+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.726472+0000', 'last_undegraded': '2023-11-18T20:39:01.726472+0000', 'last_fullsized': '2023-11-18T20:39:01.726472+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.725581+0000', 'last_change': '2023-11-18T20:39:01.725581+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.725581+0000', 'last_undegraded': '2023-11-18T20:39:01.725581+0000', 'last_fullsized': '2023-11-18T20:39:01.725581+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.742732+0000', 'last_change': '2023-11-18T20:39:01.742732+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.742732+0000', 'last_undegraded': '2023-11-18T20:39:01.742732+0000', 'last_fullsized': '2023-11-18T20:39:01.742732+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:39:08.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.736236+0000', 'last_change': '2023-11-18T20:39:01.736236+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.736236+0000', 'last_undegraded': '2023-11-18T20:39:01.736236+0000', 'last_fullsized': '2023-11-18T20:39:01.736236+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.726073+0000', 'last_change': '2023-11-18T20:39:01.726073+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.726073+0000', 'last_undegraded': '2023-11-18T20:39:01.726073+0000', 'last_fullsized': '2023-11-18T20:39:01.726073+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.727785+0000', 'last_change': '2023-11-18T20:39:01.727785+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.727785+0000', 'last_undegraded': '2023-11-18T20:39:01.727785+0000', 'last_fullsized': '2023-11-18T20:39:01.727785+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.725551+0000', 'last_change': '2023-11-18T20:39:01.725551+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.725551+0000', 'last_undegraded': '2023-11-18T20:39:01.725551+0000', 'last_fullsized': '2023-11-18T20:39:01.725551+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.744133+0000', 'last_change': '2023-11-18T20:39:01.744133+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.744133+0000', 'last_undegraded': '2023-11-18T20:39:01.744133+0000', 'last_fullsized': '2023-11-18T20:39:01.744133+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:39:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.739864+0000', 'last_change': '2023-11-18T20:39:01.739864+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.739864+0000', 'last_undegraded': '2023-11-18T20:39:01.739864+0000', 'last_fullsized': '2023-11-18T20:39:01.739864+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.741417+0000', 'last_change': '2023-11-18T20:39:01.741417+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.741417+0000', 'last_undegraded': '2023-11-18T20:39:01.741417+0000', 'last_fullsized': '2023-11-18T20:39:01.741417+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.727725+0000', 'last_change': '2023-11-18T20:39:01.727725+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.727725+0000', 'last_undegraded': '2023-11-18T20:39:01.727725+0000', 'last_fullsized': '2023-11-18T20:39:01.727725+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.736379+0000', 'last_change': '2023-11-18T20:39:01.736379+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.736379+0000', 'last_undegraded': '2023-11-18T20:39:01.736379+0000', 'last_fullsized': '2023-11-18T20:39:01.736379+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.735586+0000', 'last_change': '2023-11-18T20:39:01.735586+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.735586+0000', 'last_undegraded': '2023-11-18T20:39:01.735586+0000', 'last_fullsized': '2023-11-18T20:39:01.735586+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-18T20:39:08.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.737588+0000', 'last_change': '2023-11-18T20:39:01.737588+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.737588+0000', 'last_undegraded': '2023-11-18T20:39:01.737588+0000', 'last_fullsized': '2023-11-18T20:39:01.737588+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T20:39:08.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-18T20:39:08.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-11-18T20:39:01.729839+0000', 'last_change': '2023-11-18T20:39:01.729839+0000', 'last_active': '2023-11-18T20:39:01.710473+0000', 'last_peered': '2023-11-18T20:39:01.710473+0000', 'last_clean': '2023-11-18T20:39:01.710473+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T20:39:01.729839+0000', 'last_undegraded': '2023-11-18T20:39:01.729839+0000', 'last_fullsized': '2023-11-18T20:39:01.729839+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'last_clean_scrub_stamp': '2023-11-18T20:39:01.710473+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T20:39:08.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-18T20:39:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.473+0000 7fd008389640 1 Processor -- start 2023-11-18T20:39:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.473+0000 7fd008389640 1 -- start start 2023-11-18T20:39:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.475+0000 7fd008389640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0000724f0 0x7fd000154c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.475+0000 7fd008389640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0000aadc0 con 0x7fd0000c3bc0 2023-11-18T20:39:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.475+0000 7fd008389640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0000c4170 con 0x7fd0000a5240 2023-11-18T20:39:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.475+0000 7fd008389640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd000151be0 con 0x7fd0000724f0 2023-11-18T20:39:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.475+0000 7fd005924640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd0000c3bc0 0x7fd000154500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37418/0 (socket says 172.21.15.132:37418) 2023-11-18T20:39:08.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.475+0000 7fd005924640 1 -- 172.21.15.132:0/2625008871 learned_addr learned my addr 172.21.15.132:0/2625008871 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:08.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd006926640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0000724f0 0x7fd000154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158087471 0 0) 0x7fd0000aadc0 con 0x7fd0000c3bc0 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfec003440 con 0x7fd0000c3bc0 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2487072634 0 0) 0x7fcfec003440 con 0x7fd0000c3bc0 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0000724f0 msgr2=0x7fd000154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0000724f0 0x7fd000154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 >> v1:172.21.15.161:6789/0 conn(0x7fd0000a5240 legacy=0x7fd0000c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000c4450 con 0x7fd0000c3bc0 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fcff4001670 con 0x7fd0000c3bc0 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 >> v1:172.21.15.132:6789/0 conn(0x7fd0000c3bc0 legacy=0x7fd000154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fcfec003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0000724f0 0x7fcfec00a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfec00afa0 0x7fcfec00d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec00dcb0 con 0x7fcfec003a90 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec00de20 con 0x7fcfec00afa0 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.476+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec00dfe0 con 0x7fd0000724f0 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.477+0000 7fd006125640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fcfec003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.477+0000 7fd006125640 1 -- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0000724f0 msgr2=0x7fcfec00a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.477+0000 7fd006125640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0000724f0 0x7fcfec00a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.477+0000 7fd006125640 1 -- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfec00afa0 msgr2=0x7fcfec00d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.477+0000 7fd006125640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfec00afa0 0x7fcfec00d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.477+0000 7fd006125640 1 -- 172.21.15.132:0/2625008871 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec003440 con 0x7fcfec003a90 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.478+0000 7fd006125640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fcfec003eb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcffc001750 tx=0x7fcfec0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0deb5747743a95 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.478+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0052d0 con 0x7fcfec003a90 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.478+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc02e050 con 0x7fcfec003a90 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.478+0000 7fd005123640 1 -- 172.21.15.132:0/2625008871 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0035f0 con 0x7fcfec003a90 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.479+0000 7fd008389640 1 -- 172.21.15.132:0/2625008871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 msgr2=0x7fcfec003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.479+0000 7fd008389640 1 --2- 172.21.15.132:0/2625008871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fcfec003eb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcffc001750 tx=0x7fcfec0036f0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.479+0000 7fd006926640 1 -- 172.21.15.132:0/2625008871 reap_dead start 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.479+0000 7fd008389640 1 -- 172.21.15.132:0/2625008871 shutdown_connections 2023-11-18T20:39:08.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.479+0000 7fd008389640 1 -- 172.21.15.132:0/2625008871 >> 172.21.15.132:0/2625008871 conn(0x7fd00006a500 msgr2=0x7fd00006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.479+0000 7fd008389640 1 -- 172.21.15.132:0/2625008871 shutdown_connections 2023-11-18T20:39:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.479+0000 7fd008389640 1 -- 172.21.15.132:0/2625008871 wait complete. 2023-11-18T20:39:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.481+0000 7fd008389640 1 Processor -- start 2023-11-18T20:39:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.481+0000 7fd008389640 1 -- start start 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd008389640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fd0001edde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd008389640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd00014dd90 0x7fd00014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd008389640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd000144df0 0x7fd000145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd008389640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00014c8e0 con 0x7fcfec003a90 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd008389640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00014cbc0 con 0x7fd00014dd90 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd008389640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00014cea0 con 0x7fd000144df0 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd006125640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fd0001edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd006125640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fd0001edde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33418/0 (socket says 172.21.15.132:33418) 2023-11-18T20:39:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.482+0000 7fd006125640 1 -- 172.21.15.132:0/686277391 learned_addr learned my addr 172.21.15.132:0/686277391 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd006125640 1 -- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd000144df0 msgr2=0x7fd000145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd006926640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd000144df0 0x7fd000145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd005924640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd00014dd90 0x7fd00014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd006125640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd000144df0 0x7fd000145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd006125640 1 -- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd00014dd90 msgr2=0x7fd00014bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd006125640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd00014dd90 0x7fd00014bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd006125640 1 -- 172.21.15.132:0/686277391 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00014d180 con 0x7fcfec003a90 2023-11-18T20:39:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd005924640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd00014dd90 0x7fd00014bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd006125640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fd0001edde0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcffc008fd0 tx=0x7fcffc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fcff2ffd640 1 -- 172.21.15.132:0/686277391 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0076c0 con 0x7fcfec003a90 2023-11-18T20:39:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fcff2ffd640 1 -- 172.21.15.132:0/686277391 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc007a30 con 0x7fcfec003a90 2023-11-18T20:39:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fcff2ffd640 1 -- 172.21.15.132:0/686277391 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc006be0 con 0x7fcfec003a90 2023-11-18T20:39:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.483+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00014d460 con 0x7fcfec003a90 2023-11-18T20:39:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.484+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00014c020 con 0x7fcfec003a90 2023-11-18T20:39:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.485+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00014d5f0 con 0x7fcfec003a90 2023-11-18T20:39:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.486+0000 7fcff2ffd640 1 -- 172.21.15.132:0/686277391 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcffc006d40 con 0x7fcfec003a90 2023-11-18T20:39:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.487+0000 7fcff2ffd640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfe406ae40 0x7fcfe406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.487+0000 7fcff2ffd640 1 -- 172.21.15.132:0/686277391 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcffc0ab640 con 0x7fcfec003a90 2023-11-18T20:39:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.487+0000 7fd005924640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfe406ae40 0x7fcfe406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.489+0000 7fd005924640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfe406ae40 0x7fcfe406d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0000a6c40 tx=0x7fcff4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:08.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.491+0000 7fcff2ffd640 1 -- 172.21.15.132:0/686277391 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcffc076780 con 0x7fcfec003a90 2023-11-18T20:39:08.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.751+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd000068350 con 0x7fcfec003a90 2023-11-18T20:39:08.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.752+0000 7fcff2ffd640 1 -- 172.21.15.132:0/686277391 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1580 (secure 0 0 0) 0x7fcffc079da0 con 0x7fcfec003a90 2023-11-18T20:39:08.753 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:08.754 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":89,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1700339871,"num_in_osds":8,"osd_in_since":1700339863,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225472512,"bytes_avail":772868640768,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4977}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-18T20:38:54.650627+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-18T20:39:08.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfe406ae40 msgr2=0x7fcfe406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfe406ae40 0x7fcfe406d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0000a6c40 tx=0x7fcff4009040 comp rx=0 tx=0).stop 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 msgr2=0x7fd0001edde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fd0001edde0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcffc008fd0 tx=0x7fcffc001120 comp rx=0 tx=0).stop 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 shutdown_connections 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcfe406ae40 0x7fcfe406d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd000144df0 0x7fd000145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd00014dd90 0x7fd00014bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 --2- 172.21.15.132:0/686277391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfec003a90 0x7fd0001edde0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 >> 172.21.15.132:0/686277391 conn(0x7fd00006a500 msgr2=0x7fd00006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 shutdown_connections 2023-11-18T20:39:08.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.755+0000 7fd008389640 1 -- 172.21.15.132:0/686277391 wait complete. 2023-11-18T20:39:08.774 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-18T20:39:08.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.987+0000 7fb980a46640 1 Processor -- start 2023-11-18T20:39:08.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.987+0000 7fb980a46640 1 -- start start 2023-11-18T20:39:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.988+0000 7fb980a46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb97c14fd30 0x7fb97c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb980a46640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c3ea0 0x7fb97c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb980a46640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c0c64a0 con 0x7fb97c06d0a0 2023-11-18T20:39:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb980a46640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c0c5c00 con 0x7fb97c14fd30 2023-11-18T20:39:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb980a46640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0c5ee0 con 0x7fb97c0c3ea0 2023-11-18T20:39:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb97a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb97c14fd30 0x7fb97c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb973fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb97c06d0a0 0x7fb97c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43822/0 (socket says 172.21.15.132:43822) 2023-11-18T20:39:08.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb97a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb97c14fd30 0x7fb97c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55930/0 (socket says 172.21.15.132:55930) 2023-11-18T20:39:08.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb973fff640 1 -- 172.21.15.132:0/3598885646 learned_addr learned my addr 172.21.15.132:0/3598885646 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:08.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb97ad9d640 1 --2- 172.21.15.132:0/3598885646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c3ea0 0x7fb97c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb97a59c640 1 -- 172.21.15.132:0/3598885646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c3ea0 msgr2=0x7fb97c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:08.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb97a59c640 1 --2- 172.21.15.132:0/3598885646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c3ea0 0x7fb97c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb97a59c640 1 -- 172.21.15.132:0/3598885646 >> v1:172.21.15.132:6789/0 conn(0x7fb97c06d0a0 legacy=0x7fb97c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb97a59c640 1 -- 172.21.15.132:0/3598885646 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0c61c0 con 0x7fb97c14fd30 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb979d9b640 1 -- 172.21.15.132:0/3598885646 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595184117 0 0) 0x7fb97c0c64a0 con 0x7fb97c06d0a0 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.989+0000 7fb97ad9d640 1 --2- 172.21.15.132:0/3598885646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c3ea0 0x7fb97c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.991+0000 7fb97a59c640 1 --2- 172.21.15.132:0/3598885646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c152f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0097a0 tx=0x7fb96c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e43ab4de05587e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.991+0000 7fb979d9b640 1 -- 172.21.15.132:0/3598885646 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c02d040 con 0x7fb97c14fd30 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.991+0000 7fb979d9b640 1 -- 172.21.15.132:0/3598885646 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c031810 con 0x7fb97c14fd30 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.991+0000 7fb979d9b640 1 -- 172.21.15.132:0/3598885646 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c031ba0 con 0x7fb97c14fd30 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.991+0000 7fb980a46640 1 -- 172.21.15.132:0/3598885646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 msgr2=0x7fb97c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.991+0000 7fb980a46640 1 --2- 172.21.15.132:0/3598885646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c152f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0097a0 tx=0x7fb96c02b8b0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.991+0000 7fb980a46640 1 -- 172.21.15.132:0/3598885646 shutdown_connections 2023-11-18T20:39:08.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.992+0000 7fb980a46640 1 --2- 172.21.15.132:0/3598885646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c3ea0 0x7fb97c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.992+0000 7fb980a46640 1 --2- 172.21.15.132:0/3598885646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c152f20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:08.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.992+0000 7fb980a46640 1 -- 172.21.15.132:0/3598885646 >> 172.21.15.132:0/3598885646 conn(0x7fb97c06a500 msgr2=0x7fb97c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:08.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.992+0000 7fb980a46640 1 -- 172.21.15.132:0/3598885646 shutdown_connections 2023-11-18T20:39:08.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.992+0000 7fb980a46640 1 -- 172.21.15.132:0/3598885646 wait complete. 2023-11-18T20:39:08.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.993+0000 7fb980a46640 1 Processor -- start 2023-11-18T20:39:08.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.993+0000 7fb980a46640 1 -- start start 2023-11-18T20:39:08.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.994+0000 7fb980a46640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c06d0a0 0x7fb97c155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.994+0000 7fb980a46640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c0c3ea0 0x7fb97c14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.994+0000 7fb980a46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c1e9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.994+0000 7fb980a46640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c153f60 con 0x7fb97c14fd30 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.994+0000 7fb980a46640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0a7f90 con 0x7fb97c0c3ea0 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.994+0000 7fb980a46640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c1e63c0 con 0x7fb97c06d0a0 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c1e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c1e9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55936/0 (socket says 172.21.15.132:55936) 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 -- 172.21.15.132:0/2290267708 learned_addr learned my addr 172.21.15.132:0/2290267708 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97a59c640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c06d0a0 0x7fb97c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb973fff640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c0c3ea0 0x7fb97c14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 -- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c06d0a0 msgr2=0x7fb97c155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:08.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c06d0a0 0x7fb97c155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 -- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c0c3ea0 msgr2=0x7fb97c14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c0c3ea0 0x7fb97c14d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 -- 172.21.15.132:0/2290267708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c009400 con 0x7fb97c14fd30 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97a59c640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c06d0a0 0x7fb97c155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.995+0000 7fb97ad9d640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c1e9640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb97400cef0 tx=0x7fb97400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.996+0000 7fb972ffd640 1 -- 172.21.15.132:0/2290267708 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97400d840 con 0x7fb97c14fd30 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.996+0000 7fb972ffd640 1 -- 172.21.15.132:0/2290267708 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97400d9c0 con 0x7fb97c14fd30 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.996+0000 7fb972ffd640 1 -- 172.21.15.132:0/2290267708 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97400dd70 con 0x7fb97c14fd30 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.996+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c1e8e40 con 0x7fb97c14fd30 2023-11-18T20:39:09.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.996+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c14d7b0 con 0x7fb97c14fd30 2023-11-18T20:39:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.997+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c1e9360 con 0x7fb97c14fd30 2023-11-18T20:39:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.998+0000 7fb972ffd640 1 -- 172.21.15.132:0/2290267708 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb97401e3b0 con 0x7fb97c14fd30 2023-11-18T20:39:09.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.999+0000 7fb972ffd640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb95c06ae70 0x7fb95c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:09.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:08.999+0000 7fb972ffd640 1 -- 172.21.15.132:0/2290267708 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb97408a150 con 0x7fb97c14fd30 2023-11-18T20:39:09.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.000+0000 7fb97a59c640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb95c06ae70 0x7fb95c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:09.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.001+0000 7fb97a59c640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb95c06ae70 0x7fb95c06d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb96c036000 tx=0x7fb96c03c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:09.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.003+0000 7fb972ffd640 1 -- 172.21.15.132:0/2290267708 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb97c1e9360 con 0x7fb97c14fd30 2023-11-18T20:39:09.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.191+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb97c072980 con 0x7fb95c06ae70 2023-11-18T20:39:09.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.214+0000 7fb972ffd640 1 -- 172.21.15.132:0/2290267708 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286465 (secure 0 0 0) 0x7fb96c03a420 con 0x7fb95c06ae70 2023-11-18T20:39:09.218 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb95c06ae70 msgr2=0x7fb95c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb95c06ae70 0x7fb95c06d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb96c036000 tx=0x7fb96c03c040 comp rx=0 tx=0).stop 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 msgr2=0x7fb97c1e9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c1e9640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb97400cef0 tx=0x7fb97400a710 comp rx=0 tx=0).stop 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 shutdown_connections 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb95c06ae70 0x7fb95c06d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb97c14fd30 0x7fb97c1e9640 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c0c3ea0 0x7fb97c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 --2- 172.21.15.132:0/2290267708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c06d0a0 0x7fb97c155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.221+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 >> 172.21.15.132:0/2290267708 conn(0x7fb97c06a500 msgr2=0x7fb97c06ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.222+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 shutdown_connections 2023-11-18T20:39:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:09.222+0000 7fb980a46640 1 -- 172.21.15.132:0/2290267708 wait complete. 2023-11-18T20:39:09.243 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-18T20:39:08.654578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220492,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754228,"statfs":{"total":773094113280,"available":772868329472,"internally_reserved":0,"allocated":4399104,"data_stored":2422628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.935267"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861344+0000","last_change":"2023-11-18T20:39:02.760762+0000","last_active":"2023-11-18T20:39:03.861344+0000","last_peered":"2023-11-18T20:39:03.861344+0000","last_clean":"2023-11-18T20:39:03.861344+0000","last_became_active":"2023-11-18T20:39:02.760426+0000","last_became_peered":"2023-11-18T20:39:02.760426+0000","last_unstale":"2023-11-18T20:39:03.861344+0000","last_undegraded":"2023-11-18T20:39:03.861344+0000","last_fullsized":"2023-11-18T20:39:03.861344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859510+0000","last_change":"2023-11-18T20:39:02.774649+0000","last_active":"2023-11-18T20:39:03.859510+0000","last_peered":"2023-11-18T20:39:03.859510+0000","last_clean":"2023-11-18T20:39:03.859510+0000","last_became_active":"2023-11-18T20:39:02.774358+0000","last_became_peered":"2023-11-18T20:39:02.774358+0000","last_unstale":"2023-11-18T20:39:03.859510+0000","last_undegraded":"2023-11-18T20:39:03.859510+0000","last_fullsized":"2023-11-18T20:39:03.859510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861338+0000","last_change":"2023-11-18T20:39:02.756005+0000","last_active":"2023-11-18T20:39:03.861338+0000","last_peered":"2023-11-18T20:39:03.861338+0000","last_clean":"2023-11-18T20:39:03.861338+0000","last_became_active":"2023-11-18T20:39:02.754298+0000","last_became_peered":"2023-11-18T20:39:02.754298+0000","last_unstale":"2023-11-18T20:39:03.861338+0000","last_undegraded":"2023-11-18T20:39:03.861338+0000","last_fullsized":"2023-11-18T20:39:03.861338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753401+0000","last_change":"2023-11-18T20:39:02.752584+0000","last_active":"2023-11-18T20:39:03.753401+0000","last_peered":"2023-11-18T20:39:03.753401+0000","last_clean":"2023-11-18T20:39:03.753401+0000","last_became_active":"2023-11-18T20:39:02.752259+0000","last_became_peered":"2023-11-18T20:39:02.752259+0000","last_unstale":"2023-11-18T20:39:03.753401+0000","last_undegraded":"2023-11-18T20:39:03.753401+0000","last_fullsized":"2023-11-18T20:39:03.753401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859198+0000","last_change":"2023-11-18T20:39:02.757930+0000","last_active":"2023-11-18T20:39:03.859198+0000","last_peered":"2023-11-18T20:39:03.859198+0000","last_clean":"2023-11-18T20:39:03.859198+0000","last_became_active":"2023-11-18T20:39:02.757463+0000","last_became_peered":"2023-11-18T20:39:02.757463+0000","last_unstale":"2023-11-18T20:39:03.859198+0000","last_undegraded":"2023-11-18T20:39:03.859198+0000","last_fullsized":"2023-11-18T20:39:03.859198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.755543+0000","last_change":"2023-11-18T20:39:02.755127+0000","last_active":"2023-11-18T20:39:03.755543+0000","last_peered":"2023-11-18T20:39:03.755543+0000","last_clean":"2023-11-18T20:39:03.755543+0000","last_became_active":"2023-11-18T20:39:02.754791+0000","last_became_peered":"2023-11-18T20:39:02.754791+0000","last_unstale":"2023-11-18T20:39:03.755543+0000","last_undegraded":"2023-11-18T20:39:03.755543+0000","last_fullsized":"2023-11-18T20:39:03.755543+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860507+0000","last_change":"2023-11-18T20:39:02.767101+0000","last_active":"2023-11-18T20:39:03.860507+0000","last_peered":"2023-11-18T20:39:03.860507+0000","last_clean":"2023-11-18T20:39:03.860507+0000","last_became_active":"2023-11-18T20:39:02.764500+0000","last_became_peered":"2023-11-18T20:39:02.764500+0000","last_unstale":"2023-11-18T20:39:03.860507+0000","last_undegraded":"2023-11-18T20:39:03.860507+0000","last_fullsized":"2023-11-18T20:39:03.860507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860187+0000","last_change":"2023-11-18T20:39:02.744529+0000","last_active":"2023-11-18T20:39:03.860187+0000","last_peered":"2023-11-18T20:39:03.860187+0000","last_clean":"2023-11-18T20:39:03.860187+0000","last_became_active":"2023-11-18T20:39:02.744056+0000","last_became_peered":"2023-11-18T20:39:02.744056+0000","last_unstale":"2023-11-18T20:39:03.860187+0000","last_undegraded":"2023-11-18T20:39:03.860187+0000","last_fullsized":"2023-11-18T20:39:03.860187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:28.509793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861733+0000","last_change":"2023-11-18T20:39:02.775795+0000","last_active":"2023-11-18T20:39:03.861733+0000","last_peered":"2023-11-18T20:39:03.861733+0000","last_clean":"2023-11-18T20:39:03.861733+0000","last_became_active":"2023-11-18T20:39:02.775493+0000","last_became_peered":"2023-11-18T20:39:02.775493+0000","last_unstale":"2023-11-18T20:39:03.861733+0000","last_undegraded":"2023-11-18T20:39:03.861733+0000","last_fullsized":"2023-11-18T20:39:03.861733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754139+0000","last_change":"2023-11-18T20:39:02.764804+0000","last_active":"2023-11-18T20:39:03.754139+0000","last_peered":"2023-11-18T20:39:03.754139+0000","last_clean":"2023-11-18T20:39:03.754139+0000","last_became_active":"2023-11-18T20:39:02.764574+0000","last_became_peered":"2023-11-18T20:39:02.764574+0000","last_unstale":"2023-11-18T20:39:03.754139+0000","last_undegraded":"2023-11-18T20:39:03.754139+0000","last_fullsized":"2023-11-18T20:39:03.754139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754367+0000","last_change":"2023-11-18T20:39:02.773954+0000","last_active":"2023-11-18T20:39:03.754367+0000","last_peered":"2023-11-18T20:39:03.754367+0000","last_clean":"2023-11-18T20:39:03.754367+0000","last_became_active":"2023-11-18T20:39:02.773686+0000","last_became_peered":"2023-11-18T20:39:02.773686+0000","last_unstale":"2023-11-18T20:39:03.754367+0000","last_undegraded":"2023-11-18T20:39:03.754367+0000","last_fullsized":"2023-11-18T20:39:03.754367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:54.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860861+0000","last_change":"2023-11-18T20:39:02.756659+0000","last_active":"2023-11-18T20:39:03.860861+0000","last_peered":"2023-11-18T20:39:03.860861+0000","last_clean":"2023-11-18T20:39:03.860861+0000","last_became_active":"2023-11-18T20:39:02.756336+0000","last_became_peered":"2023-11-18T20:39:02.756336+0000","last_unstale":"2023-11-18T20:39:03.860861+0000","last_undegraded":"2023-11-18T20:39:03.860861+0000","last_fullsized":"2023-11-18T20:39:03.860861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:14.460811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.864332+0000","last_change":"2023-11-18T20:39:02.748415+0000","last_active":"2023-11-18T20:39:03.864332+0000","last_peered":"2023-11-18T20:39:03.864332+0000","last_clean":"2023-11-18T20:39:03.864332+0000","last_became_active":"2023-11-18T20:39:02.748123+0000","last_became_peered":"2023-11-18T20:39:02.748123+0000","last_unstale":"2023-11-18T20:39:03.864332+0000","last_undegraded":"2023-11-18T20:39:03.864332+0000","last_fullsized":"2023-11-18T20:39:03.864332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:36:58.122129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754662+0000","last_change":"2023-11-18T20:39:02.766121+0000","last_active":"2023-11-18T20:39:03.754662+0000","last_peered":"2023-11-18T20:39:03.754662+0000","last_clean":"2023-11-18T20:39:03.754662+0000","last_became_active":"2023-11-18T20:39:02.765807+0000","last_became_peered":"2023-11-18T20:39:02.765807+0000","last_unstale":"2023-11-18T20:39:03.754662+0000","last_undegraded":"2023-11-18T20:39:03.754662+0000","last_fullsized":"2023-11-18T20:39:03.754662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:15.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779211+0000","last_change":"2023-11-18T20:39:02.750962+0000","last_active":"2023-11-18T20:39:03.779211+0000","last_peered":"2023-11-18T20:39:03.779211+0000","last_clean":"2023-11-18T20:39:03.779211+0000","last_became_active":"2023-11-18T20:39:02.750695+0000","last_became_peered":"2023-11-18T20:39:02.750695+0000","last_unstale":"2023-11-18T20:39:03.779211+0000","last_undegraded":"2023-11-18T20:39:03.779211+0000","last_fullsized":"2023-11-18T20:39:03.779211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779037+0000","last_change":"2023-11-18T20:39:02.759711+0000","last_active":"2023-11-18T20:39:03.779037+0000","last_peered":"2023-11-18T20:39:03.779037+0000","last_clean":"2023-11-18T20:39:03.779037+0000","last_became_active":"2023-11-18T20:39:02.759422+0000","last_became_peered":"2023-11-18T20:39:02.759422+0000","last_unstale":"2023-11-18T20:39:03.779037+0000","last_undegraded":"2023-11-18T20:39:03.779037+0000","last_fullsized":"2023-11-18T20:39:03.779037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754122+0000","last_change":"2023-11-18T20:39:02.766551+0000","last_active":"2023-11-18T20:39:03.754122+0000","last_peered":"2023-11-18T20:39:03.754122+0000","last_clean":"2023-11-18T20:39:03.754122+0000","last_became_active":"2023-11-18T20:39:02.765528+0000","last_became_peered":"2023-11-18T20:39:02.765528+0000","last_unstale":"2023-11-18T20:39:03.754122+0000","last_undegraded":"2023-11-18T20:39:03.754122+0000","last_fullsized":"2023-11-18T20:39:03.754122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:30.943404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.756184+0000","last_change":"2023-11-18T20:39:02.755514+0000","last_active":"2023-11-18T20:39:03.756184+0000","last_peered":"2023-11-18T20:39:03.756184+0000","last_clean":"2023-11-18T20:39:03.756184+0000","last_became_active":"2023-11-18T20:39:02.755083+0000","last_became_peered":"2023-11-18T20:39:02.755083+0000","last_unstale":"2023-11-18T20:39:03.756184+0000","last_undegraded":"2023-11-18T20:39:03.756184+0000","last_fullsized":"2023-11-18T20:39:03.756184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:57.948105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.755773+0000","last_change":"2023-11-18T20:39:02.759862+0000","last_active":"2023-11-18T20:39:03.755773+0000","last_peered":"2023-11-18T20:39:03.755773+0000","last_clean":"2023-11-18T20:39:03.755773+0000","last_became_active":"2023-11-18T20:39:02.759565+0000","last_became_peered":"2023-11-18T20:39:02.759565+0000","last_unstale":"2023-11-18T20:39:03.755773+0000","last_undegraded":"2023-11-18T20:39:03.755773+0000","last_fullsized":"2023-11-18T20:39:03.755773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.864544+0000","last_change":"2023-11-18T20:39:02.769220+0000","last_active":"2023-11-18T20:39:03.864544+0000","last_peered":"2023-11-18T20:39:03.864544+0000","last_clean":"2023-11-18T20:39:03.864544+0000","last_became_active":"2023-11-18T20:39:02.762271+0000","last_became_peered":"2023-11-18T20:39:02.762271+0000","last_unstale":"2023-11-18T20:39:03.864544+0000","last_undegraded":"2023-11-18T20:39:03.864544+0000","last_fullsized":"2023-11-18T20:39:03.864544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:37.501746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779387+0000","last_change":"2023-11-18T20:39:02.758393+0000","last_active":"2023-11-18T20:39:03.779387+0000","last_peered":"2023-11-18T20:39:03.779387+0000","last_clean":"2023-11-18T20:39:03.779387+0000","last_became_active":"2023-11-18T20:39:02.752864+0000","last_became_peered":"2023-11-18T20:39:02.752864+0000","last_unstale":"2023-11-18T20:39:03.779387+0000","last_undegraded":"2023-11-18T20:39:03.779387+0000","last_fullsized":"2023-11-18T20:39:03.779387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860348+0000","last_change":"2023-11-18T20:39:02.752211+0000","last_active":"2023-11-18T20:39:03.860348+0000","last_peered":"2023-11-18T20:39:03.860348+0000","last_clean":"2023-11-18T20:39:03.860348+0000","last_became_active":"2023-11-18T20:39:02.751940+0000","last_became_peered":"2023-11-18T20:39:02.751940+0000","last_unstale":"2023-11-18T20:39:03.860348+0000","last_undegraded":"2023-11-18T20:39:03.860348+0000","last_fullsized":"2023-11-18T20:39:03.860348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.863413+0000","last_change":"2023-11-18T20:39:02.758024+0000","last_active":"2023-11-18T20:39:03.863413+0000","last_peered":"2023-11-18T20:39:03.863413+0000","last_clean":"2023-11-18T20:39:03.863413+0000","last_became_active":"2023-11-18T20:39:02.757737+0000","last_became_peered":"2023-11-18T20:39:02.757737+0000","last_unstale":"2023-11-18T20:39:03.863413+0000","last_undegraded":"2023-11-18T20:39:03.863413+0000","last_fullsized":"2023-11-18T20:39:03.863413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:42:50.023528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860316+0000","last_change":"2023-11-18T20:39:02.752133+0000","last_active":"2023-11-18T20:39:03.860316+0000","last_peered":"2023-11-18T20:39:03.860316+0000","last_clean":"2023-11-18T20:39:03.860316+0000","last_became_active":"2023-11-18T20:39:02.751863+0000","last_became_peered":"2023-11-18T20:39:02.751863+0000","last_unstale":"2023-11-18T20:39:03.860316+0000","last_undegraded":"2023-11-18T20:39:03.860316+0000","last_fullsized":"2023-11-18T20:39:03.860316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:56.070643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753100+0000","last_change":"2023-11-18T20:39:02.772030+0000","last_active":"2023-11-18T20:39:03.753100+0000","last_peered":"2023-11-18T20:39:03.753100+0000","last_clean":"2023-11-18T20:39:03.753100+0000","last_became_active":"2023-11-18T20:39:02.771761+0000","last_became_peered":"2023-11-18T20:39:02.771761+0000","last_unstale":"2023-11-18T20:39:03.753100+0000","last_undegraded":"2023-11-18T20:39:03.753100+0000","last_fullsized":"2023-11-18T20:39:03.753100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754128+0000","last_change":"2023-11-18T20:39:02.774172+0000","last_active":"2023-11-18T20:39:03.754128+0000","last_peered":"2023-11-18T20:39:03.754128+0000","last_clean":"2023-11-18T20:39:03.754128+0000","last_became_active":"2023-11-18T20:39:02.773141+0000","last_became_peered":"2023-11-18T20:39:02.773141+0000","last_unstale":"2023-11-18T20:39:03.754128+0000","last_undegraded":"2023-11-18T20:39:03.754128+0000","last_fullsized":"2023-11-18T20:39:03.754128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:59:44.902815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859948+0000","last_change":"2023-11-18T20:39:02.775796+0000","last_active":"2023-11-18T20:39:03.859948+0000","last_peered":"2023-11-18T20:39:03.859948+0000","last_clean":"2023-11-18T20:39:03.859948+0000","last_became_active":"2023-11-18T20:39:02.775503+0000","last_became_peered":"2023-11-18T20:39:02.775503+0000","last_unstale":"2023-11-18T20:39:03.859948+0000","last_undegraded":"2023-11-18T20:39:03.859948+0000","last_fullsized":"2023-11-18T20:39:03.859948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861021+0000","last_change":"2023-11-18T20:39:02.746609+0000","last_active":"2023-11-18T20:39:03.861021+0000","last_peered":"2023-11-18T20:39:03.861021+0000","last_clean":"2023-11-18T20:39:03.861021+0000","last_became_active":"2023-11-18T20:39:02.746324+0000","last_became_peered":"2023-11-18T20:39:02.746324+0000","last_unstale":"2023-11-18T20:39:03.861021+0000","last_undegraded":"2023-11-18T20:39:03.861021+0000","last_fullsized":"2023-11-18T20:39:03.861021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779219+0000","last_change":"2023-11-18T20:39:02.772625+0000","last_active":"2023-11-18T20:39:03.779219+0000","last_peered":"2023-11-18T20:39:03.779219+0000","last_clean":"2023-11-18T20:39:03.779219+0000","last_became_active":"2023-11-18T20:39:02.772348+0000","last_became_peered":"2023-11-18T20:39:02.772348+0000","last_unstale":"2023-11-18T20:39:03.779219+0000","last_undegraded":"2023-11-18T20:39:03.779219+0000","last_fullsized":"2023-11-18T20:39:03.779219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.778990+0000","last_change":"2023-11-18T20:39:02.758480+0000","last_active":"2023-11-18T20:39:03.778990+0000","last_peered":"2023-11-18T20:39:03.778990+0000","last_clean":"2023-11-18T20:39:03.778990+0000","last_became_active":"2023-11-18T20:39:02.752070+0000","last_became_peered":"2023-11-18T20:39:02.752070+0000","last_unstale":"2023-11-18T20:39:03.778990+0000","last_undegraded":"2023-11-18T20:39:03.778990+0000","last_fullsized":"2023-11-18T20:39:03.778990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860793+0000","last_change":"2023-11-18T20:39:02.767291+0000","last_active":"2023-11-18T20:39:03.860793+0000","last_peered":"2023-11-18T20:39:03.860793+0000","last_clean":"2023-11-18T20:39:03.860793+0000","last_became_active":"2023-11-18T20:39:02.764390+0000","last_became_peered":"2023-11-18T20:39:02.764390+0000","last_unstale":"2023-11-18T20:39:03.860793+0000","last_undegraded":"2023-11-18T20:39:03.860793+0000","last_fullsized":"2023-11-18T20:39:03.860793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753215+0000","last_change":"2023-11-18T20:39:02.764472+0000","last_active":"2023-11-18T20:39:03.753215+0000","last_peered":"2023-11-18T20:39:03.753215+0000","last_clean":"2023-11-18T20:39:03.753215+0000","last_became_active":"2023-11-18T20:39:02.764087+0000","last_became_peered":"2023-11-18T20:39:02.764087+0000","last_unstale":"2023-11-18T20:39:03.753215+0000","last_undegraded":"2023-11-18T20:39:03.753215+0000","last_fullsized":"2023-11-18T20:39:03.753215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:00.994479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.864541+0000","last_change":"2023-11-18T20:39:02.761380+0000","last_active":"2023-11-18T20:39:03.864541+0000","last_peered":"2023-11-18T20:39:03.864541+0000","last_clean":"2023-11-18T20:39:03.864541+0000","last_became_active":"2023-11-18T20:39:02.760958+0000","last_became_peered":"2023-11-18T20:39:02.760958+0000","last_unstale":"2023-11-18T20:39:03.864541+0000","last_undegraded":"2023-11-18T20:39:03.864541+0000","last_fullsized":"2023-11-18T20:39:03.864541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:25.114138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.779721+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:02.779721+0000","last_peered":"2023-11-18T20:39:02.779721+0000","last_clean":"2023-11-18T20:39:02.779721+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:02.779721+0000","last_undegraded":"2023-11-18T20:39:02.779721+0000","last_fullsized":"2023-11-18T20:39:02.779721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:00.564472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861323+0000","last_change":"2023-11-18T20:39:02.761289+0000","last_active":"2023-11-18T20:39:03.861323+0000","last_peered":"2023-11-18T20:39:03.861323+0000","last_clean":"2023-11-18T20:39:03.861323+0000","last_became_active":"2023-11-18T20:39:02.760948+0000","last_became_peered":"2023-11-18T20:39:02.760948+0000","last_unstale":"2023-11-18T20:39:03.861323+0000","last_undegraded":"2023-11-18T20:39:03.861323+0000","last_fullsized":"2023-11-18T20:39:03.861323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.784374+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:02.784374+0000","last_peered":"2023-11-18T20:39:02.784374+0000","last_clean":"2023-11-18T20:39:02.784374+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:02.784374+0000","last_undegraded":"2023-11-18T20:39:02.784374+0000","last_fullsized":"2023-11-18T20:39:02.784374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861018+0000","last_change":"2023-11-18T20:39:02.751638+0000","last_active":"2023-11-18T20:39:03.861018+0000","last_peered":"2023-11-18T20:39:03.861018+0000","last_clean":"2023-11-18T20:39:03.861018+0000","last_became_active":"2023-11-18T20:39:02.751330+0000","last_became_peered":"2023-11-18T20:39:02.751330+0000","last_unstale":"2023-11-18T20:39:03.861018+0000","last_undegraded":"2023-11-18T20:39:03.861018+0000","last_fullsized":"2023-11-18T20:39:03.861018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.772056+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:02.772056+0000","last_peered":"2023-11-18T20:39:02.772056+0000","last_clean":"2023-11-18T20:39:02.772056+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:02.772056+0000","last_undegraded":"2023-11-18T20:39:02.772056+0000","last_fullsized":"2023-11-18T20:39:02.772056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753657+0000","last_change":"2023-11-18T20:39:02.758817+0000","last_active":"2023-11-18T20:39:03.753657+0000","last_peered":"2023-11-18T20:39:03.753657+0000","last_clean":"2023-11-18T20:39:03.753657+0000","last_became_active":"2023-11-18T20:39:02.758440+0000","last_became_peered":"2023-11-18T20:39:02.758440+0000","last_unstale":"2023-11-18T20:39:03.753657+0000","last_undegraded":"2023-11-18T20:39:03.753657+0000","last_fullsized":"2023-11-18T20:39:03.753657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.784611+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:02.784611+0000","last_peered":"2023-11-18T20:39:02.784611+0000","last_clean":"2023-11-18T20:39:02.784611+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:02.784611+0000","last_undegraded":"2023-11-18T20:39:02.784611+0000","last_fullsized":"2023-11-18T20:39:02.784611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861031+0000","last_change":"2023-11-18T20:39:02.774591+0000","last_active":"2023-11-18T20:39:03.861031+0000","last_peered":"2023-11-18T20:39:03.861031+0000","last_clean":"2023-11-18T20:39:03.861031+0000","last_became_active":"2023-11-18T20:39:02.774338+0000","last_became_peered":"2023-11-18T20:39:02.774338+0000","last_unstale":"2023-11-18T20:39:03.861031+0000","last_undegraded":"2023-11-18T20:39:03.861031+0000","last_fullsized":"2023-11-18T20:39:03.861031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:32.560325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.779156+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:02.779156+0000","last_peered":"2023-11-18T20:39:02.779156+0000","last_clean":"2023-11-18T20:39:02.779156+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:02.779156+0000","last_undegraded":"2023-11-18T20:39:02.779156+0000","last_fullsized":"2023-11-18T20:39:02.779156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860659+0000","last_change":"2023-11-18T20:39:02.754613+0000","last_active":"2023-11-18T20:39:03.860659+0000","last_peered":"2023-11-18T20:39:03.860659+0000","last_clean":"2023-11-18T20:39:03.860659+0000","last_became_active":"2023-11-18T20:39:02.754350+0000","last_became_peered":"2023-11-18T20:39:02.754350+0000","last_unstale":"2023-11-18T20:39:03.860659+0000","last_undegraded":"2023-11-18T20:39:03.860659+0000","last_fullsized":"2023-11-18T20:39:03.860659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.775290+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:02.775290+0000","last_peered":"2023-11-18T20:39:02.775290+0000","last_clean":"2023-11-18T20:39:02.775290+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:02.775290+0000","last_undegraded":"2023-11-18T20:39:02.775290+0000","last_fullsized":"2023-11-18T20:39:02.775290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:47.442387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860112+0000","last_change":"2023-11-18T20:39:02.772323+0000","last_active":"2023-11-18T20:39:03.860112+0000","last_peered":"2023-11-18T20:39:03.860112+0000","last_clean":"2023-11-18T20:39:03.860112+0000","last_became_active":"2023-11-18T20:39:02.771746+0000","last_became_peered":"2023-11-18T20:39:02.771746+0000","last_unstale":"2023-11-18T20:39:03.860112+0000","last_undegraded":"2023-11-18T20:39:03.860112+0000","last_fullsized":"2023-11-18T20:39:03.860112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:51.574371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.744815+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:02.744815+0000","last_peered":"2023-11-18T20:39:02.744815+0000","last_clean":"2023-11-18T20:39:02.744815+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:02.744815+0000","last_undegraded":"2023-11-18T20:39:02.744815+0000","last_fullsized":"2023-11-18T20:39:02.744815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.752672+0000","last_change":"2023-11-18T20:39:02.770693+0000","last_active":"2023-11-18T20:39:03.752672+0000","last_peered":"2023-11-18T20:39:03.752672+0000","last_clean":"2023-11-18T20:39:03.752672+0000","last_became_active":"2023-11-18T20:39:02.766515+0000","last_became_peered":"2023-11-18T20:39:02.766515+0000","last_unstale":"2023-11-18T20:39:03.752672+0000","last_undegraded":"2023-11-18T20:39:03.752672+0000","last_fullsized":"2023-11-18T20:39:03.752672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.729375+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:02.729375+0000","last_peered":"2023-11-18T20:39:02.729375+0000","last_clean":"2023-11-18T20:39:02.729375+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:02.729375+0000","last_undegraded":"2023-11-18T20:39:02.729375+0000","last_fullsized":"2023-11-18T20:39:02.729375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753824+0000","last_change":"2023-11-18T20:39:02.759699+0000","last_active":"2023-11-18T20:39:03.753824+0000","last_peered":"2023-11-18T20:39:03.753824+0000","last_clean":"2023-11-18T20:39:03.753824+0000","last_became_active":"2023-11-18T20:39:02.759410+0000","last_became_peered":"2023-11-18T20:39:02.759410+0000","last_unstale":"2023-11-18T20:39:03.753824+0000","last_undegraded":"2023-11-18T20:39:03.753824+0000","last_fullsized":"2023-11-18T20:39:03.753824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:52:49.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.753117+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:02.753117+0000","last_peered":"2023-11-18T20:39:02.753117+0000","last_clean":"2023-11-18T20:39:02.753117+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:02.753117+0000","last_undegraded":"2023-11-18T20:39:02.753117+0000","last_fullsized":"2023-11-18T20:39:02.753117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.109348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754735+0000","last_change":"2023-11-18T20:39:02.763642+0000","last_active":"2023-11-18T20:39:03.754735+0000","last_peered":"2023-11-18T20:39:03.754735+0000","last_clean":"2023-11-18T20:39:03.754735+0000","last_became_active":"2023-11-18T20:39:02.763357+0000","last_became_peered":"2023-11-18T20:39:02.763357+0000","last_unstale":"2023-11-18T20:39:03.754735+0000","last_undegraded":"2023-11-18T20:39:03.754735+0000","last_fullsized":"2023-11-18T20:39:03.754735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:04.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.754613+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:02.754613+0000","last_peered":"2023-11-18T20:39:02.754613+0000","last_clean":"2023-11-18T20:39:02.754613+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:02.754613+0000","last_undegraded":"2023-11-18T20:39:02.754613+0000","last_fullsized":"2023-11-18T20:39:02.754613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753745+0000","last_change":"2023-11-18T20:39:02.753904+0000","last_active":"2023-11-18T20:39:03.753745+0000","last_peered":"2023-11-18T20:39:03.753745+0000","last_clean":"2023-11-18T20:39:03.753745+0000","last_became_active":"2023-11-18T20:39:02.753415+0000","last_became_peered":"2023-11-18T20:39:02.753415+0000","last_unstale":"2023-11-18T20:39:03.753745+0000","last_undegraded":"2023-11-18T20:39:03.753745+0000","last_fullsized":"2023-11-18T20:39:03.753745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.778180+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:02.778180+0000","last_peered":"2023-11-18T20:39:02.778180+0000","last_clean":"2023-11-18T20:39:02.778180+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:02.778180+0000","last_undegraded":"2023-11-18T20:39:02.778180+0000","last_fullsized":"2023-11-18T20:39:02.778180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:25.771785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754017+0000","last_change":"2023-11-18T20:39:02.774185+0000","last_active":"2023-11-18T20:39:03.754017+0000","last_peered":"2023-11-18T20:39:03.754017+0000","last_clean":"2023-11-18T20:39:03.754017+0000","last_became_active":"2023-11-18T20:39:02.773865+0000","last_became_peered":"2023-11-18T20:39:02.773865+0000","last_unstale":"2023-11-18T20:39:03.754017+0000","last_undegraded":"2023-11-18T20:39:03.754017+0000","last_fullsized":"2023-11-18T20:39:03.754017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:29.774288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.784859+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:02.784859+0000","last_peered":"2023-11-18T20:39:02.784859+0000","last_clean":"2023-11-18T20:39:02.784859+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:02.784859+0000","last_undegraded":"2023-11-18T20:39:02.784859+0000","last_fullsized":"2023-11-18T20:39:02.784859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:26.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.863582+0000","last_change":"2023-11-18T20:39:02.755872+0000","last_active":"2023-11-18T20:39:03.863582+0000","last_peered":"2023-11-18T20:39:03.863582+0000","last_clean":"2023-11-18T20:39:03.863582+0000","last_became_active":"2023-11-18T20:39:02.755415+0000","last_became_peered":"2023-11-18T20:39:02.755415+0000","last_unstale":"2023-11-18T20:39:03.863582+0000","last_undegraded":"2023-11-18T20:39:03.863582+0000","last_fullsized":"2023-11-18T20:39:03.863582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:08.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.780535+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:02.780535+0000","last_peered":"2023-11-18T20:39:02.780535+0000","last_clean":"2023-11-18T20:39:02.780535+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:02.780535+0000","last_undegraded":"2023-11-18T20:39:02.780535+0000","last_fullsized":"2023-11-18T20:39:02.780535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754101+0000","last_change":"2023-11-18T20:39:02.748892+0000","last_active":"2023-11-18T20:39:03.754101+0000","last_peered":"2023-11-18T20:39:03.754101+0000","last_clean":"2023-11-18T20:39:03.754101+0000","last_became_active":"2023-11-18T20:39:02.748392+0000","last_became_peered":"2023-11-18T20:39:02.748392+0000","last_unstale":"2023-11-18T20:39:03.754101+0000","last_undegraded":"2023-11-18T20:39:03.754101+0000","last_fullsized":"2023-11-18T20:39:03.754101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:18.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.728039+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:02.728039+0000","last_peered":"2023-11-18T20:39:02.728039+0000","last_clean":"2023-11-18T20:39:02.728039+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:02.728039+0000","last_undegraded":"2023-11-18T20:39:02.728039+0000","last_fullsized":"2023-11-18T20:39:02.728039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860441+0000","last_change":"2023-11-18T20:39:02.767695+0000","last_active":"2023-11-18T20:39:03.860441+0000","last_peered":"2023-11-18T20:39:03.860441+0000","last_clean":"2023-11-18T20:39:03.860441+0000","last_became_active":"2023-11-18T20:39:02.765964+0000","last_became_peered":"2023-11-18T20:39:02.765964+0000","last_unstale":"2023-11-18T20:39:03.860441+0000","last_undegraded":"2023-11-18T20:39:03.860441+0000","last_fullsized":"2023-11-18T20:39:03.860441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.729951+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:02.729951+0000","last_peered":"2023-11-18T20:39:02.729951+0000","last_clean":"2023-11-18T20:39:02.729951+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:02.729951+0000","last_undegraded":"2023-11-18T20:39:02.729951+0000","last_fullsized":"2023-11-18T20:39:02.729951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:52:57.711383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753443+0000","last_change":"2023-11-18T20:39:02.777823+0000","last_active":"2023-11-18T20:39:03.753443+0000","last_peered":"2023-11-18T20:39:03.753443+0000","last_clean":"2023-11-18T20:39:03.753443+0000","last_became_active":"2023-11-18T20:39:02.777456+0000","last_became_peered":"2023-11-18T20:39:02.777456+0000","last_unstale":"2023-11-18T20:39:03.753443+0000","last_undegraded":"2023-11-18T20:39:03.753443+0000","last_fullsized":"2023-11-18T20:39:03.753443+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:44.618827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.780393+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:02.780393+0000","last_peered":"2023-11-18T20:39:02.780393+0000","last_clean":"2023-11-18T20:39:02.780393+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:02.780393+0000","last_undegraded":"2023-11-18T20:39:02.780393+0000","last_fullsized":"2023-11-18T20:39:02.780393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754173+0000","last_change":"2023-11-18T20:39:02.773440+0000","last_active":"2023-11-18T20:39:03.754173+0000","last_peered":"2023-11-18T20:39:03.754173+0000","last_clean":"2023-11-18T20:39:03.754173+0000","last_became_active":"2023-11-18T20:39:02.773133+0000","last_became_peered":"2023-11-18T20:39:02.773133+0000","last_unstale":"2023-11-18T20:39:03.754173+0000","last_undegraded":"2023-11-18T20:39:03.754173+0000","last_fullsized":"2023-11-18T20:39:03.754173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:02.899681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.779501+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:02.779501+0000","last_peered":"2023-11-18T20:39:02.779501+0000","last_clean":"2023-11-18T20:39:02.779501+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:02.779501+0000","last_undegraded":"2023-11-18T20:39:02.779501+0000","last_fullsized":"2023-11-18T20:39:02.779501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861761+0000","last_change":"2023-11-18T20:39:02.765789+0000","last_active":"2023-11-18T20:39:03.861761+0000","last_peered":"2023-11-18T20:39:03.861761+0000","last_clean":"2023-11-18T20:39:03.861761+0000","last_became_active":"2023-11-18T20:39:02.764984+0000","last_became_peered":"2023-11-18T20:39:02.764984+0000","last_unstale":"2023-11-18T20:39:03.861761+0000","last_undegraded":"2023-11-18T20:39:03.861761+0000","last_fullsized":"2023-11-18T20:39:03.861761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.780639+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:02.780639+0000","last_peered":"2023-11-18T20:39:02.780639+0000","last_clean":"2023-11-18T20:39:02.780639+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:02.780639+0000","last_undegraded":"2023-11-18T20:39:02.780639+0000","last_fullsized":"2023-11-18T20:39:02.780639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859292+0000","last_change":"2023-11-18T20:39:02.763496+0000","last_active":"2023-11-18T20:39:03.859292+0000","last_peered":"2023-11-18T20:39:03.859292+0000","last_clean":"2023-11-18T20:39:03.859292+0000","last_became_active":"2023-11-18T20:39:02.762875+0000","last_became_peered":"2023-11-18T20:39:02.762875+0000","last_unstale":"2023-11-18T20:39:03.859292+0000","last_undegraded":"2023-11-18T20:39:03.859292+0000","last_fullsized":"2023-11-18T20:39:03.859292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.776710+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:02.776710+0000","last_peered":"2023-11-18T20:39:02.776710+0000","last_clean":"2023-11-18T20:39:02.776710+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:02.776710+0000","last_undegraded":"2023-11-18T20:39:02.776710+0000","last_fullsized":"2023-11-18T20:39:02.776710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:41.560904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.756108+0000","last_change":"2023-11-18T20:39:02.760383+0000","last_active":"2023-11-18T20:39:03.756108+0000","last_peered":"2023-11-18T20:39:03.756108+0000","last_clean":"2023-11-18T20:39:03.756108+0000","last_became_active":"2023-11-18T20:39:02.760126+0000","last_became_peered":"2023-11-18T20:39:02.760126+0000","last_unstale":"2023-11-18T20:39:03.756108+0000","last_undegraded":"2023-11-18T20:39:03.756108+0000","last_fullsized":"2023-11-18T20:39:03.756108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.749759+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:02.749759+0000","last_peered":"2023-11-18T20:39:02.749759+0000","last_clean":"2023-11-18T20:39:02.749759+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:02.749759+0000","last_undegraded":"2023-11-18T20:39:02.749759+0000","last_fullsized":"2023-11-18T20:39:02.749759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:27.505414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.863835+0000","last_change":"2023-11-18T20:39:02.762298+0000","last_active":"2023-11-18T20:39:03.863835+0000","last_peered":"2023-11-18T20:39:03.863835+0000","last_clean":"2023-11-18T20:39:03.863835+0000","last_became_active":"2023-11-18T20:39:02.761752+0000","last_became_peered":"2023-11-18T20:39:02.761752+0000","last_unstale":"2023-11-18T20:39:03.863835+0000","last_undegraded":"2023-11-18T20:39:03.863835+0000","last_fullsized":"2023-11-18T20:39:03.863835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:16:15.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.774295+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:02.774295+0000","last_peered":"2023-11-18T20:39:02.774295+0000","last_clean":"2023-11-18T20:39:02.774295+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:02.774295+0000","last_undegraded":"2023-11-18T20:39:02.774295+0000","last_fullsized":"2023-11-18T20:39:02.774295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859427+0000","last_change":"2023-11-18T20:39:02.757357+0000","last_active":"2023-11-18T20:39:03.859427+0000","last_peered":"2023-11-18T20:39:03.859427+0000","last_clean":"2023-11-18T20:39:03.859427+0000","last_became_active":"2023-11-18T20:39:02.757000+0000","last_became_peered":"2023-11-18T20:39:02.757000+0000","last_unstale":"2023-11-18T20:39:03.859427+0000","last_undegraded":"2023-11-18T20:39:03.859427+0000","last_fullsized":"2023-11-18T20:39:03.859427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.730518+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:02.730518+0000","last_peered":"2023-11-18T20:39:02.730518+0000","last_clean":"2023-11-18T20:39:02.730518+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:02.730518+0000","last_undegraded":"2023-11-18T20:39:02.730518+0000","last_fullsized":"2023-11-18T20:39:02.730518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.863435+0000","last_change":"2023-11-18T20:39:02.750840+0000","last_active":"2023-11-18T20:39:03.863435+0000","last_peered":"2023-11-18T20:39:03.863435+0000","last_clean":"2023-11-18T20:39:03.863435+0000","last_became_active":"2023-11-18T20:39:02.749491+0000","last_became_peered":"2023-11-18T20:39:02.749491+0000","last_unstale":"2023-11-18T20:39:03.863435+0000","last_undegraded":"2023-11-18T20:39:03.863435+0000","last_fullsized":"2023-11-18T20:39:03.863435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:27:46.865954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.752868+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:02.752868+0000","last_peered":"2023-11-18T20:39:02.752868+0000","last_clean":"2023-11-18T20:39:02.752868+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:02.752868+0000","last_undegraded":"2023-11-18T20:39:02.752868+0000","last_fullsized":"2023-11-18T20:39:02.752868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860516+0000","last_change":"2023-11-18T20:39:02.769526+0000","last_active":"2023-11-18T20:39:03.860516+0000","last_peered":"2023-11-18T20:39:03.860516+0000","last_clean":"2023-11-18T20:39:03.860516+0000","last_became_active":"2023-11-18T20:39:02.767946+0000","last_became_peered":"2023-11-18T20:39:02.767946+0000","last_unstale":"2023-11-18T20:39:03.860516+0000","last_undegraded":"2023-11-18T20:39:03.860516+0000","last_fullsized":"2023-11-18T20:39:03.860516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.745127+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:02.745127+0000","last_peered":"2023-11-18T20:39:02.745127+0000","last_clean":"2023-11-18T20:39:02.745127+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:02.745127+0000","last_undegraded":"2023-11-18T20:39:02.745127+0000","last_fullsized":"2023-11-18T20:39:02.745127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:48:04.385451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.756562+0000","last_change":"2023-11-18T20:39:02.762642+0000","last_active":"2023-11-18T20:39:03.756562+0000","last_peered":"2023-11-18T20:39:03.756562+0000","last_clean":"2023-11-18T20:39:03.756562+0000","last_became_active":"2023-11-18T20:39:02.761245+0000","last_became_peered":"2023-11-18T20:39:02.761245+0000","last_unstale":"2023-11-18T20:39:03.756562+0000","last_undegraded":"2023-11-18T20:39:03.756562+0000","last_fullsized":"2023-11-18T20:39:03.756562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:59.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.777727+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:02.777727+0000","last_peered":"2023-11-18T20:39:02.777727+0000","last_clean":"2023-11-18T20:39:02.777727+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:02.777727+0000","last_undegraded":"2023-11-18T20:39:02.777727+0000","last_fullsized":"2023-11-18T20:39:02.777727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:39.869697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754191+0000","last_change":"2023-11-18T20:39:02.760873+0000","last_active":"2023-11-18T20:39:03.754191+0000","last_peered":"2023-11-18T20:39:03.754191+0000","last_clean":"2023-11-18T20:39:03.754191+0000","last_became_active":"2023-11-18T20:39:02.759887+0000","last_became_peered":"2023-11-18T20:39:02.759887+0000","last_unstale":"2023-11-18T20:39:03.754191+0000","last_undegraded":"2023-11-18T20:39:03.754191+0000","last_fullsized":"2023-11-18T20:39:03.754191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:26.185944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859857+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:03.859857+0000","last_peered":"2023-11-18T20:39:03.859857+0000","last_clean":"2023-11-18T20:39:03.859857+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:03.859857+0000","last_undegraded":"2023-11-18T20:39:03.859857+0000","last_fullsized":"2023-11-18T20:39:03.859857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:32.771880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.756465+0000","last_change":"2023-11-18T20:39:02.766797+0000","last_active":"2023-11-18T20:39:03.756465+0000","last_peered":"2023-11-18T20:39:03.756465+0000","last_clean":"2023-11-18T20:39:03.756465+0000","last_became_active":"2023-11-18T20:39:02.766466+0000","last_became_peered":"2023-11-18T20:39:02.766466+0000","last_unstale":"2023-11-18T20:39:03.756465+0000","last_undegraded":"2023-11-18T20:39:03.756465+0000","last_fullsized":"2023-11-18T20:39:03.756465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.491100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.740143+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:02.740143+0000","last_peered":"2023-11-18T20:39:02.740143+0000","last_clean":"2023-11-18T20:39:02.740143+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:02.740143+0000","last_undegraded":"2023-11-18T20:39:02.740143+0000","last_fullsized":"2023-11-18T20:39:02.740143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:43.756070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779010+0000","last_change":"2023-11-18T20:39:02.755847+0000","last_active":"2023-11-18T20:39:03.779010+0000","last_peered":"2023-11-18T20:39:03.779010+0000","last_clean":"2023-11-18T20:39:03.779010+0000","last_became_active":"2023-11-18T20:39:02.755565+0000","last_became_peered":"2023-11-18T20:39:02.755565+0000","last_unstale":"2023-11-18T20:39:03.779010+0000","last_undegraded":"2023-11-18T20:39:03.779010+0000","last_fullsized":"2023-11-18T20:39:03.779010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.743188+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:02.743188+0000","last_peered":"2023-11-18T20:39:02.743188+0000","last_clean":"2023-11-18T20:39:02.743188+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:02.743188+0000","last_undegraded":"2023-11-18T20:39:02.743188+0000","last_fullsized":"2023-11-18T20:39:02.743188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:01.441027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754246+0000","last_change":"2023-11-18T20:39:02.748674+0000","last_active":"2023-11-18T20:39:03.754246+0000","last_peered":"2023-11-18T20:39:03.754246+0000","last_clean":"2023-11-18T20:39:03.754246+0000","last_became_active":"2023-11-18T20:39:02.748033+0000","last_became_peered":"2023-11-18T20:39:02.748033+0000","last_unstale":"2023-11-18T20:39:03.754246+0000","last_undegraded":"2023-11-18T20:39:03.754246+0000","last_fullsized":"2023-11-18T20:39:03.754246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:31.017030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.734303+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:02.734303+0000","last_peered":"2023-11-18T20:39:02.734303+0000","last_clean":"2023-11-18T20:39:02.734303+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:02.734303+0000","last_undegraded":"2023-11-18T20:39:02.734303+0000","last_fullsized":"2023-11-18T20:39:02.734303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:30.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.752598+0000","last_change":"2023-11-18T20:39:02.752804+0000","last_active":"2023-11-18T20:39:03.752598+0000","last_peered":"2023-11-18T20:39:03.752598+0000","last_clean":"2023-11-18T20:39:03.752598+0000","last_became_active":"2023-11-18T20:39:02.752203+0000","last_became_peered":"2023-11-18T20:39:02.752203+0000","last_unstale":"2023-11-18T20:39:03.752598+0000","last_undegraded":"2023-11-18T20:39:03.752598+0000","last_fullsized":"2023-11-18T20:39:03.752598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.730274+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:02.730274+0000","last_peered":"2023-11-18T20:39:02.730274+0000","last_clean":"2023-11-18T20:39:02.730274+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:02.730274+0000","last_undegraded":"2023-11-18T20:39:02.730274+0000","last_fullsized":"2023-11-18T20:39:02.730274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:24.984694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753594+0000","last_change":"2023-11-18T20:39:02.755764+0000","last_active":"2023-11-18T20:39:03.753594+0000","last_peered":"2023-11-18T20:39:03.753594+0000","last_clean":"2023-11-18T20:39:03.753594+0000","last_became_active":"2023-11-18T20:39:02.755464+0000","last_became_peered":"2023-11-18T20:39:02.755464+0000","last_unstale":"2023-11-18T20:39:03.753594+0000","last_undegraded":"2023-11-18T20:39:03.753594+0000","last_fullsized":"2023-11-18T20:39:03.753594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:24.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.727659+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:02.727659+0000","last_peered":"2023-11-18T20:39:02.727659+0000","last_clean":"2023-11-18T20:39:02.727659+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:02.727659+0000","last_undegraded":"2023-11-18T20:39:02.727659+0000","last_fullsized":"2023-11-18T20:39:02.727659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:56.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779508+0000","last_change":"2023-11-18T20:39:02.760047+0000","last_active":"2023-11-18T20:39:03.779508+0000","last_peered":"2023-11-18T20:39:03.779508+0000","last_clean":"2023-11-18T20:39:03.779508+0000","last_became_active":"2023-11-18T20:39:02.759514+0000","last_became_peered":"2023-11-18T20:39:02.759514+0000","last_unstale":"2023-11-18T20:39:03.779508+0000","last_undegraded":"2023-11-18T20:39:03.779508+0000","last_fullsized":"2023-11-18T20:39:03.779508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.745411+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:02.745411+0000","last_peered":"2023-11-18T20:39:02.745411+0000","last_clean":"2023-11-18T20:39:02.745411+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:02.745411+0000","last_undegraded":"2023-11-18T20:39:02.745411+0000","last_fullsized":"2023-11-18T20:39:02.745411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:49.505805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.743928+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:02.743928+0000","last_peered":"2023-11-18T20:39:02.743928+0000","last_clean":"2023-11-18T20:39:02.743928+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:02.743928+0000","last_undegraded":"2023-11-18T20:39:02.743928+0000","last_fullsized":"2023-11-18T20:39:02.743928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":154656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.7470000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.548},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.1879999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.24},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.3939999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.6930000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.9039999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.651}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":1.9910000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.0510000000000002},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":2.02}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":156246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.89300000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.212}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1830000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.343}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.3},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3999999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.4419999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.9590000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":991232,"data_stored":745584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.494},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.321}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.2829999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.98299999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.127},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.667}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.397}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.516},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.2509999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.5920000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":156268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.3899999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.327}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.117},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.056}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.5549999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.581},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.524}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.47}]}]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":155410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.101}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.87},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.77500000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.93400000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.581}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.651},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.53}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.4970000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.6200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.68000000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.88700000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.103},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.94099999999999995}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.012},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.1739999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.25},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.98399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":745072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.97499999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.79800000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.872}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.2330000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.056}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.077}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":154724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.629}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.2669999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.03},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.1539999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.48}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.2949999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:12.249 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.470+0000 7f1692bce640 1 Processor -- start 2023-11-18T20:39:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.470+0000 7f1692bce640 1 -- start start 2023-11-18T20:39:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f1692bce640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f168c0c5ec0 0x7f168c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f1692bce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f168c0c45d0 0x7f168c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f1692bce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0bfdc0 con 0x7f168c0721a0 2023-11-18T20:39:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f1692bce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c06e390 con 0x7f168c0c45d0 2023-11-18T20:39:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f1692bce640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c06ddd0 con 0x7f168c0c5ec0 2023-11-18T20:39:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f168bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f168c0c45d0 0x7f168c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f169116b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f168c0721a0 0x7f168c155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43838/0 (socket says 172.21.15.132:43838) 2023-11-18T20:39:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f169116b640 1 -- 172.21.15.132:0/515546443 learned_addr learned my addr 172.21.15.132:0/515546443 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f169096a640 1 --2- 172.21.15.132:0/515546443 >> v2:172.21.15.161:3300/0 conn(0x7f168c0c5ec0 0x7f168c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.472+0000 7f168bfff640 1 -- 172.21.15.132:0/515546443 >> v2:172.21.15.161:3300/0 conn(0x7f168c0c5ec0 msgr2=0x7f168c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.473+0000 7f168bfff640 1 --2- 172.21.15.132:0/515546443 >> v2:172.21.15.161:3300/0 conn(0x7f168c0c5ec0 0x7f168c0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.473+0000 7f168bfff640 1 -- 172.21.15.132:0/515546443 >> v1:172.21.15.132:6789/0 conn(0x7f168c0721a0 legacy=0x7f168c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.473+0000 7f168bfff640 1 -- 172.21.15.132:0/515546443 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c06e0b0 con 0x7f168c0c45d0 2023-11-18T20:39:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.473+0000 7f168b7fe640 1 -- 172.21.15.132:0/515546443 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312561104 0 0) 0x7f168c0bfdc0 con 0x7f168c0721a0 2023-11-18T20:39:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.474+0000 7f168bfff640 1 --2- 172.21.15.132:0/515546443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c45d0 0x7f168c0c3170 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f168c06b250 tx=0x7f167802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159a2ef3a49884b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.474+0000 7f168b7fe640 1 -- 172.21.15.132:0/515546443 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678031710 con 0x7f168c0c45d0 2023-11-18T20:39:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.474+0000 7f168b7fe640 1 -- 172.21.15.132:0/515546443 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167802f050 con 0x7f168c0c45d0 2023-11-18T20:39:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.474+0000 7f168b7fe640 1 -- 172.21.15.132:0/515546443 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678031a90 con 0x7f168c0c45d0 2023-11-18T20:39:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.475+0000 7f1692bce640 1 -- 172.21.15.132:0/515546443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c45d0 msgr2=0x7f168c0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.475+0000 7f1692bce640 1 --2- 172.21.15.132:0/515546443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c45d0 0x7f168c0c3170 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f168c06b250 tx=0x7f167802b7b0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.475+0000 7f1692bce640 1 -- 172.21.15.132:0/515546443 shutdown_connections 2023-11-18T20:39:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.475+0000 7f1692bce640 1 --2- 172.21.15.132:0/515546443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c45d0 0x7f168c0c3170 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.475+0000 7f1692bce640 1 --2- 172.21.15.132:0/515546443 >> v2:172.21.15.161:3300/0 conn(0x7f168c0c5ec0 0x7f168c0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.475+0000 7f1692bce640 1 -- 172.21.15.132:0/515546443 >> 172.21.15.132:0/515546443 conn(0x7f168c06a500 msgr2=0x7f168c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.475+0000 7f1692bce640 1 -- 172.21.15.132:0/515546443 shutdown_connections 2023-11-18T20:39:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.475+0000 7f1692bce640 1 -- 172.21.15.132:0/515546443 wait complete. 2023-11-18T20:39:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.477+0000 7f1692bce640 1 Processor -- start 2023-11-18T20:39:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.477+0000 7f1692bce640 1 -- start start 2023-11-18T20:39:12.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f1692bce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f168c0721a0 0x7f168c0a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f1692bce640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f168c0c45d0 0x7f168c0a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f1692bce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c5ec0 0x7f168c157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f1692bce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c099d00 con 0x7f168c0c5ec0 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f1692bce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1574c0 con 0x7f168c0721a0 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f1692bce640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c149e20 con 0x7f168c0c45d0 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169116b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c5ec0 0x7f168c157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169116b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c5ec0 0x7f168c157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55958/0 (socket says 172.21.15.132:55958) 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169116b640 1 -- 172.21.15.132:0/174445017 learned_addr learned my addr 172.21.15.132:0/174445017 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169096a640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f168c0721a0 0x7f168c0a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f168bfff640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f168c0c45d0 0x7f168c0a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169116b640 1 -- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f168c0c45d0 msgr2=0x7f168c0a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169116b640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f168c0c45d0 0x7f168c0a85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169116b640 1 -- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f168c0721a0 msgr2=0x7f168c0a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:12.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169116b640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f168c0721a0 0x7f168c0a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169116b640 1 -- 172.21.15.132:0/174445017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678009400 con 0x7f168c0c5ec0 2023-11-18T20:39:12.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.478+0000 7f169096a640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f168c0721a0 0x7f168c0a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:12.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.479+0000 7f169116b640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c5ec0 0x7f168c157950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f168400c7a0 tx=0x7f168400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:12.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.479+0000 7f16897fa640 1 -- 172.21.15.132:0/174445017 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400a640 con 0x7f168c0c5ec0 2023-11-18T20:39:12.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.479+0000 7f16897fa640 1 -- 172.21.15.132:0/174445017 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168400a7a0 con 0x7f168c0c5ec0 2023-11-18T20:39:12.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.479+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c155f00 con 0x7f168c0c5ec0 2023-11-18T20:39:12.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.479+0000 7f16897fa640 1 -- 172.21.15.132:0/174445017 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400ab90 con 0x7f168c0c5ec0 2023-11-18T20:39:12.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.479+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c156e70 con 0x7f168c0c5ec0 2023-11-18T20:39:12.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.480+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c0c1ee0 con 0x7f168c0c5ec0 2023-11-18T20:39:12.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.481+0000 7f16897fa640 1 -- 172.21.15.132:0/174445017 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f168400acf0 con 0x7f168c0c5ec0 2023-11-18T20:39:12.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.482+0000 7f16897fa640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f167006ae40 0x7f167006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.482+0000 7f16897fa640 1 -- 172.21.15.132:0/174445017 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1684088e70 con 0x7f168c0c5ec0 2023-11-18T20:39:12.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.483+0000 7f169096a640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f167006ae40 0x7f167006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:12.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.484+0000 7f169096a640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f167006ae40 0x7f167006d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1680006fd0 tx=0x7f1680008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:12.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.487+0000 7f16897fa640 1 -- 172.21.15.132:0/174445017 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1684053f20 con 0x7f168c0c5ec0 2023-11-18T20:39:12.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.676+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f168c155290 con 0x7f167006ae40 2023-11-18T20:39:12.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.701+0000 7f16897fa640 1 -- 172.21.15.132:0/174445017 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286465 (secure 0 0 0) 0x7f168c155290 con 0x7f167006ae40 2023-11-18T20:39:12.708 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:12.709 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.707+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f167006ae40 msgr2=0x7f167006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.707+0000 7f1692bce640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f167006ae40 0x7f167006d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1680006fd0 tx=0x7f1680008040 comp rx=0 tx=0).stop 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.707+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c5ec0 msgr2=0x7f168c157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.707+0000 7f1692bce640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c5ec0 0x7f168c157950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f168400c7a0 tx=0x7f168400cc60 comp rx=0 tx=0).stop 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.708+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 shutdown_connections 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.708+0000 7f1692bce640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f167006ae40 0x7f167006d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.708+0000 7f1692bce640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f168c0c5ec0 0x7f168c157950 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.708+0000 7f1692bce640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f168c0c45d0 0x7f168c0a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.708+0000 7f1692bce640 1 --2- 172.21.15.132:0/174445017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f168c0721a0 0x7f168c0a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.708+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 >> 172.21.15.132:0/174445017 conn(0x7f168c06a500 msgr2=0x7f168c0c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.708+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 shutdown_connections 2023-11-18T20:39:12.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.708+0000 7f1692bce640 1 -- 172.21.15.132:0/174445017 wait complete. 2023-11-18T20:39:12.729 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-11-18T20:39:12.656259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220492,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754228,"statfs":{"total":773094113280,"available":772868329472,"internally_reserved":0,"allocated":4399104,"data_stored":2422628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.933253"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861344+0000","last_change":"2023-11-18T20:39:02.760762+0000","last_active":"2023-11-18T20:39:03.861344+0000","last_peered":"2023-11-18T20:39:03.861344+0000","last_clean":"2023-11-18T20:39:03.861344+0000","last_became_active":"2023-11-18T20:39:02.760426+0000","last_became_peered":"2023-11-18T20:39:02.760426+0000","last_unstale":"2023-11-18T20:39:03.861344+0000","last_undegraded":"2023-11-18T20:39:03.861344+0000","last_fullsized":"2023-11-18T20:39:03.861344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859510+0000","last_change":"2023-11-18T20:39:02.774649+0000","last_active":"2023-11-18T20:39:03.859510+0000","last_peered":"2023-11-18T20:39:03.859510+0000","last_clean":"2023-11-18T20:39:03.859510+0000","last_became_active":"2023-11-18T20:39:02.774358+0000","last_became_peered":"2023-11-18T20:39:02.774358+0000","last_unstale":"2023-11-18T20:39:03.859510+0000","last_undegraded":"2023-11-18T20:39:03.859510+0000","last_fullsized":"2023-11-18T20:39:03.859510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861338+0000","last_change":"2023-11-18T20:39:02.756005+0000","last_active":"2023-11-18T20:39:03.861338+0000","last_peered":"2023-11-18T20:39:03.861338+0000","last_clean":"2023-11-18T20:39:03.861338+0000","last_became_active":"2023-11-18T20:39:02.754298+0000","last_became_peered":"2023-11-18T20:39:02.754298+0000","last_unstale":"2023-11-18T20:39:03.861338+0000","last_undegraded":"2023-11-18T20:39:03.861338+0000","last_fullsized":"2023-11-18T20:39:03.861338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753401+0000","last_change":"2023-11-18T20:39:02.752584+0000","last_active":"2023-11-18T20:39:03.753401+0000","last_peered":"2023-11-18T20:39:03.753401+0000","last_clean":"2023-11-18T20:39:03.753401+0000","last_became_active":"2023-11-18T20:39:02.752259+0000","last_became_peered":"2023-11-18T20:39:02.752259+0000","last_unstale":"2023-11-18T20:39:03.753401+0000","last_undegraded":"2023-11-18T20:39:03.753401+0000","last_fullsized":"2023-11-18T20:39:03.753401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859198+0000","last_change":"2023-11-18T20:39:02.757930+0000","last_active":"2023-11-18T20:39:03.859198+0000","last_peered":"2023-11-18T20:39:03.859198+0000","last_clean":"2023-11-18T20:39:03.859198+0000","last_became_active":"2023-11-18T20:39:02.757463+0000","last_became_peered":"2023-11-18T20:39:02.757463+0000","last_unstale":"2023-11-18T20:39:03.859198+0000","last_undegraded":"2023-11-18T20:39:03.859198+0000","last_fullsized":"2023-11-18T20:39:03.859198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.755543+0000","last_change":"2023-11-18T20:39:02.755127+0000","last_active":"2023-11-18T20:39:03.755543+0000","last_peered":"2023-11-18T20:39:03.755543+0000","last_clean":"2023-11-18T20:39:03.755543+0000","last_became_active":"2023-11-18T20:39:02.754791+0000","last_became_peered":"2023-11-18T20:39:02.754791+0000","last_unstale":"2023-11-18T20:39:03.755543+0000","last_undegraded":"2023-11-18T20:39:03.755543+0000","last_fullsized":"2023-11-18T20:39:03.755543+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860507+0000","last_change":"2023-11-18T20:39:02.767101+0000","last_active":"2023-11-18T20:39:03.860507+0000","last_peered":"2023-11-18T20:39:03.860507+0000","last_clean":"2023-11-18T20:39:03.860507+0000","last_became_active":"2023-11-18T20:39:02.764500+0000","last_became_peered":"2023-11-18T20:39:02.764500+0000","last_unstale":"2023-11-18T20:39:03.860507+0000","last_undegraded":"2023-11-18T20:39:03.860507+0000","last_fullsized":"2023-11-18T20:39:03.860507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860187+0000","last_change":"2023-11-18T20:39:02.744529+0000","last_active":"2023-11-18T20:39:03.860187+0000","last_peered":"2023-11-18T20:39:03.860187+0000","last_clean":"2023-11-18T20:39:03.860187+0000","last_became_active":"2023-11-18T20:39:02.744056+0000","last_became_peered":"2023-11-18T20:39:02.744056+0000","last_unstale":"2023-11-18T20:39:03.860187+0000","last_undegraded":"2023-11-18T20:39:03.860187+0000","last_fullsized":"2023-11-18T20:39:03.860187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:28.509793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861733+0000","last_change":"2023-11-18T20:39:02.775795+0000","last_active":"2023-11-18T20:39:03.861733+0000","last_peered":"2023-11-18T20:39:03.861733+0000","last_clean":"2023-11-18T20:39:03.861733+0000","last_became_active":"2023-11-18T20:39:02.775493+0000","last_became_peered":"2023-11-18T20:39:02.775493+0000","last_unstale":"2023-11-18T20:39:03.861733+0000","last_undegraded":"2023-11-18T20:39:03.861733+0000","last_fullsized":"2023-11-18T20:39:03.861733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754139+0000","last_change":"2023-11-18T20:39:02.764804+0000","last_active":"2023-11-18T20:39:03.754139+0000","last_peered":"2023-11-18T20:39:03.754139+0000","last_clean":"2023-11-18T20:39:03.754139+0000","last_became_active":"2023-11-18T20:39:02.764574+0000","last_became_peered":"2023-11-18T20:39:02.764574+0000","last_unstale":"2023-11-18T20:39:03.754139+0000","last_undegraded":"2023-11-18T20:39:03.754139+0000","last_fullsized":"2023-11-18T20:39:03.754139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754367+0000","last_change":"2023-11-18T20:39:02.773954+0000","last_active":"2023-11-18T20:39:03.754367+0000","last_peered":"2023-11-18T20:39:03.754367+0000","last_clean":"2023-11-18T20:39:03.754367+0000","last_became_active":"2023-11-18T20:39:02.773686+0000","last_became_peered":"2023-11-18T20:39:02.773686+0000","last_unstale":"2023-11-18T20:39:03.754367+0000","last_undegraded":"2023-11-18T20:39:03.754367+0000","last_fullsized":"2023-11-18T20:39:03.754367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:54.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860861+0000","last_change":"2023-11-18T20:39:02.756659+0000","last_active":"2023-11-18T20:39:03.860861+0000","last_peered":"2023-11-18T20:39:03.860861+0000","last_clean":"2023-11-18T20:39:03.860861+0000","last_became_active":"2023-11-18T20:39:02.756336+0000","last_became_peered":"2023-11-18T20:39:02.756336+0000","last_unstale":"2023-11-18T20:39:03.860861+0000","last_undegraded":"2023-11-18T20:39:03.860861+0000","last_fullsized":"2023-11-18T20:39:03.860861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:14.460811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.864332+0000","last_change":"2023-11-18T20:39:02.748415+0000","last_active":"2023-11-18T20:39:03.864332+0000","last_peered":"2023-11-18T20:39:03.864332+0000","last_clean":"2023-11-18T20:39:03.864332+0000","last_became_active":"2023-11-18T20:39:02.748123+0000","last_became_peered":"2023-11-18T20:39:02.748123+0000","last_unstale":"2023-11-18T20:39:03.864332+0000","last_undegraded":"2023-11-18T20:39:03.864332+0000","last_fullsized":"2023-11-18T20:39:03.864332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:36:58.122129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754662+0000","last_change":"2023-11-18T20:39:02.766121+0000","last_active":"2023-11-18T20:39:03.754662+0000","last_peered":"2023-11-18T20:39:03.754662+0000","last_clean":"2023-11-18T20:39:03.754662+0000","last_became_active":"2023-11-18T20:39:02.765807+0000","last_became_peered":"2023-11-18T20:39:02.765807+0000","last_unstale":"2023-11-18T20:39:03.754662+0000","last_undegraded":"2023-11-18T20:39:03.754662+0000","last_fullsized":"2023-11-18T20:39:03.754662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:15.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779211+0000","last_change":"2023-11-18T20:39:02.750962+0000","last_active":"2023-11-18T20:39:03.779211+0000","last_peered":"2023-11-18T20:39:03.779211+0000","last_clean":"2023-11-18T20:39:03.779211+0000","last_became_active":"2023-11-18T20:39:02.750695+0000","last_became_peered":"2023-11-18T20:39:02.750695+0000","last_unstale":"2023-11-18T20:39:03.779211+0000","last_undegraded":"2023-11-18T20:39:03.779211+0000","last_fullsized":"2023-11-18T20:39:03.779211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779037+0000","last_change":"2023-11-18T20:39:02.759711+0000","last_active":"2023-11-18T20:39:03.779037+0000","last_peered":"2023-11-18T20:39:03.779037+0000","last_clean":"2023-11-18T20:39:03.779037+0000","last_became_active":"2023-11-18T20:39:02.759422+0000","last_became_peered":"2023-11-18T20:39:02.759422+0000","last_unstale":"2023-11-18T20:39:03.779037+0000","last_undegraded":"2023-11-18T20:39:03.779037+0000","last_fullsized":"2023-11-18T20:39:03.779037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754122+0000","last_change":"2023-11-18T20:39:02.766551+0000","last_active":"2023-11-18T20:39:03.754122+0000","last_peered":"2023-11-18T20:39:03.754122+0000","last_clean":"2023-11-18T20:39:03.754122+0000","last_became_active":"2023-11-18T20:39:02.765528+0000","last_became_peered":"2023-11-18T20:39:02.765528+0000","last_unstale":"2023-11-18T20:39:03.754122+0000","last_undegraded":"2023-11-18T20:39:03.754122+0000","last_fullsized":"2023-11-18T20:39:03.754122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:30.943404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.756184+0000","last_change":"2023-11-18T20:39:02.755514+0000","last_active":"2023-11-18T20:39:03.756184+0000","last_peered":"2023-11-18T20:39:03.756184+0000","last_clean":"2023-11-18T20:39:03.756184+0000","last_became_active":"2023-11-18T20:39:02.755083+0000","last_became_peered":"2023-11-18T20:39:02.755083+0000","last_unstale":"2023-11-18T20:39:03.756184+0000","last_undegraded":"2023-11-18T20:39:03.756184+0000","last_fullsized":"2023-11-18T20:39:03.756184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:57.948105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.755773+0000","last_change":"2023-11-18T20:39:02.759862+0000","last_active":"2023-11-18T20:39:03.755773+0000","last_peered":"2023-11-18T20:39:03.755773+0000","last_clean":"2023-11-18T20:39:03.755773+0000","last_became_active":"2023-11-18T20:39:02.759565+0000","last_became_peered":"2023-11-18T20:39:02.759565+0000","last_unstale":"2023-11-18T20:39:03.755773+0000","last_undegraded":"2023-11-18T20:39:03.755773+0000","last_fullsized":"2023-11-18T20:39:03.755773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.864544+0000","last_change":"2023-11-18T20:39:02.769220+0000","last_active":"2023-11-18T20:39:03.864544+0000","last_peered":"2023-11-18T20:39:03.864544+0000","last_clean":"2023-11-18T20:39:03.864544+0000","last_became_active":"2023-11-18T20:39:02.762271+0000","last_became_peered":"2023-11-18T20:39:02.762271+0000","last_unstale":"2023-11-18T20:39:03.864544+0000","last_undegraded":"2023-11-18T20:39:03.864544+0000","last_fullsized":"2023-11-18T20:39:03.864544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:37.501746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779387+0000","last_change":"2023-11-18T20:39:02.758393+0000","last_active":"2023-11-18T20:39:03.779387+0000","last_peered":"2023-11-18T20:39:03.779387+0000","last_clean":"2023-11-18T20:39:03.779387+0000","last_became_active":"2023-11-18T20:39:02.752864+0000","last_became_peered":"2023-11-18T20:39:02.752864+0000","last_unstale":"2023-11-18T20:39:03.779387+0000","last_undegraded":"2023-11-18T20:39:03.779387+0000","last_fullsized":"2023-11-18T20:39:03.779387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860348+0000","last_change":"2023-11-18T20:39:02.752211+0000","last_active":"2023-11-18T20:39:03.860348+0000","last_peered":"2023-11-18T20:39:03.860348+0000","last_clean":"2023-11-18T20:39:03.860348+0000","last_became_active":"2023-11-18T20:39:02.751940+0000","last_became_peered":"2023-11-18T20:39:02.751940+0000","last_unstale":"2023-11-18T20:39:03.860348+0000","last_undegraded":"2023-11-18T20:39:03.860348+0000","last_fullsized":"2023-11-18T20:39:03.860348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.863413+0000","last_change":"2023-11-18T20:39:02.758024+0000","last_active":"2023-11-18T20:39:03.863413+0000","last_peered":"2023-11-18T20:39:03.863413+0000","last_clean":"2023-11-18T20:39:03.863413+0000","last_became_active":"2023-11-18T20:39:02.757737+0000","last_became_peered":"2023-11-18T20:39:02.757737+0000","last_unstale":"2023-11-18T20:39:03.863413+0000","last_undegraded":"2023-11-18T20:39:03.863413+0000","last_fullsized":"2023-11-18T20:39:03.863413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:42:50.023528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860316+0000","last_change":"2023-11-18T20:39:02.752133+0000","last_active":"2023-11-18T20:39:03.860316+0000","last_peered":"2023-11-18T20:39:03.860316+0000","last_clean":"2023-11-18T20:39:03.860316+0000","last_became_active":"2023-11-18T20:39:02.751863+0000","last_became_peered":"2023-11-18T20:39:02.751863+0000","last_unstale":"2023-11-18T20:39:03.860316+0000","last_undegraded":"2023-11-18T20:39:03.860316+0000","last_fullsized":"2023-11-18T20:39:03.860316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:56.070643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753100+0000","last_change":"2023-11-18T20:39:02.772030+0000","last_active":"2023-11-18T20:39:03.753100+0000","last_peered":"2023-11-18T20:39:03.753100+0000","last_clean":"2023-11-18T20:39:03.753100+0000","last_became_active":"2023-11-18T20:39:02.771761+0000","last_became_peered":"2023-11-18T20:39:02.771761+0000","last_unstale":"2023-11-18T20:39:03.753100+0000","last_undegraded":"2023-11-18T20:39:03.753100+0000","last_fullsized":"2023-11-18T20:39:03.753100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754128+0000","last_change":"2023-11-18T20:39:02.774172+0000","last_active":"2023-11-18T20:39:03.754128+0000","last_peered":"2023-11-18T20:39:03.754128+0000","last_clean":"2023-11-18T20:39:03.754128+0000","last_became_active":"2023-11-18T20:39:02.773141+0000","last_became_peered":"2023-11-18T20:39:02.773141+0000","last_unstale":"2023-11-18T20:39:03.754128+0000","last_undegraded":"2023-11-18T20:39:03.754128+0000","last_fullsized":"2023-11-18T20:39:03.754128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:59:44.902815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859948+0000","last_change":"2023-11-18T20:39:02.775796+0000","last_active":"2023-11-18T20:39:03.859948+0000","last_peered":"2023-11-18T20:39:03.859948+0000","last_clean":"2023-11-18T20:39:03.859948+0000","last_became_active":"2023-11-18T20:39:02.775503+0000","last_became_peered":"2023-11-18T20:39:02.775503+0000","last_unstale":"2023-11-18T20:39:03.859948+0000","last_undegraded":"2023-11-18T20:39:03.859948+0000","last_fullsized":"2023-11-18T20:39:03.859948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861021+0000","last_change":"2023-11-18T20:39:02.746609+0000","last_active":"2023-11-18T20:39:03.861021+0000","last_peered":"2023-11-18T20:39:03.861021+0000","last_clean":"2023-11-18T20:39:03.861021+0000","last_became_active":"2023-11-18T20:39:02.746324+0000","last_became_peered":"2023-11-18T20:39:02.746324+0000","last_unstale":"2023-11-18T20:39:03.861021+0000","last_undegraded":"2023-11-18T20:39:03.861021+0000","last_fullsized":"2023-11-18T20:39:03.861021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779219+0000","last_change":"2023-11-18T20:39:02.772625+0000","last_active":"2023-11-18T20:39:03.779219+0000","last_peered":"2023-11-18T20:39:03.779219+0000","last_clean":"2023-11-18T20:39:03.779219+0000","last_became_active":"2023-11-18T20:39:02.772348+0000","last_became_peered":"2023-11-18T20:39:02.772348+0000","last_unstale":"2023-11-18T20:39:03.779219+0000","last_undegraded":"2023-11-18T20:39:03.779219+0000","last_fullsized":"2023-11-18T20:39:03.779219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.778990+0000","last_change":"2023-11-18T20:39:02.758480+0000","last_active":"2023-11-18T20:39:03.778990+0000","last_peered":"2023-11-18T20:39:03.778990+0000","last_clean":"2023-11-18T20:39:03.778990+0000","last_became_active":"2023-11-18T20:39:02.752070+0000","last_became_peered":"2023-11-18T20:39:02.752070+0000","last_unstale":"2023-11-18T20:39:03.778990+0000","last_undegraded":"2023-11-18T20:39:03.778990+0000","last_fullsized":"2023-11-18T20:39:03.778990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860793+0000","last_change":"2023-11-18T20:39:02.767291+0000","last_active":"2023-11-18T20:39:03.860793+0000","last_peered":"2023-11-18T20:39:03.860793+0000","last_clean":"2023-11-18T20:39:03.860793+0000","last_became_active":"2023-11-18T20:39:02.764390+0000","last_became_peered":"2023-11-18T20:39:02.764390+0000","last_unstale":"2023-11-18T20:39:03.860793+0000","last_undegraded":"2023-11-18T20:39:03.860793+0000","last_fullsized":"2023-11-18T20:39:03.860793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753215+0000","last_change":"2023-11-18T20:39:02.764472+0000","last_active":"2023-11-18T20:39:03.753215+0000","last_peered":"2023-11-18T20:39:03.753215+0000","last_clean":"2023-11-18T20:39:03.753215+0000","last_became_active":"2023-11-18T20:39:02.764087+0000","last_became_peered":"2023-11-18T20:39:02.764087+0000","last_unstale":"2023-11-18T20:39:03.753215+0000","last_undegraded":"2023-11-18T20:39:03.753215+0000","last_fullsized":"2023-11-18T20:39:03.753215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:00.994479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.864541+0000","last_change":"2023-11-18T20:39:02.761380+0000","last_active":"2023-11-18T20:39:03.864541+0000","last_peered":"2023-11-18T20:39:03.864541+0000","last_clean":"2023-11-18T20:39:03.864541+0000","last_became_active":"2023-11-18T20:39:02.760958+0000","last_became_peered":"2023-11-18T20:39:02.760958+0000","last_unstale":"2023-11-18T20:39:03.864541+0000","last_undegraded":"2023-11-18T20:39:03.864541+0000","last_fullsized":"2023-11-18T20:39:03.864541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:25.114138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.779721+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:02.779721+0000","last_peered":"2023-11-18T20:39:02.779721+0000","last_clean":"2023-11-18T20:39:02.779721+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:02.779721+0000","last_undegraded":"2023-11-18T20:39:02.779721+0000","last_fullsized":"2023-11-18T20:39:02.779721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:00.564472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861323+0000","last_change":"2023-11-18T20:39:02.761289+0000","last_active":"2023-11-18T20:39:03.861323+0000","last_peered":"2023-11-18T20:39:03.861323+0000","last_clean":"2023-11-18T20:39:03.861323+0000","last_became_active":"2023-11-18T20:39:02.760948+0000","last_became_peered":"2023-11-18T20:39:02.760948+0000","last_unstale":"2023-11-18T20:39:03.861323+0000","last_undegraded":"2023-11-18T20:39:03.861323+0000","last_fullsized":"2023-11-18T20:39:03.861323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.784374+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:02.784374+0000","last_peered":"2023-11-18T20:39:02.784374+0000","last_clean":"2023-11-18T20:39:02.784374+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:02.784374+0000","last_undegraded":"2023-11-18T20:39:02.784374+0000","last_fullsized":"2023-11-18T20:39:02.784374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861018+0000","last_change":"2023-11-18T20:39:02.751638+0000","last_active":"2023-11-18T20:39:03.861018+0000","last_peered":"2023-11-18T20:39:03.861018+0000","last_clean":"2023-11-18T20:39:03.861018+0000","last_became_active":"2023-11-18T20:39:02.751330+0000","last_became_peered":"2023-11-18T20:39:02.751330+0000","last_unstale":"2023-11-18T20:39:03.861018+0000","last_undegraded":"2023-11-18T20:39:03.861018+0000","last_fullsized":"2023-11-18T20:39:03.861018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.772056+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:02.772056+0000","last_peered":"2023-11-18T20:39:02.772056+0000","last_clean":"2023-11-18T20:39:02.772056+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:02.772056+0000","last_undegraded":"2023-11-18T20:39:02.772056+0000","last_fullsized":"2023-11-18T20:39:02.772056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753657+0000","last_change":"2023-11-18T20:39:02.758817+0000","last_active":"2023-11-18T20:39:03.753657+0000","last_peered":"2023-11-18T20:39:03.753657+0000","last_clean":"2023-11-18T20:39:03.753657+0000","last_became_active":"2023-11-18T20:39:02.758440+0000","last_became_peered":"2023-11-18T20:39:02.758440+0000","last_unstale":"2023-11-18T20:39:03.753657+0000","last_undegraded":"2023-11-18T20:39:03.753657+0000","last_fullsized":"2023-11-18T20:39:03.753657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.784611+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:02.784611+0000","last_peered":"2023-11-18T20:39:02.784611+0000","last_clean":"2023-11-18T20:39:02.784611+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:02.784611+0000","last_undegraded":"2023-11-18T20:39:02.784611+0000","last_fullsized":"2023-11-18T20:39:02.784611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861031+0000","last_change":"2023-11-18T20:39:02.774591+0000","last_active":"2023-11-18T20:39:03.861031+0000","last_peered":"2023-11-18T20:39:03.861031+0000","last_clean":"2023-11-18T20:39:03.861031+0000","last_became_active":"2023-11-18T20:39:02.774338+0000","last_became_peered":"2023-11-18T20:39:02.774338+0000","last_unstale":"2023-11-18T20:39:03.861031+0000","last_undegraded":"2023-11-18T20:39:03.861031+0000","last_fullsized":"2023-11-18T20:39:03.861031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:32.560325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.779156+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:02.779156+0000","last_peered":"2023-11-18T20:39:02.779156+0000","last_clean":"2023-11-18T20:39:02.779156+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:02.779156+0000","last_undegraded":"2023-11-18T20:39:02.779156+0000","last_fullsized":"2023-11-18T20:39:02.779156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860659+0000","last_change":"2023-11-18T20:39:02.754613+0000","last_active":"2023-11-18T20:39:03.860659+0000","last_peered":"2023-11-18T20:39:03.860659+0000","last_clean":"2023-11-18T20:39:03.860659+0000","last_became_active":"2023-11-18T20:39:02.754350+0000","last_became_peered":"2023-11-18T20:39:02.754350+0000","last_unstale":"2023-11-18T20:39:03.860659+0000","last_undegraded":"2023-11-18T20:39:03.860659+0000","last_fullsized":"2023-11-18T20:39:03.860659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.775290+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:02.775290+0000","last_peered":"2023-11-18T20:39:02.775290+0000","last_clean":"2023-11-18T20:39:02.775290+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:02.775290+0000","last_undegraded":"2023-11-18T20:39:02.775290+0000","last_fullsized":"2023-11-18T20:39:02.775290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:47.442387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860112+0000","last_change":"2023-11-18T20:39:02.772323+0000","last_active":"2023-11-18T20:39:03.860112+0000","last_peered":"2023-11-18T20:39:03.860112+0000","last_clean":"2023-11-18T20:39:03.860112+0000","last_became_active":"2023-11-18T20:39:02.771746+0000","last_became_peered":"2023-11-18T20:39:02.771746+0000","last_unstale":"2023-11-18T20:39:03.860112+0000","last_undegraded":"2023-11-18T20:39:03.860112+0000","last_fullsized":"2023-11-18T20:39:03.860112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:51.574371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.744815+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:02.744815+0000","last_peered":"2023-11-18T20:39:02.744815+0000","last_clean":"2023-11-18T20:39:02.744815+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:02.744815+0000","last_undegraded":"2023-11-18T20:39:02.744815+0000","last_fullsized":"2023-11-18T20:39:02.744815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.752672+0000","last_change":"2023-11-18T20:39:02.770693+0000","last_active":"2023-11-18T20:39:03.752672+0000","last_peered":"2023-11-18T20:39:03.752672+0000","last_clean":"2023-11-18T20:39:03.752672+0000","last_became_active":"2023-11-18T20:39:02.766515+0000","last_became_peered":"2023-11-18T20:39:02.766515+0000","last_unstale":"2023-11-18T20:39:03.752672+0000","last_undegraded":"2023-11-18T20:39:03.752672+0000","last_fullsized":"2023-11-18T20:39:03.752672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.729375+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:02.729375+0000","last_peered":"2023-11-18T20:39:02.729375+0000","last_clean":"2023-11-18T20:39:02.729375+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:02.729375+0000","last_undegraded":"2023-11-18T20:39:02.729375+0000","last_fullsized":"2023-11-18T20:39:02.729375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753824+0000","last_change":"2023-11-18T20:39:02.759699+0000","last_active":"2023-11-18T20:39:03.753824+0000","last_peered":"2023-11-18T20:39:03.753824+0000","last_clean":"2023-11-18T20:39:03.753824+0000","last_became_active":"2023-11-18T20:39:02.759410+0000","last_became_peered":"2023-11-18T20:39:02.759410+0000","last_unstale":"2023-11-18T20:39:03.753824+0000","last_undegraded":"2023-11-18T20:39:03.753824+0000","last_fullsized":"2023-11-18T20:39:03.753824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:52:49.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.753117+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:02.753117+0000","last_peered":"2023-11-18T20:39:02.753117+0000","last_clean":"2023-11-18T20:39:02.753117+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:02.753117+0000","last_undegraded":"2023-11-18T20:39:02.753117+0000","last_fullsized":"2023-11-18T20:39:02.753117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.109348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754735+0000","last_change":"2023-11-18T20:39:02.763642+0000","last_active":"2023-11-18T20:39:03.754735+0000","last_peered":"2023-11-18T20:39:03.754735+0000","last_clean":"2023-11-18T20:39:03.754735+0000","last_became_active":"2023-11-18T20:39:02.763357+0000","last_became_peered":"2023-11-18T20:39:02.763357+0000","last_unstale":"2023-11-18T20:39:03.754735+0000","last_undegraded":"2023-11-18T20:39:03.754735+0000","last_fullsized":"2023-11-18T20:39:03.754735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:04.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.754613+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:02.754613+0000","last_peered":"2023-11-18T20:39:02.754613+0000","last_clean":"2023-11-18T20:39:02.754613+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:02.754613+0000","last_undegraded":"2023-11-18T20:39:02.754613+0000","last_fullsized":"2023-11-18T20:39:02.754613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753745+0000","last_change":"2023-11-18T20:39:02.753904+0000","last_active":"2023-11-18T20:39:03.753745+0000","last_peered":"2023-11-18T20:39:03.753745+0000","last_clean":"2023-11-18T20:39:03.753745+0000","last_became_active":"2023-11-18T20:39:02.753415+0000","last_became_peered":"2023-11-18T20:39:02.753415+0000","last_unstale":"2023-11-18T20:39:03.753745+0000","last_undegraded":"2023-11-18T20:39:03.753745+0000","last_fullsized":"2023-11-18T20:39:03.753745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.778180+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:02.778180+0000","last_peered":"2023-11-18T20:39:02.778180+0000","last_clean":"2023-11-18T20:39:02.778180+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:02.778180+0000","last_undegraded":"2023-11-18T20:39:02.778180+0000","last_fullsized":"2023-11-18T20:39:02.778180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:25.771785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754017+0000","last_change":"2023-11-18T20:39:02.774185+0000","last_active":"2023-11-18T20:39:03.754017+0000","last_peered":"2023-11-18T20:39:03.754017+0000","last_clean":"2023-11-18T20:39:03.754017+0000","last_became_active":"2023-11-18T20:39:02.773865+0000","last_became_peered":"2023-11-18T20:39:02.773865+0000","last_unstale":"2023-11-18T20:39:03.754017+0000","last_undegraded":"2023-11-18T20:39:03.754017+0000","last_fullsized":"2023-11-18T20:39:03.754017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:29.774288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.784859+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:02.784859+0000","last_peered":"2023-11-18T20:39:02.784859+0000","last_clean":"2023-11-18T20:39:02.784859+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:02.784859+0000","last_undegraded":"2023-11-18T20:39:02.784859+0000","last_fullsized":"2023-11-18T20:39:02.784859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:26.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.863582+0000","last_change":"2023-11-18T20:39:02.755872+0000","last_active":"2023-11-18T20:39:03.863582+0000","last_peered":"2023-11-18T20:39:03.863582+0000","last_clean":"2023-11-18T20:39:03.863582+0000","last_became_active":"2023-11-18T20:39:02.755415+0000","last_became_peered":"2023-11-18T20:39:02.755415+0000","last_unstale":"2023-11-18T20:39:03.863582+0000","last_undegraded":"2023-11-18T20:39:03.863582+0000","last_fullsized":"2023-11-18T20:39:03.863582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:08.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.780535+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:02.780535+0000","last_peered":"2023-11-18T20:39:02.780535+0000","last_clean":"2023-11-18T20:39:02.780535+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:02.780535+0000","last_undegraded":"2023-11-18T20:39:02.780535+0000","last_fullsized":"2023-11-18T20:39:02.780535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754101+0000","last_change":"2023-11-18T20:39:02.748892+0000","last_active":"2023-11-18T20:39:03.754101+0000","last_peered":"2023-11-18T20:39:03.754101+0000","last_clean":"2023-11-18T20:39:03.754101+0000","last_became_active":"2023-11-18T20:39:02.748392+0000","last_became_peered":"2023-11-18T20:39:02.748392+0000","last_unstale":"2023-11-18T20:39:03.754101+0000","last_undegraded":"2023-11-18T20:39:03.754101+0000","last_fullsized":"2023-11-18T20:39:03.754101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:18.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.728039+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:02.728039+0000","last_peered":"2023-11-18T20:39:02.728039+0000","last_clean":"2023-11-18T20:39:02.728039+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:02.728039+0000","last_undegraded":"2023-11-18T20:39:02.728039+0000","last_fullsized":"2023-11-18T20:39:02.728039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860441+0000","last_change":"2023-11-18T20:39:02.767695+0000","last_active":"2023-11-18T20:39:03.860441+0000","last_peered":"2023-11-18T20:39:03.860441+0000","last_clean":"2023-11-18T20:39:03.860441+0000","last_became_active":"2023-11-18T20:39:02.765964+0000","last_became_peered":"2023-11-18T20:39:02.765964+0000","last_unstale":"2023-11-18T20:39:03.860441+0000","last_undegraded":"2023-11-18T20:39:03.860441+0000","last_fullsized":"2023-11-18T20:39:03.860441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.729951+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:02.729951+0000","last_peered":"2023-11-18T20:39:02.729951+0000","last_clean":"2023-11-18T20:39:02.729951+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:02.729951+0000","last_undegraded":"2023-11-18T20:39:02.729951+0000","last_fullsized":"2023-11-18T20:39:02.729951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:52:57.711383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753443+0000","last_change":"2023-11-18T20:39:02.777823+0000","last_active":"2023-11-18T20:39:03.753443+0000","last_peered":"2023-11-18T20:39:03.753443+0000","last_clean":"2023-11-18T20:39:03.753443+0000","last_became_active":"2023-11-18T20:39:02.777456+0000","last_became_peered":"2023-11-18T20:39:02.777456+0000","last_unstale":"2023-11-18T20:39:03.753443+0000","last_undegraded":"2023-11-18T20:39:03.753443+0000","last_fullsized":"2023-11-18T20:39:03.753443+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:44.618827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.780393+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:02.780393+0000","last_peered":"2023-11-18T20:39:02.780393+0000","last_clean":"2023-11-18T20:39:02.780393+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:02.780393+0000","last_undegraded":"2023-11-18T20:39:02.780393+0000","last_fullsized":"2023-11-18T20:39:02.780393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754173+0000","last_change":"2023-11-18T20:39:02.773440+0000","last_active":"2023-11-18T20:39:03.754173+0000","last_peered":"2023-11-18T20:39:03.754173+0000","last_clean":"2023-11-18T20:39:03.754173+0000","last_became_active":"2023-11-18T20:39:02.773133+0000","last_became_peered":"2023-11-18T20:39:02.773133+0000","last_unstale":"2023-11-18T20:39:03.754173+0000","last_undegraded":"2023-11-18T20:39:03.754173+0000","last_fullsized":"2023-11-18T20:39:03.754173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:02.899681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.779501+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:02.779501+0000","last_peered":"2023-11-18T20:39:02.779501+0000","last_clean":"2023-11-18T20:39:02.779501+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:02.779501+0000","last_undegraded":"2023-11-18T20:39:02.779501+0000","last_fullsized":"2023-11-18T20:39:02.779501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.861761+0000","last_change":"2023-11-18T20:39:02.765789+0000","last_active":"2023-11-18T20:39:03.861761+0000","last_peered":"2023-11-18T20:39:03.861761+0000","last_clean":"2023-11-18T20:39:03.861761+0000","last_became_active":"2023-11-18T20:39:02.764984+0000","last_became_peered":"2023-11-18T20:39:02.764984+0000","last_unstale":"2023-11-18T20:39:03.861761+0000","last_undegraded":"2023-11-18T20:39:03.861761+0000","last_fullsized":"2023-11-18T20:39:03.861761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.780639+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:02.780639+0000","last_peered":"2023-11-18T20:39:02.780639+0000","last_clean":"2023-11-18T20:39:02.780639+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:02.780639+0000","last_undegraded":"2023-11-18T20:39:02.780639+0000","last_fullsized":"2023-11-18T20:39:02.780639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859292+0000","last_change":"2023-11-18T20:39:02.763496+0000","last_active":"2023-11-18T20:39:03.859292+0000","last_peered":"2023-11-18T20:39:03.859292+0000","last_clean":"2023-11-18T20:39:03.859292+0000","last_became_active":"2023-11-18T20:39:02.762875+0000","last_became_peered":"2023-11-18T20:39:02.762875+0000","last_unstale":"2023-11-18T20:39:03.859292+0000","last_undegraded":"2023-11-18T20:39:03.859292+0000","last_fullsized":"2023-11-18T20:39:03.859292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.776710+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:02.776710+0000","last_peered":"2023-11-18T20:39:02.776710+0000","last_clean":"2023-11-18T20:39:02.776710+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:02.776710+0000","last_undegraded":"2023-11-18T20:39:02.776710+0000","last_fullsized":"2023-11-18T20:39:02.776710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:41.560904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.756108+0000","last_change":"2023-11-18T20:39:02.760383+0000","last_active":"2023-11-18T20:39:03.756108+0000","last_peered":"2023-11-18T20:39:03.756108+0000","last_clean":"2023-11-18T20:39:03.756108+0000","last_became_active":"2023-11-18T20:39:02.760126+0000","last_became_peered":"2023-11-18T20:39:02.760126+0000","last_unstale":"2023-11-18T20:39:03.756108+0000","last_undegraded":"2023-11-18T20:39:03.756108+0000","last_fullsized":"2023-11-18T20:39:03.756108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.749759+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:02.749759+0000","last_peered":"2023-11-18T20:39:02.749759+0000","last_clean":"2023-11-18T20:39:02.749759+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:02.749759+0000","last_undegraded":"2023-11-18T20:39:02.749759+0000","last_fullsized":"2023-11-18T20:39:02.749759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:27.505414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.863835+0000","last_change":"2023-11-18T20:39:02.762298+0000","last_active":"2023-11-18T20:39:03.863835+0000","last_peered":"2023-11-18T20:39:03.863835+0000","last_clean":"2023-11-18T20:39:03.863835+0000","last_became_active":"2023-11-18T20:39:02.761752+0000","last_became_peered":"2023-11-18T20:39:02.761752+0000","last_unstale":"2023-11-18T20:39:03.863835+0000","last_undegraded":"2023-11-18T20:39:03.863835+0000","last_fullsized":"2023-11-18T20:39:03.863835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:16:15.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.774295+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:02.774295+0000","last_peered":"2023-11-18T20:39:02.774295+0000","last_clean":"2023-11-18T20:39:02.774295+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:02.774295+0000","last_undegraded":"2023-11-18T20:39:02.774295+0000","last_fullsized":"2023-11-18T20:39:02.774295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859427+0000","last_change":"2023-11-18T20:39:02.757357+0000","last_active":"2023-11-18T20:39:03.859427+0000","last_peered":"2023-11-18T20:39:03.859427+0000","last_clean":"2023-11-18T20:39:03.859427+0000","last_became_active":"2023-11-18T20:39:02.757000+0000","last_became_peered":"2023-11-18T20:39:02.757000+0000","last_unstale":"2023-11-18T20:39:03.859427+0000","last_undegraded":"2023-11-18T20:39:03.859427+0000","last_fullsized":"2023-11-18T20:39:03.859427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.730518+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:02.730518+0000","last_peered":"2023-11-18T20:39:02.730518+0000","last_clean":"2023-11-18T20:39:02.730518+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:02.730518+0000","last_undegraded":"2023-11-18T20:39:02.730518+0000","last_fullsized":"2023-11-18T20:39:02.730518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.863435+0000","last_change":"2023-11-18T20:39:02.750840+0000","last_active":"2023-11-18T20:39:03.863435+0000","last_peered":"2023-11-18T20:39:03.863435+0000","last_clean":"2023-11-18T20:39:03.863435+0000","last_became_active":"2023-11-18T20:39:02.749491+0000","last_became_peered":"2023-11-18T20:39:02.749491+0000","last_unstale":"2023-11-18T20:39:03.863435+0000","last_undegraded":"2023-11-18T20:39:03.863435+0000","last_fullsized":"2023-11-18T20:39:03.863435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:27:46.865954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.752868+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:02.752868+0000","last_peered":"2023-11-18T20:39:02.752868+0000","last_clean":"2023-11-18T20:39:02.752868+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:02.752868+0000","last_undegraded":"2023-11-18T20:39:02.752868+0000","last_fullsized":"2023-11-18T20:39:02.752868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.860516+0000","last_change":"2023-11-18T20:39:02.769526+0000","last_active":"2023-11-18T20:39:03.860516+0000","last_peered":"2023-11-18T20:39:03.860516+0000","last_clean":"2023-11-18T20:39:03.860516+0000","last_became_active":"2023-11-18T20:39:02.767946+0000","last_became_peered":"2023-11-18T20:39:02.767946+0000","last_unstale":"2023-11-18T20:39:03.860516+0000","last_undegraded":"2023-11-18T20:39:03.860516+0000","last_fullsized":"2023-11-18T20:39:03.860516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.745127+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:02.745127+0000","last_peered":"2023-11-18T20:39:02.745127+0000","last_clean":"2023-11-18T20:39:02.745127+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:02.745127+0000","last_undegraded":"2023-11-18T20:39:02.745127+0000","last_fullsized":"2023-11-18T20:39:02.745127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:48:04.385451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.756562+0000","last_change":"2023-11-18T20:39:02.762642+0000","last_active":"2023-11-18T20:39:03.756562+0000","last_peered":"2023-11-18T20:39:03.756562+0000","last_clean":"2023-11-18T20:39:03.756562+0000","last_became_active":"2023-11-18T20:39:02.761245+0000","last_became_peered":"2023-11-18T20:39:02.761245+0000","last_unstale":"2023-11-18T20:39:03.756562+0000","last_undegraded":"2023-11-18T20:39:03.756562+0000","last_fullsized":"2023-11-18T20:39:03.756562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:59.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.777727+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:02.777727+0000","last_peered":"2023-11-18T20:39:02.777727+0000","last_clean":"2023-11-18T20:39:02.777727+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:02.777727+0000","last_undegraded":"2023-11-18T20:39:02.777727+0000","last_fullsized":"2023-11-18T20:39:02.777727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:39.869697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754191+0000","last_change":"2023-11-18T20:39:02.760873+0000","last_active":"2023-11-18T20:39:03.754191+0000","last_peered":"2023-11-18T20:39:03.754191+0000","last_clean":"2023-11-18T20:39:03.754191+0000","last_became_active":"2023-11-18T20:39:02.759887+0000","last_became_peered":"2023-11-18T20:39:02.759887+0000","last_unstale":"2023-11-18T20:39:03.754191+0000","last_undegraded":"2023-11-18T20:39:03.754191+0000","last_fullsized":"2023-11-18T20:39:03.754191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:26.185944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.859857+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:03.859857+0000","last_peered":"2023-11-18T20:39:03.859857+0000","last_clean":"2023-11-18T20:39:03.859857+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:03.859857+0000","last_undegraded":"2023-11-18T20:39:03.859857+0000","last_fullsized":"2023-11-18T20:39:03.859857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:32.771880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.756465+0000","last_change":"2023-11-18T20:39:02.766797+0000","last_active":"2023-11-18T20:39:03.756465+0000","last_peered":"2023-11-18T20:39:03.756465+0000","last_clean":"2023-11-18T20:39:03.756465+0000","last_became_active":"2023-11-18T20:39:02.766466+0000","last_became_peered":"2023-11-18T20:39:02.766466+0000","last_unstale":"2023-11-18T20:39:03.756465+0000","last_undegraded":"2023-11-18T20:39:03.756465+0000","last_fullsized":"2023-11-18T20:39:03.756465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.491100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.740143+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:02.740143+0000","last_peered":"2023-11-18T20:39:02.740143+0000","last_clean":"2023-11-18T20:39:02.740143+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:02.740143+0000","last_undegraded":"2023-11-18T20:39:02.740143+0000","last_fullsized":"2023-11-18T20:39:02.740143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:43.756070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779010+0000","last_change":"2023-11-18T20:39:02.755847+0000","last_active":"2023-11-18T20:39:03.779010+0000","last_peered":"2023-11-18T20:39:03.779010+0000","last_clean":"2023-11-18T20:39:03.779010+0000","last_became_active":"2023-11-18T20:39:02.755565+0000","last_became_peered":"2023-11-18T20:39:02.755565+0000","last_unstale":"2023-11-18T20:39:03.779010+0000","last_undegraded":"2023-11-18T20:39:03.779010+0000","last_fullsized":"2023-11-18T20:39:03.779010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.743188+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:02.743188+0000","last_peered":"2023-11-18T20:39:02.743188+0000","last_clean":"2023-11-18T20:39:02.743188+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:02.743188+0000","last_undegraded":"2023-11-18T20:39:02.743188+0000","last_fullsized":"2023-11-18T20:39:02.743188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:01.441027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.754246+0000","last_change":"2023-11-18T20:39:02.748674+0000","last_active":"2023-11-18T20:39:03.754246+0000","last_peered":"2023-11-18T20:39:03.754246+0000","last_clean":"2023-11-18T20:39:03.754246+0000","last_became_active":"2023-11-18T20:39:02.748033+0000","last_became_peered":"2023-11-18T20:39:02.748033+0000","last_unstale":"2023-11-18T20:39:03.754246+0000","last_undegraded":"2023-11-18T20:39:03.754246+0000","last_fullsized":"2023-11-18T20:39:03.754246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:31.017030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.734303+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:02.734303+0000","last_peered":"2023-11-18T20:39:02.734303+0000","last_clean":"2023-11-18T20:39:02.734303+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:02.734303+0000","last_undegraded":"2023-11-18T20:39:02.734303+0000","last_fullsized":"2023-11-18T20:39:02.734303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:30.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.752598+0000","last_change":"2023-11-18T20:39:02.752804+0000","last_active":"2023-11-18T20:39:03.752598+0000","last_peered":"2023-11-18T20:39:03.752598+0000","last_clean":"2023-11-18T20:39:03.752598+0000","last_became_active":"2023-11-18T20:39:02.752203+0000","last_became_peered":"2023-11-18T20:39:02.752203+0000","last_unstale":"2023-11-18T20:39:03.752598+0000","last_undegraded":"2023-11-18T20:39:03.752598+0000","last_fullsized":"2023-11-18T20:39:03.752598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.730274+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:02.730274+0000","last_peered":"2023-11-18T20:39:02.730274+0000","last_clean":"2023-11-18T20:39:02.730274+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:02.730274+0000","last_undegraded":"2023-11-18T20:39:02.730274+0000","last_fullsized":"2023-11-18T20:39:02.730274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:24.984694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.753594+0000","last_change":"2023-11-18T20:39:02.755764+0000","last_active":"2023-11-18T20:39:03.753594+0000","last_peered":"2023-11-18T20:39:03.753594+0000","last_clean":"2023-11-18T20:39:03.753594+0000","last_became_active":"2023-11-18T20:39:02.755464+0000","last_became_peered":"2023-11-18T20:39:02.755464+0000","last_unstale":"2023-11-18T20:39:03.753594+0000","last_undegraded":"2023-11-18T20:39:03.753594+0000","last_fullsized":"2023-11-18T20:39:03.753594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:24.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.727659+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:02.727659+0000","last_peered":"2023-11-18T20:39:02.727659+0000","last_clean":"2023-11-18T20:39:02.727659+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:02.727659+0000","last_undegraded":"2023-11-18T20:39:02.727659+0000","last_fullsized":"2023-11-18T20:39:02.727659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:56.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-18T20:39:03.779508+0000","last_change":"2023-11-18T20:39:02.760047+0000","last_active":"2023-11-18T20:39:03.779508+0000","last_peered":"2023-11-18T20:39:03.779508+0000","last_clean":"2023-11-18T20:39:03.779508+0000","last_became_active":"2023-11-18T20:39:02.759514+0000","last_became_peered":"2023-11-18T20:39:02.759514+0000","last_unstale":"2023-11-18T20:39:03.779508+0000","last_undegraded":"2023-11-18T20:39:03.779508+0000","last_fullsized":"2023-11-18T20:39:03.779508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.745411+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:02.745411+0000","last_peered":"2023-11-18T20:39:02.745411+0000","last_clean":"2023-11-18T20:39:02.745411+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:02.745411+0000","last_undegraded":"2023-11-18T20:39:02.745411+0000","last_fullsized":"2023-11-18T20:39:02.745411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:49.505805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-18T20:39:02.743928+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:02.743928+0000","last_peered":"2023-11-18T20:39:02.743928+0000","last_clean":"2023-11-18T20:39:02.743928+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:02.743928+0000","last_undegraded":"2023-11-18T20:39:02.743928+0000","last_fullsized":"2023-11-18T20:39:02.743928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":154656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.7470000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.548},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.1879999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.24},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.3939999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.6930000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.9039999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.651}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":1.9910000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.0510000000000002},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":2.02}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":156246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.89300000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.212}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1830000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.343}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.3},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3999999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.4419999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.9590000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":991232,"data_stored":745584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.494},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.321}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.2829999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.98299999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.127},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.667}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.397}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.516},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.2509999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.5920000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":156268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.3899999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.327}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.117},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.056}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.5549999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.581},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.524}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.47}]}]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":155410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.101}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.87},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.77500000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.93400000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.581}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.651},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.53}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.4970000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.6200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.68000000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.88700000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.103},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.94099999999999995}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.012},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.1739999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.25},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.98399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":745072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.97499999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.79800000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.872}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.2330000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.056}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.077}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":154724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.629}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.2669999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.03},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.1539999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.48}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.2949999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:12.734 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T20:39:12.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-18T20:39:12.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.995+0000 7f614e1e9640 1 Processor -- start 2023-11-18T20:39:12.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.996+0000 7f614e1e9640 1 -- start start 2023-11-18T20:39:12.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f614e1e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 0x7f6148152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f614e1e9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f614806d0a0 0x7f61480a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f614e1e9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61480a5260 0x7f61480c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f614e1e9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480c64a0 con 0x7f614806d0a0 2023-11-18T20:39:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f614e1e9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480c5c00 con 0x7f61480a5260 2023-11-18T20:39:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f614e1e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480c5ee0 con 0x7f614814fd30 2023-11-18T20:39:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f613ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f614806d0a0 0x7f61480a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f613ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f614806d0a0 0x7f61480a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55962/0 (socket says 172.21.15.132:55962) 2023-11-18T20:39:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.997+0000 7f613ffff640 1 -- 172.21.15.132:0/4072994652 learned_addr learned my addr 172.21.15.132:0/4072994652 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.998+0000 7f6147fff640 1 --2- 172.21.15.132:0/4072994652 >> v2:172.21.15.161:3300/0 conn(0x7f61480a5260 0x7f61480c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.998+0000 7f61477fe640 1 --2- 172.21.15.132:0/4072994652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 0x7f6148152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.998+0000 7f613ffff640 1 -- 172.21.15.132:0/4072994652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 msgr2=0x7f6148152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.998+0000 7f613ffff640 1 --2- 172.21.15.132:0/4072994652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 0x7f6148152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.998+0000 7f613ffff640 1 -- 172.21.15.132:0/4072994652 >> v2:172.21.15.161:3300/0 conn(0x7f61480a5260 msgr2=0x7f61480c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:13.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.998+0000 7f613ffff640 1 --2- 172.21.15.132:0/4072994652 >> v2:172.21.15.161:3300/0 conn(0x7f61480a5260 0x7f61480c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.998+0000 7f613ffff640 1 -- 172.21.15.132:0/4072994652 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61480c61c0 con 0x7f614806d0a0 2023-11-18T20:39:13.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.998+0000 7f6147fff640 1 --2- 172.21.15.132:0/4072994652 >> v2:172.21.15.161:3300/0 conn(0x7f61480a5260 0x7f61480c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:13.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:12.999+0000 7f613ffff640 1 --2- 172.21.15.132:0/4072994652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a4d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f614806d990 tx=0x7f613002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb488c1ce2e9304 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f6146ffd640 1 -- 172.21.15.132:0/4072994652 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130031870 con 0x7f614806d0a0 2023-11-18T20:39:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f6146ffd640 1 -- 172.21.15.132:0/4072994652 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61300319d0 con 0x7f614806d0a0 2023-11-18T20:39:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f6146ffd640 1 -- 172.21.15.132:0/4072994652 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130031d60 con 0x7f614806d0a0 2023-11-18T20:39:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 -- 172.21.15.132:0/4072994652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 msgr2=0x7f61480a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 --2- 172.21.15.132:0/4072994652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a4d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f614806d990 tx=0x7f613002b910 comp rx=0 tx=0).stop 2023-11-18T20:39:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 -- 172.21.15.132:0/4072994652 shutdown_connections 2023-11-18T20:39:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 --2- 172.21.15.132:0/4072994652 >> v2:172.21.15.161:3300/0 conn(0x7f61480a5260 0x7f61480c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 --2- 172.21.15.132:0/4072994652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a4d20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 --2- 172.21.15.132:0/4072994652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 0x7f6148152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 -- 172.21.15.132:0/4072994652 >> 172.21.15.132:0/4072994652 conn(0x7f614806a500 msgr2=0x7f614806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 -- 172.21.15.132:0/4072994652 shutdown_connections 2023-11-18T20:39:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.000+0000 7f614e1e9640 1 -- 172.21.15.132:0/4072994652 wait complete. 2023-11-18T20:39:13.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.002+0000 7f614e1e9640 1 Processor -- start 2023-11-18T20:39:13.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.002+0000 7f614e1e9640 1 -- start start 2023-11-18T20:39:13.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f614e1e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f614e1e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61480a5260 0x7f61480a7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f614e1e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 0x7f61481ed460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f614e1e9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614814a5f0 con 0x7f614806d0a0 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f614e1e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61481491c0 con 0x7f61480a5260 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f614e1e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480a7880 con 0x7f614814fd30 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f61477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f61477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55978/0 (socket says 172.21.15.132:55978) 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.003+0000 7f61477fe640 1 -- 172.21.15.132:0/645718154 learned_addr learned my addr 172.21.15.132:0/645718154 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f613ffff640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61480a5260 0x7f61480a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f6147fff640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 0x7f61481ed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f61477fe640 1 -- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 msgr2=0x7f61481ed460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f61477fe640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 0x7f61481ed460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f61477fe640 1 -- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61480a5260 msgr2=0x7f61480a7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f61477fe640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61480a5260 0x7f61480a7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f61477fe640 1 -- 172.21.15.132:0/645718154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300094d0 con 0x7f614806d0a0 2023-11-18T20:39:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f61477fe640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a6e00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f613800d5f0 tx=0x7f613800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f6144ff9640 1 -- 172.21.15.132:0/645718154 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380125f0 con 0x7f614806d0a0 2023-11-18T20:39:13.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f6144ff9640 1 -- 172.21.15.132:0/645718154 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6138012750 con 0x7f614806d0a0 2023-11-18T20:39:13.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f6144ff9640 1 -- 172.21.15.132:0/645718154 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138012b00 con 0x7f614806d0a0 2023-11-18T20:39:13.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.004+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6148149410 con 0x7f614806d0a0 2023-11-18T20:39:13.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.005+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614814aa10 con 0x7f614806d0a0 2023-11-18T20:39:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.006+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61481ee390 con 0x7f614806d0a0 2023-11-18T20:39:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.007+0000 7f6144ff9640 1 -- 172.21.15.132:0/645718154 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6138012c60 con 0x7f614806d0a0 2023-11-18T20:39:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.008+0000 7f6144ff9640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f612806ae40 0x7f612806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.008+0000 7f6144ff9640 1 -- 172.21.15.132:0/645718154 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6138089af0 con 0x7f614806d0a0 2023-11-18T20:39:13.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.008+0000 7f613ffff640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f612806ae40 0x7f612806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.009+0000 7f613ffff640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f612806ae40 0x7f612806d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6130036000 tx=0x7f613003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:13.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.012+0000 7f6144ff9640 1 -- 172.21.15.132:0/645718154 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6138054b90 con 0x7f614806d0a0 2023-11-18T20:39:13.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.270+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6148068350 con 0x7f614806d0a0 2023-11-18T20:39:13.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.275+0000 7f6144ff9640 1 -- 172.21.15.132:0/645718154 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f61380581b0 con 0x7f614806d0a0 2023-11-18T20:39:13.276 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-11-18T20:39:13.276 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBrIFllsbdTOxAAP60vfd0AqFNopXTOFb78Tw== 2023-11-18T20:39:13.276 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow" 2023-11-18T20:39:13.276 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2023-11-18T20:39:13.276 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-18T20:39:13.277 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-11-18T20:39:13.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f612806ae40 msgr2=0x7f612806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f612806ae40 0x7f612806d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6130036000 tx=0x7f613003c040 comp rx=0 tx=0).stop 2023-11-18T20:39:13.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 msgr2=0x7f61480a6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a6e00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f613800d5f0 tx=0x7f613800dab0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 shutdown_connections 2023-11-18T20:39:13.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f612806ae40 0x7f612806d300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f614814fd30 0x7f61481ed460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61480a5260 0x7f61480a7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 --2- 172.21.15.132:0/645718154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614806d0a0 0x7f61480a6e00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 >> 172.21.15.132:0/645718154 conn(0x7f614806a500 msgr2=0x7f61480c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:13.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 shutdown_connections 2023-11-18T20:39:13.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.278+0000 7f614e1e9640 1 -- 172.21.15.132:0/645718154 wait complete. 2023-11-18T20:39:13.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:39:13.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.503+0000 7f279701c640 1 Processor -- start 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.503+0000 7f279701c640 1 -- start start 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.504+0000 7f279701c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 0x7f27900c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.504+0000 7f279701c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27900c06c0 con 0x7f27900a9b40 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.504+0000 7f279701c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27900c1020 con 0x7f2790155490 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.504+0000 7f279701c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27900a5820 con 0x7f27900c1500 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f27900a9b40 0x7f27900c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43848/0 (socket says 172.21.15.132:43848) 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278ffff640 1 -- 172.21.15.132:0/975742670 learned_addr learned my addr 172.21.15.132:0/975742670 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623375839 0 0) 0x7f27900c06c0 con 0x7f27900a9b40 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2780005730 con 0x7f27900a9b40 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f27955b9640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 0x7f27900c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570920658 0 0) 0x7f2780005730 con 0x7f27900a9b40 2023-11-18T20:39:13.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 msgr2=0x7f27900c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 0x7f27900c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 >> v1:172.21.15.161:6789/0 conn(0x7f2790155490 legacy=0x7f27900a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900c0910 con 0x7f27900a9b40 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f277c001670 con 0x7f27900a9b40 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.505+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 >> v1:172.21.15.132:6789/0 conn(0x7f27900a9b40 legacy=0x7f27900c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f278f7fe640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 0x7f2780005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f278f7fe640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27800061c0 0x7f27800069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f278f7fe640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2780006f10 0x7f2780007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278000dd20 con 0x7f2780006f10 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278000de60 con 0x7f27800061c0 2023-11-18T20:39:13.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278000e020 con 0x7f27900c1500 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f27955b9640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2780006f10 0x7f2780007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f278ffff640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27800061c0 0x7f27800069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f2794db8640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 0x7f2780005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f27955b9640 1 -- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 msgr2=0x7f2780005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f27955b9640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 0x7f2780005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f27955b9640 1 -- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27800061c0 msgr2=0x7f27800069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f27955b9640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27800061c0 0x7f27800069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f27955b9640 1 -- 172.21.15.132:0/975742670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780005730 con 0x7f2780006f10 2023-11-18T20:39:13.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.506+0000 7f2794db8640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27900c1500 0x7f2780005bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.507+0000 7f27955b9640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2780006f10 0x7f2780007390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2790067240 tx=0x7f2780007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8036de28238cfe9f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278802cc40 con 0x7f2780006f10 2023-11-18T20:39:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278802cda0 con 0x7f2780006f10 2023-11-18T20:39:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f278f7fe640 1 -- 172.21.15.132:0/975742670 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788034680 con 0x7f2780006f10 2023-11-18T20:39:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f279701c640 1 -- 172.21.15.132:0/975742670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2780006f10 msgr2=0x7f2780007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f279701c640 1 --2- 172.21.15.132:0/975742670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2780006f10 0x7f2780007390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2790067240 tx=0x7f2780007a00 comp rx=0 tx=0).stop 2023-11-18T20:39:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f27955b9640 1 -- 172.21.15.132:0/975742670 reap_dead start 2023-11-18T20:39:13.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f279701c640 1 -- 172.21.15.132:0/975742670 shutdown_connections 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f279701c640 1 -- 172.21.15.132:0/975742670 >> 172.21.15.132:0/975742670 conn(0x7f279006a500 msgr2=0x7f279006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f279701c640 1 -- 172.21.15.132:0/975742670 shutdown_connections 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.508+0000 7f279701c640 1 -- 172.21.15.132:0/975742670 wait complete. 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.510+0000 7f279701c640 1 Processor -- start 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.510+0000 7f279701c640 1 -- start start 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f279701c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27900bf360 0x7f279014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f279701c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27901dbc50 0x7f279014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f279701c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27901dd510 0x7f27901dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f279701c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27901de650 con 0x7f27900bf360 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f279701c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27901dc7e0 con 0x7f27901dbc50 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f279701c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2790150820 con 0x7f27901dd510 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f2794db8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27900bf360 0x7f279014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f2794db8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27900bf360 0x7f279014ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55998/0 (socket says 172.21.15.132:55998) 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.511+0000 7f2794db8640 1 -- 172.21.15.132:0/3273775389 learned_addr learned my addr 172.21.15.132:0/3273775389 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f2794db8640 1 -- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27901dd510 msgr2=0x7f27901dd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f2794db8640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27901dd510 0x7f27901dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f2794db8640 1 -- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27901dbc50 msgr2=0x7f279014f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f2794db8640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27901dbc50 0x7f279014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f2794db8640 1 -- 172.21.15.132:0/3273775389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27901dabe0 con 0x7f27900bf360 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f2794db8640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27900bf360 0x7f279014ef90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f278400d5c0 tx=0x7f278400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f278d7fa640 1 -- 172.21.15.132:0/3273775389 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784007220 con 0x7f27900bf360 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f278d7fa640 1 -- 172.21.15.132:0/3273775389 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27840073a0 con 0x7f27900bf360 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f278d7fa640 1 -- 172.21.15.132:0/3273775389 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840067d0 con 0x7f27900bf360 2023-11-18T20:39:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27901dca30 con 0x7f27900bf360 2023-11-18T20:39:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.512+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27901dcff0 con 0x7f27900bf360 2023-11-18T20:39:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.513+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2790068350 con 0x7f27900bf360 2023-11-18T20:39:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.514+0000 7f278d7fa640 1 -- 172.21.15.132:0/3273775389 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2784006930 con 0x7f27900bf360 2023-11-18T20:39:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.515+0000 7f278d7fa640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f277406ae40 0x7f277406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.515+0000 7f278d7fa640 1 -- 172.21.15.132:0/3273775389 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27840893b0 con 0x7f27900bf360 2023-11-18T20:39:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.516+0000 7f278ffff640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f277406ae40 0x7f277406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:13.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.517+0000 7f278ffff640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f277406ae40 0x7f277406d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f277c0017a0 tx=0x7f277c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:13.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.519+0000 7f278d7fa640 1 -- 172.21.15.132:0/3273775389 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27840543c0 con 0x7f27900bf360 2023-11-18T20:39:13.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.745+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27901dd1b0 con 0x7f27900bf360 2023-11-18T20:39:13.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.746+0000 7f278d7fa640 1 -- 172.21.15.132:0/3273775389 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f27840579e0 con 0x7f27900bf360 2023-11-18T20:39:13.747 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:13.748 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:02.182181+0000","modified":"2023-11-18T20:39:05.261751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6834/4266315561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4266315561},{"type":"v1","addr":"172.21.15.132:6834","nonce":4266315561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-18T20:39:13.748 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 15 2023-11-18T20:39:13.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.749+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f277406ae40 msgr2=0x7f277406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.749+0000 7f279701c640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f277406ae40 0x7f277406d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f277c0017a0 tx=0x7f277c009040 comp rx=0 tx=0).stop 2023-11-18T20:39:13.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.749+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27900bf360 msgr2=0x7f279014ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:13.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.749+0000 7f279701c640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27900bf360 0x7f279014ef90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f278400d5c0 tx=0x7f278400da80 comp rx=0 tx=0).stop 2023-11-18T20:39:13.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.750+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 shutdown_connections 2023-11-18T20:39:13.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.750+0000 7f279701c640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f277406ae40 0x7f277406d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.750+0000 7f279701c640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27901dd510 0x7f27901dd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.750+0000 7f279701c640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27901dbc50 0x7f279014f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.750+0000 7f279701c640 1 --2- 172.21.15.132:0/3273775389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27900bf360 0x7f279014ef90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:13.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.750+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 >> 172.21.15.132:0/3273775389 conn(0x7f279006a500 msgr2=0x7f279006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:13.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.750+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 shutdown_connections 2023-11-18T20:39:13.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:13.750+0000 7f279701c640 1 -- 172.21.15.132:0/3273775389 wait complete. 2023-11-18T20:39:14.173 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T20:39:02.182181+0000', 'modified': '2023-11-18T20:39:05.261751+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4977}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4977': {'gid': 4977, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.132:6834/4266315561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6832', 'nonce': 4266315561}, {'type': 'v1', 'addr': '172.21.15.132:6834', 'nonce': 4266315561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-18T20:39:14.173 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T20:39:14.173 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-18T20:39:14.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.397+0000 7f11d126d640 1 Processor -- start 2023-11-18T20:39:14.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.397+0000 7f11d126d640 1 -- start start 2023-11-18T20:39:14.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.398+0000 7f11d126d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11cc0a4eb0 0x7f11cc154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.398+0000 7f11d126d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc06bec0 0x7f11cc0c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.398+0000 7f11d126d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11cc0c1d30 con 0x7f11cc14e170 2023-11-18T20:39:14.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.398+0000 7f11d126d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11cc1519e0 con 0x7f11cc0a4eb0 2023-11-18T20:39:14.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.398+0000 7f11d126d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc06c350 con 0x7f11cc06bec0 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11c37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11cc0a4eb0 0x7f11cc154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11cbfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f11cc14e170 0x7f11cc1512d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43856/0 (socket says 172.21.15.132:43856) 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11cbfff640 1 -- 172.21.15.132:0/2864873723 learned_addr learned my addr 172.21.15.132:0/2864873723 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11d0a6c640 1 --2- 172.21.15.132:0/2864873723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc06bec0 0x7f11cc0c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11c37fe640 1 -- 172.21.15.132:0/2864873723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc06bec0 msgr2=0x7f11cc0c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11c37fe640 1 --2- 172.21.15.132:0/2864873723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc06bec0 0x7f11cc0c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11c37fe640 1 -- 172.21.15.132:0/2864873723 >> v1:172.21.15.132:6789/0 conn(0x7f11cc14e170 legacy=0x7f11cc1512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11c37fe640 1 -- 172.21.15.132:0/2864873723 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc0c51f0 con 0x7f11cc0a4eb0 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11cb7fe640 1 -- 172.21.15.132:0/2864873723 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650917670 0 0) 0x7f11cc0c1d30 con 0x7f11cc14e170 2023-11-18T20:39:14.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.399+0000 7f11d0a6c640 1 --2- 172.21.15.132:0/2864873723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc06bec0 0x7f11cc0c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:14.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.400+0000 7f11c37fe640 1 --2- 172.21.15.132:0/2864873723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc0a4eb0 0x7f11cc154910 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f11b40097a0 tx=0x7f11b402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfca84db3289ddef server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11cb7fe640 1 -- 172.21.15.132:0/2864873723 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4031780 con 0x7f11cc0a4eb0 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11cb7fe640 1 -- 172.21.15.132:0/2864873723 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40318e0 con 0x7f11cc0a4eb0 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11cb7fe640 1 -- 172.21.15.132:0/2864873723 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4031c70 con 0x7f11cc0a4eb0 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11d126d640 1 -- 172.21.15.132:0/2864873723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc0a4eb0 msgr2=0x7f11cc154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11d126d640 1 --2- 172.21.15.132:0/2864873723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc0a4eb0 0x7f11cc154910 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f11b40097a0 tx=0x7f11b402b820 comp rx=0 tx=0).stop 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11d126d640 1 -- 172.21.15.132:0/2864873723 shutdown_connections 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11d126d640 1 --2- 172.21.15.132:0/2864873723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc06bec0 0x7f11cc0c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11d126d640 1 --2- 172.21.15.132:0/2864873723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc0a4eb0 0x7f11cc154910 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11d126d640 1 -- 172.21.15.132:0/2864873723 >> 172.21.15.132:0/2864873723 conn(0x7f11cc0a77f0 msgr2=0x7f11cc0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11d126d640 1 -- 172.21.15.132:0/2864873723 shutdown_connections 2023-11-18T20:39:14.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.401+0000 7f11d126d640 1 -- 172.21.15.132:0/2864873723 wait complete. 2023-11-18T20:39:14.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.403+0000 7f11d126d640 1 Processor -- start 2023-11-18T20:39:14.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.403+0000 7f11d126d640 1 -- start start 2023-11-18T20:39:14.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11d126d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc06bec0 0x7f11cc0a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11d126d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11cc0a4eb0 0x7f11cc1452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11d126d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc14e170 0x7f11cc145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11d126d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0a6e60 con 0x7f11cc06bec0 2023-11-18T20:39:14.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11d126d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc145d60 con 0x7f11cc0a4eb0 2023-11-18T20:39:14.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11d126d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1ea700 con 0x7f11cc14e170 2023-11-18T20:39:14.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc06bec0 0x7f11cc0a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc06bec0 0x7f11cc0a5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56018/0 (socket says 172.21.15.132:56018) 2023-11-18T20:39:14.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.404+0000 7f11cbfff640 1 -- 172.21.15.132:0/4207878582 learned_addr learned my addr 172.21.15.132:0/4207878582 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:14.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11cbfff640 1 -- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc14e170 msgr2=0x7f11cc145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11cbfff640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc14e170 0x7f11cc145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11cbfff640 1 -- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11cc0a4eb0 msgr2=0x7f11cc1452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11cbfff640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11cc0a4eb0 0x7f11cc1452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11cbfff640 1 -- 172.21.15.132:0/4207878582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4009400 con 0x7f11cc06bec0 2023-11-18T20:39:14.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11cbfff640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc06bec0 0x7f11cc0a5c60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00c7c0 tx=0x7f11bc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11c97fa640 1 -- 172.21.15.132:0/4207878582 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00a640 con 0x7f11cc06bec0 2023-11-18T20:39:14.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11c97fa640 1 -- 172.21.15.132:0/4207878582 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc00a7c0 con 0x7f11cc06bec0 2023-11-18T20:39:14.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11d126d640 1 -- 172.21.15.132:0/4207878582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc0a7090 con 0x7f11cc06bec0 2023-11-18T20:39:14.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11c97fa640 1 -- 172.21.15.132:0/4207878582 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00ab70 con 0x7f11cc06bec0 2023-11-18T20:39:14.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.405+0000 7f11d126d640 1 -- 172.21.15.132:0/4207878582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc0a6470 con 0x7f11cc06bec0 2023-11-18T20:39:14.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.407+0000 7f11c97fa640 1 -- 172.21.15.132:0/4207878582 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11bc00acd0 con 0x7f11cc06bec0 2023-11-18T20:39:14.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.408+0000 7f11c97fa640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f11ac06ae40 0x7f11ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.408+0000 7f11c97fa640 1 -- 172.21.15.132:0/4207878582 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11bc088b40 con 0x7f11cc06bec0 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.409+0000 7f11d5068740 1 Processor -- start 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.409+0000 7f11c37fe640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f11ac06ae40 0x7f11ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.409+0000 7f11d5068740 1 -- start start 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d5068740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55074a70 0x55ce55074e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d5068740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce5503b7c0 0x55ce55077d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d5068740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce55034cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d5068740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce54f98880 con 0x55ce55078280 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d5068740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce54fa7ae0 con 0x55ce55074a70 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d5068740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce54fa51d0 con 0x55ce5503b7c0 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11c37fe640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f11ac06ae40 0x7f11ac06d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f11b4036000 tx=0x7f11b4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d0a6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce55034cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d0a6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce55034cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56024/0 (socket says 172.21.15.132:56024) 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.410+0000 7f11d0a6c640 1 -- 172.21.15.132:0/2212183820 learned_addr learned my addr 172.21.15.132:0/2212183820 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11cbfff640 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55074a70 0x55ce55074e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11c37fe640 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce5503b7c0 0x55ce55077d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11d0a6c640 1 -- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce5503b7c0 msgr2=0x55ce55077d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11d0a6c640 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce5503b7c0 0x55ce55077d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11d0a6c640 1 -- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55074a70 msgr2=0x55ce55074e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11d0a6c640 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55074a70 0x55ce55074e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11d0a6c640 1 -- 172.21.15.132:0/2212183820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce54f68860 con 0x55ce55078280 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11c37fe640 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce5503b7c0 0x55ce55077d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11d0a6c640 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce55034cb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f11c400a980 tx=0x7f11c400ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57af50360ef6b73 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11c1ffb640 1 -- 172.21.15.132:0/2212183820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c400cc00 con 0x55ce55078280 2023-11-18T20:39:14.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11c1ffb640 1 -- 172.21.15.132:0/2212183820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c400cd80 con 0x55ce55078280 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.411+0000 7f11c1ffb640 1 -- 172.21.15.132:0/2212183820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4004270 con 0x55ce55078280 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 -- 172.21.15.132:0/2212183820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 msgr2=0x55ce55034cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce55034cb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f11c400a980 tx=0x7f11c400ae40 comp rx=0 tx=0).stop 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 -- 172.21.15.132:0/2212183820 shutdown_connections 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce55034cb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce5503b7c0 0x55ce55077d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 --2- 172.21.15.132:0/2212183820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55074a70 0x55ce55074e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 -- 172.21.15.132:0/2212183820 >> 172.21.15.132:0/2212183820 conn(0x55ce54ffbbb0 msgr2=0x55ce5505b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 -- 172.21.15.132:0/2212183820 shutdown_connections 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.412+0000 7f11d5068740 1 -- 172.21.15.132:0/2212183820 wait complete. 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.413+0000 7f11d5068740 1 -- start start 2023-11-18T20:39:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.413+0000 7f11d5068740 1 Processor -- start 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11d5068740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55079fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11d5068740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce5507af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11d5068740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55078280 0x55ce55058500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11d5068740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce54fa0ac0 con 0x55ce5503b7c0 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11d5068740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce54f3d2f0 con 0x55ce55078280 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11d5068740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce54f5ac70 con 0x55ce55074a70 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11d5068740 10 client.0 _ll_register_callbacks cb 0x55ce54f5f3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55079fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55079fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56026/0 (socket says 172.21.15.132:56026) 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.414+0000 7f11cbfff640 1 -- 172.21.15.132:0/1142692064 learned_addr learned my addr 172.21.15.132:0/1142692064 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11cbfff640 1 -- 172.21.15.132:0/1142692064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 msgr2=0x55ce5507af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11cbfff640 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce5507af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11cbfff640 1 -- 172.21.15.132:0/1142692064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55078280 msgr2=0x55ce55058500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11cbfff640 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55078280 0x55ce55058500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11cbfff640 1 -- 172.21.15.132:0/1142692064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c400a5e0 con 0x55ce5503b7c0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11cbfff640 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55079fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0012e0 tx=0x7f11bc057950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c3e054ae6bba3f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11aaffd640 1 -- 172.21.15.132:0/1142692064 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc055c70 con 0x55ce5503b7c0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11aaffd640 1 -- 172.21.15.132:0/1142692064 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11bc06cc10 con 0x55ce5503b7c0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11d5068740 1 -- 172.21.15.132:0/1142692064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce54f99aa0 con 0x55ce5503b7c0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11aaffd640 1 -- 172.21.15.132:0/1142692064 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11bc06cdd0 con 0x55ce5503b7c0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11d5068740 10 client.5193 fetch_fsmap learned FSMap version 15 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11d5068740 1 -- 172.21.15.132:0/1142692064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55ce54f9f140 con 0x55ce5503b7c0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.415+0000 7f11aaffd640 1 -- 172.21.15.132:0/1142692064 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce54f99aa0 con 0x55ce5503b7c0 2023-11-18T20:39:14.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11aaffd640 1 -- 172.21.15.132:0/1142692064 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f11bc058b40 con 0x55ce5503b7c0 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11d5068740 10 client.5193 fetch_fsmap finished waiting for FSMap version 15 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11d5068740 10 client.5193 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11d5068740 20 client.5193 populate_metadata read hostname 'smithi132' 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11d5068740 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] conn(0x55ce55089a00 0x55ce55089de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11d5068740 4 client.5193 mds_command: new command op to 4977 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11d5068740 1 -- 172.21.15.132:0/1142692064 --> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce54f997c0 con 0x55ce55089a00 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11c37fe640 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] conn(0x55ce55089a00 0x55ce55089de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11c37fe640 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] conn(0x55ce55089a00 0x55ce55089de0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd1331a519f72b8a server_cookie=2dc3e3ba7828f5a7 in_seq=0 out_seq=0 2023-11-18T20:39:14.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.416+0000 7f11aaffd640 10 client.5193 ms_handle_connect on v2:172.21.15.132:6832/4266315561 2023-11-18T20:39:14.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11aaffd640 1 -- 172.21.15.132:0/1142692064 <== mds.0 v2:172.21.15.132:6832/4266315561 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ce54f997c0 con 0x55ce55089a00 2023-11-18T20:39:14.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11aaffd640 10 client.5193 handle_command_reply: tid=0 2023-11-18T20:39:14.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 client.5193 shutdown 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 -- 172.21.15.132:0/1142692064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 msgr2=0x55ce55079fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55079fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0012e0 tx=0x7f11bc057950 comp rx=0 tx=0).stop 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 -- 172.21.15.132:0/1142692064 shutdown_connections 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] conn(0x55ce55089a00 0x55ce55089de0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55078280 0x55ce55058500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce5507af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11aaffd640 0 client.5193 ms_handle_reset on v2:172.21.15.132:6832/4266315561 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 --2- 172.21.15.132:0/1142692064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55079fb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.417+0000 7f11d5068740 1 -- 172.21.15.132:0/1142692064 >> 172.21.15.132:0/1142692064 conn(0x55ce54ffbbb0 msgr2=0x55ce5505b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.418+0000 7f11d5068740 1 -- 172.21.15.132:0/1142692064 shutdown_connections 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.418+0000 7f11d5068740 1 -- 172.21.15.132:0/1142692064 wait complete. 2023-11-18T20:39:14.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.418+0000 7f11d5068740 20 client.5193 trim_cache size 0 max 16384 2023-11-18T20:39:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.434+0000 7f11d5068740 1 Processor -- start 2023-11-18T20:39:14.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.435+0000 7f11d5068740 1 -- start start 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.435+0000 7f11d5068740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55035df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.435+0000 7f11d5068740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce5505a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.435+0000 7f11d5068740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55078280 0x55ce5505ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.435+0000 7f11d5068740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce54d03f20 con 0x55ce5503b7c0 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.435+0000 7f11d5068740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce5503ab90 con 0x55ce55078280 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.435+0000 7f11d5068740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce5503a690 con 0x55ce55074a70 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.435+0000 7f11cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55035df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55035df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56036/0 (socket says 172.21.15.132:56036) 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11cbfff640 1 -- 172.21.15.132:0/1184955611 learned_addr learned my addr 172.21.15.132:0/1184955611 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11cbfff640 1 -- 172.21.15.132:0/1184955611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 msgr2=0x55ce5505a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11cbfff640 1 --2- 172.21.15.132:0/1184955611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce5505a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11cbfff640 1 -- 172.21.15.132:0/1184955611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55078280 msgr2=0x55ce5505ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11cbfff640 1 --2- 172.21.15.132:0/1184955611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55078280 0x55ce5505ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11cbfff640 1 -- 172.21.15.132:0/1184955611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce54f3cb80 con 0x55ce5503b7c0 2023-11-18T20:39:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11cbfff640 1 --2- 172.21.15.132:0/1184955611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55035df0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f11bc002230 tx=0x7f11bc05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c301a5083738e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11c27fc640 1 -- 172.21.15.132:0/1184955611 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc055c70 con 0x55ce5503b7c0 2023-11-18T20:39:14.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11c27fc640 1 -- 172.21.15.132:0/1184955611 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc058b40 con 0x55ce5503b7c0 2023-11-18T20:39:14.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.436+0000 7f11c27fc640 1 -- 172.21.15.132:0/1184955611 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc053820 con 0x55ce5503b7c0 2023-11-18T20:39:14.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 -- 172.21.15.132:0/1184955611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 msgr2=0x55ce55035df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 --2- 172.21.15.132:0/1184955611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55035df0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f11bc002230 tx=0x7f11bc05b000 comp rx=0 tx=0).stop 2023-11-18T20:39:14.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 -- 172.21.15.132:0/1184955611 shutdown_connections 2023-11-18T20:39:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 --2- 172.21.15.132:0/1184955611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce55078280 0x55ce5505ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 --2- 172.21.15.132:0/1184955611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce5505a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 --2- 172.21.15.132:0/1184955611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce5503b7c0 0x55ce55035df0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 -- 172.21.15.132:0/1184955611 >> 172.21.15.132:0/1184955611 conn(0x55ce54ffbbb0 msgr2=0x55ce5507c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 -- 172.21.15.132:0/1184955611 shutdown_connections 2023-11-18T20:39:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.437+0000 7f11d5068740 1 -- 172.21.15.132:0/1184955611 wait complete. 2023-11-18T20:39:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.438+0000 7f11d5068740 1 -- start start 2023-11-18T20:39:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.438+0000 7f11d5068740 1 Processor -- start 2023-11-18T20:39:14.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d5068740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce5503b7c0 0x55ce550ed080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d5068740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce550af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d5068740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce5505abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d5068740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce550af9f0 con 0x55ce55078280 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d5068740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce55071a90 con 0x55ce5503b7c0 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d5068740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce55086aa0 con 0x55ce55074a70 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d5068740 10 client.0 _ll_register_callbacks cb 0x7f11bc053b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d0a6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce5505abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d0a6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce5505abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56048/0 (socket says 172.21.15.132:56048) 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d0a6c640 1 -- 172.21.15.132:0/984494238 learned_addr learned my addr 172.21.15.132:0/984494238 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11cbfff640 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce5503b7c0 0x55ce550ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d0a6c640 1 -- 172.21.15.132:0/984494238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 msgr2=0x55ce550af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d0a6c640 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce550af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d0a6c640 1 -- 172.21.15.132:0/984494238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce5503b7c0 msgr2=0x55ce550ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d0a6c640 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce5503b7c0 0x55ce550ed080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.439+0000 7f11d0a6c640 1 -- 172.21.15.132:0/984494238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce54f9f140 con 0x55ce55078280 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.440+0000 7f11d0a6c640 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce5505abc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f11c400ae80 tx=0x7f11c4004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804f4db12bb05752 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.440+0000 7f11aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.440+0000 7f11aaffd640 1 -- 172.21.15.132:0/984494238 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4003610 con 0x55ce55078280 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.440+0000 7f11aaffd640 1 -- 172.21.15.132:0/984494238 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11c4003770 con 0x55ce55078280 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.440+0000 7f11d5068740 1 -- 172.21.15.132:0/984494238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce5503acd0 con 0x55ce55078280 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.440+0000 7f11aaffd640 1 -- 172.21.15.132:0/984494238 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11c4003930 con 0x55ce55078280 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.440+0000 7f11d5068740 10 client.5199 fetch_fsmap learned FSMap version 15 2023-11-18T20:39:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.440+0000 7f11d5068740 1 -- 172.21.15.132:0/984494238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55ce54f62170 con 0x55ce55078280 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11aaffd640 1 -- 172.21.15.132:0/984494238 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce5503acd0 con 0x55ce55078280 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11aaffd640 1 -- 172.21.15.132:0/984494238 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f11c4017020 con 0x55ce55078280 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11d5068740 10 client.5199 fetch_fsmap finished waiting for FSMap version 15 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11d5068740 10 client.5199 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11d5068740 20 client.5199 populate_metadata read hostname 'smithi132' 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11d5068740 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] conn(0x55ce550d28f0 0x55ce550e9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11d5068740 4 client.5199 mds_command: new command op to 4977 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11d5068740 1 -- 172.21.15.132:0/984494238 --> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f11c400cd80 con 0x55ce550d28f0 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11cbfff640 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] conn(0x55ce550d28f0 0x55ce550e9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11cbfff640 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] conn(0x55ce550d28f0 0x55ce550e9690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e02d57da0129774 server_cookie=65ab1a957211e03f in_seq=0 out_seq=0 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.441+0000 7f11aaffd640 10 client.5199 ms_handle_connect on v2:172.21.15.132:6832/4266315561 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11aaffd640 1 -- 172.21.15.132:0/984494238 <== mds.0 v2:172.21.15.132:6832/4266315561 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f11c400cd80 con 0x55ce550d28f0 2023-11-18T20:39:14.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11aaffd640 10 client.5199 handle_command_reply: tid=0 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 client.5199 shutdown 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 -- 172.21.15.132:0/984494238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 msgr2=0x55ce5505abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce5505abc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f11c400ae80 tx=0x7f11c4004260 comp rx=0 tx=0).stop 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 -- 172.21.15.132:0/984494238 shutdown_connections 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.132:6832/4266315561,v1:172.21.15.132:6834/4266315561] conn(0x55ce550d28f0 0x55ce550e9690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ce55078280 0x55ce5505abc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce55074a70 0x55ce550af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11aaffd640 0 client.5199 ms_handle_reset on v2:172.21.15.132:6832/4266315561 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 --2- 172.21.15.132:0/984494238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce5503b7c0 0x55ce550ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 -- 172.21.15.132:0/984494238 >> 172.21.15.132:0/984494238 conn(0x55ce54ffbbb0 msgr2=0x55ce5507b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:14.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 -- 172.21.15.132:0/984494238 shutdown_connections 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 1 -- 172.21.15.132:0/984494238 wait complete. 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.442+0000 7f11d5068740 20 client.5199 trim_cache size 0 max 16384 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "95273225-bfbe-4b9a-893d-dfaf6292d673", 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4977, 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-11-18T20:39:14.448 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-11-18T20:39:14.449 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 11.700236476000001, 2023-11-18T20:39:14.449 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 15, 2023-11-18T20:39:14.449 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 35, 2023-11-18T20:39:14.449 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 35, 2023-11-18T20:39:14.449 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 20.593568767000001 2023-11-18T20:39:14.449 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 -- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f11ac06ae40 msgr2=0x7f11ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f11ac06ae40 0x7f11ac06d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f11b4036000 tx=0x7f11b4030000 comp rx=0 tx=0).stop 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 -- 172.21.15.132:0/4207878582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc06bec0 msgr2=0x7f11cc0a5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc06bec0 0x7f11cc0a5c60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00c7c0 tx=0x7f11bc00cc80 comp rx=0 tx=0).stop 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 -- 172.21.15.132:0/4207878582 shutdown_connections 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f11ac06ae40 0x7f11ac06d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11cc14e170 0x7f11cc145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11cc0a4eb0 0x7f11cc1452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 --2- 172.21.15.132:0/4207878582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11cc06bec0 0x7f11cc0a5c60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 -- 172.21.15.132:0/4207878582 >> 172.21.15.132:0/4207878582 conn(0x7f11cc0a77f0 msgr2=0x7f11cc0c4710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:14.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 -- 172.21.15.132:0/4207878582 shutdown_connections 2023-11-18T20:39:14.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.443+0000 7f11d126d640 1 -- 172.21.15.132:0/4207878582 wait complete. 2023-11-18T20:39:14.462 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:39:14.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.668+0000 7effcdc34640 1 Processor -- start 2023-11-18T20:39:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.668+0000 7effcdc34640 1 -- start start 2023-11-18T20:39:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.670+0000 7effcdc34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc8152f20 0x7effc80c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.670+0000 7effcdc34640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc80c64a0 con 0x7effc814fd30 2023-11-18T20:39:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.670+0000 7effcdc34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc80c5c00 con 0x7effc806d0a0 2023-11-18T20:39:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.670+0000 7effcdc34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80c5ee0 con 0x7effc8152f20 2023-11-18T20:39:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.670+0000 7effc77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7effc814fd30 0x7effc80a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43862/0 (socket says 172.21.15.132:43862) 2023-11-18T20:39:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.670+0000 7effc77fe640 1 -- 172.21.15.132:0/2614455974 learned_addr learned my addr 172.21.15.132:0/2614455974 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc7fff640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc8152f20 0x7effc80c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104041628 0 0) 0x7effc80c64a0 con 0x7effc814fd30 2023-11-18T20:39:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb4003520 con 0x7effc814fd30 2023-11-18T20:39:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591079253 0 0) 0x7effb4003520 con 0x7effc814fd30 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc8152f20 msgr2=0x7effc80c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc8152f20 0x7effc80c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 >> v1:172.21.15.161:6789/0 conn(0x7effc806d0a0 legacy=0x7effc80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80c61c0 con 0x7effc814fd30 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7effb8001670 con 0x7effc814fd30 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 >> v1:172.21.15.132:6789/0 conn(0x7effc814fd30 legacy=0x7effc80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb40039a0 0x7effb4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb4004350 0x7effb4004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc8152f20 0x7effb4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80c5ee0 con 0x7effb40039a0 2023-11-18T20:39:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb400b9b0 con 0x7effb4004350 2023-11-18T20:39:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.671+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb400bb70 con 0x7effc8152f20 2023-11-18T20:39:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.672+0000 7effc77fe640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb40039a0 0x7effb4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.672+0000 7effc77fe640 1 -- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc8152f20 msgr2=0x7effb4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.672+0000 7effc77fe640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc8152f20 0x7effb4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.672+0000 7effc77fe640 1 -- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb4004350 msgr2=0x7effb4004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.672+0000 7effc77fe640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb4004350 0x7effb4004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.672+0000 7effc77fe640 1 -- 172.21.15.132:0/2614455974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4003520 con 0x7effb40039a0 2023-11-18T20:39:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.673+0000 7effc77fe640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb40039a0 0x7effb4003d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7effb800c190 tx=0x7effb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b74456bcf3aff4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.673+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8005ad0 con 0x7effb40039a0 2023-11-18T20:39:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.673+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8005c50 con 0x7effb40039a0 2023-11-18T20:39:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.673+0000 7effc6ffd640 1 -- 172.21.15.132:0/2614455974 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb802c850 con 0x7effb40039a0 2023-11-18T20:39:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.674+0000 7effcdc34640 1 -- 172.21.15.132:0/2614455974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb40039a0 msgr2=0x7effb4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.674+0000 7effcdc34640 1 --2- 172.21.15.132:0/2614455974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb40039a0 0x7effb4003d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7effb800c190 tx=0x7effb40057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.674+0000 7effc7fff640 1 -- 172.21.15.132:0/2614455974 reap_dead start 2023-11-18T20:39:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.674+0000 7effcdc34640 1 -- 172.21.15.132:0/2614455974 shutdown_connections 2023-11-18T20:39:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.674+0000 7effcdc34640 1 -- 172.21.15.132:0/2614455974 >> 172.21.15.132:0/2614455974 conn(0x7effc806a500 msgr2=0x7effc806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.674+0000 7effcdc34640 1 -- 172.21.15.132:0/2614455974 shutdown_connections 2023-11-18T20:39:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.674+0000 7effcdc34640 1 -- 172.21.15.132:0/2614455974 wait complete. 2023-11-18T20:39:14.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.676+0000 7effcdc34640 1 Processor -- start 2023-11-18T20:39:14.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.676+0000 7effcdc34640 1 -- start start 2023-11-18T20:39:14.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effcdc34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb40039a0 0x7effc80bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effcdc34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc81dbad0 0x7effc814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effcdc34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc814f220 0x7effc81ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effcdc34640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc81e98c0 con 0x7effc814f220 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effcdc34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80bfdc0 con 0x7effc81dbad0 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effcdc34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc81e9b80 con 0x7effb40039a0 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effc7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc814f220 0x7effc81ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effc7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc814f220 0x7effc81ed070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56068/0 (socket says 172.21.15.132:56068) 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effc7fff640 1 -- 172.21.15.132:0/92226250 learned_addr learned my addr 172.21.15.132:0/92226250 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effc7fff640 1 -- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb40039a0 msgr2=0x7effc80bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effc7fff640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb40039a0 0x7effc80bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effc7fff640 1 -- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc81dbad0 msgr2=0x7effc814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effc7fff640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc81dbad0 0x7effc814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.677+0000 7effc7fff640 1 -- 172.21.15.132:0/92226250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc81e9e60 con 0x7effc814f220 2023-11-18T20:39:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.678+0000 7effc7fff640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc814f220 0x7effc81ed070 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7effc8153300 tx=0x7effc000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.678+0000 7effc4ff9640 1 -- 172.21.15.132:0/92226250 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0010040 con 0x7effc814f220 2023-11-18T20:39:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.678+0000 7effc4ff9640 1 -- 172.21.15.132:0/92226250 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000bae0 con 0x7effc814f220 2023-11-18T20:39:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.678+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc81ea140 con 0x7effc814f220 2023-11-18T20:39:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.678+0000 7effc4ff9640 1 -- 172.21.15.132:0/92226250 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000be70 con 0x7effc814f220 2023-11-18T20:39:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.678+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc81ea700 con 0x7effc814f220 2023-11-18T20:39:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.679+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc8068350 con 0x7effc814f220 2023-11-18T20:39:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.680+0000 7effc4ff9640 1 -- 172.21.15.132:0/92226250 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effc001d400 con 0x7effc814f220 2023-11-18T20:39:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.681+0000 7effc4ff9640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effa806ae40 0x7effa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.681+0000 7effc4ff9640 1 -- 172.21.15.132:0/92226250 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effc0089c80 con 0x7effc814f220 2023-11-18T20:39:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.682+0000 7effc77fe640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effa806ae40 0x7effa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.683+0000 7effc77fe640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effa806ae40 0x7effa806d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7effb8034000 tx=0x7effb8007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:14.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.685+0000 7effc4ff9640 1 -- 172.21.15.132:0/92226250 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effc00587b0 con 0x7effc814f220 2023-11-18T20:39:14.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.912+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7effc80c66d0 con 0x7effc814f220 2023-11-18T20:39:14.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.913+0000 7effc4ff9640 1 -- 172.21.15.132:0/92226250 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7effc0018070 con 0x7effc814f220 2023-11-18T20:39:14.914 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:39:14.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.915+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effa806ae40 msgr2=0x7effa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.915+0000 7effcdc34640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effa806ae40 0x7effa806d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7effb8034000 tx=0x7effb8007000 comp rx=0 tx=0).stop 2023-11-18T20:39:14.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.915+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc814f220 msgr2=0x7effc81ed070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:14.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.915+0000 7effcdc34640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc814f220 0x7effc81ed070 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7effc8153300 tx=0x7effc000b480 comp rx=0 tx=0).stop 2023-11-18T20:39:14.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.916+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 shutdown_connections 2023-11-18T20:39:14.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.916+0000 7effcdc34640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effa806ae40 0x7effa806d300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.916+0000 7effcdc34640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc814f220 0x7effc81ed070 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.916+0000 7effcdc34640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc81dbad0 0x7effc814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.916+0000 7effcdc34640 1 --2- 172.21.15.132:0/92226250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb40039a0 0x7effc80bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:14.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.916+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 >> 172.21.15.132:0/92226250 conn(0x7effc806a500 msgr2=0x7effc80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:14.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.916+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 shutdown_connections 2023-11-18T20:39:14.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:14.916+0000 7effcdc34640 1 -- 172.21.15.132:0/92226250 wait complete. 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:39:14.935 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:39:14.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:14.936 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:14.987 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42356sec preferred_lft 42356sec 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:14.988 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::84fc:84ff:fe41:e5e7/64 scope link 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a88f:ebff:fe95:c612/64 scope link 2023-11-18T20:39:14.989 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:14.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:14.990 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:39:15.074 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-18T20:39:15.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:15.081 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-18T20:39:15.134 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-18T20:39:15.134 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:39:15.135 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:39:15.135 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:39:15.135 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:39:15.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:15.135 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:39:15.135 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:39:15.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:39:15.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:39:15.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:39:15.136 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:39:15.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:15.313 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:39:15.365 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T20:39:15.366 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:39:15.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:15.366 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-18T20:39:15.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:39:15.461 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T20:39:15.517 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:39:15.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:39:15.517 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:39:15.568 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:39:15.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:15.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:39:15.711 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:39:15.712 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:39:15.712 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:39:15.735 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:39:15.735 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:39:15.735 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:39:15.735 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:39:15.735 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:39:15.763 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:39:15.763 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:39:15.763 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:39:15.763 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:39:15.763 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:39:15.763 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:39:15.764 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:39:15.764 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:39:15.765 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-18T20:39:15.765 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:39:15.765 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:39:15.765 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:39:15.765 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:39:15.768 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:39:15.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:15.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:39:15.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:15.857 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:39:15.919 INFO:teuthology.orchestra.run.smithi132.stdout:client4780 2023-11-18T20:39:15.920 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:39:15.920 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:15.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:39:16.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.186+0000 7f3f6e3a9640 1 Processor -- start 2023-11-18T20:39:16.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.186+0000 7f3f6e3a9640 1 -- start start 2023-11-18T20:39:16.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.187+0000 7f3f6e3a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f68155490 0x7f3f680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f6e3a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3f680c1500 0x7f3f680a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f6e3a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680c06c0 con 0x7f3f680c4080 2023-11-18T20:39:16.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f6e3a9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680a5820 con 0x7f3f680c1500 2023-11-18T20:39:16.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f6e3a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680c1020 con 0x7f3f68155490 2023-11-18T20:39:16.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f6c946640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3f680c4080 0x7f3f680c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43868/0 (socket says 172.21.15.132:43868) 2023-11-18T20:39:16.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f6c946640 1 -- 172.21.15.132:0/437446454 learned_addr learned my addr 172.21.15.132:0/437446454 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f5ffff640 1 --2- 172.21.15.132:0/437446454 >> v2:172.21.15.161:3300/0 conn(0x7f3f680c1500 0x7f3f680a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154790324 0 0) 0x7f3f680c06c0 con 0x7f3f680c4080 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f54005730 con 0x7f3f680c4080 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.188+0000 7f3f67fff640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f68155490 0x7f3f680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694785153 0 0) 0x7f3f54005730 con 0x7f3f680c4080 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f68155490 msgr2=0x7f3f680a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f68155490 0x7f3f680a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 >> v2:172.21.15.161:3300/0 conn(0x7f3f680c1500 msgr2=0x7f3f680a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 --2- 172.21.15.132:0/437446454 >> v2:172.21.15.161:3300/0 conn(0x7f3f680c1500 0x7f3f680a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680c0910 con 0x7f3f680c4080 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f3f600019f0 con 0x7f3f680c4080 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 >> v1:172.21.15.132:6789/0 conn(0x7f3f680c4080 legacy=0x7f3f680c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f54005b80 0x7f3f54005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f68155490 0x7f3f540069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54006f10 0x7f3f54007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680c1020 con 0x7f3f54005b80 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5400db90 con 0x7f3f54006f10 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5400dcd0 con 0x7f3f68155490 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.189+0000 7f3f67fff640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f54005b80 0x7f3f54005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.190+0000 7f3f67fff640 1 -- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f68155490 msgr2=0x7f3f540069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.190+0000 7f3f67fff640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f68155490 0x7f3f540069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.190+0000 7f3f67fff640 1 -- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54006f10 msgr2=0x7f3f54007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.190+0000 7f3f67fff640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54006f10 0x7f3f54007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.190+0000 7f3f67fff640 1 -- 172.21.15.132:0/437446454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54005730 con 0x7f3f54005b80 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.191+0000 7f3f67fff640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f54005b80 0x7f3f54005fa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009ac0 tx=0x7f3f54007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e7833305125d21 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.191+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5802c710 con 0x7f3f54005b80 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.191+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5802c870 con 0x7f3f54005b80 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.191+0000 7f3f677fe640 1 -- 172.21.15.132:0/437446454 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5802cc00 con 0x7f3f54005b80 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.191+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/437446454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f54005b80 msgr2=0x7f3f54005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.191+0000 7f3f6e3a9640 1 --2- 172.21.15.132:0/437446454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f54005b80 0x7f3f54005fa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009ac0 tx=0x7f3f54007a00 comp rx=0 tx=0).stop 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.191+0000 7f3f6c946640 1 -- 172.21.15.132:0/437446454 reap_dead start 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.192+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/437446454 shutdown_connections 2023-11-18T20:39:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.192+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/437446454 >> 172.21.15.132:0/437446454 conn(0x7f3f6806a500 msgr2=0x7f3f6806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.192+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/437446454 shutdown_connections 2023-11-18T20:39:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.192+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/437446454 wait complete. 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.193+0000 7f3f6e3a9640 1 Processor -- start 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.193+0000 7f3f6e3a9640 1 -- start start 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.194+0000 7f3f6e3a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54005b80 0x7f3f6814a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.194+0000 7f3f6e3a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f6814f310 0x7f3f681ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.194+0000 7f3f6e3a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f681ed700 0x7f3f681eae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.194+0000 7f3f6e3a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68149bd0 con 0x7f3f6814f310 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.194+0000 7f3f6e3a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6814b520 con 0x7f3f54005b80 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.194+0000 7f3f6e3a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f681ede90 con 0x7f3f681ed700 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f6814f310 0x7f3f681ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f6814f310 0x7f3f681ed1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56086/0 (socket says 172.21.15.132:56086) 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 -- 172.21.15.132:0/37144776 learned_addr learned my addr 172.21.15.132:0/37144776 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f67fff640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54005b80 0x7f3f6814a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f6c946640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f681ed700 0x7f3f681eae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 -- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f681ed700 msgr2=0x7f3f681eae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f681ed700 0x7f3f681eae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 -- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54005b80 msgr2=0x7f3f6814a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54005b80 0x7f3f6814a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 -- 172.21.15.132:0/37144776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f68149db0 con 0x7f3f6814f310 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f67fff640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54005b80 0x7f3f6814a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f6c946640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f681ed700 0x7f3f681eae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.195+0000 7f3f5ffff640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f6814f310 0x7f3f681ed1c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000e890 tx=0x7f3f5000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.196+0000 7f3f657fa640 1 -- 172.21.15.132:0/37144776 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000c940 con 0x7f3f6814f310 2023-11-18T20:39:16.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.196+0000 7f3f657fa640 1 -- 172.21.15.132:0/37144776 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000cac0 con 0x7f3f6814f310 2023-11-18T20:39:16.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.196+0000 7f3f657fa640 1 -- 172.21.15.132:0/37144776 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000ce70 con 0x7f3f6814f310 2023-11-18T20:39:16.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.196+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f681edbb0 con 0x7f3f6814f310 2023-11-18T20:39:16.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.196+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6814b9b0 con 0x7f3f6814f310 2023-11-18T20:39:16.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.197+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6814b6d0 con 0x7f3f6814f310 2023-11-18T20:39:16.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.198+0000 7f3f657fa640 1 -- 172.21.15.132:0/37144776 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f50013470 con 0x7f3f6814f310 2023-11-18T20:39:16.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.199+0000 7f3f657fa640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f4806ae40 0x7f3f4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:16.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.199+0000 7f3f657fa640 1 -- 172.21.15.132:0/37144776 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f500896e0 con 0x7f3f6814f310 2023-11-18T20:39:16.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.199+0000 7f3f67fff640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f4806ae40 0x7f3f4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:16.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.201+0000 7f3f67fff640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f4806ae40 0x7f3f4806d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f58036000 tx=0x7f3f58030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:16.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.203+0000 7f3f657fa640 1 -- 172.21.15.132:0/37144776 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3f6814b6d0 con 0x7f3f6814f310 2023-11-18T20:39:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.429+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f6814b6d0 con 0x7f3f6814f310 2023-11-18T20:39:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.430+0000 7f3f657fa640 1 -- 172.21.15.132:0/37144776 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f6814b6d0 con 0x7f3f6814f310 2023-11-18T20:39:16.432 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f4806ae40 msgr2=0x7f3f4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f4806ae40 0x7f3f4806d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f58036000 tx=0x7f3f58030000 comp rx=0 tx=0).stop 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f6814f310 msgr2=0x7f3f681ed1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f6814f310 0x7f3f681ed1c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000e890 tx=0x7f3f5000ed50 comp rx=0 tx=0).stop 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 shutdown_connections 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f4806ae40 0x7f3f4806d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f681ed700 0x7f3f681eae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f6814f310 0x7f3f681ed1c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 --2- 172.21.15.132:0/37144776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54005b80 0x7f3f6814a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:16.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.433+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 >> 172.21.15.132:0/37144776 conn(0x7f3f6806a500 msgr2=0x7f3f680c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:16.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.434+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 shutdown_connections 2023-11-18T20:39:16.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:16.434+0000 7f3f6e3a9640 1 -- 172.21.15.132:0/37144776 wait complete. 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:39:16.456 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:39:16.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:16.457 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-18T20:39:16.518 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:39:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:39:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:39:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-18T20:39:16.518 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:39:16.519 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42353sec preferred_lft 42353sec 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::78f3:28ff:fe93:897/64 scope link 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::442e:5aff:fe28:3e67/64 scope link 2023-11-18T20:39:16.520 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:16.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:16.522 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:39:16.615 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:39:16.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:16.619 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-18T20:39:16.671 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-18T20:39:16.671 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:39:16.671 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:39:16.672 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:39:16.672 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:39:16.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:16.672 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:39:16.672 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:39:16.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:39:16.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:39:16.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:39:16.672 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:39:16.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:16.847 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:39:16.899 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T20:39:16.900 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:39:16.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:16.900 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-18T20:39:16.995 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:39:16.995 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:17.048 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:39:17.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:39:17.049 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:17.100 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:39:17.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:17.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:39:17.236 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:39:17.236 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:39:17.237 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:39:17.259 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:39:17.259 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:39:17.259 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:39:17.259 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:39:17.260 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:39:17.286 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:39:17.286 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:39:17.286 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:39:17.286 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:39:17.286 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:39:17.286 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:39:17.287 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:39:17.287 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:39:17.289 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T20:39:17.289 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:39:17.289 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:39:17.289 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:39:17.289 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:39:17.293 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:39:17.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:17.293 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:17.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:17.380 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:39:17.435 INFO:teuthology.orchestra.run.smithi161.stdout:client5214 2023-11-18T20:39:17.435 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:39:17.435 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:17.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-18T20:39:17.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.707+0000 7f2059fbd640 1 Processor -- start 2023-11-18T20:39:17.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.707+0000 7f2059fbd640 1 -- start start 2023-11-18T20:39:17.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.708+0000 7f2059fbd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f205414c2e0 0x7f20540c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.708+0000 7f2059fbd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 0x7f20540a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f2059fbd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2054071e80 con 0x7f20540c0440 2023-11-18T20:39:17.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f2059fbd640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2054071470 con 0x7f205414c2e0 2023-11-18T20:39:17.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f2059fbd640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205414c6c0 con 0x7f2054072310 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f2053fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f20540c0440 0x7f2054152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43876/0 (socket says 172.21.15.132:43876) 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f2053fff640 1 -- 172.21.15.132:0/841185236 learned_addr learned my addr 172.21.15.132:0/841185236 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f2058fbb640 1 --2- 172.21.15.132:0/841185236 >> v2:172.21.15.161:3300/0 conn(0x7f205414c2e0 0x7f20540c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f20597bc640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 0x7f20540a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645445638 0 0) 0x7f2054071e80 con 0x7f20540c0440 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.709+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f203c003520 con 0x7f20540c0440 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3345221553 0 0) 0x7f203c003520 con 0x7f20540c0440 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 msgr2=0x7f20540a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 0x7f20540a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 >> v2:172.21.15.161:3300/0 conn(0x7f205414c2e0 msgr2=0x7f20540c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 --2- 172.21.15.132:0/841185236 >> v2:172.21.15.161:3300/0 conn(0x7f205414c2e0 0x7f20540c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205406fdc0 con 0x7f20540c0440 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f2044001670 con 0x7f20540c0440 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 >> v1:172.21.15.132:6789/0 conn(0x7f20540c0440 legacy=0x7f2054152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f203c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 0x7f203c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c004d00 0x7f203c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205414c6c0 con 0x7f203c003970 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c00b980 con 0x7f203c004d00 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c00bb40 con 0x7f2054072310 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.710+0000 7f2058fbb640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f203c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:17.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.711+0000 7f2053fff640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 0x7f203c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:17.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.711+0000 7f2058fbb640 1 -- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 msgr2=0x7f203c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:17.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.711+0000 7f2058fbb640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 0x7f203c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.711+0000 7f2058fbb640 1 -- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c004d00 msgr2=0x7f203c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:17.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.711+0000 7f2058fbb640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c004d00 0x7f203c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.711+0000 7f2058fbb640 1 -- 172.21.15.132:0/841185236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c003520 con 0x7f203c003970 2023-11-18T20:39:17.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.711+0000 7f2053fff640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2054072310 0x7f203c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:17.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.712+0000 7f2058fbb640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f203c003d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2048009ac0 tx=0x7f203c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c303e3075c682bd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:17.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.712+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204802c710 con 0x7f203c003970 2023-11-18T20:39:17.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.712+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204802c870 con 0x7f203c003970 2023-11-18T20:39:17.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.712+0000 7f20537fe640 1 -- 172.21.15.132:0/841185236 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204802cc00 con 0x7f203c003970 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.713+0000 7f2059fbd640 1 -- 172.21.15.132:0/841185236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 msgr2=0x7f203c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.713+0000 7f2059fbd640 1 --2- 172.21.15.132:0/841185236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f203c003d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2048009ac0 tx=0x7f203c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.713+0000 7f20597bc640 1 -- 172.21.15.132:0/841185236 reap_dead start 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.713+0000 7f2059fbd640 1 -- 172.21.15.132:0/841185236 shutdown_connections 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.713+0000 7f2059fbd640 1 -- 172.21.15.132:0/841185236 >> 172.21.15.132:0/841185236 conn(0x7f20540a77f0 msgr2=0x7f20540a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.713+0000 7f2059fbd640 1 -- 172.21.15.132:0/841185236 shutdown_connections 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.713+0000 7f2059fbd640 1 -- 172.21.15.132:0/841185236 wait complete. 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.714+0000 7f2059fbd640 1 Processor -- start 2023-11-18T20:39:17.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.715+0000 7f2059fbd640 1 -- start start 2023-11-18T20:39:17.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.715+0000 7f2059fbd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f20540aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.715+0000 7f2059fbd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20541e8330 0x7f20540bc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.715+0000 7f2059fbd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20541e4c90 0x7f20541e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.715+0000 7f2059fbd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540bea70 con 0x7f203c003970 2023-11-18T20:39:17.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.715+0000 7f2059fbd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540a8750 con 0x7f20541e8330 2023-11-18T20:39:17.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.715+0000 7f2059fbd640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20541e87b0 con 0x7f20541e4c90 2023-11-18T20:39:17.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.716+0000 7f2058fbb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f20540aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.716+0000 7f2058fbb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f20540aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56106/0 (socket says 172.21.15.132:56106) 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.716+0000 7f2058fbb640 1 -- 172.21.15.132:0/1636971863 learned_addr learned my addr 172.21.15.132:0/1636971863 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.716+0000 7f2058fbb640 1 -- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20541e4c90 msgr2=0x7f20541e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.716+0000 7f2058fbb640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20541e4c90 0x7f20541e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.716+0000 7f2058fbb640 1 -- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20541e8330 msgr2=0x7f20540bc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.716+0000 7f2058fbb640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20541e8330 0x7f20540bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.716+0000 7f2058fbb640 1 -- 172.21.15.132:0/1636971863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540be3d0 con 0x7f203c003970 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.717+0000 7f2058fbb640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f20540aaf90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f204802c2b0 tx=0x7f2048004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.717+0000 7f20517fa640 1 -- 172.21.15.132:0/1636971863 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048003810 con 0x7f203c003970 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.717+0000 7f20517fa640 1 -- 172.21.15.132:0/1636971863 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204802de90 con 0x7f203c003970 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.717+0000 7f20517fa640 1 -- 172.21.15.132:0/1636971863 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048003b70 con 0x7f203c003970 2023-11-18T20:39:17.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.717+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20540ab570 con 0x7f203c003970 2023-11-18T20:39:17.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.717+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540be690 con 0x7f203c003970 2023-11-18T20:39:17.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.718+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205414be30 con 0x7f203c003970 2023-11-18T20:39:17.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.719+0000 7f20517fa640 1 -- 172.21.15.132:0/1636971863 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2048003cd0 con 0x7f203c003970 2023-11-18T20:39:17.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.720+0000 7f20517fa640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f204006ae70 0x7f204006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:17.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.720+0000 7f20517fa640 1 -- 172.21.15.132:0/1636971863 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20480ab6b0 con 0x7f203c003970 2023-11-18T20:39:17.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.721+0000 7f2053fff640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f204006ae70 0x7f204006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:17.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.722+0000 7f2053fff640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f204006ae70 0x7f204006d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f20540a4e30 tx=0x7f2044009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.725+0000 7f20517fa640 1 -- 172.21.15.132:0/1636971863 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2048076870 con 0x7f203c003970 2023-11-18T20:39:17.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.983+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f205404e840 con 0x7f203c003970 2023-11-18T20:39:17.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.984+0000 7f20517fa640 1 -- 172.21.15.132:0/1636971863 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7f2048079e90 con 0x7f203c003970 2023-11-18T20:39:17.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f204006ae70 msgr2=0x7f204006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:17.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f204006ae70 0x7f204006d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f20540a4e30 tx=0x7f2044009040 comp rx=0 tx=0).stop 2023-11-18T20:39:17.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 msgr2=0x7f20540aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:17.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f20540aaf90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f204802c2b0 tx=0x7f2048004730 comp rx=0 tx=0).stop 2023-11-18T20:39:17.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 shutdown_connections 2023-11-18T20:39:17.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f204006ae70 0x7f204006d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20541e4c90 0x7f20541e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20541e8330 0x7f20540bc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 --2- 172.21.15.132:0/1636971863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f203c003970 0x7f20540aaf90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:17.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 >> 172.21.15.132:0/1636971863 conn(0x7f20540a77f0 msgr2=0x7f2054149640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:17.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 shutdown_connections 2023-11-18T20:39:17.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:17.986+0000 7f2059fbd640 1 -- 172.21.15.132:0/1636971863 wait complete. 2023-11-18T20:39:18.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:18.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.216+0000 7f291d613640 1 Processor -- start 2023-11-18T20:39:18.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.216+0000 7f291d613640 1 -- start start 2023-11-18T20:39:18.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.217+0000 7f291d613640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f291814e170 0x7f2918154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.217+0000 7f291d613640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29180c1d30 con 0x7f29180a4eb0 2023-11-18T20:39:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.217+0000 7f291d613640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291806c330 con 0x7f291806bec0 2023-11-18T20:39:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.217+0000 7f291d613640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29181519e0 con 0x7f291814e170 2023-11-18T20:39:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.217+0000 7f29177fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f29180a4eb0 0x7f29181512d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43878/0 (socket says 172.21.15.132:43878) 2023-11-18T20:39:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.217+0000 7f2917fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f291814e170 0x7f2918154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.217+0000 7f29177fe640 1 -- 172.21.15.132:0/964573715 learned_addr learned my addr 172.21.15.132:0/964573715 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:18.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.218+0000 7f2917fff640 1 -- 172.21.15.132:0/964573715 >> v1:172.21.15.161:6789/0 conn(0x7f291806bec0 legacy=0x7f29180c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:18.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.218+0000 7f2917fff640 1 -- 172.21.15.132:0/964573715 >> v1:172.21.15.132:6789/0 conn(0x7f29180a4eb0 legacy=0x7f29181512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.218+0000 7f2917fff640 1 -- 172.21.15.132:0/964573715 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180c51f0 con 0x7f291814e170 2023-11-18T20:39:18.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.218+0000 7f2916ffd640 1 -- 172.21.15.132:0/964573715 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163980607 0 0) 0x7f29180c1d30 con 0x7f29180a4eb0 2023-11-18T20:39:18.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.219+0000 7f2917fff640 1 --2- 172.21.15.132:0/964573715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f291814e170 0x7f2918154910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f29080097a0 tx=0x7f290802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c391a44a8f2ef621 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:18.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.219+0000 7f2916ffd640 1 -- 172.21.15.132:0/964573715 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290802e070 con 0x7f291814e170 2023-11-18T20:39:18.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.219+0000 7f2916ffd640 1 -- 172.21.15.132:0/964573715 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29080315a0 con 0x7f291814e170 2023-11-18T20:39:18.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.219+0000 7f2916ffd640 1 -- 172.21.15.132:0/964573715 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908031930 con 0x7f291814e170 2023-11-18T20:39:18.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.220+0000 7f291d613640 1 -- 172.21.15.132:0/964573715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f291814e170 msgr2=0x7f2918154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.220+0000 7f291d613640 1 --2- 172.21.15.132:0/964573715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f291814e170 0x7f2918154910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f29080097a0 tx=0x7f290802b840 comp rx=0 tx=0).stop 2023-11-18T20:39:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.220+0000 7f291d613640 1 -- 172.21.15.132:0/964573715 shutdown_connections 2023-11-18T20:39:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.220+0000 7f291d613640 1 --2- 172.21.15.132:0/964573715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f291814e170 0x7f2918154910 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.220+0000 7f291d613640 1 -- 172.21.15.132:0/964573715 >> 172.21.15.132:0/964573715 conn(0x7f29180a77f0 msgr2=0x7f29180a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.220+0000 7f291d613640 1 -- 172.21.15.132:0/964573715 shutdown_connections 2023-11-18T20:39:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.220+0000 7f291d613640 1 -- 172.21.15.132:0/964573715 wait complete. 2023-11-18T20:39:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.222+0000 7f291d613640 1 Processor -- start 2023-11-18T20:39:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.222+0000 7f291d613640 1 -- start start 2023-11-18T20:39:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f291d613640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f291806bec0 0x7f291814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f291d613640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29180a4eb0 0x7f2918152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f291d613640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f291814e170 0x7f2918144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f291d613640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29181449d0 con 0x7f29180a4eb0 2023-11-18T20:39:18.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f291d613640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291813bd30 con 0x7f291814e170 2023-11-18T20:39:18.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f291d613640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2918145ce0 con 0x7f291806bec0 2023-11-18T20:39:18.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f29177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29180a4eb0 0x7f2918152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f29177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29180a4eb0 0x7f2918152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56132/0 (socket says 172.21.15.132:56132) 2023-11-18T20:39:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f29177fe640 1 -- 172.21.15.132:0/1939150366 learned_addr learned my addr 172.21.15.132:0/1939150366 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f29177fe640 1 -- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f291806bec0 msgr2=0x7f291814d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f29177fe640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f291806bec0 0x7f291814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f29177fe640 1 -- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f291814e170 msgr2=0x7f2918144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f29177fe640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f291814e170 0x7f2918144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.223+0000 7f29177fe640 1 -- 172.21.15.132:0/1939150366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908009400 con 0x7f29180a4eb0 2023-11-18T20:39:18.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.224+0000 7f29177fe640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29180a4eb0 0x7f2918152d80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c4d0 tx=0x7f290c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:18.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.224+0000 7f2914ff9640 1 -- 172.21.15.132:0/1939150366 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c0074e0 con 0x7f29180a4eb0 2023-11-18T20:39:18.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.224+0000 7f2914ff9640 1 -- 172.21.15.132:0/1939150366 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c007660 con 0x7f29180a4eb0 2023-11-18T20:39:18.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.224+0000 7f2914ff9640 1 -- 172.21.15.132:0/1939150366 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c004a20 con 0x7f29180a4eb0 2023-11-18T20:39:18.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.224+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2918145fc0 con 0x7f29180a4eb0 2023-11-18T20:39:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.224+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2918153ec0 con 0x7f29180a4eb0 2023-11-18T20:39:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.225+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29180a87a0 con 0x7f29180a4eb0 2023-11-18T20:39:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.226+0000 7f2914ff9640 1 -- 172.21.15.132:0/1939150366 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f290c004b80 con 0x7f29180a4eb0 2023-11-18T20:39:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.227+0000 7f2914ff9640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f290406ae40 0x7f290406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.227+0000 7f2914ff9640 1 -- 172.21.15.132:0/1939150366 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f290c088810 con 0x7f29180a4eb0 2023-11-18T20:39:18.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.228+0000 7f2917fff640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f290406ae40 0x7f290406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.229+0000 7f2917fff640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f290406ae40 0x7f290406d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2908036000 tx=0x7f2908030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:18.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.231+0000 7f2914ff9640 1 -- 172.21.15.132:0/1939150366 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f290c0538b0 con 0x7f29180a4eb0 2023-11-18T20:39:18.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.422+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29181464e0 con 0x7f29180a4eb0 2023-11-18T20:39:18.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.423+0000 7f2914ff9640 1 -- 172.21.15.132:0/1939150366 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f29181464e0 con 0x7f29180a4eb0 2023-11-18T20:39:18.426 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:18.426 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:03.740412+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:18.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f290406ae40 msgr2=0x7f290406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f290406ae40 0x7f290406d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2908036000 tx=0x7f2908030000 comp rx=0 tx=0).stop 2023-11-18T20:39:18.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29180a4eb0 msgr2=0x7f2918152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29180a4eb0 0x7f2918152d80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c4d0 tx=0x7f290c00c990 comp rx=0 tx=0).stop 2023-11-18T20:39:18.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 shutdown_connections 2023-11-18T20:39:18.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f290406ae40 0x7f290406d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f291814e170 0x7f2918144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29180a4eb0 0x7f2918152d80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 --2- 172.21.15.132:0/1939150366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f291806bec0 0x7f291814d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 >> 172.21.15.132:0/1939150366 conn(0x7f29180a77f0 msgr2=0x7f29180a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:18.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 shutdown_connections 2023-11-18T20:39:18.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.426+0000 7f291d613640 1 -- 172.21.15.132:0/1939150366 wait complete. 2023-11-18T20:39:18.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:39:00.655880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:39:01.207461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:39:18.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:39:18.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.653+0000 7f24366bb640 1 Processor -- start 2023-11-18T20:39:18.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.653+0000 7f24366bb640 1 -- start start 2023-11-18T20:39:18.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.655+0000 7f24366bb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24300c5ec0 0x7f24300c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.655+0000 7f24366bb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24300bfdc0 con 0x7f24300c45d0 2023-11-18T20:39:18.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.655+0000 7f24366bb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243006ddd0 con 0x7f24300721a0 2023-11-18T20:39:18.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.655+0000 7f24366bb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243006e390 con 0x7f24300c5ec0 2023-11-18T20:39:18.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.655+0000 7f242f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f24300c45d0 0x7f2430155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51054/0 (socket says 172.21.15.132:51054) 2023-11-18T20:39:18.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.655+0000 7f242f7fe640 1 -- 172.21.15.132:0/2781403250 learned_addr learned my addr 172.21.15.132:0/2781403250 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:18.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.655+0000 7f242ffff640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24300c5ec0 0x7f24300c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301574138 0 0) 0x7f24300bfdc0 con 0x7f24300c45d0 2023-11-18T20:39:18.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f241c003520 con 0x7f24300c45d0 2023-11-18T20:39:18.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1489018648 0 0) 0x7f241c003520 con 0x7f24300c45d0 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24300c5ec0 msgr2=0x7f24300c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24300c5ec0 0x7f24300c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 >> v1:172.21.15.161:6789/0 conn(0x7f24300721a0 legacy=0x7f2430156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243006e0b0 con 0x7f24300c45d0 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f2418001670 con 0x7f24300c45d0 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 >> v1:172.21.15.132:6789/0 conn(0x7f24300c45d0 legacy=0x7f2430155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24300c5ec0 0x7f241c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f241c003f20 0x7f241c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f241c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243006e390 con 0x7f241c004d00 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c00bbc0 con 0x7f241c003f20 2023-11-18T20:39:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.656+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c00bd80 con 0x7f24300c5ec0 2023-11-18T20:39:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.657+0000 7f2434c58640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f241c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.657+0000 7f242ffff640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24300c5ec0 0x7f241c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.657+0000 7f2434c58640 1 -- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24300c5ec0 msgr2=0x7f241c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.657+0000 7f2434c58640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24300c5ec0 0x7f241c0039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.657+0000 7f2434c58640 1 -- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f241c003f20 msgr2=0x7f241c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.657+0000 7f2434c58640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f241c003f20 0x7f241c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.657+0000 7f2434c58640 1 -- 172.21.15.132:0/2781403250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c003520 con 0x7f241c004d00 2023-11-18T20:39:18.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.658+0000 7f2434c58640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f241c005180 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2428001750 tx=0x7f241c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e1e09c7d3e70ab server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:18.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280052d0 con 0x7f241c004d00 2023-11-18T20:39:18.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242802e050 con 0x7f241c004d00 2023-11-18T20:39:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f242effd640 1 -- 172.21.15.132:0/2781403250 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428003830 con 0x7f241c004d00 2023-11-18T20:39:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f24366bb640 1 -- 172.21.15.132:0/2781403250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 msgr2=0x7f241c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f24366bb640 1 --2- 172.21.15.132:0/2781403250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f241c005180 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2428001750 tx=0x7f241c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f2434c58640 1 -- 172.21.15.132:0/2781403250 reap_dead start 2023-11-18T20:39:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f24366bb640 1 -- 172.21.15.132:0/2781403250 shutdown_connections 2023-11-18T20:39:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f24366bb640 1 -- 172.21.15.132:0/2781403250 >> 172.21.15.132:0/2781403250 conn(0x7f243006a500 msgr2=0x7f243006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f24366bb640 1 -- 172.21.15.132:0/2781403250 shutdown_connections 2023-11-18T20:39:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.659+0000 7f24366bb640 1 -- 172.21.15.132:0/2781403250 wait complete. 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.661+0000 7f24366bb640 1 Processor -- start 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.661+0000 7f24366bb640 1 -- start start 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f24366bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f24301ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f24366bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24300a4970 0x7f243014fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f24366bb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24301528a0 0x7f2430156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f24366bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300aa560 con 0x7f241c004d00 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f24366bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24301e9950 con 0x7f24300a4970 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f24366bb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24300a4ee0 con 0x7f24301528a0 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f242ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f24301ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f242ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f24301ea3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43128/0 (socket says 172.21.15.132:43128) 2023-11-18T20:39:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.662+0000 7f242ffff640 1 -- 172.21.15.132:0/1773220157 learned_addr learned my addr 172.21.15.132:0/1773220157 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242ffff640 1 -- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24301528a0 msgr2=0x7f2430156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242ffff640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24301528a0 0x7f2430156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242f7fe640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24300a4970 0x7f243014fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242ffff640 1 -- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24300a4970 msgr2=0x7f243014fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242ffff640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24300a4970 0x7f243014fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242ffff640 1 -- 172.21.15.132:0/1773220157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24301e9bf0 con 0x7f241c004d00 2023-11-18T20:39:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242ffff640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f24301ea3f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f242000f350 tx=0x7f242000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242cff9640 1 -- 172.21.15.132:0/1773220157 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000fee0 con 0x7f241c004d00 2023-11-18T20:39:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242cff9640 1 -- 172.21.15.132:0/1773220157 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420011040 con 0x7f241c004d00 2023-11-18T20:39:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f242cff9640 1 -- 172.21.15.132:0/1773220157 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420017860 con 0x7f241c004d00 2023-11-18T20:39:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24301e9ed0 con 0x7f241c004d00 2023-11-18T20:39:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.663+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2430150000 con 0x7f241c004d00 2023-11-18T20:39:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.665+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24301ea090 con 0x7f241c004d00 2023-11-18T20:39:18.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.665+0000 7f242cff9640 1 -- 172.21.15.132:0/1773220157 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24200179c0 con 0x7f241c004d00 2023-11-18T20:39:18.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.666+0000 7f242cff9640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f241006ae40 0x7f241006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:18.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.666+0000 7f242cff9640 1 -- 172.21.15.132:0/1773220157 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2420089da0 con 0x7f241c004d00 2023-11-18T20:39:18.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.667+0000 7f242f7fe640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f241006ae40 0x7f241006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.668+0000 7f242f7fe640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f241006ae40 0x7f241006d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f24180011e0 tx=0x7f2418009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:18.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.671+0000 7f242cff9640 1 -- 172.21.15.132:0/1773220157 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2420054e70 con 0x7f241c004d00 2023-11-18T20:39:18.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.862+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2430068350 con 0x7f241c004d00 2023-11-18T20:39:18.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.863+0000 7f242cff9640 1 -- 172.21.15.132:0/1773220157 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f242001c020 con 0x7f241c004d00 2023-11-18T20:39:18.866 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:39:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f241006ae40 msgr2=0x7f241006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f241006ae40 0x7f241006d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f24180011e0 tx=0x7f2418009040 comp rx=0 tx=0).stop 2023-11-18T20:39:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 msgr2=0x7f24301ea3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f24301ea3f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f242000f350 tx=0x7f242000f810 comp rx=0 tx=0).stop 2023-11-18T20:39:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 shutdown_connections 2023-11-18T20:39:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f241006ae40 0x7f241006d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24301528a0 0x7f2430156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24300a4970 0x7f243014fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 --2- 172.21.15.132:0/1773220157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f241c004d00 0x7f24301ea3f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 >> 172.21.15.132:0/1773220157 conn(0x7f243006a500 msgr2=0x7f2430070db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 shutdown_connections 2023-11-18T20:39:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:18.865+0000 7f24366bb640 1 -- 172.21.15.132:0/1773220157 wait complete. 2023-11-18T20:39:18.884 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:39:19.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.085+0000 7f3570916640 1 Processor -- start 2023-11-18T20:39:19.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.085+0000 7f3570916640 1 -- start start 2023-11-18T20:39:19.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f3570916640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f356c14e7f0 0x7f356c0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f3570916640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f356c0c52e0 0x7f356c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f3570916640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 0x7f356c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f3570916640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c0a8380 con 0x7f356c14e7f0 2023-11-18T20:39:19.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f3570916640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c1510b0 con 0x7f356c0c52e0 2023-11-18T20:39:19.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f3570916640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c06bf60 con 0x7f356c06cd20 2023-11-18T20:39:19.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f356b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f356c14e7f0 0x7f356c0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f356b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f356c14e7f0 0x7f356c0c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43142/0 (socket says 172.21.15.132:43142) 2023-11-18T20:39:19.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f356b7fe640 1 -- 172.21.15.132:0/3865423696 learned_addr learned my addr 172.21.15.132:0/3865423696 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.088+0000 7f356b7fe640 1 -- 172.21.15.132:0/3865423696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 msgr2=0x7f356c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.088+0000 7f356b7fe640 1 --2- 172.21.15.132:0/3865423696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 0x7f356c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.087+0000 7f3563fff640 1 --2- 172.21.15.132:0/3865423696 >> v2:172.21.15.161:3300/0 conn(0x7f356c0c52e0 0x7f356c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.088+0000 7f356b7fe640 1 -- 172.21.15.132:0/3865423696 >> v2:172.21.15.161:3300/0 conn(0x7f356c0c52e0 msgr2=0x7f356c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.088+0000 7f356b7fe640 1 --2- 172.21.15.132:0/3865423696 >> v2:172.21.15.161:3300/0 conn(0x7f356c0c52e0 0x7f356c06d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.088+0000 7f356b7fe640 1 -- 172.21.15.132:0/3865423696 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c06c240 con 0x7f356c14e7f0 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.089+0000 7f356b7fe640 1 --2- 172.21.15.132:0/3865423696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c0c0440 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f356c06f680 tx=0x7f355c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46c8a30721a2de7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.089+0000 7f356affd640 1 -- 172.21.15.132:0/3865423696 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0317e0 con 0x7f356c14e7f0 2023-11-18T20:39:19.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.089+0000 7f356affd640 1 -- 172.21.15.132:0/3865423696 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c031940 con 0x7f356c14e7f0 2023-11-18T20:39:19.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.089+0000 7f356affd640 1 -- 172.21.15.132:0/3865423696 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c031cd0 con 0x7f356c14e7f0 2023-11-18T20:39:19.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.089+0000 7f3570916640 1 -- 172.21.15.132:0/3865423696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 msgr2=0x7f356c0c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.089+0000 7f3570916640 1 --2- 172.21.15.132:0/3865423696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c0c0440 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f356c06f680 tx=0x7f355c02b880 comp rx=0 tx=0).stop 2023-11-18T20:39:19.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.090+0000 7f3570916640 1 -- 172.21.15.132:0/3865423696 shutdown_connections 2023-11-18T20:39:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.090+0000 7f3570916640 1 --2- 172.21.15.132:0/3865423696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 0x7f356c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.090+0000 7f3570916640 1 --2- 172.21.15.132:0/3865423696 >> v2:172.21.15.161:3300/0 conn(0x7f356c0c52e0 0x7f356c06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.090+0000 7f3570916640 1 --2- 172.21.15.132:0/3865423696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c0c0440 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.090+0000 7f3570916640 1 -- 172.21.15.132:0/3865423696 >> 172.21.15.132:0/3865423696 conn(0x7f356c0a77f0 msgr2=0x7f356c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.090+0000 7f3570916640 1 -- 172.21.15.132:0/3865423696 shutdown_connections 2023-11-18T20:39:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.090+0000 7f3570916640 1 -- 172.21.15.132:0/3865423696 wait complete. 2023-11-18T20:39:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.091+0000 7f3570916640 1 Processor -- start 2023-11-18T20:39:19.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.091+0000 7f3570916640 1 -- start start 2023-11-18T20:39:19.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.092+0000 7f3570916640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 0x7f356c14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.092+0000 7f3570916640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f356c0c52e0 0x7f356c1503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.092+0000 7f3570916640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.092+0000 7f3570916640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0abe60 con 0x7f356c14e7f0 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.092+0000 7f3570916640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0a9510 con 0x7f356c0c52e0 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.092+0000 7f3570916640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1e8b00 con 0x7f356c06cd20 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43152/0 (socket says 172.21.15.132:43152) 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 -- 172.21.15.132:0/4085193236 learned_addr learned my addr 172.21.15.132:0/4085193236 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356b7fe640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 0x7f356c14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f3563fff640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f356c0c52e0 0x7f356c1503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 -- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 msgr2=0x7f356c14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 0x7f356c14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 -- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f356c0c52e0 msgr2=0x7f356c1503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f356c0c52e0 0x7f356c1503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 -- 172.21.15.132:0/4085193236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0094d0 con 0x7f356c14e7f0 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356b7fe640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 0x7f356c14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f356bfff640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c147a30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f356400b9e0 tx=0x7f356400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.093+0000 7f3568ff9640 1 -- 172.21.15.132:0/4085193236 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400cb20 con 0x7f356c14e7f0 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.094+0000 7f3568ff9640 1 -- 172.21.15.132:0/4085193236 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356400cc80 con 0x7f356c14e7f0 2023-11-18T20:39:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.094+0000 7f3568ff9640 1 -- 172.21.15.132:0/4085193236 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564014680 con 0x7f356c14e7f0 2023-11-18T20:39:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.094+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c148a90 con 0x7f356c14e7f0 2023-11-18T20:39:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.094+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c0a88e0 con 0x7f356c14e7f0 2023-11-18T20:39:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.095+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c06c7e0 con 0x7f356c14e7f0 2023-11-18T20:39:19.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.096+0000 7f3568ff9640 1 -- 172.21.15.132:0/4085193236 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f356401c360 con 0x7f356c14e7f0 2023-11-18T20:39:19.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.097+0000 7f3568ff9640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f354c06ae40 0x7f354c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.097+0000 7f3568ff9640 1 -- 172.21.15.132:0/4085193236 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35640894c0 con 0x7f356c14e7f0 2023-11-18T20:39:19.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.097+0000 7f356b7fe640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f354c06ae40 0x7f354c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.098+0000 7f356b7fe640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f354c06ae40 0x7f354c06d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f355c036000 tx=0x7f355c03d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.101+0000 7f3568ff9640 1 -- 172.21.15.132:0/4085193236 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f356c06c7e0 con 0x7f356c14e7f0 2023-11-18T20:39:19.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.290+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f356c1e8c70 con 0x7f356c14e7f0 2023-11-18T20:39:19.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.291+0000 7f3568ff9640 1 -- 172.21.15.132:0/4085193236 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f356c1e8c70 con 0x7f356c14e7f0 2023-11-18T20:39:19.292 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:19.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f354c06ae40 msgr2=0x7f354c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f354c06ae40 0x7f354c06d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f355c036000 tx=0x7f355c03d040 comp rx=0 tx=0).stop 2023-11-18T20:39:19.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 msgr2=0x7f356c147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c147a30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f356400b9e0 tx=0x7f356400bea0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 shutdown_connections 2023-11-18T20:39:19.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f354c06ae40 0x7f354c06d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f356c14e7f0 0x7f356c147a30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f356c0c52e0 0x7f356c1503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 --2- 172.21.15.132:0/4085193236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f356c06cd20 0x7f356c14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 >> 172.21.15.132:0/4085193236 conn(0x7f356c0a77f0 msgr2=0x7f356c0c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 shutdown_connections 2023-11-18T20:39:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.294+0000 7f3570916640 1 -- 172.21.15.132:0/4085193236 wait complete. 2023-11-18T20:39:19.312 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:39:19.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.528+0000 7fdeffae7640 1 Processor -- start 2023-11-18T20:39:19.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.528+0000 7fdeffae7640 1 -- start start 2023-11-18T20:39:19.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.529+0000 7fdeffae7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 0x7fdef8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.529+0000 7fdeffae7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdef806d0a0 0x7fdef80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.529+0000 7fdeffae7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef80c64a0 con 0x7fdef80a5260 2023-11-18T20:39:19.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.529+0000 7fdeffae7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef80c5c00 con 0x7fdef806d0a0 2023-11-18T20:39:19.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.529+0000 7fdeffae7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c5ee0 con 0x7fdef814fd30 2023-11-18T20:39:19.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.530+0000 7fdefe084640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdef80a5260 0x7fdef80c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51066/0 (socket says 172.21.15.132:51066) 2023-11-18T20:39:19.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.530+0000 7fdefe084640 1 -- 172.21.15.132:0/4033715170 learned_addr learned my addr 172.21.15.132:0/4033715170 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:19.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.530+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527801347 0 0) 0x7fdef80c64a0 con 0x7fdef80a5260 2023-11-18T20:39:19.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.530+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee4003520 con 0x7fdef80a5260 2023-11-18T20:39:19.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.530+0000 7fdefd883640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 0x7fdef8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.530+0000 7fdefd082640 1 --2- 172.21.15.132:0/4033715170 >> v2:172.21.15.161:3300/0 conn(0x7fdef806d0a0 0x7fdef80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1381262109 0 0) 0x7fdee4003520 con 0x7fdef80a5260 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 msgr2=0x7fdef8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 0x7fdef8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 >> v2:172.21.15.161:3300/0 conn(0x7fdef806d0a0 msgr2=0x7fdef80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 --2- 172.21.15.132:0/4033715170 >> v2:172.21.15.161:3300/0 conn(0x7fdef806d0a0 0x7fdef80a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80c61c0 con 0x7fdef80a5260 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fdef0001670 con 0x7fdef80a5260 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 >> v1:172.21.15.132:6789/0 conn(0x7fdef80a5260 legacy=0x7fdef80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdee4003970 0x7fdee4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdee4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 0x7fdee4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c5c00 con 0x7fdee40047c0 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c5ee0 con 0x7fdee4003970 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee400b980 con 0x7fdef814fd30 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefd082640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdee4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefd082640 1 -- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 msgr2=0x7fdee4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefd883640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdee4003970 0x7fdee4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.531+0000 7fdefe084640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 0x7fdee4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.532+0000 7fdefd082640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 0x7fdee4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.532+0000 7fdefd082640 1 -- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdee4003970 msgr2=0x7fdee4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.532+0000 7fdefd082640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdee4003970 0x7fdee4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.532+0000 7fdefd082640 1 -- 172.21.15.132:0/4033715170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4003520 con 0x7fdee40047c0 2023-11-18T20:39:19.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.532+0000 7fdefd883640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdee4003970 0x7fdee4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:19.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.532+0000 7fdefe084640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef814fd30 0x7fdee4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:19.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.533+0000 7fdefd082640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdee4004c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdee800ba00 tx=0x7fdee40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b4e5d843e9968b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.533+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8032640 con 0x7fdee40047c0 2023-11-18T20:39:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.533+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee80327a0 con 0x7fdee40047c0 2023-11-18T20:39:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.533+0000 7fdefc881640 1 -- 172.21.15.132:0/4033715170 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8032b30 con 0x7fdee40047c0 2023-11-18T20:39:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.533+0000 7fdeffae7640 1 -- 172.21.15.132:0/4033715170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 msgr2=0x7fdee4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.533+0000 7fdeffae7640 1 --2- 172.21.15.132:0/4033715170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdee4004c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdee800ba00 tx=0x7fdee40057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.533+0000 7fdefe084640 1 -- 172.21.15.132:0/4033715170 reap_dead start 2023-11-18T20:39:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.534+0000 7fdeffae7640 1 -- 172.21.15.132:0/4033715170 shutdown_connections 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.534+0000 7fdeffae7640 1 -- 172.21.15.132:0/4033715170 >> 172.21.15.132:0/4033715170 conn(0x7fdef806a500 msgr2=0x7fdef806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.534+0000 7fdeffae7640 1 -- 172.21.15.132:0/4033715170 shutdown_connections 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.534+0000 7fdeffae7640 1 -- 172.21.15.132:0/4033715170 wait complete. 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.535+0000 7fdeffae7640 1 Processor -- start 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.535+0000 7fdeffae7640 1 -- start start 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.536+0000 7fdeffae7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdef80bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.536+0000 7fdeffae7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef81550b0 0x7fdef8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.536+0000 7fdeffae7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef8154790 0x7fdef8151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.536+0000 7fdeffae7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef81dbee0 con 0x7fdee40047c0 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.536+0000 7fdeffae7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef8155540 con 0x7fdef8154790 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.536+0000 7fdeffae7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef81edd90 con 0x7fdef81550b0 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdef80bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdef80bf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43172/0 (socket says 172.21.15.132:43172) 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 -- 172.21.15.132:0/723193897 learned_addr learned my addr 172.21.15.132:0/723193897 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd082640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef81550b0 0x7fdef8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 -- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef81550b0 msgr2=0x7fdef8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef81550b0 0x7fdef8154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 -- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef8154790 msgr2=0x7fdef8151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef8154790 0x7fdef8151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 -- 172.21.15.132:0/723193897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef81dbb70 con 0x7fdee40047c0 2023-11-18T20:39:19.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd082640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef81550b0 0x7fdef8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.537+0000 7fdefd883640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdef80bf5c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdef400f350 tx=0x7fdef400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.538+0000 7fdeee7fc640 1 -- 172.21.15.132:0/723193897 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4003b90 con 0x7fdee40047c0 2023-11-18T20:39:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.538+0000 7fdeee7fc640 1 -- 172.21.15.132:0/723193897 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4011040 con 0x7fdee40047c0 2023-11-18T20:39:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.538+0000 7fdeee7fc640 1 -- 172.21.15.132:0/723193897 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4004020 con 0x7fdee40047c0 2023-11-18T20:39:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.538+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef80bfb00 con 0x7fdee40047c0 2023-11-18T20:39:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.538+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef8155720 con 0x7fdee40047c0 2023-11-18T20:39:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.539+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef8068350 con 0x7fdee40047c0 2023-11-18T20:39:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.540+0000 7fdeee7fc640 1 -- 172.21.15.132:0/723193897 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdef4004180 con 0x7fdee40047c0 2023-11-18T20:39:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.541+0000 7fdeee7fc640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdedc06ae70 0x7fdedc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.541+0000 7fdeee7fc640 1 -- 172.21.15.132:0/723193897 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdef4089c70 con 0x7fdee40047c0 2023-11-18T20:39:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.541+0000 7fdefd082640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdedc06ae70 0x7fdedc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.542+0000 7fdefd082640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdedc06ae70 0x7fdedc06d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdef806d4e0 tx=0x7fdee803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.545+0000 7fdeee7fc640 1 -- 172.21.15.132:0/723193897 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdef4054d10 con 0x7fdee40047c0 2023-11-18T20:39:19.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.735+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdef80c66d0 con 0x7fdee40047c0 2023-11-18T20:39:19.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.736+0000 7fdeee7fc640 1 -- 172.21.15.132:0/723193897 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdef4058330 con 0x7fdee40047c0 2023-11-18T20:39:19.737 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:19.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdedc06ae70 msgr2=0x7fdedc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdedc06ae70 0x7fdedc06d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdef806d4e0 tx=0x7fdee803d040 comp rx=0 tx=0).stop 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 msgr2=0x7fdef80bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdef80bf5c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdef400f350 tx=0x7fdef400f810 comp rx=0 tx=0).stop 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 shutdown_connections 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdedc06ae70 0x7fdedc06d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef8154790 0x7fdef8151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef81550b0 0x7fdef8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 --2- 172.21.15.132:0/723193897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee40047c0 0x7fdef80bf5c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 >> 172.21.15.132:0/723193897 conn(0x7fdef806a500 msgr2=0x7fdef80c3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 shutdown_connections 2023-11-18T20:39:19.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.739+0000 7fdeffae7640 1 -- 172.21.15.132:0/723193897 wait complete. 2023-11-18T20:39:19.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T20:39:19.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.963+0000 7f4432b05640 1 Processor -- start 2023-11-18T20:39:19.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.963+0000 7f4432b05640 1 -- start start 2023-11-18T20:39:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.964+0000 7f4432b05640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f442c0c5ec0 0x7f442c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.964+0000 7f4432b05640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0c45d0 0x7f442c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f4432b05640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f442c0721a0 0x7f442c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f4432b05640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c06e390 con 0x7f442c0721a0 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f4432b05640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c0bfdc0 con 0x7f442c0c5ec0 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f4432b05640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c06ddd0 con 0x7f442c0c45d0 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44310a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f442c0721a0 0x7f442c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44310a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f442c0721a0 0x7f442c155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43188/0 (socket says 172.21.15.132:43188) 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44310a2640 1 -- 172.21.15.132:0/3266953889 learned_addr learned my addr 172.21.15.132:0/3266953889 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44308a1640 1 --2- 172.21.15.132:0/3266953889 >> v2:172.21.15.161:3300/0 conn(0x7f442c0c5ec0 0x7f442c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f442bfff640 1 --2- 172.21.15.132:0/3266953889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0c45d0 0x7f442c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44310a2640 1 -- 172.21.15.132:0/3266953889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0c45d0 msgr2=0x7f442c0c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:19.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44310a2640 1 --2- 172.21.15.132:0/3266953889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0c45d0 0x7f442c0c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44310a2640 1 -- 172.21.15.132:0/3266953889 >> v2:172.21.15.161:3300/0 conn(0x7f442c0c5ec0 msgr2=0x7f442c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:19.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44310a2640 1 --2- 172.21.15.132:0/3266953889 >> v2:172.21.15.161:3300/0 conn(0x7f442c0c5ec0 0x7f442c0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44310a2640 1 -- 172.21.15.132:0/3266953889 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c06e0b0 con 0x7f442c0721a0 2023-11-18T20:39:19.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f442bfff640 1 --2- 172.21.15.132:0/3266953889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0c45d0 0x7f442c0c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:19.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.965+0000 7f44308a1640 1 --2- 172.21.15.132:0/3266953889 >> v2:172.21.15.161:3300/0 conn(0x7f442c0c5ec0 0x7f442c0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:19.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.967+0000 7f44310a2640 1 --2- 172.21.15.132:0/3266953889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0721a0 0x7f442c155e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4424009e50 tx=0x7f442402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1a9fea338a5b8a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.967+0000 7f442b7fe640 1 -- 172.21.15.132:0/3266953889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442402c960 con 0x7f442c0721a0 2023-11-18T20:39:19.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.967+0000 7f442b7fe640 1 -- 172.21.15.132:0/3266953889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442402cac0 con 0x7f442c0721a0 2023-11-18T20:39:19.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.967+0000 7f442b7fe640 1 -- 172.21.15.132:0/3266953889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442402ce50 con 0x7f442c0721a0 2023-11-18T20:39:19.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.967+0000 7f4432b05640 1 -- 172.21.15.132:0/3266953889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0721a0 msgr2=0x7f442c155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.967+0000 7f4432b05640 1 --2- 172.21.15.132:0/3266953889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0721a0 0x7f442c155e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4424009e50 tx=0x7f442402bdc0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.968+0000 7f4432b05640 1 -- 172.21.15.132:0/3266953889 shutdown_connections 2023-11-18T20:39:19.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.968+0000 7f4432b05640 1 --2- 172.21.15.132:0/3266953889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0721a0 0x7f442c155e30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.968+0000 7f4432b05640 1 --2- 172.21.15.132:0/3266953889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0c45d0 0x7f442c0c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.968+0000 7f4432b05640 1 --2- 172.21.15.132:0/3266953889 >> v2:172.21.15.161:3300/0 conn(0x7f442c0c5ec0 0x7f442c0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.968+0000 7f4432b05640 1 -- 172.21.15.132:0/3266953889 >> 172.21.15.132:0/3266953889 conn(0x7f442c06a500 msgr2=0x7f442c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:19.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.968+0000 7f4432b05640 1 -- 172.21.15.132:0/3266953889 shutdown_connections 2023-11-18T20:39:19.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.968+0000 7f4432b05640 1 -- 172.21.15.132:0/3266953889 wait complete. 2023-11-18T20:39:19.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.969+0000 7f4432b05640 1 Processor -- start 2023-11-18T20:39:19.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.969+0000 7f4432b05640 1 -- start start 2023-11-18T20:39:19.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.970+0000 7f4432b05640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0721a0 0x7f442c14ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.970+0000 7f4432b05640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0c45d0 0x7f442c14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.970+0000 7f4432b05640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f442c0c5ec0 0x7f442c1e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.970+0000 7f4432b05640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c155ef0 con 0x7f442c0c45d0 2023-11-18T20:39:19.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.970+0000 7f4432b05640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1eac70 con 0x7f442c0c5ec0 2023-11-18T20:39:19.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.970+0000 7f4432b05640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1ea6f0 con 0x7f442c0721a0 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f442bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0c45d0 0x7f442c14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f442bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0c45d0 0x7f442c14f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43194/0 (socket says 172.21.15.132:43194) 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f442bfff640 1 -- 172.21.15.132:0/3923233488 learned_addr learned my addr 172.21.15.132:0/3923233488 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f44308a1640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0721a0 0x7f442c14ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f44310a2640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f442c0c5ec0 0x7f442c1e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f442bfff640 1 -- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0721a0 msgr2=0x7f442c14ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f442bfff640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0721a0 0x7f442c14ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f442bfff640 1 -- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f442c0c5ec0 msgr2=0x7f442c1e6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f442bfff640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f442c0c5ec0 0x7f442c1e6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.971+0000 7f442bfff640 1 -- 172.21.15.132:0/3923233488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4424009b30 con 0x7f442c0c45d0 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.972+0000 7f442bfff640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0c45d0 0x7f442c14f4a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f441800c7c0 tx=0x7f441800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.972+0000 7f44297fa640 1 -- 172.21.15.132:0/3923233488 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418007a30 con 0x7f442c0c45d0 2023-11-18T20:39:19.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.972+0000 7f44297fa640 1 -- 172.21.15.132:0/3923233488 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4418007b90 con 0x7f442c0c45d0 2023-11-18T20:39:19.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.972+0000 7f44297fa640 1 -- 172.21.15.132:0/3923233488 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800ce70 con 0x7f442c0c45d0 2023-11-18T20:39:19.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.972+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c0a8d60 con 0x7f442c0c45d0 2023-11-18T20:39:19.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.972+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c158420 con 0x7f442c0c45d0 2023-11-18T20:39:19.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.973+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442c158640 con 0x7f442c0c45d0 2023-11-18T20:39:19.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.974+0000 7f44297fa640 1 -- 172.21.15.132:0/3923233488 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44180113f0 con 0x7f442c0c45d0 2023-11-18T20:39:19.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.975+0000 7f44297fa640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f441006ae40 0x7f441006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:19.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.975+0000 7f44297fa640 1 -- 172.21.15.132:0/3923233488 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4418089720 con 0x7f442c0c45d0 2023-11-18T20:39:19.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.976+0000 7f44308a1640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f441006ae40 0x7f441006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:19.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.977+0000 7f44308a1640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f441006ae40 0x7f441006d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f442000a950 tx=0x7f4420008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:19.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:19.979+0000 7f44297fa640 1 -- 172.21.15.132:0/3923233488 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44180547c0 con 0x7f442c0c45d0 2023-11-18T20:39:20.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.170+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f442c068350 con 0x7f442c0c45d0 2023-11-18T20:39:20.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.170+0000 7f44297fa640 1 -- 172.21.15.132:0/3923233488 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+207 (secure 0 0 0) 0x7f4418057de0 con 0x7f442c0c45d0 2023-11-18T20:39:20.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 4, 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": "cephfs_metadata" 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 5, 2023-11-18T20:39:20.172 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": "cephfs_data" 2023-11-18T20:39:20.173 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:39:20.173 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-11-18T20:39:20.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f441006ae40 msgr2=0x7f441006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:20.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f441006ae40 0x7f441006d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f442000a950 tx=0x7f4420008040 comp rx=0 tx=0).stop 2023-11-18T20:39:20.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0c45d0 msgr2=0x7f442c14f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0c45d0 0x7f442c14f4a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f441800c7c0 tx=0x7f441800cc80 comp rx=0 tx=0).stop 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 shutdown_connections 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f441006ae40 0x7f441006d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f442c0c5ec0 0x7f442c1e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f442c0c45d0 0x7f442c14f4a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 --2- 172.21.15.132:0/3923233488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f442c0721a0 0x7f442c14ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 >> 172.21.15.132:0/3923233488 conn(0x7f442c06a500 msgr2=0x7f442c0aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 shutdown_connections 2023-11-18T20:39:20.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.173+0000 7f4432b05640 1 -- 172.21.15.132:0/3923233488 wait complete. 2023-11-18T20:39:20.193 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-18T20:39:20.193 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-18T20:39:20.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.409+0000 7f32c3fdc640 1 Processor -- start 2023-11-18T20:39:20.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.409+0000 7f32c3fdc640 1 -- start start 2023-11-18T20:39:20.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c3fdc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32bc14fa80 0x7f32bc06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:20.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c3fdc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f32bc071f70 0x7f32bc0c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:20.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c3fdc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc0c0980 con 0x7f32bc072530 2023-11-18T20:39:20.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c3fdc640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc06d160 con 0x7f32bc071f70 2023-11-18T20:39:20.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c3fdc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc06c070 con 0x7f32bc14fa80 2023-11-18T20:39:20.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c2579640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f32bc071f70 0x7f32bc0c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:20.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c1577640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f32bc072530 0x7f32bc0c5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51068/0 (socket says 172.21.15.132:51068) 2023-11-18T20:39:20.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c1577640 1 -- 172.21.15.132:0/226572042 learned_addr learned my addr 172.21.15.132:0/226572042 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:20.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.411+0000 7f32c1d78640 1 --2- 172.21.15.132:0/226572042 >> v2:172.21.15.161:3300/0 conn(0x7f32bc14fa80 0x7f32bc06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:20.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.412+0000 7f32c2579640 1 -- 172.21.15.132:0/226572042 >> v2:172.21.15.161:3300/0 conn(0x7f32bc14fa80 msgr2=0x7f32bc06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:20.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.412+0000 7f32c2579640 1 --2- 172.21.15.132:0/226572042 >> v2:172.21.15.161:3300/0 conn(0x7f32bc14fa80 0x7f32bc06d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.412+0000 7f32c2579640 1 -- 172.21.15.132:0/226572042 >> v1:172.21.15.132:6789/0 conn(0x7f32bc072530 legacy=0x7f32bc0c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:20.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.412+0000 7f32c2579640 1 -- 172.21.15.132:0/226572042 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc06dc70 con 0x7f32bc071f70 2023-11-18T20:39:20.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.412+0000 7f32c1d78640 1 --2- 172.21.15.132:0/226572042 >> v2:172.21.15.161:3300/0 conn(0x7f32bc14fa80 0x7f32bc06d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:20.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.413+0000 7f32c2579640 1 --2- 172.21.15.132:0/226572042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc071f70 0x7f32bc0c2610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0c3310 tx=0x7f32b402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb2cc0e4a1ac6c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:20.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.413+0000 7f32c0d76640 1 -- 172.21.15.132:0/226572042 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b402cbe0 con 0x7f32bc071f70 2023-11-18T20:39:20.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.413+0000 7f32c0d76640 1 -- 172.21.15.132:0/226572042 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b402cd40 con 0x7f32bc071f70 2023-11-18T20:39:20.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.413+0000 7f32c0d76640 1 -- 172.21.15.132:0/226572042 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4034660 con 0x7f32bc071f70 2023-11-18T20:39:20.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.414+0000 7f32c3fdc640 1 -- 172.21.15.132:0/226572042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc071f70 msgr2=0x7f32bc0c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:20.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.414+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/226572042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc071f70 0x7f32bc0c2610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0c3310 tx=0x7f32b402be30 comp rx=0 tx=0).stop 2023-11-18T20:39:20.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.414+0000 7f32c3fdc640 1 -- 172.21.15.132:0/226572042 shutdown_connections 2023-11-18T20:39:20.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.414+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/226572042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc071f70 0x7f32bc0c2610 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.414+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/226572042 >> v2:172.21.15.161:3300/0 conn(0x7f32bc14fa80 0x7f32bc06d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.414+0000 7f32c3fdc640 1 -- 172.21.15.132:0/226572042 >> 172.21.15.132:0/226572042 conn(0x7f32bc0c5bc0 msgr2=0x7f32bc0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:20.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.414+0000 7f32c3fdc640 1 -- 172.21.15.132:0/226572042 shutdown_connections 2023-11-18T20:39:20.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.414+0000 7f32c3fdc640 1 -- 172.21.15.132:0/226572042 wait complete. 2023-11-18T20:39:20.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.416+0000 7f32c3fdc640 1 Processor -- start 2023-11-18T20:39:20.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.416+0000 7f32c3fdc640 1 -- start start 2023-11-18T20:39:20.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c3fdc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32bc071f70 0x7f32bc0bac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:20.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c3fdc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32bc072530 0x7f32bc071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c3fdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc14fa80 0x7f32bc1e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c3fdc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0bca80 con 0x7f32bc14fa80 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c3fdc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0a89d0 con 0x7f32bc072530 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c3fdc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0a8540 con 0x7f32bc071f70 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c2579640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc14fa80 0x7f32bc1e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c2579640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc14fa80 0x7f32bc1e7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43206/0 (socket says 172.21.15.132:43206) 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c2579640 1 -- 172.21.15.132:0/4236829358 learned_addr learned my addr 172.21.15.132:0/4236829358 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c2579640 1 -- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32bc071f70 msgr2=0x7f32bc0bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c2579640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32bc071f70 0x7f32bc0bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c2579640 1 -- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32bc072530 msgr2=0x7f32bc071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:20.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c2579640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32bc072530 0x7f32bc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:20.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.417+0000 7f32c2579640 1 -- 172.21.15.132:0/4236829358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4009a70 con 0x7f32bc14fa80 2023-11-18T20:39:20.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.418+0000 7f32c2579640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc14fa80 0x7f32bc1e7db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f32b402c440 tx=0x7f32b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:20.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.418+0000 7f32b27fc640 1 -- 172.21.15.132:0/4236829358 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b403e610 con 0x7f32bc14fa80 2023-11-18T20:39:20.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.418+0000 7f32b27fc640 1 -- 172.21.15.132:0/4236829358 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b403e770 con 0x7f32bc14fa80 2023-11-18T20:39:20.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.418+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc0a76f0 con 0x7f32bc14fa80 2023-11-18T20:39:20.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.418+0000 7f32b27fc640 1 -- 172.21.15.132:0/4236829358 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b403eb00 con 0x7f32bc14fa80 2023-11-18T20:39:20.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.418+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc0a81d0 con 0x7f32bc14fa80 2023-11-18T20:39:20.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.419+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc068350 con 0x7f32bc14fa80 2023-11-18T20:39:20.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.420+0000 7f32b27fc640 1 -- 172.21.15.132:0/4236829358 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32b403b050 con 0x7f32bc14fa80 2023-11-18T20:39:20.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.421+0000 7f32b27fc640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32a006ae70 0x7f32a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:20.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.421+0000 7f32b27fc640 1 -- 172.21.15.132:0/4236829358 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32b40abdd0 con 0x7f32bc14fa80 2023-11-18T20:39:20.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.422+0000 7f32c1d78640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32a006ae70 0x7f32a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:20.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.423+0000 7f32c1d78640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32a006ae70 0x7f32a006d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006fd0 tx=0x7f32b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:20.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.426+0000 7f32b27fc640 1 -- 172.21.15.132:0/4236829358 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32b4076e70 con 0x7f32bc14fa80 2023-11-18T20:39:20.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:20.615+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f32bc0c4fb0 con 0x7f32bc14fa80 2023-11-18T20:39:21.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.359+0000 7f32b27fc640 1 -- 172.21.15.132:0/4236829358 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v36) v1 ==== 140+0+0 (secure 0 0 0) 0x7f32b40390b0 con 0x7f32bc14fa80 2023-11-18T20:39:21.361 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_metadata' created 2023-11-18T20:39:21.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.363+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32a006ae70 msgr2=0x7f32a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:21.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32a006ae70 0x7f32a006d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006fd0 tx=0x7f32b8008040 comp rx=0 tx=0).stop 2023-11-18T20:39:21.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc14fa80 msgr2=0x7f32bc1e7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:21.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc14fa80 0x7f32bc1e7db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f32b402c440 tx=0x7f32b4004a40 comp rx=0 tx=0).stop 2023-11-18T20:39:21.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 shutdown_connections 2023-11-18T20:39:21.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f32a006ae70 0x7f32a006d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32bc14fa80 0x7f32bc1e7db0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32bc072530 0x7f32bc071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 --2- 172.21.15.132:0/4236829358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32bc071f70 0x7f32bc0bac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.364+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 >> 172.21.15.132:0/4236829358 conn(0x7f32bc0c5bc0 msgr2=0x7f32bc14e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:21.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.365+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 shutdown_connections 2023-11-18T20:39:21.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.365+0000 7f32c3fdc640 1 -- 172.21.15.132:0/4236829358 wait complete. 2023-11-18T20:39:21.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T20:39:21.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.591+0000 7fbfb7e07640 1 Processor -- start 2023-11-18T20:39:21.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.591+0000 7fbfb7e07640 1 -- start start 2023-11-18T20:39:21.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.592+0000 7fbfb7e07640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb006d0a0 0x7fbfb0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:21.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.592+0000 7fbfb7e07640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbfb00c3ea0 0x7fbfb00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:21.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.592+0000 7fbfb7e07640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb00c64a0 con 0x7fbfb014fd30 2023-11-18T20:39:21.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.592+0000 7fbfb7e07640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb00c5c00 con 0x7fbfb00c3ea0 2023-11-18T20:39:21.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.592+0000 7fbfb7e07640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00c5ee0 con 0x7fbfb006d0a0 2023-11-18T20:39:21.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.593+0000 7fbfb5ba3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbfb014fd30 0x7fbfb00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51084/0 (socket says 172.21.15.132:51084) 2023-11-18T20:39:21.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.593+0000 7fbfb5ba3640 1 -- 172.21.15.132:0/666010570 learned_addr learned my addr 172.21.15.132:0/666010570 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:21.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.593+0000 7fbfb53a2640 1 --2- 172.21.15.132:0/666010570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb006d0a0 0x7fbfb0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:21.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.593+0000 7fbfb63a4640 1 --2- 172.21.15.132:0/666010570 >> v2:172.21.15.161:3300/0 conn(0x7fbfb00c3ea0 0x7fbfb00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:21.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.594+0000 7fbfb4ba1640 1 -- 172.21.15.132:0/666010570 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222345431 0 0) 0x7fbfb00c64a0 con 0x7fbfb014fd30 2023-11-18T20:39:21.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.594+0000 7fbfb4ba1640 1 -- 172.21.15.132:0/666010570 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf9c003520 con 0x7fbfb014fd30 2023-11-18T20:39:21.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.594+0000 7fbfb4ba1640 1 -- 172.21.15.132:0/666010570 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 65155928 0 0) 0x7fbf9c003520 con 0x7fbfb014fd30 2023-11-18T20:39:21.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.594+0000 7fbfb53a2640 1 -- 172.21.15.132:0/666010570 >> v2:172.21.15.161:3300/0 conn(0x7fbfb00c3ea0 msgr2=0x7fbfb00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:21.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.594+0000 7fbfb53a2640 1 --2- 172.21.15.132:0/666010570 >> v2:172.21.15.161:3300/0 conn(0x7fbfb00c3ea0 0x7fbfb00c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.594+0000 7fbfb53a2640 1 -- 172.21.15.132:0/666010570 >> v1:172.21.15.132:6789/0 conn(0x7fbfb014fd30 legacy=0x7fbfb00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:21.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.594+0000 7fbfb53a2640 1 -- 172.21.15.132:0/666010570 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00c61c0 con 0x7fbfb006d0a0 2023-11-18T20:39:21.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.595+0000 7fbfb53a2640 1 --2- 172.21.15.132:0/666010570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb006d0a0 0x7fbfb0152f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00097a0 tx=0x7fbfa002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c1f05216098f4dd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:21.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb4ba1640 1 -- 172.21.15.132:0/666010570 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac001670 con 0x7fbfb006d0a0 2023-11-18T20:39:21.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb4ba1640 1 -- 172.21.15.132:0/666010570 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa002e050 con 0x7fbfb006d0a0 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb4ba1640 1 -- 172.21.15.132:0/666010570 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0030730 con 0x7fbfb006d0a0 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb7e07640 1 -- 172.21.15.132:0/666010570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb006d0a0 msgr2=0x7fbfb0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/666010570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb006d0a0 0x7fbfb0152f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00097a0 tx=0x7fbfa002b790 comp rx=0 tx=0).stop 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb7e07640 1 -- 172.21.15.132:0/666010570 shutdown_connections 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/666010570 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb006d0a0 0x7fbfb0152f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/666010570 >> v2:172.21.15.161:3300/0 conn(0x7fbfb00c3ea0 0x7fbfb00c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb7e07640 1 -- 172.21.15.132:0/666010570 >> 172.21.15.132:0/666010570 conn(0x7fbfb006a500 msgr2=0x7fbfb006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb7e07640 1 -- 172.21.15.132:0/666010570 shutdown_connections 2023-11-18T20:39:21.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.596+0000 7fbfb7e07640 1 -- 172.21.15.132:0/666010570 wait complete. 2023-11-18T20:39:21.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.598+0000 7fbfb7e07640 1 Processor -- start 2023-11-18T20:39:21.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.598+0000 7fbfb7e07640 1 -- start start 2023-11-18T20:39:21.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.599+0000 7fbfb7e07640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb006d0a0 0x7fbfb0151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:21.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.599+0000 7fbfb7e07640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfb00c3ea0 0x7fbfb0148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:21.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.599+0000 7fbfb7e07640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb014fd30 0x7fbfb0148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:21.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.599+0000 7fbfb7e07640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0156960 con 0x7fbfb006d0a0 2023-11-18T20:39:21.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.599+0000 7fbfb7e07640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0156680 con 0x7fbfb00c3ea0 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.599+0000 7fbfb7e07640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0155780 con 0x7fbfb014fd30 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb006d0a0 0x7fbfb0151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb006d0a0 0x7fbfb0151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43214/0 (socket says 172.21.15.132:43214) 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 -- 172.21.15.132:0/1089372379 learned_addr learned my addr 172.21.15.132:0/1089372379 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb63a4640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb014fd30 0x7fbfb0148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb53a2640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfb00c3ea0 0x7fbfb0148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 -- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb014fd30 msgr2=0x7fbfb0148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb014fd30 0x7fbfb0148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 -- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfb00c3ea0 msgr2=0x7fbfb0148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfb00c3ea0 0x7fbfb0148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:21.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 -- 172.21.15.132:0/1089372379 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0009400 con 0x7fbfb006d0a0 2023-11-18T20:39:21.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.600+0000 7fbfb5ba3640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb006d0a0 0x7fbfb0151820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c760 tx=0x7fbfac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:21.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.601+0000 7fbfa67fc640 1 -- 172.21.15.132:0/1089372379 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac005ad0 con 0x7fbfb006d0a0 2023-11-18T20:39:21.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.601+0000 7fbfa67fc640 1 -- 172.21.15.132:0/1089372379 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac005c30 con 0x7fbfb006d0a0 2023-11-18T20:39:21.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.601+0000 7fbfa67fc640 1 -- 172.21.15.132:0/1089372379 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac007070 con 0x7fbfb006d0a0 2023-11-18T20:39:21.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.601+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb0155a60 con 0x7fbfb006d0a0 2023-11-18T20:39:21.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.601+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb0154a50 con 0x7fbfb006d0a0 2023-11-18T20:39:21.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.602+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb0153280 con 0x7fbfb006d0a0 2023-11-18T20:39:21.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.603+0000 7fbfa67fc640 1 -- 172.21.15.132:0/1089372379 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfac0071d0 con 0x7fbfb006d0a0 2023-11-18T20:39:21.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.604+0000 7fbfa67fc640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf9406ae40 0x7fbf9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:21.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.604+0000 7fbfa67fc640 1 -- 172.21.15.132:0/1089372379 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fbfac0894b0 con 0x7fbfb006d0a0 2023-11-18T20:39:21.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.605+0000 7fbfb53a2640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf9406ae40 0x7fbf9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.606+0000 7fbfb53a2640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf9406ae40 0x7fbf9406d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0034000 tx=0x7fbfa002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.609+0000 7fbfa67fc640 1 -- 172.21.15.132:0/1089372379 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbfac054480 con 0x7fbfb006d0a0 2023-11-18T20:39:21.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:21.800+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbfb0068350 con 0x7fbfb006d0a0 2023-11-18T20:39:22.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.365+0000 7fbfa67fc640 1 -- 172.21.15.132:0/1089372379 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v37) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbfac057aa0 con 0x7fbfb006d0a0 2023-11-18T20:39:22.367 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_data' created 2023-11-18T20:39:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.370+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf9406ae40 msgr2=0x7fbf9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.370+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf9406ae40 0x7fbf9406d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0034000 tx=0x7fbfa002f000 comp rx=0 tx=0).stop 2023-11-18T20:39:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.370+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb006d0a0 msgr2=0x7fbfb0151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.370+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb006d0a0 0x7fbfb0151820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c760 tx=0x7fbfac00cc20 comp rx=0 tx=0).stop 2023-11-18T20:39:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.371+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 shutdown_connections 2023-11-18T20:39:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.371+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbf9406ae40 0x7fbf9406d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.371+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb014fd30 0x7fbfb0148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.371+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfb00c3ea0 0x7fbfb0148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.371+0000 7fbfb7e07640 1 --2- 172.21.15.132:0/1089372379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb006d0a0 0x7fbfb0151820 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.371+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 >> 172.21.15.132:0/1089372379 conn(0x7fbfb006a500 msgr2=0x7fbfb006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.371+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 shutdown_connections 2023-11-18T20:39:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.371+0000 7fbfb7e07640 1 -- 172.21.15.132:0/1089372379 wait complete. 2023-11-18T20:39:22.407 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-18T20:39:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.590+0000 7fb614d16640 1 Processor -- start 2023-11-18T20:39:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.590+0000 7fb614d16640 1 -- start start 2023-11-18T20:39:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb614d16640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb61014e7c0 0x7fb6100c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb614d16640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 0x7fb6100ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb614d16640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb610158a60 con 0x7fb6100ca990 2023-11-18T20:39:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb614d16640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100c5b10 con 0x7fb61014e7c0 2023-11-18T20:39:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb614d16640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb610157ca0 con 0x7fb6100c4c00 2023-11-18T20:39:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb60f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb61014e7c0 0x7fb6100c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb60f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb61014e7c0 0x7fb6100c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43226/0 (socket says 172.21.15.132:43226) 2023-11-18T20:39:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb60f7fe640 1 -- 172.21.15.132:0/1326093056 learned_addr learned my addr 172.21.15.132:0/1326093056 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb60f7fe640 1 -- 172.21.15.132:0/1326093056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 msgr2=0x7fb6100ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb60f7fe640 1 --2- 172.21.15.132:0/1326093056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 0x7fb6100ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb60f7fe640 1 -- 172.21.15.132:0/1326093056 >> v1:172.21.15.161:6789/0 conn(0x7fb6100ca990 legacy=0x7fb610154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.592+0000 7fb60f7fe640 1 -- 172.21.15.132:0/1326093056 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610157f80 con 0x7fb61014e7c0 2023-11-18T20:39:22.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.594+0000 7fb60f7fe640 1 --2- 172.21.15.132:0/1326093056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb6100c46c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb600009e50 tx=0x7fb60002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb80b47b8fa3189 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:22.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.594+0000 7fb60e7fc640 1 -- 172.21.15.132:0/1326093056 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60002c950 con 0x7fb61014e7c0 2023-11-18T20:39:22.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.594+0000 7fb60e7fc640 1 -- 172.21.15.132:0/1326093056 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60002cab0 con 0x7fb61014e7c0 2023-11-18T20:39:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.594+0000 7fb60e7fc640 1 -- 172.21.15.132:0/1326093056 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60002ce40 con 0x7fb61014e7c0 2023-11-18T20:39:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.595+0000 7fb614d16640 1 -- 172.21.15.132:0/1326093056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 msgr2=0x7fb6100c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.595+0000 7fb614d16640 1 --2- 172.21.15.132:0/1326093056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb6100c46c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb600009e50 tx=0x7fb60002bdb0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.595+0000 7fb614d16640 1 -- 172.21.15.132:0/1326093056 shutdown_connections 2023-11-18T20:39:22.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.595+0000 7fb614d16640 1 --2- 172.21.15.132:0/1326093056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 0x7fb6100ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.595+0000 7fb614d16640 1 --2- 172.21.15.132:0/1326093056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb6100c46c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.595+0000 7fb614d16640 1 -- 172.21.15.132:0/1326093056 >> 172.21.15.132:0/1326093056 conn(0x7fb6100abf00 msgr2=0x7fb6100c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:22.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.595+0000 7fb614d16640 1 -- 172.21.15.132:0/1326093056 shutdown_connections 2023-11-18T20:39:22.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.595+0000 7fb614d16640 1 -- 172.21.15.132:0/1326093056 wait complete. 2023-11-18T20:39:22.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.597+0000 7fb614d16640 1 Processor -- start 2023-11-18T20:39:22.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.597+0000 7fb614d16640 1 -- start start 2023-11-18T20:39:22.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.598+0000 7fb614d16640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 0x7fb6100c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:22.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.598+0000 7fb614d16640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6100ca990 0x7fb6100c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:22.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.598+0000 7fb614d16640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb610145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:22.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.598+0000 7fb614d16640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb610149b70 con 0x7fb61014e7c0 2023-11-18T20:39:22.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.598+0000 7fb614d16640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6101eaf10 con 0x7fb6100ca990 2023-11-18T20:39:22.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.598+0000 7fb614d16640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6101ea300 con 0x7fb6100c4c00 2023-11-18T20:39:22.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb610145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:22.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb610145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43240/0 (socket says 172.21.15.132:43240) 2023-11-18T20:39:22.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 -- 172.21.15.132:0/2852428649 learned_addr learned my addr 172.21.15.132:0/2852428649 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:22.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60f7fe640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 0x7fb6100c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:22.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60effd640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6100ca990 0x7fb6100c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:22.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 -- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 msgr2=0x7fb6100c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:22.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 0x7fb6100c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 -- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6100ca990 msgr2=0x7fb6100c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:22.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6100ca990 0x7fb6100c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:22.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 -- 172.21.15.132:0/2852428649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600009b30 con 0x7fb61014e7c0 2023-11-18T20:39:22.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60effd640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6100ca990 0x7fb6100c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:22.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.599+0000 7fb60ffff640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb610145f10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c410 tx=0x7fb60800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:22.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.600+0000 7fb607fff640 1 -- 172.21.15.132:0/2852428649 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608011790 con 0x7fb61014e7c0 2023-11-18T20:39:22.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.600+0000 7fb607fff640 1 -- 172.21.15.132:0/2852428649 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6080118f0 con 0x7fb61014e7c0 2023-11-18T20:39:22.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.600+0000 7fb607fff640 1 -- 172.21.15.132:0/2852428649 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608011ce0 con 0x7fb61014e7c0 2023-11-18T20:39:22.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.600+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6101ea5e0 con 0x7fb61014e7c0 2023-11-18T20:39:22.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.600+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6101eaba0 con 0x7fb61014e7c0 2023-11-18T20:39:22.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.601+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6101541a0 con 0x7fb61014e7c0 2023-11-18T20:39:22.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.602+0000 7fb607fff640 1 -- 172.21.15.132:0/2852428649 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb60801c460 con 0x7fb61014e7c0 2023-11-18T20:39:22.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.603+0000 7fb607fff640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5f006ae40 0x7fb5f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:22.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.603+0000 7fb607fff640 1 -- 172.21.15.132:0/2852428649 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fb6080895b0 con 0x7fb61014e7c0 2023-11-18T20:39:22.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.604+0000 7fb60f7fe640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5f006ae40 0x7fb5f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:22.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.605+0000 7fb60f7fe640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5f006ae40 0x7fb5f006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb600035000 tx=0x7fb600030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:22.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.608+0000 7fb607fff640 1 -- 172.21.15.132:0/2852428649 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6101541a0 con 0x7fb61014e7c0 2023-11-18T20:39:22.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:22.833+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fb6101541a0 con 0x7fb61014e7c0 2023-11-18T20:39:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.407+0000 7fb607fff640 1 -- 172.21.15.132:0/2852428649 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v16) v1 ==== 175+0+0 (secure 0 0 0) 0x7fb6101541a0 con 0x7fb61014e7c0 2023-11-18T20:39:23.409 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 6 and data pool 7 2023-11-18T20:39:23.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.414+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5f006ae40 msgr2=0x7fb5f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:23.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.414+0000 7fb614d16640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5f006ae40 0x7fb5f006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb600035000 tx=0x7fb600030000 comp rx=0 tx=0).stop 2023-11-18T20:39:23.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.414+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 msgr2=0x7fb610145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:23.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.414+0000 7fb614d16640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb610145f10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c410 tx=0x7fb60800c8d0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.415+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 shutdown_connections 2023-11-18T20:39:23.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.415+0000 7fb614d16640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5f006ae40 0x7fb5f006d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.415+0000 7fb614d16640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61014e7c0 0x7fb610145f10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.415+0000 7fb614d16640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6100ca990 0x7fb6100c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.415+0000 7fb614d16640 1 --2- 172.21.15.132:0/2852428649 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6100c4c00 0x7fb6100c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.415+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 >> 172.21.15.132:0/2852428649 conn(0x7fb6100abf00 msgr2=0x7fb610149dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:23.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.415+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 shutdown_connections 2023-11-18T20:39:23.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.416+0000 7fb614d16640 1 -- 172.21.15.132:0/2852428649 wait complete. 2023-11-18T20:39:23.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:23.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.627+0000 7f3c2759e640 1 Processor -- start 2023-11-18T20:39:23.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.628+0000 7f3c2759e640 1 -- start start 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.629+0000 7f3c2759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2806e000 0x7f3c280c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.629+0000 7f3c2759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c280c1100 0x7f3c280c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.629+0000 7f3c2759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c28159800 con 0x7f3c28155f60 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.629+0000 7f3c2759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2806c440 con 0x7f3c280c1100 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.629+0000 7f3c2759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28156340 con 0x7f3c2806e000 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.630+0000 7f3c1dd9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2806e000 0x7f3c280c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.630+0000 7f3c1dd9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2806e000 0x7f3c280c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:34034/0 (socket says 172.21.15.132:34034) 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.630+0000 7f3c1dd9b640 1 -- 172.21.15.132:0/602574752 learned_addr learned my addr 172.21.15.132:0/602574752 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:23.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.630+0000 7f3c26d9d640 1 --2- 172.21.15.132:0/602574752 >> v2:172.21.15.161:3300/0 conn(0x7f3c280c1100 0x7f3c280c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:23.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.630+0000 7f3c1dd9b640 1 -- 172.21.15.132:0/602574752 >> v2:172.21.15.161:3300/0 conn(0x7f3c280c1100 msgr2=0x7f3c280c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:23.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.630+0000 7f3c1dd9b640 1 --2- 172.21.15.132:0/602574752 >> v2:172.21.15.161:3300/0 conn(0x7f3c280c1100 0x7f3c280c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.631+0000 7f3c1dd9b640 1 -- 172.21.15.132:0/602574752 >> v1:172.21.15.161:6789/0 conn(0x7f3c28155f60 legacy=0x7f3c280c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:23.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.631+0000 7f3c1dd9b640 1 -- 172.21.15.132:0/602574752 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c28158a40 con 0x7f3c2806e000 2023-11-18T20:39:23.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.632+0000 7f3c1dd9b640 1 --2- 172.21.15.132:0/602574752 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2806e000 0x7f3c280c3940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009870 tx=0x7f3c1002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f774a788397716ec server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:23.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.632+0000 7f3c25d9b640 1 -- 172.21.15.132:0/602574752 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10030840 con 0x7f3c2806e000 2023-11-18T20:39:23.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.632+0000 7f3c25d9b640 1 -- 172.21.15.132:0/602574752 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c100309a0 con 0x7f3c2806e000 2023-11-18T20:39:23.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.632+0000 7f3c25d9b640 1 -- 172.21.15.132:0/602574752 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10030d30 con 0x7f3c2806e000 2023-11-18T20:39:23.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.633+0000 7f3c2759e640 1 -- 172.21.15.132:0/602574752 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2806e000 msgr2=0x7f3c280c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:23.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.633+0000 7f3c2759e640 1 --2- 172.21.15.132:0/602574752 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2806e000 0x7f3c280c3940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009870 tx=0x7f3c1002b980 comp rx=0 tx=0).stop 2023-11-18T20:39:23.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.633+0000 7f3c2759e640 1 -- 172.21.15.132:0/602574752 shutdown_connections 2023-11-18T20:39:23.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.633+0000 7f3c2759e640 1 --2- 172.21.15.132:0/602574752 >> v2:172.21.15.161:3300/0 conn(0x7f3c280c1100 0x7f3c280c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.633+0000 7f3c2759e640 1 --2- 172.21.15.132:0/602574752 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2806e000 0x7f3c280c3940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.633+0000 7f3c2759e640 1 -- 172.21.15.132:0/602574752 >> 172.21.15.132:0/602574752 conn(0x7f3c280a77f0 msgr2=0x7f3c280a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:23.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.633+0000 7f3c2759e640 1 -- 172.21.15.132:0/602574752 shutdown_connections 2023-11-18T20:39:23.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.633+0000 7f3c2759e640 1 -- 172.21.15.132:0/602574752 wait complete. 2023-11-18T20:39:23.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.635+0000 7f3c2759e640 1 Processor -- start 2023-11-18T20:39:23.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.635+0000 7f3c2759e640 1 -- start start 2023-11-18T20:39:23.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c2759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2806e000 0x7f3c281e3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c2759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c280c1100 0x7f3c28071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c2759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c28155f60 0x7f3c281e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c2759e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a3940 con 0x7f3c280c1100 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c2759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281e3d40 con 0x7f3c2806e000 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c2759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a4920 con 0x7f3c28155f60 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c1dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c280c1100 0x7f3c28071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c1dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c280c1100 0x7f3c28071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43246/0 (socket says 172.21.15.132:43246) 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.636+0000 7f3c1dd9b640 1 -- 172.21.15.132:0/1070781885 learned_addr learned my addr 172.21.15.132:0/1070781885 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c2659c640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2806e000 0x7f3c281e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c1dd9b640 1 -- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c28155f60 msgr2=0x7f3c281e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:23.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c26d9d640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c28155f60 0x7f3c281e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:23.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c1dd9b640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c28155f60 0x7f3c281e1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c1dd9b640 1 -- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2806e000 msgr2=0x7f3c281e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:23.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c1dd9b640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2806e000 0x7f3c281e3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c1dd9b640 1 -- 172.21.15.132:0/1070781885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c100094d0 con 0x7f3c280c1100 2023-11-18T20:39:23.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c1dd9b640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c280c1100 0x7f3c28071060 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3c1002b9c0 tx=0x7f3c10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:23.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c1f7fe640 1 -- 172.21.15.132:0/1070781885 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10039c90 con 0x7f3c280c1100 2023-11-18T20:39:23.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c1f7fe640 1 -- 172.21.15.132:0/1070781885 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10039df0 con 0x7f3c280c1100 2023-11-18T20:39:23.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.637+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c281e4860 con 0x7f3c280c1100 2023-11-18T20:39:23.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.638+0000 7f3c1f7fe640 1 -- 172.21.15.132:0/1070781885 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100446c0 con 0x7f3c280c1100 2023-11-18T20:39:23.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.638+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c281e42a0 con 0x7f3c280c1100 2023-11-18T20:39:23.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.639+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c281e4100 con 0x7f3c280c1100 2023-11-18T20:39:23.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.640+0000 7f3c1f7fe640 1 -- 172.21.15.132:0/1070781885 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c1004d3b0 con 0x7f3c280c1100 2023-11-18T20:39:23.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.641+0000 7f3c1f7fe640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3c0806ae40 0x7f3c0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.641+0000 7f3c1f7fe640 1 -- 172.21.15.132:0/1070781885 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3c1003e070 con 0x7f3c280c1100 2023-11-18T20:39:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.641+0000 7f3c2659c640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3c0806ae40 0x7f3c0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:23.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.642+0000 7f3c2659c640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3c0806ae40 0x7f3c0806d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3c280bfd40 tx=0x7f3c18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:23.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.645+0000 7f3c1f7fe640 1 -- 172.21.15.132:0/1070781885 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c281e4100 con 0x7f3c280c1100 2023-11-18T20:39:23.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.829+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c281e4100 con 0x7f3c280c1100 2023-11-18T20:39:23.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.833+0000 7f3c1f7fe640 1 -- 172.21.15.132:0/1070781885 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20214 (secure 0 0 0) 0x7f3c281e4100 con 0x7f3c280c1100 2023-11-18T20:39:23.834 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:23.835 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:22.834612+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:23.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.835+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3c0806ae40 msgr2=0x7f3c0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:23.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.835+0000 7f3c2759e640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3c0806ae40 0x7f3c0806d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3c280bfd40 tx=0x7f3c18009040 comp rx=0 tx=0).stop 2023-11-18T20:39:23.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.835+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c280c1100 msgr2=0x7f3c28071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:23.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.835+0000 7f3c2759e640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c280c1100 0x7f3c28071060 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3c1002b9c0 tx=0x7f3c10004730 comp rx=0 tx=0).stop 2023-11-18T20:39:23.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.836+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 shutdown_connections 2023-11-18T20:39:23.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.836+0000 7f3c2759e640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3c0806ae40 0x7f3c0806d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.836+0000 7f3c2759e640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c28155f60 0x7f3c281e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.836+0000 7f3c2759e640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c280c1100 0x7f3c28071060 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.836+0000 7f3c2759e640 1 --2- 172.21.15.132:0/1070781885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2806e000 0x7f3c281e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:23.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.836+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 >> 172.21.15.132:0/1070781885 conn(0x7f3c280a77f0 msgr2=0x7f3c280c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:23.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.836+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 shutdown_connections 2023-11-18T20:39:23.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:23.836+0000 7f3c2759e640 1 -- 172.21.15.132:0/1070781885 wait complete. 2023-11-18T20:39:23.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.058+0000 7f0b45232640 1 Processor -- start 2023-11-18T20:39:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.058+0000 7f0b45232640 1 -- start start 2023-11-18T20:39:24.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.059+0000 7f0b45232640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0b4014c2e0 0x7f0b400c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.060+0000 7f0b45232640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b40072310 0x7f0b400a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.060+0000 7f0b45232640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b40071e80 con 0x7f0b400c0440 2023-11-18T20:39:24.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.060+0000 7f0b45232640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b40071470 con 0x7f0b40072310 2023-11-18T20:39:24.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.060+0000 7f0b45232640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4014c6c0 con 0x7f0b4014c2e0 2023-11-18T20:39:24.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.060+0000 7f0b3f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0b400c0440 0x7f0b40152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51098/0 (socket says 172.21.15.132:51098) 2023-11-18T20:39:24.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.060+0000 7f0b3f7fe640 1 -- 172.21.15.132:0/1641561405 learned_addr learned my addr 172.21.15.132:0/1641561405 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:24.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.060+0000 7f0b44a31640 1 --2- 172.21.15.132:0/1641561405 >> v2:172.21.15.132:3300/0 conn(0x7f0b40072310 0x7f0b400a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.060+0000 7f0b3ffff640 1 --2- 172.21.15.132:0/1641561405 >> v2:172.21.15.161:3300/0 conn(0x7f0b4014c2e0 0x7f0b400c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.061+0000 7f0b3effd640 1 -- 172.21.15.132:0/1641561405 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570428704 0 0) 0x7f0b40071e80 con 0x7f0b400c0440 2023-11-18T20:39:24.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.061+0000 7f0b3effd640 1 -- 172.21.15.132:0/1641561405 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b28003520 con 0x7f0b400c0440 2023-11-18T20:39:24.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.061+0000 7f0b44a31640 1 -- 172.21.15.132:0/1641561405 >> v2:172.21.15.161:3300/0 conn(0x7f0b4014c2e0 msgr2=0x7f0b400c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:24.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.061+0000 7f0b44a31640 1 --2- 172.21.15.132:0/1641561405 >> v2:172.21.15.161:3300/0 conn(0x7f0b4014c2e0 0x7f0b400c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.061+0000 7f0b44a31640 1 -- 172.21.15.132:0/1641561405 >> v1:172.21.15.132:6789/0 conn(0x7f0b400c0440 legacy=0x7f0b40152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.061+0000 7f0b44a31640 1 -- 172.21.15.132:0/1641561405 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4006fdc0 con 0x7f0b40072310 2023-11-18T20:39:24.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.061+0000 7f0b3ffff640 1 --2- 172.21.15.132:0/1641561405 >> v2:172.21.15.161:3300/0 conn(0x7f0b4014c2e0 0x7f0b400c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:39:24.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.062+0000 7f0b44a31640 1 --2- 172.21.15.132:0/1641561405 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b400a4d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0b40067940 tx=0x7f0b3802bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b6b8dd65712a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:24.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.062+0000 7f0b3effd640 1 -- 172.21.15.132:0/1641561405 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3802cb50 con 0x7f0b40072310 2023-11-18T20:39:24.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.062+0000 7f0b3effd640 1 -- 172.21.15.132:0/1641561405 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3802ccb0 con 0x7f0b40072310 2023-11-18T20:39:24.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.062+0000 7f0b3effd640 1 -- 172.21.15.132:0/1641561405 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38034660 con 0x7f0b40072310 2023-11-18T20:39:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.063+0000 7f0b45232640 1 -- 172.21.15.132:0/1641561405 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 msgr2=0x7f0b400a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.063+0000 7f0b45232640 1 --2- 172.21.15.132:0/1641561405 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b400a4d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0b40067940 tx=0x7f0b3802bda0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.063+0000 7f0b45232640 1 -- 172.21.15.132:0/1641561405 shutdown_connections 2023-11-18T20:39:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.063+0000 7f0b45232640 1 --2- 172.21.15.132:0/1641561405 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b400a4d20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.063+0000 7f0b45232640 1 --2- 172.21.15.132:0/1641561405 >> v2:172.21.15.161:3300/0 conn(0x7f0b4014c2e0 0x7f0b400c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.063+0000 7f0b45232640 1 -- 172.21.15.132:0/1641561405 >> 172.21.15.132:0/1641561405 conn(0x7f0b400a77f0 msgr2=0x7f0b400a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.063+0000 7f0b45232640 1 -- 172.21.15.132:0/1641561405 shutdown_connections 2023-11-18T20:39:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.063+0000 7f0b45232640 1 -- 172.21.15.132:0/1641561405 wait complete. 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.064+0000 7f0b45232640 1 Processor -- start 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.065+0000 7f0b45232640 1 -- start start 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.065+0000 7f0b45232640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b401e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.065+0000 7f0b45232640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b400c0440 0x7f0b400ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.065+0000 7f0b45232640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b4014c2e0 0x7f0b4013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.065+0000 7f0b45232640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4014f960 con 0x7f0b40072310 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.065+0000 7f0b45232640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40147960 con 0x7f0b400c0440 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.065+0000 7f0b45232640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40147c40 con 0x7f0b4014c2e0 2023-11-18T20:39:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b401e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b401e9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43268/0 (socket says 172.21.15.132:43268) 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 -- 172.21.15.132:0/4281817394 learned_addr learned my addr 172.21.15.132:0/4281817394 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 -- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b4014c2e0 msgr2=0x7f0b4013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b4014c2e0 0x7f0b4013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 -- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b400c0440 msgr2=0x7f0b400ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b400c0440 0x7f0b400ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 -- 172.21.15.132:0/4281817394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38009a70 con 0x7f0b40072310 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3ffff640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b401e9bd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d7d0 tx=0x7f0b3000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.066+0000 7f0b3cff9640 1 -- 172.21.15.132:0/4281817394 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30004030 con 0x7f0b40072310 2023-11-18T20:39:24.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.067+0000 7f0b3cff9640 1 -- 172.21.15.132:0/4281817394 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30004190 con 0x7f0b40072310 2023-11-18T20:39:24.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.067+0000 7f0b3cff9640 1 -- 172.21.15.132:0/4281817394 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000b6c0 con 0x7f0b40072310 2023-11-18T20:39:24.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.067+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b40147f20 con 0x7f0b40072310 2023-11-18T20:39:24.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.067+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b401484e0 con 0x7f0b40072310 2023-11-18T20:39:24.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.068+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4004e840 con 0x7f0b40072310 2023-11-18T20:39:24.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.069+0000 7f0b3cff9640 1 -- 172.21.15.132:0/4281817394 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b3000b820 con 0x7f0b40072310 2023-11-18T20:39:24.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.069+0000 7f0b3cff9640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0b2c06ae40 0x7f0b2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.070+0000 7f0b3cff9640 1 -- 172.21.15.132:0/4281817394 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0b30089b00 con 0x7f0b40072310 2023-11-18T20:39:24.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.070+0000 7f0b3f7fe640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0b2c06ae40 0x7f0b2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.071+0000 7f0b3f7fe640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0b2c06ae40 0x7f0b2c06d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0b400aa230 tx=0x7f0b34007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:24.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.074+0000 7f0b3cff9640 1 -- 172.21.15.132:0/4281817394 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b300548e0 con 0x7f0b40072310 2023-11-18T20:39:24.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.247+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b400c5380 con 0x7f0b40072310 2023-11-18T20:39:24.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.250+0000 7f0b3cff9640 1 -- 172.21.15.132:0/4281817394 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20214 (secure 0 0 0) 0x7f0b30057f00 con 0x7f0b40072310 2023-11-18T20:39:24.251 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:24.252 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:22.834612+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:24.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.252+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0b2c06ae40 msgr2=0x7f0b2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.252+0000 7f0b45232640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0b2c06ae40 0x7f0b2c06d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0b400aa230 tx=0x7f0b34007930 comp rx=0 tx=0).stop 2023-11-18T20:39:24.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.252+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 msgr2=0x7f0b401e9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.252+0000 7f0b45232640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b401e9bd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d7d0 tx=0x7f0b3000dc90 comp rx=0 tx=0).stop 2023-11-18T20:39:24.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.253+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 shutdown_connections 2023-11-18T20:39:24.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.253+0000 7f0b45232640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0b2c06ae40 0x7f0b2c06d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.253+0000 7f0b45232640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b4014c2e0 0x7f0b4013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.253+0000 7f0b45232640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b400c0440 0x7f0b400ab3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.253+0000 7f0b45232640 1 --2- 172.21.15.132:0/4281817394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b40072310 0x7f0b401e9bd0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.253+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 >> 172.21.15.132:0/4281817394 conn(0x7f0b400a77f0 msgr2=0x7f0b4014a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:24.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.253+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 shutdown_connections 2023-11-18T20:39:24.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.253+0000 7f0b45232640 1 -- 172.21.15.132:0/4281817394 wait complete. 2023-11-18T20:39:24.272 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-18T20:39:24.607 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-11-18T20:39:24.605+0000 7fc711c9c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:39:24.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.633+0000 7f8ea6bb0640 1 Processor -- start 2023-11-18T20:39:24.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.633+0000 7f8ea6bb0640 1 -- start start 2023-11-18T20:39:24.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.634+0000 7f8ea6bb0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8ea00c1500 0x7f8ea00c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.634+0000 7f8ea6bb0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00c06c0 con 0x7f8ea0155490 2023-11-18T20:39:24.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.634+0000 7f8ea6bb0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00c1020 con 0x7f8ea00a9b40 2023-11-18T20:39:24.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.634+0000 7f8ea6bb0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea00a5820 con 0x7f8ea00c1500 2023-11-18T20:39:24.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8ea494c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8ea0155490 0x7f8ea00a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51106/0 (socket says 172.21.15.132:51106) 2023-11-18T20:39:24.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8ea494c640 1 -- 172.21.15.132:0/2400201245 learned_addr learned my addr 172.21.15.132:0/2400201245 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270250257 0 0) 0x7f8ea00c06c0 con 0x7f8ea0155490 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8ea514d640 1 --2- 172.21.15.132:0/2400201245 >> v2:172.21.15.161:3300/0 conn(0x7f8ea00c1500 0x7f8ea00c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e8c005730 con 0x7f8ea0155490 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1209719047 0 0) 0x7f8e8c005730 con 0x7f8ea0155490 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 >> v2:172.21.15.161:3300/0 conn(0x7f8ea00c1500 msgr2=0x7f8ea00c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8e9f7fe640 1 --2- 172.21.15.132:0/2400201245 >> v2:172.21.15.161:3300/0 conn(0x7f8ea00c1500 0x7f8ea00c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.635+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 >> v1:172.21.15.161:6789/0 conn(0x7f8ea00a9b40 legacy=0x7f8ea00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00c0910 con 0x7f8ea0155490 2023-11-18T20:39:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f8e900019f0 con 0x7f8ea0155490 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 >> v1:172.21.15.132:6789/0 conn(0x7f8ea0155490 legacy=0x7f8ea00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c005b80 0x7f8e8c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e8c0069d0 0x7f8e8c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8e8c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c00e200 con 0x7f8e8c007390 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c00e370 con 0x7f8e8c005b80 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c00e530 con 0x7f8e8c0069d0 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8ea514d640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8e8c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8ea494c640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c005b80 0x7f8e8c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8ea514d640 1 -- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e8c0069d0 msgr2=0x7f8e8c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8e9ffff640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e8c0069d0 0x7f8e8c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8ea514d640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e8c0069d0 0x7f8e8c006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8ea514d640 1 -- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c005b80 msgr2=0x7f8e8c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.636+0000 7f8ea514d640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c005b80 0x7f8e8c005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.637+0000 7f8ea514d640 1 -- 172.21.15.132:0/2400201245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c005730 con 0x7f8e8c007390 2023-11-18T20:39:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.637+0000 7f8ea494c640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c005b80 0x7f8e8c005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:24.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.637+0000 7f8ea514d640 1 -- 172.21.15.132:0/2400201245 reap_dead start 2023-11-18T20:39:24.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8ea514d640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8e8c00db90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009ac0 tx=0x7f8e8c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689522e10bf6eb8f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:24.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98004020 con 0x7f8e8c007390 2023-11-18T20:39:24.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98004180 con 0x7f8e8c007390 2023-11-18T20:39:24.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8e9f7fe640 1 -- 172.21.15.132:0/2400201245 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9802c710 con 0x7f8e8c007390 2023-11-18T20:39:24.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/2400201245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 msgr2=0x7f8e8c00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8ea6bb0640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8e8c00db90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009ac0 tx=0x7f8e8c007a00 comp rx=0 tx=0).stop 2023-11-18T20:39:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/2400201245 shutdown_connections 2023-11-18T20:39:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8ea6bb0640 1 --2- 172.21.15.132:0/2400201245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8e8c00db90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.638+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/2400201245 >> 172.21.15.132:0/2400201245 conn(0x7f8ea006a500 msgr2=0x7f8ea006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.639+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/2400201245 shutdown_connections 2023-11-18T20:39:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.639+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/2400201245 wait complete. 2023-11-18T20:39:24.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.640+0000 7f8ea6bb0640 1 Processor -- start 2023-11-18T20:39:24.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.641+0000 7f8ea6bb0640 1 -- start start 2023-11-18T20:39:24.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea6bb0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8ea00c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea6bb0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ea00bf210 0x7f8ea014ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea6bb0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ea014f3b0 0x7f8ea006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea6bb0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00712d0 con 0x7f8e8c007390 2023-11-18T20:39:24.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea6bb0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00715b0 con 0x7f8ea014f3b0 2023-11-18T20:39:24.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea6bb0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00bfd40 con 0x7f8ea00bf210 2023-11-18T20:39:24.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea494c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8ea00c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea494c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8ea00c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43280/0 (socket says 172.21.15.132:43280) 2023-11-18T20:39:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea494c640 1 -- 172.21.15.132:0/1160479948 learned_addr learned my addr 172.21.15.132:0/1160479948 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea494c640 1 -- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ea00bf210 msgr2=0x7f8ea014ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea494c640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ea00bf210 0x7f8ea014ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea494c640 1 -- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ea014f3b0 msgr2=0x7f8ea006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea514d640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ea014f3b0 0x7f8ea006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea494c640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ea014f3b0 0x7f8ea006fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea494c640 1 -- 172.21.15.132:0/1160479948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00c0020 con 0x7f8e8c007390 2023-11-18T20:39:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.642+0000 7f8ea514d640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ea014f3b0 0x7f8ea006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.643+0000 7f8ea494c640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8ea00c56d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8e90001370 tx=0x7f8e9000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.643+0000 7f8e9d7fa640 1 -- 172.21.15.132:0/1160479948 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90004d60 con 0x7f8e8c007390 2023-11-18T20:39:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.643+0000 7f8e9d7fa640 1 -- 172.21.15.132:0/1160479948 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000be20 con 0x7f8e8c007390 2023-11-18T20:39:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.643+0000 7f8e9d7fa640 1 -- 172.21.15.132:0/1160479948 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900072d0 con 0x7f8e8c007390 2023-11-18T20:39:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.643+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea00c5c10 con 0x7f8e8c007390 2023-11-18T20:39:24.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.643+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea00be260 con 0x7f8e8c007390 2023-11-18T20:39:24.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.644+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea014f790 con 0x7f8e8c007390 2023-11-18T20:39:24.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.645+0000 7f8e9d7fa640 1 -- 172.21.15.132:0/1160479948 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e90007430 con 0x7f8e8c007390 2023-11-18T20:39:24.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.646+0000 7f8e9d7fa640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e8006ae40 0x7f8e8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:24.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.646+0000 7f8e9d7fa640 1 -- 172.21.15.132:0/1160479948 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8e900898d0 con 0x7f8e8c007390 2023-11-18T20:39:24.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.647+0000 7f8e9ffff640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e8006ae40 0x7f8e8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:24.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.648+0000 7f8e9ffff640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e8006ae40 0x7f8e8006d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e88000f60 tx=0x7f8e88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:24.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.651+0000 7f8e9d7fa640 1 -- 172.21.15.132:0/1160479948 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e900546b0 con 0x7f8e8c007390 2023-11-18T20:39:24.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:24.881+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ea0068350 con 0x7f8e8c007390 2023-11-18T20:39:25.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.420+0000 7f8e9d7fa640 1 -- 172.21.15.132:0/1160479948 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 119+0+0 (secure 0 0 0) 0x7f8e900190b0 con 0x7f8e8c007390 2023-11-18T20:39:25.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e8006ae40 msgr2=0x7f8e8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:25.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e8006ae40 0x7f8e8006d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e88000f60 tx=0x7f8e88009040 comp rx=0 tx=0).stop 2023-11-18T20:39:25.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 msgr2=0x7f8ea00c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:25.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8ea00c56d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8e90001370 tx=0x7f8e9000b4a0 comp rx=0 tx=0).stop 2023-11-18T20:39:25.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 shutdown_connections 2023-11-18T20:39:25.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8e8006ae40 0x7f8e8006d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:25.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ea014f3b0 0x7f8ea006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:25.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ea00bf210 0x7f8ea014ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:25.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 --2- 172.21.15.132:0/1160479948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c007390 0x7f8ea00c56d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:25.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 >> 172.21.15.132:0/1160479948 conn(0x7f8ea006a500 msgr2=0x7f8ea0152540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:25.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.424+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 shutdown_connections 2023-11-18T20:39:25.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.425+0000 7f8ea6bb0640 1 -- 172.21.15.132:0/1160479948 wait complete. 2023-11-18T20:39:25.445 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T20:39:25.445 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-18T20:39:25.628 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:39:25.637 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:39:25.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.658+0000 7f7b73933640 1 Processor -- start 2023-11-18T20:39:25.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.658+0000 7f7b73933640 1 -- start start 2023-11-18T20:39:25.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.659+0000 7f7b73933640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7b6c0c45d0 0x7f7b6c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:25.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.659+0000 7f7b73933640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0bfdc0 con 0x7f7b6c0c3340 2023-11-18T20:39:25.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.659+0000 7f7b73933640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c156a80 con 0x7f7b6c0c5ec0 2023-11-18T20:39:25.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.659+0000 7f7b73933640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c06e390 con 0x7f7b6c0c45d0 2023-11-18T20:39:25.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b71ed0640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7b6c0c3340 0x7f7b6c156370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51108/0 (socket says 172.21.15.132:51108) 2023-11-18T20:39:25.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b71ed0640 1 -- 172.21.15.132:0/1225598080 learned_addr learned my addr 172.21.15.132:0/1225598080 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:25.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b70ece640 1 --2- 172.21.15.132:0/1225598080 >> v2:172.21.15.161:3300/0 conn(0x7f7b6c0c45d0 0x7f7b6c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:25.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b63fff640 1 -- 172.21.15.132:0/1225598080 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882585844 0 0) 0x7f7b6c0bfdc0 con 0x7f7b6c0c3340 2023-11-18T20:39:25.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b63fff640 1 -- 172.21.15.132:0/1225598080 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b58003520 con 0x7f7b6c0c3340 2023-11-18T20:39:25.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b63fff640 1 -- 172.21.15.132:0/1225598080 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42311855 0 0) 0x7f7b6c156a80 con 0x7f7b6c0c5ec0 2023-11-18T20:39:25.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b63fff640 1 -- 172.21.15.132:0/1225598080 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b6c0bfdc0 con 0x7f7b6c0c5ec0 2023-11-18T20:39:25.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b70ece640 1 -- 172.21.15.132:0/1225598080 >> v1:172.21.15.161:6789/0 conn(0x7f7b6c0c5ec0 legacy=0x7f7b6c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:25.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b70ece640 1 -- 172.21.15.132:0/1225598080 >> v1:172.21.15.132:6789/0 conn(0x7f7b6c0c3340 legacy=0x7f7b6c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:25.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.660+0000 7f7b70ece640 1 -- 172.21.15.132:0/1225598080 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c06ddd0 con 0x7f7b6c0c45d0 2023-11-18T20:39:25.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.662+0000 7f7b70ece640 1 --2- 172.21.15.132:0/1225598080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c45d0 0x7f7b6c155e30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0097d0 tx=0x7f7b5c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=861527241527117c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:25.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.662+0000 7f7b63fff640 1 -- 172.21.15.132:0/1225598080 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0316f0 con 0x7f7b6c0c45d0 2023-11-18T20:39:25.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.662+0000 7f7b63fff640 1 -- 172.21.15.132:0/1225598080 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c031850 con 0x7f7b6c0c45d0 2023-11-18T20:39:25.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.662+0000 7f7b63fff640 1 -- 172.21.15.132:0/1225598080 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c031bc0 con 0x7f7b6c0c45d0 2023-11-18T20:39:25.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.663+0000 7f7b73933640 1 -- 172.21.15.132:0/1225598080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c45d0 msgr2=0x7f7b6c155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:25.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.663+0000 7f7b73933640 1 --2- 172.21.15.132:0/1225598080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c45d0 0x7f7b6c155e30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0097d0 tx=0x7f7b5c02b790 comp rx=0 tx=0).stop 2023-11-18T20:39:25.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.663+0000 7f7b73933640 1 -- 172.21.15.132:0/1225598080 shutdown_connections 2023-11-18T20:39:25.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.663+0000 7f7b73933640 1 --2- 172.21.15.132:0/1225598080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c45d0 0x7f7b6c155e30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:25.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.663+0000 7f7b73933640 1 -- 172.21.15.132:0/1225598080 >> 172.21.15.132:0/1225598080 conn(0x7f7b6c06a500 msgr2=0x7f7b6c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:25.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.663+0000 7f7b73933640 1 -- 172.21.15.132:0/1225598080 shutdown_connections 2023-11-18T20:39:25.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.663+0000 7f7b73933640 1 -- 172.21.15.132:0/1225598080 wait complete. 2023-11-18T20:39:25.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.665+0000 7f7b73933640 1 Processor -- start 2023-11-18T20:39:25.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.665+0000 7f7b73933640 1 -- start start 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b73933640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b6c0c3340 0x7f7b6c1ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b73933640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b6c0c45d0 0x7f7b6c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b73933640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c5ec0 0x7f7b6c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b73933640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0a6ee0 con 0x7f7b6c0c3340 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b73933640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1eadf0 con 0x7f7b6c0c5ec0 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b73933640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0a7130 con 0x7f7b6c0c45d0 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b716cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b6c0c3340 0x7f7b6c1ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b716cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b6c0c3340 0x7f7b6c1ea8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43284/0 (socket says 172.21.15.132:43284) 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b716cf640 1 -- 172.21.15.132:0/1735930358 learned_addr learned my addr 172.21.15.132:0/1735930358 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b70ece640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b6c0c45d0 0x7f7b6c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b71ed0640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c5ec0 0x7f7b6c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:25.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b716cf640 1 -- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b6c0c45d0 msgr2=0x7f7b6c157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.666+0000 7f7b716cf640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b6c0c45d0 0x7f7b6c157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b716cf640 1 -- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c5ec0 msgr2=0x7f7b6c0a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b716cf640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c5ec0 0x7f7b6c0a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b716cf640 1 -- 172.21.15.132:0/1735930358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c009400 con 0x7f7b6c0c3340 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b71ed0640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c5ec0 0x7f7b6c0a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b716cf640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b6c0c3340 0x7f7b6c1ea8b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800c460 tx=0x7f7b6800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b61ffb640 1 -- 172.21.15.132:0/1735930358 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68005480 con 0x7f7b6c0c3340 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b61ffb640 1 -- 172.21.15.132:0/1735930358 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b680035f0 con 0x7f7b6c0c3340 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b61ffb640 1 -- 172.21.15.132:0/1735930358 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b680039e0 con 0x7f7b6c0c3340 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c0a7410 con 0x7f7b6c0c3340 2023-11-18T20:39:25.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.667+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c0a5870 con 0x7f7b6c0c3340 2023-11-18T20:39:25.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.669+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c0c5540 con 0x7f7b6c0c3340 2023-11-18T20:39:25.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.669+0000 7f7b61ffb640 1 -- 172.21.15.132:0/1735930358 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b68003b40 con 0x7f7b6c0c3340 2023-11-18T20:39:25.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.670+0000 7f7b61ffb640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b5006ae70 0x7f7b5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:25.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.670+0000 7f7b61ffb640 1 -- 172.21.15.132:0/1735930358 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7b68088e30 con 0x7f7b6c0c3340 2023-11-18T20:39:25.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.671+0000 7f7b70ece640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b5006ae70 0x7f7b5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:25.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.671+0000 7f7b70ece640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b5006ae70 0x7f7b5006d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c036000 tx=0x7f7b5c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:25.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.675+0000 7f7b61ffb640 1 -- 172.21.15.132:0/1735930358 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b68053c20 con 0x7f7b6c0c3340 2023-11-18T20:39:25.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:25.903+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7b6c0c6b60 con 0x7f7b6c0c3340 2023-11-18T20:39:26.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.424+0000 7f7b61ffb640 1 -- 172.21.15.132:0/1735930358 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7b68017070 con 0x7f7b6c0c3340 2023-11-18T20:39:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b5006ae70 msgr2=0x7f7b5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b5006ae70 0x7f7b5006d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c036000 tx=0x7f7b5c008030 comp rx=0 tx=0).stop 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b6c0c3340 msgr2=0x7f7b6c1ea8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b6c0c3340 0x7f7b6c1ea8b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800c460 tx=0x7f7b6800c920 comp rx=0 tx=0).stop 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 shutdown_connections 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b5006ae70 0x7f7b5006d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b6c0c5ec0 0x7f7b6c0a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b6c0c45d0 0x7f7b6c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 --2- 172.21.15.132:0/1735930358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b6c0c3340 0x7f7b6c1ea8b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 >> 172.21.15.132:0/1735930358 conn(0x7f7b6c06a500 msgr2=0x7f7b6c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 shutdown_connections 2023-11-18T20:39:26.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.428+0000 7f7b73933640 1 -- 172.21.15.132:0/1735930358 wait complete. 2023-11-18T20:39:26.452 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-18T20:39:26.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:39:26.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.662+0000 7f0736d1d640 1 Processor -- start 2023-11-18T20:39:26.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.662+0000 7f0736d1d640 1 -- start start 2023-11-18T20:39:26.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f0736d1d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f073014fd30 0x7f0730152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:26.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f0736d1d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f073006d0a0 0x7f07300a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:26.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f0736d1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 0x7f07300c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:26.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f0736d1d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300c64a0 con 0x7f073006d0a0 2023-11-18T20:39:26.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f0736d1d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300c5c00 con 0x7f073014fd30 2023-11-18T20:39:26.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f0736d1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07300c5ee0 con 0x7f07300a5260 2023-11-18T20:39:26.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f072ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f073006d0a0 0x7f07300a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:26.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f072ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f073006d0a0 0x7f07300a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43290/0 (socket says 172.21.15.132:43290) 2023-11-18T20:39:26.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.663+0000 7f072ffff640 1 -- 172.21.15.132:0/1843875878 learned_addr learned my addr 172.21.15.132:0/1843875878 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.664+0000 7f072ffff640 1 -- 172.21.15.132:0/1843875878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 msgr2=0x7f07300c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.664+0000 7f072ffff640 1 --2- 172.21.15.132:0/1843875878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 0x7f07300c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.664+0000 7f072ffff640 1 -- 172.21.15.132:0/1843875878 >> v2:172.21.15.161:3300/0 conn(0x7f073014fd30 msgr2=0x7f0730152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.664+0000 7f072ffff640 1 --2- 172.21.15.132:0/1843875878 >> v2:172.21.15.161:3300/0 conn(0x7f073014fd30 0x7f0730152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.664+0000 7f072ffff640 1 -- 172.21.15.132:0/1843875878 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300c61c0 con 0x7f073006d0a0 2023-11-18T20:39:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.665+0000 7f072ffff640 1 --2- 172.21.15.132:0/1843875878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073006d0a0 0x7f07300a4d20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f073006b200 tx=0x7f071c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c064ed1542819ce8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:26.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.665+0000 7f072f7fe640 1 -- 172.21.15.132:0/1843875878 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c031870 con 0x7f073006d0a0 2023-11-18T20:39:26.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.665+0000 7f072f7fe640 1 -- 172.21.15.132:0/1843875878 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c0319d0 con 0x7f073006d0a0 2023-11-18T20:39:26.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.665+0000 7f072f7fe640 1 -- 172.21.15.132:0/1843875878 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c031d60 con 0x7f073006d0a0 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 -- 172.21.15.132:0/1843875878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073006d0a0 msgr2=0x7f07300a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 --2- 172.21.15.132:0/1843875878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073006d0a0 0x7f07300a4d20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f073006b200 tx=0x7f071c02b910 comp rx=0 tx=0).stop 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 -- 172.21.15.132:0/1843875878 shutdown_connections 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 --2- 172.21.15.132:0/1843875878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 0x7f07300c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 --2- 172.21.15.132:0/1843875878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073006d0a0 0x7f07300a4d20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 --2- 172.21.15.132:0/1843875878 >> v2:172.21.15.161:3300/0 conn(0x7f073014fd30 0x7f0730152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 -- 172.21.15.132:0/1843875878 >> 172.21.15.132:0/1843875878 conn(0x7f073006a500 msgr2=0x7f073006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 -- 172.21.15.132:0/1843875878 shutdown_connections 2023-11-18T20:39:26.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.666+0000 7f0736d1d640 1 -- 172.21.15.132:0/1843875878 wait complete. 2023-11-18T20:39:26.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.668+0000 7f0736d1d640 1 Processor -- start 2023-11-18T20:39:26.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.668+0000 7f0736d1d640 1 -- start start 2023-11-18T20:39:26.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f0736d1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f073006d0a0 0x7f07301edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:26.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f0736d1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 0x7f0730071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:26.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f0736d1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073014fd30 0x7f07301490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:26.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f0736d1d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07300a6f00 con 0x7f073014fd30 2023-11-18T20:39:26.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f0736d1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07301ee2c0 con 0x7f073006d0a0 2023-11-18T20:39:26.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f0736d1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07301de030 con 0x7f07300a5260 2023-11-18T20:39:26.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f07352ba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073014fd30 0x7f07301490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:26.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f07352ba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073014fd30 0x7f07301490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43298/0 (socket says 172.21.15.132:43298) 2023-11-18T20:39:26.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.669+0000 7f07352ba640 1 -- 172.21.15.132:0/752065632 learned_addr learned my addr 172.21.15.132:0/752065632 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:26.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f072ffff640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 0x7f0730071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:26.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f0734ab9640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f073006d0a0 0x7f07301edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:26.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f07352ba640 1 -- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 msgr2=0x7f0730071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:26.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f07352ba640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 0x7f0730071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f07352ba640 1 -- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f073006d0a0 msgr2=0x7f07301edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:26.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f07352ba640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f073006d0a0 0x7f07301edd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f07352ba640 1 -- 172.21.15.132:0/752065632 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c0094d0 con 0x7f073014fd30 2023-11-18T20:39:26.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f072ffff640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 0x7f0730071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:26.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f0734ab9640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f073006d0a0 0x7f07301edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:26.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f07352ba640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073014fd30 0x7f07301490d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f072800b9a0 tx=0x7f072800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:26.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f072d7fa640 1 -- 172.21.15.132:0/752065632 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072800cba0 con 0x7f073014fd30 2023-11-18T20:39:26.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f072d7fa640 1 -- 172.21.15.132:0/752065632 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072800cd20 con 0x7f073014fd30 2023-11-18T20:39:26.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f072d7fa640 1 -- 172.21.15.132:0/752065632 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728014680 con 0x7f073014fd30 2023-11-18T20:39:26.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.670+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07301de310 con 0x7f073014fd30 2023-11-18T20:39:26.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.671+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07300a7450 con 0x7f073014fd30 2023-11-18T20:39:26.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.672+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07300a7640 con 0x7f073014fd30 2023-11-18T20:39:26.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.672+0000 7f072d7fa640 1 -- 172.21.15.132:0/752065632 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f072801d3b0 con 0x7f073014fd30 2023-11-18T20:39:26.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.673+0000 7f072d7fa640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f071406ae40 0x7f071406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:26.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.673+0000 7f072d7fa640 1 -- 172.21.15.132:0/752065632 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f07280899b0 con 0x7f073014fd30 2023-11-18T20:39:26.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.674+0000 7f0734ab9640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f071406ae40 0x7f071406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:26.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.675+0000 7f0734ab9640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f071406ae40 0x7f071406d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f072400a870 tx=0x7f0724008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:26.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.678+0000 7f072d7fa640 1 -- 172.21.15.132:0/752065632 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0728054660 con 0x7f073014fd30 2023-11-18T20:39:26.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.897+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0730068350 con 0x7f073014fd30 2023-11-18T20:39:26.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.899+0000 7f072d7fa640 1 -- 172.21.15.132:0/752065632 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6142 (secure 0 0 0) 0x7f0728019090 con 0x7f073014fd30 2023-11-18T20:39:26.900 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:26.900 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:02.182181+0000","modified":"2023-11-18T20:39:05.261751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6834/4266315561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4266315561},{"type":"v1","addr":"172.21.15.132:6834","nonce":4266315561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:22.835223+0000","modified":"2023-11-18T20:39:25.904986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4562":{"gid":4562,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-18T20:39:26.900 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-11-18T20:39:26.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.901+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f071406ae40 msgr2=0x7f071406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:26.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.901+0000 7f0736d1d640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f071406ae40 0x7f071406d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f072400a870 tx=0x7f0724008040 comp rx=0 tx=0).stop 2023-11-18T20:39:26.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.901+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073014fd30 msgr2=0x7f07301490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:26.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.901+0000 7f0736d1d640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073014fd30 0x7f07301490d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f072800b9a0 tx=0x7f072800be60 comp rx=0 tx=0).stop 2023-11-18T20:39:26.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.902+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 shutdown_connections 2023-11-18T20:39:26.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.902+0000 7f0736d1d640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f071406ae40 0x7f071406d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.902+0000 7f0736d1d640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f073014fd30 0x7f07301490d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.902+0000 7f0736d1d640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07300a5260 0x7f0730071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.902+0000 7f0736d1d640 1 --2- 172.21.15.132:0/752065632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f073006d0a0 0x7f07301edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.902+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 >> 172.21.15.132:0/752065632 conn(0x7f073006a500 msgr2=0x7f07300c2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.902+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 shutdown_connections 2023-11-18T20:39:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:26.902+0000 7f0736d1d640 1 -- 172.21.15.132:0/752065632 wait complete. 2023-11-18T20:39:26.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:27.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.123+0000 7f5671c59640 1 Processor -- start 2023-11-18T20:39:27.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.123+0000 7f5671c59640 1 -- start start 2023-11-18T20:39:27.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.124+0000 7f5671c59640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f566c14c2e0 0x7f566c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.125+0000 7f5671c59640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f566c072310 0x7f566c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.125+0000 7f5671c59640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c071e80 con 0x7f566c0c0440 2023-11-18T20:39:27.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.125+0000 7f5671c59640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c071470 con 0x7f566c072310 2023-11-18T20:39:27.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.125+0000 7f5671c59640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c14c6c0 con 0x7f566c14c2e0 2023-11-18T20:39:27.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.125+0000 7f5671458640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f566c072310 0x7f566c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.125+0000 7f5671458640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f566c072310 0x7f566c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43314/0 (socket says 172.21.15.132:43314) 2023-11-18T20:39:27.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.125+0000 7f5671458640 1 -- 172.21.15.132:0/3086622495 learned_addr learned my addr 172.21.15.132:0/3086622495 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:27.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.126+0000 7f5671458640 1 -- 172.21.15.132:0/3086622495 >> v2:172.21.15.161:3300/0 conn(0x7f566c14c2e0 msgr2=0x7f566c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:27.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.126+0000 7f5670c57640 1 --2- 172.21.15.132:0/3086622495 >> v2:172.21.15.161:3300/0 conn(0x7f566c14c2e0 0x7f566c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.126+0000 7f5671458640 1 --2- 172.21.15.132:0/3086622495 >> v2:172.21.15.161:3300/0 conn(0x7f566c14c2e0 0x7f566c0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.126+0000 7f5671458640 1 -- 172.21.15.132:0/3086622495 >> v1:172.21.15.161:6789/0 conn(0x7f566c0c0440 legacy=0x7f566c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:27.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.126+0000 7f5671458640 1 -- 172.21.15.132:0/3086622495 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c06fdc0 con 0x7f566c072310 2023-11-18T20:39:27.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.126+0000 7f5670c57640 1 --2- 172.21.15.132:0/3086622495 >> v2:172.21.15.161:3300/0 conn(0x7f566c14c2e0 0x7f566c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:27.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.127+0000 7f5671458640 1 --2- 172.21.15.132:0/3086622495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c0a4d20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f566c067940 tx=0x7f566402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7cb0c4e88049e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:27.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.127+0000 7f566b7fe640 1 -- 172.21.15.132:0/3086622495 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566402c960 con 0x7f566c072310 2023-11-18T20:39:27.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.127+0000 7f566b7fe640 1 -- 172.21.15.132:0/3086622495 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566402cac0 con 0x7f566c072310 2023-11-18T20:39:27.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.127+0000 7f566b7fe640 1 -- 172.21.15.132:0/3086622495 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566402ce50 con 0x7f566c072310 2023-11-18T20:39:27.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.128+0000 7f5671c59640 1 -- 172.21.15.132:0/3086622495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 msgr2=0x7f566c0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.128+0000 7f5671c59640 1 --2- 172.21.15.132:0/3086622495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c0a4d20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f566c067940 tx=0x7f566402bdc0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.128+0000 7f5671c59640 1 -- 172.21.15.132:0/3086622495 shutdown_connections 2023-11-18T20:39:27.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.128+0000 7f5671c59640 1 --2- 172.21.15.132:0/3086622495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c0a4d20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.128+0000 7f5671c59640 1 --2- 172.21.15.132:0/3086622495 >> v2:172.21.15.161:3300/0 conn(0x7f566c14c2e0 0x7f566c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.128+0000 7f5671c59640 1 -- 172.21.15.132:0/3086622495 >> 172.21.15.132:0/3086622495 conn(0x7f566c0a77f0 msgr2=0x7f566c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:27.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.128+0000 7f5671c59640 1 -- 172.21.15.132:0/3086622495 shutdown_connections 2023-11-18T20:39:27.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.128+0000 7f5671c59640 1 -- 172.21.15.132:0/3086622495 wait complete. 2023-11-18T20:39:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.130+0000 7f5671c59640 1 Processor -- start 2023-11-18T20:39:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.130+0000 7f5671c59640 1 -- start start 2023-11-18T20:39:27.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5671c59640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c1eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5671c59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f566c0c0440 0x7f566c1eb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5671c59640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f566c14c2e0 0x7f566c1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5671c59640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c1eb750 con 0x7f566c072310 2023-11-18T20:39:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5671c59640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c14f310 con 0x7f566c14c2e0 2023-11-18T20:39:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5671c59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c1e8a00 con 0x7f566c0c0440 2023-11-18T20:39:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5670c57640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c1eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5670c57640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c1eacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43330/0 (socket says 172.21.15.132:43330) 2023-11-18T20:39:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.131+0000 7f5670c57640 1 -- 172.21.15.132:0/574955955 learned_addr learned my addr 172.21.15.132:0/574955955 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f566bfff640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f566c0c0440 0x7f566c1eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5671458640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f566c14c2e0 0x7f566c1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5670c57640 1 -- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f566c0c0440 msgr2=0x7f566c1eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5670c57640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f566c0c0440 0x7f566c1eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5670c57640 1 -- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f566c14c2e0 msgr2=0x7f566c1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5670c57640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f566c14c2e0 0x7f566c1487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5670c57640 1 -- 172.21.15.132:0/574955955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664009b30 con 0x7f566c072310 2023-11-18T20:39:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5671458640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f566c14c2e0 0x7f566c1487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:27.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5670c57640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c1eacd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f566000c7f0 tx=0x7f566000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f56697fa640 1 -- 172.21.15.132:0/574955955 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660007820 con 0x7f566c072310 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f56697fa640 1 -- 172.21.15.132:0/574955955 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5660007980 con 0x7f566c072310 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c0a8750 con 0x7f566c072310 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.132+0000 7f56697fa640 1 -- 172.21.15.132:0/574955955 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660007cf0 con 0x7f566c072310 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.133+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c0a8d10 con 0x7f566c072310 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.134+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c0a8b40 con 0x7f566c072310 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.134+0000 7f56697fa640 1 -- 172.21.15.132:0/574955955 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56600113f0 con 0x7f566c072310 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.135+0000 7f56697fa640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f565006ae40 0x7f565006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.135+0000 7f56697fa640 1 -- 172.21.15.132:0/574955955 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5660089cc0 con 0x7f566c072310 2023-11-18T20:39:27.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.136+0000 7f566bfff640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f565006ae40 0x7f565006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.137+0000 7f566bfff640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f565006ae40 0x7f565006d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f566c14bf90 tx=0x7f5658009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:27.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.139+0000 7f56697fa640 1 -- 172.21.15.132:0/574955955 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5660090080 con 0x7f566c072310 2023-11-18T20:39:27.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.327+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f566c04e840 con 0x7f566c072310 2023-11-18T20:39:27.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.331+0000 7f56697fa640 1 -- 172.21.15.132:0/574955955 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20201 (secure 0 0 0) 0x7f566001f090 con 0x7f566c072310 2023-11-18T20:39:27.333 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:27.333 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":39,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:24.407150+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:27.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f565006ae40 msgr2=0x7f565006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f565006ae40 0x7f565006d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f566c14bf90 tx=0x7f5658009040 comp rx=0 tx=0).stop 2023-11-18T20:39:27.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 msgr2=0x7f566c1eacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c1eacd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f566000c7f0 tx=0x7f566000ccb0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 shutdown_connections 2023-11-18T20:39:27.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f565006ae40 0x7f565006d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f566c14c2e0 0x7f566c1487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f566c0c0440 0x7f566c1eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 --2- 172.21.15.132:0/574955955 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f566c072310 0x7f566c1eacd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 >> 172.21.15.132:0/574955955 conn(0x7f566c0a77f0 msgr2=0x7f566c154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:27.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 shutdown_connections 2023-11-18T20:39:27.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.334+0000 7f5671c59640 1 -- 172.21.15.132:0/574955955 wait complete. 2023-11-18T20:39:27.355 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T20:39:27.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.595+0000 7f7b1e8c9640 1 Processor -- start 2023-11-18T20:39:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.595+0000 7f7b1e8c9640 1 -- start start 2023-11-18T20:39:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.596+0000 7f7b1e8c9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7b180a6da0 0x7f7b18157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.596+0000 7f7b1e8c9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c4fa0 0x7f7b18158400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.597+0000 7f7b1e8c9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b180c3180 con 0x7f7b180c7100 2023-11-18T20:39:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.597+0000 7f7b1e8c9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b180c33d0 con 0x7f7b180a6da0 2023-11-18T20:39:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.597+0000 7f7b1e8c9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180c36b0 con 0x7f7b180c4fa0 2023-11-18T20:39:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.597+0000 7f7b1ce66640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c4fa0 0x7f7b18158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.597+0000 7f7b1ce66640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c4fa0 0x7f7b18158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:34120/0 (socket says 172.21.15.132:34120) 2023-11-18T20:39:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.597+0000 7f7b1ce66640 1 -- 172.21.15.132:0/2370055951 learned_addr learned my addr 172.21.15.132:0/2370055951 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.598+0000 7f7b177fe640 1 --2- 172.21.15.132:0/2370055951 >> v2:172.21.15.161:3300/0 conn(0x7f7b180a6da0 0x7f7b18157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.598+0000 7f7b1ce66640 1 -- 172.21.15.132:0/2370055951 >> v2:172.21.15.161:3300/0 conn(0x7f7b180a6da0 msgr2=0x7f7b18157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.598+0000 7f7b1ce66640 1 --2- 172.21.15.132:0/2370055951 >> v2:172.21.15.161:3300/0 conn(0x7f7b180a6da0 0x7f7b18157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.598+0000 7f7b1ce66640 1 -- 172.21.15.132:0/2370055951 >> v1:172.21.15.161:6789/0 conn(0x7f7b180c7100 legacy=0x7f7b18155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.598+0000 7f7b1ce66640 1 -- 172.21.15.132:0/2370055951 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180c27c0 con 0x7f7b180c4fa0 2023-11-18T20:39:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.600+0000 7f7b1ce66640 1 --2- 172.21.15.132:0/2370055951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c4fa0 0x7f7b18158400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009e50 tx=0x7f7b1002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd463664a4243789 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:27.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.600+0000 7f7b16ffd640 1 -- 172.21.15.132:0/2370055951 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1002ca70 con 0x7f7b180c4fa0 2023-11-18T20:39:27.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.600+0000 7f7b16ffd640 1 -- 172.21.15.132:0/2370055951 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1002cbd0 con 0x7f7b180c4fa0 2023-11-18T20:39:27.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.600+0000 7f7b16ffd640 1 -- 172.21.15.132:0/2370055951 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100343f0 con 0x7f7b180c4fa0 2023-11-18T20:39:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.601+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/2370055951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c4fa0 msgr2=0x7f7b18158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.601+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/2370055951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c4fa0 0x7f7b18158400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009e50 tx=0x7f7b1002bed0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.601+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/2370055951 shutdown_connections 2023-11-18T20:39:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.601+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/2370055951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c4fa0 0x7f7b18158400 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.601+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/2370055951 >> v2:172.21.15.161:3300/0 conn(0x7f7b180a6da0 0x7f7b18157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.601+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/2370055951 >> 172.21.15.132:0/2370055951 conn(0x7f7b180c7dc0 msgr2=0x7f7b180c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.601+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/2370055951 shutdown_connections 2023-11-18T20:39:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.601+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/2370055951 wait complete. 2023-11-18T20:39:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.602+0000 7f7b1e8c9640 1 Processor -- start 2023-11-18T20:39:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.603+0000 7f7b1e8c9640 1 -- start start 2023-11-18T20:39:27.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.603+0000 7f7b1e8c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b180a6da0 0x7f7b18157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.603+0000 7f7b1e8c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b180c4fa0 0x7f7b181e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.603+0000 7f7b1e8c9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c7100 0x7f7b18151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.603+0000 7f7b1e8c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181577d0 con 0x7f7b180a6da0 2023-11-18T20:39:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.603+0000 7f7b1e8c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181eded0 con 0x7f7b180c4fa0 2023-11-18T20:39:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.603+0000 7f7b1e8c9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181ee1b0 con 0x7f7b180c7100 2023-11-18T20:39:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b180a6da0 0x7f7b18157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b180a6da0 0x7f7b18157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43340/0 (socket says 172.21.15.132:43340) 2023-11-18T20:39:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 -- 172.21.15.132:0/1974735049 learned_addr learned my addr 172.21.15.132:0/1974735049 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b177fe640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b180c4fa0 0x7f7b181e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b1ce66640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c7100 0x7f7b18151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 -- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c7100 msgr2=0x7f7b18151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c7100 0x7f7b18151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 -- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b180c4fa0 msgr2=0x7f7b181e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b180c4fa0 0x7f7b181e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 -- 172.21.15.132:0/1974735049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10009b30 con 0x7f7b180a6da0 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b177fe640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b180c4fa0 0x7f7b181e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.604+0000 7f7b17fff640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b180a6da0 0x7f7b18157290 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800c400 tx=0x7f7b0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.605+0000 7f7b14ff9640 1 -- 172.21.15.132:0/1974735049 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b080052d0 con 0x7f7b180a6da0 2023-11-18T20:39:27.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.605+0000 7f7b14ff9640 1 -- 172.21.15.132:0/1974735049 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b08005430 con 0x7f7b180a6da0 2023-11-18T20:39:27.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.605+0000 7f7b14ff9640 1 -- 172.21.15.132:0/1974735049 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08003830 con 0x7f7b180a6da0 2023-11-18T20:39:27.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.605+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b180ade50 con 0x7f7b180a6da0 2023-11-18T20:39:27.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.605+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b180a6380 con 0x7f7b180a6da0 2023-11-18T20:39:27.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.606+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b18156fb0 con 0x7f7b180a6da0 2023-11-18T20:39:27.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.607+0000 7f7b14ff9640 1 -- 172.21.15.132:0/1974735049 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b08003990 con 0x7f7b180a6da0 2023-11-18T20:39:27.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.608+0000 7f7b14ff9640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b0406ae40 0x7f7b0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:27.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.608+0000 7f7b14ff9640 1 -- 172.21.15.132:0/1974735049 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7b08088ee0 con 0x7f7b180a6da0 2023-11-18T20:39:27.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.609+0000 7f7b177fe640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b0406ae40 0x7f7b0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:27.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.610+0000 7f7b177fe640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b0406ae40 0x7f7b0406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b181ee4b0 tx=0x7f7b0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:27.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.612+0000 7f7b14ff9640 1 -- 172.21.15.132:0/1974735049 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b08053c20 con 0x7f7b180a6da0 2023-11-18T20:39:27.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.800+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b18158940 con 0x7f7b0406ae40 2023-11-18T20:39:27.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.840+0000 7f7b14ff9640 1 -- 172.21.15.132:0/1974735049 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519648 (secure 0 0 0) 0x7f7b0c010900 con 0x7f7b0406ae40 2023-11-18T20:39:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:27.852 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b0406ae40 msgr2=0x7f7b0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b0406ae40 0x7f7b0406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b181ee4b0 tx=0x7f7b0c008040 comp rx=0 tx=0).stop 2023-11-18T20:39:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b180a6da0 msgr2=0x7f7b18157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b180a6da0 0x7f7b18157290 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800c400 tx=0x7f7b0800c8c0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 shutdown_connections 2023-11-18T20:39:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b0406ae40 0x7f7b0406d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b180c7100 0x7f7b18151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b180c4fa0 0x7f7b181e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 --2- 172.21.15.132:0/1974735049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b180a6da0 0x7f7b18157290 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.850+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 >> 172.21.15.132:0/1974735049 conn(0x7f7b180c7dc0 msgr2=0x7f7b1806c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.851+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 shutdown_connections 2023-11-18T20:39:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:27.851+0000 7f7b1e8c9640 1 -- 172.21.15.132:0/1974735049 wait complete. 2023-11-18T20:39:27.874 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-11-18T20:39:26.661356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":218,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4521984,"data_stored":2493246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.298310"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.396999+0000","last_change":"2023-11-18T20:39:22.396999+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.396999+0000","last_undegraded":"2023-11-18T20:39:22.396999+0000","last_fullsized":"2023-11-18T20:39:22.396999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377687+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:21.377687+0000","last_peered":"2023-11-18T20:39:21.377687+0000","last_clean":"2023-11-18T20:39:21.377687+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:21.377687+0000","last_undegraded":"2023-11-18T20:39:21.377687+0000","last_fullsized":"2023-11-18T20:39:21.377687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.369050+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:21.369050+0000","last_peered":"2023-11-18T20:39:21.369050+0000","last_clean":"2023-11-18T20:39:21.369050+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:21.369050+0000","last_undegraded":"2023-11-18T20:39:21.369050+0000","last_fullsized":"2023-11-18T20:39:21.369050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:49.505805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373936+0000","last_change":"2023-11-18T20:39:02.760047+0000","last_active":"2023-11-18T20:39:21.373936+0000","last_peered":"2023-11-18T20:39:21.373936+0000","last_clean":"2023-11-18T20:39:21.373936+0000","last_became_active":"2023-11-18T20:39:02.759514+0000","last_became_peered":"2023-11-18T20:39:02.759514+0000","last_unstale":"2023-11-18T20:39:21.373936+0000","last_undegraded":"2023-11-18T20:39:21.373936+0000","last_fullsized":"2023-11-18T20:39:21.373936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.412681+0000","last_change":"2023-11-18T20:39:22.407903+0000","last_active":"2023-11-18T20:39:22.412681+0000","last_peered":"2023-11-18T20:39:22.412681+0000","last_clean":"2023-11-18T20:39:22.412681+0000","last_became_active":"2023-11-18T20:39:22.407672+0000","last_became_peered":"2023-11-18T20:39:22.407672+0000","last_unstale":"2023-11-18T20:39:22.412681+0000","last_undegraded":"2023-11-18T20:39:22.412681+0000","last_fullsized":"2023-11-18T20:39:22.412681+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:37:47.593870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.395272+0000","last_change":"2023-11-18T20:39:22.395272+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.395272+0000","last_undegraded":"2023-11-18T20:39:22.395272+0000","last_fullsized":"2023-11-18T20:39:22.395272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372391+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:21.372391+0000","last_peered":"2023-11-18T20:39:21.372391+0000","last_clean":"2023-11-18T20:39:21.372391+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:21.372391+0000","last_undegraded":"2023-11-18T20:39:21.372391+0000","last_fullsized":"2023-11-18T20:39:21.372391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:56.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368439+0000","last_change":"2023-11-18T20:39:02.755764+0000","last_active":"2023-11-18T20:39:21.368439+0000","last_peered":"2023-11-18T20:39:21.368439+0000","last_clean":"2023-11-18T20:39:21.368439+0000","last_became_active":"2023-11-18T20:39:02.755464+0000","last_became_peered":"2023-11-18T20:39:02.755464+0000","last_unstale":"2023-11-18T20:39:21.368439+0000","last_undegraded":"2023-11-18T20:39:21.368439+0000","last_fullsized":"2023-11-18T20:39:21.368439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:24.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410322+0000","last_change":"2023-11-18T20:39:22.406273+0000","last_active":"2023-11-18T20:39:22.410322+0000","last_peered":"2023-11-18T20:39:22.410322+0000","last_clean":"2023-11-18T20:39:22.410322+0000","last_became_active":"2023-11-18T20:39:22.405680+0000","last_became_peered":"2023-11-18T20:39:22.405680+0000","last_unstale":"2023-11-18T20:39:22.410322+0000","last_undegraded":"2023-11-18T20:39:22.410322+0000","last_fullsized":"2023-11-18T20:39:22.410322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:49:29.718002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381641+0000","last_change":"2023-11-18T20:39:22.381641+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381641+0000","last_undegraded":"2023-11-18T20:39:22.381641+0000","last_fullsized":"2023-11-18T20:39:22.381641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372377+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:21.372377+0000","last_peered":"2023-11-18T20:39:21.372377+0000","last_clean":"2023-11-18T20:39:21.372377+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:21.372377+0000","last_undegraded":"2023-11-18T20:39:21.372377+0000","last_fullsized":"2023-11-18T20:39:21.372377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:24.984694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371989+0000","last_change":"2023-11-18T20:39:02.752804+0000","last_active":"2023-11-18T20:39:21.371989+0000","last_peered":"2023-11-18T20:39:21.371989+0000","last_clean":"2023-11-18T20:39:21.371989+0000","last_became_active":"2023-11-18T20:39:02.752203+0000","last_became_peered":"2023-11-18T20:39:02.752203+0000","last_unstale":"2023-11-18T20:39:21.371989+0000","last_undegraded":"2023-11-18T20:39:21.371989+0000","last_fullsized":"2023-11-18T20:39:21.371989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410107+0000","last_change":"2023-11-18T20:39:22.406528+0000","last_active":"2023-11-18T20:39:22.410107+0000","last_peered":"2023-11-18T20:39:22.410107+0000","last_clean":"2023-11-18T20:39:22.410107+0000","last_became_active":"2023-11-18T20:39:22.406024+0000","last_became_peered":"2023-11-18T20:39:22.406024+0000","last_unstale":"2023-11-18T20:39:22.410107+0000","last_undegraded":"2023-11-18T20:39:22.410107+0000","last_fullsized":"2023-11-18T20:39:22.410107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:24.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.375987+0000","last_change":"2023-11-18T20:39:22.375987+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.375987+0000","last_undegraded":"2023-11-18T20:39:22.375987+0000","last_fullsized":"2023-11-18T20:39:22.375987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377747+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:21.377747+0000","last_peered":"2023-11-18T20:39:21.377747+0000","last_clean":"2023-11-18T20:39:21.377747+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:21.377747+0000","last_undegraded":"2023-11-18T20:39:21.377747+0000","last_fullsized":"2023-11-18T20:39:21.377747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:30.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380867+0000","last_change":"2023-11-18T20:39:02.748674+0000","last_active":"2023-11-18T20:39:21.380867+0000","last_peered":"2023-11-18T20:39:21.380867+0000","last_clean":"2023-11-18T20:39:21.380867+0000","last_became_active":"2023-11-18T20:39:02.748033+0000","last_became_peered":"2023-11-18T20:39:02.748033+0000","last_unstale":"2023-11-18T20:39:21.380867+0000","last_undegraded":"2023-11-18T20:39:21.380867+0000","last_fullsized":"2023-11-18T20:39:21.380867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:31.017030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.413393+0000","last_change":"2023-11-18T20:39:22.409054+0000","last_active":"2023-11-18T20:39:22.413393+0000","last_peered":"2023-11-18T20:39:22.413393+0000","last_clean":"2023-11-18T20:39:22.413393+0000","last_became_active":"2023-11-18T20:39:22.408725+0000","last_became_peered":"2023-11-18T20:39:22.408725+0000","last_unstale":"2023-11-18T20:39:22.413393+0000","last_undegraded":"2023-11-18T20:39:22.413393+0000","last_fullsized":"2023-11-18T20:39:22.413393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:48.145975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.379247+0000","last_change":"2023-11-18T20:39:22.379247+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.379247+0000","last_undegraded":"2023-11-18T20:39:22.379247+0000","last_fullsized":"2023-11-18T20:39:22.379247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380290+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:21.380290+0000","last_peered":"2023-11-18T20:39:21.380290+0000","last_clean":"2023-11-18T20:39:21.380290+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:21.380290+0000","last_undegraded":"2023-11-18T20:39:21.380290+0000","last_fullsized":"2023-11-18T20:39:21.380290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:01.441027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372898+0000","last_change":"2023-11-18T20:39:02.755847+0000","last_active":"2023-11-18T20:39:21.372898+0000","last_peered":"2023-11-18T20:39:21.372898+0000","last_clean":"2023-11-18T20:39:21.372898+0000","last_became_active":"2023-11-18T20:39:02.755565+0000","last_became_peered":"2023-11-18T20:39:02.755565+0000","last_unstale":"2023-11-18T20:39:21.372898+0000","last_undegraded":"2023-11-18T20:39:21.372898+0000","last_fullsized":"2023-11-18T20:39:21.372898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407929+0000","last_change":"2023-11-18T20:39:22.400862+0000","last_active":"2023-11-18T20:39:22.407929+0000","last_peered":"2023-11-18T20:39:22.407929+0000","last_clean":"2023-11-18T20:39:22.407929+0000","last_became_active":"2023-11-18T20:39:22.400584+0000","last_became_peered":"2023-11-18T20:39:22.400584+0000","last_unstale":"2023-11-18T20:39:22.407929+0000","last_undegraded":"2023-11-18T20:39:22.407929+0000","last_fullsized":"2023-11-18T20:39:22.407929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:02.530453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388653+0000","last_change":"2023-11-18T20:39:22.388653+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388653+0000","last_undegraded":"2023-11-18T20:39:22.388653+0000","last_fullsized":"2023-11-18T20:39:22.388653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.381017+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:21.381017+0000","last_peered":"2023-11-18T20:39:21.381017+0000","last_clean":"2023-11-18T20:39:21.381017+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:21.381017+0000","last_undegraded":"2023-11-18T20:39:21.381017+0000","last_fullsized":"2023-11-18T20:39:21.381017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:43.756070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386291+0000","last_change":"2023-11-18T20:39:02.766797+0000","last_active":"2023-11-18T20:39:21.386291+0000","last_peered":"2023-11-18T20:39:21.386291+0000","last_clean":"2023-11-18T20:39:21.386291+0000","last_became_active":"2023-11-18T20:39:02.766466+0000","last_became_peered":"2023-11-18T20:39:02.766466+0000","last_unstale":"2023-11-18T20:39:21.386291+0000","last_undegraded":"2023-11-18T20:39:21.386291+0000","last_fullsized":"2023-11-18T20:39:21.386291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.491100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.413842+0000","last_change":"2023-11-18T20:39:22.410942+0000","last_active":"2023-11-18T20:39:22.413842+0000","last_peered":"2023-11-18T20:39:22.413842+0000","last_clean":"2023-11-18T20:39:22.413842+0000","last_became_active":"2023-11-18T20:39:22.410660+0000","last_became_peered":"2023-11-18T20:39:22.410660+0000","last_unstale":"2023-11-18T20:39:22.413842+0000","last_undegraded":"2023-11-18T20:39:22.413842+0000","last_fullsized":"2023-11-18T20:39:22.413842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:32:14.715267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.386260+0000","last_change":"2023-11-18T20:39:22.386260+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.386260+0000","last_undegraded":"2023-11-18T20:39:22.386260+0000","last_fullsized":"2023-11-18T20:39:22.386260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.383263+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:21.383263+0000","last_peered":"2023-11-18T20:39:21.383263+0000","last_clean":"2023-11-18T20:39:21.383263+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:21.383263+0000","last_undegraded":"2023-11-18T20:39:21.383263+0000","last_fullsized":"2023-11-18T20:39:21.383263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:32.771880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.369140+0000","last_change":"2023-11-18T20:39:02.760873+0000","last_active":"2023-11-18T20:39:21.369140+0000","last_peered":"2023-11-18T20:39:21.369140+0000","last_clean":"2023-11-18T20:39:21.369140+0000","last_became_active":"2023-11-18T20:39:02.759887+0000","last_became_peered":"2023-11-18T20:39:02.759887+0000","last_unstale":"2023-11-18T20:39:21.369140+0000","last_undegraded":"2023-11-18T20:39:21.369140+0000","last_fullsized":"2023-11-18T20:39:21.369140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:26.185944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.413782+0000","last_change":"2023-11-18T20:39:22.411188+0000","last_active":"2023-11-18T20:39:22.413782+0000","last_peered":"2023-11-18T20:39:22.413782+0000","last_clean":"2023-11-18T20:39:22.413782+0000","last_became_active":"2023-11-18T20:39:22.410686+0000","last_became_peered":"2023-11-18T20:39:22.410686+0000","last_unstale":"2023-11-18T20:39:22.413782+0000","last_undegraded":"2023-11-18T20:39:22.413782+0000","last_fullsized":"2023-11-18T20:39:22.413782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:15.706826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382028+0000","last_change":"2023-11-18T20:39:22.382028+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382028+0000","last_undegraded":"2023-11-18T20:39:22.382028+0000","last_fullsized":"2023-11-18T20:39:22.382028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385711+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:21.385711+0000","last_peered":"2023-11-18T20:39:21.385711+0000","last_clean":"2023-11-18T20:39:21.385711+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:21.385711+0000","last_undegraded":"2023-11-18T20:39:21.385711+0000","last_fullsized":"2023-11-18T20:39:21.385711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:39.869697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386333+0000","last_change":"2023-11-18T20:39:02.762642+0000","last_active":"2023-11-18T20:39:21.386333+0000","last_peered":"2023-11-18T20:39:21.386333+0000","last_clean":"2023-11-18T20:39:21.386333+0000","last_became_active":"2023-11-18T20:39:02.761245+0000","last_became_peered":"2023-11-18T20:39:02.761245+0000","last_unstale":"2023-11-18T20:39:21.386333+0000","last_undegraded":"2023-11-18T20:39:21.386333+0000","last_fullsized":"2023-11-18T20:39:21.386333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:59.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410065+0000","last_change":"2023-11-18T20:39:22.403397+0000","last_active":"2023-11-18T20:39:22.410065+0000","last_peered":"2023-11-18T20:39:22.410065+0000","last_clean":"2023-11-18T20:39:22.410065+0000","last_became_active":"2023-11-18T20:39:22.403108+0000","last_became_peered":"2023-11-18T20:39:22.403108+0000","last_unstale":"2023-11-18T20:39:22.410065+0000","last_undegraded":"2023-11-18T20:39:22.410065+0000","last_fullsized":"2023-11-18T20:39:22.410065+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:46.482331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.386304+0000","last_change":"2023-11-18T20:39:22.386304+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.386304+0000","last_undegraded":"2023-11-18T20:39:22.386304+0000","last_fullsized":"2023-11-18T20:39:22.386304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368272+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:21.368272+0000","last_peered":"2023-11-18T20:39:21.368272+0000","last_clean":"2023-11-18T20:39:21.368272+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:21.368272+0000","last_undegraded":"2023-11-18T20:39:21.368272+0000","last_fullsized":"2023-11-18T20:39:21.368272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:48:04.385451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377671+0000","last_change":"2023-11-18T20:39:02.769526+0000","last_active":"2023-11-18T20:39:21.377671+0000","last_peered":"2023-11-18T20:39:21.377671+0000","last_clean":"2023-11-18T20:39:21.377671+0000","last_became_active":"2023-11-18T20:39:02.767946+0000","last_became_peered":"2023-11-18T20:39:02.767946+0000","last_unstale":"2023-11-18T20:39:21.377671+0000","last_undegraded":"2023-11-18T20:39:21.377671+0000","last_fullsized":"2023-11-18T20:39:21.377671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.398846+0000","last_change":"2023-11-18T20:39:22.397295+0000","last_active":"2023-11-18T20:39:22.398846+0000","last_peered":"2023-11-18T20:39:22.398846+0000","last_clean":"2023-11-18T20:39:22.398846+0000","last_became_active":"2023-11-18T20:39:22.396777+0000","last_became_peered":"2023-11-18T20:39:22.396777+0000","last_unstale":"2023-11-18T20:39:22.398846+0000","last_undegraded":"2023-11-18T20:39:22.398846+0000","last_fullsized":"2023-11-18T20:39:22.398846+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:35.388829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382889+0000","last_change":"2023-11-18T20:39:22.382889+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382889+0000","last_undegraded":"2023-11-18T20:39:22.382889+0000","last_fullsized":"2023-11-18T20:39:22.382889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377785+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:21.377785+0000","last_peered":"2023-11-18T20:39:21.377785+0000","last_clean":"2023-11-18T20:39:21.377785+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:21.377785+0000","last_undegraded":"2023-11-18T20:39:21.377785+0000","last_fullsized":"2023-11-18T20:39:21.377785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377249+0000","last_change":"2023-11-18T20:39:02.750840+0000","last_active":"2023-11-18T20:39:21.377249+0000","last_peered":"2023-11-18T20:39:21.377249+0000","last_clean":"2023-11-18T20:39:21.377249+0000","last_became_active":"2023-11-18T20:39:02.749491+0000","last_became_peered":"2023-11-18T20:39:02.749491+0000","last_unstale":"2023-11-18T20:39:21.377249+0000","last_undegraded":"2023-11-18T20:39:21.377249+0000","last_fullsized":"2023-11-18T20:39:21.377249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:27:46.865954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.401986+0000","last_change":"2023-11-18T20:39:22.396910+0000","last_active":"2023-11-18T20:39:22.401986+0000","last_peered":"2023-11-18T20:39:22.401986+0000","last_clean":"2023-11-18T20:39:22.401986+0000","last_became_active":"2023-11-18T20:39:22.396615+0000","last_became_peered":"2023-11-18T20:39:22.396615+0000","last_unstale":"2023-11-18T20:39:22.401986+0000","last_undegraded":"2023-11-18T20:39:22.401986+0000","last_fullsized":"2023-11-18T20:39:22.401986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:18:36.439871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388314+0000","last_change":"2023-11-18T20:39:22.388314+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388314+0000","last_undegraded":"2023-11-18T20:39:22.388314+0000","last_fullsized":"2023-11-18T20:39:22.388314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371891+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:21.371891+0000","last_peered":"2023-11-18T20:39:21.371891+0000","last_clean":"2023-11-18T20:39:21.371891+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:21.371891+0000","last_undegraded":"2023-11-18T20:39:21.371891+0000","last_fullsized":"2023-11-18T20:39:21.371891+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.384136+0000","last_change":"2023-11-18T20:39:02.757357+0000","last_active":"2023-11-18T20:39:21.384136+0000","last_peered":"2023-11-18T20:39:21.384136+0000","last_clean":"2023-11-18T20:39:21.384136+0000","last_became_active":"2023-11-18T20:39:02.757000+0000","last_became_peered":"2023-11-18T20:39:02.757000+0000","last_unstale":"2023-11-18T20:39:21.384136+0000","last_undegraded":"2023-11-18T20:39:21.384136+0000","last_fullsized":"2023-11-18T20:39:21.384136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410014+0000","last_change":"2023-11-18T20:39:22.404704+0000","last_active":"2023-11-18T20:39:22.410014+0000","last_peered":"2023-11-18T20:39:22.410014+0000","last_clean":"2023-11-18T20:39:22.410014+0000","last_became_active":"2023-11-18T20:39:22.403768+0000","last_became_peered":"2023-11-18T20:39:22.403768+0000","last_unstale":"2023-11-18T20:39:22.410014+0000","last_undegraded":"2023-11-18T20:39:22.410014+0000","last_fullsized":"2023-11-18T20:39:22.410014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:12.088341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.396224+0000","last_change":"2023-11-18T20:39:22.396224+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.396224+0000","last_undegraded":"2023-11-18T20:39:22.396224+0000","last_fullsized":"2023-11-18T20:39:22.396224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.382571+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:21.382571+0000","last_peered":"2023-11-18T20:39:21.382571+0000","last_clean":"2023-11-18T20:39:21.382571+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:21.382571+0000","last_undegraded":"2023-11-18T20:39:21.382571+0000","last_fullsized":"2023-11-18T20:39:21.382571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377669+0000","last_change":"2023-11-18T20:39:02.762298+0000","last_active":"2023-11-18T20:39:21.377669+0000","last_peered":"2023-11-18T20:39:21.377669+0000","last_clean":"2023-11-18T20:39:21.377669+0000","last_became_active":"2023-11-18T20:39:02.761752+0000","last_became_peered":"2023-11-18T20:39:02.761752+0000","last_unstale":"2023-11-18T20:39:21.377669+0000","last_undegraded":"2023-11-18T20:39:21.377669+0000","last_fullsized":"2023-11-18T20:39:21.377669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:16:15.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.402040+0000","last_change":"2023-11-18T20:39:22.398043+0000","last_active":"2023-11-18T20:39:22.402040+0000","last_peered":"2023-11-18T20:39:22.402040+0000","last_clean":"2023-11-18T20:39:22.402040+0000","last_became_active":"2023-11-18T20:39:22.397732+0000","last_became_peered":"2023-11-18T20:39:22.397732+0000","last_unstale":"2023-11-18T20:39:22.402040+0000","last_undegraded":"2023-11-18T20:39:22.402040+0000","last_fullsized":"2023-11-18T20:39:22.402040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:19.760244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.393838+0000","last_change":"2023-11-18T20:39:22.393838+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.393838+0000","last_undegraded":"2023-11-18T20:39:22.393838+0000","last_fullsized":"2023-11-18T20:39:22.393838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374053+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:21.374053+0000","last_peered":"2023-11-18T20:39:21.374053+0000","last_clean":"2023-11-18T20:39:21.374053+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:21.374053+0000","last_undegraded":"2023-11-18T20:39:21.374053+0000","last_fullsized":"2023-11-18T20:39:21.374053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:27.505414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386228+0000","last_change":"2023-11-18T20:39:02.760383+0000","last_active":"2023-11-18T20:39:21.386228+0000","last_peered":"2023-11-18T20:39:21.386228+0000","last_clean":"2023-11-18T20:39:21.386228+0000","last_became_active":"2023-11-18T20:39:02.760126+0000","last_became_peered":"2023-11-18T20:39:02.760126+0000","last_unstale":"2023-11-18T20:39:21.386228+0000","last_undegraded":"2023-11-18T20:39:21.386228+0000","last_fullsized":"2023-11-18T20:39:21.386228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410423+0000","last_change":"2023-11-18T20:39:22.404538+0000","last_active":"2023-11-18T20:39:22.410423+0000","last_peered":"2023-11-18T20:39:22.410423+0000","last_clean":"2023-11-18T20:39:22.410423+0000","last_became_active":"2023-11-18T20:39:22.404275+0000","last_became_peered":"2023-11-18T20:39:22.404275+0000","last_unstale":"2023-11-18T20:39:22.410423+0000","last_undegraded":"2023-11-18T20:39:22.410423+0000","last_fullsized":"2023-11-18T20:39:22.410423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:18.351945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.390628+0000","last_change":"2023-11-18T20:39:22.390628+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.390628+0000","last_undegraded":"2023-11-18T20:39:22.390628+0000","last_fullsized":"2023-11-18T20:39:22.390628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368934+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:21.368934+0000","last_peered":"2023-11-18T20:39:21.368934+0000","last_clean":"2023-11-18T20:39:21.368934+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:21.368934+0000","last_undegraded":"2023-11-18T20:39:21.368934+0000","last_fullsized":"2023-11-18T20:39:21.368934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:41.560904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.383445+0000","last_change":"2023-11-18T20:39:02.763496+0000","last_active":"2023-11-18T20:39:21.383445+0000","last_peered":"2023-11-18T20:39:21.383445+0000","last_clean":"2023-11-18T20:39:21.383445+0000","last_became_active":"2023-11-18T20:39:02.762875+0000","last_became_peered":"2023-11-18T20:39:02.762875+0000","last_unstale":"2023-11-18T20:39:21.383445+0000","last_undegraded":"2023-11-18T20:39:21.383445+0000","last_fullsized":"2023-11-18T20:39:21.383445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.408862+0000","last_change":"2023-11-18T20:39:22.405242+0000","last_active":"2023-11-18T20:39:22.408862+0000","last_peered":"2023-11-18T20:39:22.408862+0000","last_clean":"2023-11-18T20:39:22.408862+0000","last_became_active":"2023-11-18T20:39:22.404935+0000","last_became_peered":"2023-11-18T20:39:22.404935+0000","last_unstale":"2023-11-18T20:39:22.408862+0000","last_undegraded":"2023-11-18T20:39:22.408862+0000","last_fullsized":"2023-11-18T20:39:22.408862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:24.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381151+0000","last_change":"2023-11-18T20:39:22.381151+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381151+0000","last_undegraded":"2023-11-18T20:39:22.381151+0000","last_fullsized":"2023-11-18T20:39:22.381151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373410+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:21.373410+0000","last_peered":"2023-11-18T20:39:21.373410+0000","last_clean":"2023-11-18T20:39:21.373410+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:21.373410+0000","last_undegraded":"2023-11-18T20:39:21.373410+0000","last_fullsized":"2023-11-18T20:39:21.373410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378380+0000","last_change":"2023-11-18T20:39:02.765789+0000","last_active":"2023-11-18T20:39:21.378380+0000","last_peered":"2023-11-18T20:39:21.378380+0000","last_clean":"2023-11-18T20:39:21.378380+0000","last_became_active":"2023-11-18T20:39:02.764984+0000","last_became_peered":"2023-11-18T20:39:02.764984+0000","last_unstale":"2023-11-18T20:39:21.378380+0000","last_undegraded":"2023-11-18T20:39:21.378380+0000","last_fullsized":"2023-11-18T20:39:21.378380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.408505+0000","last_change":"2023-11-18T20:39:22.403628+0000","last_active":"2023-11-18T20:39:22.408505+0000","last_peered":"2023-11-18T20:39:22.408505+0000","last_clean":"2023-11-18T20:39:22.408505+0000","last_became_active":"2023-11-18T20:39:22.401145+0000","last_became_peered":"2023-11-18T20:39:22.401145+0000","last_unstale":"2023-11-18T20:39:22.408505+0000","last_undegraded":"2023-11-18T20:39:22.408505+0000","last_fullsized":"2023-11-18T20:39:22.408505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:44.742398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.374726+0000","last_change":"2023-11-18T20:39:22.374726+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.374726+0000","last_undegraded":"2023-11-18T20:39:22.374726+0000","last_fullsized":"2023-11-18T20:39:22.374726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386657+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:21.386657+0000","last_peered":"2023-11-18T20:39:21.386657+0000","last_clean":"2023-11-18T20:39:21.386657+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:21.386657+0000","last_undegraded":"2023-11-18T20:39:21.386657+0000","last_fullsized":"2023-11-18T20:39:21.386657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368817+0000","last_change":"2023-11-18T20:39:02.773440+0000","last_active":"2023-11-18T20:39:21.368817+0000","last_peered":"2023-11-18T20:39:21.368817+0000","last_clean":"2023-11-18T20:39:21.368817+0000","last_became_active":"2023-11-18T20:39:02.773133+0000","last_became_peered":"2023-11-18T20:39:02.773133+0000","last_unstale":"2023-11-18T20:39:21.368817+0000","last_undegraded":"2023-11-18T20:39:21.368817+0000","last_fullsized":"2023-11-18T20:39:21.368817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:02.899681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.402942+0000","last_change":"2023-11-18T20:39:22.398608+0000","last_active":"2023-11-18T20:39:22.402942+0000","last_peered":"2023-11-18T20:39:22.402942+0000","last_clean":"2023-11-18T20:39:22.402942+0000","last_became_active":"2023-11-18T20:39:22.398282+0000","last_became_peered":"2023-11-18T20:39:22.398282+0000","last_unstale":"2023-11-18T20:39:22.402942+0000","last_undegraded":"2023-11-18T20:39:22.402942+0000","last_fullsized":"2023-11-18T20:39:22.402942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:45.625256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.389061+0000","last_change":"2023-11-18T20:39:22.389061+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.389061+0000","last_undegraded":"2023-11-18T20:39:22.389061+0000","last_fullsized":"2023-11-18T20:39:22.389061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385451+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:21.385451+0000","last_peered":"2023-11-18T20:39:21.385451+0000","last_clean":"2023-11-18T20:39:21.385451+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:21.385451+0000","last_undegraded":"2023-11-18T20:39:21.385451+0000","last_fullsized":"2023-11-18T20:39:21.385451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368329+0000","last_change":"2023-11-18T20:39:02.777823+0000","last_active":"2023-11-18T20:39:21.368329+0000","last_peered":"2023-11-18T20:39:21.368329+0000","last_clean":"2023-11-18T20:39:21.368329+0000","last_became_active":"2023-11-18T20:39:02.777456+0000","last_became_peered":"2023-11-18T20:39:02.777456+0000","last_unstale":"2023-11-18T20:39:21.368329+0000","last_undegraded":"2023-11-18T20:39:21.368329+0000","last_fullsized":"2023-11-18T20:39:21.368329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:44.618827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.409982+0000","last_change":"2023-11-18T20:39:22.402262+0000","last_active":"2023-11-18T20:39:22.409982+0000","last_peered":"2023-11-18T20:39:22.409982+0000","last_clean":"2023-11-18T20:39:22.409982+0000","last_became_active":"2023-11-18T20:39:22.401944+0000","last_became_peered":"2023-11-18T20:39:22.401944+0000","last_unstale":"2023-11-18T20:39:22.409982+0000","last_undegraded":"2023-11-18T20:39:22.409982+0000","last_fullsized":"2023-11-18T20:39:22.409982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:50.653213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.379405+0000","last_change":"2023-11-18T20:39:22.379405+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.379405+0000","last_undegraded":"2023-11-18T20:39:22.379405+0000","last_fullsized":"2023-11-18T20:39:22.379405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374000+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:21.374000+0000","last_peered":"2023-11-18T20:39:21.374000+0000","last_clean":"2023-11-18T20:39:21.374000+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:21.374000+0000","last_undegraded":"2023-11-18T20:39:21.374000+0000","last_fullsized":"2023-11-18T20:39:21.374000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:52:57.711383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371714+0000","last_change":"2023-11-18T20:39:02.767695+0000","last_active":"2023-11-18T20:39:21.371714+0000","last_peered":"2023-11-18T20:39:21.371714+0000","last_clean":"2023-11-18T20:39:21.371714+0000","last_became_active":"2023-11-18T20:39:02.765964+0000","last_became_peered":"2023-11-18T20:39:02.765964+0000","last_unstale":"2023-11-18T20:39:21.371714+0000","last_undegraded":"2023-11-18T20:39:21.371714+0000","last_fullsized":"2023-11-18T20:39:21.371714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410534+0000","last_change":"2023-11-18T20:39:22.406580+0000","last_active":"2023-11-18T20:39:22.410534+0000","last_peered":"2023-11-18T20:39:22.410534+0000","last_clean":"2023-11-18T20:39:22.410534+0000","last_became_active":"2023-11-18T20:39:22.405573+0000","last_became_peered":"2023-11-18T20:39:22.405573+0000","last_unstale":"2023-11-18T20:39:22.410534+0000","last_undegraded":"2023-11-18T20:39:22.410534+0000","last_fullsized":"2023-11-18T20:39:22.410534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:39.749910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.376577+0000","last_change":"2023-11-18T20:39:22.376577+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.376577+0000","last_undegraded":"2023-11-18T20:39:22.376577+0000","last_fullsized":"2023-11-18T20:39:22.376577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374887+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:21.374887+0000","last_peered":"2023-11-18T20:39:21.374887+0000","last_clean":"2023-11-18T20:39:21.374887+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:21.374887+0000","last_undegraded":"2023-11-18T20:39:21.374887+0000","last_fullsized":"2023-11-18T20:39:21.374887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378253+0000","last_change":"2023-11-18T20:39:02.748892+0000","last_active":"2023-11-18T20:39:21.378253+0000","last_peered":"2023-11-18T20:39:21.378253+0000","last_clean":"2023-11-18T20:39:21.378253+0000","last_became_active":"2023-11-18T20:39:02.748392+0000","last_became_peered":"2023-11-18T20:39:02.748392+0000","last_unstale":"2023-11-18T20:39:21.378253+0000","last_undegraded":"2023-11-18T20:39:21.378253+0000","last_fullsized":"2023-11-18T20:39:21.378253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:18.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.395025+0000","last_change":"2023-11-18T20:39:22.383835+0000","last_active":"2023-11-18T20:39:22.395025+0000","last_peered":"2023-11-18T20:39:22.395025+0000","last_clean":"2023-11-18T20:39:22.395025+0000","last_became_active":"2023-11-18T20:39:22.383055+0000","last_became_peered":"2023-11-18T20:39:22.383055+0000","last_unstale":"2023-11-18T20:39:22.395025+0000","last_undegraded":"2023-11-18T20:39:22.395025+0000","last_fullsized":"2023-11-18T20:39:22.395025+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:39.434602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387587+0000","last_change":"2023-11-18T20:39:22.387587+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387587+0000","last_undegraded":"2023-11-18T20:39:22.387587+0000","last_fullsized":"2023-11-18T20:39:22.387587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372159+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:21.372159+0000","last_peered":"2023-11-18T20:39:21.372159+0000","last_clean":"2023-11-18T20:39:21.372159+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:21.372159+0000","last_undegraded":"2023-11-18T20:39:21.372159+0000","last_fullsized":"2023-11-18T20:39:21.372159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377510+0000","last_change":"2023-11-18T20:39:02.755872+0000","last_active":"2023-11-18T20:39:21.377510+0000","last_peered":"2023-11-18T20:39:21.377510+0000","last_clean":"2023-11-18T20:39:21.377510+0000","last_became_active":"2023-11-18T20:39:02.755415+0000","last_became_peered":"2023-11-18T20:39:02.755415+0000","last_unstale":"2023-11-18T20:39:21.377510+0000","last_undegraded":"2023-11-18T20:39:21.377510+0000","last_fullsized":"2023-11-18T20:39:21.377510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:08.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.408515+0000","last_change":"2023-11-18T20:39:22.403667+0000","last_active":"2023-11-18T20:39:22.408515+0000","last_peered":"2023-11-18T20:39:22.408515+0000","last_clean":"2023-11-18T20:39:22.408515+0000","last_became_active":"2023-11-18T20:39:22.402205+0000","last_became_peered":"2023-11-18T20:39:22.402205+0000","last_unstale":"2023-11-18T20:39:22.408515+0000","last_undegraded":"2023-11-18T20:39:22.408515+0000","last_fullsized":"2023-11-18T20:39:22.408515+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:46.412346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381500+0000","last_change":"2023-11-18T20:39:22.381500+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381500+0000","last_undegraded":"2023-11-18T20:39:22.381500+0000","last_fullsized":"2023-11-18T20:39:22.381500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380866+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:21.380866+0000","last_peered":"2023-11-18T20:39:21.380866+0000","last_clean":"2023-11-18T20:39:21.380866+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:21.380866+0000","last_undegraded":"2023-11-18T20:39:21.380866+0000","last_fullsized":"2023-11-18T20:39:21.380866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:26.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368755+0000","last_change":"2023-11-18T20:39:02.774185+0000","last_active":"2023-11-18T20:39:21.368755+0000","last_peered":"2023-11-18T20:39:21.368755+0000","last_clean":"2023-11-18T20:39:21.368755+0000","last_became_active":"2023-11-18T20:39:02.773865+0000","last_became_peered":"2023-11-18T20:39:02.773865+0000","last_unstale":"2023-11-18T20:39:21.368755+0000","last_undegraded":"2023-11-18T20:39:21.368755+0000","last_fullsized":"2023-11-18T20:39:21.368755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:29.774288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.403839+0000","last_change":"2023-11-18T20:39:22.399738+0000","last_active":"2023-11-18T20:39:22.403839+0000","last_peered":"2023-11-18T20:39:22.403839+0000","last_clean":"2023-11-18T20:39:22.403839+0000","last_became_active":"2023-11-18T20:39:22.399456+0000","last_became_peered":"2023-11-18T20:39:22.399456+0000","last_unstale":"2023-11-18T20:39:22.403839+0000","last_undegraded":"2023-11-18T20:39:22.403839+0000","last_fullsized":"2023-11-18T20:39:22.403839+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:00.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381190+0000","last_change":"2023-11-18T20:39:22.381190+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381190+0000","last_undegraded":"2023-11-18T20:39:22.381190+0000","last_fullsized":"2023-11-18T20:39:22.381190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368764+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:21.368764+0000","last_peered":"2023-11-18T20:39:21.368764+0000","last_clean":"2023-11-18T20:39:21.368764+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:21.368764+0000","last_undegraded":"2023-11-18T20:39:21.368764+0000","last_fullsized":"2023-11-18T20:39:21.368764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:25.771785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.379101+0000","last_change":"2023-11-18T20:39:02.753904+0000","last_active":"2023-11-18T20:39:21.379101+0000","last_peered":"2023-11-18T20:39:21.379101+0000","last_clean":"2023-11-18T20:39:21.379101+0000","last_became_active":"2023-11-18T20:39:02.753415+0000","last_became_peered":"2023-11-18T20:39:02.753415+0000","last_unstale":"2023-11-18T20:39:21.379101+0000","last_undegraded":"2023-11-18T20:39:21.379101+0000","last_fullsized":"2023-11-18T20:39:21.379101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.402930+0000","last_change":"2023-11-18T20:39:22.398779+0000","last_active":"2023-11-18T20:39:22.402930+0000","last_peered":"2023-11-18T20:39:22.402930+0000","last_clean":"2023-11-18T20:39:22.402930+0000","last_became_active":"2023-11-18T20:39:22.398477+0000","last_became_peered":"2023-11-18T20:39:22.398477+0000","last_unstale":"2023-11-18T20:39:22.402930+0000","last_undegraded":"2023-11-18T20:39:22.402930+0000","last_fullsized":"2023-11-18T20:39:22.402930+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:52:08.082949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.386822+0000","last_change":"2023-11-18T20:39:22.386822+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.386822+0000","last_undegraded":"2023-11-18T20:39:22.386822+0000","last_fullsized":"2023-11-18T20:39:22.386822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.383126+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:21.383126+0000","last_peered":"2023-11-18T20:39:21.383126+0000","last_clean":"2023-11-18T20:39:21.383126+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:21.383126+0000","last_undegraded":"2023-11-18T20:39:21.383126+0000","last_fullsized":"2023-11-18T20:39:21.383126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380340+0000","last_change":"2023-11-18T20:39:02.763642+0000","last_active":"2023-11-18T20:39:21.380340+0000","last_peered":"2023-11-18T20:39:21.380340+0000","last_clean":"2023-11-18T20:39:21.380340+0000","last_became_active":"2023-11-18T20:39:02.763357+0000","last_became_peered":"2023-11-18T20:39:02.763357+0000","last_unstale":"2023-11-18T20:39:21.380340+0000","last_undegraded":"2023-11-18T20:39:21.380340+0000","last_fullsized":"2023-11-18T20:39:21.380340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:04.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.403456+0000","last_change":"2023-11-18T20:39:22.398742+0000","last_active":"2023-11-18T20:39:22.403456+0000","last_peered":"2023-11-18T20:39:22.403456+0000","last_clean":"2023-11-18T20:39:22.403456+0000","last_became_active":"2023-11-18T20:39:22.397880+0000","last_became_peered":"2023-11-18T20:39:22.397880+0000","last_unstale":"2023-11-18T20:39:22.403456+0000","last_undegraded":"2023-11-18T20:39:22.403456+0000","last_fullsized":"2023-11-18T20:39:22.403456+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:06.496537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387701+0000","last_change":"2023-11-18T20:39:22.387701+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387701+0000","last_undegraded":"2023-11-18T20:39:22.387701+0000","last_fullsized":"2023-11-18T20:39:22.387701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.384174+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:21.384174+0000","last_peered":"2023-11-18T20:39:21.384174+0000","last_clean":"2023-11-18T20:39:21.384174+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:21.384174+0000","last_undegraded":"2023-11-18T20:39:21.384174+0000","last_fullsized":"2023-11-18T20:39:21.384174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.109348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368762+0000","last_change":"2023-11-18T20:39:02.759699+0000","last_active":"2023-11-18T20:39:21.368762+0000","last_peered":"2023-11-18T20:39:21.368762+0000","last_clean":"2023-11-18T20:39:21.368762+0000","last_became_active":"2023-11-18T20:39:02.759410+0000","last_became_peered":"2023-11-18T20:39:02.759410+0000","last_unstale":"2023-11-18T20:39:21.368762+0000","last_undegraded":"2023-11-18T20:39:21.368762+0000","last_fullsized":"2023-11-18T20:39:21.368762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:52:49.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.395969+0000","last_change":"2023-11-18T20:39:22.393343+0000","last_active":"2023-11-18T20:39:22.395969+0000","last_peered":"2023-11-18T20:39:22.395969+0000","last_clean":"2023-11-18T20:39:22.395969+0000","last_became_active":"2023-11-18T20:39:22.392729+0000","last_became_peered":"2023-11-18T20:39:22.392729+0000","last_unstale":"2023-11-18T20:39:22.395969+0000","last_undegraded":"2023-11-18T20:39:22.395969+0000","last_fullsized":"2023-11-18T20:39:22.395969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:58:20.301898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.383458+0000","last_change":"2023-11-18T20:39:22.383458+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.383458+0000","last_undegraded":"2023-11-18T20:39:22.383458+0000","last_fullsized":"2023-11-18T20:39:22.383458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371833+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:21.371833+0000","last_peered":"2023-11-18T20:39:21.371833+0000","last_clean":"2023-11-18T20:39:21.371833+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:21.371833+0000","last_undegraded":"2023-11-18T20:39:21.371833+0000","last_fullsized":"2023-11-18T20:39:21.371833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373772+0000","last_change":"2023-11-18T20:39:02.770693+0000","last_active":"2023-11-18T20:39:21.373772+0000","last_peered":"2023-11-18T20:39:21.373772+0000","last_clean":"2023-11-18T20:39:21.373772+0000","last_became_active":"2023-11-18T20:39:02.766515+0000","last_became_peered":"2023-11-18T20:39:02.766515+0000","last_unstale":"2023-11-18T20:39:21.373772+0000","last_undegraded":"2023-11-18T20:39:21.373772+0000","last_fullsized":"2023-11-18T20:39:21.373772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.409962+0000","last_change":"2023-11-18T20:39:22.402398+0000","last_active":"2023-11-18T20:39:22.409962+0000","last_peered":"2023-11-18T20:39:22.409962+0000","last_clean":"2023-11-18T20:39:22.409962+0000","last_became_active":"2023-11-18T20:39:22.401355+0000","last_became_peered":"2023-11-18T20:39:22.401355+0000","last_unstale":"2023-11-18T20:39:22.409962+0000","last_undegraded":"2023-11-18T20:39:22.409962+0000","last_fullsized":"2023-11-18T20:39:22.409962+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:37.154011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387614+0000","last_change":"2023-11-18T20:39:22.387614+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387614+0000","last_undegraded":"2023-11-18T20:39:22.387614+0000","last_fullsized":"2023-11-18T20:39:22.387614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385622+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:21.385622+0000","last_peered":"2023-11-18T20:39:21.385622+0000","last_clean":"2023-11-18T20:39:21.385622+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:21.385622+0000","last_undegraded":"2023-11-18T20:39:21.385622+0000","last_fullsized":"2023-11-18T20:39:21.385622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377710+0000","last_change":"2023-11-18T20:39:02.772323+0000","last_active":"2023-11-18T20:39:21.377710+0000","last_peered":"2023-11-18T20:39:21.377710+0000","last_clean":"2023-11-18T20:39:21.377710+0000","last_became_active":"2023-11-18T20:39:02.771746+0000","last_became_peered":"2023-11-18T20:39:02.771746+0000","last_unstale":"2023-11-18T20:39:21.377710+0000","last_undegraded":"2023-11-18T20:39:21.377710+0000","last_fullsized":"2023-11-18T20:39:21.377710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:51.574371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.408005+0000","last_change":"2023-11-18T20:39:22.401734+0000","last_active":"2023-11-18T20:39:22.408005+0000","last_peered":"2023-11-18T20:39:22.408005+0000","last_clean":"2023-11-18T20:39:22.408005+0000","last_became_active":"2023-11-18T20:39:22.398776+0000","last_became_peered":"2023-11-18T20:39:22.398776+0000","last_unstale":"2023-11-18T20:39:22.408005+0000","last_undegraded":"2023-11-18T20:39:22.408005+0000","last_fullsized":"2023-11-18T20:39:22.408005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:16:14.495859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.384517+0000","last_change":"2023-11-18T20:39:22.384517+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.384517+0000","last_undegraded":"2023-11-18T20:39:22.384517+0000","last_fullsized":"2023-11-18T20:39:22.384517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371810+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:21.371810+0000","last_peered":"2023-11-18T20:39:21.371810+0000","last_clean":"2023-11-18T20:39:21.371810+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:21.371810+0000","last_undegraded":"2023-11-18T20:39:21.371810+0000","last_fullsized":"2023-11-18T20:39:21.371810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:47.442387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372008+0000","last_change":"2023-11-18T20:39:02.754613+0000","last_active":"2023-11-18T20:39:21.372008+0000","last_peered":"2023-11-18T20:39:21.372008+0000","last_clean":"2023-11-18T20:39:21.372008+0000","last_became_active":"2023-11-18T20:39:02.754350+0000","last_became_peered":"2023-11-18T20:39:02.754350+0000","last_unstale":"2023-11-18T20:39:21.372008+0000","last_undegraded":"2023-11-18T20:39:21.372008+0000","last_fullsized":"2023-11-18T20:39:21.372008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.411339+0000","last_change":"2023-11-18T20:39:22.406251+0000","last_active":"2023-11-18T20:39:22.411339+0000","last_peered":"2023-11-18T20:39:22.411339+0000","last_clean":"2023-11-18T20:39:22.411339+0000","last_became_active":"2023-11-18T20:39:22.405901+0000","last_became_peered":"2023-11-18T20:39:22.405901+0000","last_unstale":"2023-11-18T20:39:22.411339+0000","last_undegraded":"2023-11-18T20:39:22.411339+0000","last_fullsized":"2023-11-18T20:39:22.411339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:25:36.170594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381466+0000","last_change":"2023-11-18T20:39:22.381466+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381466+0000","last_undegraded":"2023-11-18T20:39:22.381466+0000","last_fullsized":"2023-11-18T20:39:22.381466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372104+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:21.372104+0000","last_peered":"2023-11-18T20:39:21.372104+0000","last_clean":"2023-11-18T20:39:21.372104+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:21.372104+0000","last_undegraded":"2023-11-18T20:39:21.372104+0000","last_fullsized":"2023-11-18T20:39:21.372104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378129+0000","last_change":"2023-11-18T20:39:02.774591+0000","last_active":"2023-11-18T20:39:21.378129+0000","last_peered":"2023-11-18T20:39:21.378129+0000","last_clean":"2023-11-18T20:39:21.378129+0000","last_became_active":"2023-11-18T20:39:02.774338+0000","last_became_peered":"2023-11-18T20:39:02.774338+0000","last_unstale":"2023-11-18T20:39:21.378129+0000","last_undegraded":"2023-11-18T20:39:21.378129+0000","last_fullsized":"2023-11-18T20:39:21.378129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:32.560325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410111+0000","last_change":"2023-11-18T20:39:22.406308+0000","last_active":"2023-11-18T20:39:22.410111+0000","last_peered":"2023-11-18T20:39:22.410111+0000","last_clean":"2023-11-18T20:39:22.410111+0000","last_became_active":"2023-11-18T20:39:22.405980+0000","last_became_peered":"2023-11-18T20:39:22.405980+0000","last_unstale":"2023-11-18T20:39:22.410111+0000","last_undegraded":"2023-11-18T20:39:22.410111+0000","last_fullsized":"2023-11-18T20:39:22.410111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:32:14.715267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385222+0000","last_change":"2023-11-18T20:39:22.385222+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385222+0000","last_undegraded":"2023-11-18T20:39:22.385222+0000","last_fullsized":"2023-11-18T20:39:22.385222+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407509+0000","last_change":"2023-11-18T20:39:22.399160+0000","last_active":"2023-11-18T20:39:22.407509+0000","last_peered":"2023-11-18T20:39:22.407509+0000","last_clean":"2023-11-18T20:39:22.407509+0000","last_became_active":"2023-11-18T20:39:22.397086+0000","last_became_peered":"2023-11-18T20:39:22.397086+0000","last_unstale":"2023-11-18T20:39:22.407509+0000","last_undegraded":"2023-11-18T20:39:22.407509+0000","last_fullsized":"2023-11-18T20:39:22.407509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.397359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.379513+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:21.379513+0000","last_peered":"2023-11-18T20:39:21.379513+0000","last_clean":"2023-11-18T20:39:21.379513+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:21.379513+0000","last_undegraded":"2023-11-18T20:39:21.379513+0000","last_fullsized":"2023-11-18T20:39:21.379513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.379919+0000","last_change":"2023-11-18T20:39:02.758817+0000","last_active":"2023-11-18T20:39:21.379919+0000","last_peered":"2023-11-18T20:39:21.379919+0000","last_clean":"2023-11-18T20:39:21.379919+0000","last_became_active":"2023-11-18T20:39:02.758440+0000","last_became_peered":"2023-11-18T20:39:02.758440+0000","last_unstale":"2023-11-18T20:39:21.379919+0000","last_undegraded":"2023-11-18T20:39:21.379919+0000","last_fullsized":"2023-11-18T20:39:21.379919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.392347+0000","last_change":"2023-11-18T20:39:22.392347+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.392347+0000","last_undegraded":"2023-11-18T20:39:22.392347+0000","last_fullsized":"2023-11-18T20:39:22.392347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407782+0000","last_change":"2023-11-18T20:39:22.399945+0000","last_active":"2023-11-18T20:39:22.407782+0000","last_peered":"2023-11-18T20:39:22.407782+0000","last_clean":"2023-11-18T20:39:22.407782+0000","last_became_active":"2023-11-18T20:39:22.399644+0000","last_became_peered":"2023-11-18T20:39:22.399644+0000","last_unstale":"2023-11-18T20:39:22.407782+0000","last_undegraded":"2023-11-18T20:39:22.407782+0000","last_fullsized":"2023-11-18T20:39:22.407782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:45.574523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386416+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:21.386416+0000","last_peered":"2023-11-18T20:39:21.386416+0000","last_clean":"2023-11-18T20:39:21.386416+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:21.386416+0000","last_undegraded":"2023-11-18T20:39:21.386416+0000","last_fullsized":"2023-11-18T20:39:21.386416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373035+0000","last_change":"2023-11-18T20:39:02.751638+0000","last_active":"2023-11-18T20:39:21.373035+0000","last_peered":"2023-11-18T20:39:21.373035+0000","last_clean":"2023-11-18T20:39:21.373035+0000","last_became_active":"2023-11-18T20:39:02.751330+0000","last_became_peered":"2023-11-18T20:39:02.751330+0000","last_unstale":"2023-11-18T20:39:21.373035+0000","last_undegraded":"2023-11-18T20:39:21.373035+0000","last_fullsized":"2023-11-18T20:39:21.373035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.394984+0000","last_change":"2023-11-18T20:39:22.394984+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.394984+0000","last_undegraded":"2023-11-18T20:39:22.394984+0000","last_fullsized":"2023-11-18T20:39:22.394984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377917+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:21.377917+0000","last_peered":"2023-11-18T20:39:21.377917+0000","last_clean":"2023-11-18T20:39:21.377917+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:21.377917+0000","last_undegraded":"2023-11-18T20:39:21.377917+0000","last_fullsized":"2023-11-18T20:39:21.377917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373683+0000","last_change":"2023-11-18T20:39:02.761289+0000","last_active":"2023-11-18T20:39:21.373683+0000","last_peered":"2023-11-18T20:39:21.373683+0000","last_clean":"2023-11-18T20:39:21.373683+0000","last_became_active":"2023-11-18T20:39:02.760948+0000","last_became_peered":"2023-11-18T20:39:02.760948+0000","last_unstale":"2023-11-18T20:39:21.373683+0000","last_undegraded":"2023-11-18T20:39:21.373683+0000","last_fullsized":"2023-11-18T20:39:21.373683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407101+0000","last_change":"2023-11-18T20:39:22.400658+0000","last_active":"2023-11-18T20:39:22.407101+0000","last_peered":"2023-11-18T20:39:22.407101+0000","last_clean":"2023-11-18T20:39:22.407101+0000","last_became_active":"2023-11-18T20:39:22.399324+0000","last_became_peered":"2023-11-18T20:39:22.399324+0000","last_unstale":"2023-11-18T20:39:22.407101+0000","last_undegraded":"2023-11-18T20:39:22.407101+0000","last_fullsized":"2023-11-18T20:39:22.407101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:06.739080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.375204+0000","last_change":"2023-11-18T20:39:22.375204+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.375204+0000","last_undegraded":"2023-11-18T20:39:22.375204+0000","last_fullsized":"2023-11-18T20:39:22.375204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.369268+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:21.369268+0000","last_peered":"2023-11-18T20:39:21.369268+0000","last_clean":"2023-11-18T20:39:21.369268+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:21.369268+0000","last_undegraded":"2023-11-18T20:39:21.369268+0000","last_fullsized":"2023-11-18T20:39:21.369268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:00.564472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385455+0000","last_change":"2023-11-18T20:39:02.761380+0000","last_active":"2023-11-18T20:39:21.385455+0000","last_peered":"2023-11-18T20:39:21.385455+0000","last_clean":"2023-11-18T20:39:21.385455+0000","last_became_active":"2023-11-18T20:39:02.760958+0000","last_became_peered":"2023-11-18T20:39:02.760958+0000","last_unstale":"2023-11-18T20:39:21.385455+0000","last_undegraded":"2023-11-18T20:39:21.385455+0000","last_fullsized":"2023-11-18T20:39:21.385455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:25.114138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407987+0000","last_change":"2023-11-18T20:39:22.400634+0000","last_active":"2023-11-18T20:39:22.407987+0000","last_peered":"2023-11-18T20:39:22.407987+0000","last_clean":"2023-11-18T20:39:22.407987+0000","last_became_active":"2023-11-18T20:39:22.399955+0000","last_became_peered":"2023-11-18T20:39:22.399955+0000","last_unstale":"2023-11-18T20:39:22.407987+0000","last_undegraded":"2023-11-18T20:39:22.407987+0000","last_fullsized":"2023-11-18T20:39:22.407987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:36:00.180292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.373909+0000","last_change":"2023-11-18T20:39:22.373909+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.373909+0000","last_undegraded":"2023-11-18T20:39:22.373909+0000","last_fullsized":"2023-11-18T20:39:22.373909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368223+0000","last_change":"2023-11-18T20:39:02.764472+0000","last_active":"2023-11-18T20:39:21.368223+0000","last_peered":"2023-11-18T20:39:21.368223+0000","last_clean":"2023-11-18T20:39:21.368223+0000","last_became_active":"2023-11-18T20:39:02.764087+0000","last_became_peered":"2023-11-18T20:39:02.764087+0000","last_unstale":"2023-11-18T20:39:21.368223+0000","last_undegraded":"2023-11-18T20:39:21.368223+0000","last_fullsized":"2023-11-18T20:39:21.368223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:00.994479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382078+0000","last_change":"2023-11-18T20:39:22.382078+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382078+0000","last_undegraded":"2023-11-18T20:39:22.382078+0000","last_fullsized":"2023-11-18T20:39:22.382078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371560+0000","last_change":"2023-11-18T20:39:02.767291+0000","last_active":"2023-11-18T20:39:21.371560+0000","last_peered":"2023-11-18T20:39:21.371560+0000","last_clean":"2023-11-18T20:39:21.371560+0000","last_became_active":"2023-11-18T20:39:02.764390+0000","last_became_peered":"2023-11-18T20:39:02.764390+0000","last_unstale":"2023-11-18T20:39:21.371560+0000","last_undegraded":"2023-11-18T20:39:21.371560+0000","last_fullsized":"2023-11-18T20:39:21.371560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.396739+0000","last_change":"2023-11-18T20:39:22.396739+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.396739+0000","last_undegraded":"2023-11-18T20:39:22.396739+0000","last_fullsized":"2023-11-18T20:39:22.396739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372866+0000","last_change":"2023-11-18T20:39:02.758480+0000","last_active":"2023-11-18T20:39:21.372866+0000","last_peered":"2023-11-18T20:39:21.372866+0000","last_clean":"2023-11-18T20:39:21.372866+0000","last_became_active":"2023-11-18T20:39:02.752070+0000","last_became_peered":"2023-11-18T20:39:02.752070+0000","last_unstale":"2023-11-18T20:39:21.372866+0000","last_undegraded":"2023-11-18T20:39:21.372866+0000","last_fullsized":"2023-11-18T20:39:21.372866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382153+0000","last_change":"2023-11-18T20:39:22.382153+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382153+0000","last_undegraded":"2023-11-18T20:39:22.382153+0000","last_fullsized":"2023-11-18T20:39:22.382153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374386+0000","last_change":"2023-11-18T20:39:02.772625+0000","last_active":"2023-11-18T20:39:21.374386+0000","last_peered":"2023-11-18T20:39:21.374386+0000","last_clean":"2023-11-18T20:39:21.374386+0000","last_became_active":"2023-11-18T20:39:02.772348+0000","last_became_peered":"2023-11-18T20:39:02.772348+0000","last_unstale":"2023-11-18T20:39:21.374386+0000","last_undegraded":"2023-11-18T20:39:21.374386+0000","last_fullsized":"2023-11-18T20:39:21.374386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.392693+0000","last_change":"2023-11-18T20:39:22.392693+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.392693+0000","last_undegraded":"2023-11-18T20:39:22.392693+0000","last_fullsized":"2023-11-18T20:39:22.392693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372946+0000","last_change":"2023-11-18T20:39:02.746609+0000","last_active":"2023-11-18T20:39:21.372946+0000","last_peered":"2023-11-18T20:39:21.372946+0000","last_clean":"2023-11-18T20:39:21.372946+0000","last_became_active":"2023-11-18T20:39:02.746324+0000","last_became_peered":"2023-11-18T20:39:02.746324+0000","last_unstale":"2023-11-18T20:39:21.372946+0000","last_undegraded":"2023-11-18T20:39:21.372946+0000","last_fullsized":"2023-11-18T20:39:21.372946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.384743+0000","last_change":"2023-11-18T20:39:22.384743+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.384743+0000","last_undegraded":"2023-11-18T20:39:22.384743+0000","last_fullsized":"2023-11-18T20:39:22.384743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.383741+0000","last_change":"2023-11-18T20:39:02.775796+0000","last_active":"2023-11-18T20:39:21.383741+0000","last_peered":"2023-11-18T20:39:21.383741+0000","last_clean":"2023-11-18T20:39:21.383741+0000","last_became_active":"2023-11-18T20:39:02.775503+0000","last_became_peered":"2023-11-18T20:39:02.775503+0000","last_unstale":"2023-11-18T20:39:21.383741+0000","last_undegraded":"2023-11-18T20:39:21.383741+0000","last_fullsized":"2023-11-18T20:39:21.383741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387217+0000","last_change":"2023-11-18T20:39:22.387217+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387217+0000","last_undegraded":"2023-11-18T20:39:22.387217+0000","last_fullsized":"2023-11-18T20:39:22.387217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377668+0000","last_change":"2023-11-18T20:39:02.774172+0000","last_active":"2023-11-18T20:39:21.377668+0000","last_peered":"2023-11-18T20:39:21.377668+0000","last_clean":"2023-11-18T20:39:21.377668+0000","last_became_active":"2023-11-18T20:39:02.773141+0000","last_became_peered":"2023-11-18T20:39:02.773141+0000","last_unstale":"2023-11-18T20:39:21.377668+0000","last_undegraded":"2023-11-18T20:39:21.377668+0000","last_fullsized":"2023-11-18T20:39:21.377668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:59:44.902815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387329+0000","last_change":"2023-11-18T20:39:22.387329+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387329+0000","last_undegraded":"2023-11-18T20:39:22.387329+0000","last_fullsized":"2023-11-18T20:39:22.387329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380176+0000","last_change":"2023-11-18T20:39:02.772030+0000","last_active":"2023-11-18T20:39:21.380176+0000","last_peered":"2023-11-18T20:39:21.380176+0000","last_clean":"2023-11-18T20:39:21.380176+0000","last_became_active":"2023-11-18T20:39:02.771761+0000","last_became_peered":"2023-11-18T20:39:02.771761+0000","last_unstale":"2023-11-18T20:39:21.380176+0000","last_undegraded":"2023-11-18T20:39:21.380176+0000","last_fullsized":"2023-11-18T20:39:21.380176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.394484+0000","last_change":"2023-11-18T20:39:22.394484+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.394484+0000","last_undegraded":"2023-11-18T20:39:22.394484+0000","last_fullsized":"2023-11-18T20:39:22.394484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371599+0000","last_change":"2023-11-18T20:39:02.752133+0000","last_active":"2023-11-18T20:39:21.371599+0000","last_peered":"2023-11-18T20:39:21.371599+0000","last_clean":"2023-11-18T20:39:21.371599+0000","last_became_active":"2023-11-18T20:39:02.751863+0000","last_became_peered":"2023-11-18T20:39:02.751863+0000","last_unstale":"2023-11-18T20:39:21.371599+0000","last_undegraded":"2023-11-18T20:39:21.371599+0000","last_fullsized":"2023-11-18T20:39:21.371599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:56.070643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.394716+0000","last_change":"2023-11-18T20:39:22.394716+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.394716+0000","last_undegraded":"2023-11-18T20:39:22.394716+0000","last_fullsized":"2023-11-18T20:39:22.394716+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.375268+0000","last_change":"2023-11-18T20:39:02.758024+0000","last_active":"2023-11-18T20:39:21.375268+0000","last_peered":"2023-11-18T20:39:21.375268+0000","last_clean":"2023-11-18T20:39:21.375268+0000","last_became_active":"2023-11-18T20:39:02.757737+0000","last_became_peered":"2023-11-18T20:39:02.757737+0000","last_unstale":"2023-11-18T20:39:21.375268+0000","last_undegraded":"2023-11-18T20:39:21.375268+0000","last_fullsized":"2023-11-18T20:39:21.375268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:42:50.023528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.373200+0000","last_change":"2023-11-18T20:39:22.373200+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.373200+0000","last_undegraded":"2023-11-18T20:39:22.373200+0000","last_fullsized":"2023-11-18T20:39:22.373200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371721+0000","last_change":"2023-11-18T20:39:02.752211+0000","last_active":"2023-11-18T20:39:21.371721+0000","last_peered":"2023-11-18T20:39:21.371721+0000","last_clean":"2023-11-18T20:39:21.371721+0000","last_became_active":"2023-11-18T20:39:02.751940+0000","last_became_peered":"2023-11-18T20:39:02.751940+0000","last_unstale":"2023-11-18T20:39:21.371721+0000","last_undegraded":"2023-11-18T20:39:21.371721+0000","last_fullsized":"2023-11-18T20:39:21.371721+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387652+0000","last_change":"2023-11-18T20:39:22.387652+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387652+0000","last_undegraded":"2023-11-18T20:39:22.387652+0000","last_fullsized":"2023-11-18T20:39:22.387652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374177+0000","last_change":"2023-11-18T20:39:02.758393+0000","last_active":"2023-11-18T20:39:21.374177+0000","last_peered":"2023-11-18T20:39:21.374177+0000","last_clean":"2023-11-18T20:39:21.374177+0000","last_became_active":"2023-11-18T20:39:02.752864+0000","last_became_peered":"2023-11-18T20:39:02.752864+0000","last_unstale":"2023-11-18T20:39:21.374177+0000","last_undegraded":"2023-11-18T20:39:21.374177+0000","last_fullsized":"2023-11-18T20:39:21.374177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381673+0000","last_change":"2023-11-18T20:39:22.381673+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381673+0000","last_undegraded":"2023-11-18T20:39:22.381673+0000","last_fullsized":"2023-11-18T20:39:22.381673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380693+0000","last_change":"2023-11-18T20:39:02.769220+0000","last_active":"2023-11-18T20:39:21.380693+0000","last_peered":"2023-11-18T20:39:21.380693+0000","last_clean":"2023-11-18T20:39:21.380693+0000","last_became_active":"2023-11-18T20:39:02.762271+0000","last_became_peered":"2023-11-18T20:39:02.762271+0000","last_unstale":"2023-11-18T20:39:21.380693+0000","last_undegraded":"2023-11-18T20:39:21.380693+0000","last_fullsized":"2023-11-18T20:39:21.380693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:37.501746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.374555+0000","last_change":"2023-11-18T20:39:22.374555+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.374555+0000","last_undegraded":"2023-11-18T20:39:22.374555+0000","last_fullsized":"2023-11-18T20:39:22.374555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386146+0000","last_change":"2023-11-18T20:39:02.759862+0000","last_active":"2023-11-18T20:39:21.386146+0000","last_peered":"2023-11-18T20:39:21.386146+0000","last_clean":"2023-11-18T20:39:21.386146+0000","last_became_active":"2023-11-18T20:39:02.759565+0000","last_became_peered":"2023-11-18T20:39:02.759565+0000","last_unstale":"2023-11-18T20:39:21.386146+0000","last_undegraded":"2023-11-18T20:39:21.386146+0000","last_fullsized":"2023-11-18T20:39:21.386146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385282+0000","last_change":"2023-11-18T20:39:22.385282+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385282+0000","last_undegraded":"2023-11-18T20:39:22.385282+0000","last_fullsized":"2023-11-18T20:39:22.385282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386280+0000","last_change":"2023-11-18T20:39:02.755514+0000","last_active":"2023-11-18T20:39:21.386280+0000","last_peered":"2023-11-18T20:39:21.386280+0000","last_clean":"2023-11-18T20:39:21.386280+0000","last_became_active":"2023-11-18T20:39:02.755083+0000","last_became_peered":"2023-11-18T20:39:02.755083+0000","last_unstale":"2023-11-18T20:39:21.386280+0000","last_undegraded":"2023-11-18T20:39:21.386280+0000","last_fullsized":"2023-11-18T20:39:21.386280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:57.948105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385739+0000","last_change":"2023-11-18T20:39:22.385739+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385739+0000","last_undegraded":"2023-11-18T20:39:22.385739+0000","last_fullsized":"2023-11-18T20:39:22.385739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.369021+0000","last_change":"2023-11-18T20:39:02.766551+0000","last_active":"2023-11-18T20:39:21.369021+0000","last_peered":"2023-11-18T20:39:21.369021+0000","last_clean":"2023-11-18T20:39:21.369021+0000","last_became_active":"2023-11-18T20:39:02.765528+0000","last_became_peered":"2023-11-18T20:39:02.765528+0000","last_unstale":"2023-11-18T20:39:21.369021+0000","last_undegraded":"2023-11-18T20:39:21.369021+0000","last_fullsized":"2023-11-18T20:39:21.369021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:30.943404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387576+0000","last_change":"2023-11-18T20:39:22.387576+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387576+0000","last_undegraded":"2023-11-18T20:39:22.387576+0000","last_fullsized":"2023-11-18T20:39:22.387576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372574+0000","last_change":"2023-11-18T20:39:02.759711+0000","last_active":"2023-11-18T20:39:21.372574+0000","last_peered":"2023-11-18T20:39:21.372574+0000","last_clean":"2023-11-18T20:39:21.372574+0000","last_became_active":"2023-11-18T20:39:02.759422+0000","last_became_peered":"2023-11-18T20:39:02.759422+0000","last_unstale":"2023-11-18T20:39:21.372574+0000","last_undegraded":"2023-11-18T20:39:21.372574+0000","last_fullsized":"2023-11-18T20:39:21.372574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388741+0000","last_change":"2023-11-18T20:39:22.388741+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388741+0000","last_undegraded":"2023-11-18T20:39:22.388741+0000","last_fullsized":"2023-11-18T20:39:22.388741+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373110+0000","last_change":"2023-11-18T20:39:02.750962+0000","last_active":"2023-11-18T20:39:21.373110+0000","last_peered":"2023-11-18T20:39:21.373110+0000","last_clean":"2023-11-18T20:39:21.373110+0000","last_became_active":"2023-11-18T20:39:02.750695+0000","last_became_peered":"2023-11-18T20:39:02.750695+0000","last_unstale":"2023-11-18T20:39:21.373110+0000","last_undegraded":"2023-11-18T20:39:21.373110+0000","last_fullsized":"2023-11-18T20:39:21.373110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.378443+0000","last_change":"2023-11-18T20:39:22.378443+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.378443+0000","last_undegraded":"2023-11-18T20:39:22.378443+0000","last_fullsized":"2023-11-18T20:39:22.378443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374569+0000","last_change":"2023-11-18T20:39:02.766121+0000","last_active":"2023-11-18T20:39:21.374569+0000","last_peered":"2023-11-18T20:39:21.374569+0000","last_clean":"2023-11-18T20:39:21.374569+0000","last_became_active":"2023-11-18T20:39:02.765807+0000","last_became_peered":"2023-11-18T20:39:02.765807+0000","last_unstale":"2023-11-18T20:39:21.374569+0000","last_undegraded":"2023-11-18T20:39:21.374569+0000","last_fullsized":"2023-11-18T20:39:21.374569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:15.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.392990+0000","last_change":"2023-11-18T20:39:22.392990+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.392990+0000","last_undegraded":"2023-11-18T20:39:22.392990+0000","last_fullsized":"2023-11-18T20:39:22.392990+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.379938+0000","last_change":"2023-11-18T20:39:02.748415+0000","last_active":"2023-11-18T20:39:21.379938+0000","last_peered":"2023-11-18T20:39:21.379938+0000","last_clean":"2023-11-18T20:39:21.379938+0000","last_became_active":"2023-11-18T20:39:02.748123+0000","last_became_peered":"2023-11-18T20:39:02.748123+0000","last_unstale":"2023-11-18T20:39:21.379938+0000","last_undegraded":"2023-11-18T20:39:21.379938+0000","last_fullsized":"2023-11-18T20:39:21.379938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:36:58.122129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.383843+0000","last_change":"2023-11-18T20:39:22.383843+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.383843+0000","last_undegraded":"2023-11-18T20:39:22.383843+0000","last_fullsized":"2023-11-18T20:39:22.383843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378161+0000","last_change":"2023-11-18T20:39:02.756659+0000","last_active":"2023-11-18T20:39:21.378161+0000","last_peered":"2023-11-18T20:39:21.378161+0000","last_clean":"2023-11-18T20:39:21.378161+0000","last_became_active":"2023-11-18T20:39:02.756336+0000","last_became_peered":"2023-11-18T20:39:02.756336+0000","last_unstale":"2023-11-18T20:39:21.378161+0000","last_undegraded":"2023-11-18T20:39:21.378161+0000","last_fullsized":"2023-11-18T20:39:21.378161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:14.460811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.386788+0000","last_change":"2023-11-18T20:39:22.386788+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.386788+0000","last_undegraded":"2023-11-18T20:39:22.386788+0000","last_fullsized":"2023-11-18T20:39:22.386788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368908+0000","last_change":"2023-11-18T20:39:02.773954+0000","last_active":"2023-11-18T20:39:21.368908+0000","last_peered":"2023-11-18T20:39:21.368908+0000","last_clean":"2023-11-18T20:39:21.368908+0000","last_became_active":"2023-11-18T20:39:02.773686+0000","last_became_peered":"2023-11-18T20:39:02.773686+0000","last_unstale":"2023-11-18T20:39:21.368908+0000","last_undegraded":"2023-11-18T20:39:21.368908+0000","last_fullsized":"2023-11-18T20:39:21.368908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:54.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.373867+0000","last_change":"2023-11-18T20:39:22.373867+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.373867+0000","last_undegraded":"2023-11-18T20:39:22.373867+0000","last_fullsized":"2023-11-18T20:39:22.373867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377419+0000","last_change":"2023-11-18T20:39:02.764804+0000","last_active":"2023-11-18T20:39:21.377419+0000","last_peered":"2023-11-18T20:39:21.377419+0000","last_clean":"2023-11-18T20:39:21.377419+0000","last_became_active":"2023-11-18T20:39:02.764574+0000","last_became_peered":"2023-11-18T20:39:02.764574+0000","last_unstale":"2023-11-18T20:39:21.377419+0000","last_undegraded":"2023-11-18T20:39:21.377419+0000","last_fullsized":"2023-11-18T20:39:21.377419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.395968+0000","last_change":"2023-11-18T20:39:22.395968+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.395968+0000","last_undegraded":"2023-11-18T20:39:22.395968+0000","last_fullsized":"2023-11-18T20:39:22.395968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378323+0000","last_change":"2023-11-18T20:39:02.775795+0000","last_active":"2023-11-18T20:39:21.378323+0000","last_peered":"2023-11-18T20:39:21.378323+0000","last_clean":"2023-11-18T20:39:21.378323+0000","last_became_active":"2023-11-18T20:39:02.775493+0000","last_became_peered":"2023-11-18T20:39:02.775493+0000","last_unstale":"2023-11-18T20:39:21.378323+0000","last_undegraded":"2023-11-18T20:39:21.378323+0000","last_fullsized":"2023-11-18T20:39:21.378323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385114+0000","last_change":"2023-11-18T20:39:22.385114+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385114+0000","last_undegraded":"2023-11-18T20:39:22.385114+0000","last_fullsized":"2023-11-18T20:39:22.385114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371471+0000","last_change":"2023-11-18T20:39:02.744529+0000","last_active":"2023-11-18T20:39:21.371471+0000","last_peered":"2023-11-18T20:39:21.371471+0000","last_clean":"2023-11-18T20:39:21.371471+0000","last_became_active":"2023-11-18T20:39:02.744056+0000","last_became_peered":"2023-11-18T20:39:02.744056+0000","last_unstale":"2023-11-18T20:39:21.371471+0000","last_undegraded":"2023-11-18T20:39:21.371471+0000","last_fullsized":"2023-11-18T20:39:21.371471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:28.509793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382476+0000","last_change":"2023-11-18T20:39:22.382476+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382476+0000","last_undegraded":"2023-11-18T20:39:22.382476+0000","last_fullsized":"2023-11-18T20:39:22.382476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371550+0000","last_change":"2023-11-18T20:39:02.767101+0000","last_active":"2023-11-18T20:39:21.371550+0000","last_peered":"2023-11-18T20:39:21.371550+0000","last_clean":"2023-11-18T20:39:21.371550+0000","last_became_active":"2023-11-18T20:39:02.764500+0000","last_became_peered":"2023-11-18T20:39:02.764500+0000","last_unstale":"2023-11-18T20:39:21.371550+0000","last_undegraded":"2023-11-18T20:39:21.371550+0000","last_fullsized":"2023-11-18T20:39:21.371550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.397224+0000","last_change":"2023-11-18T20:39:22.397224+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.397224+0000","last_undegraded":"2023-11-18T20:39:22.397224+0000","last_fullsized":"2023-11-18T20:39:22.397224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385948+0000","last_change":"2023-11-18T20:39:02.755127+0000","last_active":"2023-11-18T20:39:21.385948+0000","last_peered":"2023-11-18T20:39:21.385948+0000","last_clean":"2023-11-18T20:39:21.385948+0000","last_became_active":"2023-11-18T20:39:02.754791+0000","last_became_peered":"2023-11-18T20:39:02.754791+0000","last_unstale":"2023-11-18T20:39:21.385948+0000","last_undegraded":"2023-11-18T20:39:21.385948+0000","last_fullsized":"2023-11-18T20:39:21.385948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388143+0000","last_change":"2023-11-18T20:39:22.388143+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388143+0000","last_undegraded":"2023-11-18T20:39:22.388143+0000","last_fullsized":"2023-11-18T20:39:22.388143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.382238+0000","last_change":"2023-11-18T20:39:02.757930+0000","last_active":"2023-11-18T20:39:21.382238+0000","last_peered":"2023-11-18T20:39:21.382238+0000","last_clean":"2023-11-18T20:39:21.382238+0000","last_became_active":"2023-11-18T20:39:02.757463+0000","last_became_peered":"2023-11-18T20:39:02.757463+0000","last_unstale":"2023-11-18T20:39:21.382238+0000","last_undegraded":"2023-11-18T20:39:21.382238+0000","last_fullsized":"2023-11-18T20:39:21.382238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.377910+0000","last_change":"2023-11-18T20:39:22.377910+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.377910+0000","last_undegraded":"2023-11-18T20:39:22.377910+0000","last_fullsized":"2023-11-18T20:39:22.377910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378876+0000","last_change":"2023-11-18T20:39:02.752584+0000","last_active":"2023-11-18T20:39:21.378876+0000","last_peered":"2023-11-18T20:39:21.378876+0000","last_clean":"2023-11-18T20:39:21.378876+0000","last_became_active":"2023-11-18T20:39:02.752259+0000","last_became_peered":"2023-11-18T20:39:02.752259+0000","last_unstale":"2023-11-18T20:39:21.378876+0000","last_undegraded":"2023-11-18T20:39:21.378876+0000","last_fullsized":"2023-11-18T20:39:21.378876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385645+0000","last_change":"2023-11-18T20:39:22.385645+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385645+0000","last_undegraded":"2023-11-18T20:39:22.385645+0000","last_fullsized":"2023-11-18T20:39:22.385645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378430+0000","last_change":"2023-11-18T20:39:02.756005+0000","last_active":"2023-11-18T20:39:21.378430+0000","last_peered":"2023-11-18T20:39:21.378430+0000","last_clean":"2023-11-18T20:39:21.378430+0000","last_became_active":"2023-11-18T20:39:02.754298+0000","last_became_peered":"2023-11-18T20:39:02.754298+0000","last_unstale":"2023-11-18T20:39:21.378430+0000","last_undegraded":"2023-11-18T20:39:21.378430+0000","last_fullsized":"2023-11-18T20:39:21.378430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388278+0000","last_change":"2023-11-18T20:39:22.388278+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388278+0000","last_undegraded":"2023-11-18T20:39:22.388278+0000","last_fullsized":"2023-11-18T20:39:22.388278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.382997+0000","last_change":"2023-11-18T20:39:02.774649+0000","last_active":"2023-11-18T20:39:21.382997+0000","last_peered":"2023-11-18T20:39:21.382997+0000","last_clean":"2023-11-18T20:39:21.382997+0000","last_became_active":"2023-11-18T20:39:02.774358+0000","last_became_peered":"2023-11-18T20:39:02.774358+0000","last_unstale":"2023-11-18T20:39:21.382997+0000","last_undegraded":"2023-11-18T20:39:21.382997+0000","last_fullsized":"2023-11-18T20:39:21.382997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381602+0000","last_change":"2023-11-18T20:39:22.381602+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381602+0000","last_undegraded":"2023-11-18T20:39:22.381602+0000","last_fullsized":"2023-11-18T20:39:22.381602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373613+0000","last_change":"2023-11-18T20:39:02.760762+0000","last_active":"2023-11-18T20:39:21.373613+0000","last_peered":"2023-11-18T20:39:21.373613+0000","last_clean":"2023-11-18T20:39:21.373613+0000","last_became_active":"2023-11-18T20:39:02.760426+0000","last_became_peered":"2023-11-18T20:39:02.760426+0000","last_unstale":"2023-11-18T20:39:21.373613+0000","last_undegraded":"2023-11-18T20:39:21.373613+0000","last_fullsized":"2023-11-18T20:39:21.373613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":168457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.083}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.6180000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.036},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.3400000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.4490000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.407}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":2.1040000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.1669999999999998},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.5580000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.99299999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0569999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1080000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.403}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.204}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.26}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":752255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.25},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.7110000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.1040000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.617},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.369}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.345},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.827}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.478},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.4299999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.778},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.6759999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.528},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.8740000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":164434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.82899999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.1180000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.3069999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.224}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.4750000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.28},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.532}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.597},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.5740000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":169211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.2170000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.595}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.675}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.345},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.7330000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.7809999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.8240000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":2.081}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":161339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.61299999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.94099999999999995}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.74299999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.97499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":751743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.016},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.071}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.1279999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2669999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.391},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.5740000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.4810000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.45},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.512}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.54}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":161395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":1.331},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":1.141},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.6459999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.5549999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.514}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.421}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.601},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.6180000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:27.885 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:28.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.134+0000 7f46957ee640 1 Processor -- start 2023-11-18T20:39:28.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.134+0000 7f46957ee640 1 -- start start 2023-11-18T20:39:28.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.136+0000 7f46957ee640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4690155490 0x7f46900a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.136+0000 7f46957ee640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46900c06c0 con 0x7f46900c1500 2023-11-18T20:39:28.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.136+0000 7f46957ee640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46900c1020 con 0x7f46900a9b40 2023-11-18T20:39:28.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.136+0000 7f46957ee640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46900a5820 con 0x7f4690155490 2023-11-18T20:39:28.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.136+0000 7f4687fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f46900c1500 0x7f46900a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51122/0 (socket says 172.21.15.132:51122) 2023-11-18T20:39:28.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.136+0000 7f4687fff640 1 -- 172.21.15.132:0/334636355 learned_addr learned my addr 172.21.15.132:0/334636355 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:28.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.136+0000 7f468effd640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4690155490 0x7f46900a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018215639 0 0) 0x7f46900c06c0 con 0x7f46900c1500 2023-11-18T20:39:28.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467c003520 con 0x7f46900c1500 2023-11-18T20:39:28.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4024041775 0 0) 0x7f467c003520 con 0x7f46900c1500 2023-11-18T20:39:28.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4690155490 msgr2=0x7f46900a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:28.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4690155490 0x7f46900a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 >> v1:172.21.15.161:6789/0 conn(0x7f46900a9b40 legacy=0x7f46900c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46900c0910 con 0x7f46900c1500 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f4678001670 con 0x7f46900c1500 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 >> v1:172.21.15.132:6789/0 conn(0x7f46900c1500 legacy=0x7f46900a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f467c0039a0 0x7f467c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0047c0 0x7f467c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c005180 0x7f467c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c00e260 con 0x7f467c0039a0 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c00e3d0 con 0x7f467c005180 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c00e590 con 0x7f467c0047c0 2023-11-18T20:39:28.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.137+0000 7f468effd640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4690155490 0x7f46900a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:39:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.138+0000 7f468effd640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f467c0039a0 0x7f467c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.138+0000 7f4687fff640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0047c0 0x7f467c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.138+0000 7f468f7fe640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c005180 0x7f467c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.138+0000 7f468effd640 1 -- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0047c0 msgr2=0x7f467c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.138+0000 7f468effd640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0047c0 0x7f467c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.138+0000 7f468effd640 1 -- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c005180 msgr2=0x7f467c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.138+0000 7f468effd640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c005180 0x7f467c00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.138+0000 7f468effd640 1 -- 172.21.15.132:0/334636355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c003520 con 0x7f467c0039a0 2023-11-18T20:39:28.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.139+0000 7f468effd640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f467c0039a0 0x7f467c003dc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4680006fd0 tx=0x7f467c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84c24753cae7b4b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:28.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.139+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680033600 con 0x7f467c0039a0 2023-11-18T20:39:28.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.139+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468002f050 con 0x7f467c0039a0 2023-11-18T20:39:28.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.139+0000 7f468e7fc640 1 -- 172.21.15.132:0/334636355 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680033980 con 0x7f467c0039a0 2023-11-18T20:39:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.140+0000 7f46957ee640 1 -- 172.21.15.132:0/334636355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f467c0039a0 msgr2=0x7f467c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.140+0000 7f46957ee640 1 --2- 172.21.15.132:0/334636355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f467c0039a0 0x7f467c003dc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4680006fd0 tx=0x7f467c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.140+0000 7f468f7fe640 1 -- 172.21.15.132:0/334636355 reap_dead start 2023-11-18T20:39:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.140+0000 7f46957ee640 1 -- 172.21.15.132:0/334636355 shutdown_connections 2023-11-18T20:39:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.140+0000 7f46957ee640 1 -- 172.21.15.132:0/334636355 >> 172.21.15.132:0/334636355 conn(0x7f469006a500 msgr2=0x7f469006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.140+0000 7f46957ee640 1 -- 172.21.15.132:0/334636355 shutdown_connections 2023-11-18T20:39:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.140+0000 7f46957ee640 1 -- 172.21.15.132:0/334636355 wait complete. 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.142+0000 7f46957ee640 1 Processor -- start 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.142+0000 7f46957ee640 1 -- start start 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f46957ee640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0039a0 0x7f46900bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f46957ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46900a68d0 0x7f46900a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f46957ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f469014e100 0x7f469014e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f46957ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46900bd4f0 con 0x7f469014e100 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f46957ee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46900715f0 con 0x7f46900a68d0 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f46957ee640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4690071dc0 con 0x7f467c0039a0 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f469014e100 0x7f469014e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f469014e100 0x7f469014e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43352/0 (socket says 172.21.15.132:43352) 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.143+0000 7f468f7fe640 1 -- 172.21.15.132:0/653510601 learned_addr learned my addr 172.21.15.132:0/653510601 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f468effd640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0039a0 0x7f46900bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f468f7fe640 1 -- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0039a0 msgr2=0x7f46900bf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f4687fff640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46900a68d0 0x7f46900a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f468f7fe640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0039a0 0x7f46900bf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f468f7fe640 1 -- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46900a68d0 msgr2=0x7f46900a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f468f7fe640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46900a68d0 0x7f46900a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f468f7fe640 1 -- 172.21.15.132:0/653510601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46901e6ad0 con 0x7f469014e100 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f468effd640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0039a0 0x7f46900bf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f4687fff640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46900a68d0 0x7f46900a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f468f7fe640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f469014e100 0x7f469014e580 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4688007fd0 tx=0x7f468800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:28.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f46877fe640 1 -- 172.21.15.132:0/653510601 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688003970 con 0x7f469014e100 2023-11-18T20:39:28.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f46877fe640 1 -- 172.21.15.132:0/653510601 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4688003af0 con 0x7f469014e100 2023-11-18T20:39:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f46877fe640 1 -- 172.21.15.132:0/653510601 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688003ea0 con 0x7f469014e100 2023-11-18T20:39:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4690071800 con 0x7f469014e100 2023-11-18T20:39:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.144+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46901e6780 con 0x7f469014e100 2023-11-18T20:39:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.146+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4690068350 con 0x7f469014e100 2023-11-18T20:39:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.147+0000 7f46877fe640 1 -- 172.21.15.132:0/653510601 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46880050d0 con 0x7f469014e100 2023-11-18T20:39:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.148+0000 7f46877fe640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f467006ae40 0x7f467006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.148+0000 7f46877fe640 1 -- 172.21.15.132:0/653510601 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f46880895e0 con 0x7f469014e100 2023-11-18T20:39:28.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.149+0000 7f468effd640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f467006ae40 0x7f467006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.150+0000 7f468effd640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f467006ae40 0x7f467006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4680036000 tx=0x7f4680035040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:28.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.152+0000 7f46877fe640 1 -- 172.21.15.132:0/653510601 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46880543c0 con 0x7f469014e100 2023-11-18T20:39:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.338+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4690155870 con 0x7f467006ae40 2023-11-18T20:39:28.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.377+0000 7f46877fe640 1 -- 172.21.15.132:0/653510601 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519648 (secure 0 0 0) 0x7f4680033810 con 0x7f467006ae40 2023-11-18T20:39:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:28.388 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:28.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.383+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f467006ae40 msgr2=0x7f467006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.383+0000 7f46957ee640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f467006ae40 0x7f467006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4680036000 tx=0x7f4680035040 comp rx=0 tx=0).stop 2023-11-18T20:39:28.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.383+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f469014e100 msgr2=0x7f469014e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.383+0000 7f46957ee640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f469014e100 0x7f469014e580 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4688007fd0 tx=0x7f468800ec10 comp rx=0 tx=0).stop 2023-11-18T20:39:28.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.384+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 shutdown_connections 2023-11-18T20:39:28.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.384+0000 7f46957ee640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f467006ae40 0x7f467006d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.384+0000 7f46957ee640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f469014e100 0x7f469014e580 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.384+0000 7f46957ee640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46900a68d0 0x7f46900a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.384+0000 7f46957ee640 1 --2- 172.21.15.132:0/653510601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c0039a0 0x7f46900bf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.384+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 >> 172.21.15.132:0/653510601 conn(0x7f469006a500 msgr2=0x7f469006ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:28.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.384+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 shutdown_connections 2023-11-18T20:39:28.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.384+0000 7f46957ee640 1 -- 172.21.15.132:0/653510601 wait complete. 2023-11-18T20:39:28.405 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-11-18T20:39:26.661356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":218,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4521984,"data_stored":2493246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.298310"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.396999+0000","last_change":"2023-11-18T20:39:22.396999+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.396999+0000","last_undegraded":"2023-11-18T20:39:22.396999+0000","last_fullsized":"2023-11-18T20:39:22.396999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377687+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:21.377687+0000","last_peered":"2023-11-18T20:39:21.377687+0000","last_clean":"2023-11-18T20:39:21.377687+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:21.377687+0000","last_undegraded":"2023-11-18T20:39:21.377687+0000","last_fullsized":"2023-11-18T20:39:21.377687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.369050+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:21.369050+0000","last_peered":"2023-11-18T20:39:21.369050+0000","last_clean":"2023-11-18T20:39:21.369050+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:21.369050+0000","last_undegraded":"2023-11-18T20:39:21.369050+0000","last_fullsized":"2023-11-18T20:39:21.369050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:49.505805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373936+0000","last_change":"2023-11-18T20:39:02.760047+0000","last_active":"2023-11-18T20:39:21.373936+0000","last_peered":"2023-11-18T20:39:21.373936+0000","last_clean":"2023-11-18T20:39:21.373936+0000","last_became_active":"2023-11-18T20:39:02.759514+0000","last_became_peered":"2023-11-18T20:39:02.759514+0000","last_unstale":"2023-11-18T20:39:21.373936+0000","last_undegraded":"2023-11-18T20:39:21.373936+0000","last_fullsized":"2023-11-18T20:39:21.373936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.412681+0000","last_change":"2023-11-18T20:39:22.407903+0000","last_active":"2023-11-18T20:39:22.412681+0000","last_peered":"2023-11-18T20:39:22.412681+0000","last_clean":"2023-11-18T20:39:22.412681+0000","last_became_active":"2023-11-18T20:39:22.407672+0000","last_became_peered":"2023-11-18T20:39:22.407672+0000","last_unstale":"2023-11-18T20:39:22.412681+0000","last_undegraded":"2023-11-18T20:39:22.412681+0000","last_fullsized":"2023-11-18T20:39:22.412681+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:37:47.593870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.395272+0000","last_change":"2023-11-18T20:39:22.395272+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.395272+0000","last_undegraded":"2023-11-18T20:39:22.395272+0000","last_fullsized":"2023-11-18T20:39:22.395272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372391+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:21.372391+0000","last_peered":"2023-11-18T20:39:21.372391+0000","last_clean":"2023-11-18T20:39:21.372391+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:21.372391+0000","last_undegraded":"2023-11-18T20:39:21.372391+0000","last_fullsized":"2023-11-18T20:39:21.372391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:56.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368439+0000","last_change":"2023-11-18T20:39:02.755764+0000","last_active":"2023-11-18T20:39:21.368439+0000","last_peered":"2023-11-18T20:39:21.368439+0000","last_clean":"2023-11-18T20:39:21.368439+0000","last_became_active":"2023-11-18T20:39:02.755464+0000","last_became_peered":"2023-11-18T20:39:02.755464+0000","last_unstale":"2023-11-18T20:39:21.368439+0000","last_undegraded":"2023-11-18T20:39:21.368439+0000","last_fullsized":"2023-11-18T20:39:21.368439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:24.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410322+0000","last_change":"2023-11-18T20:39:22.406273+0000","last_active":"2023-11-18T20:39:22.410322+0000","last_peered":"2023-11-18T20:39:22.410322+0000","last_clean":"2023-11-18T20:39:22.410322+0000","last_became_active":"2023-11-18T20:39:22.405680+0000","last_became_peered":"2023-11-18T20:39:22.405680+0000","last_unstale":"2023-11-18T20:39:22.410322+0000","last_undegraded":"2023-11-18T20:39:22.410322+0000","last_fullsized":"2023-11-18T20:39:22.410322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:49:29.718002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381641+0000","last_change":"2023-11-18T20:39:22.381641+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381641+0000","last_undegraded":"2023-11-18T20:39:22.381641+0000","last_fullsized":"2023-11-18T20:39:22.381641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372377+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:21.372377+0000","last_peered":"2023-11-18T20:39:21.372377+0000","last_clean":"2023-11-18T20:39:21.372377+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:21.372377+0000","last_undegraded":"2023-11-18T20:39:21.372377+0000","last_fullsized":"2023-11-18T20:39:21.372377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:24.984694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371989+0000","last_change":"2023-11-18T20:39:02.752804+0000","last_active":"2023-11-18T20:39:21.371989+0000","last_peered":"2023-11-18T20:39:21.371989+0000","last_clean":"2023-11-18T20:39:21.371989+0000","last_became_active":"2023-11-18T20:39:02.752203+0000","last_became_peered":"2023-11-18T20:39:02.752203+0000","last_unstale":"2023-11-18T20:39:21.371989+0000","last_undegraded":"2023-11-18T20:39:21.371989+0000","last_fullsized":"2023-11-18T20:39:21.371989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410107+0000","last_change":"2023-11-18T20:39:22.406528+0000","last_active":"2023-11-18T20:39:22.410107+0000","last_peered":"2023-11-18T20:39:22.410107+0000","last_clean":"2023-11-18T20:39:22.410107+0000","last_became_active":"2023-11-18T20:39:22.406024+0000","last_became_peered":"2023-11-18T20:39:22.406024+0000","last_unstale":"2023-11-18T20:39:22.410107+0000","last_undegraded":"2023-11-18T20:39:22.410107+0000","last_fullsized":"2023-11-18T20:39:22.410107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:24.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.375987+0000","last_change":"2023-11-18T20:39:22.375987+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.375987+0000","last_undegraded":"2023-11-18T20:39:22.375987+0000","last_fullsized":"2023-11-18T20:39:22.375987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377747+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:21.377747+0000","last_peered":"2023-11-18T20:39:21.377747+0000","last_clean":"2023-11-18T20:39:21.377747+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:21.377747+0000","last_undegraded":"2023-11-18T20:39:21.377747+0000","last_fullsized":"2023-11-18T20:39:21.377747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:30.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380867+0000","last_change":"2023-11-18T20:39:02.748674+0000","last_active":"2023-11-18T20:39:21.380867+0000","last_peered":"2023-11-18T20:39:21.380867+0000","last_clean":"2023-11-18T20:39:21.380867+0000","last_became_active":"2023-11-18T20:39:02.748033+0000","last_became_peered":"2023-11-18T20:39:02.748033+0000","last_unstale":"2023-11-18T20:39:21.380867+0000","last_undegraded":"2023-11-18T20:39:21.380867+0000","last_fullsized":"2023-11-18T20:39:21.380867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:31.017030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.413393+0000","last_change":"2023-11-18T20:39:22.409054+0000","last_active":"2023-11-18T20:39:22.413393+0000","last_peered":"2023-11-18T20:39:22.413393+0000","last_clean":"2023-11-18T20:39:22.413393+0000","last_became_active":"2023-11-18T20:39:22.408725+0000","last_became_peered":"2023-11-18T20:39:22.408725+0000","last_unstale":"2023-11-18T20:39:22.413393+0000","last_undegraded":"2023-11-18T20:39:22.413393+0000","last_fullsized":"2023-11-18T20:39:22.413393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:48.145975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.379247+0000","last_change":"2023-11-18T20:39:22.379247+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.379247+0000","last_undegraded":"2023-11-18T20:39:22.379247+0000","last_fullsized":"2023-11-18T20:39:22.379247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380290+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:21.380290+0000","last_peered":"2023-11-18T20:39:21.380290+0000","last_clean":"2023-11-18T20:39:21.380290+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:21.380290+0000","last_undegraded":"2023-11-18T20:39:21.380290+0000","last_fullsized":"2023-11-18T20:39:21.380290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:01.441027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372898+0000","last_change":"2023-11-18T20:39:02.755847+0000","last_active":"2023-11-18T20:39:21.372898+0000","last_peered":"2023-11-18T20:39:21.372898+0000","last_clean":"2023-11-18T20:39:21.372898+0000","last_became_active":"2023-11-18T20:39:02.755565+0000","last_became_peered":"2023-11-18T20:39:02.755565+0000","last_unstale":"2023-11-18T20:39:21.372898+0000","last_undegraded":"2023-11-18T20:39:21.372898+0000","last_fullsized":"2023-11-18T20:39:21.372898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407929+0000","last_change":"2023-11-18T20:39:22.400862+0000","last_active":"2023-11-18T20:39:22.407929+0000","last_peered":"2023-11-18T20:39:22.407929+0000","last_clean":"2023-11-18T20:39:22.407929+0000","last_became_active":"2023-11-18T20:39:22.400584+0000","last_became_peered":"2023-11-18T20:39:22.400584+0000","last_unstale":"2023-11-18T20:39:22.407929+0000","last_undegraded":"2023-11-18T20:39:22.407929+0000","last_fullsized":"2023-11-18T20:39:22.407929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:02.530453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388653+0000","last_change":"2023-11-18T20:39:22.388653+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388653+0000","last_undegraded":"2023-11-18T20:39:22.388653+0000","last_fullsized":"2023-11-18T20:39:22.388653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.381017+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:21.381017+0000","last_peered":"2023-11-18T20:39:21.381017+0000","last_clean":"2023-11-18T20:39:21.381017+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:21.381017+0000","last_undegraded":"2023-11-18T20:39:21.381017+0000","last_fullsized":"2023-11-18T20:39:21.381017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:43.756070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386291+0000","last_change":"2023-11-18T20:39:02.766797+0000","last_active":"2023-11-18T20:39:21.386291+0000","last_peered":"2023-11-18T20:39:21.386291+0000","last_clean":"2023-11-18T20:39:21.386291+0000","last_became_active":"2023-11-18T20:39:02.766466+0000","last_became_peered":"2023-11-18T20:39:02.766466+0000","last_unstale":"2023-11-18T20:39:21.386291+0000","last_undegraded":"2023-11-18T20:39:21.386291+0000","last_fullsized":"2023-11-18T20:39:21.386291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.491100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.413842+0000","last_change":"2023-11-18T20:39:22.410942+0000","last_active":"2023-11-18T20:39:22.413842+0000","last_peered":"2023-11-18T20:39:22.413842+0000","last_clean":"2023-11-18T20:39:22.413842+0000","last_became_active":"2023-11-18T20:39:22.410660+0000","last_became_peered":"2023-11-18T20:39:22.410660+0000","last_unstale":"2023-11-18T20:39:22.413842+0000","last_undegraded":"2023-11-18T20:39:22.413842+0000","last_fullsized":"2023-11-18T20:39:22.413842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:32:14.715267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.386260+0000","last_change":"2023-11-18T20:39:22.386260+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.386260+0000","last_undegraded":"2023-11-18T20:39:22.386260+0000","last_fullsized":"2023-11-18T20:39:22.386260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.383263+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:21.383263+0000","last_peered":"2023-11-18T20:39:21.383263+0000","last_clean":"2023-11-18T20:39:21.383263+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:21.383263+0000","last_undegraded":"2023-11-18T20:39:21.383263+0000","last_fullsized":"2023-11-18T20:39:21.383263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:32.771880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.369140+0000","last_change":"2023-11-18T20:39:02.760873+0000","last_active":"2023-11-18T20:39:21.369140+0000","last_peered":"2023-11-18T20:39:21.369140+0000","last_clean":"2023-11-18T20:39:21.369140+0000","last_became_active":"2023-11-18T20:39:02.759887+0000","last_became_peered":"2023-11-18T20:39:02.759887+0000","last_unstale":"2023-11-18T20:39:21.369140+0000","last_undegraded":"2023-11-18T20:39:21.369140+0000","last_fullsized":"2023-11-18T20:39:21.369140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:26.185944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.413782+0000","last_change":"2023-11-18T20:39:22.411188+0000","last_active":"2023-11-18T20:39:22.413782+0000","last_peered":"2023-11-18T20:39:22.413782+0000","last_clean":"2023-11-18T20:39:22.413782+0000","last_became_active":"2023-11-18T20:39:22.410686+0000","last_became_peered":"2023-11-18T20:39:22.410686+0000","last_unstale":"2023-11-18T20:39:22.413782+0000","last_undegraded":"2023-11-18T20:39:22.413782+0000","last_fullsized":"2023-11-18T20:39:22.413782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:15.706826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382028+0000","last_change":"2023-11-18T20:39:22.382028+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382028+0000","last_undegraded":"2023-11-18T20:39:22.382028+0000","last_fullsized":"2023-11-18T20:39:22.382028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385711+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:21.385711+0000","last_peered":"2023-11-18T20:39:21.385711+0000","last_clean":"2023-11-18T20:39:21.385711+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:21.385711+0000","last_undegraded":"2023-11-18T20:39:21.385711+0000","last_fullsized":"2023-11-18T20:39:21.385711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:39.869697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386333+0000","last_change":"2023-11-18T20:39:02.762642+0000","last_active":"2023-11-18T20:39:21.386333+0000","last_peered":"2023-11-18T20:39:21.386333+0000","last_clean":"2023-11-18T20:39:21.386333+0000","last_became_active":"2023-11-18T20:39:02.761245+0000","last_became_peered":"2023-11-18T20:39:02.761245+0000","last_unstale":"2023-11-18T20:39:21.386333+0000","last_undegraded":"2023-11-18T20:39:21.386333+0000","last_fullsized":"2023-11-18T20:39:21.386333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:59.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410065+0000","last_change":"2023-11-18T20:39:22.403397+0000","last_active":"2023-11-18T20:39:22.410065+0000","last_peered":"2023-11-18T20:39:22.410065+0000","last_clean":"2023-11-18T20:39:22.410065+0000","last_became_active":"2023-11-18T20:39:22.403108+0000","last_became_peered":"2023-11-18T20:39:22.403108+0000","last_unstale":"2023-11-18T20:39:22.410065+0000","last_undegraded":"2023-11-18T20:39:22.410065+0000","last_fullsized":"2023-11-18T20:39:22.410065+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:46.482331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.386304+0000","last_change":"2023-11-18T20:39:22.386304+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.386304+0000","last_undegraded":"2023-11-18T20:39:22.386304+0000","last_fullsized":"2023-11-18T20:39:22.386304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368272+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:21.368272+0000","last_peered":"2023-11-18T20:39:21.368272+0000","last_clean":"2023-11-18T20:39:21.368272+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:21.368272+0000","last_undegraded":"2023-11-18T20:39:21.368272+0000","last_fullsized":"2023-11-18T20:39:21.368272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:48:04.385451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377671+0000","last_change":"2023-11-18T20:39:02.769526+0000","last_active":"2023-11-18T20:39:21.377671+0000","last_peered":"2023-11-18T20:39:21.377671+0000","last_clean":"2023-11-18T20:39:21.377671+0000","last_became_active":"2023-11-18T20:39:02.767946+0000","last_became_peered":"2023-11-18T20:39:02.767946+0000","last_unstale":"2023-11-18T20:39:21.377671+0000","last_undegraded":"2023-11-18T20:39:21.377671+0000","last_fullsized":"2023-11-18T20:39:21.377671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.398846+0000","last_change":"2023-11-18T20:39:22.397295+0000","last_active":"2023-11-18T20:39:22.398846+0000","last_peered":"2023-11-18T20:39:22.398846+0000","last_clean":"2023-11-18T20:39:22.398846+0000","last_became_active":"2023-11-18T20:39:22.396777+0000","last_became_peered":"2023-11-18T20:39:22.396777+0000","last_unstale":"2023-11-18T20:39:22.398846+0000","last_undegraded":"2023-11-18T20:39:22.398846+0000","last_fullsized":"2023-11-18T20:39:22.398846+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:35.388829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382889+0000","last_change":"2023-11-18T20:39:22.382889+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382889+0000","last_undegraded":"2023-11-18T20:39:22.382889+0000","last_fullsized":"2023-11-18T20:39:22.382889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377785+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:21.377785+0000","last_peered":"2023-11-18T20:39:21.377785+0000","last_clean":"2023-11-18T20:39:21.377785+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:21.377785+0000","last_undegraded":"2023-11-18T20:39:21.377785+0000","last_fullsized":"2023-11-18T20:39:21.377785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377249+0000","last_change":"2023-11-18T20:39:02.750840+0000","last_active":"2023-11-18T20:39:21.377249+0000","last_peered":"2023-11-18T20:39:21.377249+0000","last_clean":"2023-11-18T20:39:21.377249+0000","last_became_active":"2023-11-18T20:39:02.749491+0000","last_became_peered":"2023-11-18T20:39:02.749491+0000","last_unstale":"2023-11-18T20:39:21.377249+0000","last_undegraded":"2023-11-18T20:39:21.377249+0000","last_fullsized":"2023-11-18T20:39:21.377249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:27:46.865954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.401986+0000","last_change":"2023-11-18T20:39:22.396910+0000","last_active":"2023-11-18T20:39:22.401986+0000","last_peered":"2023-11-18T20:39:22.401986+0000","last_clean":"2023-11-18T20:39:22.401986+0000","last_became_active":"2023-11-18T20:39:22.396615+0000","last_became_peered":"2023-11-18T20:39:22.396615+0000","last_unstale":"2023-11-18T20:39:22.401986+0000","last_undegraded":"2023-11-18T20:39:22.401986+0000","last_fullsized":"2023-11-18T20:39:22.401986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:18:36.439871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388314+0000","last_change":"2023-11-18T20:39:22.388314+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388314+0000","last_undegraded":"2023-11-18T20:39:22.388314+0000","last_fullsized":"2023-11-18T20:39:22.388314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371891+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:21.371891+0000","last_peered":"2023-11-18T20:39:21.371891+0000","last_clean":"2023-11-18T20:39:21.371891+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:21.371891+0000","last_undegraded":"2023-11-18T20:39:21.371891+0000","last_fullsized":"2023-11-18T20:39:21.371891+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.384136+0000","last_change":"2023-11-18T20:39:02.757357+0000","last_active":"2023-11-18T20:39:21.384136+0000","last_peered":"2023-11-18T20:39:21.384136+0000","last_clean":"2023-11-18T20:39:21.384136+0000","last_became_active":"2023-11-18T20:39:02.757000+0000","last_became_peered":"2023-11-18T20:39:02.757000+0000","last_unstale":"2023-11-18T20:39:21.384136+0000","last_undegraded":"2023-11-18T20:39:21.384136+0000","last_fullsized":"2023-11-18T20:39:21.384136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410014+0000","last_change":"2023-11-18T20:39:22.404704+0000","last_active":"2023-11-18T20:39:22.410014+0000","last_peered":"2023-11-18T20:39:22.410014+0000","last_clean":"2023-11-18T20:39:22.410014+0000","last_became_active":"2023-11-18T20:39:22.403768+0000","last_became_peered":"2023-11-18T20:39:22.403768+0000","last_unstale":"2023-11-18T20:39:22.410014+0000","last_undegraded":"2023-11-18T20:39:22.410014+0000","last_fullsized":"2023-11-18T20:39:22.410014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:12.088341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.396224+0000","last_change":"2023-11-18T20:39:22.396224+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.396224+0000","last_undegraded":"2023-11-18T20:39:22.396224+0000","last_fullsized":"2023-11-18T20:39:22.396224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.382571+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:21.382571+0000","last_peered":"2023-11-18T20:39:21.382571+0000","last_clean":"2023-11-18T20:39:21.382571+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:21.382571+0000","last_undegraded":"2023-11-18T20:39:21.382571+0000","last_fullsized":"2023-11-18T20:39:21.382571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377669+0000","last_change":"2023-11-18T20:39:02.762298+0000","last_active":"2023-11-18T20:39:21.377669+0000","last_peered":"2023-11-18T20:39:21.377669+0000","last_clean":"2023-11-18T20:39:21.377669+0000","last_became_active":"2023-11-18T20:39:02.761752+0000","last_became_peered":"2023-11-18T20:39:02.761752+0000","last_unstale":"2023-11-18T20:39:21.377669+0000","last_undegraded":"2023-11-18T20:39:21.377669+0000","last_fullsized":"2023-11-18T20:39:21.377669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:16:15.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.402040+0000","last_change":"2023-11-18T20:39:22.398043+0000","last_active":"2023-11-18T20:39:22.402040+0000","last_peered":"2023-11-18T20:39:22.402040+0000","last_clean":"2023-11-18T20:39:22.402040+0000","last_became_active":"2023-11-18T20:39:22.397732+0000","last_became_peered":"2023-11-18T20:39:22.397732+0000","last_unstale":"2023-11-18T20:39:22.402040+0000","last_undegraded":"2023-11-18T20:39:22.402040+0000","last_fullsized":"2023-11-18T20:39:22.402040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:19.760244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.393838+0000","last_change":"2023-11-18T20:39:22.393838+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.393838+0000","last_undegraded":"2023-11-18T20:39:22.393838+0000","last_fullsized":"2023-11-18T20:39:22.393838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374053+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:21.374053+0000","last_peered":"2023-11-18T20:39:21.374053+0000","last_clean":"2023-11-18T20:39:21.374053+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:21.374053+0000","last_undegraded":"2023-11-18T20:39:21.374053+0000","last_fullsized":"2023-11-18T20:39:21.374053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:27.505414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386228+0000","last_change":"2023-11-18T20:39:02.760383+0000","last_active":"2023-11-18T20:39:21.386228+0000","last_peered":"2023-11-18T20:39:21.386228+0000","last_clean":"2023-11-18T20:39:21.386228+0000","last_became_active":"2023-11-18T20:39:02.760126+0000","last_became_peered":"2023-11-18T20:39:02.760126+0000","last_unstale":"2023-11-18T20:39:21.386228+0000","last_undegraded":"2023-11-18T20:39:21.386228+0000","last_fullsized":"2023-11-18T20:39:21.386228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410423+0000","last_change":"2023-11-18T20:39:22.404538+0000","last_active":"2023-11-18T20:39:22.410423+0000","last_peered":"2023-11-18T20:39:22.410423+0000","last_clean":"2023-11-18T20:39:22.410423+0000","last_became_active":"2023-11-18T20:39:22.404275+0000","last_became_peered":"2023-11-18T20:39:22.404275+0000","last_unstale":"2023-11-18T20:39:22.410423+0000","last_undegraded":"2023-11-18T20:39:22.410423+0000","last_fullsized":"2023-11-18T20:39:22.410423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:18.351945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.390628+0000","last_change":"2023-11-18T20:39:22.390628+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.390628+0000","last_undegraded":"2023-11-18T20:39:22.390628+0000","last_fullsized":"2023-11-18T20:39:22.390628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368934+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:21.368934+0000","last_peered":"2023-11-18T20:39:21.368934+0000","last_clean":"2023-11-18T20:39:21.368934+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:21.368934+0000","last_undegraded":"2023-11-18T20:39:21.368934+0000","last_fullsized":"2023-11-18T20:39:21.368934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:41.560904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.383445+0000","last_change":"2023-11-18T20:39:02.763496+0000","last_active":"2023-11-18T20:39:21.383445+0000","last_peered":"2023-11-18T20:39:21.383445+0000","last_clean":"2023-11-18T20:39:21.383445+0000","last_became_active":"2023-11-18T20:39:02.762875+0000","last_became_peered":"2023-11-18T20:39:02.762875+0000","last_unstale":"2023-11-18T20:39:21.383445+0000","last_undegraded":"2023-11-18T20:39:21.383445+0000","last_fullsized":"2023-11-18T20:39:21.383445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.408862+0000","last_change":"2023-11-18T20:39:22.405242+0000","last_active":"2023-11-18T20:39:22.408862+0000","last_peered":"2023-11-18T20:39:22.408862+0000","last_clean":"2023-11-18T20:39:22.408862+0000","last_became_active":"2023-11-18T20:39:22.404935+0000","last_became_peered":"2023-11-18T20:39:22.404935+0000","last_unstale":"2023-11-18T20:39:22.408862+0000","last_undegraded":"2023-11-18T20:39:22.408862+0000","last_fullsized":"2023-11-18T20:39:22.408862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:24.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381151+0000","last_change":"2023-11-18T20:39:22.381151+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381151+0000","last_undegraded":"2023-11-18T20:39:22.381151+0000","last_fullsized":"2023-11-18T20:39:22.381151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373410+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:21.373410+0000","last_peered":"2023-11-18T20:39:21.373410+0000","last_clean":"2023-11-18T20:39:21.373410+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:21.373410+0000","last_undegraded":"2023-11-18T20:39:21.373410+0000","last_fullsized":"2023-11-18T20:39:21.373410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378380+0000","last_change":"2023-11-18T20:39:02.765789+0000","last_active":"2023-11-18T20:39:21.378380+0000","last_peered":"2023-11-18T20:39:21.378380+0000","last_clean":"2023-11-18T20:39:21.378380+0000","last_became_active":"2023-11-18T20:39:02.764984+0000","last_became_peered":"2023-11-18T20:39:02.764984+0000","last_unstale":"2023-11-18T20:39:21.378380+0000","last_undegraded":"2023-11-18T20:39:21.378380+0000","last_fullsized":"2023-11-18T20:39:21.378380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.408505+0000","last_change":"2023-11-18T20:39:22.403628+0000","last_active":"2023-11-18T20:39:22.408505+0000","last_peered":"2023-11-18T20:39:22.408505+0000","last_clean":"2023-11-18T20:39:22.408505+0000","last_became_active":"2023-11-18T20:39:22.401145+0000","last_became_peered":"2023-11-18T20:39:22.401145+0000","last_unstale":"2023-11-18T20:39:22.408505+0000","last_undegraded":"2023-11-18T20:39:22.408505+0000","last_fullsized":"2023-11-18T20:39:22.408505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:44.742398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.374726+0000","last_change":"2023-11-18T20:39:22.374726+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.374726+0000","last_undegraded":"2023-11-18T20:39:22.374726+0000","last_fullsized":"2023-11-18T20:39:22.374726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386657+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:21.386657+0000","last_peered":"2023-11-18T20:39:21.386657+0000","last_clean":"2023-11-18T20:39:21.386657+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:21.386657+0000","last_undegraded":"2023-11-18T20:39:21.386657+0000","last_fullsized":"2023-11-18T20:39:21.386657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368817+0000","last_change":"2023-11-18T20:39:02.773440+0000","last_active":"2023-11-18T20:39:21.368817+0000","last_peered":"2023-11-18T20:39:21.368817+0000","last_clean":"2023-11-18T20:39:21.368817+0000","last_became_active":"2023-11-18T20:39:02.773133+0000","last_became_peered":"2023-11-18T20:39:02.773133+0000","last_unstale":"2023-11-18T20:39:21.368817+0000","last_undegraded":"2023-11-18T20:39:21.368817+0000","last_fullsized":"2023-11-18T20:39:21.368817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:02.899681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.402942+0000","last_change":"2023-11-18T20:39:22.398608+0000","last_active":"2023-11-18T20:39:22.402942+0000","last_peered":"2023-11-18T20:39:22.402942+0000","last_clean":"2023-11-18T20:39:22.402942+0000","last_became_active":"2023-11-18T20:39:22.398282+0000","last_became_peered":"2023-11-18T20:39:22.398282+0000","last_unstale":"2023-11-18T20:39:22.402942+0000","last_undegraded":"2023-11-18T20:39:22.402942+0000","last_fullsized":"2023-11-18T20:39:22.402942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:45.625256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.389061+0000","last_change":"2023-11-18T20:39:22.389061+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.389061+0000","last_undegraded":"2023-11-18T20:39:22.389061+0000","last_fullsized":"2023-11-18T20:39:22.389061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385451+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:21.385451+0000","last_peered":"2023-11-18T20:39:21.385451+0000","last_clean":"2023-11-18T20:39:21.385451+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:21.385451+0000","last_undegraded":"2023-11-18T20:39:21.385451+0000","last_fullsized":"2023-11-18T20:39:21.385451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368329+0000","last_change":"2023-11-18T20:39:02.777823+0000","last_active":"2023-11-18T20:39:21.368329+0000","last_peered":"2023-11-18T20:39:21.368329+0000","last_clean":"2023-11-18T20:39:21.368329+0000","last_became_active":"2023-11-18T20:39:02.777456+0000","last_became_peered":"2023-11-18T20:39:02.777456+0000","last_unstale":"2023-11-18T20:39:21.368329+0000","last_undegraded":"2023-11-18T20:39:21.368329+0000","last_fullsized":"2023-11-18T20:39:21.368329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:44.618827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.409982+0000","last_change":"2023-11-18T20:39:22.402262+0000","last_active":"2023-11-18T20:39:22.409982+0000","last_peered":"2023-11-18T20:39:22.409982+0000","last_clean":"2023-11-18T20:39:22.409982+0000","last_became_active":"2023-11-18T20:39:22.401944+0000","last_became_peered":"2023-11-18T20:39:22.401944+0000","last_unstale":"2023-11-18T20:39:22.409982+0000","last_undegraded":"2023-11-18T20:39:22.409982+0000","last_fullsized":"2023-11-18T20:39:22.409982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:50.653213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.379405+0000","last_change":"2023-11-18T20:39:22.379405+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.379405+0000","last_undegraded":"2023-11-18T20:39:22.379405+0000","last_fullsized":"2023-11-18T20:39:22.379405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374000+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:21.374000+0000","last_peered":"2023-11-18T20:39:21.374000+0000","last_clean":"2023-11-18T20:39:21.374000+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:21.374000+0000","last_undegraded":"2023-11-18T20:39:21.374000+0000","last_fullsized":"2023-11-18T20:39:21.374000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:52:57.711383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371714+0000","last_change":"2023-11-18T20:39:02.767695+0000","last_active":"2023-11-18T20:39:21.371714+0000","last_peered":"2023-11-18T20:39:21.371714+0000","last_clean":"2023-11-18T20:39:21.371714+0000","last_became_active":"2023-11-18T20:39:02.765964+0000","last_became_peered":"2023-11-18T20:39:02.765964+0000","last_unstale":"2023-11-18T20:39:21.371714+0000","last_undegraded":"2023-11-18T20:39:21.371714+0000","last_fullsized":"2023-11-18T20:39:21.371714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410534+0000","last_change":"2023-11-18T20:39:22.406580+0000","last_active":"2023-11-18T20:39:22.410534+0000","last_peered":"2023-11-18T20:39:22.410534+0000","last_clean":"2023-11-18T20:39:22.410534+0000","last_became_active":"2023-11-18T20:39:22.405573+0000","last_became_peered":"2023-11-18T20:39:22.405573+0000","last_unstale":"2023-11-18T20:39:22.410534+0000","last_undegraded":"2023-11-18T20:39:22.410534+0000","last_fullsized":"2023-11-18T20:39:22.410534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:39.749910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.376577+0000","last_change":"2023-11-18T20:39:22.376577+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.376577+0000","last_undegraded":"2023-11-18T20:39:22.376577+0000","last_fullsized":"2023-11-18T20:39:22.376577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374887+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:21.374887+0000","last_peered":"2023-11-18T20:39:21.374887+0000","last_clean":"2023-11-18T20:39:21.374887+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:21.374887+0000","last_undegraded":"2023-11-18T20:39:21.374887+0000","last_fullsized":"2023-11-18T20:39:21.374887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378253+0000","last_change":"2023-11-18T20:39:02.748892+0000","last_active":"2023-11-18T20:39:21.378253+0000","last_peered":"2023-11-18T20:39:21.378253+0000","last_clean":"2023-11-18T20:39:21.378253+0000","last_became_active":"2023-11-18T20:39:02.748392+0000","last_became_peered":"2023-11-18T20:39:02.748392+0000","last_unstale":"2023-11-18T20:39:21.378253+0000","last_undegraded":"2023-11-18T20:39:21.378253+0000","last_fullsized":"2023-11-18T20:39:21.378253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:18.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.395025+0000","last_change":"2023-11-18T20:39:22.383835+0000","last_active":"2023-11-18T20:39:22.395025+0000","last_peered":"2023-11-18T20:39:22.395025+0000","last_clean":"2023-11-18T20:39:22.395025+0000","last_became_active":"2023-11-18T20:39:22.383055+0000","last_became_peered":"2023-11-18T20:39:22.383055+0000","last_unstale":"2023-11-18T20:39:22.395025+0000","last_undegraded":"2023-11-18T20:39:22.395025+0000","last_fullsized":"2023-11-18T20:39:22.395025+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:39.434602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387587+0000","last_change":"2023-11-18T20:39:22.387587+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387587+0000","last_undegraded":"2023-11-18T20:39:22.387587+0000","last_fullsized":"2023-11-18T20:39:22.387587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372159+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:21.372159+0000","last_peered":"2023-11-18T20:39:21.372159+0000","last_clean":"2023-11-18T20:39:21.372159+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:21.372159+0000","last_undegraded":"2023-11-18T20:39:21.372159+0000","last_fullsized":"2023-11-18T20:39:21.372159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377510+0000","last_change":"2023-11-18T20:39:02.755872+0000","last_active":"2023-11-18T20:39:21.377510+0000","last_peered":"2023-11-18T20:39:21.377510+0000","last_clean":"2023-11-18T20:39:21.377510+0000","last_became_active":"2023-11-18T20:39:02.755415+0000","last_became_peered":"2023-11-18T20:39:02.755415+0000","last_unstale":"2023-11-18T20:39:21.377510+0000","last_undegraded":"2023-11-18T20:39:21.377510+0000","last_fullsized":"2023-11-18T20:39:21.377510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:08.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.408515+0000","last_change":"2023-11-18T20:39:22.403667+0000","last_active":"2023-11-18T20:39:22.408515+0000","last_peered":"2023-11-18T20:39:22.408515+0000","last_clean":"2023-11-18T20:39:22.408515+0000","last_became_active":"2023-11-18T20:39:22.402205+0000","last_became_peered":"2023-11-18T20:39:22.402205+0000","last_unstale":"2023-11-18T20:39:22.408515+0000","last_undegraded":"2023-11-18T20:39:22.408515+0000","last_fullsized":"2023-11-18T20:39:22.408515+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:46.412346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381500+0000","last_change":"2023-11-18T20:39:22.381500+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381500+0000","last_undegraded":"2023-11-18T20:39:22.381500+0000","last_fullsized":"2023-11-18T20:39:22.381500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380866+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:21.380866+0000","last_peered":"2023-11-18T20:39:21.380866+0000","last_clean":"2023-11-18T20:39:21.380866+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:21.380866+0000","last_undegraded":"2023-11-18T20:39:21.380866+0000","last_fullsized":"2023-11-18T20:39:21.380866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:26.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368755+0000","last_change":"2023-11-18T20:39:02.774185+0000","last_active":"2023-11-18T20:39:21.368755+0000","last_peered":"2023-11-18T20:39:21.368755+0000","last_clean":"2023-11-18T20:39:21.368755+0000","last_became_active":"2023-11-18T20:39:02.773865+0000","last_became_peered":"2023-11-18T20:39:02.773865+0000","last_unstale":"2023-11-18T20:39:21.368755+0000","last_undegraded":"2023-11-18T20:39:21.368755+0000","last_fullsized":"2023-11-18T20:39:21.368755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:29.774288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.403839+0000","last_change":"2023-11-18T20:39:22.399738+0000","last_active":"2023-11-18T20:39:22.403839+0000","last_peered":"2023-11-18T20:39:22.403839+0000","last_clean":"2023-11-18T20:39:22.403839+0000","last_became_active":"2023-11-18T20:39:22.399456+0000","last_became_peered":"2023-11-18T20:39:22.399456+0000","last_unstale":"2023-11-18T20:39:22.403839+0000","last_undegraded":"2023-11-18T20:39:22.403839+0000","last_fullsized":"2023-11-18T20:39:22.403839+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:00.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381190+0000","last_change":"2023-11-18T20:39:22.381190+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381190+0000","last_undegraded":"2023-11-18T20:39:22.381190+0000","last_fullsized":"2023-11-18T20:39:22.381190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368764+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:21.368764+0000","last_peered":"2023-11-18T20:39:21.368764+0000","last_clean":"2023-11-18T20:39:21.368764+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:21.368764+0000","last_undegraded":"2023-11-18T20:39:21.368764+0000","last_fullsized":"2023-11-18T20:39:21.368764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:25.771785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.379101+0000","last_change":"2023-11-18T20:39:02.753904+0000","last_active":"2023-11-18T20:39:21.379101+0000","last_peered":"2023-11-18T20:39:21.379101+0000","last_clean":"2023-11-18T20:39:21.379101+0000","last_became_active":"2023-11-18T20:39:02.753415+0000","last_became_peered":"2023-11-18T20:39:02.753415+0000","last_unstale":"2023-11-18T20:39:21.379101+0000","last_undegraded":"2023-11-18T20:39:21.379101+0000","last_fullsized":"2023-11-18T20:39:21.379101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.402930+0000","last_change":"2023-11-18T20:39:22.398779+0000","last_active":"2023-11-18T20:39:22.402930+0000","last_peered":"2023-11-18T20:39:22.402930+0000","last_clean":"2023-11-18T20:39:22.402930+0000","last_became_active":"2023-11-18T20:39:22.398477+0000","last_became_peered":"2023-11-18T20:39:22.398477+0000","last_unstale":"2023-11-18T20:39:22.402930+0000","last_undegraded":"2023-11-18T20:39:22.402930+0000","last_fullsized":"2023-11-18T20:39:22.402930+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:52:08.082949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.386822+0000","last_change":"2023-11-18T20:39:22.386822+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.386822+0000","last_undegraded":"2023-11-18T20:39:22.386822+0000","last_fullsized":"2023-11-18T20:39:22.386822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.383126+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:21.383126+0000","last_peered":"2023-11-18T20:39:21.383126+0000","last_clean":"2023-11-18T20:39:21.383126+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:21.383126+0000","last_undegraded":"2023-11-18T20:39:21.383126+0000","last_fullsized":"2023-11-18T20:39:21.383126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380340+0000","last_change":"2023-11-18T20:39:02.763642+0000","last_active":"2023-11-18T20:39:21.380340+0000","last_peered":"2023-11-18T20:39:21.380340+0000","last_clean":"2023-11-18T20:39:21.380340+0000","last_became_active":"2023-11-18T20:39:02.763357+0000","last_became_peered":"2023-11-18T20:39:02.763357+0000","last_unstale":"2023-11-18T20:39:21.380340+0000","last_undegraded":"2023-11-18T20:39:21.380340+0000","last_fullsized":"2023-11-18T20:39:21.380340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:04.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.403456+0000","last_change":"2023-11-18T20:39:22.398742+0000","last_active":"2023-11-18T20:39:22.403456+0000","last_peered":"2023-11-18T20:39:22.403456+0000","last_clean":"2023-11-18T20:39:22.403456+0000","last_became_active":"2023-11-18T20:39:22.397880+0000","last_became_peered":"2023-11-18T20:39:22.397880+0000","last_unstale":"2023-11-18T20:39:22.403456+0000","last_undegraded":"2023-11-18T20:39:22.403456+0000","last_fullsized":"2023-11-18T20:39:22.403456+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:06.496537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387701+0000","last_change":"2023-11-18T20:39:22.387701+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387701+0000","last_undegraded":"2023-11-18T20:39:22.387701+0000","last_fullsized":"2023-11-18T20:39:22.387701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.384174+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:21.384174+0000","last_peered":"2023-11-18T20:39:21.384174+0000","last_clean":"2023-11-18T20:39:21.384174+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:21.384174+0000","last_undegraded":"2023-11-18T20:39:21.384174+0000","last_fullsized":"2023-11-18T20:39:21.384174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.109348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368762+0000","last_change":"2023-11-18T20:39:02.759699+0000","last_active":"2023-11-18T20:39:21.368762+0000","last_peered":"2023-11-18T20:39:21.368762+0000","last_clean":"2023-11-18T20:39:21.368762+0000","last_became_active":"2023-11-18T20:39:02.759410+0000","last_became_peered":"2023-11-18T20:39:02.759410+0000","last_unstale":"2023-11-18T20:39:21.368762+0000","last_undegraded":"2023-11-18T20:39:21.368762+0000","last_fullsized":"2023-11-18T20:39:21.368762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:52:49.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.395969+0000","last_change":"2023-11-18T20:39:22.393343+0000","last_active":"2023-11-18T20:39:22.395969+0000","last_peered":"2023-11-18T20:39:22.395969+0000","last_clean":"2023-11-18T20:39:22.395969+0000","last_became_active":"2023-11-18T20:39:22.392729+0000","last_became_peered":"2023-11-18T20:39:22.392729+0000","last_unstale":"2023-11-18T20:39:22.395969+0000","last_undegraded":"2023-11-18T20:39:22.395969+0000","last_fullsized":"2023-11-18T20:39:22.395969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:58:20.301898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.383458+0000","last_change":"2023-11-18T20:39:22.383458+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.383458+0000","last_undegraded":"2023-11-18T20:39:22.383458+0000","last_fullsized":"2023-11-18T20:39:22.383458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371833+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:21.371833+0000","last_peered":"2023-11-18T20:39:21.371833+0000","last_clean":"2023-11-18T20:39:21.371833+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:21.371833+0000","last_undegraded":"2023-11-18T20:39:21.371833+0000","last_fullsized":"2023-11-18T20:39:21.371833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373772+0000","last_change":"2023-11-18T20:39:02.770693+0000","last_active":"2023-11-18T20:39:21.373772+0000","last_peered":"2023-11-18T20:39:21.373772+0000","last_clean":"2023-11-18T20:39:21.373772+0000","last_became_active":"2023-11-18T20:39:02.766515+0000","last_became_peered":"2023-11-18T20:39:02.766515+0000","last_unstale":"2023-11-18T20:39:21.373772+0000","last_undegraded":"2023-11-18T20:39:21.373772+0000","last_fullsized":"2023-11-18T20:39:21.373772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.409962+0000","last_change":"2023-11-18T20:39:22.402398+0000","last_active":"2023-11-18T20:39:22.409962+0000","last_peered":"2023-11-18T20:39:22.409962+0000","last_clean":"2023-11-18T20:39:22.409962+0000","last_became_active":"2023-11-18T20:39:22.401355+0000","last_became_peered":"2023-11-18T20:39:22.401355+0000","last_unstale":"2023-11-18T20:39:22.409962+0000","last_undegraded":"2023-11-18T20:39:22.409962+0000","last_fullsized":"2023-11-18T20:39:22.409962+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:37.154011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387614+0000","last_change":"2023-11-18T20:39:22.387614+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387614+0000","last_undegraded":"2023-11-18T20:39:22.387614+0000","last_fullsized":"2023-11-18T20:39:22.387614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385622+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:21.385622+0000","last_peered":"2023-11-18T20:39:21.385622+0000","last_clean":"2023-11-18T20:39:21.385622+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:21.385622+0000","last_undegraded":"2023-11-18T20:39:21.385622+0000","last_fullsized":"2023-11-18T20:39:21.385622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377710+0000","last_change":"2023-11-18T20:39:02.772323+0000","last_active":"2023-11-18T20:39:21.377710+0000","last_peered":"2023-11-18T20:39:21.377710+0000","last_clean":"2023-11-18T20:39:21.377710+0000","last_became_active":"2023-11-18T20:39:02.771746+0000","last_became_peered":"2023-11-18T20:39:02.771746+0000","last_unstale":"2023-11-18T20:39:21.377710+0000","last_undegraded":"2023-11-18T20:39:21.377710+0000","last_fullsized":"2023-11-18T20:39:21.377710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:51.574371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.408005+0000","last_change":"2023-11-18T20:39:22.401734+0000","last_active":"2023-11-18T20:39:22.408005+0000","last_peered":"2023-11-18T20:39:22.408005+0000","last_clean":"2023-11-18T20:39:22.408005+0000","last_became_active":"2023-11-18T20:39:22.398776+0000","last_became_peered":"2023-11-18T20:39:22.398776+0000","last_unstale":"2023-11-18T20:39:22.408005+0000","last_undegraded":"2023-11-18T20:39:22.408005+0000","last_fullsized":"2023-11-18T20:39:22.408005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:16:14.495859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.384517+0000","last_change":"2023-11-18T20:39:22.384517+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.384517+0000","last_undegraded":"2023-11-18T20:39:22.384517+0000","last_fullsized":"2023-11-18T20:39:22.384517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371810+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:21.371810+0000","last_peered":"2023-11-18T20:39:21.371810+0000","last_clean":"2023-11-18T20:39:21.371810+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:21.371810+0000","last_undegraded":"2023-11-18T20:39:21.371810+0000","last_fullsized":"2023-11-18T20:39:21.371810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:47.442387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372008+0000","last_change":"2023-11-18T20:39:02.754613+0000","last_active":"2023-11-18T20:39:21.372008+0000","last_peered":"2023-11-18T20:39:21.372008+0000","last_clean":"2023-11-18T20:39:21.372008+0000","last_became_active":"2023-11-18T20:39:02.754350+0000","last_became_peered":"2023-11-18T20:39:02.754350+0000","last_unstale":"2023-11-18T20:39:21.372008+0000","last_undegraded":"2023-11-18T20:39:21.372008+0000","last_fullsized":"2023-11-18T20:39:21.372008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.411339+0000","last_change":"2023-11-18T20:39:22.406251+0000","last_active":"2023-11-18T20:39:22.411339+0000","last_peered":"2023-11-18T20:39:22.411339+0000","last_clean":"2023-11-18T20:39:22.411339+0000","last_became_active":"2023-11-18T20:39:22.405901+0000","last_became_peered":"2023-11-18T20:39:22.405901+0000","last_unstale":"2023-11-18T20:39:22.411339+0000","last_undegraded":"2023-11-18T20:39:22.411339+0000","last_fullsized":"2023-11-18T20:39:22.411339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:25:36.170594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381466+0000","last_change":"2023-11-18T20:39:22.381466+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381466+0000","last_undegraded":"2023-11-18T20:39:22.381466+0000","last_fullsized":"2023-11-18T20:39:22.381466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372104+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:21.372104+0000","last_peered":"2023-11-18T20:39:21.372104+0000","last_clean":"2023-11-18T20:39:21.372104+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:21.372104+0000","last_undegraded":"2023-11-18T20:39:21.372104+0000","last_fullsized":"2023-11-18T20:39:21.372104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378129+0000","last_change":"2023-11-18T20:39:02.774591+0000","last_active":"2023-11-18T20:39:21.378129+0000","last_peered":"2023-11-18T20:39:21.378129+0000","last_clean":"2023-11-18T20:39:21.378129+0000","last_became_active":"2023-11-18T20:39:02.774338+0000","last_became_peered":"2023-11-18T20:39:02.774338+0000","last_unstale":"2023-11-18T20:39:21.378129+0000","last_undegraded":"2023-11-18T20:39:21.378129+0000","last_fullsized":"2023-11-18T20:39:21.378129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:32.560325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.410111+0000","last_change":"2023-11-18T20:39:22.406308+0000","last_active":"2023-11-18T20:39:22.410111+0000","last_peered":"2023-11-18T20:39:22.410111+0000","last_clean":"2023-11-18T20:39:22.410111+0000","last_became_active":"2023-11-18T20:39:22.405980+0000","last_became_peered":"2023-11-18T20:39:22.405980+0000","last_unstale":"2023-11-18T20:39:22.410111+0000","last_undegraded":"2023-11-18T20:39:22.410111+0000","last_fullsized":"2023-11-18T20:39:22.410111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:32:14.715267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385222+0000","last_change":"2023-11-18T20:39:22.385222+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385222+0000","last_undegraded":"2023-11-18T20:39:22.385222+0000","last_fullsized":"2023-11-18T20:39:22.385222+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407509+0000","last_change":"2023-11-18T20:39:22.399160+0000","last_active":"2023-11-18T20:39:22.407509+0000","last_peered":"2023-11-18T20:39:22.407509+0000","last_clean":"2023-11-18T20:39:22.407509+0000","last_became_active":"2023-11-18T20:39:22.397086+0000","last_became_peered":"2023-11-18T20:39:22.397086+0000","last_unstale":"2023-11-18T20:39:22.407509+0000","last_undegraded":"2023-11-18T20:39:22.407509+0000","last_fullsized":"2023-11-18T20:39:22.407509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.397359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.379513+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:21.379513+0000","last_peered":"2023-11-18T20:39:21.379513+0000","last_clean":"2023-11-18T20:39:21.379513+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:21.379513+0000","last_undegraded":"2023-11-18T20:39:21.379513+0000","last_fullsized":"2023-11-18T20:39:21.379513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.379919+0000","last_change":"2023-11-18T20:39:02.758817+0000","last_active":"2023-11-18T20:39:21.379919+0000","last_peered":"2023-11-18T20:39:21.379919+0000","last_clean":"2023-11-18T20:39:21.379919+0000","last_became_active":"2023-11-18T20:39:02.758440+0000","last_became_peered":"2023-11-18T20:39:02.758440+0000","last_unstale":"2023-11-18T20:39:21.379919+0000","last_undegraded":"2023-11-18T20:39:21.379919+0000","last_fullsized":"2023-11-18T20:39:21.379919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.392347+0000","last_change":"2023-11-18T20:39:22.392347+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.392347+0000","last_undegraded":"2023-11-18T20:39:22.392347+0000","last_fullsized":"2023-11-18T20:39:22.392347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407782+0000","last_change":"2023-11-18T20:39:22.399945+0000","last_active":"2023-11-18T20:39:22.407782+0000","last_peered":"2023-11-18T20:39:22.407782+0000","last_clean":"2023-11-18T20:39:22.407782+0000","last_became_active":"2023-11-18T20:39:22.399644+0000","last_became_peered":"2023-11-18T20:39:22.399644+0000","last_unstale":"2023-11-18T20:39:22.407782+0000","last_undegraded":"2023-11-18T20:39:22.407782+0000","last_fullsized":"2023-11-18T20:39:22.407782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:45.574523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386416+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:21.386416+0000","last_peered":"2023-11-18T20:39:21.386416+0000","last_clean":"2023-11-18T20:39:21.386416+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:21.386416+0000","last_undegraded":"2023-11-18T20:39:21.386416+0000","last_fullsized":"2023-11-18T20:39:21.386416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373035+0000","last_change":"2023-11-18T20:39:02.751638+0000","last_active":"2023-11-18T20:39:21.373035+0000","last_peered":"2023-11-18T20:39:21.373035+0000","last_clean":"2023-11-18T20:39:21.373035+0000","last_became_active":"2023-11-18T20:39:02.751330+0000","last_became_peered":"2023-11-18T20:39:02.751330+0000","last_unstale":"2023-11-18T20:39:21.373035+0000","last_undegraded":"2023-11-18T20:39:21.373035+0000","last_fullsized":"2023-11-18T20:39:21.373035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.394984+0000","last_change":"2023-11-18T20:39:22.394984+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.394984+0000","last_undegraded":"2023-11-18T20:39:22.394984+0000","last_fullsized":"2023-11-18T20:39:22.394984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377917+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:21.377917+0000","last_peered":"2023-11-18T20:39:21.377917+0000","last_clean":"2023-11-18T20:39:21.377917+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:21.377917+0000","last_undegraded":"2023-11-18T20:39:21.377917+0000","last_fullsized":"2023-11-18T20:39:21.377917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373683+0000","last_change":"2023-11-18T20:39:02.761289+0000","last_active":"2023-11-18T20:39:21.373683+0000","last_peered":"2023-11-18T20:39:21.373683+0000","last_clean":"2023-11-18T20:39:21.373683+0000","last_became_active":"2023-11-18T20:39:02.760948+0000","last_became_peered":"2023-11-18T20:39:02.760948+0000","last_unstale":"2023-11-18T20:39:21.373683+0000","last_undegraded":"2023-11-18T20:39:21.373683+0000","last_fullsized":"2023-11-18T20:39:21.373683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407101+0000","last_change":"2023-11-18T20:39:22.400658+0000","last_active":"2023-11-18T20:39:22.407101+0000","last_peered":"2023-11-18T20:39:22.407101+0000","last_clean":"2023-11-18T20:39:22.407101+0000","last_became_active":"2023-11-18T20:39:22.399324+0000","last_became_peered":"2023-11-18T20:39:22.399324+0000","last_unstale":"2023-11-18T20:39:22.407101+0000","last_undegraded":"2023-11-18T20:39:22.407101+0000","last_fullsized":"2023-11-18T20:39:22.407101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:06.739080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.375204+0000","last_change":"2023-11-18T20:39:22.375204+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.375204+0000","last_undegraded":"2023-11-18T20:39:22.375204+0000","last_fullsized":"2023-11-18T20:39:22.375204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.369268+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:21.369268+0000","last_peered":"2023-11-18T20:39:21.369268+0000","last_clean":"2023-11-18T20:39:21.369268+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:21.369268+0000","last_undegraded":"2023-11-18T20:39:21.369268+0000","last_fullsized":"2023-11-18T20:39:21.369268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:00.564472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385455+0000","last_change":"2023-11-18T20:39:02.761380+0000","last_active":"2023-11-18T20:39:21.385455+0000","last_peered":"2023-11-18T20:39:21.385455+0000","last_clean":"2023-11-18T20:39:21.385455+0000","last_became_active":"2023-11-18T20:39:02.760958+0000","last_became_peered":"2023-11-18T20:39:02.760958+0000","last_unstale":"2023-11-18T20:39:21.385455+0000","last_undegraded":"2023-11-18T20:39:21.385455+0000","last_fullsized":"2023-11-18T20:39:21.385455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:25.114138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-18T20:39:22.407987+0000","last_change":"2023-11-18T20:39:22.400634+0000","last_active":"2023-11-18T20:39:22.407987+0000","last_peered":"2023-11-18T20:39:22.407987+0000","last_clean":"2023-11-18T20:39:22.407987+0000","last_became_active":"2023-11-18T20:39:22.399955+0000","last_became_peered":"2023-11-18T20:39:22.399955+0000","last_unstale":"2023-11-18T20:39:22.407987+0000","last_undegraded":"2023-11-18T20:39:22.407987+0000","last_fullsized":"2023-11-18T20:39:22.407987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:36:00.180292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.373909+0000","last_change":"2023-11-18T20:39:22.373909+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.373909+0000","last_undegraded":"2023-11-18T20:39:22.373909+0000","last_fullsized":"2023-11-18T20:39:22.373909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368223+0000","last_change":"2023-11-18T20:39:02.764472+0000","last_active":"2023-11-18T20:39:21.368223+0000","last_peered":"2023-11-18T20:39:21.368223+0000","last_clean":"2023-11-18T20:39:21.368223+0000","last_became_active":"2023-11-18T20:39:02.764087+0000","last_became_peered":"2023-11-18T20:39:02.764087+0000","last_unstale":"2023-11-18T20:39:21.368223+0000","last_undegraded":"2023-11-18T20:39:21.368223+0000","last_fullsized":"2023-11-18T20:39:21.368223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:00.994479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382078+0000","last_change":"2023-11-18T20:39:22.382078+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382078+0000","last_undegraded":"2023-11-18T20:39:22.382078+0000","last_fullsized":"2023-11-18T20:39:22.382078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371560+0000","last_change":"2023-11-18T20:39:02.767291+0000","last_active":"2023-11-18T20:39:21.371560+0000","last_peered":"2023-11-18T20:39:21.371560+0000","last_clean":"2023-11-18T20:39:21.371560+0000","last_became_active":"2023-11-18T20:39:02.764390+0000","last_became_peered":"2023-11-18T20:39:02.764390+0000","last_unstale":"2023-11-18T20:39:21.371560+0000","last_undegraded":"2023-11-18T20:39:21.371560+0000","last_fullsized":"2023-11-18T20:39:21.371560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.396739+0000","last_change":"2023-11-18T20:39:22.396739+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.396739+0000","last_undegraded":"2023-11-18T20:39:22.396739+0000","last_fullsized":"2023-11-18T20:39:22.396739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372866+0000","last_change":"2023-11-18T20:39:02.758480+0000","last_active":"2023-11-18T20:39:21.372866+0000","last_peered":"2023-11-18T20:39:21.372866+0000","last_clean":"2023-11-18T20:39:21.372866+0000","last_became_active":"2023-11-18T20:39:02.752070+0000","last_became_peered":"2023-11-18T20:39:02.752070+0000","last_unstale":"2023-11-18T20:39:21.372866+0000","last_undegraded":"2023-11-18T20:39:21.372866+0000","last_fullsized":"2023-11-18T20:39:21.372866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382153+0000","last_change":"2023-11-18T20:39:22.382153+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382153+0000","last_undegraded":"2023-11-18T20:39:22.382153+0000","last_fullsized":"2023-11-18T20:39:22.382153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374386+0000","last_change":"2023-11-18T20:39:02.772625+0000","last_active":"2023-11-18T20:39:21.374386+0000","last_peered":"2023-11-18T20:39:21.374386+0000","last_clean":"2023-11-18T20:39:21.374386+0000","last_became_active":"2023-11-18T20:39:02.772348+0000","last_became_peered":"2023-11-18T20:39:02.772348+0000","last_unstale":"2023-11-18T20:39:21.374386+0000","last_undegraded":"2023-11-18T20:39:21.374386+0000","last_fullsized":"2023-11-18T20:39:21.374386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.392693+0000","last_change":"2023-11-18T20:39:22.392693+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.392693+0000","last_undegraded":"2023-11-18T20:39:22.392693+0000","last_fullsized":"2023-11-18T20:39:22.392693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372946+0000","last_change":"2023-11-18T20:39:02.746609+0000","last_active":"2023-11-18T20:39:21.372946+0000","last_peered":"2023-11-18T20:39:21.372946+0000","last_clean":"2023-11-18T20:39:21.372946+0000","last_became_active":"2023-11-18T20:39:02.746324+0000","last_became_peered":"2023-11-18T20:39:02.746324+0000","last_unstale":"2023-11-18T20:39:21.372946+0000","last_undegraded":"2023-11-18T20:39:21.372946+0000","last_fullsized":"2023-11-18T20:39:21.372946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.384743+0000","last_change":"2023-11-18T20:39:22.384743+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.384743+0000","last_undegraded":"2023-11-18T20:39:22.384743+0000","last_fullsized":"2023-11-18T20:39:22.384743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.383741+0000","last_change":"2023-11-18T20:39:02.775796+0000","last_active":"2023-11-18T20:39:21.383741+0000","last_peered":"2023-11-18T20:39:21.383741+0000","last_clean":"2023-11-18T20:39:21.383741+0000","last_became_active":"2023-11-18T20:39:02.775503+0000","last_became_peered":"2023-11-18T20:39:02.775503+0000","last_unstale":"2023-11-18T20:39:21.383741+0000","last_undegraded":"2023-11-18T20:39:21.383741+0000","last_fullsized":"2023-11-18T20:39:21.383741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387217+0000","last_change":"2023-11-18T20:39:22.387217+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387217+0000","last_undegraded":"2023-11-18T20:39:22.387217+0000","last_fullsized":"2023-11-18T20:39:22.387217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377668+0000","last_change":"2023-11-18T20:39:02.774172+0000","last_active":"2023-11-18T20:39:21.377668+0000","last_peered":"2023-11-18T20:39:21.377668+0000","last_clean":"2023-11-18T20:39:21.377668+0000","last_became_active":"2023-11-18T20:39:02.773141+0000","last_became_peered":"2023-11-18T20:39:02.773141+0000","last_unstale":"2023-11-18T20:39:21.377668+0000","last_undegraded":"2023-11-18T20:39:21.377668+0000","last_fullsized":"2023-11-18T20:39:21.377668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:59:44.902815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387329+0000","last_change":"2023-11-18T20:39:22.387329+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387329+0000","last_undegraded":"2023-11-18T20:39:22.387329+0000","last_fullsized":"2023-11-18T20:39:22.387329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380176+0000","last_change":"2023-11-18T20:39:02.772030+0000","last_active":"2023-11-18T20:39:21.380176+0000","last_peered":"2023-11-18T20:39:21.380176+0000","last_clean":"2023-11-18T20:39:21.380176+0000","last_became_active":"2023-11-18T20:39:02.771761+0000","last_became_peered":"2023-11-18T20:39:02.771761+0000","last_unstale":"2023-11-18T20:39:21.380176+0000","last_undegraded":"2023-11-18T20:39:21.380176+0000","last_fullsized":"2023-11-18T20:39:21.380176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.394484+0000","last_change":"2023-11-18T20:39:22.394484+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.394484+0000","last_undegraded":"2023-11-18T20:39:22.394484+0000","last_fullsized":"2023-11-18T20:39:22.394484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371599+0000","last_change":"2023-11-18T20:39:02.752133+0000","last_active":"2023-11-18T20:39:21.371599+0000","last_peered":"2023-11-18T20:39:21.371599+0000","last_clean":"2023-11-18T20:39:21.371599+0000","last_became_active":"2023-11-18T20:39:02.751863+0000","last_became_peered":"2023-11-18T20:39:02.751863+0000","last_unstale":"2023-11-18T20:39:21.371599+0000","last_undegraded":"2023-11-18T20:39:21.371599+0000","last_fullsized":"2023-11-18T20:39:21.371599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:56.070643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.394716+0000","last_change":"2023-11-18T20:39:22.394716+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.394716+0000","last_undegraded":"2023-11-18T20:39:22.394716+0000","last_fullsized":"2023-11-18T20:39:22.394716+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.375268+0000","last_change":"2023-11-18T20:39:02.758024+0000","last_active":"2023-11-18T20:39:21.375268+0000","last_peered":"2023-11-18T20:39:21.375268+0000","last_clean":"2023-11-18T20:39:21.375268+0000","last_became_active":"2023-11-18T20:39:02.757737+0000","last_became_peered":"2023-11-18T20:39:02.757737+0000","last_unstale":"2023-11-18T20:39:21.375268+0000","last_undegraded":"2023-11-18T20:39:21.375268+0000","last_fullsized":"2023-11-18T20:39:21.375268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:42:50.023528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.373200+0000","last_change":"2023-11-18T20:39:22.373200+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.373200+0000","last_undegraded":"2023-11-18T20:39:22.373200+0000","last_fullsized":"2023-11-18T20:39:22.373200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371721+0000","last_change":"2023-11-18T20:39:02.752211+0000","last_active":"2023-11-18T20:39:21.371721+0000","last_peered":"2023-11-18T20:39:21.371721+0000","last_clean":"2023-11-18T20:39:21.371721+0000","last_became_active":"2023-11-18T20:39:02.751940+0000","last_became_peered":"2023-11-18T20:39:02.751940+0000","last_unstale":"2023-11-18T20:39:21.371721+0000","last_undegraded":"2023-11-18T20:39:21.371721+0000","last_fullsized":"2023-11-18T20:39:21.371721+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387652+0000","last_change":"2023-11-18T20:39:22.387652+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387652+0000","last_undegraded":"2023-11-18T20:39:22.387652+0000","last_fullsized":"2023-11-18T20:39:22.387652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374177+0000","last_change":"2023-11-18T20:39:02.758393+0000","last_active":"2023-11-18T20:39:21.374177+0000","last_peered":"2023-11-18T20:39:21.374177+0000","last_clean":"2023-11-18T20:39:21.374177+0000","last_became_active":"2023-11-18T20:39:02.752864+0000","last_became_peered":"2023-11-18T20:39:02.752864+0000","last_unstale":"2023-11-18T20:39:21.374177+0000","last_undegraded":"2023-11-18T20:39:21.374177+0000","last_fullsized":"2023-11-18T20:39:21.374177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381673+0000","last_change":"2023-11-18T20:39:22.381673+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381673+0000","last_undegraded":"2023-11-18T20:39:22.381673+0000","last_fullsized":"2023-11-18T20:39:22.381673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.380693+0000","last_change":"2023-11-18T20:39:02.769220+0000","last_active":"2023-11-18T20:39:21.380693+0000","last_peered":"2023-11-18T20:39:21.380693+0000","last_clean":"2023-11-18T20:39:21.380693+0000","last_became_active":"2023-11-18T20:39:02.762271+0000","last_became_peered":"2023-11-18T20:39:02.762271+0000","last_unstale":"2023-11-18T20:39:21.380693+0000","last_undegraded":"2023-11-18T20:39:21.380693+0000","last_fullsized":"2023-11-18T20:39:21.380693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:37.501746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.374555+0000","last_change":"2023-11-18T20:39:22.374555+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.374555+0000","last_undegraded":"2023-11-18T20:39:22.374555+0000","last_fullsized":"2023-11-18T20:39:22.374555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386146+0000","last_change":"2023-11-18T20:39:02.759862+0000","last_active":"2023-11-18T20:39:21.386146+0000","last_peered":"2023-11-18T20:39:21.386146+0000","last_clean":"2023-11-18T20:39:21.386146+0000","last_became_active":"2023-11-18T20:39:02.759565+0000","last_became_peered":"2023-11-18T20:39:02.759565+0000","last_unstale":"2023-11-18T20:39:21.386146+0000","last_undegraded":"2023-11-18T20:39:21.386146+0000","last_fullsized":"2023-11-18T20:39:21.386146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385282+0000","last_change":"2023-11-18T20:39:22.385282+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385282+0000","last_undegraded":"2023-11-18T20:39:22.385282+0000","last_fullsized":"2023-11-18T20:39:22.385282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.386280+0000","last_change":"2023-11-18T20:39:02.755514+0000","last_active":"2023-11-18T20:39:21.386280+0000","last_peered":"2023-11-18T20:39:21.386280+0000","last_clean":"2023-11-18T20:39:21.386280+0000","last_became_active":"2023-11-18T20:39:02.755083+0000","last_became_peered":"2023-11-18T20:39:02.755083+0000","last_unstale":"2023-11-18T20:39:21.386280+0000","last_undegraded":"2023-11-18T20:39:21.386280+0000","last_fullsized":"2023-11-18T20:39:21.386280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:57.948105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385739+0000","last_change":"2023-11-18T20:39:22.385739+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385739+0000","last_undegraded":"2023-11-18T20:39:22.385739+0000","last_fullsized":"2023-11-18T20:39:22.385739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.369021+0000","last_change":"2023-11-18T20:39:02.766551+0000","last_active":"2023-11-18T20:39:21.369021+0000","last_peered":"2023-11-18T20:39:21.369021+0000","last_clean":"2023-11-18T20:39:21.369021+0000","last_became_active":"2023-11-18T20:39:02.765528+0000","last_became_peered":"2023-11-18T20:39:02.765528+0000","last_unstale":"2023-11-18T20:39:21.369021+0000","last_undegraded":"2023-11-18T20:39:21.369021+0000","last_fullsized":"2023-11-18T20:39:21.369021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:30.943404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.387576+0000","last_change":"2023-11-18T20:39:22.387576+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.387576+0000","last_undegraded":"2023-11-18T20:39:22.387576+0000","last_fullsized":"2023-11-18T20:39:22.387576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.372574+0000","last_change":"2023-11-18T20:39:02.759711+0000","last_active":"2023-11-18T20:39:21.372574+0000","last_peered":"2023-11-18T20:39:21.372574+0000","last_clean":"2023-11-18T20:39:21.372574+0000","last_became_active":"2023-11-18T20:39:02.759422+0000","last_became_peered":"2023-11-18T20:39:02.759422+0000","last_unstale":"2023-11-18T20:39:21.372574+0000","last_undegraded":"2023-11-18T20:39:21.372574+0000","last_fullsized":"2023-11-18T20:39:21.372574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388741+0000","last_change":"2023-11-18T20:39:22.388741+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388741+0000","last_undegraded":"2023-11-18T20:39:22.388741+0000","last_fullsized":"2023-11-18T20:39:22.388741+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373110+0000","last_change":"2023-11-18T20:39:02.750962+0000","last_active":"2023-11-18T20:39:21.373110+0000","last_peered":"2023-11-18T20:39:21.373110+0000","last_clean":"2023-11-18T20:39:21.373110+0000","last_became_active":"2023-11-18T20:39:02.750695+0000","last_became_peered":"2023-11-18T20:39:02.750695+0000","last_unstale":"2023-11-18T20:39:21.373110+0000","last_undegraded":"2023-11-18T20:39:21.373110+0000","last_fullsized":"2023-11-18T20:39:21.373110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.378443+0000","last_change":"2023-11-18T20:39:22.378443+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.378443+0000","last_undegraded":"2023-11-18T20:39:22.378443+0000","last_fullsized":"2023-11-18T20:39:22.378443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.374569+0000","last_change":"2023-11-18T20:39:02.766121+0000","last_active":"2023-11-18T20:39:21.374569+0000","last_peered":"2023-11-18T20:39:21.374569+0000","last_clean":"2023-11-18T20:39:21.374569+0000","last_became_active":"2023-11-18T20:39:02.765807+0000","last_became_peered":"2023-11-18T20:39:02.765807+0000","last_unstale":"2023-11-18T20:39:21.374569+0000","last_undegraded":"2023-11-18T20:39:21.374569+0000","last_fullsized":"2023-11-18T20:39:21.374569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:15.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.392990+0000","last_change":"2023-11-18T20:39:22.392990+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.392990+0000","last_undegraded":"2023-11-18T20:39:22.392990+0000","last_fullsized":"2023-11-18T20:39:22.392990+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.379938+0000","last_change":"2023-11-18T20:39:02.748415+0000","last_active":"2023-11-18T20:39:21.379938+0000","last_peered":"2023-11-18T20:39:21.379938+0000","last_clean":"2023-11-18T20:39:21.379938+0000","last_became_active":"2023-11-18T20:39:02.748123+0000","last_became_peered":"2023-11-18T20:39:02.748123+0000","last_unstale":"2023-11-18T20:39:21.379938+0000","last_undegraded":"2023-11-18T20:39:21.379938+0000","last_fullsized":"2023-11-18T20:39:21.379938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:36:58.122129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.383843+0000","last_change":"2023-11-18T20:39:22.383843+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.383843+0000","last_undegraded":"2023-11-18T20:39:22.383843+0000","last_fullsized":"2023-11-18T20:39:22.383843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378161+0000","last_change":"2023-11-18T20:39:02.756659+0000","last_active":"2023-11-18T20:39:21.378161+0000","last_peered":"2023-11-18T20:39:21.378161+0000","last_clean":"2023-11-18T20:39:21.378161+0000","last_became_active":"2023-11-18T20:39:02.756336+0000","last_became_peered":"2023-11-18T20:39:02.756336+0000","last_unstale":"2023-11-18T20:39:21.378161+0000","last_undegraded":"2023-11-18T20:39:21.378161+0000","last_fullsized":"2023-11-18T20:39:21.378161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:14.460811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.386788+0000","last_change":"2023-11-18T20:39:22.386788+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.386788+0000","last_undegraded":"2023-11-18T20:39:22.386788+0000","last_fullsized":"2023-11-18T20:39:22.386788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.368908+0000","last_change":"2023-11-18T20:39:02.773954+0000","last_active":"2023-11-18T20:39:21.368908+0000","last_peered":"2023-11-18T20:39:21.368908+0000","last_clean":"2023-11-18T20:39:21.368908+0000","last_became_active":"2023-11-18T20:39:02.773686+0000","last_became_peered":"2023-11-18T20:39:02.773686+0000","last_unstale":"2023-11-18T20:39:21.368908+0000","last_undegraded":"2023-11-18T20:39:21.368908+0000","last_fullsized":"2023-11-18T20:39:21.368908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:54.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.373867+0000","last_change":"2023-11-18T20:39:22.373867+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.373867+0000","last_undegraded":"2023-11-18T20:39:22.373867+0000","last_fullsized":"2023-11-18T20:39:22.373867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.377419+0000","last_change":"2023-11-18T20:39:02.764804+0000","last_active":"2023-11-18T20:39:21.377419+0000","last_peered":"2023-11-18T20:39:21.377419+0000","last_clean":"2023-11-18T20:39:21.377419+0000","last_became_active":"2023-11-18T20:39:02.764574+0000","last_became_peered":"2023-11-18T20:39:02.764574+0000","last_unstale":"2023-11-18T20:39:21.377419+0000","last_undegraded":"2023-11-18T20:39:21.377419+0000","last_fullsized":"2023-11-18T20:39:21.377419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.395968+0000","last_change":"2023-11-18T20:39:22.395968+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.395968+0000","last_undegraded":"2023-11-18T20:39:22.395968+0000","last_fullsized":"2023-11-18T20:39:22.395968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378323+0000","last_change":"2023-11-18T20:39:02.775795+0000","last_active":"2023-11-18T20:39:21.378323+0000","last_peered":"2023-11-18T20:39:21.378323+0000","last_clean":"2023-11-18T20:39:21.378323+0000","last_became_active":"2023-11-18T20:39:02.775493+0000","last_became_peered":"2023-11-18T20:39:02.775493+0000","last_unstale":"2023-11-18T20:39:21.378323+0000","last_undegraded":"2023-11-18T20:39:21.378323+0000","last_fullsized":"2023-11-18T20:39:21.378323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385114+0000","last_change":"2023-11-18T20:39:22.385114+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385114+0000","last_undegraded":"2023-11-18T20:39:22.385114+0000","last_fullsized":"2023-11-18T20:39:22.385114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371471+0000","last_change":"2023-11-18T20:39:02.744529+0000","last_active":"2023-11-18T20:39:21.371471+0000","last_peered":"2023-11-18T20:39:21.371471+0000","last_clean":"2023-11-18T20:39:21.371471+0000","last_became_active":"2023-11-18T20:39:02.744056+0000","last_became_peered":"2023-11-18T20:39:02.744056+0000","last_unstale":"2023-11-18T20:39:21.371471+0000","last_undegraded":"2023-11-18T20:39:21.371471+0000","last_fullsized":"2023-11-18T20:39:21.371471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:28.509793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.382476+0000","last_change":"2023-11-18T20:39:22.382476+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.382476+0000","last_undegraded":"2023-11-18T20:39:22.382476+0000","last_fullsized":"2023-11-18T20:39:22.382476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.371550+0000","last_change":"2023-11-18T20:39:02.767101+0000","last_active":"2023-11-18T20:39:21.371550+0000","last_peered":"2023-11-18T20:39:21.371550+0000","last_clean":"2023-11-18T20:39:21.371550+0000","last_became_active":"2023-11-18T20:39:02.764500+0000","last_became_peered":"2023-11-18T20:39:02.764500+0000","last_unstale":"2023-11-18T20:39:21.371550+0000","last_undegraded":"2023-11-18T20:39:21.371550+0000","last_fullsized":"2023-11-18T20:39:21.371550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.397224+0000","last_change":"2023-11-18T20:39:22.397224+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.397224+0000","last_undegraded":"2023-11-18T20:39:22.397224+0000","last_fullsized":"2023-11-18T20:39:22.397224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.385948+0000","last_change":"2023-11-18T20:39:02.755127+0000","last_active":"2023-11-18T20:39:21.385948+0000","last_peered":"2023-11-18T20:39:21.385948+0000","last_clean":"2023-11-18T20:39:21.385948+0000","last_became_active":"2023-11-18T20:39:02.754791+0000","last_became_peered":"2023-11-18T20:39:02.754791+0000","last_unstale":"2023-11-18T20:39:21.385948+0000","last_undegraded":"2023-11-18T20:39:21.385948+0000","last_fullsized":"2023-11-18T20:39:21.385948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388143+0000","last_change":"2023-11-18T20:39:22.388143+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388143+0000","last_undegraded":"2023-11-18T20:39:22.388143+0000","last_fullsized":"2023-11-18T20:39:22.388143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.382238+0000","last_change":"2023-11-18T20:39:02.757930+0000","last_active":"2023-11-18T20:39:21.382238+0000","last_peered":"2023-11-18T20:39:21.382238+0000","last_clean":"2023-11-18T20:39:21.382238+0000","last_became_active":"2023-11-18T20:39:02.757463+0000","last_became_peered":"2023-11-18T20:39:02.757463+0000","last_unstale":"2023-11-18T20:39:21.382238+0000","last_undegraded":"2023-11-18T20:39:21.382238+0000","last_fullsized":"2023-11-18T20:39:21.382238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.377910+0000","last_change":"2023-11-18T20:39:22.377910+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.377910+0000","last_undegraded":"2023-11-18T20:39:22.377910+0000","last_fullsized":"2023-11-18T20:39:22.377910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378876+0000","last_change":"2023-11-18T20:39:02.752584+0000","last_active":"2023-11-18T20:39:21.378876+0000","last_peered":"2023-11-18T20:39:21.378876+0000","last_clean":"2023-11-18T20:39:21.378876+0000","last_became_active":"2023-11-18T20:39:02.752259+0000","last_became_peered":"2023-11-18T20:39:02.752259+0000","last_unstale":"2023-11-18T20:39:21.378876+0000","last_undegraded":"2023-11-18T20:39:21.378876+0000","last_fullsized":"2023-11-18T20:39:21.378876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.385645+0000","last_change":"2023-11-18T20:39:22.385645+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.385645+0000","last_undegraded":"2023-11-18T20:39:22.385645+0000","last_fullsized":"2023-11-18T20:39:22.385645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.378430+0000","last_change":"2023-11-18T20:39:02.756005+0000","last_active":"2023-11-18T20:39:21.378430+0000","last_peered":"2023-11-18T20:39:21.378430+0000","last_clean":"2023-11-18T20:39:21.378430+0000","last_became_active":"2023-11-18T20:39:02.754298+0000","last_became_peered":"2023-11-18T20:39:02.754298+0000","last_unstale":"2023-11-18T20:39:21.378430+0000","last_undegraded":"2023-11-18T20:39:21.378430+0000","last_fullsized":"2023-11-18T20:39:21.378430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.388278+0000","last_change":"2023-11-18T20:39:22.388278+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.388278+0000","last_undegraded":"2023-11-18T20:39:22.388278+0000","last_fullsized":"2023-11-18T20:39:22.388278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.382997+0000","last_change":"2023-11-18T20:39:02.774649+0000","last_active":"2023-11-18T20:39:21.382997+0000","last_peered":"2023-11-18T20:39:21.382997+0000","last_clean":"2023-11-18T20:39:21.382997+0000","last_became_active":"2023-11-18T20:39:02.774358+0000","last_became_peered":"2023-11-18T20:39:02.774358+0000","last_unstale":"2023-11-18T20:39:21.382997+0000","last_undegraded":"2023-11-18T20:39:21.382997+0000","last_fullsized":"2023-11-18T20:39:21.382997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-18T20:39:22.381602+0000","last_change":"2023-11-18T20:39:22.381602+0000","last_active":"2023-11-18T20:39:22.359370+0000","last_peered":"2023-11-18T20:39:22.359370+0000","last_clean":"2023-11-18T20:39:22.359370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T20:39:22.381602+0000","last_undegraded":"2023-11-18T20:39:22.381602+0000","last_fullsized":"2023-11-18T20:39:22.381602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-18T20:39:21.373613+0000","last_change":"2023-11-18T20:39:02.760762+0000","last_active":"2023-11-18T20:39:21.373613+0000","last_peered":"2023-11-18T20:39:21.373613+0000","last_clean":"2023-11-18T20:39:21.373613+0000","last_became_active":"2023-11-18T20:39:02.760426+0000","last_became_peered":"2023-11-18T20:39:02.760426+0000","last_unstale":"2023-11-18T20:39:21.373613+0000","last_undegraded":"2023-11-18T20:39:21.373613+0000","last_fullsized":"2023-11-18T20:39:21.373613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":168457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.083}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.6180000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.036},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.3400000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.4490000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.407}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":2.1040000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.1669999999999998},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.5580000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.99299999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0569999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1080000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.403}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.204}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.26}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":752255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.25},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.7110000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.1040000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.617},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.369}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.345},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.827}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.478},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.4299999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.778},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.6759999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.528},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.8740000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":164434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.82899999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.1180000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.3069999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.224}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.4750000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.28},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.532}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.597},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.5740000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":169211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.2170000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.595}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.675}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.345},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.7330000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.7809999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.8240000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":2.081}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":161339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.61299999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.94099999999999995}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.74299999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.97499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":751743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.016},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.071}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.1279999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2669999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.391},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.5740000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.4810000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.45},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.512}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.54}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":161395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":1.331},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":1.141},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.6459999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.5549999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.514}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.421}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.601},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.6180000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:28.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:28.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.659+0000 7f0986a51640 1 Processor -- start 2023-11-18T20:39:28.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.659+0000 7f0986a51640 1 -- start start 2023-11-18T20:39:28.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.660+0000 7f0986a51640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f098014fd30 0x7f0980152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.660+0000 7f0986a51640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09800a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.660+0000 7f0986a51640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09800a5260 0x7f09800c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f0986a51640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09800c64a0 con 0x7f098014fd30 2023-11-18T20:39:28.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f0986a51640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09800c5c00 con 0x7f09800a5260 2023-11-18T20:39:28.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f0986a51640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09800c5ee0 con 0x7f098006d0a0 2023-11-18T20:39:28.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f097ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f098014fd30 0x7f0980152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f097ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f098014fd30 0x7f0980152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48840/0 (socket says 172.21.15.132:48840) 2023-11-18T20:39:28.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f097ffff640 1 -- 172.21.15.132:0/1549572033 learned_addr learned my addr 172.21.15.132:0/1549572033 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:28.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f097f7fe640 1 --2- 172.21.15.132:0/1549572033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09800a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f0984fee640 1 --2- 172.21.15.132:0/1549572033 >> v2:172.21.15.161:3300/0 conn(0x7f09800a5260 0x7f09800c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f097ffff640 1 -- 172.21.15.132:0/1549572033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 msgr2=0x7f09800a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:28.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f097ffff640 1 --2- 172.21.15.132:0/1549572033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09800a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f097ffff640 1 -- 172.21.15.132:0/1549572033 >> v2:172.21.15.161:3300/0 conn(0x7f09800a5260 msgr2=0x7f09800c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:28.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.661+0000 7f097ffff640 1 --2- 172.21.15.132:0/1549572033 >> v2:172.21.15.161:3300/0 conn(0x7f09800a5260 0x7f09800c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.662+0000 7f097ffff640 1 -- 172.21.15.132:0/1549572033 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800c61c0 con 0x7f098014fd30 2023-11-18T20:39:28.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.662+0000 7f097f7fe640 1 --2- 172.21.15.132:0/1549572033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09800a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:28.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.662+0000 7f0984fee640 1 --2- 172.21.15.132:0/1549572033 >> v2:172.21.15.161:3300/0 conn(0x7f09800a5260 0x7f09800c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:28.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.663+0000 7f097ffff640 1 --2- 172.21.15.132:0/1549572033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f0980152f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f098006d990 tx=0x7f097002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645962f23f7a1f21 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:28.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f097effd640 1 -- 172.21.15.132:0/1549572033 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970031870 con 0x7f098014fd30 2023-11-18T20:39:28.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f097effd640 1 -- 172.21.15.132:0/1549572033 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09700319d0 con 0x7f098014fd30 2023-11-18T20:39:28.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f097effd640 1 -- 172.21.15.132:0/1549572033 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970031d60 con 0x7f098014fd30 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f0986a51640 1 -- 172.21.15.132:0/1549572033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 msgr2=0x7f0980152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f0986a51640 1 --2- 172.21.15.132:0/1549572033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f0980152f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f098006d990 tx=0x7f097002b910 comp rx=0 tx=0).stop 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f0986a51640 1 -- 172.21.15.132:0/1549572033 shutdown_connections 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f0986a51640 1 --2- 172.21.15.132:0/1549572033 >> v2:172.21.15.161:3300/0 conn(0x7f09800a5260 0x7f09800c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f0986a51640 1 --2- 172.21.15.132:0/1549572033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09800a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f0986a51640 1 --2- 172.21.15.132:0/1549572033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f0980152f20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f0986a51640 1 -- 172.21.15.132:0/1549572033 >> 172.21.15.132:0/1549572033 conn(0x7f098006a500 msgr2=0x7f098006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.664+0000 7f0986a51640 1 -- 172.21.15.132:0/1549572033 shutdown_connections 2023-11-18T20:39:28.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.665+0000 7f0986a51640 1 -- 172.21.15.132:0/1549572033 wait complete. 2023-11-18T20:39:28.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.666+0000 7f0986a51640 1 Processor -- start 2023-11-18T20:39:28.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.666+0000 7f0986a51640 1 -- start start 2023-11-18T20:39:28.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.667+0000 7f0986a51640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09801df350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.667+0000 7f0986a51640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09800a5260 0x7f098014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.667+0000 7f0986a51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f09801dbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.667+0000 7f0986a51640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800aaf20 con 0x7f098014fd30 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.667+0000 7f0986a51640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800bf8e0 con 0x7f09800a5260 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.667+0000 7f0986a51640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098014f8e0 con 0x7f098006d0a0 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f0984fee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f09801dbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f0984fee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f09801dbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48852/0 (socket says 172.21.15.132:48852) 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f0984fee640 1 -- 172.21.15.132:0/1998365407 learned_addr learned my addr 172.21.15.132:0/1998365407 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f097ffff640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09801df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f097f7fe640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09800a5260 0x7f098014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f0984fee640 1 -- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 msgr2=0x7f09801df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f0984fee640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09801df350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f0984fee640 1 -- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09800a5260 msgr2=0x7f098014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f0984fee640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09800a5260 0x7f098014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.668+0000 7f0984fee640 1 -- 172.21.15.132:0/1998365407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700094d0 con 0x7f098014fd30 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.669+0000 7f0984fee640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f09801dbce0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f097800cef0 tx=0x7f097800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.669+0000 7f097cff9640 1 -- 172.21.15.132:0/1998365407 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800d840 con 0x7f098014fd30 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.669+0000 7f097cff9640 1 -- 172.21.15.132:0/1998365407 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097800d9c0 con 0x7f098014fd30 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.669+0000 7f097cff9640 1 -- 172.21.15.132:0/1998365407 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800dd70 con 0x7f098014fd30 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.669+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09800aac40 con 0x7f098014fd30 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.669+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09800bf570 con 0x7f098014fd30 2023-11-18T20:39:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.670+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09800bf0f0 con 0x7f098014fd30 2023-11-18T20:39:28.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.671+0000 7f097cff9640 1 -- 172.21.15.132:0/1998365407 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f097801e3b0 con 0x7f098014fd30 2023-11-18T20:39:28.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.672+0000 7f097cff9640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f096c06ae40 0x7f096c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.673+0000 7f097cff9640 1 -- 172.21.15.132:0/1998365407 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f097808a420 con 0x7f098014fd30 2023-11-18T20:39:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.673+0000 7f097ffff640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f096c06ae40 0x7f096c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.674+0000 7f097ffff640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f096c06ae40 0x7f096c06d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0970036000 tx=0x7f097003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:28.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.677+0000 7f097cff9640 1 -- 172.21.15.132:0/1998365407 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09800bf0f0 con 0x7f098014fd30 2023-11-18T20:39:28.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.867+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09800c43e0 con 0x7f096c06ae40 2023-11-18T20:39:28.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.907+0000 7f097cff9640 1 -- 172.21.15.132:0/1998365407 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+524907 (secure 0 0 0) 0x7f0970044400 con 0x7f096c06ae40 2023-11-18T20:39:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:28.919 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:28.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f096c06ae40 msgr2=0x7f096c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f096c06ae40 0x7f096c06d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0970036000 tx=0x7f097003c040 comp rx=0 tx=0).stop 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 msgr2=0x7f09801dbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f09801dbce0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f097800cef0 tx=0x7f097800a710 comp rx=0 tx=0).stop 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 shutdown_connections 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f096c06ae40 0x7f096c06d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014fd30 0x7f09801dbce0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09800a5260 0x7f098014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 --2- 172.21.15.132:0/1998365407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f098006d0a0 0x7f09801df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 >> 172.21.15.132:0/1998365407 conn(0x7f098006a500 msgr2=0x7f09800c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.918+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 shutdown_connections 2023-11-18T20:39:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:28.919+0000 7f0986a51640 1 -- 172.21.15.132:0/1998365407 wait complete. 2023-11-18T20:39:28.945 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-11-18T20:39:28.662012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225084,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749636,"statfs":{"total":773094113280,"available":772863627264,"internally_reserved":0,"allocated":4857856,"data_stored":2659166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.290700"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495110+0000","last_change":"2023-11-18T20:39:23.420773+0000","last_active":"2023-11-18T20:39:24.495110+0000","last_peered":"2023-11-18T20:39:24.495110+0000","last_clean":"2023-11-18T20:39:24.495110+0000","last_became_active":"2023-11-18T20:39:23.420497+0000","last_became_peered":"2023-11-18T20:39:23.420497+0000","last_unstale":"2023-11-18T20:39:24.495110+0000","last_undegraded":"2023-11-18T20:39:24.495110+0000","last_fullsized":"2023-11-18T20:39:24.495110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:06.573461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412009+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:23.412009+0000","last_peered":"2023-11-18T20:39:23.412009+0000","last_clean":"2023-11-18T20:39:23.412009+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:23.412009+0000","last_undegraded":"2023-11-18T20:39:23.412009+0000","last_fullsized":"2023-11-18T20:39:23.412009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414782+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:23.414782+0000","last_peered":"2023-11-18T20:39:23.414782+0000","last_clean":"2023-11-18T20:39:23.414782+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:23.414782+0000","last_undegraded":"2023-11-18T20:39:23.414782+0000","last_fullsized":"2023-11-18T20:39:23.414782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:49.505805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.391765+0000","last_change":"2023-11-18T20:39:02.760047+0000","last_active":"2023-11-18T20:39:23.391765+0000","last_peered":"2023-11-18T20:39:23.391765+0000","last_clean":"2023-11-18T20:39:23.391765+0000","last_became_active":"2023-11-18T20:39:02.759514+0000","last_became_peered":"2023-11-18T20:39:02.759514+0000","last_unstale":"2023-11-18T20:39:23.391765+0000","last_undegraded":"2023-11-18T20:39:23.391765+0000","last_fullsized":"2023-11-18T20:39:23.391765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449037+0000","last_change":"2023-11-18T20:39:22.407903+0000","last_active":"2023-11-18T20:39:23.449037+0000","last_peered":"2023-11-18T20:39:23.449037+0000","last_clean":"2023-11-18T20:39:23.449037+0000","last_became_active":"2023-11-18T20:39:22.407672+0000","last_became_peered":"2023-11-18T20:39:22.407672+0000","last_unstale":"2023-11-18T20:39:23.449037+0000","last_undegraded":"2023-11-18T20:39:23.449037+0000","last_fullsized":"2023-11-18T20:39:23.449037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:55.384588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494796+0000","last_change":"2023-11-18T20:39:23.429888+0000","last_active":"2023-11-18T20:39:24.494796+0000","last_peered":"2023-11-18T20:39:24.494796+0000","last_clean":"2023-11-18T20:39:24.494796+0000","last_became_active":"2023-11-18T20:39:23.428493+0000","last_became_peered":"2023-11-18T20:39:23.428493+0000","last_unstale":"2023-11-18T20:39:24.494796+0000","last_undegraded":"2023-11-18T20:39:24.494796+0000","last_fullsized":"2023-11-18T20:39:24.494796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.419455+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:23.419455+0000","last_peered":"2023-11-18T20:39:23.419455+0000","last_clean":"2023-11-18T20:39:23.419455+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:23.419455+0000","last_undegraded":"2023-11-18T20:39:23.419455+0000","last_fullsized":"2023-11-18T20:39:23.419455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:56.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412479+0000","last_change":"2023-11-18T20:39:02.755764+0000","last_active":"2023-11-18T20:39:23.412479+0000","last_peered":"2023-11-18T20:39:23.412479+0000","last_clean":"2023-11-18T20:39:23.412479+0000","last_became_active":"2023-11-18T20:39:02.755464+0000","last_became_peered":"2023-11-18T20:39:02.755464+0000","last_unstale":"2023-11-18T20:39:23.412479+0000","last_undegraded":"2023-11-18T20:39:23.412479+0000","last_fullsized":"2023-11-18T20:39:23.412479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:24.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407111+0000","last_change":"2023-11-18T20:39:22.406273+0000","last_active":"2023-11-18T20:39:23.407111+0000","last_peered":"2023-11-18T20:39:23.407111+0000","last_clean":"2023-11-18T20:39:23.407111+0000","last_became_active":"2023-11-18T20:39:22.405680+0000","last_became_peered":"2023-11-18T20:39:22.405680+0000","last_unstale":"2023-11-18T20:39:23.407111+0000","last_undegraded":"2023-11-18T20:39:23.407111+0000","last_fullsized":"2023-11-18T20:39:23.407111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:38.292942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419768+0000","last_change":"2023-11-18T20:39:23.427239+0000","last_active":"2023-11-18T20:39:24.419768+0000","last_peered":"2023-11-18T20:39:24.419768+0000","last_clean":"2023-11-18T20:39:24.419768+0000","last_became_active":"2023-11-18T20:39:23.426300+0000","last_became_peered":"2023-11-18T20:39:23.426300+0000","last_unstale":"2023-11-18T20:39:24.419768+0000","last_undegraded":"2023-11-18T20:39:24.419768+0000","last_fullsized":"2023-11-18T20:39:24.419768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:47:00.725680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405270+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:23.405270+0000","last_peered":"2023-11-18T20:39:23.405270+0000","last_clean":"2023-11-18T20:39:23.405270+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:23.405270+0000","last_undegraded":"2023-11-18T20:39:23.405270+0000","last_fullsized":"2023-11-18T20:39:23.405270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:24.984694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415529+0000","last_change":"2023-11-18T20:39:02.752804+0000","last_active":"2023-11-18T20:39:23.415529+0000","last_peered":"2023-11-18T20:39:23.415529+0000","last_clean":"2023-11-18T20:39:23.415529+0000","last_became_active":"2023-11-18T20:39:02.752203+0000","last_became_peered":"2023-11-18T20:39:02.752203+0000","last_unstale":"2023-11-18T20:39:23.415529+0000","last_undegraded":"2023-11-18T20:39:23.415529+0000","last_fullsized":"2023-11-18T20:39:23.415529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396860+0000","last_change":"2023-11-18T20:39:22.406528+0000","last_active":"2023-11-18T20:39:23.396860+0000","last_peered":"2023-11-18T20:39:23.396860+0000","last_clean":"2023-11-18T20:39:23.396860+0000","last_became_active":"2023-11-18T20:39:22.406024+0000","last_became_peered":"2023-11-18T20:39:22.406024+0000","last_unstale":"2023-11-18T20:39:23.396860+0000","last_undegraded":"2023-11-18T20:39:23.396860+0000","last_fullsized":"2023-11-18T20:39:23.396860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:18:36.439871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417717+0000","last_change":"2023-11-18T20:39:23.417467+0000","last_active":"2023-11-18T20:39:24.417717+0000","last_peered":"2023-11-18T20:39:24.417717+0000","last_clean":"2023-11-18T20:39:24.417717+0000","last_became_active":"2023-11-18T20:39:23.417144+0000","last_became_peered":"2023-11-18T20:39:23.417144+0000","last_unstale":"2023-11-18T20:39:24.417717+0000","last_undegraded":"2023-11-18T20:39:24.417717+0000","last_fullsized":"2023-11-18T20:39:24.417717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:36.617668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.400291+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:23.400291+0000","last_peered":"2023-11-18T20:39:23.400291+0000","last_clean":"2023-11-18T20:39:23.400291+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:23.400291+0000","last_undegraded":"2023-11-18T20:39:23.400291+0000","last_fullsized":"2023-11-18T20:39:23.400291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:30.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413890+0000","last_change":"2023-11-18T20:39:02.748674+0000","last_active":"2023-11-18T20:39:23.413890+0000","last_peered":"2023-11-18T20:39:23.413890+0000","last_clean":"2023-11-18T20:39:23.413890+0000","last_became_active":"2023-11-18T20:39:02.748033+0000","last_became_peered":"2023-11-18T20:39:02.748033+0000","last_unstale":"2023-11-18T20:39:23.413890+0000","last_undegraded":"2023-11-18T20:39:23.413890+0000","last_fullsized":"2023-11-18T20:39:23.413890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:31.017030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405800+0000","last_change":"2023-11-18T20:39:22.409054+0000","last_active":"2023-11-18T20:39:23.405800+0000","last_peered":"2023-11-18T20:39:23.405800+0000","last_clean":"2023-11-18T20:39:23.405800+0000","last_became_active":"2023-11-18T20:39:22.408725+0000","last_became_peered":"2023-11-18T20:39:22.408725+0000","last_unstale":"2023-11-18T20:39:23.405800+0000","last_undegraded":"2023-11-18T20:39:23.405800+0000","last_fullsized":"2023-11-18T20:39:23.405800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:53.412441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492146+0000","last_change":"2023-11-18T20:39:23.443088+0000","last_active":"2023-11-18T20:39:24.492146+0000","last_peered":"2023-11-18T20:39:24.492146+0000","last_clean":"2023-11-18T20:39:24.492146+0000","last_became_active":"2023-11-18T20:39:23.442820+0000","last_became_peered":"2023-11-18T20:39:23.442820+0000","last_unstale":"2023-11-18T20:39:24.492146+0000","last_undegraded":"2023-11-18T20:39:24.492146+0000","last_fullsized":"2023-11-18T20:39:24.492146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:46:15.687815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.399349+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:23.399349+0000","last_peered":"2023-11-18T20:39:23.399349+0000","last_clean":"2023-11-18T20:39:23.399349+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:23.399349+0000","last_undegraded":"2023-11-18T20:39:23.399349+0000","last_fullsized":"2023-11-18T20:39:23.399349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:01.441027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393686+0000","last_change":"2023-11-18T20:39:02.755847+0000","last_active":"2023-11-18T20:39:23.393686+0000","last_peered":"2023-11-18T20:39:23.393686+0000","last_clean":"2023-11-18T20:39:23.393686+0000","last_became_active":"2023-11-18T20:39:02.755565+0000","last_became_peered":"2023-11-18T20:39:02.755565+0000","last_unstale":"2023-11-18T20:39:23.393686+0000","last_undegraded":"2023-11-18T20:39:23.393686+0000","last_fullsized":"2023-11-18T20:39:23.393686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396472+0000","last_change":"2023-11-18T20:39:22.400862+0000","last_active":"2023-11-18T20:39:23.396472+0000","last_peered":"2023-11-18T20:39:23.396472+0000","last_clean":"2023-11-18T20:39:23.396472+0000","last_became_active":"2023-11-18T20:39:22.400584+0000","last_became_peered":"2023-11-18T20:39:22.400584+0000","last_unstale":"2023-11-18T20:39:23.396472+0000","last_undegraded":"2023-11-18T20:39:23.396472+0000","last_fullsized":"2023-11-18T20:39:23.396472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:03.815644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494568+0000","last_change":"2023-11-18T20:39:23.427290+0000","last_active":"2023-11-18T20:39:24.494568+0000","last_peered":"2023-11-18T20:39:24.494568+0000","last_clean":"2023-11-18T20:39:24.494568+0000","last_became_active":"2023-11-18T20:39:23.426945+0000","last_became_peered":"2023-11-18T20:39:23.426945+0000","last_unstale":"2023-11-18T20:39:24.494568+0000","last_undegraded":"2023-11-18T20:39:24.494568+0000","last_fullsized":"2023-11-18T20:39:24.494568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:55:10.225203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397899+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:23.397899+0000","last_peered":"2023-11-18T20:39:23.397899+0000","last_clean":"2023-11-18T20:39:23.397899+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:23.397899+0000","last_undegraded":"2023-11-18T20:39:23.397899+0000","last_fullsized":"2023-11-18T20:39:23.397899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:43.756070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413481+0000","last_change":"2023-11-18T20:39:02.766797+0000","last_active":"2023-11-18T20:39:23.413481+0000","last_peered":"2023-11-18T20:39:23.413481+0000","last_clean":"2023-11-18T20:39:23.413481+0000","last_became_active":"2023-11-18T20:39:02.766466+0000","last_became_peered":"2023-11-18T20:39:02.766466+0000","last_unstale":"2023-11-18T20:39:23.413481+0000","last_undegraded":"2023-11-18T20:39:23.413481+0000","last_fullsized":"2023-11-18T20:39:23.413481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.491100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.428827+0000","last_change":"2023-11-18T20:39:22.410942+0000","last_active":"2023-11-18T20:39:23.428827+0000","last_peered":"2023-11-18T20:39:23.428827+0000","last_clean":"2023-11-18T20:39:23.428827+0000","last_became_active":"2023-11-18T20:39:22.410660+0000","last_became_peered":"2023-11-18T20:39:22.410660+0000","last_unstale":"2023-11-18T20:39:23.428827+0000","last_undegraded":"2023-11-18T20:39:23.428827+0000","last_fullsized":"2023-11-18T20:39:23.428827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:42.926451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494430+0000","last_change":"2023-11-18T20:39:23.438792+0000","last_active":"2023-11-18T20:39:24.494430+0000","last_peered":"2023-11-18T20:39:24.494430+0000","last_clean":"2023-11-18T20:39:24.494430+0000","last_became_active":"2023-11-18T20:39:23.437752+0000","last_became_peered":"2023-11-18T20:39:23.437752+0000","last_unstale":"2023-11-18T20:39:24.494430+0000","last_undegraded":"2023-11-18T20:39:24.494430+0000","last_fullsized":"2023-11-18T20:39:24.494430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:29:36.331864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427691+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:23.427691+0000","last_peered":"2023-11-18T20:39:23.427691+0000","last_clean":"2023-11-18T20:39:23.427691+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:23.427691+0000","last_undegraded":"2023-11-18T20:39:23.427691+0000","last_fullsized":"2023-11-18T20:39:23.427691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:32.771880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406533+0000","last_change":"2023-11-18T20:39:02.760873+0000","last_active":"2023-11-18T20:39:23.406533+0000","last_peered":"2023-11-18T20:39:23.406533+0000","last_clean":"2023-11-18T20:39:23.406533+0000","last_became_active":"2023-11-18T20:39:02.759887+0000","last_became_peered":"2023-11-18T20:39:02.759887+0000","last_unstale":"2023-11-18T20:39:23.406533+0000","last_undegraded":"2023-11-18T20:39:23.406533+0000","last_fullsized":"2023-11-18T20:39:23.406533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:26.185944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412595+0000","last_change":"2023-11-18T20:39:22.411188+0000","last_active":"2023-11-18T20:39:23.412595+0000","last_peered":"2023-11-18T20:39:23.412595+0000","last_clean":"2023-11-18T20:39:23.412595+0000","last_became_active":"2023-11-18T20:39:22.410686+0000","last_became_peered":"2023-11-18T20:39:22.410686+0000","last_unstale":"2023-11-18T20:39:23.412595+0000","last_undegraded":"2023-11-18T20:39:23.412595+0000","last_fullsized":"2023-11-18T20:39:23.412595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:44.343230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421439+0000","last_change":"2023-11-18T20:39:23.432967+0000","last_active":"2023-11-18T20:39:24.421439+0000","last_peered":"2023-11-18T20:39:24.421439+0000","last_clean":"2023-11-18T20:39:24.421439+0000","last_became_active":"2023-11-18T20:39:23.432657+0000","last_became_peered":"2023-11-18T20:39:23.432657+0000","last_unstale":"2023-11-18T20:39:24.421439+0000","last_undegraded":"2023-11-18T20:39:24.421439+0000","last_fullsized":"2023-11-18T20:39:24.421439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:38.580148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398698+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:23.398698+0000","last_peered":"2023-11-18T20:39:23.398698+0000","last_clean":"2023-11-18T20:39:23.398698+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:23.398698+0000","last_undegraded":"2023-11-18T20:39:23.398698+0000","last_fullsized":"2023-11-18T20:39:23.398698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:39.869697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413300+0000","last_change":"2023-11-18T20:39:02.762642+0000","last_active":"2023-11-18T20:39:23.413300+0000","last_peered":"2023-11-18T20:39:23.413300+0000","last_clean":"2023-11-18T20:39:23.413300+0000","last_became_active":"2023-11-18T20:39:02.761245+0000","last_became_peered":"2023-11-18T20:39:02.761245+0000","last_unstale":"2023-11-18T20:39:23.413300+0000","last_undegraded":"2023-11-18T20:39:23.413300+0000","last_fullsized":"2023-11-18T20:39:23.413300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:59.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397637+0000","last_change":"2023-11-18T20:39:22.403397+0000","last_active":"2023-11-18T20:39:23.397637+0000","last_peered":"2023-11-18T20:39:23.397637+0000","last_clean":"2023-11-18T20:39:23.397637+0000","last_became_active":"2023-11-18T20:39:22.403108+0000","last_became_peered":"2023-11-18T20:39:22.403108+0000","last_unstale":"2023-11-18T20:39:23.397637+0000","last_undegraded":"2023-11-18T20:39:23.397637+0000","last_fullsized":"2023-11-18T20:39:23.397637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:00.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419824+0000","last_change":"2023-11-18T20:39:23.419397+0000","last_active":"2023-11-18T20:39:24.419824+0000","last_peered":"2023-11-18T20:39:24.419824+0000","last_clean":"2023-11-18T20:39:24.419824+0000","last_became_active":"2023-11-18T20:39:23.419142+0000","last_became_peered":"2023-11-18T20:39:23.419142+0000","last_unstale":"2023-11-18T20:39:24.419824+0000","last_undegraded":"2023-11-18T20:39:24.419824+0000","last_fullsized":"2023-11-18T20:39:24.419824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:51.592301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406992+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:23.406992+0000","last_peered":"2023-11-18T20:39:23.406992+0000","last_clean":"2023-11-18T20:39:23.406992+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:23.406992+0000","last_undegraded":"2023-11-18T20:39:23.406992+0000","last_fullsized":"2023-11-18T20:39:23.406992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:48:04.385451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411551+0000","last_change":"2023-11-18T20:39:02.769526+0000","last_active":"2023-11-18T20:39:23.411551+0000","last_peered":"2023-11-18T20:39:23.411551+0000","last_clean":"2023-11-18T20:39:23.411551+0000","last_became_active":"2023-11-18T20:39:02.767946+0000","last_became_peered":"2023-11-18T20:39:02.767946+0000","last_unstale":"2023-11-18T20:39:23.411551+0000","last_undegraded":"2023-11-18T20:39:23.411551+0000","last_fullsized":"2023-11-18T20:39:23.411551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.392639+0000","last_change":"2023-11-18T20:39:22.397295+0000","last_active":"2023-11-18T20:39:23.392639+0000","last_peered":"2023-11-18T20:39:23.392639+0000","last_clean":"2023-11-18T20:39:23.392639+0000","last_became_active":"2023-11-18T20:39:22.396777+0000","last_became_peered":"2023-11-18T20:39:22.396777+0000","last_unstale":"2023-11-18T20:39:23.392639+0000","last_undegraded":"2023-11-18T20:39:23.392639+0000","last_fullsized":"2023-11-18T20:39:23.392639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:44.041536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419400+0000","last_change":"2023-11-18T20:39:23.427589+0000","last_active":"2023-11-18T20:39:24.419400+0000","last_peered":"2023-11-18T20:39:24.419400+0000","last_clean":"2023-11-18T20:39:24.419400+0000","last_became_active":"2023-11-18T20:39:23.426763+0000","last_became_peered":"2023-11-18T20:39:23.426763+0000","last_unstale":"2023-11-18T20:39:24.419400+0000","last_undegraded":"2023-11-18T20:39:24.419400+0000","last_fullsized":"2023-11-18T20:39:24.419400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:41:24.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411644+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:23.411644+0000","last_peered":"2023-11-18T20:39:23.411644+0000","last_clean":"2023-11-18T20:39:23.411644+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:23.411644+0000","last_undegraded":"2023-11-18T20:39:23.411644+0000","last_fullsized":"2023-11-18T20:39:23.411644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.395924+0000","last_change":"2023-11-18T20:39:02.750840+0000","last_active":"2023-11-18T20:39:23.395924+0000","last_peered":"2023-11-18T20:39:23.395924+0000","last_clean":"2023-11-18T20:39:23.395924+0000","last_became_active":"2023-11-18T20:39:02.749491+0000","last_became_peered":"2023-11-18T20:39:02.749491+0000","last_unstale":"2023-11-18T20:39:23.395924+0000","last_undegraded":"2023-11-18T20:39:23.395924+0000","last_fullsized":"2023-11-18T20:39:23.395924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:27:46.865954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.446332+0000","last_change":"2023-11-18T20:39:22.396910+0000","last_active":"2023-11-18T20:39:23.446332+0000","last_peered":"2023-11-18T20:39:23.446332+0000","last_clean":"2023-11-18T20:39:23.446332+0000","last_became_active":"2023-11-18T20:39:22.396615+0000","last_became_peered":"2023-11-18T20:39:22.396615+0000","last_unstale":"2023-11-18T20:39:23.446332+0000","last_undegraded":"2023-11-18T20:39:23.446332+0000","last_fullsized":"2023-11-18T20:39:23.446332+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:22.047139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495361+0000","last_change":"2023-11-18T20:39:23.434749+0000","last_active":"2023-11-18T20:39:24.495361+0000","last_peered":"2023-11-18T20:39:24.495361+0000","last_clean":"2023-11-18T20:39:24.495361+0000","last_became_active":"2023-11-18T20:39:23.434450+0000","last_became_peered":"2023-11-18T20:39:23.434450+0000","last_unstale":"2023-11-18T20:39:24.495361+0000","last_undegraded":"2023-11-18T20:39:24.495361+0000","last_fullsized":"2023-11-18T20:39:24.495361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:41.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403561+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:23.403561+0000","last_peered":"2023-11-18T20:39:23.403561+0000","last_clean":"2023-11-18T20:39:23.403561+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:23.403561+0000","last_undegraded":"2023-11-18T20:39:23.403561+0000","last_fullsized":"2023-11-18T20:39:23.403561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.432189+0000","last_change":"2023-11-18T20:39:02.757357+0000","last_active":"2023-11-18T20:39:23.432189+0000","last_peered":"2023-11-18T20:39:23.432189+0000","last_clean":"2023-11-18T20:39:23.432189+0000","last_became_active":"2023-11-18T20:39:02.757000+0000","last_became_peered":"2023-11-18T20:39:02.757000+0000","last_unstale":"2023-11-18T20:39:23.432189+0000","last_undegraded":"2023-11-18T20:39:23.432189+0000","last_fullsized":"2023-11-18T20:39:23.432189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406421+0000","last_change":"2023-11-18T20:39:22.404704+0000","last_active":"2023-11-18T20:39:23.406421+0000","last_peered":"2023-11-18T20:39:23.406421+0000","last_clean":"2023-11-18T20:39:23.406421+0000","last_became_active":"2023-11-18T20:39:22.403768+0000","last_became_peered":"2023-11-18T20:39:22.403768+0000","last_unstale":"2023-11-18T20:39:23.406421+0000","last_undegraded":"2023-11-18T20:39:23.406421+0000","last_fullsized":"2023-11-18T20:39:23.406421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:20:23.165252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496768+0000","last_change":"2023-11-18T20:39:23.434493+0000","last_active":"2023-11-18T20:39:24.496768+0000","last_peered":"2023-11-18T20:39:24.496768+0000","last_clean":"2023-11-18T20:39:24.496768+0000","last_became_active":"2023-11-18T20:39:23.434041+0000","last_became_peered":"2023-11-18T20:39:23.434041+0000","last_unstale":"2023-11-18T20:39:24.496768+0000","last_undegraded":"2023-11-18T20:39:24.496768+0000","last_fullsized":"2023-11-18T20:39:24.496768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:23.674417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.428097+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:23.428097+0000","last_peered":"2023-11-18T20:39:23.428097+0000","last_clean":"2023-11-18T20:39:23.428097+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:23.428097+0000","last_undegraded":"2023-11-18T20:39:23.428097+0000","last_fullsized":"2023-11-18T20:39:23.428097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397015+0000","last_change":"2023-11-18T20:39:02.762298+0000","last_active":"2023-11-18T20:39:23.397015+0000","last_peered":"2023-11-18T20:39:23.397015+0000","last_clean":"2023-11-18T20:39:23.397015+0000","last_became_active":"2023-11-18T20:39:02.761752+0000","last_became_peered":"2023-11-18T20:39:02.761752+0000","last_unstale":"2023-11-18T20:39:23.397015+0000","last_undegraded":"2023-11-18T20:39:23.397015+0000","last_fullsized":"2023-11-18T20:39:23.397015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:16:15.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415731+0000","last_change":"2023-11-18T20:39:22.398043+0000","last_active":"2023-11-18T20:39:23.415731+0000","last_peered":"2023-11-18T20:39:23.415731+0000","last_clean":"2023-11-18T20:39:23.415731+0000","last_became_active":"2023-11-18T20:39:22.397732+0000","last_became_peered":"2023-11-18T20:39:22.397732+0000","last_unstale":"2023-11-18T20:39:23.415731+0000","last_undegraded":"2023-11-18T20:39:23.415731+0000","last_fullsized":"2023-11-18T20:39:23.415731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:05.560747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494710+0000","last_change":"2023-11-18T20:39:23.446473+0000","last_active":"2023-11-18T20:39:24.494710+0000","last_peered":"2023-11-18T20:39:24.494710+0000","last_clean":"2023-11-18T20:39:24.494710+0000","last_became_active":"2023-11-18T20:39:23.444958+0000","last_became_peered":"2023-11-18T20:39:23.444958+0000","last_unstale":"2023-11-18T20:39:24.494710+0000","last_undegraded":"2023-11-18T20:39:24.494710+0000","last_fullsized":"2023-11-18T20:39:24.494710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:36.401544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.392006+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:23.392006+0000","last_peered":"2023-11-18T20:39:23.392006+0000","last_clean":"2023-11-18T20:39:23.392006+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:23.392006+0000","last_undegraded":"2023-11-18T20:39:23.392006+0000","last_fullsized":"2023-11-18T20:39:23.392006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:27.505414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413223+0000","last_change":"2023-11-18T20:39:02.760383+0000","last_active":"2023-11-18T20:39:23.413223+0000","last_peered":"2023-11-18T20:39:23.413223+0000","last_clean":"2023-11-18T20:39:23.413223+0000","last_became_active":"2023-11-18T20:39:02.760126+0000","last_became_peered":"2023-11-18T20:39:02.760126+0000","last_unstale":"2023-11-18T20:39:23.413223+0000","last_undegraded":"2023-11-18T20:39:23.413223+0000","last_fullsized":"2023-11-18T20:39:23.413223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.441711+0000","last_change":"2023-11-18T20:39:22.404538+0000","last_active":"2023-11-18T20:39:23.441711+0000","last_peered":"2023-11-18T20:39:23.441711+0000","last_clean":"2023-11-18T20:39:23.441711+0000","last_became_active":"2023-11-18T20:39:22.404275+0000","last_became_peered":"2023-11-18T20:39:22.404275+0000","last_unstale":"2023-11-18T20:39:23.441711+0000","last_undegraded":"2023-11-18T20:39:23.441711+0000","last_fullsized":"2023-11-18T20:39:23.441711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:20.984416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494724+0000","last_change":"2023-11-18T20:39:23.425133+0000","last_active":"2023-11-18T20:39:24.494724+0000","last_peered":"2023-11-18T20:39:24.494724+0000","last_clean":"2023-11-18T20:39:24.494724+0000","last_became_active":"2023-11-18T20:39:23.424861+0000","last_became_peered":"2023-11-18T20:39:23.424861+0000","last_unstale":"2023-11-18T20:39:24.494724+0000","last_undegraded":"2023-11-18T20:39:24.494724+0000","last_fullsized":"2023-11-18T20:39:24.494724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:25.077001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414704+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:23.414704+0000","last_peered":"2023-11-18T20:39:23.414704+0000","last_clean":"2023-11-18T20:39:23.414704+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:23.414704+0000","last_undegraded":"2023-11-18T20:39:23.414704+0000","last_fullsized":"2023-11-18T20:39:23.414704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:41.560904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.425614+0000","last_change":"2023-11-18T20:39:02.763496+0000","last_active":"2023-11-18T20:39:23.425614+0000","last_peered":"2023-11-18T20:39:23.425614+0000","last_clean":"2023-11-18T20:39:23.425614+0000","last_became_active":"2023-11-18T20:39:02.762875+0000","last_became_peered":"2023-11-18T20:39:02.762875+0000","last_unstale":"2023-11-18T20:39:23.425614+0000","last_undegraded":"2023-11-18T20:39:23.425614+0000","last_fullsized":"2023-11-18T20:39:23.425614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.450896+0000","last_change":"2023-11-18T20:39:22.405242+0000","last_active":"2023-11-18T20:39:23.450896+0000","last_peered":"2023-11-18T20:39:23.450896+0000","last_clean":"2023-11-18T20:39:23.450896+0000","last_became_active":"2023-11-18T20:39:22.404935+0000","last_became_peered":"2023-11-18T20:39:22.404935+0000","last_unstale":"2023-11-18T20:39:23.450896+0000","last_undegraded":"2023-11-18T20:39:23.450896+0000","last_fullsized":"2023-11-18T20:39:23.450896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:35.604954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493572+0000","last_change":"2023-11-18T20:39:23.427457+0000","last_active":"2023-11-18T20:39:24.493572+0000","last_peered":"2023-11-18T20:39:24.493572+0000","last_clean":"2023-11-18T20:39:24.493572+0000","last_became_active":"2023-11-18T20:39:23.426833+0000","last_became_peered":"2023-11-18T20:39:23.426833+0000","last_unstale":"2023-11-18T20:39:24.493572+0000","last_undegraded":"2023-11-18T20:39:24.493572+0000","last_fullsized":"2023-11-18T20:39:24.493572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:05.551712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405886+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:23.405886+0000","last_peered":"2023-11-18T20:39:23.405886+0000","last_clean":"2023-11-18T20:39:23.405886+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:23.405886+0000","last_undegraded":"2023-11-18T20:39:23.405886+0000","last_fullsized":"2023-11-18T20:39:23.405886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415095+0000","last_change":"2023-11-18T20:39:02.765789+0000","last_active":"2023-11-18T20:39:23.415095+0000","last_peered":"2023-11-18T20:39:23.415095+0000","last_clean":"2023-11-18T20:39:23.415095+0000","last_became_active":"2023-11-18T20:39:02.764984+0000","last_became_peered":"2023-11-18T20:39:02.764984+0000","last_unstale":"2023-11-18T20:39:23.415095+0000","last_undegraded":"2023-11-18T20:39:23.415095+0000","last_fullsized":"2023-11-18T20:39:23.415095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397152+0000","last_change":"2023-11-18T20:39:22.403628+0000","last_active":"2023-11-18T20:39:23.397152+0000","last_peered":"2023-11-18T20:39:23.397152+0000","last_clean":"2023-11-18T20:39:23.397152+0000","last_became_active":"2023-11-18T20:39:22.401145+0000","last_became_peered":"2023-11-18T20:39:22.401145+0000","last_unstale":"2023-11-18T20:39:23.397152+0000","last_undegraded":"2023-11-18T20:39:23.397152+0000","last_fullsized":"2023-11-18T20:39:23.397152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:55.116379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419133+0000","last_change":"2023-11-18T20:39:23.439752+0000","last_active":"2023-11-18T20:39:24.419133+0000","last_peered":"2023-11-18T20:39:24.419133+0000","last_clean":"2023-11-18T20:39:24.419133+0000","last_became_active":"2023-11-18T20:39:23.439379+0000","last_became_peered":"2023-11-18T20:39:23.439379+0000","last_unstale":"2023-11-18T20:39:24.419133+0000","last_undegraded":"2023-11-18T20:39:24.419133+0000","last_fullsized":"2023-11-18T20:39:24.419133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:06.573461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.416613+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:23.416613+0000","last_peered":"2023-11-18T20:39:23.416613+0000","last_clean":"2023-11-18T20:39:23.416613+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:23.416613+0000","last_undegraded":"2023-11-18T20:39:23.416613+0000","last_fullsized":"2023-11-18T20:39:23.416613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407607+0000","last_change":"2023-11-18T20:39:02.773440+0000","last_active":"2023-11-18T20:39:23.407607+0000","last_peered":"2023-11-18T20:39:23.407607+0000","last_clean":"2023-11-18T20:39:23.407607+0000","last_became_active":"2023-11-18T20:39:02.773133+0000","last_became_peered":"2023-11-18T20:39:02.773133+0000","last_unstale":"2023-11-18T20:39:23.407607+0000","last_undegraded":"2023-11-18T20:39:23.407607+0000","last_fullsized":"2023-11-18T20:39:23.407607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:02.899681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.448335+0000","last_change":"2023-11-18T20:39:22.398608+0000","last_active":"2023-11-18T20:39:23.448335+0000","last_peered":"2023-11-18T20:39:23.448335+0000","last_clean":"2023-11-18T20:39:23.448335+0000","last_became_active":"2023-11-18T20:39:22.398282+0000","last_became_peered":"2023-11-18T20:39:22.398282+0000","last_unstale":"2023-11-18T20:39:23.448335+0000","last_undegraded":"2023-11-18T20:39:23.448335+0000","last_fullsized":"2023-11-18T20:39:23.448335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:24:07.788841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493728+0000","last_change":"2023-11-18T20:39:23.429471+0000","last_active":"2023-11-18T20:39:24.493728+0000","last_peered":"2023-11-18T20:39:24.493728+0000","last_clean":"2023-11-18T20:39:24.493728+0000","last_became_active":"2023-11-18T20:39:23.425105+0000","last_became_peered":"2023-11-18T20:39:23.425105+0000","last_unstale":"2023-11-18T20:39:24.493728+0000","last_undegraded":"2023-11-18T20:39:24.493728+0000","last_fullsized":"2023-11-18T20:39:24.493728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:05.551712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412061+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:23.412061+0000","last_peered":"2023-11-18T20:39:23.412061+0000","last_clean":"2023-11-18T20:39:23.412061+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:23.412061+0000","last_undegraded":"2023-11-18T20:39:23.412061+0000","last_fullsized":"2023-11-18T20:39:23.412061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412378+0000","last_change":"2023-11-18T20:39:02.777823+0000","last_active":"2023-11-18T20:39:23.412378+0000","last_peered":"2023-11-18T20:39:23.412378+0000","last_clean":"2023-11-18T20:39:23.412378+0000","last_became_active":"2023-11-18T20:39:02.777456+0000","last_became_peered":"2023-11-18T20:39:02.777456+0000","last_unstale":"2023-11-18T20:39:23.412378+0000","last_undegraded":"2023-11-18T20:39:23.412378+0000","last_fullsized":"2023-11-18T20:39:23.412378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:44.618827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393472+0000","last_change":"2023-11-18T20:39:22.402262+0000","last_active":"2023-11-18T20:39:23.393472+0000","last_peered":"2023-11-18T20:39:23.393472+0000","last_clean":"2023-11-18T20:39:23.393472+0000","last_became_active":"2023-11-18T20:39:22.401944+0000","last_became_peered":"2023-11-18T20:39:22.401944+0000","last_unstale":"2023-11-18T20:39:23.393472+0000","last_undegraded":"2023-11-18T20:39:23.393472+0000","last_fullsized":"2023-11-18T20:39:23.393472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:39.434602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492720+0000","last_change":"2023-11-18T20:39:23.444095+0000","last_active":"2023-11-18T20:39:24.492720+0000","last_peered":"2023-11-18T20:39:24.492720+0000","last_clean":"2023-11-18T20:39:24.492720+0000","last_became_active":"2023-11-18T20:39:23.443826+0000","last_became_peered":"2023-11-18T20:39:23.443826+0000","last_unstale":"2023-11-18T20:39:24.492720+0000","last_undegraded":"2023-11-18T20:39:24.492720+0000","last_fullsized":"2023-11-18T20:39:24.492720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:58.405497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415943+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:23.415943+0000","last_peered":"2023-11-18T20:39:23.415943+0000","last_clean":"2023-11-18T20:39:23.415943+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:23.415943+0000","last_undegraded":"2023-11-18T20:39:23.415943+0000","last_fullsized":"2023-11-18T20:39:23.415943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:52:57.711383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403600+0000","last_change":"2023-11-18T20:39:02.767695+0000","last_active":"2023-11-18T20:39:23.403600+0000","last_peered":"2023-11-18T20:39:23.403600+0000","last_clean":"2023-11-18T20:39:23.403600+0000","last_became_active":"2023-11-18T20:39:02.765964+0000","last_became_peered":"2023-11-18T20:39:02.765964+0000","last_unstale":"2023-11-18T20:39:23.403600+0000","last_undegraded":"2023-11-18T20:39:23.403600+0000","last_fullsized":"2023-11-18T20:39:23.403600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449118+0000","last_change":"2023-11-18T20:39:22.406580+0000","last_active":"2023-11-18T20:39:23.449118+0000","last_peered":"2023-11-18T20:39:23.449118+0000","last_clean":"2023-11-18T20:39:23.449118+0000","last_became_active":"2023-11-18T20:39:22.405573+0000","last_became_peered":"2023-11-18T20:39:22.405573+0000","last_unstale":"2023-11-18T20:39:23.449118+0000","last_undegraded":"2023-11-18T20:39:23.449118+0000","last_fullsized":"2023-11-18T20:39:23.449118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:46:14.675100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417717+0000","last_change":"2023-11-18T20:39:23.418507+0000","last_active":"2023-11-18T20:39:24.417717+0000","last_peered":"2023-11-18T20:39:24.417717+0000","last_clean":"2023-11-18T20:39:24.417717+0000","last_became_active":"2023-11-18T20:39:23.418209+0000","last_became_peered":"2023-11-18T20:39:23.418209+0000","last_unstale":"2023-11-18T20:39:24.417717+0000","last_undegraded":"2023-11-18T20:39:24.417717+0000","last_fullsized":"2023-11-18T20:39:24.417717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:43.939166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414749+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:23.414749+0000","last_peered":"2023-11-18T20:39:23.414749+0000","last_clean":"2023-11-18T20:39:23.414749+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:23.414749+0000","last_undegraded":"2023-11-18T20:39:23.414749+0000","last_fullsized":"2023-11-18T20:39:23.414749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413806+0000","last_change":"2023-11-18T20:39:02.748892+0000","last_active":"2023-11-18T20:39:23.413806+0000","last_peered":"2023-11-18T20:39:23.413806+0000","last_clean":"2023-11-18T20:39:23.413806+0000","last_became_active":"2023-11-18T20:39:02.748392+0000","last_became_peered":"2023-11-18T20:39:02.748392+0000","last_unstale":"2023-11-18T20:39:23.413806+0000","last_undegraded":"2023-11-18T20:39:23.413806+0000","last_fullsized":"2023-11-18T20:39:23.413806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:18.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449318+0000","last_change":"2023-11-18T20:39:22.383835+0000","last_active":"2023-11-18T20:39:23.449318+0000","last_peered":"2023-11-18T20:39:23.449318+0000","last_clean":"2023-11-18T20:39:23.449318+0000","last_became_active":"2023-11-18T20:39:22.383055+0000","last_became_peered":"2023-11-18T20:39:22.383055+0000","last_unstale":"2023-11-18T20:39:23.449318+0000","last_undegraded":"2023-11-18T20:39:23.449318+0000","last_fullsized":"2023-11-18T20:39:23.449318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:05.923006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493264+0000","last_change":"2023-11-18T20:39:23.434794+0000","last_active":"2023-11-18T20:39:24.493264+0000","last_peered":"2023-11-18T20:39:24.493264+0000","last_clean":"2023-11-18T20:39:24.493264+0000","last_became_active":"2023-11-18T20:39:23.434508+0000","last_became_peered":"2023-11-18T20:39:23.434508+0000","last_unstale":"2023-11-18T20:39:24.493264+0000","last_undegraded":"2023-11-18T20:39:24.493264+0000","last_fullsized":"2023-11-18T20:39:24.493264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:38.915609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404337+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:23.404337+0000","last_peered":"2023-11-18T20:39:23.404337+0000","last_clean":"2023-11-18T20:39:23.404337+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:23.404337+0000","last_undegraded":"2023-11-18T20:39:23.404337+0000","last_fullsized":"2023-11-18T20:39:23.404337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396780+0000","last_change":"2023-11-18T20:39:02.755872+0000","last_active":"2023-11-18T20:39:23.396780+0000","last_peered":"2023-11-18T20:39:23.396780+0000","last_clean":"2023-11-18T20:39:23.396780+0000","last_became_active":"2023-11-18T20:39:02.755415+0000","last_became_peered":"2023-11-18T20:39:02.755415+0000","last_unstale":"2023-11-18T20:39:23.396780+0000","last_undegraded":"2023-11-18T20:39:23.396780+0000","last_fullsized":"2023-11-18T20:39:23.396780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:08.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.395696+0000","last_change":"2023-11-18T20:39:22.403667+0000","last_active":"2023-11-18T20:39:23.395696+0000","last_peered":"2023-11-18T20:39:23.395696+0000","last_clean":"2023-11-18T20:39:23.395696+0000","last_became_active":"2023-11-18T20:39:22.402205+0000","last_became_peered":"2023-11-18T20:39:22.402205+0000","last_unstale":"2023-11-18T20:39:23.395696+0000","last_undegraded":"2023-11-18T20:39:23.395696+0000","last_fullsized":"2023-11-18T20:39:23.395696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:17:50.919163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494419+0000","last_change":"2023-11-18T20:39:23.422652+0000","last_active":"2023-11-18T20:39:24.494419+0000","last_peered":"2023-11-18T20:39:24.494419+0000","last_clean":"2023-11-18T20:39:24.494419+0000","last_became_active":"2023-11-18T20:39:23.420660+0000","last_became_peered":"2023-11-18T20:39:23.420660+0000","last_unstale":"2023-11-18T20:39:24.494419+0000","last_undegraded":"2023-11-18T20:39:24.494419+0000","last_fullsized":"2023-11-18T20:39:24.494419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'8","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397812+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:23.397812+0000","last_peered":"2023-11-18T20:39:23.397812+0000","last_clean":"2023-11-18T20:39:23.397812+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:23.397812+0000","last_undegraded":"2023-11-18T20:39:23.397812+0000","last_fullsized":"2023-11-18T20:39:23.397812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:26.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414434+0000","last_change":"2023-11-18T20:39:02.774185+0000","last_active":"2023-11-18T20:39:23.414434+0000","last_peered":"2023-11-18T20:39:23.414434+0000","last_clean":"2023-11-18T20:39:23.414434+0000","last_became_active":"2023-11-18T20:39:02.773865+0000","last_became_peered":"2023-11-18T20:39:02.773865+0000","last_unstale":"2023-11-18T20:39:23.414434+0000","last_undegraded":"2023-11-18T20:39:23.414434+0000","last_fullsized":"2023-11-18T20:39:23.414434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:29.774288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422277+0000","last_change":"2023-11-18T20:39:22.399738+0000","last_active":"2023-11-18T20:39:23.422277+0000","last_peered":"2023-11-18T20:39:23.422277+0000","last_clean":"2023-11-18T20:39:23.422277+0000","last_became_active":"2023-11-18T20:39:22.399456+0000","last_became_peered":"2023-11-18T20:39:22.399456+0000","last_unstale":"2023-11-18T20:39:23.422277+0000","last_undegraded":"2023-11-18T20:39:23.422277+0000","last_fullsized":"2023-11-18T20:39:23.422277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:41.606873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494888+0000","last_change":"2023-11-18T20:39:23.434431+0000","last_active":"2023-11-18T20:39:24.494888+0000","last_peered":"2023-11-18T20:39:24.494888+0000","last_clean":"2023-11-18T20:39:24.494888+0000","last_became_active":"2023-11-18T20:39:23.433510+0000","last_became_peered":"2023-11-18T20:39:23.433510+0000","last_unstale":"2023-11-18T20:39:24.494888+0000","last_undegraded":"2023-11-18T20:39:24.494888+0000","last_fullsized":"2023-11-18T20:39:24.494888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:36.401544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414524+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:23.414524+0000","last_peered":"2023-11-18T20:39:23.414524+0000","last_clean":"2023-11-18T20:39:23.414524+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:23.414524+0000","last_undegraded":"2023-11-18T20:39:23.414524+0000","last_fullsized":"2023-11-18T20:39:23.414524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:25.771785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422233+0000","last_change":"2023-11-18T20:39:02.753904+0000","last_active":"2023-11-18T20:39:23.422233+0000","last_peered":"2023-11-18T20:39:23.422233+0000","last_clean":"2023-11-18T20:39:23.422233+0000","last_became_active":"2023-11-18T20:39:02.753415+0000","last_became_peered":"2023-11-18T20:39:02.753415+0000","last_unstale":"2023-11-18T20:39:23.422233+0000","last_undegraded":"2023-11-18T20:39:23.422233+0000","last_fullsized":"2023-11-18T20:39:23.422233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414852+0000","last_change":"2023-11-18T20:39:22.398779+0000","last_active":"2023-11-18T20:39:23.414852+0000","last_peered":"2023-11-18T20:39:23.414852+0000","last_clean":"2023-11-18T20:39:23.414852+0000","last_became_active":"2023-11-18T20:39:22.398477+0000","last_became_peered":"2023-11-18T20:39:22.398477+0000","last_unstale":"2023-11-18T20:39:23.414852+0000","last_undegraded":"2023-11-18T20:39:23.414852+0000","last_fullsized":"2023-11-18T20:39:23.414852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:31:02.989486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494145+0000","last_change":"2023-11-18T20:39:23.438807+0000","last_active":"2023-11-18T20:39:24.494145+0000","last_peered":"2023-11-18T20:39:24.494145+0000","last_clean":"2023-11-18T20:39:24.494145+0000","last_became_active":"2023-11-18T20:39:23.438271+0000","last_became_peered":"2023-11-18T20:39:23.438271+0000","last_unstale":"2023-11-18T20:39:24.494145+0000","last_undegraded":"2023-11-18T20:39:24.494145+0000","last_fullsized":"2023-11-18T20:39:24.494145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:53:48.228541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427598+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:23.427598+0000","last_peered":"2023-11-18T20:39:23.427598+0000","last_clean":"2023-11-18T20:39:23.427598+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:23.427598+0000","last_undegraded":"2023-11-18T20:39:23.427598+0000","last_fullsized":"2023-11-18T20:39:23.427598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427187+0000","last_change":"2023-11-18T20:39:02.763642+0000","last_active":"2023-11-18T20:39:23.427187+0000","last_peered":"2023-11-18T20:39:23.427187+0000","last_clean":"2023-11-18T20:39:23.427187+0000","last_became_active":"2023-11-18T20:39:02.763357+0000","last_became_peered":"2023-11-18T20:39:02.763357+0000","last_unstale":"2023-11-18T20:39:23.427187+0000","last_undegraded":"2023-11-18T20:39:23.427187+0000","last_fullsized":"2023-11-18T20:39:23.427187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:04.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.452282+0000","last_change":"2023-11-18T20:39:22.398742+0000","last_active":"2023-11-18T20:39:23.452282+0000","last_peered":"2023-11-18T20:39:23.452282+0000","last_clean":"2023-11-18T20:39:23.452282+0000","last_became_active":"2023-11-18T20:39:22.397880+0000","last_became_peered":"2023-11-18T20:39:22.397880+0000","last_unstale":"2023-11-18T20:39:23.452282+0000","last_undegraded":"2023-11-18T20:39:23.452282+0000","last_fullsized":"2023-11-18T20:39:23.452282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:40.332897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.497129+0000","last_change":"2023-11-18T20:39:23.446378+0000","last_active":"2023-11-18T20:39:24.497129+0000","last_peered":"2023-11-18T20:39:24.497129+0000","last_clean":"2023-11-18T20:39:24.497129+0000","last_became_active":"2023-11-18T20:39:23.445327+0000","last_became_peered":"2023-11-18T20:39:23.445327+0000","last_unstale":"2023-11-18T20:39:24.497129+0000","last_undegraded":"2023-11-18T20:39:24.497129+0000","last_fullsized":"2023-11-18T20:39:24.497129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:03.443291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.432067+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:23.432067+0000","last_peered":"2023-11-18T20:39:23.432067+0000","last_clean":"2023-11-18T20:39:23.432067+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:23.432067+0000","last_undegraded":"2023-11-18T20:39:23.432067+0000","last_fullsized":"2023-11-18T20:39:23.432067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.109348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407326+0000","last_change":"2023-11-18T20:39:02.759699+0000","last_active":"2023-11-18T20:39:23.407326+0000","last_peered":"2023-11-18T20:39:23.407326+0000","last_clean":"2023-11-18T20:39:23.407326+0000","last_became_active":"2023-11-18T20:39:02.759410+0000","last_became_peered":"2023-11-18T20:39:02.759410+0000","last_unstale":"2023-11-18T20:39:23.407326+0000","last_undegraded":"2023-11-18T20:39:23.407326+0000","last_fullsized":"2023-11-18T20:39:23.407326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:52:49.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.436190+0000","last_change":"2023-11-18T20:39:22.393343+0000","last_active":"2023-11-18T20:39:23.436190+0000","last_peered":"2023-11-18T20:39:23.436190+0000","last_clean":"2023-11-18T20:39:23.436190+0000","last_became_active":"2023-11-18T20:39:22.392729+0000","last_became_peered":"2023-11-18T20:39:22.392729+0000","last_unstale":"2023-11-18T20:39:23.436190+0000","last_undegraded":"2023-11-18T20:39:23.436190+0000","last_fullsized":"2023-11-18T20:39:23.436190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:18.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421141+0000","last_change":"2023-11-18T20:39:23.447500+0000","last_active":"2023-11-18T20:39:24.421141+0000","last_peered":"2023-11-18T20:39:24.421141+0000","last_clean":"2023-11-18T20:39:24.421141+0000","last_became_active":"2023-11-18T20:39:23.447118+0000","last_became_peered":"2023-11-18T20:39:23.447118+0000","last_unstale":"2023-11-18T20:39:24.421141+0000","last_undegraded":"2023-11-18T20:39:24.421141+0000","last_fullsized":"2023-11-18T20:39:24.421141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:23.674417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403828+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:23.403828+0000","last_peered":"2023-11-18T20:39:23.403828+0000","last_clean":"2023-11-18T20:39:23.403828+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:23.403828+0000","last_undegraded":"2023-11-18T20:39:23.403828+0000","last_fullsized":"2023-11-18T20:39:23.403828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415861+0000","last_change":"2023-11-18T20:39:02.770693+0000","last_active":"2023-11-18T20:39:23.415861+0000","last_peered":"2023-11-18T20:39:23.415861+0000","last_clean":"2023-11-18T20:39:23.415861+0000","last_became_active":"2023-11-18T20:39:02.766515+0000","last_became_peered":"2023-11-18T20:39:02.766515+0000","last_unstale":"2023-11-18T20:39:23.415861+0000","last_undegraded":"2023-11-18T20:39:23.415861+0000","last_fullsized":"2023-11-18T20:39:23.415861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447319+0000","last_change":"2023-11-18T20:39:22.402398+0000","last_active":"2023-11-18T20:39:23.447319+0000","last_peered":"2023-11-18T20:39:23.447319+0000","last_clean":"2023-11-18T20:39:23.447319+0000","last_became_active":"2023-11-18T20:39:22.401355+0000","last_became_peered":"2023-11-18T20:39:22.401355+0000","last_unstale":"2023-11-18T20:39:23.447319+0000","last_undegraded":"2023-11-18T20:39:23.447319+0000","last_fullsized":"2023-11-18T20:39:23.447319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:39:09.138913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492614+0000","last_change":"2023-11-18T20:39:23.420099+0000","last_active":"2023-11-18T20:39:24.492614+0000","last_peered":"2023-11-18T20:39:24.492614+0000","last_clean":"2023-11-18T20:39:24.492614+0000","last_became_active":"2023-11-18T20:39:23.418883+0000","last_became_peered":"2023-11-18T20:39:23.418883+0000","last_unstale":"2023-11-18T20:39:24.492614+0000","last_undegraded":"2023-11-18T20:39:24.492614+0000","last_fullsized":"2023-11-18T20:39:24.492614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:29:19.381062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413271+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:23.413271+0000","last_peered":"2023-11-18T20:39:23.413271+0000","last_clean":"2023-11-18T20:39:23.413271+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:23.413271+0000","last_undegraded":"2023-11-18T20:39:23.413271+0000","last_fullsized":"2023-11-18T20:39:23.413271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411822+0000","last_change":"2023-11-18T20:39:02.772323+0000","last_active":"2023-11-18T20:39:23.411822+0000","last_peered":"2023-11-18T20:39:23.411822+0000","last_clean":"2023-11-18T20:39:23.411822+0000","last_became_active":"2023-11-18T20:39:02.771746+0000","last_became_peered":"2023-11-18T20:39:02.771746+0000","last_unstale":"2023-11-18T20:39:23.411822+0000","last_undegraded":"2023-11-18T20:39:23.411822+0000","last_fullsized":"2023-11-18T20:39:23.411822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:51.574371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.442222+0000","last_change":"2023-11-18T20:39:22.401734+0000","last_active":"2023-11-18T20:39:23.442222+0000","last_peered":"2023-11-18T20:39:23.442222+0000","last_clean":"2023-11-18T20:39:23.442222+0000","last_became_active":"2023-11-18T20:39:22.398776+0000","last_became_peered":"2023-11-18T20:39:22.398776+0000","last_unstale":"2023-11-18T20:39:23.442222+0000","last_undegraded":"2023-11-18T20:39:23.442222+0000","last_fullsized":"2023-11-18T20:39:23.442222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:42.979247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492749+0000","last_change":"2023-11-18T20:39:23.428158+0000","last_active":"2023-11-18T20:39:24.492749+0000","last_peered":"2023-11-18T20:39:24.492749+0000","last_clean":"2023-11-18T20:39:24.492749+0000","last_became_active":"2023-11-18T20:39:23.427875+0000","last_became_peered":"2023-11-18T20:39:23.427875+0000","last_unstale":"2023-11-18T20:39:24.492749+0000","last_undegraded":"2023-11-18T20:39:24.492749+0000","last_fullsized":"2023-11-18T20:39:24.492749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:41:28.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403425+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:23.403425+0000","last_peered":"2023-11-18T20:39:23.403425+0000","last_clean":"2023-11-18T20:39:23.403425+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:23.403425+0000","last_undegraded":"2023-11-18T20:39:23.403425+0000","last_fullsized":"2023-11-18T20:39:23.403425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:47.442387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404066+0000","last_change":"2023-11-18T20:39:02.754613+0000","last_active":"2023-11-18T20:39:23.404066+0000","last_peered":"2023-11-18T20:39:23.404066+0000","last_clean":"2023-11-18T20:39:23.404066+0000","last_became_active":"2023-11-18T20:39:02.754350+0000","last_became_peered":"2023-11-18T20:39:02.754350+0000","last_unstale":"2023-11-18T20:39:23.404066+0000","last_undegraded":"2023-11-18T20:39:23.404066+0000","last_fullsized":"2023-11-18T20:39:23.404066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415693+0000","last_change":"2023-11-18T20:39:22.406251+0000","last_active":"2023-11-18T20:39:23.415693+0000","last_peered":"2023-11-18T20:39:23.415693+0000","last_clean":"2023-11-18T20:39:23.415693+0000","last_became_active":"2023-11-18T20:39:22.405901+0000","last_became_peered":"2023-11-18T20:39:22.405901+0000","last_unstale":"2023-11-18T20:39:23.415693+0000","last_undegraded":"2023-11-18T20:39:23.415693+0000","last_fullsized":"2023-11-18T20:39:23.415693+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:47.004453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418917+0000","last_change":"2023-11-18T20:39:23.430972+0000","last_active":"2023-11-18T20:39:24.418917+0000","last_peered":"2023-11-18T20:39:24.418917+0000","last_clean":"2023-11-18T20:39:24.418917+0000","last_became_active":"2023-11-18T20:39:23.430684+0000","last_became_peered":"2023-11-18T20:39:23.430684+0000","last_unstale":"2023-11-18T20:39:24.418917+0000","last_undegraded":"2023-11-18T20:39:24.418917+0000","last_fullsized":"2023-11-18T20:39:24.418917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:41:54.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404200+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:23.404200+0000","last_peered":"2023-11-18T20:39:23.404200+0000","last_clean":"2023-11-18T20:39:23.404200+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:23.404200+0000","last_undegraded":"2023-11-18T20:39:23.404200+0000","last_fullsized":"2023-11-18T20:39:23.404200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413690+0000","last_change":"2023-11-18T20:39:02.774591+0000","last_active":"2023-11-18T20:39:23.413690+0000","last_peered":"2023-11-18T20:39:23.413690+0000","last_clean":"2023-11-18T20:39:23.413690+0000","last_became_active":"2023-11-18T20:39:02.774338+0000","last_became_peered":"2023-11-18T20:39:02.774338+0000","last_unstale":"2023-11-18T20:39:23.413690+0000","last_undegraded":"2023-11-18T20:39:23.413690+0000","last_fullsized":"2023-11-18T20:39:23.413690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:32.560325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398471+0000","last_change":"2023-11-18T20:39:22.406308+0000","last_active":"2023-11-18T20:39:23.398471+0000","last_peered":"2023-11-18T20:39:23.398471+0000","last_clean":"2023-11-18T20:39:23.398471+0000","last_became_active":"2023-11-18T20:39:22.405980+0000","last_became_peered":"2023-11-18T20:39:22.405980+0000","last_unstale":"2023-11-18T20:39:23.398471+0000","last_undegraded":"2023-11-18T20:39:23.398471+0000","last_fullsized":"2023-11-18T20:39:23.398471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:48.566281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496412+0000","last_change":"2023-11-18T20:39:23.423726+0000","last_active":"2023-11-18T20:39:24.496412+0000","last_peered":"2023-11-18T20:39:24.496412+0000","last_clean":"2023-11-18T20:39:24.496412+0000","last_became_active":"2023-11-18T20:39:23.423431+0000","last_became_peered":"2023-11-18T20:39:23.423431+0000","last_unstale":"2023-11-18T20:39:24.496412+0000","last_undegraded":"2023-11-18T20:39:24.496412+0000","last_fullsized":"2023-11-18T20:39:24.496412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447164+0000","last_change":"2023-11-18T20:39:22.399160+0000","last_active":"2023-11-18T20:39:23.447164+0000","last_peered":"2023-11-18T20:39:23.447164+0000","last_clean":"2023-11-18T20:39:23.447164+0000","last_became_active":"2023-11-18T20:39:22.397086+0000","last_became_peered":"2023-11-18T20:39:22.397086+0000","last_unstale":"2023-11-18T20:39:23.447164+0000","last_undegraded":"2023-11-18T20:39:23.447164+0000","last_fullsized":"2023-11-18T20:39:23.447164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:31.506417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422373+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:23.422373+0000","last_peered":"2023-11-18T20:39:23.422373+0000","last_clean":"2023-11-18T20:39:23.422373+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:23.422373+0000","last_undegraded":"2023-11-18T20:39:23.422373+0000","last_fullsized":"2023-11-18T20:39:23.422373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415204+0000","last_change":"2023-11-18T20:39:02.758817+0000","last_active":"2023-11-18T20:39:23.415204+0000","last_peered":"2023-11-18T20:39:23.415204+0000","last_clean":"2023-11-18T20:39:23.415204+0000","last_became_active":"2023-11-18T20:39:02.758440+0000","last_became_peered":"2023-11-18T20:39:02.758440+0000","last_unstale":"2023-11-18T20:39:23.415204+0000","last_undegraded":"2023-11-18T20:39:23.415204+0000","last_fullsized":"2023-11-18T20:39:23.415204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494320+0000","last_change":"2023-11-18T20:39:23.440848+0000","last_active":"2023-11-18T20:39:24.494320+0000","last_peered":"2023-11-18T20:39:24.494320+0000","last_clean":"2023-11-18T20:39:24.494320+0000","last_became_active":"2023-11-18T20:39:23.440178+0000","last_became_peered":"2023-11-18T20:39:23.440178+0000","last_unstale":"2023-11-18T20:39:24.494320+0000","last_undegraded":"2023-11-18T20:39:24.494320+0000","last_fullsized":"2023-11-18T20:39:24.494320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.442140+0000","last_change":"2023-11-18T20:39:22.399945+0000","last_active":"2023-11-18T20:39:23.442140+0000","last_peered":"2023-11-18T20:39:23.442140+0000","last_clean":"2023-11-18T20:39:23.442140+0000","last_became_active":"2023-11-18T20:39:22.399644+0000","last_became_peered":"2023-11-18T20:39:22.399644+0000","last_unstale":"2023-11-18T20:39:23.442140+0000","last_undegraded":"2023-11-18T20:39:23.442140+0000","last_fullsized":"2023-11-18T20:39:23.442140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:20.630662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413693+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:23.413693+0000","last_peered":"2023-11-18T20:39:23.413693+0000","last_clean":"2023-11-18T20:39:23.413693+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:23.413693+0000","last_undegraded":"2023-11-18T20:39:23.413693+0000","last_fullsized":"2023-11-18T20:39:23.413693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404234+0000","last_change":"2023-11-18T20:39:02.751638+0000","last_active":"2023-11-18T20:39:23.404234+0000","last_peered":"2023-11-18T20:39:23.404234+0000","last_clean":"2023-11-18T20:39:23.404234+0000","last_became_active":"2023-11-18T20:39:02.751330+0000","last_became_peered":"2023-11-18T20:39:02.751330+0000","last_unstale":"2023-11-18T20:39:23.404234+0000","last_undegraded":"2023-11-18T20:39:23.404234+0000","last_fullsized":"2023-11-18T20:39:23.404234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495418+0000","last_change":"2023-11-18T20:39:23.426282+0000","last_active":"2023-11-18T20:39:24.495418+0000","last_peered":"2023-11-18T20:39:24.495418+0000","last_clean":"2023-11-18T20:39:24.495418+0000","last_became_active":"2023-11-18T20:39:23.426011+0000","last_became_peered":"2023-11-18T20:39:23.426011+0000","last_unstale":"2023-11-18T20:39:24.495418+0000","last_undegraded":"2023-11-18T20:39:24.495418+0000","last_fullsized":"2023-11-18T20:39:24.495418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:42.619588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422645+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:23.422645+0000","last_peered":"2023-11-18T20:39:23.422645+0000","last_clean":"2023-11-18T20:39:23.422645+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:23.422645+0000","last_undegraded":"2023-11-18T20:39:23.422645+0000","last_fullsized":"2023-11-18T20:39:23.422645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405311+0000","last_change":"2023-11-18T20:39:02.761289+0000","last_active":"2023-11-18T20:39:23.405311+0000","last_peered":"2023-11-18T20:39:23.405311+0000","last_clean":"2023-11-18T20:39:23.405311+0000","last_became_active":"2023-11-18T20:39:02.760948+0000","last_became_peered":"2023-11-18T20:39:02.760948+0000","last_unstale":"2023-11-18T20:39:23.405311+0000","last_undegraded":"2023-11-18T20:39:23.405311+0000","last_fullsized":"2023-11-18T20:39:23.405311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447327+0000","last_change":"2023-11-18T20:39:22.400658+0000","last_active":"2023-11-18T20:39:23.447327+0000","last_peered":"2023-11-18T20:39:23.447327+0000","last_clean":"2023-11-18T20:39:23.447327+0000","last_became_active":"2023-11-18T20:39:22.399324+0000","last_became_peered":"2023-11-18T20:39:22.399324+0000","last_unstale":"2023-11-18T20:39:23.447327+0000","last_undegraded":"2023-11-18T20:39:23.447327+0000","last_fullsized":"2023-11-18T20:39:23.447327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:22.449238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418745+0000","last_change":"2023-11-18T20:39:23.432727+0000","last_active":"2023-11-18T20:39:24.418745+0000","last_peered":"2023-11-18T20:39:24.418745+0000","last_clean":"2023-11-18T20:39:24.418745+0000","last_became_active":"2023-11-18T20:39:23.432461+0000","last_became_peered":"2023-11-18T20:39:23.432461+0000","last_unstale":"2023-11-18T20:39:24.418745+0000","last_undegraded":"2023-11-18T20:39:24.418745+0000","last_fullsized":"2023-11-18T20:39:24.418745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406905+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:23.406905+0000","last_peered":"2023-11-18T20:39:23.406905+0000","last_clean":"2023-11-18T20:39:23.406905+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:23.406905+0000","last_undegraded":"2023-11-18T20:39:23.406905+0000","last_fullsized":"2023-11-18T20:39:23.406905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:00.564472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397605+0000","last_change":"2023-11-18T20:39:02.761380+0000","last_active":"2023-11-18T20:39:23.397605+0000","last_peered":"2023-11-18T20:39:23.397605+0000","last_clean":"2023-11-18T20:39:23.397605+0000","last_became_active":"2023-11-18T20:39:02.760958+0000","last_became_peered":"2023-11-18T20:39:02.760958+0000","last_unstale":"2023-11-18T20:39:23.397605+0000","last_undegraded":"2023-11-18T20:39:23.397605+0000","last_fullsized":"2023-11-18T20:39:23.397605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:25.114138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.438778+0000","last_change":"2023-11-18T20:39:22.400634+0000","last_active":"2023-11-18T20:39:23.438778+0000","last_peered":"2023-11-18T20:39:23.438778+0000","last_clean":"2023-11-18T20:39:23.438778+0000","last_became_active":"2023-11-18T20:39:22.399955+0000","last_became_peered":"2023-11-18T20:39:22.399955+0000","last_unstale":"2023-11-18T20:39:23.438778+0000","last_undegraded":"2023-11-18T20:39:23.438778+0000","last_fullsized":"2023-11-18T20:39:23.438778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:21.205034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417953+0000","last_change":"2023-11-18T20:39:23.419745+0000","last_active":"2023-11-18T20:39:24.417953+0000","last_peered":"2023-11-18T20:39:24.417953+0000","last_clean":"2023-11-18T20:39:24.417953+0000","last_became_active":"2023-11-18T20:39:23.419381+0000","last_became_peered":"2023-11-18T20:39:23.419381+0000","last_unstale":"2023-11-18T20:39:24.417953+0000","last_undegraded":"2023-11-18T20:39:24.417953+0000","last_fullsized":"2023-11-18T20:39:24.417953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406778+0000","last_change":"2023-11-18T20:39:02.764472+0000","last_active":"2023-11-18T20:39:23.406778+0000","last_peered":"2023-11-18T20:39:23.406778+0000","last_clean":"2023-11-18T20:39:23.406778+0000","last_became_active":"2023-11-18T20:39:02.764087+0000","last_became_peered":"2023-11-18T20:39:02.764087+0000","last_unstale":"2023-11-18T20:39:23.406778+0000","last_undegraded":"2023-11-18T20:39:23.406778+0000","last_fullsized":"2023-11-18T20:39:23.406778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:00.994479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495181+0000","last_change":"2023-11-18T20:39:23.428059+0000","last_active":"2023-11-18T20:39:24.495181+0000","last_peered":"2023-11-18T20:39:24.495181+0000","last_clean":"2023-11-18T20:39:24.495181+0000","last_became_active":"2023-11-18T20:39:23.427465+0000","last_became_peered":"2023-11-18T20:39:23.427465+0000","last_unstale":"2023-11-18T20:39:24.495181+0000","last_undegraded":"2023-11-18T20:39:24.495181+0000","last_fullsized":"2023-11-18T20:39:24.495181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:36.617668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405159+0000","last_change":"2023-11-18T20:39:02.767291+0000","last_active":"2023-11-18T20:39:23.405159+0000","last_peered":"2023-11-18T20:39:23.405159+0000","last_clean":"2023-11-18T20:39:23.405159+0000","last_became_active":"2023-11-18T20:39:02.764390+0000","last_became_peered":"2023-11-18T20:39:02.764390+0000","last_unstale":"2023-11-18T20:39:23.405159+0000","last_undegraded":"2023-11-18T20:39:23.405159+0000","last_fullsized":"2023-11-18T20:39:23.405159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496394+0000","last_change":"2023-11-18T20:39:23.432917+0000","last_active":"2023-11-18T20:39:24.496394+0000","last_peered":"2023-11-18T20:39:24.496394+0000","last_clean":"2023-11-18T20:39:24.496394+0000","last_became_active":"2023-11-18T20:39:23.428767+0000","last_became_peered":"2023-11-18T20:39:23.428767+0000","last_unstale":"2023-11-18T20:39:24.496394+0000","last_undegraded":"2023-11-18T20:39:24.496394+0000","last_fullsized":"2023-11-18T20:39:24.496394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:41:24.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393169+0000","last_change":"2023-11-18T20:39:02.758480+0000","last_active":"2023-11-18T20:39:23.393169+0000","last_peered":"2023-11-18T20:39:23.393169+0000","last_clean":"2023-11-18T20:39:23.393169+0000","last_became_active":"2023-11-18T20:39:02.752070+0000","last_became_peered":"2023-11-18T20:39:02.752070+0000","last_unstale":"2023-11-18T20:39:23.393169+0000","last_undegraded":"2023-11-18T20:39:23.393169+0000","last_fullsized":"2023-11-18T20:39:23.393169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417985+0000","last_change":"2023-11-18T20:39:23.409355+0000","last_active":"2023-11-18T20:39:24.417985+0000","last_peered":"2023-11-18T20:39:24.417985+0000","last_clean":"2023-11-18T20:39:24.417985+0000","last_became_active":"2023-11-18T20:39:23.408604+0000","last_became_peered":"2023-11-18T20:39:23.408604+0000","last_unstale":"2023-11-18T20:39:24.417985+0000","last_undegraded":"2023-11-18T20:39:24.417985+0000","last_fullsized":"2023-11-18T20:39:24.417985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:05.267724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397065+0000","last_change":"2023-11-18T20:39:02.772625+0000","last_active":"2023-11-18T20:39:23.397065+0000","last_peered":"2023-11-18T20:39:23.397065+0000","last_clean":"2023-11-18T20:39:23.397065+0000","last_became_active":"2023-11-18T20:39:02.772348+0000","last_became_peered":"2023-11-18T20:39:02.772348+0000","last_unstale":"2023-11-18T20:39:23.397065+0000","last_undegraded":"2023-11-18T20:39:23.397065+0000","last_fullsized":"2023-11-18T20:39:23.397065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495555+0000","last_change":"2023-11-18T20:39:23.438347+0000","last_active":"2023-11-18T20:39:24.495555+0000","last_peered":"2023-11-18T20:39:24.495555+0000","last_clean":"2023-11-18T20:39:24.495555+0000","last_became_active":"2023-11-18T20:39:23.438076+0000","last_became_peered":"2023-11-18T20:39:23.438076+0000","last_unstale":"2023-11-18T20:39:24.495555+0000","last_undegraded":"2023-11-18T20:39:24.495555+0000","last_fullsized":"2023-11-18T20:39:24.495555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:41:54.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403234+0000","last_change":"2023-11-18T20:39:02.746609+0000","last_active":"2023-11-18T20:39:23.403234+0000","last_peered":"2023-11-18T20:39:23.403234+0000","last_clean":"2023-11-18T20:39:23.403234+0000","last_became_active":"2023-11-18T20:39:02.746324+0000","last_became_peered":"2023-11-18T20:39:02.746324+0000","last_unstale":"2023-11-18T20:39:23.403234+0000","last_undegraded":"2023-11-18T20:39:23.403234+0000","last_fullsized":"2023-11-18T20:39:23.403234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496548+0000","last_change":"2023-11-18T20:39:23.415863+0000","last_active":"2023-11-18T20:39:24.496548+0000","last_peered":"2023-11-18T20:39:24.496548+0000","last_clean":"2023-11-18T20:39:24.496548+0000","last_became_active":"2023-11-18T20:39:23.415576+0000","last_became_peered":"2023-11-18T20:39:23.415576+0000","last_unstale":"2023-11-18T20:39:24.496548+0000","last_undegraded":"2023-11-18T20:39:24.496548+0000","last_fullsized":"2023-11-18T20:39:24.496548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.426612+0000","last_change":"2023-11-18T20:39:02.775796+0000","last_active":"2023-11-18T20:39:23.426612+0000","last_peered":"2023-11-18T20:39:23.426612+0000","last_clean":"2023-11-18T20:39:23.426612+0000","last_became_active":"2023-11-18T20:39:02.775503+0000","last_became_peered":"2023-11-18T20:39:02.775503+0000","last_unstale":"2023-11-18T20:39:23.426612+0000","last_undegraded":"2023-11-18T20:39:23.426612+0000","last_fullsized":"2023-11-18T20:39:23.426612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493649+0000","last_change":"2023-11-18T20:39:23.422077+0000","last_active":"2023-11-18T20:39:24.493649+0000","last_peered":"2023-11-18T20:39:24.493649+0000","last_clean":"2023-11-18T20:39:24.493649+0000","last_became_active":"2023-11-18T20:39:23.418009+0000","last_became_peered":"2023-11-18T20:39:23.418009+0000","last_unstale":"2023-11-18T20:39:24.493649+0000","last_undegraded":"2023-11-18T20:39:24.493649+0000","last_fullsized":"2023-11-18T20:39:24.493649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:52.188384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422553+0000","last_change":"2023-11-18T20:39:02.774172+0000","last_active":"2023-11-18T20:39:23.422553+0000","last_peered":"2023-11-18T20:39:23.422553+0000","last_clean":"2023-11-18T20:39:23.422553+0000","last_became_active":"2023-11-18T20:39:02.773141+0000","last_became_peered":"2023-11-18T20:39:02.773141+0000","last_unstale":"2023-11-18T20:39:23.422553+0000","last_undegraded":"2023-11-18T20:39:23.422553+0000","last_fullsized":"2023-11-18T20:39:23.422553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:59:44.902815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494155+0000","last_change":"2023-11-18T20:39:23.421675+0000","last_active":"2023-11-18T20:39:24.494155+0000","last_peered":"2023-11-18T20:39:24.494155+0000","last_clean":"2023-11-18T20:39:24.494155+0000","last_became_active":"2023-11-18T20:39:23.421357+0000","last_became_peered":"2023-11-18T20:39:23.421357+0000","last_unstale":"2023-11-18T20:39:24.494155+0000","last_undegraded":"2023-11-18T20:39:24.494155+0000","last_fullsized":"2023-11-18T20:39:24.494155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:39.994594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427100+0000","last_change":"2023-11-18T20:39:02.772030+0000","last_active":"2023-11-18T20:39:23.427100+0000","last_peered":"2023-11-18T20:39:23.427100+0000","last_clean":"2023-11-18T20:39:23.427100+0000","last_became_active":"2023-11-18T20:39:02.771761+0000","last_became_peered":"2023-11-18T20:39:02.771761+0000","last_unstale":"2023-11-18T20:39:23.427100+0000","last_undegraded":"2023-11-18T20:39:23.427100+0000","last_fullsized":"2023-11-18T20:39:23.427100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493562+0000","last_change":"2023-11-18T20:39:23.429421+0000","last_active":"2023-11-18T20:39:24.493562+0000","last_peered":"2023-11-18T20:39:24.493562+0000","last_clean":"2023-11-18T20:39:24.493562+0000","last_became_active":"2023-11-18T20:39:23.428260+0000","last_became_peered":"2023-11-18T20:39:23.428260+0000","last_unstale":"2023-11-18T20:39:24.493562+0000","last_undegraded":"2023-11-18T20:39:24.493562+0000","last_fullsized":"2023-11-18T20:39:24.493562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:51.665927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403335+0000","last_change":"2023-11-18T20:39:02.752133+0000","last_active":"2023-11-18T20:39:23.403335+0000","last_peered":"2023-11-18T20:39:23.403335+0000","last_clean":"2023-11-18T20:39:23.403335+0000","last_became_active":"2023-11-18T20:39:02.751863+0000","last_became_peered":"2023-11-18T20:39:02.751863+0000","last_unstale":"2023-11-18T20:39:23.403335+0000","last_undegraded":"2023-11-18T20:39:23.403335+0000","last_fullsized":"2023-11-18T20:39:23.403335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:56.070643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495148+0000","last_change":"2023-11-18T20:39:23.430072+0000","last_active":"2023-11-18T20:39:24.495148+0000","last_peered":"2023-11-18T20:39:24.495148+0000","last_clean":"2023-11-18T20:39:24.495148+0000","last_became_active":"2023-11-18T20:39:23.428918+0000","last_became_peered":"2023-11-18T20:39:23.428918+0000","last_unstale":"2023-11-18T20:39:24.495148+0000","last_undegraded":"2023-11-18T20:39:24.495148+0000","last_fullsized":"2023-11-18T20:39:24.495148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:37.811641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396600+0000","last_change":"2023-11-18T20:39:02.758024+0000","last_active":"2023-11-18T20:39:23.396600+0000","last_peered":"2023-11-18T20:39:23.396600+0000","last_clean":"2023-11-18T20:39:23.396600+0000","last_became_active":"2023-11-18T20:39:02.757737+0000","last_became_peered":"2023-11-18T20:39:02.757737+0000","last_unstale":"2023-11-18T20:39:23.396600+0000","last_undegraded":"2023-11-18T20:39:23.396600+0000","last_fullsized":"2023-11-18T20:39:23.396600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:42:50.023528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418187+0000","last_change":"2023-11-18T20:39:23.430247+0000","last_active":"2023-11-18T20:39:24.418187+0000","last_peered":"2023-11-18T20:39:24.418187+0000","last_clean":"2023-11-18T20:39:24.418187+0000","last_became_active":"2023-11-18T20:39:23.429408+0000","last_became_peered":"2023-11-18T20:39:23.429408+0000","last_unstale":"2023-11-18T20:39:24.418187+0000","last_undegraded":"2023-11-18T20:39:24.418187+0000","last_fullsized":"2023-11-18T20:39:24.418187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.402903+0000","last_change":"2023-11-18T20:39:02.752211+0000","last_active":"2023-11-18T20:39:23.402903+0000","last_peered":"2023-11-18T20:39:23.402903+0000","last_clean":"2023-11-18T20:39:23.402903+0000","last_became_active":"2023-11-18T20:39:02.751940+0000","last_became_peered":"2023-11-18T20:39:02.751940+0000","last_unstale":"2023-11-18T20:39:23.402903+0000","last_undegraded":"2023-11-18T20:39:23.402903+0000","last_fullsized":"2023-11-18T20:39:23.402903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492406+0000","last_change":"2023-11-18T20:39:23.420764+0000","last_active":"2023-11-18T20:39:24.492406+0000","last_peered":"2023-11-18T20:39:24.492406+0000","last_clean":"2023-11-18T20:39:24.492406+0000","last_became_active":"2023-11-18T20:39:23.420487+0000","last_became_peered":"2023-11-18T20:39:23.420487+0000","last_unstale":"2023-11-18T20:39:24.492406+0000","last_undegraded":"2023-11-18T20:39:24.492406+0000","last_fullsized":"2023-11-18T20:39:24.492406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:37:49.228681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397207+0000","last_change":"2023-11-18T20:39:02.758393+0000","last_active":"2023-11-18T20:39:23.397207+0000","last_peered":"2023-11-18T20:39:23.397207+0000","last_clean":"2023-11-18T20:39:23.397207+0000","last_became_active":"2023-11-18T20:39:02.752864+0000","last_became_peered":"2023-11-18T20:39:02.752864+0000","last_unstale":"2023-11-18T20:39:23.397207+0000","last_undegraded":"2023-11-18T20:39:23.397207+0000","last_fullsized":"2023-11-18T20:39:23.397207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494808+0000","last_change":"2023-11-18T20:39:23.441180+0000","last_active":"2023-11-18T20:39:24.494808+0000","last_peered":"2023-11-18T20:39:24.494808+0000","last_clean":"2023-11-18T20:39:24.494808+0000","last_became_active":"2023-11-18T20:39:23.440877+0000","last_became_peered":"2023-11-18T20:39:23.440877+0000","last_unstale":"2023-11-18T20:39:24.494808+0000","last_undegraded":"2023-11-18T20:39:24.494808+0000","last_fullsized":"2023-11-18T20:39:24.494808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:51.665927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397681+0000","last_change":"2023-11-18T20:39:02.769220+0000","last_active":"2023-11-18T20:39:23.397681+0000","last_peered":"2023-11-18T20:39:23.397681+0000","last_clean":"2023-11-18T20:39:23.397681+0000","last_became_active":"2023-11-18T20:39:02.762271+0000","last_became_peered":"2023-11-18T20:39:02.762271+0000","last_unstale":"2023-11-18T20:39:23.397681+0000","last_undegraded":"2023-11-18T20:39:23.397681+0000","last_fullsized":"2023-11-18T20:39:23.397681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:37.501746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418640+0000","last_change":"2023-11-18T20:39:23.405475+0000","last_active":"2023-11-18T20:39:24.418640+0000","last_peered":"2023-11-18T20:39:24.418640+0000","last_clean":"2023-11-18T20:39:24.418640+0000","last_became_active":"2023-11-18T20:39:23.404710+0000","last_became_peered":"2023-11-18T20:39:23.404710+0000","last_unstale":"2023-11-18T20:39:24.418640+0000","last_undegraded":"2023-11-18T20:39:24.418640+0000","last_fullsized":"2023-11-18T20:39:24.418640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413035+0000","last_change":"2023-11-18T20:39:02.759862+0000","last_active":"2023-11-18T20:39:23.413035+0000","last_peered":"2023-11-18T20:39:23.413035+0000","last_clean":"2023-11-18T20:39:23.413035+0000","last_became_active":"2023-11-18T20:39:02.759565+0000","last_became_peered":"2023-11-18T20:39:02.759565+0000","last_unstale":"2023-11-18T20:39:23.413035+0000","last_undegraded":"2023-11-18T20:39:23.413035+0000","last_fullsized":"2023-11-18T20:39:23.413035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421837+0000","last_change":"2023-11-18T20:39:23.441932+0000","last_active":"2023-11-18T20:39:24.421837+0000","last_peered":"2023-11-18T20:39:24.421837+0000","last_clean":"2023-11-18T20:39:24.421837+0000","last_became_active":"2023-11-18T20:39:23.441592+0000","last_became_peered":"2023-11-18T20:39:23.441592+0000","last_unstale":"2023-11-18T20:39:24.421837+0000","last_undegraded":"2023-11-18T20:39:24.421837+0000","last_fullsized":"2023-11-18T20:39:24.421837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:03.443291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413198+0000","last_change":"2023-11-18T20:39:02.755514+0000","last_active":"2023-11-18T20:39:23.413198+0000","last_peered":"2023-11-18T20:39:23.413198+0000","last_clean":"2023-11-18T20:39:23.413198+0000","last_became_active":"2023-11-18T20:39:02.755083+0000","last_became_peered":"2023-11-18T20:39:02.755083+0000","last_unstale":"2023-11-18T20:39:23.413198+0000","last_undegraded":"2023-11-18T20:39:23.413198+0000","last_fullsized":"2023-11-18T20:39:23.413198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:57.948105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495760+0000","last_change":"2023-11-18T20:39:23.416569+0000","last_active":"2023-11-18T20:39:24.495760+0000","last_peered":"2023-11-18T20:39:24.495760+0000","last_clean":"2023-11-18T20:39:24.495760+0000","last_became_active":"2023-11-18T20:39:23.415936+0000","last_became_peered":"2023-11-18T20:39:23.415936+0000","last_unstale":"2023-11-18T20:39:24.495760+0000","last_undegraded":"2023-11-18T20:39:24.495760+0000","last_fullsized":"2023-11-18T20:39:24.495760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406407+0000","last_change":"2023-11-18T20:39:02.766551+0000","last_active":"2023-11-18T20:39:23.406407+0000","last_peered":"2023-11-18T20:39:23.406407+0000","last_clean":"2023-11-18T20:39:23.406407+0000","last_became_active":"2023-11-18T20:39:02.765528+0000","last_became_peered":"2023-11-18T20:39:02.765528+0000","last_unstale":"2023-11-18T20:39:23.406407+0000","last_undegraded":"2023-11-18T20:39:23.406407+0000","last_fullsized":"2023-11-18T20:39:23.406407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:30.943404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494313+0000","last_change":"2023-11-18T20:39:23.440738+0000","last_active":"2023-11-18T20:39:24.494313+0000","last_peered":"2023-11-18T20:39:24.494313+0000","last_clean":"2023-11-18T20:39:24.494313+0000","last_became_active":"2023-11-18T20:39:23.438183+0000","last_became_peered":"2023-11-18T20:39:23.438183+0000","last_unstale":"2023-11-18T20:39:24.494313+0000","last_undegraded":"2023-11-18T20:39:24.494313+0000","last_fullsized":"2023-11-18T20:39:24.494313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.391162+0000","last_change":"2023-11-18T20:39:02.759711+0000","last_active":"2023-11-18T20:39:23.391162+0000","last_peered":"2023-11-18T20:39:23.391162+0000","last_clean":"2023-11-18T20:39:23.391162+0000","last_became_active":"2023-11-18T20:39:02.759422+0000","last_became_peered":"2023-11-18T20:39:02.759422+0000","last_unstale":"2023-11-18T20:39:23.391162+0000","last_undegraded":"2023-11-18T20:39:23.391162+0000","last_fullsized":"2023-11-18T20:39:23.391162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418433+0000","last_change":"2023-11-18T20:39:23.435850+0000","last_active":"2023-11-18T20:39:24.418433+0000","last_peered":"2023-11-18T20:39:24.418433+0000","last_clean":"2023-11-18T20:39:24.418433+0000","last_became_active":"2023-11-18T20:39:23.435565+0000","last_became_peered":"2023-11-18T20:39:23.435565+0000","last_unstale":"2023-11-18T20:39:24.418433+0000","last_undegraded":"2023-11-18T20:39:24.418433+0000","last_fullsized":"2023-11-18T20:39:24.418433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:50.423185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393591+0000","last_change":"2023-11-18T20:39:02.750962+0000","last_active":"2023-11-18T20:39:23.393591+0000","last_peered":"2023-11-18T20:39:23.393591+0000","last_clean":"2023-11-18T20:39:23.393591+0000","last_became_active":"2023-11-18T20:39:02.750695+0000","last_became_peered":"2023-11-18T20:39:02.750695+0000","last_unstale":"2023-11-18T20:39:23.393591+0000","last_undegraded":"2023-11-18T20:39:23.393591+0000","last_fullsized":"2023-11-18T20:39:23.393591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.490966+0000","last_change":"2023-11-18T20:39:23.438134+0000","last_active":"2023-11-18T20:39:24.490966+0000","last_peered":"2023-11-18T20:39:24.490966+0000","last_clean":"2023-11-18T20:39:24.490966+0000","last_became_active":"2023-11-18T20:39:23.437851+0000","last_became_peered":"2023-11-18T20:39:23.437851+0000","last_unstale":"2023-11-18T20:39:24.490966+0000","last_undegraded":"2023-11-18T20:39:24.490966+0000","last_fullsized":"2023-11-18T20:39:24.490966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:30:34.308551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414661+0000","last_change":"2023-11-18T20:39:02.766121+0000","last_active":"2023-11-18T20:39:23.414661+0000","last_peered":"2023-11-18T20:39:23.414661+0000","last_clean":"2023-11-18T20:39:23.414661+0000","last_became_active":"2023-11-18T20:39:02.765807+0000","last_became_peered":"2023-11-18T20:39:02.765807+0000","last_unstale":"2023-11-18T20:39:23.414661+0000","last_undegraded":"2023-11-18T20:39:23.414661+0000","last_fullsized":"2023-11-18T20:39:23.414661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:15.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494142+0000","last_change":"2023-11-18T20:39:23.432185+0000","last_active":"2023-11-18T20:39:24.494142+0000","last_peered":"2023-11-18T20:39:24.494142+0000","last_clean":"2023-11-18T20:39:24.494142+0000","last_became_active":"2023-11-18T20:39:23.431390+0000","last_became_peered":"2023-11-18T20:39:23.431390+0000","last_unstale":"2023-11-18T20:39:24.494142+0000","last_undegraded":"2023-11-18T20:39:24.494142+0000","last_fullsized":"2023-11-18T20:39:24.494142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398310+0000","last_change":"2023-11-18T20:39:02.748415+0000","last_active":"2023-11-18T20:39:23.398310+0000","last_peered":"2023-11-18T20:39:23.398310+0000","last_clean":"2023-11-18T20:39:23.398310+0000","last_became_active":"2023-11-18T20:39:02.748123+0000","last_became_peered":"2023-11-18T20:39:02.748123+0000","last_unstale":"2023-11-18T20:39:23.398310+0000","last_undegraded":"2023-11-18T20:39:23.398310+0000","last_fullsized":"2023-11-18T20:39:23.398310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:36:58.122129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.422209+0000","last_change":"2023-11-18T20:39:23.431236+0000","last_active":"2023-11-18T20:39:24.422209+0000","last_peered":"2023-11-18T20:39:24.422209+0000","last_clean":"2023-11-18T20:39:24.422209+0000","last_became_active":"2023-11-18T20:39:23.430987+0000","last_became_peered":"2023-11-18T20:39:23.430987+0000","last_unstale":"2023-11-18T20:39:24.422209+0000","last_undegraded":"2023-11-18T20:39:24.422209+0000","last_fullsized":"2023-11-18T20:39:24.422209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:17.043049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414330+0000","last_change":"2023-11-18T20:39:02.756659+0000","last_active":"2023-11-18T20:39:23.414330+0000","last_peered":"2023-11-18T20:39:23.414330+0000","last_clean":"2023-11-18T20:39:23.414330+0000","last_became_active":"2023-11-18T20:39:02.756336+0000","last_became_peered":"2023-11-18T20:39:02.756336+0000","last_unstale":"2023-11-18T20:39:23.414330+0000","last_undegraded":"2023-11-18T20:39:23.414330+0000","last_fullsized":"2023-11-18T20:39:23.414330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:14.460811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419345+0000","last_change":"2023-11-18T20:39:23.442964+0000","last_active":"2023-11-18T20:39:24.419345+0000","last_peered":"2023-11-18T20:39:24.419345+0000","last_clean":"2023-11-18T20:39:24.419345+0000","last_became_active":"2023-11-18T20:39:23.442713+0000","last_became_peered":"2023-11-18T20:39:23.442713+0000","last_unstale":"2023-11-18T20:39:24.419345+0000","last_undegraded":"2023-11-18T20:39:24.419345+0000","last_fullsized":"2023-11-18T20:39:24.419345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:09.956411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414611+0000","last_change":"2023-11-18T20:39:02.773954+0000","last_active":"2023-11-18T20:39:23.414611+0000","last_peered":"2023-11-18T20:39:23.414611+0000","last_clean":"2023-11-18T20:39:23.414611+0000","last_became_active":"2023-11-18T20:39:02.773686+0000","last_became_peered":"2023-11-18T20:39:02.773686+0000","last_unstale":"2023-11-18T20:39:23.414611+0000","last_undegraded":"2023-11-18T20:39:23.414611+0000","last_fullsized":"2023-11-18T20:39:23.414611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:54.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419559+0000","last_change":"2023-11-18T20:39:23.421271+0000","last_active":"2023-11-18T20:39:24.419559+0000","last_peered":"2023-11-18T20:39:24.419559+0000","last_clean":"2023-11-18T20:39:24.419559+0000","last_became_active":"2023-11-18T20:39:23.421029+0000","last_became_peered":"2023-11-18T20:39:23.421029+0000","last_unstale":"2023-11-18T20:39:24.419559+0000","last_undegraded":"2023-11-18T20:39:24.419559+0000","last_fullsized":"2023-11-18T20:39:24.419559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:41.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422456+0000","last_change":"2023-11-18T20:39:02.764804+0000","last_active":"2023-11-18T20:39:23.422456+0000","last_peered":"2023-11-18T20:39:23.422456+0000","last_clean":"2023-11-18T20:39:23.422456+0000","last_became_active":"2023-11-18T20:39:02.764574+0000","last_became_peered":"2023-11-18T20:39:02.764574+0000","last_unstale":"2023-11-18T20:39:23.422456+0000","last_undegraded":"2023-11-18T20:39:23.422456+0000","last_fullsized":"2023-11-18T20:39:23.422456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494986+0000","last_change":"2023-11-18T20:39:23.439973+0000","last_active":"2023-11-18T20:39:24.494986+0000","last_peered":"2023-11-18T20:39:24.494986+0000","last_clean":"2023-11-18T20:39:24.494986+0000","last_became_active":"2023-11-18T20:39:23.439707+0000","last_became_peered":"2023-11-18T20:39:23.439707+0000","last_unstale":"2023-11-18T20:39:24.494986+0000","last_undegraded":"2023-11-18T20:39:24.494986+0000","last_fullsized":"2023-11-18T20:39:24.494986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415013+0000","last_change":"2023-11-18T20:39:02.775795+0000","last_active":"2023-11-18T20:39:23.415013+0000","last_peered":"2023-11-18T20:39:23.415013+0000","last_clean":"2023-11-18T20:39:23.415013+0000","last_became_active":"2023-11-18T20:39:02.775493+0000","last_became_peered":"2023-11-18T20:39:02.775493+0000","last_unstale":"2023-11-18T20:39:23.415013+0000","last_undegraded":"2023-11-18T20:39:23.415013+0000","last_fullsized":"2023-11-18T20:39:23.415013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418411+0000","last_change":"2023-11-18T20:39:23.432535+0000","last_active":"2023-11-18T20:39:24.418411+0000","last_peered":"2023-11-18T20:39:24.418411+0000","last_clean":"2023-11-18T20:39:24.418411+0000","last_became_active":"2023-11-18T20:39:23.432225+0000","last_became_peered":"2023-11-18T20:39:23.432225+0000","last_unstale":"2023-11-18T20:39:24.418411+0000","last_undegraded":"2023-11-18T20:39:24.418411+0000","last_fullsized":"2023-11-18T20:39:24.418411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:44.726874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403097+0000","last_change":"2023-11-18T20:39:02.744529+0000","last_active":"2023-11-18T20:39:23.403097+0000","last_peered":"2023-11-18T20:39:23.403097+0000","last_clean":"2023-11-18T20:39:23.403097+0000","last_became_active":"2023-11-18T20:39:02.744056+0000","last_became_peered":"2023-11-18T20:39:02.744056+0000","last_unstale":"2023-11-18T20:39:23.403097+0000","last_undegraded":"2023-11-18T20:39:23.403097+0000","last_fullsized":"2023-11-18T20:39:23.403097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:28.509793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492875+0000","last_change":"2023-11-18T20:39:23.409578+0000","last_active":"2023-11-18T20:39:24.492875+0000","last_peered":"2023-11-18T20:39:24.492875+0000","last_clean":"2023-11-18T20:39:24.492875+0000","last_became_active":"2023-11-18T20:39:23.409313+0000","last_became_peered":"2023-11-18T20:39:23.409313+0000","last_unstale":"2023-11-18T20:39:24.492875+0000","last_undegraded":"2023-11-18T20:39:24.492875+0000","last_fullsized":"2023-11-18T20:39:24.492875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:43.939166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405062+0000","last_change":"2023-11-18T20:39:02.767101+0000","last_active":"2023-11-18T20:39:23.405062+0000","last_peered":"2023-11-18T20:39:23.405062+0000","last_clean":"2023-11-18T20:39:23.405062+0000","last_became_active":"2023-11-18T20:39:02.764500+0000","last_became_peered":"2023-11-18T20:39:02.764500+0000","last_unstale":"2023-11-18T20:39:23.405062+0000","last_undegraded":"2023-11-18T20:39:23.405062+0000","last_fullsized":"2023-11-18T20:39:23.405062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496180+0000","last_change":"2023-11-18T20:39:23.425628+0000","last_active":"2023-11-18T20:39:24.496180+0000","last_peered":"2023-11-18T20:39:24.496180+0000","last_clean":"2023-11-18T20:39:24.496180+0000","last_became_active":"2023-11-18T20:39:23.425145+0000","last_became_peered":"2023-11-18T20:39:23.425145+0000","last_unstale":"2023-11-18T20:39:24.496180+0000","last_undegraded":"2023-11-18T20:39:24.496180+0000","last_fullsized":"2023-11-18T20:39:24.496180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:47:00.725680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413802+0000","last_change":"2023-11-18T20:39:02.755127+0000","last_active":"2023-11-18T20:39:23.413802+0000","last_peered":"2023-11-18T20:39:23.413802+0000","last_clean":"2023-11-18T20:39:23.413802+0000","last_became_active":"2023-11-18T20:39:02.754791+0000","last_became_peered":"2023-11-18T20:39:02.754791+0000","last_unstale":"2023-11-18T20:39:23.413802+0000","last_undegraded":"2023-11-18T20:39:23.413802+0000","last_fullsized":"2023-11-18T20:39:23.413802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.491424+0000","last_change":"2023-11-18T20:39:23.425893+0000","last_active":"2023-11-18T20:39:24.491424+0000","last_peered":"2023-11-18T20:39:24.491424+0000","last_clean":"2023-11-18T20:39:24.491424+0000","last_became_active":"2023-11-18T20:39:23.425362+0000","last_became_peered":"2023-11-18T20:39:23.425362+0000","last_unstale":"2023-11-18T20:39:24.491424+0000","last_undegraded":"2023-11-18T20:39:24.491424+0000","last_fullsized":"2023-11-18T20:39:24.491424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:50:54.388639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427940+0000","last_change":"2023-11-18T20:39:02.757930+0000","last_active":"2023-11-18T20:39:23.427940+0000","last_peered":"2023-11-18T20:39:23.427940+0000","last_clean":"2023-11-18T20:39:23.427940+0000","last_became_active":"2023-11-18T20:39:02.757463+0000","last_became_peered":"2023-11-18T20:39:02.757463+0000","last_unstale":"2023-11-18T20:39:23.427940+0000","last_undegraded":"2023-11-18T20:39:23.427940+0000","last_fullsized":"2023-11-18T20:39:23.427940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419320+0000","last_change":"2023-11-18T20:39:23.435438+0000","last_active":"2023-11-18T20:39:24.419320+0000","last_peered":"2023-11-18T20:39:24.419320+0000","last_clean":"2023-11-18T20:39:24.419320+0000","last_became_active":"2023-11-18T20:39:23.435003+0000","last_became_peered":"2023-11-18T20:39:23.435003+0000","last_unstale":"2023-11-18T20:39:24.419320+0000","last_undegraded":"2023-11-18T20:39:24.419320+0000","last_fullsized":"2023-11-18T20:39:24.419320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:37.811641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422139+0000","last_change":"2023-11-18T20:39:02.752584+0000","last_active":"2023-11-18T20:39:23.422139+0000","last_peered":"2023-11-18T20:39:23.422139+0000","last_clean":"2023-11-18T20:39:23.422139+0000","last_became_active":"2023-11-18T20:39:02.752259+0000","last_became_peered":"2023-11-18T20:39:02.752259+0000","last_unstale":"2023-11-18T20:39:23.422139+0000","last_undegraded":"2023-11-18T20:39:23.422139+0000","last_fullsized":"2023-11-18T20:39:23.422139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496316+0000","last_change":"2023-11-18T20:39:23.413254+0000","last_active":"2023-11-18T20:39:24.496316+0000","last_peered":"2023-11-18T20:39:24.496316+0000","last_clean":"2023-11-18T20:39:24.496316+0000","last_became_active":"2023-11-18T20:39:23.408288+0000","last_became_peered":"2023-11-18T20:39:23.408288+0000","last_unstale":"2023-11-18T20:39:24.496316+0000","last_undegraded":"2023-11-18T20:39:24.496316+0000","last_fullsized":"2023-11-18T20:39:24.496316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414893+0000","last_change":"2023-11-18T20:39:02.756005+0000","last_active":"2023-11-18T20:39:23.414893+0000","last_peered":"2023-11-18T20:39:23.414893+0000","last_clean":"2023-11-18T20:39:23.414893+0000","last_became_active":"2023-11-18T20:39:02.754298+0000","last_became_peered":"2023-11-18T20:39:02.754298+0000","last_unstale":"2023-11-18T20:39:23.414893+0000","last_undegraded":"2023-11-18T20:39:23.414893+0000","last_fullsized":"2023-11-18T20:39:23.414893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496924+0000","last_change":"2023-11-18T20:39:23.432493+0000","last_active":"2023-11-18T20:39:24.496924+0000","last_peered":"2023-11-18T20:39:24.496924+0000","last_clean":"2023-11-18T20:39:24.496924+0000","last_became_active":"2023-11-18T20:39:23.432175+0000","last_became_peered":"2023-11-18T20:39:23.432175+0000","last_unstale":"2023-11-18T20:39:24.496924+0000","last_undegraded":"2023-11-18T20:39:24.496924+0000","last_fullsized":"2023-11-18T20:39:24.496924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:38.580148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427177+0000","last_change":"2023-11-18T20:39:02.774649+0000","last_active":"2023-11-18T20:39:23.427177+0000","last_peered":"2023-11-18T20:39:23.427177+0000","last_clean":"2023-11-18T20:39:23.427177+0000","last_became_active":"2023-11-18T20:39:02.774358+0000","last_became_peered":"2023-11-18T20:39:02.774358+0000","last_unstale":"2023-11-18T20:39:23.427177+0000","last_undegraded":"2023-11-18T20:39:23.427177+0000","last_fullsized":"2023-11-18T20:39:23.427177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493419+0000","last_change":"2023-11-18T20:39:23.427619+0000","last_active":"2023-11-18T20:39:24.493419+0000","last_peered":"2023-11-18T20:39:24.493419+0000","last_clean":"2023-11-18T20:39:24.493419+0000","last_became_active":"2023-11-18T20:39:23.427203+0000","last_became_peered":"2023-11-18T20:39:23.427203+0000","last_unstale":"2023-11-18T20:39:24.493419+0000","last_undegraded":"2023-11-18T20:39:24.493419+0000","last_fullsized":"2023-11-18T20:39:24.493419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:38.915609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405199+0000","last_change":"2023-11-18T20:39:02.760762+0000","last_active":"2023-11-18T20:39:23.405199+0000","last_peered":"2023-11-18T20:39:23.405199+0000","last_clean":"2023-11-18T20:39:23.405199+0000","last_became_active":"2023-11-18T20:39:02.760426+0000","last_became_peered":"2023-11-18T20:39:02.760426+0000","last_unstale":"2023-11-18T20:39:23.405199+0000","last_undegraded":"2023-11-18T20:39:23.405199+0000","last_fullsized":"2023-11-18T20:39:23.405199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":183281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.72099999999999997}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.538}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.1559999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.597},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.3220000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.643},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.4710000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":1.7110000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.6699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":186948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.78600000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.145}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2689999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.488}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.736}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1044480,"data_stored":774197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.92800000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.161}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.294},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.044}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.264},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.706}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.345},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.3879999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.831},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.423}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":188058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.3460000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.01}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.381},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.4790000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.444},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.538}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.585},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.5029999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":185613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.038}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.087},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71699999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.173},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.2829999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.129},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3600000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.304},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":183349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.085},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.2629999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.357},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.03}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.21},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.153}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.502},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.4490000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.3180000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.482},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.411}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1044480,"data_stored":773733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.495},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.79900000000000004}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.84299999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.2250000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.0049999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":183987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":2.173}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.746}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.1950000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.256},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.286}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.218},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.458}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:28.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-18T20:39:29.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.204+0000 7f556cd06640 1 Processor -- start 2023-11-18T20:39:29.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.204+0000 7f556cd06640 1 -- start start 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.205+0000 7f556cd06640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f556814e7f0 0x7f55680c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.205+0000 7f556cd06640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556806cd20 0x7f556815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.205+0000 7f556cd06640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55680a8380 con 0x7f55680c52e0 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.205+0000 7f556cd06640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55681510b0 con 0x7f556814e7f0 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.205+0000 7f556cd06640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556806bf60 con 0x7f556806cd20 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.205+0000 7f55677fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f556814e7f0 0x7f55680c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.205+0000 7f55677fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f556814e7f0 0x7f55680c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48868/0 (socket says 172.21.15.132:48868) 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.205+0000 7f55677fe640 1 -- 172.21.15.132:0/1202644407 learned_addr learned my addr 172.21.15.132:0/1202644407 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.206+0000 7f55677fe640 1 -- 172.21.15.132:0/1202644407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556806cd20 msgr2=0x7f556815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.206+0000 7f55677fe640 1 --2- 172.21.15.132:0/1202644407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556806cd20 0x7f556815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.206+0000 7f55677fe640 1 -- 172.21.15.132:0/1202644407 >> v1:172.21.15.132:6789/0 conn(0x7f55680c52e0 legacy=0x7f556806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:29.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.206+0000 7f55677fe640 1 -- 172.21.15.132:0/1202644407 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556806c240 con 0x7f556814e7f0 2023-11-18T20:39:29.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.207+0000 7f55677fe640 1 --2- 172.21.15.132:0/1202644407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f556814e7f0 0x7f55680c0440 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5558009870 tx=0x7f555802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcb18921e48741d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:29.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.207+0000 7f55667fc640 1 -- 172.21.15.132:0/1202644407 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558031640 con 0x7f556814e7f0 2023-11-18T20:39:29.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.207+0000 7f55667fc640 1 -- 172.21.15.132:0/1202644407 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55580317a0 con 0x7f556814e7f0 2023-11-18T20:39:29.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.207+0000 7f55667fc640 1 -- 172.21.15.132:0/1202644407 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558031b30 con 0x7f556814e7f0 2023-11-18T20:39:29.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.208+0000 7f556cd06640 1 -- 172.21.15.132:0/1202644407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f556814e7f0 msgr2=0x7f55680c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.208+0000 7f556cd06640 1 --2- 172.21.15.132:0/1202644407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f556814e7f0 0x7f55680c0440 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5558009870 tx=0x7f555802b8f0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.208+0000 7f556cd06640 1 -- 172.21.15.132:0/1202644407 shutdown_connections 2023-11-18T20:39:29.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.208+0000 7f556cd06640 1 --2- 172.21.15.132:0/1202644407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556806cd20 0x7f556815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.208+0000 7f556cd06640 1 --2- 172.21.15.132:0/1202644407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f556814e7f0 0x7f55680c0440 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.208+0000 7f556cd06640 1 -- 172.21.15.132:0/1202644407 >> 172.21.15.132:0/1202644407 conn(0x7f55680a77f0 msgr2=0x7f55680a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:29.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.208+0000 7f556cd06640 1 -- 172.21.15.132:0/1202644407 shutdown_connections 2023-11-18T20:39:29.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.208+0000 7f556cd06640 1 -- 172.21.15.132:0/1202644407 wait complete. 2023-11-18T20:39:29.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.210+0000 7f556cd06640 1 Processor -- start 2023-11-18T20:39:29.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.210+0000 7f556cd06640 1 -- start start 2023-11-18T20:39:29.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f556cd06640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556806cd20 0x7f5568150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f556cd06640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55680c52e0 0x7f55681de960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f556cd06640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556814e7f0 0x7f55681eba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f556cd06640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55681dc570 con 0x7f55680c52e0 2023-11-18T20:39:29.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f556cd06640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55681eb370 con 0x7f556814e7f0 2023-11-18T20:39:29.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f556cd06640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55681dc040 con 0x7f556806cd20 2023-11-18T20:39:29.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f5566ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55680c52e0 0x7f55681de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:29.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f5566ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55680c52e0 0x7f55681de960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48870/0 (socket says 172.21.15.132:48870) 2023-11-18T20:39:29.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f5566ffd640 1 -- 172.21.15.132:0/4040886377 learned_addr learned my addr 172.21.15.132:0/4040886377 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f5566ffd640 1 -- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556806cd20 msgr2=0x7f5568150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f5566ffd640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556806cd20 0x7f5568150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f5566ffd640 1 -- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556814e7f0 msgr2=0x7f55681eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.211+0000 7f5567fff640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556814e7f0 0x7f55681eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f5566ffd640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556814e7f0 0x7f55681eba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f5566ffd640 1 -- 172.21.15.132:0/4040886377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55580094d0 con 0x7f55680c52e0 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f5567fff640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556814e7f0 0x7f55681eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f5566ffd640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55680c52e0 0x7f55681de960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f555000c870 tx=0x7f555000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f555ffff640 1 -- 172.21.15.132:0/4040886377 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550003b70 con 0x7f55680c52e0 2023-11-18T20:39:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f555ffff640 1 -- 172.21.15.132:0/4040886377 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5550003cf0 con 0x7f55680c52e0 2023-11-18T20:39:29.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f555ffff640 1 -- 172.21.15.132:0/4040886377 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000aa90 con 0x7f55680c52e0 2023-11-18T20:39:29.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55681eb5f0 con 0x7f55680c52e0 2023-11-18T20:39:29.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.212+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55681e8180 con 0x7f55680c52e0 2023-11-18T20:39:29.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.213+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556804e840 con 0x7f55680c52e0 2023-11-18T20:39:29.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.214+0000 7f555ffff640 1 -- 172.21.15.132:0/4040886377 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f555000abf0 con 0x7f55680c52e0 2023-11-18T20:39:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.215+0000 7f555ffff640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f554806ae40 0x7f554806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.215+0000 7f555ffff640 1 -- 172.21.15.132:0/4040886377 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f55500897a0 con 0x7f55680c52e0 2023-11-18T20:39:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.216+0000 7f55677fe640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f554806ae40 0x7f554806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.217+0000 7f55677fe640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f554806ae40 0x7f554806d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5558036000 tx=0x7f5558030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.220+0000 7f555ffff640 1 -- 172.21.15.132:0/4040886377 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5550054580 con 0x7f55680c52e0 2023-11-18T20:39:29.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.478+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55680abdd0 con 0x7f55680c52e0 2023-11-18T20:39:29.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.480+0000 7f555ffff640 1 -- 172.21.15.132:0/4040886377 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1663 (secure 0 0 0) 0x7f5550003e60 con 0x7f55680c52e0 2023-11-18T20:39:29.481 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:29.481 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":109,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1700339871,"num_in_osds":8,"osd_in_since":1700339863,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":193}],"num_pgs":193,"num_pools":5,"num_objects":45,"data_bytes":596683,"bytes_used":230486016,"bytes_avail":772863627264,"bytes_total":773094113280,"write_bytes_sec":2278,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":19,"id":2,"up":1,"in":1,"max":1,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":4562},{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4977}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-18T20:38:54.650627+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-18T20:39:29.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f554806ae40 msgr2=0x7f554806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f554806ae40 0x7f554806d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5558036000 tx=0x7f5558030000 comp rx=0 tx=0).stop 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55680c52e0 msgr2=0x7f55681de960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55680c52e0 0x7f55681de960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f555000c870 tx=0x7f555000cd30 comp rx=0 tx=0).stop 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 shutdown_connections 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f554806ae40 0x7f554806d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556814e7f0 0x7f55681eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55680c52e0 0x7f55681de960 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 --2- 172.21.15.132:0/4040886377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556806cd20 0x7f5568150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 >> 172.21.15.132:0/4040886377 conn(0x7f55680a77f0 msgr2=0x7f55680a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 shutdown_connections 2023-11-18T20:39:29.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.482+0000 7f556cd06640 1 -- 172.21.15.132:0/4040886377 wait complete. 2023-11-18T20:39:29.503 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-18T20:39:29.503 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:29.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.703+0000 7fd82d527640 1 Processor -- start 2023-11-18T20:39:29.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.704+0000 7fd82d527640 1 -- start start 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.705+0000 7fd82d527640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8280a5100 0x7fd82815fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.705+0000 7fd82d527640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280c1b60 con 0x7fd8280a4d20 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.705+0000 7fd82d527640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280a5530 con 0x7fd828154b40 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.705+0000 7fd82d527640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd828154fd0 con 0x7fd8280a5100 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.705+0000 7fd827fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd8280a4d20 0x7fd828154430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33942/0 (socket says 172.21.15.132:33942) 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.705+0000 7fd827fff640 1 -- 172.21.15.132:0/3686682418 learned_addr learned my addr 172.21.15.132:0/3686682418 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.705+0000 7fd82cd26640 1 --2- 172.21.15.132:0/3686682418 >> v2:172.21.15.132:3300/0 conn(0x7fd8280a5100 0x7fd82815fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.706+0000 7fd826ffd640 1 -- 172.21.15.132:0/3686682418 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119502143 0 0) 0x7fd8280c1b60 con 0x7fd8280a4d20 2023-11-18T20:39:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.706+0000 7fd826ffd640 1 -- 172.21.15.132:0/3686682418 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd810003520 con 0x7fd8280a4d20 2023-11-18T20:39:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.706+0000 7fd82cd26640 1 -- 172.21.15.132:0/3686682418 >> v1:172.21.15.161:6789/0 conn(0x7fd828154b40 legacy=0x7fd8280c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.706+0000 7fd82cd26640 1 -- 172.21.15.132:0/3686682418 >> v1:172.21.15.132:6789/0 conn(0x7fd8280a4d20 legacy=0x7fd828154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.706+0000 7fd82cd26640 1 -- 172.21.15.132:0/3686682418 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828157ad0 con 0x7fd8280a5100 2023-11-18T20:39:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.707+0000 7fd82cd26640 1 --2- 172.21.15.132:0/3686682418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8280a5100 0x7fd82815fce0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd820009d90 tx=0x7fd82002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a5f504fc5b17a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.707+0000 7fd826ffd640 1 -- 172.21.15.132:0/3686682418 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82002cc60 con 0x7fd8280a5100 2023-11-18T20:39:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.707+0000 7fd826ffd640 1 -- 172.21.15.132:0/3686682418 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82002cdc0 con 0x7fd8280a5100 2023-11-18T20:39:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.707+0000 7fd826ffd640 1 -- 172.21.15.132:0/3686682418 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820034640 con 0x7fd8280a5100 2023-11-18T20:39:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.708+0000 7fd82d527640 1 -- 172.21.15.132:0/3686682418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8280a5100 msgr2=0x7fd82815fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.708+0000 7fd82d527640 1 --2- 172.21.15.132:0/3686682418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8280a5100 0x7fd82815fce0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd820009d90 tx=0x7fd82002beb0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.708+0000 7fd82d527640 1 -- 172.21.15.132:0/3686682418 shutdown_connections 2023-11-18T20:39:29.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.708+0000 7fd82d527640 1 --2- 172.21.15.132:0/3686682418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8280a5100 0x7fd82815fce0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.708+0000 7fd82d527640 1 -- 172.21.15.132:0/3686682418 >> 172.21.15.132:0/3686682418 conn(0x7fd8280a77f0 msgr2=0x7fd8280a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:29.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.708+0000 7fd82d527640 1 -- 172.21.15.132:0/3686682418 shutdown_connections 2023-11-18T20:39:29.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.708+0000 7fd82d527640 1 -- 172.21.15.132:0/3686682418 wait complete. 2023-11-18T20:39:29.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.710+0000 7fd82d527640 1 Processor -- start 2023-11-18T20:39:29.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.710+0000 7fd82d527640 1 -- start start 2023-11-18T20:39:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82d527640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8280a4d20 0x7fd828152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82d527640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8280a5100 0x7fd8281457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82d527640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828154b40 0x7fd828070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82d527640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828152770 con 0x7fd828154b40 2023-11-18T20:39:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82d527640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828152960 con 0x7fd8280a4d20 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82d527640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd828156780 con 0x7fd8280a5100 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82cd26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828154b40 0x7fd828070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82cd26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828154b40 0x7fd828070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48888/0 (socket says 172.21.15.132:48888) 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82cd26640 1 -- 172.21.15.132:0/4234828357 learned_addr learned my addr 172.21.15.132:0/4234828357 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd827fff640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8280a4d20 0x7fd828152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82cd26640 1 -- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8280a5100 msgr2=0x7fd8281457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82cd26640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8280a5100 0x7fd8281457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82cd26640 1 -- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8280a4d20 msgr2=0x7fd828152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82cd26640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8280a4d20 0x7fd828152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.711+0000 7fd82cd26640 1 -- 172.21.15.132:0/4234828357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009a70 con 0x7fd828154b40 2023-11-18T20:39:29.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.712+0000 7fd82cd26640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828154b40 0x7fd828070be0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd820009d90 tx=0x7fd820004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:29.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.712+0000 7fd824ff9640 1 -- 172.21.15.132:0/4234828357 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820003b90 con 0x7fd828154b40 2023-11-18T20:39:29.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.712+0000 7fd824ff9640 1 -- 172.21.15.132:0/4234828357 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820003d10 con 0x7fd828154b40 2023-11-18T20:39:29.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.712+0000 7fd824ff9640 1 -- 172.21.15.132:0/4234828357 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820004270 con 0x7fd828154b40 2023-11-18T20:39:29.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.712+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8281ee030 con 0x7fd828154b40 2023-11-18T20:39:29.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.712+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd828156a40 con 0x7fd828154b40 2023-11-18T20:39:29.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.713+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82804e840 con 0x7fd828154b40 2023-11-18T20:39:29.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.714+0000 7fd824ff9640 1 -- 172.21.15.132:0/4234828357 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd82003b050 con 0x7fd828154b40 2023-11-18T20:39:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.715+0000 7fd824ff9640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd81406ae70 0x7fd81406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.715+0000 7fd824ff9640 1 -- 172.21.15.132:0/4234828357 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd8200abe90 con 0x7fd828154b40 2023-11-18T20:39:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.716+0000 7fd827fff640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd81406ae70 0x7fd81406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:29.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.717+0000 7fd827fff640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd81406ae70 0x7fd81406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd8180011e0 tx=0x7fd818009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:29.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.719+0000 7fd824ff9640 1 -- 172.21.15.132:0/4234828357 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd820076be0 con 0x7fd828154b40 2023-11-18T20:39:29.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.904+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8281562e0 con 0x7fd81406ae70 2023-11-18T20:39:29.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.943+0000 7fd824ff9640 1 -- 172.21.15.132:0/4234828357 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+524907 (secure 0 0 0) 0x7fd8281562e0 con 0x7fd81406ae70 2023-11-18T20:39:29.949 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:29.954 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd81406ae70 msgr2=0x7fd81406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd81406ae70 0x7fd81406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd8180011e0 tx=0x7fd818009040 comp rx=0 tx=0).stop 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828154b40 msgr2=0x7fd828070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828154b40 0x7fd828070be0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd820009d90 tx=0x7fd820004a40 comp rx=0 tx=0).stop 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 shutdown_connections 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd81406ae70 0x7fd81406d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828154b40 0x7fd828070be0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8280a5100 0x7fd8281457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 --2- 172.21.15.132:0/4234828357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8280a4d20 0x7fd828152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 >> 172.21.15.132:0/4234828357 conn(0x7fd8280a77f0 msgr2=0x7fd82806cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 shutdown_connections 2023-11-18T20:39:29.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:29.953+0000 7fd82d527640 1 -- 172.21.15.132:0/4234828357 wait complete. 2023-11-18T20:39:29.978 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-11-18T20:39:28.662012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225084,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749636,"statfs":{"total":773094113280,"available":772863627264,"internally_reserved":0,"allocated":4857856,"data_stored":2659166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.290700"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495110+0000","last_change":"2023-11-18T20:39:23.420773+0000","last_active":"2023-11-18T20:39:24.495110+0000","last_peered":"2023-11-18T20:39:24.495110+0000","last_clean":"2023-11-18T20:39:24.495110+0000","last_became_active":"2023-11-18T20:39:23.420497+0000","last_became_peered":"2023-11-18T20:39:23.420497+0000","last_unstale":"2023-11-18T20:39:24.495110+0000","last_undegraded":"2023-11-18T20:39:24.495110+0000","last_fullsized":"2023-11-18T20:39:24.495110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:06.573461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412009+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:23.412009+0000","last_peered":"2023-11-18T20:39:23.412009+0000","last_clean":"2023-11-18T20:39:23.412009+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:23.412009+0000","last_undegraded":"2023-11-18T20:39:23.412009+0000","last_fullsized":"2023-11-18T20:39:23.412009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414782+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:23.414782+0000","last_peered":"2023-11-18T20:39:23.414782+0000","last_clean":"2023-11-18T20:39:23.414782+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:23.414782+0000","last_undegraded":"2023-11-18T20:39:23.414782+0000","last_fullsized":"2023-11-18T20:39:23.414782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:49.505805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.391765+0000","last_change":"2023-11-18T20:39:02.760047+0000","last_active":"2023-11-18T20:39:23.391765+0000","last_peered":"2023-11-18T20:39:23.391765+0000","last_clean":"2023-11-18T20:39:23.391765+0000","last_became_active":"2023-11-18T20:39:02.759514+0000","last_became_peered":"2023-11-18T20:39:02.759514+0000","last_unstale":"2023-11-18T20:39:23.391765+0000","last_undegraded":"2023-11-18T20:39:23.391765+0000","last_fullsized":"2023-11-18T20:39:23.391765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449037+0000","last_change":"2023-11-18T20:39:22.407903+0000","last_active":"2023-11-18T20:39:23.449037+0000","last_peered":"2023-11-18T20:39:23.449037+0000","last_clean":"2023-11-18T20:39:23.449037+0000","last_became_active":"2023-11-18T20:39:22.407672+0000","last_became_peered":"2023-11-18T20:39:22.407672+0000","last_unstale":"2023-11-18T20:39:23.449037+0000","last_undegraded":"2023-11-18T20:39:23.449037+0000","last_fullsized":"2023-11-18T20:39:23.449037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:55.384588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494796+0000","last_change":"2023-11-18T20:39:23.429888+0000","last_active":"2023-11-18T20:39:24.494796+0000","last_peered":"2023-11-18T20:39:24.494796+0000","last_clean":"2023-11-18T20:39:24.494796+0000","last_became_active":"2023-11-18T20:39:23.428493+0000","last_became_peered":"2023-11-18T20:39:23.428493+0000","last_unstale":"2023-11-18T20:39:24.494796+0000","last_undegraded":"2023-11-18T20:39:24.494796+0000","last_fullsized":"2023-11-18T20:39:24.494796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.419455+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:23.419455+0000","last_peered":"2023-11-18T20:39:23.419455+0000","last_clean":"2023-11-18T20:39:23.419455+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:23.419455+0000","last_undegraded":"2023-11-18T20:39:23.419455+0000","last_fullsized":"2023-11-18T20:39:23.419455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:56.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412479+0000","last_change":"2023-11-18T20:39:02.755764+0000","last_active":"2023-11-18T20:39:23.412479+0000","last_peered":"2023-11-18T20:39:23.412479+0000","last_clean":"2023-11-18T20:39:23.412479+0000","last_became_active":"2023-11-18T20:39:02.755464+0000","last_became_peered":"2023-11-18T20:39:02.755464+0000","last_unstale":"2023-11-18T20:39:23.412479+0000","last_undegraded":"2023-11-18T20:39:23.412479+0000","last_fullsized":"2023-11-18T20:39:23.412479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:24.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407111+0000","last_change":"2023-11-18T20:39:22.406273+0000","last_active":"2023-11-18T20:39:23.407111+0000","last_peered":"2023-11-18T20:39:23.407111+0000","last_clean":"2023-11-18T20:39:23.407111+0000","last_became_active":"2023-11-18T20:39:22.405680+0000","last_became_peered":"2023-11-18T20:39:22.405680+0000","last_unstale":"2023-11-18T20:39:23.407111+0000","last_undegraded":"2023-11-18T20:39:23.407111+0000","last_fullsized":"2023-11-18T20:39:23.407111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:38.292942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419768+0000","last_change":"2023-11-18T20:39:23.427239+0000","last_active":"2023-11-18T20:39:24.419768+0000","last_peered":"2023-11-18T20:39:24.419768+0000","last_clean":"2023-11-18T20:39:24.419768+0000","last_became_active":"2023-11-18T20:39:23.426300+0000","last_became_peered":"2023-11-18T20:39:23.426300+0000","last_unstale":"2023-11-18T20:39:24.419768+0000","last_undegraded":"2023-11-18T20:39:24.419768+0000","last_fullsized":"2023-11-18T20:39:24.419768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:47:00.725680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405270+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:23.405270+0000","last_peered":"2023-11-18T20:39:23.405270+0000","last_clean":"2023-11-18T20:39:23.405270+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:23.405270+0000","last_undegraded":"2023-11-18T20:39:23.405270+0000","last_fullsized":"2023-11-18T20:39:23.405270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:24.984694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415529+0000","last_change":"2023-11-18T20:39:02.752804+0000","last_active":"2023-11-18T20:39:23.415529+0000","last_peered":"2023-11-18T20:39:23.415529+0000","last_clean":"2023-11-18T20:39:23.415529+0000","last_became_active":"2023-11-18T20:39:02.752203+0000","last_became_peered":"2023-11-18T20:39:02.752203+0000","last_unstale":"2023-11-18T20:39:23.415529+0000","last_undegraded":"2023-11-18T20:39:23.415529+0000","last_fullsized":"2023-11-18T20:39:23.415529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396860+0000","last_change":"2023-11-18T20:39:22.406528+0000","last_active":"2023-11-18T20:39:23.396860+0000","last_peered":"2023-11-18T20:39:23.396860+0000","last_clean":"2023-11-18T20:39:23.396860+0000","last_became_active":"2023-11-18T20:39:22.406024+0000","last_became_peered":"2023-11-18T20:39:22.406024+0000","last_unstale":"2023-11-18T20:39:23.396860+0000","last_undegraded":"2023-11-18T20:39:23.396860+0000","last_fullsized":"2023-11-18T20:39:23.396860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:18:36.439871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417717+0000","last_change":"2023-11-18T20:39:23.417467+0000","last_active":"2023-11-18T20:39:24.417717+0000","last_peered":"2023-11-18T20:39:24.417717+0000","last_clean":"2023-11-18T20:39:24.417717+0000","last_became_active":"2023-11-18T20:39:23.417144+0000","last_became_peered":"2023-11-18T20:39:23.417144+0000","last_unstale":"2023-11-18T20:39:24.417717+0000","last_undegraded":"2023-11-18T20:39:24.417717+0000","last_fullsized":"2023-11-18T20:39:24.417717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:36.617668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.400291+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:23.400291+0000","last_peered":"2023-11-18T20:39:23.400291+0000","last_clean":"2023-11-18T20:39:23.400291+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:23.400291+0000","last_undegraded":"2023-11-18T20:39:23.400291+0000","last_fullsized":"2023-11-18T20:39:23.400291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:30.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413890+0000","last_change":"2023-11-18T20:39:02.748674+0000","last_active":"2023-11-18T20:39:23.413890+0000","last_peered":"2023-11-18T20:39:23.413890+0000","last_clean":"2023-11-18T20:39:23.413890+0000","last_became_active":"2023-11-18T20:39:02.748033+0000","last_became_peered":"2023-11-18T20:39:02.748033+0000","last_unstale":"2023-11-18T20:39:23.413890+0000","last_undegraded":"2023-11-18T20:39:23.413890+0000","last_fullsized":"2023-11-18T20:39:23.413890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:31.017030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405800+0000","last_change":"2023-11-18T20:39:22.409054+0000","last_active":"2023-11-18T20:39:23.405800+0000","last_peered":"2023-11-18T20:39:23.405800+0000","last_clean":"2023-11-18T20:39:23.405800+0000","last_became_active":"2023-11-18T20:39:22.408725+0000","last_became_peered":"2023-11-18T20:39:22.408725+0000","last_unstale":"2023-11-18T20:39:23.405800+0000","last_undegraded":"2023-11-18T20:39:23.405800+0000","last_fullsized":"2023-11-18T20:39:23.405800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:53.412441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492146+0000","last_change":"2023-11-18T20:39:23.443088+0000","last_active":"2023-11-18T20:39:24.492146+0000","last_peered":"2023-11-18T20:39:24.492146+0000","last_clean":"2023-11-18T20:39:24.492146+0000","last_became_active":"2023-11-18T20:39:23.442820+0000","last_became_peered":"2023-11-18T20:39:23.442820+0000","last_unstale":"2023-11-18T20:39:24.492146+0000","last_undegraded":"2023-11-18T20:39:24.492146+0000","last_fullsized":"2023-11-18T20:39:24.492146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:46:15.687815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.399349+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:23.399349+0000","last_peered":"2023-11-18T20:39:23.399349+0000","last_clean":"2023-11-18T20:39:23.399349+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:23.399349+0000","last_undegraded":"2023-11-18T20:39:23.399349+0000","last_fullsized":"2023-11-18T20:39:23.399349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:01.441027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393686+0000","last_change":"2023-11-18T20:39:02.755847+0000","last_active":"2023-11-18T20:39:23.393686+0000","last_peered":"2023-11-18T20:39:23.393686+0000","last_clean":"2023-11-18T20:39:23.393686+0000","last_became_active":"2023-11-18T20:39:02.755565+0000","last_became_peered":"2023-11-18T20:39:02.755565+0000","last_unstale":"2023-11-18T20:39:23.393686+0000","last_undegraded":"2023-11-18T20:39:23.393686+0000","last_fullsized":"2023-11-18T20:39:23.393686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396472+0000","last_change":"2023-11-18T20:39:22.400862+0000","last_active":"2023-11-18T20:39:23.396472+0000","last_peered":"2023-11-18T20:39:23.396472+0000","last_clean":"2023-11-18T20:39:23.396472+0000","last_became_active":"2023-11-18T20:39:22.400584+0000","last_became_peered":"2023-11-18T20:39:22.400584+0000","last_unstale":"2023-11-18T20:39:23.396472+0000","last_undegraded":"2023-11-18T20:39:23.396472+0000","last_fullsized":"2023-11-18T20:39:23.396472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:03.815644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494568+0000","last_change":"2023-11-18T20:39:23.427290+0000","last_active":"2023-11-18T20:39:24.494568+0000","last_peered":"2023-11-18T20:39:24.494568+0000","last_clean":"2023-11-18T20:39:24.494568+0000","last_became_active":"2023-11-18T20:39:23.426945+0000","last_became_peered":"2023-11-18T20:39:23.426945+0000","last_unstale":"2023-11-18T20:39:24.494568+0000","last_undegraded":"2023-11-18T20:39:24.494568+0000","last_fullsized":"2023-11-18T20:39:24.494568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:55:10.225203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397899+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:23.397899+0000","last_peered":"2023-11-18T20:39:23.397899+0000","last_clean":"2023-11-18T20:39:23.397899+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:23.397899+0000","last_undegraded":"2023-11-18T20:39:23.397899+0000","last_fullsized":"2023-11-18T20:39:23.397899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:43.756070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413481+0000","last_change":"2023-11-18T20:39:02.766797+0000","last_active":"2023-11-18T20:39:23.413481+0000","last_peered":"2023-11-18T20:39:23.413481+0000","last_clean":"2023-11-18T20:39:23.413481+0000","last_became_active":"2023-11-18T20:39:02.766466+0000","last_became_peered":"2023-11-18T20:39:02.766466+0000","last_unstale":"2023-11-18T20:39:23.413481+0000","last_undegraded":"2023-11-18T20:39:23.413481+0000","last_fullsized":"2023-11-18T20:39:23.413481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.491100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.428827+0000","last_change":"2023-11-18T20:39:22.410942+0000","last_active":"2023-11-18T20:39:23.428827+0000","last_peered":"2023-11-18T20:39:23.428827+0000","last_clean":"2023-11-18T20:39:23.428827+0000","last_became_active":"2023-11-18T20:39:22.410660+0000","last_became_peered":"2023-11-18T20:39:22.410660+0000","last_unstale":"2023-11-18T20:39:23.428827+0000","last_undegraded":"2023-11-18T20:39:23.428827+0000","last_fullsized":"2023-11-18T20:39:23.428827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:42.926451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494430+0000","last_change":"2023-11-18T20:39:23.438792+0000","last_active":"2023-11-18T20:39:24.494430+0000","last_peered":"2023-11-18T20:39:24.494430+0000","last_clean":"2023-11-18T20:39:24.494430+0000","last_became_active":"2023-11-18T20:39:23.437752+0000","last_became_peered":"2023-11-18T20:39:23.437752+0000","last_unstale":"2023-11-18T20:39:24.494430+0000","last_undegraded":"2023-11-18T20:39:24.494430+0000","last_fullsized":"2023-11-18T20:39:24.494430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:29:36.331864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427691+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:23.427691+0000","last_peered":"2023-11-18T20:39:23.427691+0000","last_clean":"2023-11-18T20:39:23.427691+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:23.427691+0000","last_undegraded":"2023-11-18T20:39:23.427691+0000","last_fullsized":"2023-11-18T20:39:23.427691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:32.771880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406533+0000","last_change":"2023-11-18T20:39:02.760873+0000","last_active":"2023-11-18T20:39:23.406533+0000","last_peered":"2023-11-18T20:39:23.406533+0000","last_clean":"2023-11-18T20:39:23.406533+0000","last_became_active":"2023-11-18T20:39:02.759887+0000","last_became_peered":"2023-11-18T20:39:02.759887+0000","last_unstale":"2023-11-18T20:39:23.406533+0000","last_undegraded":"2023-11-18T20:39:23.406533+0000","last_fullsized":"2023-11-18T20:39:23.406533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:26.185944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412595+0000","last_change":"2023-11-18T20:39:22.411188+0000","last_active":"2023-11-18T20:39:23.412595+0000","last_peered":"2023-11-18T20:39:23.412595+0000","last_clean":"2023-11-18T20:39:23.412595+0000","last_became_active":"2023-11-18T20:39:22.410686+0000","last_became_peered":"2023-11-18T20:39:22.410686+0000","last_unstale":"2023-11-18T20:39:23.412595+0000","last_undegraded":"2023-11-18T20:39:23.412595+0000","last_fullsized":"2023-11-18T20:39:23.412595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:44.343230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421439+0000","last_change":"2023-11-18T20:39:23.432967+0000","last_active":"2023-11-18T20:39:24.421439+0000","last_peered":"2023-11-18T20:39:24.421439+0000","last_clean":"2023-11-18T20:39:24.421439+0000","last_became_active":"2023-11-18T20:39:23.432657+0000","last_became_peered":"2023-11-18T20:39:23.432657+0000","last_unstale":"2023-11-18T20:39:24.421439+0000","last_undegraded":"2023-11-18T20:39:24.421439+0000","last_fullsized":"2023-11-18T20:39:24.421439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:38.580148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398698+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:23.398698+0000","last_peered":"2023-11-18T20:39:23.398698+0000","last_clean":"2023-11-18T20:39:23.398698+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:23.398698+0000","last_undegraded":"2023-11-18T20:39:23.398698+0000","last_fullsized":"2023-11-18T20:39:23.398698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:39.869697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413300+0000","last_change":"2023-11-18T20:39:02.762642+0000","last_active":"2023-11-18T20:39:23.413300+0000","last_peered":"2023-11-18T20:39:23.413300+0000","last_clean":"2023-11-18T20:39:23.413300+0000","last_became_active":"2023-11-18T20:39:02.761245+0000","last_became_peered":"2023-11-18T20:39:02.761245+0000","last_unstale":"2023-11-18T20:39:23.413300+0000","last_undegraded":"2023-11-18T20:39:23.413300+0000","last_fullsized":"2023-11-18T20:39:23.413300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:59.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397637+0000","last_change":"2023-11-18T20:39:22.403397+0000","last_active":"2023-11-18T20:39:23.397637+0000","last_peered":"2023-11-18T20:39:23.397637+0000","last_clean":"2023-11-18T20:39:23.397637+0000","last_became_active":"2023-11-18T20:39:22.403108+0000","last_became_peered":"2023-11-18T20:39:22.403108+0000","last_unstale":"2023-11-18T20:39:23.397637+0000","last_undegraded":"2023-11-18T20:39:23.397637+0000","last_fullsized":"2023-11-18T20:39:23.397637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:00.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419824+0000","last_change":"2023-11-18T20:39:23.419397+0000","last_active":"2023-11-18T20:39:24.419824+0000","last_peered":"2023-11-18T20:39:24.419824+0000","last_clean":"2023-11-18T20:39:24.419824+0000","last_became_active":"2023-11-18T20:39:23.419142+0000","last_became_peered":"2023-11-18T20:39:23.419142+0000","last_unstale":"2023-11-18T20:39:24.419824+0000","last_undegraded":"2023-11-18T20:39:24.419824+0000","last_fullsized":"2023-11-18T20:39:24.419824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:51.592301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406992+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:23.406992+0000","last_peered":"2023-11-18T20:39:23.406992+0000","last_clean":"2023-11-18T20:39:23.406992+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:23.406992+0000","last_undegraded":"2023-11-18T20:39:23.406992+0000","last_fullsized":"2023-11-18T20:39:23.406992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:48:04.385451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411551+0000","last_change":"2023-11-18T20:39:02.769526+0000","last_active":"2023-11-18T20:39:23.411551+0000","last_peered":"2023-11-18T20:39:23.411551+0000","last_clean":"2023-11-18T20:39:23.411551+0000","last_became_active":"2023-11-18T20:39:02.767946+0000","last_became_peered":"2023-11-18T20:39:02.767946+0000","last_unstale":"2023-11-18T20:39:23.411551+0000","last_undegraded":"2023-11-18T20:39:23.411551+0000","last_fullsized":"2023-11-18T20:39:23.411551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.392639+0000","last_change":"2023-11-18T20:39:22.397295+0000","last_active":"2023-11-18T20:39:23.392639+0000","last_peered":"2023-11-18T20:39:23.392639+0000","last_clean":"2023-11-18T20:39:23.392639+0000","last_became_active":"2023-11-18T20:39:22.396777+0000","last_became_peered":"2023-11-18T20:39:22.396777+0000","last_unstale":"2023-11-18T20:39:23.392639+0000","last_undegraded":"2023-11-18T20:39:23.392639+0000","last_fullsized":"2023-11-18T20:39:23.392639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:44.041536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419400+0000","last_change":"2023-11-18T20:39:23.427589+0000","last_active":"2023-11-18T20:39:24.419400+0000","last_peered":"2023-11-18T20:39:24.419400+0000","last_clean":"2023-11-18T20:39:24.419400+0000","last_became_active":"2023-11-18T20:39:23.426763+0000","last_became_peered":"2023-11-18T20:39:23.426763+0000","last_unstale":"2023-11-18T20:39:24.419400+0000","last_undegraded":"2023-11-18T20:39:24.419400+0000","last_fullsized":"2023-11-18T20:39:24.419400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:41:24.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411644+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:23.411644+0000","last_peered":"2023-11-18T20:39:23.411644+0000","last_clean":"2023-11-18T20:39:23.411644+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:23.411644+0000","last_undegraded":"2023-11-18T20:39:23.411644+0000","last_fullsized":"2023-11-18T20:39:23.411644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.395924+0000","last_change":"2023-11-18T20:39:02.750840+0000","last_active":"2023-11-18T20:39:23.395924+0000","last_peered":"2023-11-18T20:39:23.395924+0000","last_clean":"2023-11-18T20:39:23.395924+0000","last_became_active":"2023-11-18T20:39:02.749491+0000","last_became_peered":"2023-11-18T20:39:02.749491+0000","last_unstale":"2023-11-18T20:39:23.395924+0000","last_undegraded":"2023-11-18T20:39:23.395924+0000","last_fullsized":"2023-11-18T20:39:23.395924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:27:46.865954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.446332+0000","last_change":"2023-11-18T20:39:22.396910+0000","last_active":"2023-11-18T20:39:23.446332+0000","last_peered":"2023-11-18T20:39:23.446332+0000","last_clean":"2023-11-18T20:39:23.446332+0000","last_became_active":"2023-11-18T20:39:22.396615+0000","last_became_peered":"2023-11-18T20:39:22.396615+0000","last_unstale":"2023-11-18T20:39:23.446332+0000","last_undegraded":"2023-11-18T20:39:23.446332+0000","last_fullsized":"2023-11-18T20:39:23.446332+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:22.047139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495361+0000","last_change":"2023-11-18T20:39:23.434749+0000","last_active":"2023-11-18T20:39:24.495361+0000","last_peered":"2023-11-18T20:39:24.495361+0000","last_clean":"2023-11-18T20:39:24.495361+0000","last_became_active":"2023-11-18T20:39:23.434450+0000","last_became_peered":"2023-11-18T20:39:23.434450+0000","last_unstale":"2023-11-18T20:39:24.495361+0000","last_undegraded":"2023-11-18T20:39:24.495361+0000","last_fullsized":"2023-11-18T20:39:24.495361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:41.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403561+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:23.403561+0000","last_peered":"2023-11-18T20:39:23.403561+0000","last_clean":"2023-11-18T20:39:23.403561+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:23.403561+0000","last_undegraded":"2023-11-18T20:39:23.403561+0000","last_fullsized":"2023-11-18T20:39:23.403561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.432189+0000","last_change":"2023-11-18T20:39:02.757357+0000","last_active":"2023-11-18T20:39:23.432189+0000","last_peered":"2023-11-18T20:39:23.432189+0000","last_clean":"2023-11-18T20:39:23.432189+0000","last_became_active":"2023-11-18T20:39:02.757000+0000","last_became_peered":"2023-11-18T20:39:02.757000+0000","last_unstale":"2023-11-18T20:39:23.432189+0000","last_undegraded":"2023-11-18T20:39:23.432189+0000","last_fullsized":"2023-11-18T20:39:23.432189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406421+0000","last_change":"2023-11-18T20:39:22.404704+0000","last_active":"2023-11-18T20:39:23.406421+0000","last_peered":"2023-11-18T20:39:23.406421+0000","last_clean":"2023-11-18T20:39:23.406421+0000","last_became_active":"2023-11-18T20:39:22.403768+0000","last_became_peered":"2023-11-18T20:39:22.403768+0000","last_unstale":"2023-11-18T20:39:23.406421+0000","last_undegraded":"2023-11-18T20:39:23.406421+0000","last_fullsized":"2023-11-18T20:39:23.406421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:20:23.165252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496768+0000","last_change":"2023-11-18T20:39:23.434493+0000","last_active":"2023-11-18T20:39:24.496768+0000","last_peered":"2023-11-18T20:39:24.496768+0000","last_clean":"2023-11-18T20:39:24.496768+0000","last_became_active":"2023-11-18T20:39:23.434041+0000","last_became_peered":"2023-11-18T20:39:23.434041+0000","last_unstale":"2023-11-18T20:39:24.496768+0000","last_undegraded":"2023-11-18T20:39:24.496768+0000","last_fullsized":"2023-11-18T20:39:24.496768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:23.674417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.428097+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:23.428097+0000","last_peered":"2023-11-18T20:39:23.428097+0000","last_clean":"2023-11-18T20:39:23.428097+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:23.428097+0000","last_undegraded":"2023-11-18T20:39:23.428097+0000","last_fullsized":"2023-11-18T20:39:23.428097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397015+0000","last_change":"2023-11-18T20:39:02.762298+0000","last_active":"2023-11-18T20:39:23.397015+0000","last_peered":"2023-11-18T20:39:23.397015+0000","last_clean":"2023-11-18T20:39:23.397015+0000","last_became_active":"2023-11-18T20:39:02.761752+0000","last_became_peered":"2023-11-18T20:39:02.761752+0000","last_unstale":"2023-11-18T20:39:23.397015+0000","last_undegraded":"2023-11-18T20:39:23.397015+0000","last_fullsized":"2023-11-18T20:39:23.397015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:16:15.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415731+0000","last_change":"2023-11-18T20:39:22.398043+0000","last_active":"2023-11-18T20:39:23.415731+0000","last_peered":"2023-11-18T20:39:23.415731+0000","last_clean":"2023-11-18T20:39:23.415731+0000","last_became_active":"2023-11-18T20:39:22.397732+0000","last_became_peered":"2023-11-18T20:39:22.397732+0000","last_unstale":"2023-11-18T20:39:23.415731+0000","last_undegraded":"2023-11-18T20:39:23.415731+0000","last_fullsized":"2023-11-18T20:39:23.415731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:05.560747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494710+0000","last_change":"2023-11-18T20:39:23.446473+0000","last_active":"2023-11-18T20:39:24.494710+0000","last_peered":"2023-11-18T20:39:24.494710+0000","last_clean":"2023-11-18T20:39:24.494710+0000","last_became_active":"2023-11-18T20:39:23.444958+0000","last_became_peered":"2023-11-18T20:39:23.444958+0000","last_unstale":"2023-11-18T20:39:24.494710+0000","last_undegraded":"2023-11-18T20:39:24.494710+0000","last_fullsized":"2023-11-18T20:39:24.494710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:36.401544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.392006+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:23.392006+0000","last_peered":"2023-11-18T20:39:23.392006+0000","last_clean":"2023-11-18T20:39:23.392006+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:23.392006+0000","last_undegraded":"2023-11-18T20:39:23.392006+0000","last_fullsized":"2023-11-18T20:39:23.392006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:27.505414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413223+0000","last_change":"2023-11-18T20:39:02.760383+0000","last_active":"2023-11-18T20:39:23.413223+0000","last_peered":"2023-11-18T20:39:23.413223+0000","last_clean":"2023-11-18T20:39:23.413223+0000","last_became_active":"2023-11-18T20:39:02.760126+0000","last_became_peered":"2023-11-18T20:39:02.760126+0000","last_unstale":"2023-11-18T20:39:23.413223+0000","last_undegraded":"2023-11-18T20:39:23.413223+0000","last_fullsized":"2023-11-18T20:39:23.413223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.441711+0000","last_change":"2023-11-18T20:39:22.404538+0000","last_active":"2023-11-18T20:39:23.441711+0000","last_peered":"2023-11-18T20:39:23.441711+0000","last_clean":"2023-11-18T20:39:23.441711+0000","last_became_active":"2023-11-18T20:39:22.404275+0000","last_became_peered":"2023-11-18T20:39:22.404275+0000","last_unstale":"2023-11-18T20:39:23.441711+0000","last_undegraded":"2023-11-18T20:39:23.441711+0000","last_fullsized":"2023-11-18T20:39:23.441711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:20.984416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494724+0000","last_change":"2023-11-18T20:39:23.425133+0000","last_active":"2023-11-18T20:39:24.494724+0000","last_peered":"2023-11-18T20:39:24.494724+0000","last_clean":"2023-11-18T20:39:24.494724+0000","last_became_active":"2023-11-18T20:39:23.424861+0000","last_became_peered":"2023-11-18T20:39:23.424861+0000","last_unstale":"2023-11-18T20:39:24.494724+0000","last_undegraded":"2023-11-18T20:39:24.494724+0000","last_fullsized":"2023-11-18T20:39:24.494724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:25.077001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414704+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:23.414704+0000","last_peered":"2023-11-18T20:39:23.414704+0000","last_clean":"2023-11-18T20:39:23.414704+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:23.414704+0000","last_undegraded":"2023-11-18T20:39:23.414704+0000","last_fullsized":"2023-11-18T20:39:23.414704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:41.560904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.425614+0000","last_change":"2023-11-18T20:39:02.763496+0000","last_active":"2023-11-18T20:39:23.425614+0000","last_peered":"2023-11-18T20:39:23.425614+0000","last_clean":"2023-11-18T20:39:23.425614+0000","last_became_active":"2023-11-18T20:39:02.762875+0000","last_became_peered":"2023-11-18T20:39:02.762875+0000","last_unstale":"2023-11-18T20:39:23.425614+0000","last_undegraded":"2023-11-18T20:39:23.425614+0000","last_fullsized":"2023-11-18T20:39:23.425614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.450896+0000","last_change":"2023-11-18T20:39:22.405242+0000","last_active":"2023-11-18T20:39:23.450896+0000","last_peered":"2023-11-18T20:39:23.450896+0000","last_clean":"2023-11-18T20:39:23.450896+0000","last_became_active":"2023-11-18T20:39:22.404935+0000","last_became_peered":"2023-11-18T20:39:22.404935+0000","last_unstale":"2023-11-18T20:39:23.450896+0000","last_undegraded":"2023-11-18T20:39:23.450896+0000","last_fullsized":"2023-11-18T20:39:23.450896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:35.604954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493572+0000","last_change":"2023-11-18T20:39:23.427457+0000","last_active":"2023-11-18T20:39:24.493572+0000","last_peered":"2023-11-18T20:39:24.493572+0000","last_clean":"2023-11-18T20:39:24.493572+0000","last_became_active":"2023-11-18T20:39:23.426833+0000","last_became_peered":"2023-11-18T20:39:23.426833+0000","last_unstale":"2023-11-18T20:39:24.493572+0000","last_undegraded":"2023-11-18T20:39:24.493572+0000","last_fullsized":"2023-11-18T20:39:24.493572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:05.551712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405886+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:23.405886+0000","last_peered":"2023-11-18T20:39:23.405886+0000","last_clean":"2023-11-18T20:39:23.405886+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:23.405886+0000","last_undegraded":"2023-11-18T20:39:23.405886+0000","last_fullsized":"2023-11-18T20:39:23.405886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415095+0000","last_change":"2023-11-18T20:39:02.765789+0000","last_active":"2023-11-18T20:39:23.415095+0000","last_peered":"2023-11-18T20:39:23.415095+0000","last_clean":"2023-11-18T20:39:23.415095+0000","last_became_active":"2023-11-18T20:39:02.764984+0000","last_became_peered":"2023-11-18T20:39:02.764984+0000","last_unstale":"2023-11-18T20:39:23.415095+0000","last_undegraded":"2023-11-18T20:39:23.415095+0000","last_fullsized":"2023-11-18T20:39:23.415095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397152+0000","last_change":"2023-11-18T20:39:22.403628+0000","last_active":"2023-11-18T20:39:23.397152+0000","last_peered":"2023-11-18T20:39:23.397152+0000","last_clean":"2023-11-18T20:39:23.397152+0000","last_became_active":"2023-11-18T20:39:22.401145+0000","last_became_peered":"2023-11-18T20:39:22.401145+0000","last_unstale":"2023-11-18T20:39:23.397152+0000","last_undegraded":"2023-11-18T20:39:23.397152+0000","last_fullsized":"2023-11-18T20:39:23.397152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:55.116379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419133+0000","last_change":"2023-11-18T20:39:23.439752+0000","last_active":"2023-11-18T20:39:24.419133+0000","last_peered":"2023-11-18T20:39:24.419133+0000","last_clean":"2023-11-18T20:39:24.419133+0000","last_became_active":"2023-11-18T20:39:23.439379+0000","last_became_peered":"2023-11-18T20:39:23.439379+0000","last_unstale":"2023-11-18T20:39:24.419133+0000","last_undegraded":"2023-11-18T20:39:24.419133+0000","last_fullsized":"2023-11-18T20:39:24.419133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:06.573461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.416613+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:23.416613+0000","last_peered":"2023-11-18T20:39:23.416613+0000","last_clean":"2023-11-18T20:39:23.416613+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:23.416613+0000","last_undegraded":"2023-11-18T20:39:23.416613+0000","last_fullsized":"2023-11-18T20:39:23.416613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407607+0000","last_change":"2023-11-18T20:39:02.773440+0000","last_active":"2023-11-18T20:39:23.407607+0000","last_peered":"2023-11-18T20:39:23.407607+0000","last_clean":"2023-11-18T20:39:23.407607+0000","last_became_active":"2023-11-18T20:39:02.773133+0000","last_became_peered":"2023-11-18T20:39:02.773133+0000","last_unstale":"2023-11-18T20:39:23.407607+0000","last_undegraded":"2023-11-18T20:39:23.407607+0000","last_fullsized":"2023-11-18T20:39:23.407607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:02.899681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.448335+0000","last_change":"2023-11-18T20:39:22.398608+0000","last_active":"2023-11-18T20:39:23.448335+0000","last_peered":"2023-11-18T20:39:23.448335+0000","last_clean":"2023-11-18T20:39:23.448335+0000","last_became_active":"2023-11-18T20:39:22.398282+0000","last_became_peered":"2023-11-18T20:39:22.398282+0000","last_unstale":"2023-11-18T20:39:23.448335+0000","last_undegraded":"2023-11-18T20:39:23.448335+0000","last_fullsized":"2023-11-18T20:39:23.448335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:24:07.788841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493728+0000","last_change":"2023-11-18T20:39:23.429471+0000","last_active":"2023-11-18T20:39:24.493728+0000","last_peered":"2023-11-18T20:39:24.493728+0000","last_clean":"2023-11-18T20:39:24.493728+0000","last_became_active":"2023-11-18T20:39:23.425105+0000","last_became_peered":"2023-11-18T20:39:23.425105+0000","last_unstale":"2023-11-18T20:39:24.493728+0000","last_undegraded":"2023-11-18T20:39:24.493728+0000","last_fullsized":"2023-11-18T20:39:24.493728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:05.551712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412061+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:23.412061+0000","last_peered":"2023-11-18T20:39:23.412061+0000","last_clean":"2023-11-18T20:39:23.412061+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:23.412061+0000","last_undegraded":"2023-11-18T20:39:23.412061+0000","last_fullsized":"2023-11-18T20:39:23.412061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412378+0000","last_change":"2023-11-18T20:39:02.777823+0000","last_active":"2023-11-18T20:39:23.412378+0000","last_peered":"2023-11-18T20:39:23.412378+0000","last_clean":"2023-11-18T20:39:23.412378+0000","last_became_active":"2023-11-18T20:39:02.777456+0000","last_became_peered":"2023-11-18T20:39:02.777456+0000","last_unstale":"2023-11-18T20:39:23.412378+0000","last_undegraded":"2023-11-18T20:39:23.412378+0000","last_fullsized":"2023-11-18T20:39:23.412378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:44.618827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393472+0000","last_change":"2023-11-18T20:39:22.402262+0000","last_active":"2023-11-18T20:39:23.393472+0000","last_peered":"2023-11-18T20:39:23.393472+0000","last_clean":"2023-11-18T20:39:23.393472+0000","last_became_active":"2023-11-18T20:39:22.401944+0000","last_became_peered":"2023-11-18T20:39:22.401944+0000","last_unstale":"2023-11-18T20:39:23.393472+0000","last_undegraded":"2023-11-18T20:39:23.393472+0000","last_fullsized":"2023-11-18T20:39:23.393472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:39.434602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492720+0000","last_change":"2023-11-18T20:39:23.444095+0000","last_active":"2023-11-18T20:39:24.492720+0000","last_peered":"2023-11-18T20:39:24.492720+0000","last_clean":"2023-11-18T20:39:24.492720+0000","last_became_active":"2023-11-18T20:39:23.443826+0000","last_became_peered":"2023-11-18T20:39:23.443826+0000","last_unstale":"2023-11-18T20:39:24.492720+0000","last_undegraded":"2023-11-18T20:39:24.492720+0000","last_fullsized":"2023-11-18T20:39:24.492720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:58.405497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415943+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:23.415943+0000","last_peered":"2023-11-18T20:39:23.415943+0000","last_clean":"2023-11-18T20:39:23.415943+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:23.415943+0000","last_undegraded":"2023-11-18T20:39:23.415943+0000","last_fullsized":"2023-11-18T20:39:23.415943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:52:57.711383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403600+0000","last_change":"2023-11-18T20:39:02.767695+0000","last_active":"2023-11-18T20:39:23.403600+0000","last_peered":"2023-11-18T20:39:23.403600+0000","last_clean":"2023-11-18T20:39:23.403600+0000","last_became_active":"2023-11-18T20:39:02.765964+0000","last_became_peered":"2023-11-18T20:39:02.765964+0000","last_unstale":"2023-11-18T20:39:23.403600+0000","last_undegraded":"2023-11-18T20:39:23.403600+0000","last_fullsized":"2023-11-18T20:39:23.403600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449118+0000","last_change":"2023-11-18T20:39:22.406580+0000","last_active":"2023-11-18T20:39:23.449118+0000","last_peered":"2023-11-18T20:39:23.449118+0000","last_clean":"2023-11-18T20:39:23.449118+0000","last_became_active":"2023-11-18T20:39:22.405573+0000","last_became_peered":"2023-11-18T20:39:22.405573+0000","last_unstale":"2023-11-18T20:39:23.449118+0000","last_undegraded":"2023-11-18T20:39:23.449118+0000","last_fullsized":"2023-11-18T20:39:23.449118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:46:14.675100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417717+0000","last_change":"2023-11-18T20:39:23.418507+0000","last_active":"2023-11-18T20:39:24.417717+0000","last_peered":"2023-11-18T20:39:24.417717+0000","last_clean":"2023-11-18T20:39:24.417717+0000","last_became_active":"2023-11-18T20:39:23.418209+0000","last_became_peered":"2023-11-18T20:39:23.418209+0000","last_unstale":"2023-11-18T20:39:24.417717+0000","last_undegraded":"2023-11-18T20:39:24.417717+0000","last_fullsized":"2023-11-18T20:39:24.417717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:43.939166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414749+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:23.414749+0000","last_peered":"2023-11-18T20:39:23.414749+0000","last_clean":"2023-11-18T20:39:23.414749+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:23.414749+0000","last_undegraded":"2023-11-18T20:39:23.414749+0000","last_fullsized":"2023-11-18T20:39:23.414749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413806+0000","last_change":"2023-11-18T20:39:02.748892+0000","last_active":"2023-11-18T20:39:23.413806+0000","last_peered":"2023-11-18T20:39:23.413806+0000","last_clean":"2023-11-18T20:39:23.413806+0000","last_became_active":"2023-11-18T20:39:02.748392+0000","last_became_peered":"2023-11-18T20:39:02.748392+0000","last_unstale":"2023-11-18T20:39:23.413806+0000","last_undegraded":"2023-11-18T20:39:23.413806+0000","last_fullsized":"2023-11-18T20:39:23.413806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:18.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449318+0000","last_change":"2023-11-18T20:39:22.383835+0000","last_active":"2023-11-18T20:39:23.449318+0000","last_peered":"2023-11-18T20:39:23.449318+0000","last_clean":"2023-11-18T20:39:23.449318+0000","last_became_active":"2023-11-18T20:39:22.383055+0000","last_became_peered":"2023-11-18T20:39:22.383055+0000","last_unstale":"2023-11-18T20:39:23.449318+0000","last_undegraded":"2023-11-18T20:39:23.449318+0000","last_fullsized":"2023-11-18T20:39:23.449318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:05.923006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493264+0000","last_change":"2023-11-18T20:39:23.434794+0000","last_active":"2023-11-18T20:39:24.493264+0000","last_peered":"2023-11-18T20:39:24.493264+0000","last_clean":"2023-11-18T20:39:24.493264+0000","last_became_active":"2023-11-18T20:39:23.434508+0000","last_became_peered":"2023-11-18T20:39:23.434508+0000","last_unstale":"2023-11-18T20:39:24.493264+0000","last_undegraded":"2023-11-18T20:39:24.493264+0000","last_fullsized":"2023-11-18T20:39:24.493264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:38.915609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404337+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:23.404337+0000","last_peered":"2023-11-18T20:39:23.404337+0000","last_clean":"2023-11-18T20:39:23.404337+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:23.404337+0000","last_undegraded":"2023-11-18T20:39:23.404337+0000","last_fullsized":"2023-11-18T20:39:23.404337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396780+0000","last_change":"2023-11-18T20:39:02.755872+0000","last_active":"2023-11-18T20:39:23.396780+0000","last_peered":"2023-11-18T20:39:23.396780+0000","last_clean":"2023-11-18T20:39:23.396780+0000","last_became_active":"2023-11-18T20:39:02.755415+0000","last_became_peered":"2023-11-18T20:39:02.755415+0000","last_unstale":"2023-11-18T20:39:23.396780+0000","last_undegraded":"2023-11-18T20:39:23.396780+0000","last_fullsized":"2023-11-18T20:39:23.396780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:08.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.395696+0000","last_change":"2023-11-18T20:39:22.403667+0000","last_active":"2023-11-18T20:39:23.395696+0000","last_peered":"2023-11-18T20:39:23.395696+0000","last_clean":"2023-11-18T20:39:23.395696+0000","last_became_active":"2023-11-18T20:39:22.402205+0000","last_became_peered":"2023-11-18T20:39:22.402205+0000","last_unstale":"2023-11-18T20:39:23.395696+0000","last_undegraded":"2023-11-18T20:39:23.395696+0000","last_fullsized":"2023-11-18T20:39:23.395696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:17:50.919163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494419+0000","last_change":"2023-11-18T20:39:23.422652+0000","last_active":"2023-11-18T20:39:24.494419+0000","last_peered":"2023-11-18T20:39:24.494419+0000","last_clean":"2023-11-18T20:39:24.494419+0000","last_became_active":"2023-11-18T20:39:23.420660+0000","last_became_peered":"2023-11-18T20:39:23.420660+0000","last_unstale":"2023-11-18T20:39:24.494419+0000","last_undegraded":"2023-11-18T20:39:24.494419+0000","last_fullsized":"2023-11-18T20:39:24.494419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'8","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397812+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:23.397812+0000","last_peered":"2023-11-18T20:39:23.397812+0000","last_clean":"2023-11-18T20:39:23.397812+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:23.397812+0000","last_undegraded":"2023-11-18T20:39:23.397812+0000","last_fullsized":"2023-11-18T20:39:23.397812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:26.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414434+0000","last_change":"2023-11-18T20:39:02.774185+0000","last_active":"2023-11-18T20:39:23.414434+0000","last_peered":"2023-11-18T20:39:23.414434+0000","last_clean":"2023-11-18T20:39:23.414434+0000","last_became_active":"2023-11-18T20:39:02.773865+0000","last_became_peered":"2023-11-18T20:39:02.773865+0000","last_unstale":"2023-11-18T20:39:23.414434+0000","last_undegraded":"2023-11-18T20:39:23.414434+0000","last_fullsized":"2023-11-18T20:39:23.414434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:29.774288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422277+0000","last_change":"2023-11-18T20:39:22.399738+0000","last_active":"2023-11-18T20:39:23.422277+0000","last_peered":"2023-11-18T20:39:23.422277+0000","last_clean":"2023-11-18T20:39:23.422277+0000","last_became_active":"2023-11-18T20:39:22.399456+0000","last_became_peered":"2023-11-18T20:39:22.399456+0000","last_unstale":"2023-11-18T20:39:23.422277+0000","last_undegraded":"2023-11-18T20:39:23.422277+0000","last_fullsized":"2023-11-18T20:39:23.422277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:41.606873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494888+0000","last_change":"2023-11-18T20:39:23.434431+0000","last_active":"2023-11-18T20:39:24.494888+0000","last_peered":"2023-11-18T20:39:24.494888+0000","last_clean":"2023-11-18T20:39:24.494888+0000","last_became_active":"2023-11-18T20:39:23.433510+0000","last_became_peered":"2023-11-18T20:39:23.433510+0000","last_unstale":"2023-11-18T20:39:24.494888+0000","last_undegraded":"2023-11-18T20:39:24.494888+0000","last_fullsized":"2023-11-18T20:39:24.494888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:36.401544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414524+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:23.414524+0000","last_peered":"2023-11-18T20:39:23.414524+0000","last_clean":"2023-11-18T20:39:23.414524+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:23.414524+0000","last_undegraded":"2023-11-18T20:39:23.414524+0000","last_fullsized":"2023-11-18T20:39:23.414524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:25.771785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422233+0000","last_change":"2023-11-18T20:39:02.753904+0000","last_active":"2023-11-18T20:39:23.422233+0000","last_peered":"2023-11-18T20:39:23.422233+0000","last_clean":"2023-11-18T20:39:23.422233+0000","last_became_active":"2023-11-18T20:39:02.753415+0000","last_became_peered":"2023-11-18T20:39:02.753415+0000","last_unstale":"2023-11-18T20:39:23.422233+0000","last_undegraded":"2023-11-18T20:39:23.422233+0000","last_fullsized":"2023-11-18T20:39:23.422233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414852+0000","last_change":"2023-11-18T20:39:22.398779+0000","last_active":"2023-11-18T20:39:23.414852+0000","last_peered":"2023-11-18T20:39:23.414852+0000","last_clean":"2023-11-18T20:39:23.414852+0000","last_became_active":"2023-11-18T20:39:22.398477+0000","last_became_peered":"2023-11-18T20:39:22.398477+0000","last_unstale":"2023-11-18T20:39:23.414852+0000","last_undegraded":"2023-11-18T20:39:23.414852+0000","last_fullsized":"2023-11-18T20:39:23.414852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:31:02.989486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494145+0000","last_change":"2023-11-18T20:39:23.438807+0000","last_active":"2023-11-18T20:39:24.494145+0000","last_peered":"2023-11-18T20:39:24.494145+0000","last_clean":"2023-11-18T20:39:24.494145+0000","last_became_active":"2023-11-18T20:39:23.438271+0000","last_became_peered":"2023-11-18T20:39:23.438271+0000","last_unstale":"2023-11-18T20:39:24.494145+0000","last_undegraded":"2023-11-18T20:39:24.494145+0000","last_fullsized":"2023-11-18T20:39:24.494145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:53:48.228541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427598+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:23.427598+0000","last_peered":"2023-11-18T20:39:23.427598+0000","last_clean":"2023-11-18T20:39:23.427598+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:23.427598+0000","last_undegraded":"2023-11-18T20:39:23.427598+0000","last_fullsized":"2023-11-18T20:39:23.427598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427187+0000","last_change":"2023-11-18T20:39:02.763642+0000","last_active":"2023-11-18T20:39:23.427187+0000","last_peered":"2023-11-18T20:39:23.427187+0000","last_clean":"2023-11-18T20:39:23.427187+0000","last_became_active":"2023-11-18T20:39:02.763357+0000","last_became_peered":"2023-11-18T20:39:02.763357+0000","last_unstale":"2023-11-18T20:39:23.427187+0000","last_undegraded":"2023-11-18T20:39:23.427187+0000","last_fullsized":"2023-11-18T20:39:23.427187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:04.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.452282+0000","last_change":"2023-11-18T20:39:22.398742+0000","last_active":"2023-11-18T20:39:23.452282+0000","last_peered":"2023-11-18T20:39:23.452282+0000","last_clean":"2023-11-18T20:39:23.452282+0000","last_became_active":"2023-11-18T20:39:22.397880+0000","last_became_peered":"2023-11-18T20:39:22.397880+0000","last_unstale":"2023-11-18T20:39:23.452282+0000","last_undegraded":"2023-11-18T20:39:23.452282+0000","last_fullsized":"2023-11-18T20:39:23.452282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:40.332897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.497129+0000","last_change":"2023-11-18T20:39:23.446378+0000","last_active":"2023-11-18T20:39:24.497129+0000","last_peered":"2023-11-18T20:39:24.497129+0000","last_clean":"2023-11-18T20:39:24.497129+0000","last_became_active":"2023-11-18T20:39:23.445327+0000","last_became_peered":"2023-11-18T20:39:23.445327+0000","last_unstale":"2023-11-18T20:39:24.497129+0000","last_undegraded":"2023-11-18T20:39:24.497129+0000","last_fullsized":"2023-11-18T20:39:24.497129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:03.443291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.432067+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:23.432067+0000","last_peered":"2023-11-18T20:39:23.432067+0000","last_clean":"2023-11-18T20:39:23.432067+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:23.432067+0000","last_undegraded":"2023-11-18T20:39:23.432067+0000","last_fullsized":"2023-11-18T20:39:23.432067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.109348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407326+0000","last_change":"2023-11-18T20:39:02.759699+0000","last_active":"2023-11-18T20:39:23.407326+0000","last_peered":"2023-11-18T20:39:23.407326+0000","last_clean":"2023-11-18T20:39:23.407326+0000","last_became_active":"2023-11-18T20:39:02.759410+0000","last_became_peered":"2023-11-18T20:39:02.759410+0000","last_unstale":"2023-11-18T20:39:23.407326+0000","last_undegraded":"2023-11-18T20:39:23.407326+0000","last_fullsized":"2023-11-18T20:39:23.407326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:52:49.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.436190+0000","last_change":"2023-11-18T20:39:22.393343+0000","last_active":"2023-11-18T20:39:23.436190+0000","last_peered":"2023-11-18T20:39:23.436190+0000","last_clean":"2023-11-18T20:39:23.436190+0000","last_became_active":"2023-11-18T20:39:22.392729+0000","last_became_peered":"2023-11-18T20:39:22.392729+0000","last_unstale":"2023-11-18T20:39:23.436190+0000","last_undegraded":"2023-11-18T20:39:23.436190+0000","last_fullsized":"2023-11-18T20:39:23.436190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:18.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421141+0000","last_change":"2023-11-18T20:39:23.447500+0000","last_active":"2023-11-18T20:39:24.421141+0000","last_peered":"2023-11-18T20:39:24.421141+0000","last_clean":"2023-11-18T20:39:24.421141+0000","last_became_active":"2023-11-18T20:39:23.447118+0000","last_became_peered":"2023-11-18T20:39:23.447118+0000","last_unstale":"2023-11-18T20:39:24.421141+0000","last_undegraded":"2023-11-18T20:39:24.421141+0000","last_fullsized":"2023-11-18T20:39:24.421141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:23.674417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403828+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:23.403828+0000","last_peered":"2023-11-18T20:39:23.403828+0000","last_clean":"2023-11-18T20:39:23.403828+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:23.403828+0000","last_undegraded":"2023-11-18T20:39:23.403828+0000","last_fullsized":"2023-11-18T20:39:23.403828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415861+0000","last_change":"2023-11-18T20:39:02.770693+0000","last_active":"2023-11-18T20:39:23.415861+0000","last_peered":"2023-11-18T20:39:23.415861+0000","last_clean":"2023-11-18T20:39:23.415861+0000","last_became_active":"2023-11-18T20:39:02.766515+0000","last_became_peered":"2023-11-18T20:39:02.766515+0000","last_unstale":"2023-11-18T20:39:23.415861+0000","last_undegraded":"2023-11-18T20:39:23.415861+0000","last_fullsized":"2023-11-18T20:39:23.415861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447319+0000","last_change":"2023-11-18T20:39:22.402398+0000","last_active":"2023-11-18T20:39:23.447319+0000","last_peered":"2023-11-18T20:39:23.447319+0000","last_clean":"2023-11-18T20:39:23.447319+0000","last_became_active":"2023-11-18T20:39:22.401355+0000","last_became_peered":"2023-11-18T20:39:22.401355+0000","last_unstale":"2023-11-18T20:39:23.447319+0000","last_undegraded":"2023-11-18T20:39:23.447319+0000","last_fullsized":"2023-11-18T20:39:23.447319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:39:09.138913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492614+0000","last_change":"2023-11-18T20:39:23.420099+0000","last_active":"2023-11-18T20:39:24.492614+0000","last_peered":"2023-11-18T20:39:24.492614+0000","last_clean":"2023-11-18T20:39:24.492614+0000","last_became_active":"2023-11-18T20:39:23.418883+0000","last_became_peered":"2023-11-18T20:39:23.418883+0000","last_unstale":"2023-11-18T20:39:24.492614+0000","last_undegraded":"2023-11-18T20:39:24.492614+0000","last_fullsized":"2023-11-18T20:39:24.492614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:29:19.381062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413271+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:23.413271+0000","last_peered":"2023-11-18T20:39:23.413271+0000","last_clean":"2023-11-18T20:39:23.413271+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:23.413271+0000","last_undegraded":"2023-11-18T20:39:23.413271+0000","last_fullsized":"2023-11-18T20:39:23.413271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411822+0000","last_change":"2023-11-18T20:39:02.772323+0000","last_active":"2023-11-18T20:39:23.411822+0000","last_peered":"2023-11-18T20:39:23.411822+0000","last_clean":"2023-11-18T20:39:23.411822+0000","last_became_active":"2023-11-18T20:39:02.771746+0000","last_became_peered":"2023-11-18T20:39:02.771746+0000","last_unstale":"2023-11-18T20:39:23.411822+0000","last_undegraded":"2023-11-18T20:39:23.411822+0000","last_fullsized":"2023-11-18T20:39:23.411822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:51.574371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.442222+0000","last_change":"2023-11-18T20:39:22.401734+0000","last_active":"2023-11-18T20:39:23.442222+0000","last_peered":"2023-11-18T20:39:23.442222+0000","last_clean":"2023-11-18T20:39:23.442222+0000","last_became_active":"2023-11-18T20:39:22.398776+0000","last_became_peered":"2023-11-18T20:39:22.398776+0000","last_unstale":"2023-11-18T20:39:23.442222+0000","last_undegraded":"2023-11-18T20:39:23.442222+0000","last_fullsized":"2023-11-18T20:39:23.442222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:42.979247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492749+0000","last_change":"2023-11-18T20:39:23.428158+0000","last_active":"2023-11-18T20:39:24.492749+0000","last_peered":"2023-11-18T20:39:24.492749+0000","last_clean":"2023-11-18T20:39:24.492749+0000","last_became_active":"2023-11-18T20:39:23.427875+0000","last_became_peered":"2023-11-18T20:39:23.427875+0000","last_unstale":"2023-11-18T20:39:24.492749+0000","last_undegraded":"2023-11-18T20:39:24.492749+0000","last_fullsized":"2023-11-18T20:39:24.492749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:41:28.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403425+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:23.403425+0000","last_peered":"2023-11-18T20:39:23.403425+0000","last_clean":"2023-11-18T20:39:23.403425+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:23.403425+0000","last_undegraded":"2023-11-18T20:39:23.403425+0000","last_fullsized":"2023-11-18T20:39:23.403425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:47.442387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404066+0000","last_change":"2023-11-18T20:39:02.754613+0000","last_active":"2023-11-18T20:39:23.404066+0000","last_peered":"2023-11-18T20:39:23.404066+0000","last_clean":"2023-11-18T20:39:23.404066+0000","last_became_active":"2023-11-18T20:39:02.754350+0000","last_became_peered":"2023-11-18T20:39:02.754350+0000","last_unstale":"2023-11-18T20:39:23.404066+0000","last_undegraded":"2023-11-18T20:39:23.404066+0000","last_fullsized":"2023-11-18T20:39:23.404066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415693+0000","last_change":"2023-11-18T20:39:22.406251+0000","last_active":"2023-11-18T20:39:23.415693+0000","last_peered":"2023-11-18T20:39:23.415693+0000","last_clean":"2023-11-18T20:39:23.415693+0000","last_became_active":"2023-11-18T20:39:22.405901+0000","last_became_peered":"2023-11-18T20:39:22.405901+0000","last_unstale":"2023-11-18T20:39:23.415693+0000","last_undegraded":"2023-11-18T20:39:23.415693+0000","last_fullsized":"2023-11-18T20:39:23.415693+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:47.004453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418917+0000","last_change":"2023-11-18T20:39:23.430972+0000","last_active":"2023-11-18T20:39:24.418917+0000","last_peered":"2023-11-18T20:39:24.418917+0000","last_clean":"2023-11-18T20:39:24.418917+0000","last_became_active":"2023-11-18T20:39:23.430684+0000","last_became_peered":"2023-11-18T20:39:23.430684+0000","last_unstale":"2023-11-18T20:39:24.418917+0000","last_undegraded":"2023-11-18T20:39:24.418917+0000","last_fullsized":"2023-11-18T20:39:24.418917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:41:54.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404200+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:23.404200+0000","last_peered":"2023-11-18T20:39:23.404200+0000","last_clean":"2023-11-18T20:39:23.404200+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:23.404200+0000","last_undegraded":"2023-11-18T20:39:23.404200+0000","last_fullsized":"2023-11-18T20:39:23.404200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413690+0000","last_change":"2023-11-18T20:39:02.774591+0000","last_active":"2023-11-18T20:39:23.413690+0000","last_peered":"2023-11-18T20:39:23.413690+0000","last_clean":"2023-11-18T20:39:23.413690+0000","last_became_active":"2023-11-18T20:39:02.774338+0000","last_became_peered":"2023-11-18T20:39:02.774338+0000","last_unstale":"2023-11-18T20:39:23.413690+0000","last_undegraded":"2023-11-18T20:39:23.413690+0000","last_fullsized":"2023-11-18T20:39:23.413690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:32.560325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398471+0000","last_change":"2023-11-18T20:39:22.406308+0000","last_active":"2023-11-18T20:39:23.398471+0000","last_peered":"2023-11-18T20:39:23.398471+0000","last_clean":"2023-11-18T20:39:23.398471+0000","last_became_active":"2023-11-18T20:39:22.405980+0000","last_became_peered":"2023-11-18T20:39:22.405980+0000","last_unstale":"2023-11-18T20:39:23.398471+0000","last_undegraded":"2023-11-18T20:39:23.398471+0000","last_fullsized":"2023-11-18T20:39:23.398471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:48.566281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496412+0000","last_change":"2023-11-18T20:39:23.423726+0000","last_active":"2023-11-18T20:39:24.496412+0000","last_peered":"2023-11-18T20:39:24.496412+0000","last_clean":"2023-11-18T20:39:24.496412+0000","last_became_active":"2023-11-18T20:39:23.423431+0000","last_became_peered":"2023-11-18T20:39:23.423431+0000","last_unstale":"2023-11-18T20:39:24.496412+0000","last_undegraded":"2023-11-18T20:39:24.496412+0000","last_fullsized":"2023-11-18T20:39:24.496412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447164+0000","last_change":"2023-11-18T20:39:22.399160+0000","last_active":"2023-11-18T20:39:23.447164+0000","last_peered":"2023-11-18T20:39:23.447164+0000","last_clean":"2023-11-18T20:39:23.447164+0000","last_became_active":"2023-11-18T20:39:22.397086+0000","last_became_peered":"2023-11-18T20:39:22.397086+0000","last_unstale":"2023-11-18T20:39:23.447164+0000","last_undegraded":"2023-11-18T20:39:23.447164+0000","last_fullsized":"2023-11-18T20:39:23.447164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:31.506417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422373+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:23.422373+0000","last_peered":"2023-11-18T20:39:23.422373+0000","last_clean":"2023-11-18T20:39:23.422373+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:23.422373+0000","last_undegraded":"2023-11-18T20:39:23.422373+0000","last_fullsized":"2023-11-18T20:39:23.422373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415204+0000","last_change":"2023-11-18T20:39:02.758817+0000","last_active":"2023-11-18T20:39:23.415204+0000","last_peered":"2023-11-18T20:39:23.415204+0000","last_clean":"2023-11-18T20:39:23.415204+0000","last_became_active":"2023-11-18T20:39:02.758440+0000","last_became_peered":"2023-11-18T20:39:02.758440+0000","last_unstale":"2023-11-18T20:39:23.415204+0000","last_undegraded":"2023-11-18T20:39:23.415204+0000","last_fullsized":"2023-11-18T20:39:23.415204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494320+0000","last_change":"2023-11-18T20:39:23.440848+0000","last_active":"2023-11-18T20:39:24.494320+0000","last_peered":"2023-11-18T20:39:24.494320+0000","last_clean":"2023-11-18T20:39:24.494320+0000","last_became_active":"2023-11-18T20:39:23.440178+0000","last_became_peered":"2023-11-18T20:39:23.440178+0000","last_unstale":"2023-11-18T20:39:24.494320+0000","last_undegraded":"2023-11-18T20:39:24.494320+0000","last_fullsized":"2023-11-18T20:39:24.494320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.442140+0000","last_change":"2023-11-18T20:39:22.399945+0000","last_active":"2023-11-18T20:39:23.442140+0000","last_peered":"2023-11-18T20:39:23.442140+0000","last_clean":"2023-11-18T20:39:23.442140+0000","last_became_active":"2023-11-18T20:39:22.399644+0000","last_became_peered":"2023-11-18T20:39:22.399644+0000","last_unstale":"2023-11-18T20:39:23.442140+0000","last_undegraded":"2023-11-18T20:39:23.442140+0000","last_fullsized":"2023-11-18T20:39:23.442140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:20.630662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413693+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:23.413693+0000","last_peered":"2023-11-18T20:39:23.413693+0000","last_clean":"2023-11-18T20:39:23.413693+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:23.413693+0000","last_undegraded":"2023-11-18T20:39:23.413693+0000","last_fullsized":"2023-11-18T20:39:23.413693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404234+0000","last_change":"2023-11-18T20:39:02.751638+0000","last_active":"2023-11-18T20:39:23.404234+0000","last_peered":"2023-11-18T20:39:23.404234+0000","last_clean":"2023-11-18T20:39:23.404234+0000","last_became_active":"2023-11-18T20:39:02.751330+0000","last_became_peered":"2023-11-18T20:39:02.751330+0000","last_unstale":"2023-11-18T20:39:23.404234+0000","last_undegraded":"2023-11-18T20:39:23.404234+0000","last_fullsized":"2023-11-18T20:39:23.404234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495418+0000","last_change":"2023-11-18T20:39:23.426282+0000","last_active":"2023-11-18T20:39:24.495418+0000","last_peered":"2023-11-18T20:39:24.495418+0000","last_clean":"2023-11-18T20:39:24.495418+0000","last_became_active":"2023-11-18T20:39:23.426011+0000","last_became_peered":"2023-11-18T20:39:23.426011+0000","last_unstale":"2023-11-18T20:39:24.495418+0000","last_undegraded":"2023-11-18T20:39:24.495418+0000","last_fullsized":"2023-11-18T20:39:24.495418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:42.619588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422645+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:23.422645+0000","last_peered":"2023-11-18T20:39:23.422645+0000","last_clean":"2023-11-18T20:39:23.422645+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:23.422645+0000","last_undegraded":"2023-11-18T20:39:23.422645+0000","last_fullsized":"2023-11-18T20:39:23.422645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405311+0000","last_change":"2023-11-18T20:39:02.761289+0000","last_active":"2023-11-18T20:39:23.405311+0000","last_peered":"2023-11-18T20:39:23.405311+0000","last_clean":"2023-11-18T20:39:23.405311+0000","last_became_active":"2023-11-18T20:39:02.760948+0000","last_became_peered":"2023-11-18T20:39:02.760948+0000","last_unstale":"2023-11-18T20:39:23.405311+0000","last_undegraded":"2023-11-18T20:39:23.405311+0000","last_fullsized":"2023-11-18T20:39:23.405311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447327+0000","last_change":"2023-11-18T20:39:22.400658+0000","last_active":"2023-11-18T20:39:23.447327+0000","last_peered":"2023-11-18T20:39:23.447327+0000","last_clean":"2023-11-18T20:39:23.447327+0000","last_became_active":"2023-11-18T20:39:22.399324+0000","last_became_peered":"2023-11-18T20:39:22.399324+0000","last_unstale":"2023-11-18T20:39:23.447327+0000","last_undegraded":"2023-11-18T20:39:23.447327+0000","last_fullsized":"2023-11-18T20:39:23.447327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:22.449238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418745+0000","last_change":"2023-11-18T20:39:23.432727+0000","last_active":"2023-11-18T20:39:24.418745+0000","last_peered":"2023-11-18T20:39:24.418745+0000","last_clean":"2023-11-18T20:39:24.418745+0000","last_became_active":"2023-11-18T20:39:23.432461+0000","last_became_peered":"2023-11-18T20:39:23.432461+0000","last_unstale":"2023-11-18T20:39:24.418745+0000","last_undegraded":"2023-11-18T20:39:24.418745+0000","last_fullsized":"2023-11-18T20:39:24.418745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406905+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:23.406905+0000","last_peered":"2023-11-18T20:39:23.406905+0000","last_clean":"2023-11-18T20:39:23.406905+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:23.406905+0000","last_undegraded":"2023-11-18T20:39:23.406905+0000","last_fullsized":"2023-11-18T20:39:23.406905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:00.564472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397605+0000","last_change":"2023-11-18T20:39:02.761380+0000","last_active":"2023-11-18T20:39:23.397605+0000","last_peered":"2023-11-18T20:39:23.397605+0000","last_clean":"2023-11-18T20:39:23.397605+0000","last_became_active":"2023-11-18T20:39:02.760958+0000","last_became_peered":"2023-11-18T20:39:02.760958+0000","last_unstale":"2023-11-18T20:39:23.397605+0000","last_undegraded":"2023-11-18T20:39:23.397605+0000","last_fullsized":"2023-11-18T20:39:23.397605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:25.114138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.438778+0000","last_change":"2023-11-18T20:39:22.400634+0000","last_active":"2023-11-18T20:39:23.438778+0000","last_peered":"2023-11-18T20:39:23.438778+0000","last_clean":"2023-11-18T20:39:23.438778+0000","last_became_active":"2023-11-18T20:39:22.399955+0000","last_became_peered":"2023-11-18T20:39:22.399955+0000","last_unstale":"2023-11-18T20:39:23.438778+0000","last_undegraded":"2023-11-18T20:39:23.438778+0000","last_fullsized":"2023-11-18T20:39:23.438778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:21.205034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417953+0000","last_change":"2023-11-18T20:39:23.419745+0000","last_active":"2023-11-18T20:39:24.417953+0000","last_peered":"2023-11-18T20:39:24.417953+0000","last_clean":"2023-11-18T20:39:24.417953+0000","last_became_active":"2023-11-18T20:39:23.419381+0000","last_became_peered":"2023-11-18T20:39:23.419381+0000","last_unstale":"2023-11-18T20:39:24.417953+0000","last_undegraded":"2023-11-18T20:39:24.417953+0000","last_fullsized":"2023-11-18T20:39:24.417953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406778+0000","last_change":"2023-11-18T20:39:02.764472+0000","last_active":"2023-11-18T20:39:23.406778+0000","last_peered":"2023-11-18T20:39:23.406778+0000","last_clean":"2023-11-18T20:39:23.406778+0000","last_became_active":"2023-11-18T20:39:02.764087+0000","last_became_peered":"2023-11-18T20:39:02.764087+0000","last_unstale":"2023-11-18T20:39:23.406778+0000","last_undegraded":"2023-11-18T20:39:23.406778+0000","last_fullsized":"2023-11-18T20:39:23.406778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:00.994479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495181+0000","last_change":"2023-11-18T20:39:23.428059+0000","last_active":"2023-11-18T20:39:24.495181+0000","last_peered":"2023-11-18T20:39:24.495181+0000","last_clean":"2023-11-18T20:39:24.495181+0000","last_became_active":"2023-11-18T20:39:23.427465+0000","last_became_peered":"2023-11-18T20:39:23.427465+0000","last_unstale":"2023-11-18T20:39:24.495181+0000","last_undegraded":"2023-11-18T20:39:24.495181+0000","last_fullsized":"2023-11-18T20:39:24.495181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:36.617668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405159+0000","last_change":"2023-11-18T20:39:02.767291+0000","last_active":"2023-11-18T20:39:23.405159+0000","last_peered":"2023-11-18T20:39:23.405159+0000","last_clean":"2023-11-18T20:39:23.405159+0000","last_became_active":"2023-11-18T20:39:02.764390+0000","last_became_peered":"2023-11-18T20:39:02.764390+0000","last_unstale":"2023-11-18T20:39:23.405159+0000","last_undegraded":"2023-11-18T20:39:23.405159+0000","last_fullsized":"2023-11-18T20:39:23.405159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496394+0000","last_change":"2023-11-18T20:39:23.432917+0000","last_active":"2023-11-18T20:39:24.496394+0000","last_peered":"2023-11-18T20:39:24.496394+0000","last_clean":"2023-11-18T20:39:24.496394+0000","last_became_active":"2023-11-18T20:39:23.428767+0000","last_became_peered":"2023-11-18T20:39:23.428767+0000","last_unstale":"2023-11-18T20:39:24.496394+0000","last_undegraded":"2023-11-18T20:39:24.496394+0000","last_fullsized":"2023-11-18T20:39:24.496394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:41:24.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393169+0000","last_change":"2023-11-18T20:39:02.758480+0000","last_active":"2023-11-18T20:39:23.393169+0000","last_peered":"2023-11-18T20:39:23.393169+0000","last_clean":"2023-11-18T20:39:23.393169+0000","last_became_active":"2023-11-18T20:39:02.752070+0000","last_became_peered":"2023-11-18T20:39:02.752070+0000","last_unstale":"2023-11-18T20:39:23.393169+0000","last_undegraded":"2023-11-18T20:39:23.393169+0000","last_fullsized":"2023-11-18T20:39:23.393169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417985+0000","last_change":"2023-11-18T20:39:23.409355+0000","last_active":"2023-11-18T20:39:24.417985+0000","last_peered":"2023-11-18T20:39:24.417985+0000","last_clean":"2023-11-18T20:39:24.417985+0000","last_became_active":"2023-11-18T20:39:23.408604+0000","last_became_peered":"2023-11-18T20:39:23.408604+0000","last_unstale":"2023-11-18T20:39:24.417985+0000","last_undegraded":"2023-11-18T20:39:24.417985+0000","last_fullsized":"2023-11-18T20:39:24.417985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:05.267724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397065+0000","last_change":"2023-11-18T20:39:02.772625+0000","last_active":"2023-11-18T20:39:23.397065+0000","last_peered":"2023-11-18T20:39:23.397065+0000","last_clean":"2023-11-18T20:39:23.397065+0000","last_became_active":"2023-11-18T20:39:02.772348+0000","last_became_peered":"2023-11-18T20:39:02.772348+0000","last_unstale":"2023-11-18T20:39:23.397065+0000","last_undegraded":"2023-11-18T20:39:23.397065+0000","last_fullsized":"2023-11-18T20:39:23.397065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495555+0000","last_change":"2023-11-18T20:39:23.438347+0000","last_active":"2023-11-18T20:39:24.495555+0000","last_peered":"2023-11-18T20:39:24.495555+0000","last_clean":"2023-11-18T20:39:24.495555+0000","last_became_active":"2023-11-18T20:39:23.438076+0000","last_became_peered":"2023-11-18T20:39:23.438076+0000","last_unstale":"2023-11-18T20:39:24.495555+0000","last_undegraded":"2023-11-18T20:39:24.495555+0000","last_fullsized":"2023-11-18T20:39:24.495555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:41:54.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403234+0000","last_change":"2023-11-18T20:39:02.746609+0000","last_active":"2023-11-18T20:39:23.403234+0000","last_peered":"2023-11-18T20:39:23.403234+0000","last_clean":"2023-11-18T20:39:23.403234+0000","last_became_active":"2023-11-18T20:39:02.746324+0000","last_became_peered":"2023-11-18T20:39:02.746324+0000","last_unstale":"2023-11-18T20:39:23.403234+0000","last_undegraded":"2023-11-18T20:39:23.403234+0000","last_fullsized":"2023-11-18T20:39:23.403234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496548+0000","last_change":"2023-11-18T20:39:23.415863+0000","last_active":"2023-11-18T20:39:24.496548+0000","last_peered":"2023-11-18T20:39:24.496548+0000","last_clean":"2023-11-18T20:39:24.496548+0000","last_became_active":"2023-11-18T20:39:23.415576+0000","last_became_peered":"2023-11-18T20:39:23.415576+0000","last_unstale":"2023-11-18T20:39:24.496548+0000","last_undegraded":"2023-11-18T20:39:24.496548+0000","last_fullsized":"2023-11-18T20:39:24.496548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.426612+0000","last_change":"2023-11-18T20:39:02.775796+0000","last_active":"2023-11-18T20:39:23.426612+0000","last_peered":"2023-11-18T20:39:23.426612+0000","last_clean":"2023-11-18T20:39:23.426612+0000","last_became_active":"2023-11-18T20:39:02.775503+0000","last_became_peered":"2023-11-18T20:39:02.775503+0000","last_unstale":"2023-11-18T20:39:23.426612+0000","last_undegraded":"2023-11-18T20:39:23.426612+0000","last_fullsized":"2023-11-18T20:39:23.426612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493649+0000","last_change":"2023-11-18T20:39:23.422077+0000","last_active":"2023-11-18T20:39:24.493649+0000","last_peered":"2023-11-18T20:39:24.493649+0000","last_clean":"2023-11-18T20:39:24.493649+0000","last_became_active":"2023-11-18T20:39:23.418009+0000","last_became_peered":"2023-11-18T20:39:23.418009+0000","last_unstale":"2023-11-18T20:39:24.493649+0000","last_undegraded":"2023-11-18T20:39:24.493649+0000","last_fullsized":"2023-11-18T20:39:24.493649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:52.188384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422553+0000","last_change":"2023-11-18T20:39:02.774172+0000","last_active":"2023-11-18T20:39:23.422553+0000","last_peered":"2023-11-18T20:39:23.422553+0000","last_clean":"2023-11-18T20:39:23.422553+0000","last_became_active":"2023-11-18T20:39:02.773141+0000","last_became_peered":"2023-11-18T20:39:02.773141+0000","last_unstale":"2023-11-18T20:39:23.422553+0000","last_undegraded":"2023-11-18T20:39:23.422553+0000","last_fullsized":"2023-11-18T20:39:23.422553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:59:44.902815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494155+0000","last_change":"2023-11-18T20:39:23.421675+0000","last_active":"2023-11-18T20:39:24.494155+0000","last_peered":"2023-11-18T20:39:24.494155+0000","last_clean":"2023-11-18T20:39:24.494155+0000","last_became_active":"2023-11-18T20:39:23.421357+0000","last_became_peered":"2023-11-18T20:39:23.421357+0000","last_unstale":"2023-11-18T20:39:24.494155+0000","last_undegraded":"2023-11-18T20:39:24.494155+0000","last_fullsized":"2023-11-18T20:39:24.494155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:39.994594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427100+0000","last_change":"2023-11-18T20:39:02.772030+0000","last_active":"2023-11-18T20:39:23.427100+0000","last_peered":"2023-11-18T20:39:23.427100+0000","last_clean":"2023-11-18T20:39:23.427100+0000","last_became_active":"2023-11-18T20:39:02.771761+0000","last_became_peered":"2023-11-18T20:39:02.771761+0000","last_unstale":"2023-11-18T20:39:23.427100+0000","last_undegraded":"2023-11-18T20:39:23.427100+0000","last_fullsized":"2023-11-18T20:39:23.427100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493562+0000","last_change":"2023-11-18T20:39:23.429421+0000","last_active":"2023-11-18T20:39:24.493562+0000","last_peered":"2023-11-18T20:39:24.493562+0000","last_clean":"2023-11-18T20:39:24.493562+0000","last_became_active":"2023-11-18T20:39:23.428260+0000","last_became_peered":"2023-11-18T20:39:23.428260+0000","last_unstale":"2023-11-18T20:39:24.493562+0000","last_undegraded":"2023-11-18T20:39:24.493562+0000","last_fullsized":"2023-11-18T20:39:24.493562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:51.665927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403335+0000","last_change":"2023-11-18T20:39:02.752133+0000","last_active":"2023-11-18T20:39:23.403335+0000","last_peered":"2023-11-18T20:39:23.403335+0000","last_clean":"2023-11-18T20:39:23.403335+0000","last_became_active":"2023-11-18T20:39:02.751863+0000","last_became_peered":"2023-11-18T20:39:02.751863+0000","last_unstale":"2023-11-18T20:39:23.403335+0000","last_undegraded":"2023-11-18T20:39:23.403335+0000","last_fullsized":"2023-11-18T20:39:23.403335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:56.070643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495148+0000","last_change":"2023-11-18T20:39:23.430072+0000","last_active":"2023-11-18T20:39:24.495148+0000","last_peered":"2023-11-18T20:39:24.495148+0000","last_clean":"2023-11-18T20:39:24.495148+0000","last_became_active":"2023-11-18T20:39:23.428918+0000","last_became_peered":"2023-11-18T20:39:23.428918+0000","last_unstale":"2023-11-18T20:39:24.495148+0000","last_undegraded":"2023-11-18T20:39:24.495148+0000","last_fullsized":"2023-11-18T20:39:24.495148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:37.811641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396600+0000","last_change":"2023-11-18T20:39:02.758024+0000","last_active":"2023-11-18T20:39:23.396600+0000","last_peered":"2023-11-18T20:39:23.396600+0000","last_clean":"2023-11-18T20:39:23.396600+0000","last_became_active":"2023-11-18T20:39:02.757737+0000","last_became_peered":"2023-11-18T20:39:02.757737+0000","last_unstale":"2023-11-18T20:39:23.396600+0000","last_undegraded":"2023-11-18T20:39:23.396600+0000","last_fullsized":"2023-11-18T20:39:23.396600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:42:50.023528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418187+0000","last_change":"2023-11-18T20:39:23.430247+0000","last_active":"2023-11-18T20:39:24.418187+0000","last_peered":"2023-11-18T20:39:24.418187+0000","last_clean":"2023-11-18T20:39:24.418187+0000","last_became_active":"2023-11-18T20:39:23.429408+0000","last_became_peered":"2023-11-18T20:39:23.429408+0000","last_unstale":"2023-11-18T20:39:24.418187+0000","last_undegraded":"2023-11-18T20:39:24.418187+0000","last_fullsized":"2023-11-18T20:39:24.418187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.402903+0000","last_change":"2023-11-18T20:39:02.752211+0000","last_active":"2023-11-18T20:39:23.402903+0000","last_peered":"2023-11-18T20:39:23.402903+0000","last_clean":"2023-11-18T20:39:23.402903+0000","last_became_active":"2023-11-18T20:39:02.751940+0000","last_became_peered":"2023-11-18T20:39:02.751940+0000","last_unstale":"2023-11-18T20:39:23.402903+0000","last_undegraded":"2023-11-18T20:39:23.402903+0000","last_fullsized":"2023-11-18T20:39:23.402903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492406+0000","last_change":"2023-11-18T20:39:23.420764+0000","last_active":"2023-11-18T20:39:24.492406+0000","last_peered":"2023-11-18T20:39:24.492406+0000","last_clean":"2023-11-18T20:39:24.492406+0000","last_became_active":"2023-11-18T20:39:23.420487+0000","last_became_peered":"2023-11-18T20:39:23.420487+0000","last_unstale":"2023-11-18T20:39:24.492406+0000","last_undegraded":"2023-11-18T20:39:24.492406+0000","last_fullsized":"2023-11-18T20:39:24.492406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:37:49.228681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397207+0000","last_change":"2023-11-18T20:39:02.758393+0000","last_active":"2023-11-18T20:39:23.397207+0000","last_peered":"2023-11-18T20:39:23.397207+0000","last_clean":"2023-11-18T20:39:23.397207+0000","last_became_active":"2023-11-18T20:39:02.752864+0000","last_became_peered":"2023-11-18T20:39:02.752864+0000","last_unstale":"2023-11-18T20:39:23.397207+0000","last_undegraded":"2023-11-18T20:39:23.397207+0000","last_fullsized":"2023-11-18T20:39:23.397207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494808+0000","last_change":"2023-11-18T20:39:23.441180+0000","last_active":"2023-11-18T20:39:24.494808+0000","last_peered":"2023-11-18T20:39:24.494808+0000","last_clean":"2023-11-18T20:39:24.494808+0000","last_became_active":"2023-11-18T20:39:23.440877+0000","last_became_peered":"2023-11-18T20:39:23.440877+0000","last_unstale":"2023-11-18T20:39:24.494808+0000","last_undegraded":"2023-11-18T20:39:24.494808+0000","last_fullsized":"2023-11-18T20:39:24.494808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:51.665927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397681+0000","last_change":"2023-11-18T20:39:02.769220+0000","last_active":"2023-11-18T20:39:23.397681+0000","last_peered":"2023-11-18T20:39:23.397681+0000","last_clean":"2023-11-18T20:39:23.397681+0000","last_became_active":"2023-11-18T20:39:02.762271+0000","last_became_peered":"2023-11-18T20:39:02.762271+0000","last_unstale":"2023-11-18T20:39:23.397681+0000","last_undegraded":"2023-11-18T20:39:23.397681+0000","last_fullsized":"2023-11-18T20:39:23.397681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:37.501746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418640+0000","last_change":"2023-11-18T20:39:23.405475+0000","last_active":"2023-11-18T20:39:24.418640+0000","last_peered":"2023-11-18T20:39:24.418640+0000","last_clean":"2023-11-18T20:39:24.418640+0000","last_became_active":"2023-11-18T20:39:23.404710+0000","last_became_peered":"2023-11-18T20:39:23.404710+0000","last_unstale":"2023-11-18T20:39:24.418640+0000","last_undegraded":"2023-11-18T20:39:24.418640+0000","last_fullsized":"2023-11-18T20:39:24.418640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413035+0000","last_change":"2023-11-18T20:39:02.759862+0000","last_active":"2023-11-18T20:39:23.413035+0000","last_peered":"2023-11-18T20:39:23.413035+0000","last_clean":"2023-11-18T20:39:23.413035+0000","last_became_active":"2023-11-18T20:39:02.759565+0000","last_became_peered":"2023-11-18T20:39:02.759565+0000","last_unstale":"2023-11-18T20:39:23.413035+0000","last_undegraded":"2023-11-18T20:39:23.413035+0000","last_fullsized":"2023-11-18T20:39:23.413035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421837+0000","last_change":"2023-11-18T20:39:23.441932+0000","last_active":"2023-11-18T20:39:24.421837+0000","last_peered":"2023-11-18T20:39:24.421837+0000","last_clean":"2023-11-18T20:39:24.421837+0000","last_became_active":"2023-11-18T20:39:23.441592+0000","last_became_peered":"2023-11-18T20:39:23.441592+0000","last_unstale":"2023-11-18T20:39:24.421837+0000","last_undegraded":"2023-11-18T20:39:24.421837+0000","last_fullsized":"2023-11-18T20:39:24.421837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:03.443291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413198+0000","last_change":"2023-11-18T20:39:02.755514+0000","last_active":"2023-11-18T20:39:23.413198+0000","last_peered":"2023-11-18T20:39:23.413198+0000","last_clean":"2023-11-18T20:39:23.413198+0000","last_became_active":"2023-11-18T20:39:02.755083+0000","last_became_peered":"2023-11-18T20:39:02.755083+0000","last_unstale":"2023-11-18T20:39:23.413198+0000","last_undegraded":"2023-11-18T20:39:23.413198+0000","last_fullsized":"2023-11-18T20:39:23.413198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:57.948105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495760+0000","last_change":"2023-11-18T20:39:23.416569+0000","last_active":"2023-11-18T20:39:24.495760+0000","last_peered":"2023-11-18T20:39:24.495760+0000","last_clean":"2023-11-18T20:39:24.495760+0000","last_became_active":"2023-11-18T20:39:23.415936+0000","last_became_peered":"2023-11-18T20:39:23.415936+0000","last_unstale":"2023-11-18T20:39:24.495760+0000","last_undegraded":"2023-11-18T20:39:24.495760+0000","last_fullsized":"2023-11-18T20:39:24.495760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406407+0000","last_change":"2023-11-18T20:39:02.766551+0000","last_active":"2023-11-18T20:39:23.406407+0000","last_peered":"2023-11-18T20:39:23.406407+0000","last_clean":"2023-11-18T20:39:23.406407+0000","last_became_active":"2023-11-18T20:39:02.765528+0000","last_became_peered":"2023-11-18T20:39:02.765528+0000","last_unstale":"2023-11-18T20:39:23.406407+0000","last_undegraded":"2023-11-18T20:39:23.406407+0000","last_fullsized":"2023-11-18T20:39:23.406407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:30.943404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494313+0000","last_change":"2023-11-18T20:39:23.440738+0000","last_active":"2023-11-18T20:39:24.494313+0000","last_peered":"2023-11-18T20:39:24.494313+0000","last_clean":"2023-11-18T20:39:24.494313+0000","last_became_active":"2023-11-18T20:39:23.438183+0000","last_became_peered":"2023-11-18T20:39:23.438183+0000","last_unstale":"2023-11-18T20:39:24.494313+0000","last_undegraded":"2023-11-18T20:39:24.494313+0000","last_fullsized":"2023-11-18T20:39:24.494313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.391162+0000","last_change":"2023-11-18T20:39:02.759711+0000","last_active":"2023-11-18T20:39:23.391162+0000","last_peered":"2023-11-18T20:39:23.391162+0000","last_clean":"2023-11-18T20:39:23.391162+0000","last_became_active":"2023-11-18T20:39:02.759422+0000","last_became_peered":"2023-11-18T20:39:02.759422+0000","last_unstale":"2023-11-18T20:39:23.391162+0000","last_undegraded":"2023-11-18T20:39:23.391162+0000","last_fullsized":"2023-11-18T20:39:23.391162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418433+0000","last_change":"2023-11-18T20:39:23.435850+0000","last_active":"2023-11-18T20:39:24.418433+0000","last_peered":"2023-11-18T20:39:24.418433+0000","last_clean":"2023-11-18T20:39:24.418433+0000","last_became_active":"2023-11-18T20:39:23.435565+0000","last_became_peered":"2023-11-18T20:39:23.435565+0000","last_unstale":"2023-11-18T20:39:24.418433+0000","last_undegraded":"2023-11-18T20:39:24.418433+0000","last_fullsized":"2023-11-18T20:39:24.418433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:50.423185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393591+0000","last_change":"2023-11-18T20:39:02.750962+0000","last_active":"2023-11-18T20:39:23.393591+0000","last_peered":"2023-11-18T20:39:23.393591+0000","last_clean":"2023-11-18T20:39:23.393591+0000","last_became_active":"2023-11-18T20:39:02.750695+0000","last_became_peered":"2023-11-18T20:39:02.750695+0000","last_unstale":"2023-11-18T20:39:23.393591+0000","last_undegraded":"2023-11-18T20:39:23.393591+0000","last_fullsized":"2023-11-18T20:39:23.393591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.490966+0000","last_change":"2023-11-18T20:39:23.438134+0000","last_active":"2023-11-18T20:39:24.490966+0000","last_peered":"2023-11-18T20:39:24.490966+0000","last_clean":"2023-11-18T20:39:24.490966+0000","last_became_active":"2023-11-18T20:39:23.437851+0000","last_became_peered":"2023-11-18T20:39:23.437851+0000","last_unstale":"2023-11-18T20:39:24.490966+0000","last_undegraded":"2023-11-18T20:39:24.490966+0000","last_fullsized":"2023-11-18T20:39:24.490966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:30:34.308551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414661+0000","last_change":"2023-11-18T20:39:02.766121+0000","last_active":"2023-11-18T20:39:23.414661+0000","last_peered":"2023-11-18T20:39:23.414661+0000","last_clean":"2023-11-18T20:39:23.414661+0000","last_became_active":"2023-11-18T20:39:02.765807+0000","last_became_peered":"2023-11-18T20:39:02.765807+0000","last_unstale":"2023-11-18T20:39:23.414661+0000","last_undegraded":"2023-11-18T20:39:23.414661+0000","last_fullsized":"2023-11-18T20:39:23.414661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:15.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494142+0000","last_change":"2023-11-18T20:39:23.432185+0000","last_active":"2023-11-18T20:39:24.494142+0000","last_peered":"2023-11-18T20:39:24.494142+0000","last_clean":"2023-11-18T20:39:24.494142+0000","last_became_active":"2023-11-18T20:39:23.431390+0000","last_became_peered":"2023-11-18T20:39:23.431390+0000","last_unstale":"2023-11-18T20:39:24.494142+0000","last_undegraded":"2023-11-18T20:39:24.494142+0000","last_fullsized":"2023-11-18T20:39:24.494142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398310+0000","last_change":"2023-11-18T20:39:02.748415+0000","last_active":"2023-11-18T20:39:23.398310+0000","last_peered":"2023-11-18T20:39:23.398310+0000","last_clean":"2023-11-18T20:39:23.398310+0000","last_became_active":"2023-11-18T20:39:02.748123+0000","last_became_peered":"2023-11-18T20:39:02.748123+0000","last_unstale":"2023-11-18T20:39:23.398310+0000","last_undegraded":"2023-11-18T20:39:23.398310+0000","last_fullsized":"2023-11-18T20:39:23.398310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:36:58.122129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.422209+0000","last_change":"2023-11-18T20:39:23.431236+0000","last_active":"2023-11-18T20:39:24.422209+0000","last_peered":"2023-11-18T20:39:24.422209+0000","last_clean":"2023-11-18T20:39:24.422209+0000","last_became_active":"2023-11-18T20:39:23.430987+0000","last_became_peered":"2023-11-18T20:39:23.430987+0000","last_unstale":"2023-11-18T20:39:24.422209+0000","last_undegraded":"2023-11-18T20:39:24.422209+0000","last_fullsized":"2023-11-18T20:39:24.422209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:17.043049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414330+0000","last_change":"2023-11-18T20:39:02.756659+0000","last_active":"2023-11-18T20:39:23.414330+0000","last_peered":"2023-11-18T20:39:23.414330+0000","last_clean":"2023-11-18T20:39:23.414330+0000","last_became_active":"2023-11-18T20:39:02.756336+0000","last_became_peered":"2023-11-18T20:39:02.756336+0000","last_unstale":"2023-11-18T20:39:23.414330+0000","last_undegraded":"2023-11-18T20:39:23.414330+0000","last_fullsized":"2023-11-18T20:39:23.414330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:14.460811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419345+0000","last_change":"2023-11-18T20:39:23.442964+0000","last_active":"2023-11-18T20:39:24.419345+0000","last_peered":"2023-11-18T20:39:24.419345+0000","last_clean":"2023-11-18T20:39:24.419345+0000","last_became_active":"2023-11-18T20:39:23.442713+0000","last_became_peered":"2023-11-18T20:39:23.442713+0000","last_unstale":"2023-11-18T20:39:24.419345+0000","last_undegraded":"2023-11-18T20:39:24.419345+0000","last_fullsized":"2023-11-18T20:39:24.419345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:09.956411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414611+0000","last_change":"2023-11-18T20:39:02.773954+0000","last_active":"2023-11-18T20:39:23.414611+0000","last_peered":"2023-11-18T20:39:23.414611+0000","last_clean":"2023-11-18T20:39:23.414611+0000","last_became_active":"2023-11-18T20:39:02.773686+0000","last_became_peered":"2023-11-18T20:39:02.773686+0000","last_unstale":"2023-11-18T20:39:23.414611+0000","last_undegraded":"2023-11-18T20:39:23.414611+0000","last_fullsized":"2023-11-18T20:39:23.414611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:54.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419559+0000","last_change":"2023-11-18T20:39:23.421271+0000","last_active":"2023-11-18T20:39:24.419559+0000","last_peered":"2023-11-18T20:39:24.419559+0000","last_clean":"2023-11-18T20:39:24.419559+0000","last_became_active":"2023-11-18T20:39:23.421029+0000","last_became_peered":"2023-11-18T20:39:23.421029+0000","last_unstale":"2023-11-18T20:39:24.419559+0000","last_undegraded":"2023-11-18T20:39:24.419559+0000","last_fullsized":"2023-11-18T20:39:24.419559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:41.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422456+0000","last_change":"2023-11-18T20:39:02.764804+0000","last_active":"2023-11-18T20:39:23.422456+0000","last_peered":"2023-11-18T20:39:23.422456+0000","last_clean":"2023-11-18T20:39:23.422456+0000","last_became_active":"2023-11-18T20:39:02.764574+0000","last_became_peered":"2023-11-18T20:39:02.764574+0000","last_unstale":"2023-11-18T20:39:23.422456+0000","last_undegraded":"2023-11-18T20:39:23.422456+0000","last_fullsized":"2023-11-18T20:39:23.422456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494986+0000","last_change":"2023-11-18T20:39:23.439973+0000","last_active":"2023-11-18T20:39:24.494986+0000","last_peered":"2023-11-18T20:39:24.494986+0000","last_clean":"2023-11-18T20:39:24.494986+0000","last_became_active":"2023-11-18T20:39:23.439707+0000","last_became_peered":"2023-11-18T20:39:23.439707+0000","last_unstale":"2023-11-18T20:39:24.494986+0000","last_undegraded":"2023-11-18T20:39:24.494986+0000","last_fullsized":"2023-11-18T20:39:24.494986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415013+0000","last_change":"2023-11-18T20:39:02.775795+0000","last_active":"2023-11-18T20:39:23.415013+0000","last_peered":"2023-11-18T20:39:23.415013+0000","last_clean":"2023-11-18T20:39:23.415013+0000","last_became_active":"2023-11-18T20:39:02.775493+0000","last_became_peered":"2023-11-18T20:39:02.775493+0000","last_unstale":"2023-11-18T20:39:23.415013+0000","last_undegraded":"2023-11-18T20:39:23.415013+0000","last_fullsized":"2023-11-18T20:39:23.415013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418411+0000","last_change":"2023-11-18T20:39:23.432535+0000","last_active":"2023-11-18T20:39:24.418411+0000","last_peered":"2023-11-18T20:39:24.418411+0000","last_clean":"2023-11-18T20:39:24.418411+0000","last_became_active":"2023-11-18T20:39:23.432225+0000","last_became_peered":"2023-11-18T20:39:23.432225+0000","last_unstale":"2023-11-18T20:39:24.418411+0000","last_undegraded":"2023-11-18T20:39:24.418411+0000","last_fullsized":"2023-11-18T20:39:24.418411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:44.726874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403097+0000","last_change":"2023-11-18T20:39:02.744529+0000","last_active":"2023-11-18T20:39:23.403097+0000","last_peered":"2023-11-18T20:39:23.403097+0000","last_clean":"2023-11-18T20:39:23.403097+0000","last_became_active":"2023-11-18T20:39:02.744056+0000","last_became_peered":"2023-11-18T20:39:02.744056+0000","last_unstale":"2023-11-18T20:39:23.403097+0000","last_undegraded":"2023-11-18T20:39:23.403097+0000","last_fullsized":"2023-11-18T20:39:23.403097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:28.509793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492875+0000","last_change":"2023-11-18T20:39:23.409578+0000","last_active":"2023-11-18T20:39:24.492875+0000","last_peered":"2023-11-18T20:39:24.492875+0000","last_clean":"2023-11-18T20:39:24.492875+0000","last_became_active":"2023-11-18T20:39:23.409313+0000","last_became_peered":"2023-11-18T20:39:23.409313+0000","last_unstale":"2023-11-18T20:39:24.492875+0000","last_undegraded":"2023-11-18T20:39:24.492875+0000","last_fullsized":"2023-11-18T20:39:24.492875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:43.939166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405062+0000","last_change":"2023-11-18T20:39:02.767101+0000","last_active":"2023-11-18T20:39:23.405062+0000","last_peered":"2023-11-18T20:39:23.405062+0000","last_clean":"2023-11-18T20:39:23.405062+0000","last_became_active":"2023-11-18T20:39:02.764500+0000","last_became_peered":"2023-11-18T20:39:02.764500+0000","last_unstale":"2023-11-18T20:39:23.405062+0000","last_undegraded":"2023-11-18T20:39:23.405062+0000","last_fullsized":"2023-11-18T20:39:23.405062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496180+0000","last_change":"2023-11-18T20:39:23.425628+0000","last_active":"2023-11-18T20:39:24.496180+0000","last_peered":"2023-11-18T20:39:24.496180+0000","last_clean":"2023-11-18T20:39:24.496180+0000","last_became_active":"2023-11-18T20:39:23.425145+0000","last_became_peered":"2023-11-18T20:39:23.425145+0000","last_unstale":"2023-11-18T20:39:24.496180+0000","last_undegraded":"2023-11-18T20:39:24.496180+0000","last_fullsized":"2023-11-18T20:39:24.496180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:47:00.725680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413802+0000","last_change":"2023-11-18T20:39:02.755127+0000","last_active":"2023-11-18T20:39:23.413802+0000","last_peered":"2023-11-18T20:39:23.413802+0000","last_clean":"2023-11-18T20:39:23.413802+0000","last_became_active":"2023-11-18T20:39:02.754791+0000","last_became_peered":"2023-11-18T20:39:02.754791+0000","last_unstale":"2023-11-18T20:39:23.413802+0000","last_undegraded":"2023-11-18T20:39:23.413802+0000","last_fullsized":"2023-11-18T20:39:23.413802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.491424+0000","last_change":"2023-11-18T20:39:23.425893+0000","last_active":"2023-11-18T20:39:24.491424+0000","last_peered":"2023-11-18T20:39:24.491424+0000","last_clean":"2023-11-18T20:39:24.491424+0000","last_became_active":"2023-11-18T20:39:23.425362+0000","last_became_peered":"2023-11-18T20:39:23.425362+0000","last_unstale":"2023-11-18T20:39:24.491424+0000","last_undegraded":"2023-11-18T20:39:24.491424+0000","last_fullsized":"2023-11-18T20:39:24.491424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:50:54.388639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427940+0000","last_change":"2023-11-18T20:39:02.757930+0000","last_active":"2023-11-18T20:39:23.427940+0000","last_peered":"2023-11-18T20:39:23.427940+0000","last_clean":"2023-11-18T20:39:23.427940+0000","last_became_active":"2023-11-18T20:39:02.757463+0000","last_became_peered":"2023-11-18T20:39:02.757463+0000","last_unstale":"2023-11-18T20:39:23.427940+0000","last_undegraded":"2023-11-18T20:39:23.427940+0000","last_fullsized":"2023-11-18T20:39:23.427940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419320+0000","last_change":"2023-11-18T20:39:23.435438+0000","last_active":"2023-11-18T20:39:24.419320+0000","last_peered":"2023-11-18T20:39:24.419320+0000","last_clean":"2023-11-18T20:39:24.419320+0000","last_became_active":"2023-11-18T20:39:23.435003+0000","last_became_peered":"2023-11-18T20:39:23.435003+0000","last_unstale":"2023-11-18T20:39:24.419320+0000","last_undegraded":"2023-11-18T20:39:24.419320+0000","last_fullsized":"2023-11-18T20:39:24.419320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:37.811641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422139+0000","last_change":"2023-11-18T20:39:02.752584+0000","last_active":"2023-11-18T20:39:23.422139+0000","last_peered":"2023-11-18T20:39:23.422139+0000","last_clean":"2023-11-18T20:39:23.422139+0000","last_became_active":"2023-11-18T20:39:02.752259+0000","last_became_peered":"2023-11-18T20:39:02.752259+0000","last_unstale":"2023-11-18T20:39:23.422139+0000","last_undegraded":"2023-11-18T20:39:23.422139+0000","last_fullsized":"2023-11-18T20:39:23.422139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496316+0000","last_change":"2023-11-18T20:39:23.413254+0000","last_active":"2023-11-18T20:39:24.496316+0000","last_peered":"2023-11-18T20:39:24.496316+0000","last_clean":"2023-11-18T20:39:24.496316+0000","last_became_active":"2023-11-18T20:39:23.408288+0000","last_became_peered":"2023-11-18T20:39:23.408288+0000","last_unstale":"2023-11-18T20:39:24.496316+0000","last_undegraded":"2023-11-18T20:39:24.496316+0000","last_fullsized":"2023-11-18T20:39:24.496316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414893+0000","last_change":"2023-11-18T20:39:02.756005+0000","last_active":"2023-11-18T20:39:23.414893+0000","last_peered":"2023-11-18T20:39:23.414893+0000","last_clean":"2023-11-18T20:39:23.414893+0000","last_became_active":"2023-11-18T20:39:02.754298+0000","last_became_peered":"2023-11-18T20:39:02.754298+0000","last_unstale":"2023-11-18T20:39:23.414893+0000","last_undegraded":"2023-11-18T20:39:23.414893+0000","last_fullsized":"2023-11-18T20:39:23.414893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496924+0000","last_change":"2023-11-18T20:39:23.432493+0000","last_active":"2023-11-18T20:39:24.496924+0000","last_peered":"2023-11-18T20:39:24.496924+0000","last_clean":"2023-11-18T20:39:24.496924+0000","last_became_active":"2023-11-18T20:39:23.432175+0000","last_became_peered":"2023-11-18T20:39:23.432175+0000","last_unstale":"2023-11-18T20:39:24.496924+0000","last_undegraded":"2023-11-18T20:39:24.496924+0000","last_fullsized":"2023-11-18T20:39:24.496924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:38.580148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427177+0000","last_change":"2023-11-18T20:39:02.774649+0000","last_active":"2023-11-18T20:39:23.427177+0000","last_peered":"2023-11-18T20:39:23.427177+0000","last_clean":"2023-11-18T20:39:23.427177+0000","last_became_active":"2023-11-18T20:39:02.774358+0000","last_became_peered":"2023-11-18T20:39:02.774358+0000","last_unstale":"2023-11-18T20:39:23.427177+0000","last_undegraded":"2023-11-18T20:39:23.427177+0000","last_fullsized":"2023-11-18T20:39:23.427177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493419+0000","last_change":"2023-11-18T20:39:23.427619+0000","last_active":"2023-11-18T20:39:24.493419+0000","last_peered":"2023-11-18T20:39:24.493419+0000","last_clean":"2023-11-18T20:39:24.493419+0000","last_became_active":"2023-11-18T20:39:23.427203+0000","last_became_peered":"2023-11-18T20:39:23.427203+0000","last_unstale":"2023-11-18T20:39:24.493419+0000","last_undegraded":"2023-11-18T20:39:24.493419+0000","last_fullsized":"2023-11-18T20:39:24.493419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:38.915609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405199+0000","last_change":"2023-11-18T20:39:02.760762+0000","last_active":"2023-11-18T20:39:23.405199+0000","last_peered":"2023-11-18T20:39:23.405199+0000","last_clean":"2023-11-18T20:39:23.405199+0000","last_became_active":"2023-11-18T20:39:02.760426+0000","last_became_peered":"2023-11-18T20:39:02.760426+0000","last_unstale":"2023-11-18T20:39:23.405199+0000","last_undegraded":"2023-11-18T20:39:23.405199+0000","last_fullsized":"2023-11-18T20:39:23.405199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":183281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.72099999999999997}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.538}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.1559999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.597},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.3220000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.643},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.4710000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":1.7110000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.6699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":186948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.78600000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.145}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2689999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.488}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.736}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1044480,"data_stored":774197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.92800000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.161}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.294},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.044}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.264},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.706}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.345},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.3879999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.831},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.423}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":188058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.3460000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.01}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.381},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.4790000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.444},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.538}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.585},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.5029999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":185613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.038}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.087},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71699999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.173},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.2829999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.129},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3600000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.304},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":183349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.085},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.2629999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.357},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.03}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.21},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.153}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.502},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.4490000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.3180000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.482},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.411}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1044480,"data_stored":773733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.495},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.79900000000000004}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.84299999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.2250000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.0049999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":183987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":2.173}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.746}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.1950000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.256},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.286}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.218},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.458}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:32.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:39:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.213+0000 7f71d6da9640 1 Processor -- start 2023-11-18T20:39:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.214+0000 7f71d6da9640 1 -- start start 2023-11-18T20:39:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.215+0000 7f71d6da9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 0x7f71d00c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.215+0000 7f71d6da9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71d0071e30 0x7f71d00c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.215+0000 7f71d6da9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d006d580 con 0x7f71d0155fc0 2023-11-18T20:39:33.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.215+0000 7f71d6da9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d006dd60 con 0x7f71d0071e30 2023-11-18T20:39:33.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.215+0000 7f71d6da9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00c6580 con 0x7f71d00c1ca0 2023-11-18T20:39:33.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.215+0000 7f71d5346640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71d0071e30 0x7f71d00c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:33.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.215+0000 7f71d5346640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71d0071e30 0x7f71d00c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48892/0 (socket says 172.21.15.132:48892) 2023-11-18T20:39:33.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.215+0000 7f71d5346640 1 -- 172.21.15.132:0/935291240 learned_addr learned my addr 172.21.15.132:0/935291240 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:33.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.216+0000 7f71cffff640 1 --2- 172.21.15.132:0/935291240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 0x7f71d00c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:33.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.216+0000 7f71d5346640 1 -- 172.21.15.132:0/935291240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 msgr2=0x7f71d00c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:33.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.216+0000 7f71d5346640 1 --2- 172.21.15.132:0/935291240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 0x7f71d00c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.216+0000 7f71d5346640 1 -- 172.21.15.132:0/935291240 >> v1:172.21.15.161:6789/0 conn(0x7f71d0155fc0 legacy=0x7f71d0159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:33.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.216+0000 7f71d5346640 1 -- 172.21.15.132:0/935291240 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00726d0 con 0x7f71d0071e30 2023-11-18T20:39:33.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.217+0000 7f71d5346640 1 --2- 172.21.15.132:0/935291240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00c2c90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009e50 tx=0x7f71c802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812041c0d4fce06 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:33.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.217+0000 7f71cf7fe640 1 -- 172.21.15.132:0/935291240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c802c950 con 0x7f71d0071e30 2023-11-18T20:39:33.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.217+0000 7f71cf7fe640 1 -- 172.21.15.132:0/935291240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c802cab0 con 0x7f71d0071e30 2023-11-18T20:39:33.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.217+0000 7f71cf7fe640 1 -- 172.21.15.132:0/935291240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c802ce40 con 0x7f71d0071e30 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.218+0000 7f71d6da9640 1 -- 172.21.15.132:0/935291240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 msgr2=0x7f71d00c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.218+0000 7f71d6da9640 1 --2- 172.21.15.132:0/935291240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00c2c90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009e50 tx=0x7f71c802bdb0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.218+0000 7f71d6da9640 1 -- 172.21.15.132:0/935291240 shutdown_connections 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.218+0000 7f71d6da9640 1 --2- 172.21.15.132:0/935291240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00c2c90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.218+0000 7f71d6da9640 1 --2- 172.21.15.132:0/935291240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 0x7f71d00c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.218+0000 7f71d6da9640 1 -- 172.21.15.132:0/935291240 >> 172.21.15.132:0/935291240 conn(0x7f71d006a500 msgr2=0x7f71d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.218+0000 7f71d6da9640 1 -- 172.21.15.132:0/935291240 shutdown_connections 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.218+0000 7f71d6da9640 1 -- 172.21.15.132:0/935291240 wait complete. 2023-11-18T20:39:33.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.220+0000 7f71d6da9640 1 Processor -- start 2023-11-18T20:39:33.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.220+0000 7f71d6da9640 1 -- start start 2023-11-18T20:39:33.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d6da9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d6da9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 0x7f71d00a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d6da9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0155fc0 0x7f71d01ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d6da9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00a4300 con 0x7f71d0071e30 2023-11-18T20:39:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d6da9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00a3cd0 con 0x7f71d0155fc0 2023-11-18T20:39:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d6da9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d01eeda0 con 0x7f71d00c1ca0 2023-11-18T20:39:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d4b45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d4b45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48900/0 (socket says 172.21.15.132:48900) 2023-11-18T20:39:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d4b45640 1 -- 172.21.15.132:0/4227032820 learned_addr learned my addr 172.21.15.132:0/4227032820 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d4b45640 1 -- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 msgr2=0x7f71d00a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d4b45640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 0x7f71d00a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d4b45640 1 -- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0155fc0 msgr2=0x7f71d01ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d4b45640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0155fc0 0x7f71d01ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.221+0000 7f71d4b45640 1 -- 172.21.15.132:0/4227032820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8009b30 con 0x7f71d0071e30 2023-11-18T20:39:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.222+0000 7f71d4b45640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00a4720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f71c400b3f0 tx=0x7f71c400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.222+0000 7f71cd7fa640 1 -- 172.21.15.132:0/4227032820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4011830 con 0x7f71d0071e30 2023-11-18T20:39:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.222+0000 7f71cd7fa640 1 -- 172.21.15.132:0/4227032820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c4011990 con 0x7f71d0071e30 2023-11-18T20:39:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.222+0000 7f71cd7fa640 1 -- 172.21.15.132:0/4227032820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4011d40 con 0x7f71d0071e30 2023-11-18T20:39:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.222+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d00a3f20 con 0x7f71d0071e30 2023-11-18T20:39:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.222+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d0157fb0 con 0x7f71d0071e30 2023-11-18T20:39:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.223+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d00a4440 con 0x7f71d0071e30 2023-11-18T20:39:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.224+0000 7f71cd7fa640 1 -- 172.21.15.132:0/4227032820 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71c401a400 con 0x7f71d0071e30 2023-11-18T20:39:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.225+0000 7f71cd7fa640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f71b406ae40 0x7f71b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.225+0000 7f71cd7fa640 1 -- 172.21.15.132:0/4227032820 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f71c4089760 con 0x7f71d0071e30 2023-11-18T20:39:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.226+0000 7f71cffff640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f71b406ae40 0x7f71b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:33.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.227+0000 7f71cffff640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f71b406ae40 0x7f71b406d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f71d0067660 tx=0x7f71bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.230+0000 7f71cd7fa640 1 -- 172.21.15.132:0/4227032820 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71d00a4440 con 0x7f71d0071e30 2023-11-18T20:39:33.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.414+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71d01563a0 con 0x7f71b406ae40 2023-11-18T20:39:33.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.453+0000 7f71cd7fa640 1 -- 172.21.15.132:0/4227032820 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+524907 (secure 0 0 0) 0x7f71bc00a4c0 con 0x7f71b406ae40 2023-11-18T20:39:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:33.466 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:39:33.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.463+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f71b406ae40 msgr2=0x7f71b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.463+0000 7f71d6da9640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f71b406ae40 0x7f71b406d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f71d0067660 tx=0x7f71bc008040 comp rx=0 tx=0).stop 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 msgr2=0x7f71d00a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00a4720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f71c400b3f0 tx=0x7f71c400b8b0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 shutdown_connections 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f71b406ae40 0x7f71b406d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0155fc0 0x7f71d01ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71d00c1ca0 0x7f71d00a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 --2- 172.21.15.132:0/4227032820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0071e30 0x7f71d00a4720 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 >> 172.21.15.132:0/4227032820 conn(0x7f71d006a500 msgr2=0x7f71d01555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 shutdown_connections 2023-11-18T20:39:33.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.464+0000 7f71d6da9640 1 -- 172.21.15.132:0/4227032820 wait complete. 2023-11-18T20:39:33.489 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-18T20:39:32.664388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225084,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749636,"statfs":{"total":773094113280,"available":772863627264,"internally_reserved":0,"allocated":4857856,"data_stored":2659166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.275571"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495110+0000","last_change":"2023-11-18T20:39:23.420773+0000","last_active":"2023-11-18T20:39:24.495110+0000","last_peered":"2023-11-18T20:39:24.495110+0000","last_clean":"2023-11-18T20:39:24.495110+0000","last_became_active":"2023-11-18T20:39:23.420497+0000","last_became_peered":"2023-11-18T20:39:23.420497+0000","last_unstale":"2023-11-18T20:39:24.495110+0000","last_undegraded":"2023-11-18T20:39:24.495110+0000","last_fullsized":"2023-11-18T20:39:24.495110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:06.573461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412009+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:39:23.412009+0000","last_peered":"2023-11-18T20:39:23.412009+0000","last_clean":"2023-11-18T20:39:23.412009+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:39:23.412009+0000","last_undegraded":"2023-11-18T20:39:23.412009+0000","last_fullsized":"2023-11-18T20:39:23.412009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414782+0000","last_change":"2023-11-18T20:39:01.749586+0000","last_active":"2023-11-18T20:39:23.414782+0000","last_peered":"2023-11-18T20:39:23.414782+0000","last_clean":"2023-11-18T20:39:23.414782+0000","last_became_active":"2023-11-18T20:39:01.748751+0000","last_became_peered":"2023-11-18T20:39:01.748751+0000","last_unstale":"2023-11-18T20:39:23.414782+0000","last_undegraded":"2023-11-18T20:39:23.414782+0000","last_fullsized":"2023-11-18T20:39:23.414782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:49.505805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.391765+0000","last_change":"2023-11-18T20:39:02.760047+0000","last_active":"2023-11-18T20:39:23.391765+0000","last_peered":"2023-11-18T20:39:23.391765+0000","last_clean":"2023-11-18T20:39:23.391765+0000","last_became_active":"2023-11-18T20:39:02.759514+0000","last_became_peered":"2023-11-18T20:39:02.759514+0000","last_unstale":"2023-11-18T20:39:23.391765+0000","last_undegraded":"2023-11-18T20:39:23.391765+0000","last_fullsized":"2023-11-18T20:39:23.391765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449037+0000","last_change":"2023-11-18T20:39:22.407903+0000","last_active":"2023-11-18T20:39:23.449037+0000","last_peered":"2023-11-18T20:39:23.449037+0000","last_clean":"2023-11-18T20:39:23.449037+0000","last_became_active":"2023-11-18T20:39:22.407672+0000","last_became_peered":"2023-11-18T20:39:22.407672+0000","last_unstale":"2023-11-18T20:39:23.449037+0000","last_undegraded":"2023-11-18T20:39:23.449037+0000","last_fullsized":"2023-11-18T20:39:23.449037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:55.384588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494796+0000","last_change":"2023-11-18T20:39:23.429888+0000","last_active":"2023-11-18T20:39:24.494796+0000","last_peered":"2023-11-18T20:39:24.494796+0000","last_clean":"2023-11-18T20:39:24.494796+0000","last_became_active":"2023-11-18T20:39:23.428493+0000","last_became_peered":"2023-11-18T20:39:23.428493+0000","last_unstale":"2023-11-18T20:39:24.494796+0000","last_undegraded":"2023-11-18T20:39:24.494796+0000","last_fullsized":"2023-11-18T20:39:24.494796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.419455+0000","last_change":"2023-11-18T20:39:01.753938+0000","last_active":"2023-11-18T20:39:23.419455+0000","last_peered":"2023-11-18T20:39:23.419455+0000","last_clean":"2023-11-18T20:39:23.419455+0000","last_became_active":"2023-11-18T20:39:01.753659+0000","last_became_peered":"2023-11-18T20:39:01.753659+0000","last_unstale":"2023-11-18T20:39:23.419455+0000","last_undegraded":"2023-11-18T20:39:23.419455+0000","last_fullsized":"2023-11-18T20:39:23.419455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:56.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412479+0000","last_change":"2023-11-18T20:39:02.755764+0000","last_active":"2023-11-18T20:39:23.412479+0000","last_peered":"2023-11-18T20:39:23.412479+0000","last_clean":"2023-11-18T20:39:23.412479+0000","last_became_active":"2023-11-18T20:39:02.755464+0000","last_became_peered":"2023-11-18T20:39:02.755464+0000","last_unstale":"2023-11-18T20:39:23.412479+0000","last_undegraded":"2023-11-18T20:39:23.412479+0000","last_fullsized":"2023-11-18T20:39:23.412479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:24.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407111+0000","last_change":"2023-11-18T20:39:22.406273+0000","last_active":"2023-11-18T20:39:23.407111+0000","last_peered":"2023-11-18T20:39:23.407111+0000","last_clean":"2023-11-18T20:39:23.407111+0000","last_became_active":"2023-11-18T20:39:22.405680+0000","last_became_peered":"2023-11-18T20:39:22.405680+0000","last_unstale":"2023-11-18T20:39:23.407111+0000","last_undegraded":"2023-11-18T20:39:23.407111+0000","last_fullsized":"2023-11-18T20:39:23.407111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:38.292942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419768+0000","last_change":"2023-11-18T20:39:23.427239+0000","last_active":"2023-11-18T20:39:24.419768+0000","last_peered":"2023-11-18T20:39:24.419768+0000","last_clean":"2023-11-18T20:39:24.419768+0000","last_became_active":"2023-11-18T20:39:23.426300+0000","last_became_peered":"2023-11-18T20:39:23.426300+0000","last_unstale":"2023-11-18T20:39:24.419768+0000","last_undegraded":"2023-11-18T20:39:24.419768+0000","last_fullsized":"2023-11-18T20:39:24.419768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:47:00.725680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405270+0000","last_change":"2023-11-18T20:39:01.750219+0000","last_active":"2023-11-18T20:39:23.405270+0000","last_peered":"2023-11-18T20:39:23.405270+0000","last_clean":"2023-11-18T20:39:23.405270+0000","last_became_active":"2023-11-18T20:39:01.749931+0000","last_became_peered":"2023-11-18T20:39:01.749931+0000","last_unstale":"2023-11-18T20:39:23.405270+0000","last_undegraded":"2023-11-18T20:39:23.405270+0000","last_fullsized":"2023-11-18T20:39:23.405270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:24.984694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415529+0000","last_change":"2023-11-18T20:39:02.752804+0000","last_active":"2023-11-18T20:39:23.415529+0000","last_peered":"2023-11-18T20:39:23.415529+0000","last_clean":"2023-11-18T20:39:23.415529+0000","last_became_active":"2023-11-18T20:39:02.752203+0000","last_became_peered":"2023-11-18T20:39:02.752203+0000","last_unstale":"2023-11-18T20:39:23.415529+0000","last_undegraded":"2023-11-18T20:39:23.415529+0000","last_fullsized":"2023-11-18T20:39:23.415529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396860+0000","last_change":"2023-11-18T20:39:22.406528+0000","last_active":"2023-11-18T20:39:23.396860+0000","last_peered":"2023-11-18T20:39:23.396860+0000","last_clean":"2023-11-18T20:39:23.396860+0000","last_became_active":"2023-11-18T20:39:22.406024+0000","last_became_peered":"2023-11-18T20:39:22.406024+0000","last_unstale":"2023-11-18T20:39:23.396860+0000","last_undegraded":"2023-11-18T20:39:23.396860+0000","last_fullsized":"2023-11-18T20:39:23.396860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:18:36.439871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417717+0000","last_change":"2023-11-18T20:39:23.417467+0000","last_active":"2023-11-18T20:39:24.417717+0000","last_peered":"2023-11-18T20:39:24.417717+0000","last_clean":"2023-11-18T20:39:24.417717+0000","last_became_active":"2023-11-18T20:39:23.417144+0000","last_became_peered":"2023-11-18T20:39:23.417144+0000","last_unstale":"2023-11-18T20:39:24.417717+0000","last_undegraded":"2023-11-18T20:39:24.417717+0000","last_fullsized":"2023-11-18T20:39:24.417717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:36.617668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.400291+0000","last_change":"2023-11-18T20:39:01.747389+0000","last_active":"2023-11-18T20:39:23.400291+0000","last_peered":"2023-11-18T20:39:23.400291+0000","last_clean":"2023-11-18T20:39:23.400291+0000","last_became_active":"2023-11-18T20:39:01.747100+0000","last_became_peered":"2023-11-18T20:39:01.747100+0000","last_unstale":"2023-11-18T20:39:23.400291+0000","last_undegraded":"2023-11-18T20:39:23.400291+0000","last_fullsized":"2023-11-18T20:39:23.400291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:30.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413890+0000","last_change":"2023-11-18T20:39:02.748674+0000","last_active":"2023-11-18T20:39:23.413890+0000","last_peered":"2023-11-18T20:39:23.413890+0000","last_clean":"2023-11-18T20:39:23.413890+0000","last_became_active":"2023-11-18T20:39:02.748033+0000","last_became_peered":"2023-11-18T20:39:02.748033+0000","last_unstale":"2023-11-18T20:39:23.413890+0000","last_undegraded":"2023-11-18T20:39:23.413890+0000","last_fullsized":"2023-11-18T20:39:23.413890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:31.017030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405800+0000","last_change":"2023-11-18T20:39:22.409054+0000","last_active":"2023-11-18T20:39:23.405800+0000","last_peered":"2023-11-18T20:39:23.405800+0000","last_clean":"2023-11-18T20:39:23.405800+0000","last_became_active":"2023-11-18T20:39:22.408725+0000","last_became_peered":"2023-11-18T20:39:22.408725+0000","last_unstale":"2023-11-18T20:39:23.405800+0000","last_undegraded":"2023-11-18T20:39:23.405800+0000","last_fullsized":"2023-11-18T20:39:23.405800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:53.412441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492146+0000","last_change":"2023-11-18T20:39:23.443088+0000","last_active":"2023-11-18T20:39:24.492146+0000","last_peered":"2023-11-18T20:39:24.492146+0000","last_clean":"2023-11-18T20:39:24.492146+0000","last_became_active":"2023-11-18T20:39:23.442820+0000","last_became_peered":"2023-11-18T20:39:23.442820+0000","last_unstale":"2023-11-18T20:39:24.492146+0000","last_undegraded":"2023-11-18T20:39:24.492146+0000","last_fullsized":"2023-11-18T20:39:24.492146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:46:15.687815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.399349+0000","last_change":"2023-11-18T20:39:01.743544+0000","last_active":"2023-11-18T20:39:23.399349+0000","last_peered":"2023-11-18T20:39:23.399349+0000","last_clean":"2023-11-18T20:39:23.399349+0000","last_became_active":"2023-11-18T20:39:01.743218+0000","last_became_peered":"2023-11-18T20:39:01.743218+0000","last_unstale":"2023-11-18T20:39:23.399349+0000","last_undegraded":"2023-11-18T20:39:23.399349+0000","last_fullsized":"2023-11-18T20:39:23.399349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:01.441027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393686+0000","last_change":"2023-11-18T20:39:02.755847+0000","last_active":"2023-11-18T20:39:23.393686+0000","last_peered":"2023-11-18T20:39:23.393686+0000","last_clean":"2023-11-18T20:39:23.393686+0000","last_became_active":"2023-11-18T20:39:02.755565+0000","last_became_peered":"2023-11-18T20:39:02.755565+0000","last_unstale":"2023-11-18T20:39:23.393686+0000","last_undegraded":"2023-11-18T20:39:23.393686+0000","last_fullsized":"2023-11-18T20:39:23.393686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396472+0000","last_change":"2023-11-18T20:39:22.400862+0000","last_active":"2023-11-18T20:39:23.396472+0000","last_peered":"2023-11-18T20:39:23.396472+0000","last_clean":"2023-11-18T20:39:23.396472+0000","last_became_active":"2023-11-18T20:39:22.400584+0000","last_became_peered":"2023-11-18T20:39:22.400584+0000","last_unstale":"2023-11-18T20:39:23.396472+0000","last_undegraded":"2023-11-18T20:39:23.396472+0000","last_fullsized":"2023-11-18T20:39:23.396472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:03.815644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494568+0000","last_change":"2023-11-18T20:39:23.427290+0000","last_active":"2023-11-18T20:39:24.494568+0000","last_peered":"2023-11-18T20:39:24.494568+0000","last_clean":"2023-11-18T20:39:24.494568+0000","last_became_active":"2023-11-18T20:39:23.426945+0000","last_became_peered":"2023-11-18T20:39:23.426945+0000","last_unstale":"2023-11-18T20:39:24.494568+0000","last_undegraded":"2023-11-18T20:39:24.494568+0000","last_fullsized":"2023-11-18T20:39:24.494568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:55:10.225203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397899+0000","last_change":"2023-11-18T20:39:01.748799+0000","last_active":"2023-11-18T20:39:23.397899+0000","last_peered":"2023-11-18T20:39:23.397899+0000","last_clean":"2023-11-18T20:39:23.397899+0000","last_became_active":"2023-11-18T20:39:01.748492+0000","last_became_peered":"2023-11-18T20:39:01.748492+0000","last_unstale":"2023-11-18T20:39:23.397899+0000","last_undegraded":"2023-11-18T20:39:23.397899+0000","last_fullsized":"2023-11-18T20:39:23.397899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:43.756070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413481+0000","last_change":"2023-11-18T20:39:02.766797+0000","last_active":"2023-11-18T20:39:23.413481+0000","last_peered":"2023-11-18T20:39:23.413481+0000","last_clean":"2023-11-18T20:39:23.413481+0000","last_became_active":"2023-11-18T20:39:02.766466+0000","last_became_peered":"2023-11-18T20:39:02.766466+0000","last_unstale":"2023-11-18T20:39:23.413481+0000","last_undegraded":"2023-11-18T20:39:23.413481+0000","last_fullsized":"2023-11-18T20:39:23.413481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.491100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.428827+0000","last_change":"2023-11-18T20:39:22.410942+0000","last_active":"2023-11-18T20:39:23.428827+0000","last_peered":"2023-11-18T20:39:23.428827+0000","last_clean":"2023-11-18T20:39:23.428827+0000","last_became_active":"2023-11-18T20:39:22.410660+0000","last_became_peered":"2023-11-18T20:39:22.410660+0000","last_unstale":"2023-11-18T20:39:23.428827+0000","last_undegraded":"2023-11-18T20:39:23.428827+0000","last_fullsized":"2023-11-18T20:39:23.428827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:42.926451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494430+0000","last_change":"2023-11-18T20:39:23.438792+0000","last_active":"2023-11-18T20:39:24.494430+0000","last_peered":"2023-11-18T20:39:24.494430+0000","last_clean":"2023-11-18T20:39:24.494430+0000","last_became_active":"2023-11-18T20:39:23.437752+0000","last_became_peered":"2023-11-18T20:39:23.437752+0000","last_unstale":"2023-11-18T20:39:24.494430+0000","last_undegraded":"2023-11-18T20:39:24.494430+0000","last_fullsized":"2023-11-18T20:39:24.494430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:29:36.331864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427691+0000","last_change":"2023-11-18T20:39:01.752473+0000","last_active":"2023-11-18T20:39:23.427691+0000","last_peered":"2023-11-18T20:39:23.427691+0000","last_clean":"2023-11-18T20:39:23.427691+0000","last_became_active":"2023-11-18T20:39:01.752017+0000","last_became_peered":"2023-11-18T20:39:01.752017+0000","last_unstale":"2023-11-18T20:39:23.427691+0000","last_undegraded":"2023-11-18T20:39:23.427691+0000","last_fullsized":"2023-11-18T20:39:23.427691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:32.771880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406533+0000","last_change":"2023-11-18T20:39:02.760873+0000","last_active":"2023-11-18T20:39:23.406533+0000","last_peered":"2023-11-18T20:39:23.406533+0000","last_clean":"2023-11-18T20:39:23.406533+0000","last_became_active":"2023-11-18T20:39:02.759887+0000","last_became_peered":"2023-11-18T20:39:02.759887+0000","last_unstale":"2023-11-18T20:39:23.406533+0000","last_undegraded":"2023-11-18T20:39:23.406533+0000","last_fullsized":"2023-11-18T20:39:23.406533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:26.185944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412595+0000","last_change":"2023-11-18T20:39:22.411188+0000","last_active":"2023-11-18T20:39:23.412595+0000","last_peered":"2023-11-18T20:39:23.412595+0000","last_clean":"2023-11-18T20:39:23.412595+0000","last_became_active":"2023-11-18T20:39:22.410686+0000","last_became_peered":"2023-11-18T20:39:22.410686+0000","last_unstale":"2023-11-18T20:39:23.412595+0000","last_undegraded":"2023-11-18T20:39:23.412595+0000","last_fullsized":"2023-11-18T20:39:23.412595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:44.343230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421439+0000","last_change":"2023-11-18T20:39:23.432967+0000","last_active":"2023-11-18T20:39:24.421439+0000","last_peered":"2023-11-18T20:39:24.421439+0000","last_clean":"2023-11-18T20:39:24.421439+0000","last_became_active":"2023-11-18T20:39:23.432657+0000","last_became_peered":"2023-11-18T20:39:23.432657+0000","last_unstale":"2023-11-18T20:39:24.421439+0000","last_undegraded":"2023-11-18T20:39:24.421439+0000","last_fullsized":"2023-11-18T20:39:24.421439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:38.580148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398698+0000","last_change":"2023-11-18T20:39:01.743607+0000","last_active":"2023-11-18T20:39:23.398698+0000","last_peered":"2023-11-18T20:39:23.398698+0000","last_clean":"2023-11-18T20:39:23.398698+0000","last_became_active":"2023-11-18T20:39:01.741986+0000","last_became_peered":"2023-11-18T20:39:01.741986+0000","last_unstale":"2023-11-18T20:39:23.398698+0000","last_undegraded":"2023-11-18T20:39:23.398698+0000","last_fullsized":"2023-11-18T20:39:23.398698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:39.869697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413300+0000","last_change":"2023-11-18T20:39:02.762642+0000","last_active":"2023-11-18T20:39:23.413300+0000","last_peered":"2023-11-18T20:39:23.413300+0000","last_clean":"2023-11-18T20:39:23.413300+0000","last_became_active":"2023-11-18T20:39:02.761245+0000","last_became_peered":"2023-11-18T20:39:02.761245+0000","last_unstale":"2023-11-18T20:39:23.413300+0000","last_undegraded":"2023-11-18T20:39:23.413300+0000","last_fullsized":"2023-11-18T20:39:23.413300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:59.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397637+0000","last_change":"2023-11-18T20:39:22.403397+0000","last_active":"2023-11-18T20:39:23.397637+0000","last_peered":"2023-11-18T20:39:23.397637+0000","last_clean":"2023-11-18T20:39:23.397637+0000","last_became_active":"2023-11-18T20:39:22.403108+0000","last_became_peered":"2023-11-18T20:39:22.403108+0000","last_unstale":"2023-11-18T20:39:23.397637+0000","last_undegraded":"2023-11-18T20:39:23.397637+0000","last_fullsized":"2023-11-18T20:39:23.397637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:00.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419824+0000","last_change":"2023-11-18T20:39:23.419397+0000","last_active":"2023-11-18T20:39:24.419824+0000","last_peered":"2023-11-18T20:39:24.419824+0000","last_clean":"2023-11-18T20:39:24.419824+0000","last_became_active":"2023-11-18T20:39:23.419142+0000","last_became_peered":"2023-11-18T20:39:23.419142+0000","last_unstale":"2023-11-18T20:39:24.419824+0000","last_undegraded":"2023-11-18T20:39:24.419824+0000","last_fullsized":"2023-11-18T20:39:24.419824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:51.592301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406992+0000","last_change":"2023-11-18T20:39:01.742479+0000","last_active":"2023-11-18T20:39:23.406992+0000","last_peered":"2023-11-18T20:39:23.406992+0000","last_clean":"2023-11-18T20:39:23.406992+0000","last_became_active":"2023-11-18T20:39:01.742208+0000","last_became_peered":"2023-11-18T20:39:01.742208+0000","last_unstale":"2023-11-18T20:39:23.406992+0000","last_undegraded":"2023-11-18T20:39:23.406992+0000","last_fullsized":"2023-11-18T20:39:23.406992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:48:04.385451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411551+0000","last_change":"2023-11-18T20:39:02.769526+0000","last_active":"2023-11-18T20:39:23.411551+0000","last_peered":"2023-11-18T20:39:23.411551+0000","last_clean":"2023-11-18T20:39:23.411551+0000","last_became_active":"2023-11-18T20:39:02.767946+0000","last_became_peered":"2023-11-18T20:39:02.767946+0000","last_unstale":"2023-11-18T20:39:23.411551+0000","last_undegraded":"2023-11-18T20:39:23.411551+0000","last_fullsized":"2023-11-18T20:39:23.411551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.392639+0000","last_change":"2023-11-18T20:39:22.397295+0000","last_active":"2023-11-18T20:39:23.392639+0000","last_peered":"2023-11-18T20:39:23.392639+0000","last_clean":"2023-11-18T20:39:23.392639+0000","last_became_active":"2023-11-18T20:39:22.396777+0000","last_became_peered":"2023-11-18T20:39:22.396777+0000","last_unstale":"2023-11-18T20:39:23.392639+0000","last_undegraded":"2023-11-18T20:39:23.392639+0000","last_fullsized":"2023-11-18T20:39:23.392639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:44.041536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419400+0000","last_change":"2023-11-18T20:39:23.427589+0000","last_active":"2023-11-18T20:39:24.419400+0000","last_peered":"2023-11-18T20:39:24.419400+0000","last_clean":"2023-11-18T20:39:24.419400+0000","last_became_active":"2023-11-18T20:39:23.426763+0000","last_became_peered":"2023-11-18T20:39:23.426763+0000","last_unstale":"2023-11-18T20:39:24.419400+0000","last_undegraded":"2023-11-18T20:39:24.419400+0000","last_fullsized":"2023-11-18T20:39:24.419400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:41:24.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411644+0000","last_change":"2023-11-18T20:39:01.744082+0000","last_active":"2023-11-18T20:39:23.411644+0000","last_peered":"2023-11-18T20:39:23.411644+0000","last_clean":"2023-11-18T20:39:23.411644+0000","last_became_active":"2023-11-18T20:39:01.743792+0000","last_became_peered":"2023-11-18T20:39:01.743792+0000","last_unstale":"2023-11-18T20:39:23.411644+0000","last_undegraded":"2023-11-18T20:39:23.411644+0000","last_fullsized":"2023-11-18T20:39:23.411644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:46:37.114460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.395924+0000","last_change":"2023-11-18T20:39:02.750840+0000","last_active":"2023-11-18T20:39:23.395924+0000","last_peered":"2023-11-18T20:39:23.395924+0000","last_clean":"2023-11-18T20:39:23.395924+0000","last_became_active":"2023-11-18T20:39:02.749491+0000","last_became_peered":"2023-11-18T20:39:02.749491+0000","last_unstale":"2023-11-18T20:39:23.395924+0000","last_undegraded":"2023-11-18T20:39:23.395924+0000","last_fullsized":"2023-11-18T20:39:23.395924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:27:46.865954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.446332+0000","last_change":"2023-11-18T20:39:22.396910+0000","last_active":"2023-11-18T20:39:23.446332+0000","last_peered":"2023-11-18T20:39:23.446332+0000","last_clean":"2023-11-18T20:39:23.446332+0000","last_became_active":"2023-11-18T20:39:22.396615+0000","last_became_peered":"2023-11-18T20:39:22.396615+0000","last_unstale":"2023-11-18T20:39:23.446332+0000","last_undegraded":"2023-11-18T20:39:23.446332+0000","last_fullsized":"2023-11-18T20:39:23.446332+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:22.047139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495361+0000","last_change":"2023-11-18T20:39:23.434749+0000","last_active":"2023-11-18T20:39:24.495361+0000","last_peered":"2023-11-18T20:39:24.495361+0000","last_clean":"2023-11-18T20:39:24.495361+0000","last_became_active":"2023-11-18T20:39:23.434450+0000","last_became_peered":"2023-11-18T20:39:23.434450+0000","last_unstale":"2023-11-18T20:39:24.495361+0000","last_undegraded":"2023-11-18T20:39:24.495361+0000","last_fullsized":"2023-11-18T20:39:24.495361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:41.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403561+0000","last_change":"2023-11-18T20:39:01.749196+0000","last_active":"2023-11-18T20:39:23.403561+0000","last_peered":"2023-11-18T20:39:23.403561+0000","last_clean":"2023-11-18T20:39:23.403561+0000","last_became_active":"2023-11-18T20:39:01.748776+0000","last_became_peered":"2023-11-18T20:39:01.748776+0000","last_unstale":"2023-11-18T20:39:23.403561+0000","last_undegraded":"2023-11-18T20:39:23.403561+0000","last_fullsized":"2023-11-18T20:39:23.403561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.432189+0000","last_change":"2023-11-18T20:39:02.757357+0000","last_active":"2023-11-18T20:39:23.432189+0000","last_peered":"2023-11-18T20:39:23.432189+0000","last_clean":"2023-11-18T20:39:23.432189+0000","last_became_active":"2023-11-18T20:39:02.757000+0000","last_became_peered":"2023-11-18T20:39:02.757000+0000","last_unstale":"2023-11-18T20:39:23.432189+0000","last_undegraded":"2023-11-18T20:39:23.432189+0000","last_fullsized":"2023-11-18T20:39:23.432189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406421+0000","last_change":"2023-11-18T20:39:22.404704+0000","last_active":"2023-11-18T20:39:23.406421+0000","last_peered":"2023-11-18T20:39:23.406421+0000","last_clean":"2023-11-18T20:39:23.406421+0000","last_became_active":"2023-11-18T20:39:22.403768+0000","last_became_peered":"2023-11-18T20:39:22.403768+0000","last_unstale":"2023-11-18T20:39:23.406421+0000","last_undegraded":"2023-11-18T20:39:23.406421+0000","last_fullsized":"2023-11-18T20:39:23.406421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:20:23.165252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496768+0000","last_change":"2023-11-18T20:39:23.434493+0000","last_active":"2023-11-18T20:39:24.496768+0000","last_peered":"2023-11-18T20:39:24.496768+0000","last_clean":"2023-11-18T20:39:24.496768+0000","last_became_active":"2023-11-18T20:39:23.434041+0000","last_became_peered":"2023-11-18T20:39:23.434041+0000","last_unstale":"2023-11-18T20:39:24.496768+0000","last_undegraded":"2023-11-18T20:39:24.496768+0000","last_fullsized":"2023-11-18T20:39:24.496768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:23.674417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.428097+0000","last_change":"2023-11-18T20:39:01.748074+0000","last_active":"2023-11-18T20:39:23.428097+0000","last_peered":"2023-11-18T20:39:23.428097+0000","last_clean":"2023-11-18T20:39:23.428097+0000","last_became_active":"2023-11-18T20:39:01.747796+0000","last_became_peered":"2023-11-18T20:39:01.747796+0000","last_unstale":"2023-11-18T20:39:23.428097+0000","last_undegraded":"2023-11-18T20:39:23.428097+0000","last_fullsized":"2023-11-18T20:39:23.428097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397015+0000","last_change":"2023-11-18T20:39:02.762298+0000","last_active":"2023-11-18T20:39:23.397015+0000","last_peered":"2023-11-18T20:39:23.397015+0000","last_clean":"2023-11-18T20:39:23.397015+0000","last_became_active":"2023-11-18T20:39:02.761752+0000","last_became_peered":"2023-11-18T20:39:02.761752+0000","last_unstale":"2023-11-18T20:39:23.397015+0000","last_undegraded":"2023-11-18T20:39:23.397015+0000","last_fullsized":"2023-11-18T20:39:23.397015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:16:15.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415731+0000","last_change":"2023-11-18T20:39:22.398043+0000","last_active":"2023-11-18T20:39:23.415731+0000","last_peered":"2023-11-18T20:39:23.415731+0000","last_clean":"2023-11-18T20:39:23.415731+0000","last_became_active":"2023-11-18T20:39:22.397732+0000","last_became_peered":"2023-11-18T20:39:22.397732+0000","last_unstale":"2023-11-18T20:39:23.415731+0000","last_undegraded":"2023-11-18T20:39:23.415731+0000","last_fullsized":"2023-11-18T20:39:23.415731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:05.560747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494710+0000","last_change":"2023-11-18T20:39:23.446473+0000","last_active":"2023-11-18T20:39:24.494710+0000","last_peered":"2023-11-18T20:39:24.494710+0000","last_clean":"2023-11-18T20:39:24.494710+0000","last_became_active":"2023-11-18T20:39:23.444958+0000","last_became_peered":"2023-11-18T20:39:23.444958+0000","last_unstale":"2023-11-18T20:39:24.494710+0000","last_undegraded":"2023-11-18T20:39:24.494710+0000","last_fullsized":"2023-11-18T20:39:24.494710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:36.401544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.392006+0000","last_change":"2023-11-18T20:39:01.746150+0000","last_active":"2023-11-18T20:39:23.392006+0000","last_peered":"2023-11-18T20:39:23.392006+0000","last_clean":"2023-11-18T20:39:23.392006+0000","last_became_active":"2023-11-18T20:39:01.745893+0000","last_became_peered":"2023-11-18T20:39:01.745893+0000","last_unstale":"2023-11-18T20:39:23.392006+0000","last_undegraded":"2023-11-18T20:39:23.392006+0000","last_fullsized":"2023-11-18T20:39:23.392006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:27.505414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413223+0000","last_change":"2023-11-18T20:39:02.760383+0000","last_active":"2023-11-18T20:39:23.413223+0000","last_peered":"2023-11-18T20:39:23.413223+0000","last_clean":"2023-11-18T20:39:23.413223+0000","last_became_active":"2023-11-18T20:39:02.760126+0000","last_became_peered":"2023-11-18T20:39:02.760126+0000","last_unstale":"2023-11-18T20:39:23.413223+0000","last_undegraded":"2023-11-18T20:39:23.413223+0000","last_fullsized":"2023-11-18T20:39:23.413223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.441711+0000","last_change":"2023-11-18T20:39:22.404538+0000","last_active":"2023-11-18T20:39:23.441711+0000","last_peered":"2023-11-18T20:39:23.441711+0000","last_clean":"2023-11-18T20:39:23.441711+0000","last_became_active":"2023-11-18T20:39:22.404275+0000","last_became_peered":"2023-11-18T20:39:22.404275+0000","last_unstale":"2023-11-18T20:39:23.441711+0000","last_undegraded":"2023-11-18T20:39:23.441711+0000","last_fullsized":"2023-11-18T20:39:23.441711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:20.984416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494724+0000","last_change":"2023-11-18T20:39:23.425133+0000","last_active":"2023-11-18T20:39:24.494724+0000","last_peered":"2023-11-18T20:39:24.494724+0000","last_clean":"2023-11-18T20:39:24.494724+0000","last_became_active":"2023-11-18T20:39:23.424861+0000","last_became_peered":"2023-11-18T20:39:23.424861+0000","last_unstale":"2023-11-18T20:39:24.494724+0000","last_undegraded":"2023-11-18T20:39:24.494724+0000","last_fullsized":"2023-11-18T20:39:24.494724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:25.077001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414704+0000","last_change":"2023-11-18T20:39:01.749138+0000","last_active":"2023-11-18T20:39:23.414704+0000","last_peered":"2023-11-18T20:39:23.414704+0000","last_clean":"2023-11-18T20:39:23.414704+0000","last_became_active":"2023-11-18T20:39:01.748392+0000","last_became_peered":"2023-11-18T20:39:01.748392+0000","last_unstale":"2023-11-18T20:39:23.414704+0000","last_undegraded":"2023-11-18T20:39:23.414704+0000","last_fullsized":"2023-11-18T20:39:23.414704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:41.560904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.425614+0000","last_change":"2023-11-18T20:39:02.763496+0000","last_active":"2023-11-18T20:39:23.425614+0000","last_peered":"2023-11-18T20:39:23.425614+0000","last_clean":"2023-11-18T20:39:23.425614+0000","last_became_active":"2023-11-18T20:39:02.762875+0000","last_became_peered":"2023-11-18T20:39:02.762875+0000","last_unstale":"2023-11-18T20:39:23.425614+0000","last_undegraded":"2023-11-18T20:39:23.425614+0000","last_fullsized":"2023-11-18T20:39:23.425614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.450896+0000","last_change":"2023-11-18T20:39:22.405242+0000","last_active":"2023-11-18T20:39:23.450896+0000","last_peered":"2023-11-18T20:39:23.450896+0000","last_clean":"2023-11-18T20:39:23.450896+0000","last_became_active":"2023-11-18T20:39:22.404935+0000","last_became_peered":"2023-11-18T20:39:22.404935+0000","last_unstale":"2023-11-18T20:39:23.450896+0000","last_undegraded":"2023-11-18T20:39:23.450896+0000","last_fullsized":"2023-11-18T20:39:23.450896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:35.604954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493572+0000","last_change":"2023-11-18T20:39:23.427457+0000","last_active":"2023-11-18T20:39:24.493572+0000","last_peered":"2023-11-18T20:39:24.493572+0000","last_clean":"2023-11-18T20:39:24.493572+0000","last_became_active":"2023-11-18T20:39:23.426833+0000","last_became_peered":"2023-11-18T20:39:23.426833+0000","last_unstale":"2023-11-18T20:39:24.493572+0000","last_undegraded":"2023-11-18T20:39:24.493572+0000","last_fullsized":"2023-11-18T20:39:24.493572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:05.551712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405886+0000","last_change":"2023-11-18T20:39:01.751764+0000","last_active":"2023-11-18T20:39:23.405886+0000","last_peered":"2023-11-18T20:39:23.405886+0000","last_clean":"2023-11-18T20:39:23.405886+0000","last_became_active":"2023-11-18T20:39:01.751500+0000","last_became_peered":"2023-11-18T20:39:01.751500+0000","last_unstale":"2023-11-18T20:39:23.405886+0000","last_undegraded":"2023-11-18T20:39:23.405886+0000","last_fullsized":"2023-11-18T20:39:23.405886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:24.768169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415095+0000","last_change":"2023-11-18T20:39:02.765789+0000","last_active":"2023-11-18T20:39:23.415095+0000","last_peered":"2023-11-18T20:39:23.415095+0000","last_clean":"2023-11-18T20:39:23.415095+0000","last_became_active":"2023-11-18T20:39:02.764984+0000","last_became_peered":"2023-11-18T20:39:02.764984+0000","last_unstale":"2023-11-18T20:39:23.415095+0000","last_undegraded":"2023-11-18T20:39:23.415095+0000","last_fullsized":"2023-11-18T20:39:23.415095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:09:12.803955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397152+0000","last_change":"2023-11-18T20:39:22.403628+0000","last_active":"2023-11-18T20:39:23.397152+0000","last_peered":"2023-11-18T20:39:23.397152+0000","last_clean":"2023-11-18T20:39:23.397152+0000","last_became_active":"2023-11-18T20:39:22.401145+0000","last_became_peered":"2023-11-18T20:39:22.401145+0000","last_unstale":"2023-11-18T20:39:23.397152+0000","last_undegraded":"2023-11-18T20:39:23.397152+0000","last_fullsized":"2023-11-18T20:39:23.397152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:55.116379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419133+0000","last_change":"2023-11-18T20:39:23.439752+0000","last_active":"2023-11-18T20:39:24.419133+0000","last_peered":"2023-11-18T20:39:24.419133+0000","last_clean":"2023-11-18T20:39:24.419133+0000","last_became_active":"2023-11-18T20:39:23.439379+0000","last_became_peered":"2023-11-18T20:39:23.439379+0000","last_unstale":"2023-11-18T20:39:24.419133+0000","last_undegraded":"2023-11-18T20:39:24.419133+0000","last_fullsized":"2023-11-18T20:39:24.419133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:06.573461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.416613+0000","last_change":"2023-11-18T20:39:01.754042+0000","last_active":"2023-11-18T20:39:23.416613+0000","last_peered":"2023-11-18T20:39:23.416613+0000","last_clean":"2023-11-18T20:39:23.416613+0000","last_became_active":"2023-11-18T20:39:01.753658+0000","last_became_peered":"2023-11-18T20:39:01.753658+0000","last_unstale":"2023-11-18T20:39:23.416613+0000","last_undegraded":"2023-11-18T20:39:23.416613+0000","last_fullsized":"2023-11-18T20:39:23.416613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:50.569992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407607+0000","last_change":"2023-11-18T20:39:02.773440+0000","last_active":"2023-11-18T20:39:23.407607+0000","last_peered":"2023-11-18T20:39:23.407607+0000","last_clean":"2023-11-18T20:39:23.407607+0000","last_became_active":"2023-11-18T20:39:02.773133+0000","last_became_peered":"2023-11-18T20:39:02.773133+0000","last_unstale":"2023-11-18T20:39:23.407607+0000","last_undegraded":"2023-11-18T20:39:23.407607+0000","last_fullsized":"2023-11-18T20:39:23.407607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:02.899681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.448335+0000","last_change":"2023-11-18T20:39:22.398608+0000","last_active":"2023-11-18T20:39:23.448335+0000","last_peered":"2023-11-18T20:39:23.448335+0000","last_clean":"2023-11-18T20:39:23.448335+0000","last_became_active":"2023-11-18T20:39:22.398282+0000","last_became_peered":"2023-11-18T20:39:22.398282+0000","last_unstale":"2023-11-18T20:39:23.448335+0000","last_undegraded":"2023-11-18T20:39:23.448335+0000","last_fullsized":"2023-11-18T20:39:23.448335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:24:07.788841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493728+0000","last_change":"2023-11-18T20:39:23.429471+0000","last_active":"2023-11-18T20:39:24.493728+0000","last_peered":"2023-11-18T20:39:24.493728+0000","last_clean":"2023-11-18T20:39:24.493728+0000","last_became_active":"2023-11-18T20:39:23.425105+0000","last_became_peered":"2023-11-18T20:39:23.425105+0000","last_unstale":"2023-11-18T20:39:24.493728+0000","last_undegraded":"2023-11-18T20:39:24.493728+0000","last_fullsized":"2023-11-18T20:39:24.493728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:05.551712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412061+0000","last_change":"2023-11-18T20:39:01.751910+0000","last_active":"2023-11-18T20:39:23.412061+0000","last_peered":"2023-11-18T20:39:23.412061+0000","last_clean":"2023-11-18T20:39:23.412061+0000","last_became_active":"2023-11-18T20:39:01.751568+0000","last_became_peered":"2023-11-18T20:39:01.751568+0000","last_unstale":"2023-11-18T20:39:23.412061+0000","last_undegraded":"2023-11-18T20:39:23.412061+0000","last_fullsized":"2023-11-18T20:39:23.412061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:39:10.283139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.412378+0000","last_change":"2023-11-18T20:39:02.777823+0000","last_active":"2023-11-18T20:39:23.412378+0000","last_peered":"2023-11-18T20:39:23.412378+0000","last_clean":"2023-11-18T20:39:23.412378+0000","last_became_active":"2023-11-18T20:39:02.777456+0000","last_became_peered":"2023-11-18T20:39:02.777456+0000","last_unstale":"2023-11-18T20:39:23.412378+0000","last_undegraded":"2023-11-18T20:39:23.412378+0000","last_fullsized":"2023-11-18T20:39:23.412378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:44.618827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393472+0000","last_change":"2023-11-18T20:39:22.402262+0000","last_active":"2023-11-18T20:39:23.393472+0000","last_peered":"2023-11-18T20:39:23.393472+0000","last_clean":"2023-11-18T20:39:23.393472+0000","last_became_active":"2023-11-18T20:39:22.401944+0000","last_became_peered":"2023-11-18T20:39:22.401944+0000","last_unstale":"2023-11-18T20:39:23.393472+0000","last_undegraded":"2023-11-18T20:39:23.393472+0000","last_fullsized":"2023-11-18T20:39:23.393472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:39.434602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492720+0000","last_change":"2023-11-18T20:39:23.444095+0000","last_active":"2023-11-18T20:39:24.492720+0000","last_peered":"2023-11-18T20:39:24.492720+0000","last_clean":"2023-11-18T20:39:24.492720+0000","last_became_active":"2023-11-18T20:39:23.443826+0000","last_became_peered":"2023-11-18T20:39:23.443826+0000","last_unstale":"2023-11-18T20:39:24.492720+0000","last_undegraded":"2023-11-18T20:39:24.492720+0000","last_fullsized":"2023-11-18T20:39:24.492720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:58.405497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415943+0000","last_change":"2023-11-18T20:39:01.744340+0000","last_active":"2023-11-18T20:39:23.415943+0000","last_peered":"2023-11-18T20:39:23.415943+0000","last_clean":"2023-11-18T20:39:23.415943+0000","last_became_active":"2023-11-18T20:39:01.744042+0000","last_became_peered":"2023-11-18T20:39:01.744042+0000","last_unstale":"2023-11-18T20:39:23.415943+0000","last_undegraded":"2023-11-18T20:39:23.415943+0000","last_fullsized":"2023-11-18T20:39:23.415943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:52:57.711383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403600+0000","last_change":"2023-11-18T20:39:02.767695+0000","last_active":"2023-11-18T20:39:23.403600+0000","last_peered":"2023-11-18T20:39:23.403600+0000","last_clean":"2023-11-18T20:39:23.403600+0000","last_became_active":"2023-11-18T20:39:02.765964+0000","last_became_peered":"2023-11-18T20:39:02.765964+0000","last_unstale":"2023-11-18T20:39:23.403600+0000","last_undegraded":"2023-11-18T20:39:23.403600+0000","last_fullsized":"2023-11-18T20:39:23.403600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:30:33.776259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449118+0000","last_change":"2023-11-18T20:39:22.406580+0000","last_active":"2023-11-18T20:39:23.449118+0000","last_peered":"2023-11-18T20:39:23.449118+0000","last_clean":"2023-11-18T20:39:23.449118+0000","last_became_active":"2023-11-18T20:39:22.405573+0000","last_became_peered":"2023-11-18T20:39:22.405573+0000","last_unstale":"2023-11-18T20:39:23.449118+0000","last_undegraded":"2023-11-18T20:39:23.449118+0000","last_fullsized":"2023-11-18T20:39:23.449118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:46:14.675100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417717+0000","last_change":"2023-11-18T20:39:23.418507+0000","last_active":"2023-11-18T20:39:24.417717+0000","last_peered":"2023-11-18T20:39:24.417717+0000","last_clean":"2023-11-18T20:39:24.417717+0000","last_became_active":"2023-11-18T20:39:23.418209+0000","last_became_peered":"2023-11-18T20:39:23.418209+0000","last_unstale":"2023-11-18T20:39:24.417717+0000","last_undegraded":"2023-11-18T20:39:24.417717+0000","last_fullsized":"2023-11-18T20:39:24.417717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:43.939166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414749+0000","last_change":"2023-11-18T20:39:01.755303+0000","last_active":"2023-11-18T20:39:23.414749+0000","last_peered":"2023-11-18T20:39:23.414749+0000","last_clean":"2023-11-18T20:39:23.414749+0000","last_became_active":"2023-11-18T20:39:01.754946+0000","last_became_peered":"2023-11-18T20:39:01.754946+0000","last_unstale":"2023-11-18T20:39:23.414749+0000","last_undegraded":"2023-11-18T20:39:23.414749+0000","last_fullsized":"2023-11-18T20:39:23.414749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413806+0000","last_change":"2023-11-18T20:39:02.748892+0000","last_active":"2023-11-18T20:39:23.413806+0000","last_peered":"2023-11-18T20:39:23.413806+0000","last_clean":"2023-11-18T20:39:23.413806+0000","last_became_active":"2023-11-18T20:39:02.748392+0000","last_became_peered":"2023-11-18T20:39:02.748392+0000","last_unstale":"2023-11-18T20:39:23.413806+0000","last_undegraded":"2023-11-18T20:39:23.413806+0000","last_fullsized":"2023-11-18T20:39:23.413806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:18.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.449318+0000","last_change":"2023-11-18T20:39:22.383835+0000","last_active":"2023-11-18T20:39:23.449318+0000","last_peered":"2023-11-18T20:39:23.449318+0000","last_clean":"2023-11-18T20:39:23.449318+0000","last_became_active":"2023-11-18T20:39:22.383055+0000","last_became_peered":"2023-11-18T20:39:22.383055+0000","last_unstale":"2023-11-18T20:39:23.449318+0000","last_undegraded":"2023-11-18T20:39:23.449318+0000","last_fullsized":"2023-11-18T20:39:23.449318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:05.923006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493264+0000","last_change":"2023-11-18T20:39:23.434794+0000","last_active":"2023-11-18T20:39:24.493264+0000","last_peered":"2023-11-18T20:39:24.493264+0000","last_clean":"2023-11-18T20:39:24.493264+0000","last_became_active":"2023-11-18T20:39:23.434508+0000","last_became_peered":"2023-11-18T20:39:23.434508+0000","last_unstale":"2023-11-18T20:39:24.493264+0000","last_undegraded":"2023-11-18T20:39:24.493264+0000","last_fullsized":"2023-11-18T20:39:24.493264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:38.915609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404337+0000","last_change":"2023-11-18T20:39:01.748705+0000","last_active":"2023-11-18T20:39:23.404337+0000","last_peered":"2023-11-18T20:39:23.404337+0000","last_clean":"2023-11-18T20:39:23.404337+0000","last_became_active":"2023-11-18T20:39:01.748406+0000","last_became_peered":"2023-11-18T20:39:01.748406+0000","last_unstale":"2023-11-18T20:39:23.404337+0000","last_undegraded":"2023-11-18T20:39:23.404337+0000","last_fullsized":"2023-11-18T20:39:23.404337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:23:46.427438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396780+0000","last_change":"2023-11-18T20:39:02.755872+0000","last_active":"2023-11-18T20:39:23.396780+0000","last_peered":"2023-11-18T20:39:23.396780+0000","last_clean":"2023-11-18T20:39:23.396780+0000","last_became_active":"2023-11-18T20:39:02.755415+0000","last_became_peered":"2023-11-18T20:39:02.755415+0000","last_unstale":"2023-11-18T20:39:23.396780+0000","last_undegraded":"2023-11-18T20:39:23.396780+0000","last_fullsized":"2023-11-18T20:39:23.396780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:08.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.395696+0000","last_change":"2023-11-18T20:39:22.403667+0000","last_active":"2023-11-18T20:39:23.395696+0000","last_peered":"2023-11-18T20:39:23.395696+0000","last_clean":"2023-11-18T20:39:23.395696+0000","last_became_active":"2023-11-18T20:39:22.402205+0000","last_became_peered":"2023-11-18T20:39:22.402205+0000","last_unstale":"2023-11-18T20:39:23.395696+0000","last_undegraded":"2023-11-18T20:39:23.395696+0000","last_fullsized":"2023-11-18T20:39:23.395696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:17:50.919163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494419+0000","last_change":"2023-11-18T20:39:23.422652+0000","last_active":"2023-11-18T20:39:24.494419+0000","last_peered":"2023-11-18T20:39:24.494419+0000","last_clean":"2023-11-18T20:39:24.494419+0000","last_became_active":"2023-11-18T20:39:23.420660+0000","last_became_peered":"2023-11-18T20:39:23.420660+0000","last_unstale":"2023-11-18T20:39:24.494419+0000","last_undegraded":"2023-11-18T20:39:24.494419+0000","last_fullsized":"2023-11-18T20:39:24.494419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'8","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397812+0000","last_change":"2023-11-18T20:39:01.755650+0000","last_active":"2023-11-18T20:39:23.397812+0000","last_peered":"2023-11-18T20:39:23.397812+0000","last_clean":"2023-11-18T20:39:23.397812+0000","last_became_active":"2023-11-18T20:39:01.754863+0000","last_became_peered":"2023-11-18T20:39:01.754863+0000","last_unstale":"2023-11-18T20:39:23.397812+0000","last_undegraded":"2023-11-18T20:39:23.397812+0000","last_fullsized":"2023-11-18T20:39:23.397812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:26.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414434+0000","last_change":"2023-11-18T20:39:02.774185+0000","last_active":"2023-11-18T20:39:23.414434+0000","last_peered":"2023-11-18T20:39:23.414434+0000","last_clean":"2023-11-18T20:39:23.414434+0000","last_became_active":"2023-11-18T20:39:02.773865+0000","last_became_peered":"2023-11-18T20:39:02.773865+0000","last_unstale":"2023-11-18T20:39:23.414434+0000","last_undegraded":"2023-11-18T20:39:23.414434+0000","last_fullsized":"2023-11-18T20:39:23.414434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:29.774288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422277+0000","last_change":"2023-11-18T20:39:22.399738+0000","last_active":"2023-11-18T20:39:23.422277+0000","last_peered":"2023-11-18T20:39:23.422277+0000","last_clean":"2023-11-18T20:39:23.422277+0000","last_became_active":"2023-11-18T20:39:22.399456+0000","last_became_peered":"2023-11-18T20:39:22.399456+0000","last_unstale":"2023-11-18T20:39:23.422277+0000","last_undegraded":"2023-11-18T20:39:23.422277+0000","last_fullsized":"2023-11-18T20:39:23.422277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:41.606873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494888+0000","last_change":"2023-11-18T20:39:23.434431+0000","last_active":"2023-11-18T20:39:24.494888+0000","last_peered":"2023-11-18T20:39:24.494888+0000","last_clean":"2023-11-18T20:39:24.494888+0000","last_became_active":"2023-11-18T20:39:23.433510+0000","last_became_peered":"2023-11-18T20:39:23.433510+0000","last_unstale":"2023-11-18T20:39:24.494888+0000","last_undegraded":"2023-11-18T20:39:24.494888+0000","last_fullsized":"2023-11-18T20:39:24.494888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:36.401544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414524+0000","last_change":"2023-11-18T20:39:01.753509+0000","last_active":"2023-11-18T20:39:23.414524+0000","last_peered":"2023-11-18T20:39:23.414524+0000","last_clean":"2023-11-18T20:39:23.414524+0000","last_became_active":"2023-11-18T20:39:01.753174+0000","last_became_peered":"2023-11-18T20:39:01.753174+0000","last_unstale":"2023-11-18T20:39:23.414524+0000","last_undegraded":"2023-11-18T20:39:23.414524+0000","last_fullsized":"2023-11-18T20:39:23.414524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:25.771785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422233+0000","last_change":"2023-11-18T20:39:02.753904+0000","last_active":"2023-11-18T20:39:23.422233+0000","last_peered":"2023-11-18T20:39:23.422233+0000","last_clean":"2023-11-18T20:39:23.422233+0000","last_became_active":"2023-11-18T20:39:02.753415+0000","last_became_peered":"2023-11-18T20:39:02.753415+0000","last_unstale":"2023-11-18T20:39:23.422233+0000","last_undegraded":"2023-11-18T20:39:23.422233+0000","last_fullsized":"2023-11-18T20:39:23.422233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414852+0000","last_change":"2023-11-18T20:39:22.398779+0000","last_active":"2023-11-18T20:39:23.414852+0000","last_peered":"2023-11-18T20:39:23.414852+0000","last_clean":"2023-11-18T20:39:23.414852+0000","last_became_active":"2023-11-18T20:39:22.398477+0000","last_became_peered":"2023-11-18T20:39:22.398477+0000","last_unstale":"2023-11-18T20:39:23.414852+0000","last_undegraded":"2023-11-18T20:39:23.414852+0000","last_fullsized":"2023-11-18T20:39:23.414852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:31:02.989486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494145+0000","last_change":"2023-11-18T20:39:23.438807+0000","last_active":"2023-11-18T20:39:24.494145+0000","last_peered":"2023-11-18T20:39:24.494145+0000","last_clean":"2023-11-18T20:39:24.494145+0000","last_became_active":"2023-11-18T20:39:23.438271+0000","last_became_peered":"2023-11-18T20:39:23.438271+0000","last_unstale":"2023-11-18T20:39:24.494145+0000","last_undegraded":"2023-11-18T20:39:24.494145+0000","last_fullsized":"2023-11-18T20:39:24.494145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:53:48.228541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427598+0000","last_change":"2023-11-18T20:39:01.752276+0000","last_active":"2023-11-18T20:39:23.427598+0000","last_peered":"2023-11-18T20:39:23.427598+0000","last_clean":"2023-11-18T20:39:23.427598+0000","last_became_active":"2023-11-18T20:39:01.751648+0000","last_became_peered":"2023-11-18T20:39:01.751648+0000","last_unstale":"2023-11-18T20:39:23.427598+0000","last_undegraded":"2023-11-18T20:39:23.427598+0000","last_fullsized":"2023-11-18T20:39:23.427598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427187+0000","last_change":"2023-11-18T20:39:02.763642+0000","last_active":"2023-11-18T20:39:23.427187+0000","last_peered":"2023-11-18T20:39:23.427187+0000","last_clean":"2023-11-18T20:39:23.427187+0000","last_became_active":"2023-11-18T20:39:02.763357+0000","last_became_peered":"2023-11-18T20:39:02.763357+0000","last_unstale":"2023-11-18T20:39:23.427187+0000","last_undegraded":"2023-11-18T20:39:23.427187+0000","last_fullsized":"2023-11-18T20:39:23.427187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:04.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.452282+0000","last_change":"2023-11-18T20:39:22.398742+0000","last_active":"2023-11-18T20:39:23.452282+0000","last_peered":"2023-11-18T20:39:23.452282+0000","last_clean":"2023-11-18T20:39:23.452282+0000","last_became_active":"2023-11-18T20:39:22.397880+0000","last_became_peered":"2023-11-18T20:39:22.397880+0000","last_unstale":"2023-11-18T20:39:23.452282+0000","last_undegraded":"2023-11-18T20:39:23.452282+0000","last_fullsized":"2023-11-18T20:39:23.452282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:40.332897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.497129+0000","last_change":"2023-11-18T20:39:23.446378+0000","last_active":"2023-11-18T20:39:24.497129+0000","last_peered":"2023-11-18T20:39:24.497129+0000","last_clean":"2023-11-18T20:39:24.497129+0000","last_became_active":"2023-11-18T20:39:23.445327+0000","last_became_peered":"2023-11-18T20:39:23.445327+0000","last_unstale":"2023-11-18T20:39:24.497129+0000","last_undegraded":"2023-11-18T20:39:24.497129+0000","last_fullsized":"2023-11-18T20:39:24.497129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:03.443291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.432067+0000","last_change":"2023-11-18T20:39:01.741060+0000","last_active":"2023-11-18T20:39:23.432067+0000","last_peered":"2023-11-18T20:39:23.432067+0000","last_clean":"2023-11-18T20:39:23.432067+0000","last_became_active":"2023-11-18T20:39:01.738368+0000","last_became_peered":"2023-11-18T20:39:01.738368+0000","last_unstale":"2023-11-18T20:39:23.432067+0000","last_undegraded":"2023-11-18T20:39:23.432067+0000","last_fullsized":"2023-11-18T20:39:23.432067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:19.109348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.407326+0000","last_change":"2023-11-18T20:39:02.759699+0000","last_active":"2023-11-18T20:39:23.407326+0000","last_peered":"2023-11-18T20:39:23.407326+0000","last_clean":"2023-11-18T20:39:23.407326+0000","last_became_active":"2023-11-18T20:39:02.759410+0000","last_became_peered":"2023-11-18T20:39:02.759410+0000","last_unstale":"2023-11-18T20:39:23.407326+0000","last_undegraded":"2023-11-18T20:39:23.407326+0000","last_fullsized":"2023-11-18T20:39:23.407326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:52:49.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.436190+0000","last_change":"2023-11-18T20:39:22.393343+0000","last_active":"2023-11-18T20:39:23.436190+0000","last_peered":"2023-11-18T20:39:23.436190+0000","last_clean":"2023-11-18T20:39:23.436190+0000","last_became_active":"2023-11-18T20:39:22.392729+0000","last_became_peered":"2023-11-18T20:39:22.392729+0000","last_unstale":"2023-11-18T20:39:23.436190+0000","last_undegraded":"2023-11-18T20:39:23.436190+0000","last_fullsized":"2023-11-18T20:39:23.436190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:18.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421141+0000","last_change":"2023-11-18T20:39:23.447500+0000","last_active":"2023-11-18T20:39:24.421141+0000","last_peered":"2023-11-18T20:39:24.421141+0000","last_clean":"2023-11-18T20:39:24.421141+0000","last_became_active":"2023-11-18T20:39:23.447118+0000","last_became_peered":"2023-11-18T20:39:23.447118+0000","last_unstale":"2023-11-18T20:39:24.421141+0000","last_undegraded":"2023-11-18T20:39:24.421141+0000","last_fullsized":"2023-11-18T20:39:24.421141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:23.674417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403828+0000","last_change":"2023-11-18T20:39:01.749447+0000","last_active":"2023-11-18T20:39:23.403828+0000","last_peered":"2023-11-18T20:39:23.403828+0000","last_clean":"2023-11-18T20:39:23.403828+0000","last_became_active":"2023-11-18T20:39:01.748841+0000","last_became_peered":"2023-11-18T20:39:01.748841+0000","last_unstale":"2023-11-18T20:39:23.403828+0000","last_undegraded":"2023-11-18T20:39:23.403828+0000","last_fullsized":"2023-11-18T20:39:23.403828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:07.644802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415861+0000","last_change":"2023-11-18T20:39:02.770693+0000","last_active":"2023-11-18T20:39:23.415861+0000","last_peered":"2023-11-18T20:39:23.415861+0000","last_clean":"2023-11-18T20:39:23.415861+0000","last_became_active":"2023-11-18T20:39:02.766515+0000","last_became_peered":"2023-11-18T20:39:02.766515+0000","last_unstale":"2023-11-18T20:39:23.415861+0000","last_undegraded":"2023-11-18T20:39:23.415861+0000","last_fullsized":"2023-11-18T20:39:23.415861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447319+0000","last_change":"2023-11-18T20:39:22.402398+0000","last_active":"2023-11-18T20:39:23.447319+0000","last_peered":"2023-11-18T20:39:23.447319+0000","last_clean":"2023-11-18T20:39:23.447319+0000","last_became_active":"2023-11-18T20:39:22.401355+0000","last_became_peered":"2023-11-18T20:39:22.401355+0000","last_unstale":"2023-11-18T20:39:23.447319+0000","last_undegraded":"2023-11-18T20:39:23.447319+0000","last_fullsized":"2023-11-18T20:39:23.447319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:39:09.138913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492614+0000","last_change":"2023-11-18T20:39:23.420099+0000","last_active":"2023-11-18T20:39:24.492614+0000","last_peered":"2023-11-18T20:39:24.492614+0000","last_clean":"2023-11-18T20:39:24.492614+0000","last_became_active":"2023-11-18T20:39:23.418883+0000","last_became_peered":"2023-11-18T20:39:23.418883+0000","last_unstale":"2023-11-18T20:39:24.492614+0000","last_undegraded":"2023-11-18T20:39:24.492614+0000","last_fullsized":"2023-11-18T20:39:24.492614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:29:19.381062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413271+0000","last_change":"2023-11-18T20:39:01.753777+0000","last_active":"2023-11-18T20:39:23.413271+0000","last_peered":"2023-11-18T20:39:23.413271+0000","last_clean":"2023-11-18T20:39:23.413271+0000","last_became_active":"2023-11-18T20:39:01.753452+0000","last_became_peered":"2023-11-18T20:39:01.753452+0000","last_unstale":"2023-11-18T20:39:23.413271+0000","last_undegraded":"2023-11-18T20:39:23.413271+0000","last_fullsized":"2023-11-18T20:39:23.413271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:37.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.411822+0000","last_change":"2023-11-18T20:39:02.772323+0000","last_active":"2023-11-18T20:39:23.411822+0000","last_peered":"2023-11-18T20:39:23.411822+0000","last_clean":"2023-11-18T20:39:23.411822+0000","last_became_active":"2023-11-18T20:39:02.771746+0000","last_became_peered":"2023-11-18T20:39:02.771746+0000","last_unstale":"2023-11-18T20:39:23.411822+0000","last_undegraded":"2023-11-18T20:39:23.411822+0000","last_fullsized":"2023-11-18T20:39:23.411822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:51.574371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.442222+0000","last_change":"2023-11-18T20:39:22.401734+0000","last_active":"2023-11-18T20:39:23.442222+0000","last_peered":"2023-11-18T20:39:23.442222+0000","last_clean":"2023-11-18T20:39:23.442222+0000","last_became_active":"2023-11-18T20:39:22.398776+0000","last_became_peered":"2023-11-18T20:39:22.398776+0000","last_unstale":"2023-11-18T20:39:23.442222+0000","last_undegraded":"2023-11-18T20:39:23.442222+0000","last_fullsized":"2023-11-18T20:39:23.442222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:42.979247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492749+0000","last_change":"2023-11-18T20:39:23.428158+0000","last_active":"2023-11-18T20:39:24.492749+0000","last_peered":"2023-11-18T20:39:24.492749+0000","last_clean":"2023-11-18T20:39:24.492749+0000","last_became_active":"2023-11-18T20:39:23.427875+0000","last_became_peered":"2023-11-18T20:39:23.427875+0000","last_unstale":"2023-11-18T20:39:24.492749+0000","last_undegraded":"2023-11-18T20:39:24.492749+0000","last_fullsized":"2023-11-18T20:39:24.492749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:41:28.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403425+0000","last_change":"2023-11-18T20:39:01.746835+0000","last_active":"2023-11-18T20:39:23.403425+0000","last_peered":"2023-11-18T20:39:23.403425+0000","last_clean":"2023-11-18T20:39:23.403425+0000","last_became_active":"2023-11-18T20:39:01.746515+0000","last_became_peered":"2023-11-18T20:39:01.746515+0000","last_unstale":"2023-11-18T20:39:23.403425+0000","last_undegraded":"2023-11-18T20:39:23.403425+0000","last_fullsized":"2023-11-18T20:39:23.403425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:47.442387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404066+0000","last_change":"2023-11-18T20:39:02.754613+0000","last_active":"2023-11-18T20:39:23.404066+0000","last_peered":"2023-11-18T20:39:23.404066+0000","last_clean":"2023-11-18T20:39:23.404066+0000","last_became_active":"2023-11-18T20:39:02.754350+0000","last_became_peered":"2023-11-18T20:39:02.754350+0000","last_unstale":"2023-11-18T20:39:23.404066+0000","last_undegraded":"2023-11-18T20:39:23.404066+0000","last_fullsized":"2023-11-18T20:39:23.404066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415693+0000","last_change":"2023-11-18T20:39:22.406251+0000","last_active":"2023-11-18T20:39:23.415693+0000","last_peered":"2023-11-18T20:39:23.415693+0000","last_clean":"2023-11-18T20:39:23.415693+0000","last_became_active":"2023-11-18T20:39:22.405901+0000","last_became_peered":"2023-11-18T20:39:22.405901+0000","last_unstale":"2023-11-18T20:39:23.415693+0000","last_undegraded":"2023-11-18T20:39:23.415693+0000","last_fullsized":"2023-11-18T20:39:23.415693+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:47.004453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418917+0000","last_change":"2023-11-18T20:39:23.430972+0000","last_active":"2023-11-18T20:39:24.418917+0000","last_peered":"2023-11-18T20:39:24.418917+0000","last_clean":"2023-11-18T20:39:24.418917+0000","last_became_active":"2023-11-18T20:39:23.430684+0000","last_became_peered":"2023-11-18T20:39:23.430684+0000","last_unstale":"2023-11-18T20:39:24.418917+0000","last_undegraded":"2023-11-18T20:39:24.418917+0000","last_fullsized":"2023-11-18T20:39:24.418917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:41:54.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404200+0000","last_change":"2023-11-18T20:39:01.748087+0000","last_active":"2023-11-18T20:39:23.404200+0000","last_peered":"2023-11-18T20:39:23.404200+0000","last_clean":"2023-11-18T20:39:23.404200+0000","last_became_active":"2023-11-18T20:39:01.747023+0000","last_became_peered":"2023-11-18T20:39:01.747023+0000","last_unstale":"2023-11-18T20:39:23.404200+0000","last_undegraded":"2023-11-18T20:39:23.404200+0000","last_fullsized":"2023-11-18T20:39:23.404200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:58.265299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413690+0000","last_change":"2023-11-18T20:39:02.774591+0000","last_active":"2023-11-18T20:39:23.413690+0000","last_peered":"2023-11-18T20:39:23.413690+0000","last_clean":"2023-11-18T20:39:23.413690+0000","last_became_active":"2023-11-18T20:39:02.774338+0000","last_became_peered":"2023-11-18T20:39:02.774338+0000","last_unstale":"2023-11-18T20:39:23.413690+0000","last_undegraded":"2023-11-18T20:39:23.413690+0000","last_fullsized":"2023-11-18T20:39:23.413690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:32.560325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398471+0000","last_change":"2023-11-18T20:39:22.406308+0000","last_active":"2023-11-18T20:39:23.398471+0000","last_peered":"2023-11-18T20:39:23.398471+0000","last_clean":"2023-11-18T20:39:23.398471+0000","last_became_active":"2023-11-18T20:39:22.405980+0000","last_became_peered":"2023-11-18T20:39:22.405980+0000","last_unstale":"2023-11-18T20:39:23.398471+0000","last_undegraded":"2023-11-18T20:39:23.398471+0000","last_fullsized":"2023-11-18T20:39:23.398471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:48.566281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496412+0000","last_change":"2023-11-18T20:39:23.423726+0000","last_active":"2023-11-18T20:39:24.496412+0000","last_peered":"2023-11-18T20:39:24.496412+0000","last_clean":"2023-11-18T20:39:24.496412+0000","last_became_active":"2023-11-18T20:39:23.423431+0000","last_became_peered":"2023-11-18T20:39:23.423431+0000","last_unstale":"2023-11-18T20:39:24.496412+0000","last_undegraded":"2023-11-18T20:39:24.496412+0000","last_fullsized":"2023-11-18T20:39:24.496412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447164+0000","last_change":"2023-11-18T20:39:22.399160+0000","last_active":"2023-11-18T20:39:23.447164+0000","last_peered":"2023-11-18T20:39:23.447164+0000","last_clean":"2023-11-18T20:39:23.447164+0000","last_became_active":"2023-11-18T20:39:22.397086+0000","last_became_peered":"2023-11-18T20:39:22.397086+0000","last_unstale":"2023-11-18T20:39:23.447164+0000","last_undegraded":"2023-11-18T20:39:23.447164+0000","last_fullsized":"2023-11-18T20:39:23.447164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:31.506417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422373+0000","last_change":"2023-11-18T20:39:01.753947+0000","last_active":"2023-11-18T20:39:23.422373+0000","last_peered":"2023-11-18T20:39:23.422373+0000","last_clean":"2023-11-18T20:39:23.422373+0000","last_became_active":"2023-11-18T20:39:01.753706+0000","last_became_peered":"2023-11-18T20:39:01.753706+0000","last_unstale":"2023-11-18T20:39:23.422373+0000","last_undegraded":"2023-11-18T20:39:23.422373+0000","last_fullsized":"2023-11-18T20:39:23.422373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:12.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415204+0000","last_change":"2023-11-18T20:39:02.758817+0000","last_active":"2023-11-18T20:39:23.415204+0000","last_peered":"2023-11-18T20:39:23.415204+0000","last_clean":"2023-11-18T20:39:23.415204+0000","last_became_active":"2023-11-18T20:39:02.758440+0000","last_became_peered":"2023-11-18T20:39:02.758440+0000","last_unstale":"2023-11-18T20:39:23.415204+0000","last_undegraded":"2023-11-18T20:39:23.415204+0000","last_fullsized":"2023-11-18T20:39:23.415204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494320+0000","last_change":"2023-11-18T20:39:23.440848+0000","last_active":"2023-11-18T20:39:24.494320+0000","last_peered":"2023-11-18T20:39:24.494320+0000","last_clean":"2023-11-18T20:39:24.494320+0000","last_became_active":"2023-11-18T20:39:23.440178+0000","last_became_peered":"2023-11-18T20:39:23.440178+0000","last_unstale":"2023-11-18T20:39:24.494320+0000","last_undegraded":"2023-11-18T20:39:24.494320+0000","last_fullsized":"2023-11-18T20:39:24.494320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.442140+0000","last_change":"2023-11-18T20:39:22.399945+0000","last_active":"2023-11-18T20:39:23.442140+0000","last_peered":"2023-11-18T20:39:23.442140+0000","last_clean":"2023-11-18T20:39:23.442140+0000","last_became_active":"2023-11-18T20:39:22.399644+0000","last_became_peered":"2023-11-18T20:39:22.399644+0000","last_unstale":"2023-11-18T20:39:23.442140+0000","last_undegraded":"2023-11-18T20:39:23.442140+0000","last_fullsized":"2023-11-18T20:39:23.442140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:20.630662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413693+0000","last_change":"2023-11-18T20:39:01.756216+0000","last_active":"2023-11-18T20:39:23.413693+0000","last_peered":"2023-11-18T20:39:23.413693+0000","last_clean":"2023-11-18T20:39:23.413693+0000","last_became_active":"2023-11-18T20:39:01.755917+0000","last_became_peered":"2023-11-18T20:39:01.755917+0000","last_unstale":"2023-11-18T20:39:23.413693+0000","last_undegraded":"2023-11-18T20:39:23.413693+0000","last_fullsized":"2023-11-18T20:39:23.413693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:19:31.555946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.404234+0000","last_change":"2023-11-18T20:39:02.751638+0000","last_active":"2023-11-18T20:39:23.404234+0000","last_peered":"2023-11-18T20:39:23.404234+0000","last_clean":"2023-11-18T20:39:23.404234+0000","last_became_active":"2023-11-18T20:39:02.751330+0000","last_became_peered":"2023-11-18T20:39:02.751330+0000","last_unstale":"2023-11-18T20:39:23.404234+0000","last_undegraded":"2023-11-18T20:39:23.404234+0000","last_fullsized":"2023-11-18T20:39:23.404234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495418+0000","last_change":"2023-11-18T20:39:23.426282+0000","last_active":"2023-11-18T20:39:24.495418+0000","last_peered":"2023-11-18T20:39:24.495418+0000","last_clean":"2023-11-18T20:39:24.495418+0000","last_became_active":"2023-11-18T20:39:23.426011+0000","last_became_peered":"2023-11-18T20:39:23.426011+0000","last_unstale":"2023-11-18T20:39:24.495418+0000","last_undegraded":"2023-11-18T20:39:24.495418+0000","last_fullsized":"2023-11-18T20:39:24.495418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:42.619588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422645+0000","last_change":"2023-11-18T20:39:01.754588+0000","last_active":"2023-11-18T20:39:23.422645+0000","last_peered":"2023-11-18T20:39:23.422645+0000","last_clean":"2023-11-18T20:39:23.422645+0000","last_became_active":"2023-11-18T20:39:01.754314+0000","last_became_peered":"2023-11-18T20:39:01.754314+0000","last_unstale":"2023-11-18T20:39:23.422645+0000","last_undegraded":"2023-11-18T20:39:23.422645+0000","last_fullsized":"2023-11-18T20:39:23.422645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:17.458620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405311+0000","last_change":"2023-11-18T20:39:02.761289+0000","last_active":"2023-11-18T20:39:23.405311+0000","last_peered":"2023-11-18T20:39:23.405311+0000","last_clean":"2023-11-18T20:39:23.405311+0000","last_became_active":"2023-11-18T20:39:02.760948+0000","last_became_peered":"2023-11-18T20:39:02.760948+0000","last_unstale":"2023-11-18T20:39:23.405311+0000","last_undegraded":"2023-11-18T20:39:23.405311+0000","last_fullsized":"2023-11-18T20:39:23.405311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:45:55.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.447327+0000","last_change":"2023-11-18T20:39:22.400658+0000","last_active":"2023-11-18T20:39:23.447327+0000","last_peered":"2023-11-18T20:39:23.447327+0000","last_clean":"2023-11-18T20:39:23.447327+0000","last_became_active":"2023-11-18T20:39:22.399324+0000","last_became_peered":"2023-11-18T20:39:22.399324+0000","last_unstale":"2023-11-18T20:39:23.447327+0000","last_undegraded":"2023-11-18T20:39:23.447327+0000","last_fullsized":"2023-11-18T20:39:23.447327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:22.449238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418745+0000","last_change":"2023-11-18T20:39:23.432727+0000","last_active":"2023-11-18T20:39:24.418745+0000","last_peered":"2023-11-18T20:39:24.418745+0000","last_clean":"2023-11-18T20:39:24.418745+0000","last_became_active":"2023-11-18T20:39:23.432461+0000","last_became_peered":"2023-11-18T20:39:23.432461+0000","last_unstale":"2023-11-18T20:39:24.418745+0000","last_undegraded":"2023-11-18T20:39:24.418745+0000","last_fullsized":"2023-11-18T20:39:24.418745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406905+0000","last_change":"2023-11-18T20:39:01.749668+0000","last_active":"2023-11-18T20:39:23.406905+0000","last_peered":"2023-11-18T20:39:23.406905+0000","last_clean":"2023-11-18T20:39:23.406905+0000","last_became_active":"2023-11-18T20:39:01.749373+0000","last_became_peered":"2023-11-18T20:39:01.749373+0000","last_unstale":"2023-11-18T20:39:23.406905+0000","last_undegraded":"2023-11-18T20:39:23.406905+0000","last_fullsized":"2023-11-18T20:39:23.406905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:00.706094+0000","last_clean_scrub_stamp":"2023-11-18T20:39:00.706094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:00.564472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397605+0000","last_change":"2023-11-18T20:39:02.761380+0000","last_active":"2023-11-18T20:39:23.397605+0000","last_peered":"2023-11-18T20:39:23.397605+0000","last_clean":"2023-11-18T20:39:23.397605+0000","last_became_active":"2023-11-18T20:39:02.760958+0000","last_became_peered":"2023-11-18T20:39:02.760958+0000","last_unstale":"2023-11-18T20:39:23.397605+0000","last_undegraded":"2023-11-18T20:39:23.397605+0000","last_fullsized":"2023-11-18T20:39:23.397605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:25.114138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.438778+0000","last_change":"2023-11-18T20:39:22.400634+0000","last_active":"2023-11-18T20:39:23.438778+0000","last_peered":"2023-11-18T20:39:23.438778+0000","last_clean":"2023-11-18T20:39:23.438778+0000","last_became_active":"2023-11-18T20:39:22.399955+0000","last_became_peered":"2023-11-18T20:39:22.399955+0000","last_unstale":"2023-11-18T20:39:23.438778+0000","last_undegraded":"2023-11-18T20:39:23.438778+0000","last_fullsized":"2023-11-18T20:39:23.438778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:21.346656+0000","last_clean_scrub_stamp":"2023-11-18T20:39:21.346656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:53:21.205034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417953+0000","last_change":"2023-11-18T20:39:23.419745+0000","last_active":"2023-11-18T20:39:24.417953+0000","last_peered":"2023-11-18T20:39:24.417953+0000","last_clean":"2023-11-18T20:39:24.417953+0000","last_became_active":"2023-11-18T20:39:23.419381+0000","last_became_peered":"2023-11-18T20:39:23.419381+0000","last_unstale":"2023-11-18T20:39:24.417953+0000","last_undegraded":"2023-11-18T20:39:24.417953+0000","last_fullsized":"2023-11-18T20:39:24.417953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406778+0000","last_change":"2023-11-18T20:39:02.764472+0000","last_active":"2023-11-18T20:39:23.406778+0000","last_peered":"2023-11-18T20:39:23.406778+0000","last_clean":"2023-11-18T20:39:23.406778+0000","last_became_active":"2023-11-18T20:39:02.764087+0000","last_became_peered":"2023-11-18T20:39:02.764087+0000","last_unstale":"2023-11-18T20:39:23.406778+0000","last_undegraded":"2023-11-18T20:39:23.406778+0000","last_fullsized":"2023-11-18T20:39:23.406778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:00.994479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495181+0000","last_change":"2023-11-18T20:39:23.428059+0000","last_active":"2023-11-18T20:39:24.495181+0000","last_peered":"2023-11-18T20:39:24.495181+0000","last_clean":"2023-11-18T20:39:24.495181+0000","last_became_active":"2023-11-18T20:39:23.427465+0000","last_became_peered":"2023-11-18T20:39:23.427465+0000","last_unstale":"2023-11-18T20:39:24.495181+0000","last_undegraded":"2023-11-18T20:39:24.495181+0000","last_fullsized":"2023-11-18T20:39:24.495181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:04:36.617668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405159+0000","last_change":"2023-11-18T20:39:02.767291+0000","last_active":"2023-11-18T20:39:23.405159+0000","last_peered":"2023-11-18T20:39:23.405159+0000","last_clean":"2023-11-18T20:39:23.405159+0000","last_became_active":"2023-11-18T20:39:02.764390+0000","last_became_peered":"2023-11-18T20:39:02.764390+0000","last_unstale":"2023-11-18T20:39:23.405159+0000","last_undegraded":"2023-11-18T20:39:23.405159+0000","last_fullsized":"2023-11-18T20:39:23.405159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496394+0000","last_change":"2023-11-18T20:39:23.432917+0000","last_active":"2023-11-18T20:39:24.496394+0000","last_peered":"2023-11-18T20:39:24.496394+0000","last_clean":"2023-11-18T20:39:24.496394+0000","last_became_active":"2023-11-18T20:39:23.428767+0000","last_became_peered":"2023-11-18T20:39:23.428767+0000","last_unstale":"2023-11-18T20:39:24.496394+0000","last_undegraded":"2023-11-18T20:39:24.496394+0000","last_fullsized":"2023-11-18T20:39:24.496394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:41:24.537974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393169+0000","last_change":"2023-11-18T20:39:02.758480+0000","last_active":"2023-11-18T20:39:23.393169+0000","last_peered":"2023-11-18T20:39:23.393169+0000","last_clean":"2023-11-18T20:39:23.393169+0000","last_became_active":"2023-11-18T20:39:02.752070+0000","last_became_peered":"2023-11-18T20:39:02.752070+0000","last_unstale":"2023-11-18T20:39:23.393169+0000","last_undegraded":"2023-11-18T20:39:23.393169+0000","last_fullsized":"2023-11-18T20:39:23.393169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.417985+0000","last_change":"2023-11-18T20:39:23.409355+0000","last_active":"2023-11-18T20:39:24.417985+0000","last_peered":"2023-11-18T20:39:24.417985+0000","last_clean":"2023-11-18T20:39:24.417985+0000","last_became_active":"2023-11-18T20:39:23.408604+0000","last_became_peered":"2023-11-18T20:39:23.408604+0000","last_unstale":"2023-11-18T20:39:24.417985+0000","last_undegraded":"2023-11-18T20:39:24.417985+0000","last_fullsized":"2023-11-18T20:39:24.417985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:05.267724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397065+0000","last_change":"2023-11-18T20:39:02.772625+0000","last_active":"2023-11-18T20:39:23.397065+0000","last_peered":"2023-11-18T20:39:23.397065+0000","last_clean":"2023-11-18T20:39:23.397065+0000","last_became_active":"2023-11-18T20:39:02.772348+0000","last_became_peered":"2023-11-18T20:39:02.772348+0000","last_unstale":"2023-11-18T20:39:23.397065+0000","last_undegraded":"2023-11-18T20:39:23.397065+0000","last_fullsized":"2023-11-18T20:39:23.397065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:48.152659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495555+0000","last_change":"2023-11-18T20:39:23.438347+0000","last_active":"2023-11-18T20:39:24.495555+0000","last_peered":"2023-11-18T20:39:24.495555+0000","last_clean":"2023-11-18T20:39:24.495555+0000","last_became_active":"2023-11-18T20:39:23.438076+0000","last_became_peered":"2023-11-18T20:39:23.438076+0000","last_unstale":"2023-11-18T20:39:24.495555+0000","last_undegraded":"2023-11-18T20:39:24.495555+0000","last_fullsized":"2023-11-18T20:39:24.495555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:41:54.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403234+0000","last_change":"2023-11-18T20:39:02.746609+0000","last_active":"2023-11-18T20:39:23.403234+0000","last_peered":"2023-11-18T20:39:23.403234+0000","last_clean":"2023-11-18T20:39:23.403234+0000","last_became_active":"2023-11-18T20:39:02.746324+0000","last_became_peered":"2023-11-18T20:39:02.746324+0000","last_unstale":"2023-11-18T20:39:23.403234+0000","last_undegraded":"2023-11-18T20:39:23.403234+0000","last_fullsized":"2023-11-18T20:39:23.403234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496548+0000","last_change":"2023-11-18T20:39:23.415863+0000","last_active":"2023-11-18T20:39:24.496548+0000","last_peered":"2023-11-18T20:39:24.496548+0000","last_clean":"2023-11-18T20:39:24.496548+0000","last_became_active":"2023-11-18T20:39:23.415576+0000","last_became_peered":"2023-11-18T20:39:23.415576+0000","last_unstale":"2023-11-18T20:39:24.496548+0000","last_undegraded":"2023-11-18T20:39:24.496548+0000","last_fullsized":"2023-11-18T20:39:24.496548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.426612+0000","last_change":"2023-11-18T20:39:02.775796+0000","last_active":"2023-11-18T20:39:23.426612+0000","last_peered":"2023-11-18T20:39:23.426612+0000","last_clean":"2023-11-18T20:39:23.426612+0000","last_became_active":"2023-11-18T20:39:02.775503+0000","last_became_peered":"2023-11-18T20:39:02.775503+0000","last_unstale":"2023-11-18T20:39:23.426612+0000","last_undegraded":"2023-11-18T20:39:23.426612+0000","last_fullsized":"2023-11-18T20:39:23.426612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493649+0000","last_change":"2023-11-18T20:39:23.422077+0000","last_active":"2023-11-18T20:39:24.493649+0000","last_peered":"2023-11-18T20:39:24.493649+0000","last_clean":"2023-11-18T20:39:24.493649+0000","last_became_active":"2023-11-18T20:39:23.418009+0000","last_became_peered":"2023-11-18T20:39:23.418009+0000","last_unstale":"2023-11-18T20:39:24.493649+0000","last_undegraded":"2023-11-18T20:39:24.493649+0000","last_fullsized":"2023-11-18T20:39:24.493649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:52.188384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422553+0000","last_change":"2023-11-18T20:39:02.774172+0000","last_active":"2023-11-18T20:39:23.422553+0000","last_peered":"2023-11-18T20:39:23.422553+0000","last_clean":"2023-11-18T20:39:23.422553+0000","last_became_active":"2023-11-18T20:39:02.773141+0000","last_became_peered":"2023-11-18T20:39:02.773141+0000","last_unstale":"2023-11-18T20:39:23.422553+0000","last_undegraded":"2023-11-18T20:39:23.422553+0000","last_fullsized":"2023-11-18T20:39:23.422553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:59:44.902815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494155+0000","last_change":"2023-11-18T20:39:23.421675+0000","last_active":"2023-11-18T20:39:24.494155+0000","last_peered":"2023-11-18T20:39:24.494155+0000","last_clean":"2023-11-18T20:39:24.494155+0000","last_became_active":"2023-11-18T20:39:23.421357+0000","last_became_peered":"2023-11-18T20:39:23.421357+0000","last_unstale":"2023-11-18T20:39:24.494155+0000","last_undegraded":"2023-11-18T20:39:24.494155+0000","last_fullsized":"2023-11-18T20:39:24.494155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:39.994594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427100+0000","last_change":"2023-11-18T20:39:02.772030+0000","last_active":"2023-11-18T20:39:23.427100+0000","last_peered":"2023-11-18T20:39:23.427100+0000","last_clean":"2023-11-18T20:39:23.427100+0000","last_became_active":"2023-11-18T20:39:02.771761+0000","last_became_peered":"2023-11-18T20:39:02.771761+0000","last_unstale":"2023-11-18T20:39:23.427100+0000","last_undegraded":"2023-11-18T20:39:23.427100+0000","last_fullsized":"2023-11-18T20:39:23.427100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493562+0000","last_change":"2023-11-18T20:39:23.429421+0000","last_active":"2023-11-18T20:39:24.493562+0000","last_peered":"2023-11-18T20:39:24.493562+0000","last_clean":"2023-11-18T20:39:24.493562+0000","last_became_active":"2023-11-18T20:39:23.428260+0000","last_became_peered":"2023-11-18T20:39:23.428260+0000","last_unstale":"2023-11-18T20:39:24.493562+0000","last_undegraded":"2023-11-18T20:39:24.493562+0000","last_fullsized":"2023-11-18T20:39:24.493562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:51.665927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403335+0000","last_change":"2023-11-18T20:39:02.752133+0000","last_active":"2023-11-18T20:39:23.403335+0000","last_peered":"2023-11-18T20:39:23.403335+0000","last_clean":"2023-11-18T20:39:23.403335+0000","last_became_active":"2023-11-18T20:39:02.751863+0000","last_became_peered":"2023-11-18T20:39:02.751863+0000","last_unstale":"2023-11-18T20:39:23.403335+0000","last_undegraded":"2023-11-18T20:39:23.403335+0000","last_fullsized":"2023-11-18T20:39:23.403335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:34:56.070643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495148+0000","last_change":"2023-11-18T20:39:23.430072+0000","last_active":"2023-11-18T20:39:24.495148+0000","last_peered":"2023-11-18T20:39:24.495148+0000","last_clean":"2023-11-18T20:39:24.495148+0000","last_became_active":"2023-11-18T20:39:23.428918+0000","last_became_peered":"2023-11-18T20:39:23.428918+0000","last_unstale":"2023-11-18T20:39:24.495148+0000","last_undegraded":"2023-11-18T20:39:24.495148+0000","last_fullsized":"2023-11-18T20:39:24.495148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:37.811641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.396600+0000","last_change":"2023-11-18T20:39:02.758024+0000","last_active":"2023-11-18T20:39:23.396600+0000","last_peered":"2023-11-18T20:39:23.396600+0000","last_clean":"2023-11-18T20:39:23.396600+0000","last_became_active":"2023-11-18T20:39:02.757737+0000","last_became_peered":"2023-11-18T20:39:02.757737+0000","last_unstale":"2023-11-18T20:39:23.396600+0000","last_undegraded":"2023-11-18T20:39:23.396600+0000","last_fullsized":"2023-11-18T20:39:23.396600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:42:50.023528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418187+0000","last_change":"2023-11-18T20:39:23.430247+0000","last_active":"2023-11-18T20:39:24.418187+0000","last_peered":"2023-11-18T20:39:24.418187+0000","last_clean":"2023-11-18T20:39:24.418187+0000","last_became_active":"2023-11-18T20:39:23.429408+0000","last_became_peered":"2023-11-18T20:39:23.429408+0000","last_unstale":"2023-11-18T20:39:24.418187+0000","last_undegraded":"2023-11-18T20:39:24.418187+0000","last_fullsized":"2023-11-18T20:39:24.418187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.402903+0000","last_change":"2023-11-18T20:39:02.752211+0000","last_active":"2023-11-18T20:39:23.402903+0000","last_peered":"2023-11-18T20:39:23.402903+0000","last_clean":"2023-11-18T20:39:23.402903+0000","last_became_active":"2023-11-18T20:39:02.751940+0000","last_became_peered":"2023-11-18T20:39:02.751940+0000","last_unstale":"2023-11-18T20:39:23.402903+0000","last_undegraded":"2023-11-18T20:39:23.402903+0000","last_fullsized":"2023-11-18T20:39:23.402903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:18.462999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492406+0000","last_change":"2023-11-18T20:39:23.420764+0000","last_active":"2023-11-18T20:39:24.492406+0000","last_peered":"2023-11-18T20:39:24.492406+0000","last_clean":"2023-11-18T20:39:24.492406+0000","last_became_active":"2023-11-18T20:39:23.420487+0000","last_became_peered":"2023-11-18T20:39:23.420487+0000","last_unstale":"2023-11-18T20:39:24.492406+0000","last_undegraded":"2023-11-18T20:39:24.492406+0000","last_fullsized":"2023-11-18T20:39:24.492406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:37:49.228681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397207+0000","last_change":"2023-11-18T20:39:02.758393+0000","last_active":"2023-11-18T20:39:23.397207+0000","last_peered":"2023-11-18T20:39:23.397207+0000","last_clean":"2023-11-18T20:39:23.397207+0000","last_became_active":"2023-11-18T20:39:02.752864+0000","last_became_peered":"2023-11-18T20:39:02.752864+0000","last_unstale":"2023-11-18T20:39:23.397207+0000","last_undegraded":"2023-11-18T20:39:23.397207+0000","last_fullsized":"2023-11-18T20:39:23.397207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494808+0000","last_change":"2023-11-18T20:39:23.441180+0000","last_active":"2023-11-18T20:39:24.494808+0000","last_peered":"2023-11-18T20:39:24.494808+0000","last_clean":"2023-11-18T20:39:24.494808+0000","last_became_active":"2023-11-18T20:39:23.440877+0000","last_became_peered":"2023-11-18T20:39:23.440877+0000","last_unstale":"2023-11-18T20:39:24.494808+0000","last_undegraded":"2023-11-18T20:39:24.494808+0000","last_fullsized":"2023-11-18T20:39:24.494808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:51.665927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.397681+0000","last_change":"2023-11-18T20:39:02.769220+0000","last_active":"2023-11-18T20:39:23.397681+0000","last_peered":"2023-11-18T20:39:23.397681+0000","last_clean":"2023-11-18T20:39:23.397681+0000","last_became_active":"2023-11-18T20:39:02.762271+0000","last_became_peered":"2023-11-18T20:39:02.762271+0000","last_unstale":"2023-11-18T20:39:23.397681+0000","last_undegraded":"2023-11-18T20:39:23.397681+0000","last_fullsized":"2023-11-18T20:39:23.397681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:37.501746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418640+0000","last_change":"2023-11-18T20:39:23.405475+0000","last_active":"2023-11-18T20:39:24.418640+0000","last_peered":"2023-11-18T20:39:24.418640+0000","last_clean":"2023-11-18T20:39:24.418640+0000","last_became_active":"2023-11-18T20:39:23.404710+0000","last_became_peered":"2023-11-18T20:39:23.404710+0000","last_unstale":"2023-11-18T20:39:24.418640+0000","last_undegraded":"2023-11-18T20:39:24.418640+0000","last_fullsized":"2023-11-18T20:39:24.418640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:49:23.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413035+0000","last_change":"2023-11-18T20:39:02.759862+0000","last_active":"2023-11-18T20:39:23.413035+0000","last_peered":"2023-11-18T20:39:23.413035+0000","last_clean":"2023-11-18T20:39:23.413035+0000","last_became_active":"2023-11-18T20:39:02.759565+0000","last_became_peered":"2023-11-18T20:39:02.759565+0000","last_unstale":"2023-11-18T20:39:23.413035+0000","last_undegraded":"2023-11-18T20:39:23.413035+0000","last_fullsized":"2023-11-18T20:39:23.413035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.421837+0000","last_change":"2023-11-18T20:39:23.441932+0000","last_active":"2023-11-18T20:39:24.421837+0000","last_peered":"2023-11-18T20:39:24.421837+0000","last_clean":"2023-11-18T20:39:24.421837+0000","last_became_active":"2023-11-18T20:39:23.441592+0000","last_became_peered":"2023-11-18T20:39:23.441592+0000","last_unstale":"2023-11-18T20:39:24.421837+0000","last_undegraded":"2023-11-18T20:39:24.421837+0000","last_fullsized":"2023-11-18T20:39:24.421837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:03.443291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413198+0000","last_change":"2023-11-18T20:39:02.755514+0000","last_active":"2023-11-18T20:39:23.413198+0000","last_peered":"2023-11-18T20:39:23.413198+0000","last_clean":"2023-11-18T20:39:23.413198+0000","last_became_active":"2023-11-18T20:39:02.755083+0000","last_became_peered":"2023-11-18T20:39:02.755083+0000","last_unstale":"2023-11-18T20:39:23.413198+0000","last_undegraded":"2023-11-18T20:39:23.413198+0000","last_fullsized":"2023-11-18T20:39:23.413198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:57.948105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.495760+0000","last_change":"2023-11-18T20:39:23.416569+0000","last_active":"2023-11-18T20:39:24.495760+0000","last_peered":"2023-11-18T20:39:24.495760+0000","last_clean":"2023-11-18T20:39:24.495760+0000","last_became_active":"2023-11-18T20:39:23.415936+0000","last_became_peered":"2023-11-18T20:39:23.415936+0000","last_unstale":"2023-11-18T20:39:24.495760+0000","last_undegraded":"2023-11-18T20:39:24.495760+0000","last_fullsized":"2023-11-18T20:39:24.495760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.406407+0000","last_change":"2023-11-18T20:39:02.766551+0000","last_active":"2023-11-18T20:39:23.406407+0000","last_peered":"2023-11-18T20:39:23.406407+0000","last_clean":"2023-11-18T20:39:23.406407+0000","last_became_active":"2023-11-18T20:39:02.765528+0000","last_became_peered":"2023-11-18T20:39:02.765528+0000","last_unstale":"2023-11-18T20:39:23.406407+0000","last_undegraded":"2023-11-18T20:39:23.406407+0000","last_fullsized":"2023-11-18T20:39:23.406407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:30.943404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494313+0000","last_change":"2023-11-18T20:39:23.440738+0000","last_active":"2023-11-18T20:39:24.494313+0000","last_peered":"2023-11-18T20:39:24.494313+0000","last_clean":"2023-11-18T20:39:24.494313+0000","last_became_active":"2023-11-18T20:39:23.438183+0000","last_became_peered":"2023-11-18T20:39:23.438183+0000","last_unstale":"2023-11-18T20:39:24.494313+0000","last_undegraded":"2023-11-18T20:39:24.494313+0000","last_fullsized":"2023-11-18T20:39:24.494313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.391162+0000","last_change":"2023-11-18T20:39:02.759711+0000","last_active":"2023-11-18T20:39:23.391162+0000","last_peered":"2023-11-18T20:39:23.391162+0000","last_clean":"2023-11-18T20:39:23.391162+0000","last_became_active":"2023-11-18T20:39:02.759422+0000","last_became_peered":"2023-11-18T20:39:02.759422+0000","last_unstale":"2023-11-18T20:39:23.391162+0000","last_undegraded":"2023-11-18T20:39:23.391162+0000","last_fullsized":"2023-11-18T20:39:23.391162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418433+0000","last_change":"2023-11-18T20:39:23.435850+0000","last_active":"2023-11-18T20:39:24.418433+0000","last_peered":"2023-11-18T20:39:24.418433+0000","last_clean":"2023-11-18T20:39:24.418433+0000","last_became_active":"2023-11-18T20:39:23.435565+0000","last_became_peered":"2023-11-18T20:39:23.435565+0000","last_unstale":"2023-11-18T20:39:24.418433+0000","last_undegraded":"2023-11-18T20:39:24.418433+0000","last_fullsized":"2023-11-18T20:39:24.418433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:26:50.423185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.393591+0000","last_change":"2023-11-18T20:39:02.750962+0000","last_active":"2023-11-18T20:39:23.393591+0000","last_peered":"2023-11-18T20:39:23.393591+0000","last_clean":"2023-11-18T20:39:23.393591+0000","last_became_active":"2023-11-18T20:39:02.750695+0000","last_became_peered":"2023-11-18T20:39:02.750695+0000","last_unstale":"2023-11-18T20:39:23.393591+0000","last_undegraded":"2023-11-18T20:39:23.393591+0000","last_fullsized":"2023-11-18T20:39:23.393591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:43.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.490966+0000","last_change":"2023-11-18T20:39:23.438134+0000","last_active":"2023-11-18T20:39:24.490966+0000","last_peered":"2023-11-18T20:39:24.490966+0000","last_clean":"2023-11-18T20:39:24.490966+0000","last_became_active":"2023-11-18T20:39:23.437851+0000","last_became_peered":"2023-11-18T20:39:23.437851+0000","last_unstale":"2023-11-18T20:39:24.490966+0000","last_undegraded":"2023-11-18T20:39:24.490966+0000","last_fullsized":"2023-11-18T20:39:24.490966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:30:34.308551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414661+0000","last_change":"2023-11-18T20:39:02.766121+0000","last_active":"2023-11-18T20:39:23.414661+0000","last_peered":"2023-11-18T20:39:23.414661+0000","last_clean":"2023-11-18T20:39:23.414661+0000","last_became_active":"2023-11-18T20:39:02.765807+0000","last_became_peered":"2023-11-18T20:39:02.765807+0000","last_unstale":"2023-11-18T20:39:23.414661+0000","last_undegraded":"2023-11-18T20:39:23.414661+0000","last_fullsized":"2023-11-18T20:39:23.414661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:40:15.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494142+0000","last_change":"2023-11-18T20:39:23.432185+0000","last_active":"2023-11-18T20:39:24.494142+0000","last_peered":"2023-11-18T20:39:24.494142+0000","last_clean":"2023-11-18T20:39:24.494142+0000","last_became_active":"2023-11-18T20:39:23.431390+0000","last_became_peered":"2023-11-18T20:39:23.431390+0000","last_unstale":"2023-11-18T20:39:24.494142+0000","last_undegraded":"2023-11-18T20:39:24.494142+0000","last_fullsized":"2023-11-18T20:39:24.494142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:06.374357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.398310+0000","last_change":"2023-11-18T20:39:02.748415+0000","last_active":"2023-11-18T20:39:23.398310+0000","last_peered":"2023-11-18T20:39:23.398310+0000","last_clean":"2023-11-18T20:39:23.398310+0000","last_became_active":"2023-11-18T20:39:02.748123+0000","last_became_peered":"2023-11-18T20:39:02.748123+0000","last_unstale":"2023-11-18T20:39:23.398310+0000","last_undegraded":"2023-11-18T20:39:23.398310+0000","last_fullsized":"2023-11-18T20:39:23.398310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:36:58.122129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.422209+0000","last_change":"2023-11-18T20:39:23.431236+0000","last_active":"2023-11-18T20:39:24.422209+0000","last_peered":"2023-11-18T20:39:24.422209+0000","last_clean":"2023-11-18T20:39:24.422209+0000","last_became_active":"2023-11-18T20:39:23.430987+0000","last_became_peered":"2023-11-18T20:39:23.430987+0000","last_unstale":"2023-11-18T20:39:24.422209+0000","last_undegraded":"2023-11-18T20:39:24.422209+0000","last_fullsized":"2023-11-18T20:39:24.422209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:17.043049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414330+0000","last_change":"2023-11-18T20:39:02.756659+0000","last_active":"2023-11-18T20:39:23.414330+0000","last_peered":"2023-11-18T20:39:23.414330+0000","last_clean":"2023-11-18T20:39:23.414330+0000","last_became_active":"2023-11-18T20:39:02.756336+0000","last_became_peered":"2023-11-18T20:39:02.756336+0000","last_unstale":"2023-11-18T20:39:23.414330+0000","last_undegraded":"2023-11-18T20:39:23.414330+0000","last_fullsized":"2023-11-18T20:39:23.414330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:14.460811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419345+0000","last_change":"2023-11-18T20:39:23.442964+0000","last_active":"2023-11-18T20:39:24.419345+0000","last_peered":"2023-11-18T20:39:24.419345+0000","last_clean":"2023-11-18T20:39:24.419345+0000","last_became_active":"2023-11-18T20:39:23.442713+0000","last_became_peered":"2023-11-18T20:39:23.442713+0000","last_unstale":"2023-11-18T20:39:24.419345+0000","last_undegraded":"2023-11-18T20:39:24.419345+0000","last_fullsized":"2023-11-18T20:39:24.419345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:09.956411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414611+0000","last_change":"2023-11-18T20:39:02.773954+0000","last_active":"2023-11-18T20:39:23.414611+0000","last_peered":"2023-11-18T20:39:23.414611+0000","last_clean":"2023-11-18T20:39:23.414611+0000","last_became_active":"2023-11-18T20:39:02.773686+0000","last_became_peered":"2023-11-18T20:39:02.773686+0000","last_unstale":"2023-11-18T20:39:23.414611+0000","last_undegraded":"2023-11-18T20:39:23.414611+0000","last_fullsized":"2023-11-18T20:39:23.414611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:54.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419559+0000","last_change":"2023-11-18T20:39:23.421271+0000","last_active":"2023-11-18T20:39:24.419559+0000","last_peered":"2023-11-18T20:39:24.419559+0000","last_clean":"2023-11-18T20:39:24.419559+0000","last_became_active":"2023-11-18T20:39:23.421029+0000","last_became_peered":"2023-11-18T20:39:23.421029+0000","last_unstale":"2023-11-18T20:39:24.419559+0000","last_undegraded":"2023-11-18T20:39:24.419559+0000","last_fullsized":"2023-11-18T20:39:24.419559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:41.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422456+0000","last_change":"2023-11-18T20:39:02.764804+0000","last_active":"2023-11-18T20:39:23.422456+0000","last_peered":"2023-11-18T20:39:23.422456+0000","last_clean":"2023-11-18T20:39:23.422456+0000","last_became_active":"2023-11-18T20:39:02.764574+0000","last_became_peered":"2023-11-18T20:39:02.764574+0000","last_unstale":"2023-11-18T20:39:23.422456+0000","last_undegraded":"2023-11-18T20:39:23.422456+0000","last_fullsized":"2023-11-18T20:39:23.422456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.494986+0000","last_change":"2023-11-18T20:39:23.439973+0000","last_active":"2023-11-18T20:39:24.494986+0000","last_peered":"2023-11-18T20:39:24.494986+0000","last_clean":"2023-11-18T20:39:24.494986+0000","last_became_active":"2023-11-18T20:39:23.439707+0000","last_became_peered":"2023-11-18T20:39:23.439707+0000","last_unstale":"2023-11-18T20:39:24.494986+0000","last_undegraded":"2023-11-18T20:39:24.494986+0000","last_fullsized":"2023-11-18T20:39:24.494986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:13:48.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.415013+0000","last_change":"2023-11-18T20:39:02.775795+0000","last_active":"2023-11-18T20:39:23.415013+0000","last_peered":"2023-11-18T20:39:23.415013+0000","last_clean":"2023-11-18T20:39:23.415013+0000","last_became_active":"2023-11-18T20:39:02.775493+0000","last_became_peered":"2023-11-18T20:39:02.775493+0000","last_unstale":"2023-11-18T20:39:23.415013+0000","last_undegraded":"2023-11-18T20:39:23.415013+0000","last_fullsized":"2023-11-18T20:39:23.415013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:25.772548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.418411+0000","last_change":"2023-11-18T20:39:23.432535+0000","last_active":"2023-11-18T20:39:24.418411+0000","last_peered":"2023-11-18T20:39:24.418411+0000","last_clean":"2023-11-18T20:39:24.418411+0000","last_became_active":"2023-11-18T20:39:23.432225+0000","last_became_peered":"2023-11-18T20:39:23.432225+0000","last_unstale":"2023-11-18T20:39:24.418411+0000","last_undegraded":"2023-11-18T20:39:24.418411+0000","last_fullsized":"2023-11-18T20:39:24.418411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:08:44.726874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.403097+0000","last_change":"2023-11-18T20:39:02.744529+0000","last_active":"2023-11-18T20:39:23.403097+0000","last_peered":"2023-11-18T20:39:23.403097+0000","last_clean":"2023-11-18T20:39:23.403097+0000","last_became_active":"2023-11-18T20:39:02.744056+0000","last_became_peered":"2023-11-18T20:39:02.744056+0000","last_unstale":"2023-11-18T20:39:23.403097+0000","last_undegraded":"2023-11-18T20:39:23.403097+0000","last_fullsized":"2023-11-18T20:39:23.403097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:28.509793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.492875+0000","last_change":"2023-11-18T20:39:23.409578+0000","last_active":"2023-11-18T20:39:24.492875+0000","last_peered":"2023-11-18T20:39:24.492875+0000","last_clean":"2023-11-18T20:39:24.492875+0000","last_became_active":"2023-11-18T20:39:23.409313+0000","last_became_peered":"2023-11-18T20:39:23.409313+0000","last_unstale":"2023-11-18T20:39:24.492875+0000","last_undegraded":"2023-11-18T20:39:24.492875+0000","last_fullsized":"2023-11-18T20:39:24.492875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:00:43.939166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405062+0000","last_change":"2023-11-18T20:39:02.767101+0000","last_active":"2023-11-18T20:39:23.405062+0000","last_peered":"2023-11-18T20:39:23.405062+0000","last_clean":"2023-11-18T20:39:23.405062+0000","last_became_active":"2023-11-18T20:39:02.764500+0000","last_became_peered":"2023-11-18T20:39:02.764500+0000","last_unstale":"2023-11-18T20:39:23.405062+0000","last_undegraded":"2023-11-18T20:39:23.405062+0000","last_fullsized":"2023-11-18T20:39:23.405062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496180+0000","last_change":"2023-11-18T20:39:23.425628+0000","last_active":"2023-11-18T20:39:24.496180+0000","last_peered":"2023-11-18T20:39:24.496180+0000","last_clean":"2023-11-18T20:39:24.496180+0000","last_became_active":"2023-11-18T20:39:23.425145+0000","last_became_peered":"2023-11-18T20:39:23.425145+0000","last_unstale":"2023-11-18T20:39:24.496180+0000","last_undegraded":"2023-11-18T20:39:24.496180+0000","last_fullsized":"2023-11-18T20:39:24.496180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:47:00.725680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.413802+0000","last_change":"2023-11-18T20:39:02.755127+0000","last_active":"2023-11-18T20:39:23.413802+0000","last_peered":"2023-11-18T20:39:23.413802+0000","last_clean":"2023-11-18T20:39:23.413802+0000","last_became_active":"2023-11-18T20:39:02.754791+0000","last_became_peered":"2023-11-18T20:39:02.754791+0000","last_unstale":"2023-11-18T20:39:23.413802+0000","last_undegraded":"2023-11-18T20:39:23.413802+0000","last_fullsized":"2023-11-18T20:39:23.413802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.491424+0000","last_change":"2023-11-18T20:39:23.425893+0000","last_active":"2023-11-18T20:39:24.491424+0000","last_peered":"2023-11-18T20:39:24.491424+0000","last_clean":"2023-11-18T20:39:24.491424+0000","last_became_active":"2023-11-18T20:39:23.425362+0000","last_became_peered":"2023-11-18T20:39:23.425362+0000","last_unstale":"2023-11-18T20:39:24.491424+0000","last_undegraded":"2023-11-18T20:39:24.491424+0000","last_fullsized":"2023-11-18T20:39:24.491424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:50:54.388639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427940+0000","last_change":"2023-11-18T20:39:02.757930+0000","last_active":"2023-11-18T20:39:23.427940+0000","last_peered":"2023-11-18T20:39:23.427940+0000","last_clean":"2023-11-18T20:39:23.427940+0000","last_became_active":"2023-11-18T20:39:02.757463+0000","last_became_peered":"2023-11-18T20:39:02.757463+0000","last_unstale":"2023-11-18T20:39:23.427940+0000","last_undegraded":"2023-11-18T20:39:23.427940+0000","last_fullsized":"2023-11-18T20:39:23.427940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:24.707048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.419320+0000","last_change":"2023-11-18T20:39:23.435438+0000","last_active":"2023-11-18T20:39:24.419320+0000","last_peered":"2023-11-18T20:39:24.419320+0000","last_clean":"2023-11-18T20:39:24.419320+0000","last_became_active":"2023-11-18T20:39:23.435003+0000","last_became_peered":"2023-11-18T20:39:23.435003+0000","last_unstale":"2023-11-18T20:39:24.419320+0000","last_undegraded":"2023-11-18T20:39:24.419320+0000","last_fullsized":"2023-11-18T20:39:24.419320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:37.811641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.422139+0000","last_change":"2023-11-18T20:39:02.752584+0000","last_active":"2023-11-18T20:39:23.422139+0000","last_peered":"2023-11-18T20:39:23.422139+0000","last_clean":"2023-11-18T20:39:23.422139+0000","last_became_active":"2023-11-18T20:39:02.752259+0000","last_became_peered":"2023-11-18T20:39:02.752259+0000","last_unstale":"2023-11-18T20:39:23.422139+0000","last_undegraded":"2023-11-18T20:39:23.422139+0000","last_fullsized":"2023-11-18T20:39:23.422139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:34:16.462260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496316+0000","last_change":"2023-11-18T20:39:23.413254+0000","last_active":"2023-11-18T20:39:24.496316+0000","last_peered":"2023-11-18T20:39:24.496316+0000","last_clean":"2023-11-18T20:39:24.496316+0000","last_became_active":"2023-11-18T20:39:23.408288+0000","last_became_peered":"2023-11-18T20:39:23.408288+0000","last_unstale":"2023-11-18T20:39:24.496316+0000","last_undegraded":"2023-11-18T20:39:24.496316+0000","last_fullsized":"2023-11-18T20:39:24.496316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:51:06.935721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.414893+0000","last_change":"2023-11-18T20:39:02.756005+0000","last_active":"2023-11-18T20:39:23.414893+0000","last_peered":"2023-11-18T20:39:23.414893+0000","last_clean":"2023-11-18T20:39:23.414893+0000","last_became_active":"2023-11-18T20:39:02.754298+0000","last_became_peered":"2023-11-18T20:39:02.754298+0000","last_unstale":"2023-11-18T20:39:23.414893+0000","last_undegraded":"2023-11-18T20:39:23.414893+0000","last_fullsized":"2023-11-18T20:39:23.414893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:46.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.496924+0000","last_change":"2023-11-18T20:39:23.432493+0000","last_active":"2023-11-18T20:39:24.496924+0000","last_peered":"2023-11-18T20:39:24.496924+0000","last_clean":"2023-11-18T20:39:24.496924+0000","last_became_active":"2023-11-18T20:39:23.432175+0000","last_became_peered":"2023-11-18T20:39:23.432175+0000","last_unstale":"2023-11-18T20:39:24.496924+0000","last_undegraded":"2023-11-18T20:39:24.496924+0000","last_fullsized":"2023-11-18T20:39:24.496924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:38.580148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.427177+0000","last_change":"2023-11-18T20:39:02.774649+0000","last_active":"2023-11-18T20:39:23.427177+0000","last_peered":"2023-11-18T20:39:23.427177+0000","last_clean":"2023-11-18T20:39:23.427177+0000","last_became_active":"2023-11-18T20:39:02.774358+0000","last_became_peered":"2023-11-18T20:39:02.774358+0000","last_unstale":"2023-11-18T20:39:23.427177+0000","last_undegraded":"2023-11-18T20:39:23.427177+0000","last_fullsized":"2023-11-18T20:39:23.427177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:01.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-18T20:39:24.493419+0000","last_change":"2023-11-18T20:39:23.427619+0000","last_active":"2023-11-18T20:39:24.493419+0000","last_peered":"2023-11-18T20:39:24.493419+0000","last_clean":"2023-11-18T20:39:24.493419+0000","last_became_active":"2023-11-18T20:39:23.427203+0000","last_became_peered":"2023-11-18T20:39:23.427203+0000","last_unstale":"2023-11-18T20:39:24.493419+0000","last_undegraded":"2023-11-18T20:39:24.493419+0000","last_fullsized":"2023-11-18T20:39:24.493419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:22.359370+0000","last_clean_scrub_stamp":"2023-11-18T20:39:22.359370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:38.915609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-18T20:39:23.405199+0000","last_change":"2023-11-18T20:39:02.760762+0000","last_active":"2023-11-18T20:39:23.405199+0000","last_peered":"2023-11-18T20:39:23.405199+0000","last_clean":"2023-11-18T20:39:23.405199+0000","last_became_active":"2023-11-18T20:39:02.760426+0000","last_became_peered":"2023-11-18T20:39:02.760426+0000","last_unstale":"2023-11-18T20:39:23.405199+0000","last_undegraded":"2023-11-18T20:39:23.405199+0000","last_fullsized":"2023-11-18T20:39:23.405199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:39:01.710473+0000","last_clean_scrub_stamp":"2023-11-18T20:39:01.710473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:37.756600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":183281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.72099999999999997}]},{"osd":1,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.538}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.1559999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.597},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.3220000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.643},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.4710000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":1.7110000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.756,"15min":1.756},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.6699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":186948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.78600000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.145}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2689999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.488}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.736}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1044480,"data_stored":774197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.92800000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.161}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.294},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.044}]},{"osd":4,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.264},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.706}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.345},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.3879999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.831},{"interface":"front","average":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.423}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":188058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.3460000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.01}]},{"osd":3,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.381},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.4790000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.444},{"interface":"front","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.538}]},{"osd":7,"last update":"Sat Nov 18 20:38:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.585},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.5029999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":185613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.038}]},{"osd":1,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.087},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71699999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.173},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.2829999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.129},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3600000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.304},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":183349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.085},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.2629999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.357},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.03}]},{"osd":4,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.21},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.153}]},{"osd":5,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.502},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.4490000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.3180000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:38:54 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.482},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.411}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1044480,"data_stored":773733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.495},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.79900000000000004}]},{"osd":2,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.84299999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.2250000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.0049999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:38:55 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":183987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":2.173}]},{"osd":3,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":11.629,"5min":11.629,"15min":11.629},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.746}]},{"osd":4,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":5.6150000000000002,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":6.202,"5min":6.202,"15min":6.202},"last":1.1950000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.256},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":5.6760000000000002,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.286}]},{"osd":7,"last update":"Sat Nov 18 20:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.238,"5min":1.238,"15min":1.238},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.218},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":1.458}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:39:33.500 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T20:39:33.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-18T20:39:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.758+0000 7f9deabd5640 1 Processor -- start 2023-11-18T20:39:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.759+0000 7f9deabd5640 1 -- start start 2023-11-18T20:39:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.760+0000 7f9deabd5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9de4072100 0x7f9de41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.760+0000 7f9deabd5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9de40c3020 0x7f9de4154e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.760+0000 7f9deabd5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de40c22f0 con 0x7f9de414b460 2023-11-18T20:39:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.760+0000 7f9deabd5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de414b840 con 0x7f9de40c3020 2023-11-18T20:39:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.760+0000 7f9deabd5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40c2b90 con 0x7f9de4072100 2023-11-18T20:39:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de8971640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9de414b460 0x7f9de406d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33954/0 (socket says 172.21.15.132:33954) 2023-11-18T20:39:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de8971640 1 -- 172.21.15.132:0/345444287 learned_addr learned my addr 172.21.15.132:0/345444287 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de9172640 1 --2- 172.21.15.132:0/345444287 >> v2:172.21.15.132:3300/0 conn(0x7f9de40c3020 0x7f9de4154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de3fff640 1 --2- 172.21.15.132:0/345444287 >> v2:172.21.15.161:3300/0 conn(0x7f9de4072100 0x7f9de41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de37fe640 1 -- 172.21.15.132:0/345444287 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533302247 0 0) 0x7f9de40c22f0 con 0x7f9de414b460 2023-11-18T20:39:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de37fe640 1 -- 172.21.15.132:0/345444287 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd0003520 con 0x7f9de414b460 2023-11-18T20:39:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de9172640 1 -- 172.21.15.132:0/345444287 >> v2:172.21.15.161:3300/0 conn(0x7f9de4072100 msgr2=0x7f9de41548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de9172640 1 --2- 172.21.15.132:0/345444287 >> v2:172.21.15.161:3300/0 conn(0x7f9de4072100 0x7f9de41548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de9172640 1 -- 172.21.15.132:0/345444287 >> v1:172.21.15.132:6789/0 conn(0x7f9de414b460 legacy=0x7f9de406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.761+0000 7f9de9172640 1 -- 172.21.15.132:0/345444287 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de41556b0 con 0x7f9de40c3020 2023-11-18T20:39:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.762+0000 7f9de9172640 1 --2- 172.21.15.132:0/345444287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de40c3020 0x7f9de4154e00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9de40c6eb0 tx=0x7f9ddc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4237ba2dac4ff server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9de37fe640 1 -- 172.21.15.132:0/345444287 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc02e070 con 0x7f9de40c3020 2023-11-18T20:39:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9de37fe640 1 -- 172.21.15.132:0/345444287 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc0315a0 con 0x7f9de40c3020 2023-11-18T20:39:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9de37fe640 1 -- 172.21.15.132:0/345444287 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc031930 con 0x7f9de40c3020 2023-11-18T20:39:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9deabd5640 1 -- 172.21.15.132:0/345444287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de40c3020 msgr2=0x7f9de4154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9deabd5640 1 --2- 172.21.15.132:0/345444287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de40c3020 0x7f9de4154e00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9de40c6eb0 tx=0x7f9ddc02b840 comp rx=0 tx=0).stop 2023-11-18T20:39:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9deabd5640 1 -- 172.21.15.132:0/345444287 shutdown_connections 2023-11-18T20:39:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9deabd5640 1 --2- 172.21.15.132:0/345444287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de40c3020 0x7f9de4154e00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9deabd5640 1 --2- 172.21.15.132:0/345444287 >> v2:172.21.15.161:3300/0 conn(0x7f9de4072100 0x7f9de41548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.763+0000 7f9deabd5640 1 -- 172.21.15.132:0/345444287 >> 172.21.15.132:0/345444287 conn(0x7f9de40c39e0 msgr2=0x7f9de40c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.764+0000 7f9deabd5640 1 -- 172.21.15.132:0/345444287 shutdown_connections 2023-11-18T20:39:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.764+0000 7f9deabd5640 1 -- 172.21.15.132:0/345444287 wait complete. 2023-11-18T20:39:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.765+0000 7f9deabd5640 1 Processor -- start 2023-11-18T20:39:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.766+0000 7f9deabd5640 1 -- start start 2023-11-18T20:39:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.766+0000 7f9deabd5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de4072100 0x7f9de40c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.766+0000 7f9deabd5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9de40c3020 0x7f9de414eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.766+0000 7f9deabd5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9de414b460 0x7f9de40ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.766+0000 7f9deabd5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de414dcf0 con 0x7f9de4072100 2023-11-18T20:39:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.766+0000 7f9deabd5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de414b990 con 0x7f9de414b460 2023-11-18T20:39:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9deabd5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de41510e0 con 0x7f9de40c3020 2023-11-18T20:39:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9de8971640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de4072100 0x7f9de40c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9de8971640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de4072100 0x7f9de40c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48910/0 (socket says 172.21.15.132:48910) 2023-11-18T20:39:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9de8971640 1 -- 172.21.15.132:0/2053422448 learned_addr learned my addr 172.21.15.132:0/2053422448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9de8971640 1 -- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9de40c3020 msgr2=0x7f9de414eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9de8971640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9de40c3020 0x7f9de414eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9de8971640 1 -- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9de414b460 msgr2=0x7f9de40ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9de8971640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9de414b460 0x7f9de40ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.767+0000 7f9de8971640 1 -- 172.21.15.132:0/2053422448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc009400 con 0x7f9de4072100 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.768+0000 7f9de8971640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de4072100 0x7f9de40c6270 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400c440 tx=0x7f9dd400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.768+0000 7f9de17fa640 1 -- 172.21.15.132:0/2053422448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4005ce0 con 0x7f9de4072100 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.768+0000 7f9de17fa640 1 -- 172.21.15.132:0/2053422448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd4005e40 con 0x7f9de4072100 2023-11-18T20:39:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.768+0000 7f9de17fa640 1 -- 172.21.15.132:0/2053422448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40072b0 con 0x7f9de4072100 2023-11-18T20:39:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.768+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de414f710 con 0x7f9de4072100 2023-11-18T20:39:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.768+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de414fcd0 con 0x7f9de4072100 2023-11-18T20:39:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.769+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de404e840 con 0x7f9de4072100 2023-11-18T20:39:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.770+0000 7f9de17fa640 1 -- 172.21.15.132:0/2053422448 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9dd4007410 con 0x7f9de4072100 2023-11-18T20:39:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.771+0000 7f9de17fa640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dc406ae40 0x7f9dc406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.771+0000 7f9de17fa640 1 -- 172.21.15.132:0/2053422448 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9dd4088f00 con 0x7f9de4072100 2023-11-18T20:39:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.771+0000 7f9de3fff640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dc406ae40 0x7f9dc406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.773+0000 7f9de3fff640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dc406ae40 0x7f9dc406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9de41522b0 tx=0x7f9dcc009610 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:33.775+0000 7f9de17fa640 1 -- 172.21.15.132:0/2053422448 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9dd4057790 con 0x7f9de4072100 2023-11-18T20:39:34.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.034+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f9de414fef0 con 0x7f9de4072100 2023-11-18T20:39:34.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.039+0000 7f9de17fa640 1 -- 172.21.15.132:0/2053422448 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7f9dd4017020 con 0x7f9de4072100 2023-11-18T20:39:34.040 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-11-18T20:39:34.040 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBsIFllrycwCxAAI7OVXj40YLGlQ4/hWY+mTA== 2023-11-18T20:39:34.040 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow" 2023-11-18T20:39:34.040 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2023-11-18T20:39:34.040 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-18T20:39:34.041 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.1 2023-11-18T20:39:34.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dc406ae40 msgr2=0x7f9dc406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dc406ae40 0x7f9dc406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9de41522b0 tx=0x7f9dcc009610 comp rx=0 tx=0).stop 2023-11-18T20:39:34.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de4072100 msgr2=0x7f9de40c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de4072100 0x7f9de40c6270 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400c440 tx=0x7f9dd400c900 comp rx=0 tx=0).stop 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 shutdown_connections 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dc406ae40 0x7f9dc406d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9de414b460 0x7f9de40ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9de40c3020 0x7f9de414eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 --2- 172.21.15.132:0/2053422448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9de4072100 0x7f9de40c6270 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 >> 172.21.15.132:0/2053422448 conn(0x7f9de40c39e0 msgr2=0x7f9de4148f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 shutdown_connections 2023-11-18T20:39:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.042+0000 7f9deabd5640 1 -- 172.21.15.132:0/2053422448 wait complete. 2023-11-18T20:39:34.061 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:39:34.061 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:34.121 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:39:34.121 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:34.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:34.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.398+0000 7f8689fff640 1 Processor -- start 2023-11-18T20:39:34.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.398+0000 7f8689fff640 1 -- start start 2023-11-18T20:39:34.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.399+0000 7f8689fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86840ca8d0 0x7f8684154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.399+0000 7f8689fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8684158a60 con 0x7f868414e7c0 2023-11-18T20:39:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.399+0000 7f8689fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86840c4dd0 con 0x7f86840ca450 2023-11-18T20:39:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.399+0000 7f8689fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86840c5b10 con 0x7f86840ca8d0 2023-11-18T20:39:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.400+0000 7f8688ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f868414e7c0 0x7f86840c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33958/0 (socket says 172.21.15.132:33958) 2023-11-18T20:39:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.400+0000 7f8688ffd640 1 -- 172.21.15.132:0/134082359 learned_addr learned my addr 172.21.15.132:0/134082359 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.400+0000 7f86897fe640 1 --2- 172.21.15.132:0/134082359 >> v2:172.21.15.132:3300/0 conn(0x7f86840ca8d0 0x7f8684154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.400+0000 7f86837fe640 1 -- 172.21.15.132:0/134082359 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533413360 0 0) 0x7f8684158a60 con 0x7f868414e7c0 2023-11-18T20:39:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.400+0000 7f86837fe640 1 -- 172.21.15.132:0/134082359 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8674003520 con 0x7f868414e7c0 2023-11-18T20:39:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.400+0000 7f86897fe640 1 -- 172.21.15.132:0/134082359 >> v1:172.21.15.161:6789/0 conn(0x7f86840ca450 legacy=0x7f8684154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.400+0000 7f86897fe640 1 -- 172.21.15.132:0/134082359 >> v1:172.21.15.132:6789/0 conn(0x7f868414e7c0 legacy=0x7f86840c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.400+0000 7f86897fe640 1 -- 172.21.15.132:0/134082359 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684157ca0 con 0x7f86840ca8d0 2023-11-18T20:39:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.401+0000 7f86897fe640 1 --2- 172.21.15.132:0/134082359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86840ca8d0 0x7f8684154c90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f867c009d90 tx=0x7f867c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0abbc78d319dcec server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.401+0000 7f86837fe640 1 -- 172.21.15.132:0/134082359 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c02cbd0 con 0x7f86840ca8d0 2023-11-18T20:39:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f86837fe640 1 -- 172.21.15.132:0/134082359 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c02cd30 con 0x7f86840ca8d0 2023-11-18T20:39:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f86837fe640 1 -- 172.21.15.132:0/134082359 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c02cea0 con 0x7f86840ca8d0 2023-11-18T20:39:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f8689fff640 1 -- 172.21.15.132:0/134082359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86840ca8d0 msgr2=0x7f8684154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f8689fff640 1 --2- 172.21.15.132:0/134082359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86840ca8d0 0x7f8684154c90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f867c009d90 tx=0x7f867c02be20 comp rx=0 tx=0).stop 2023-11-18T20:39:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f8689fff640 1 -- 172.21.15.132:0/134082359 shutdown_connections 2023-11-18T20:39:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f8689fff640 1 --2- 172.21.15.132:0/134082359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86840ca8d0 0x7f8684154c90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f8689fff640 1 -- 172.21.15.132:0/134082359 >> 172.21.15.132:0/134082359 conn(0x7f86840abf00 msgr2=0x7f86840c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f8689fff640 1 -- 172.21.15.132:0/134082359 shutdown_connections 2023-11-18T20:39:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.402+0000 7f8689fff640 1 -- 172.21.15.132:0/134082359 wait complete. 2023-11-18T20:39:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.404+0000 7f8689fff640 1 Processor -- start 2023-11-18T20:39:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.404+0000 7f8689fff640 1 -- start start 2023-11-18T20:39:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f8689fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86840ca450 0x7f86840c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f8689fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840ca8d0 0x7f8684152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f8689fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868414e7c0 0x7f8684145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f8689fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8684154340 con 0x7f868414e7c0 2023-11-18T20:39:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f8689fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8684153f20 con 0x7f86840ca8d0 2023-11-18T20:39:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f8689fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c19d0 con 0x7f86840ca450 2023-11-18T20:39:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f86897fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868414e7c0 0x7f8684145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f86897fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868414e7c0 0x7f8684145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48922/0 (socket says 172.21.15.132:48922) 2023-11-18T20:39:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f86897fe640 1 -- 172.21.15.132:0/3305478086 learned_addr learned my addr 172.21.15.132:0/3305478086 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.405+0000 7f8683fff640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840ca8d0 0x7f8684152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f8688ffd640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86840ca450 0x7f86840c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86897fe640 1 -- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86840ca450 msgr2=0x7f86840c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86897fe640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86840ca450 0x7f86840c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86897fe640 1 -- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840ca8d0 msgr2=0x7f8684152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86897fe640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840ca8d0 0x7f8684152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86897fe640 1 -- 172.21.15.132:0/3305478086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c009a70 con 0x7f868414e7c0 2023-11-18T20:39:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f8683fff640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840ca8d0 0x7f8684152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:34.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86897fe640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868414e7c0 0x7f8684145e10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f867c009d90 tx=0x7f867c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86817fa640 1 -- 172.21.15.132:0/3305478086 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c02cea0 con 0x7f868414e7c0 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86817fa640 1 -- 172.21.15.132:0/3305478086 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c003bb0 con 0x7f868414e7c0 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f86817fa640 1 -- 172.21.15.132:0/3305478086 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c009450 con 0x7f868414e7c0 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840c1cb0 con 0x7f868414e7c0 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.406+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86841eafd0 con 0x7f868414e7c0 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.407+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86841eb160 con 0x7f868414e7c0 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.408+0000 7f86817fa640 1 -- 172.21.15.132:0/3305478086 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f867c03b050 con 0x7f868414e7c0 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.409+0000 7f86817fa640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.409+0000 7f86817fa640 1 -- 172.21.15.132:0/3305478086 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f867c0abc40 con 0x7f868414e7c0 2023-11-18T20:39:34.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.410+0000 7f8688ffd640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.411+0000 7f8688ffd640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f866806ae70 0x7f866806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86780011e0 tx=0x7f8678009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:34.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.414+0000 7f86817fa640 1 -- 172.21.15.132:0/3305478086 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f867c076a20 con 0x7f868414e7c0 2023-11-18T20:39:34.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.592+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8684154480 con 0x7f868414e7c0 2023-11-18T20:39:34.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.595+0000 7f86817fa640 1 -- 172.21.15.132:0/3305478086 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20201 (secure 0 0 0) 0x7f867c039020 con 0x7f868414e7c0 2023-11-18T20:39:34.596 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:34.597 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":39,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:24.407150+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:34.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f866806ae70 msgr2=0x7f866806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f866806ae70 0x7f866806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86780011e0 tx=0x7f8678009040 comp rx=0 tx=0).stop 2023-11-18T20:39:34.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868414e7c0 msgr2=0x7f8684145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868414e7c0 0x7f8684145e10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f867c009d90 tx=0x7f867c004a40 comp rx=0 tx=0).stop 2023-11-18T20:39:34.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 shutdown_connections 2023-11-18T20:39:34.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868414e7c0 0x7f8684145e10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840ca8d0 0x7f8684152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 --2- 172.21.15.132:0/3305478086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86840ca450 0x7f86840c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.597+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 >> 172.21.15.132:0/3305478086 conn(0x7f86840abf00 msgr2=0x7f86840c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:34.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.598+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 shutdown_connections 2023-11-18T20:39:34.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.598+0000 7f8689fff640 1 -- 172.21.15.132:0/3305478086 wait complete. 2023-11-18T20:39:34.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:39:00.655880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:39:01.207461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:39:20.671493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:39:21.849411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:39:34.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:39:34.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.836+0000 7f24721f0640 1 Processor -- start 2023-11-18T20:39:34.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.837+0000 7f24721f0640 1 -- start start 2023-11-18T20:39:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.838+0000 7f24721f0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f246c0c5120 0x7f246c0c1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.838+0000 7f24721f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f246c06fe70 0x7f246c0c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.838+0000 7f24721f0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0c2830 con 0x7f246c0c6990 2023-11-18T20:39:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.838+0000 7f24721f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0c2f30 con 0x7f246c06fe70 2023-11-18T20:39:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.838+0000 7f24721f0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0c2a80 con 0x7f246c0c5120 2023-11-18T20:39:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.838+0000 7f246b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f246c0c6990 0x7f246c155250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33962/0 (socket says 172.21.15.132:33962) 2023-11-18T20:39:34.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.838+0000 7f246b7fe640 1 -- 172.21.15.132:0/217042471 learned_addr learned my addr 172.21.15.132:0/217042471 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:34.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.838+0000 7f246bfff640 1 --2- 172.21.15.132:0/217042471 >> v2:172.21.15.132:3300/0 conn(0x7f246c06fe70 0x7f246c0c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.839+0000 7f246a7fc640 1 -- 172.21.15.132:0/217042471 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610310150 0 0) 0x7f246c0c2830 con 0x7f246c0c6990 2023-11-18T20:39:34.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.839+0000 7f246a7fc640 1 -- 172.21.15.132:0/217042471 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2458003520 con 0x7f246c0c6990 2023-11-18T20:39:34.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.839+0000 7f246affd640 1 --2- 172.21.15.132:0/217042471 >> v2:172.21.15.161:3300/0 conn(0x7f246c0c5120 0x7f246c0c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.839+0000 7f246bfff640 1 -- 172.21.15.132:0/217042471 >> v2:172.21.15.161:3300/0 conn(0x7f246c0c5120 msgr2=0x7f246c0c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:34.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.839+0000 7f246bfff640 1 --2- 172.21.15.132:0/217042471 >> v2:172.21.15.161:3300/0 conn(0x7f246c0c5120 0x7f246c0c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.839+0000 7f246bfff640 1 -- 172.21.15.132:0/217042471 >> v1:172.21.15.132:6789/0 conn(0x7f246c0c6990 legacy=0x7f246c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.839+0000 7f246bfff640 1 -- 172.21.15.132:0/217042471 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0c3290 con 0x7f246c06fe70 2023-11-18T20:39:34.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.840+0000 7f246bfff640 1 --2- 172.21.15.132:0/217042471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c06fe70 0x7f246c0c1a80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f246c06fdf0 tx=0x7f246402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02d12ea5db8edb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:34.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.840+0000 7f246a7fc640 1 -- 172.21.15.132:0/217042471 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464031710 con 0x7f246c06fe70 2023-11-18T20:39:34.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.840+0000 7f246a7fc640 1 -- 172.21.15.132:0/217042471 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246402f050 con 0x7f246c06fe70 2023-11-18T20:39:34.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.840+0000 7f246a7fc640 1 -- 172.21.15.132:0/217042471 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464031a90 con 0x7f246c06fe70 2023-11-18T20:39:34.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.841+0000 7f24721f0640 1 -- 172.21.15.132:0/217042471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c06fe70 msgr2=0x7f246c0c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.841+0000 7f24721f0640 1 --2- 172.21.15.132:0/217042471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c06fe70 0x7f246c0c1a80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f246c06fdf0 tx=0x7f246402b7b0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.841+0000 7f24721f0640 1 -- 172.21.15.132:0/217042471 shutdown_connections 2023-11-18T20:39:34.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.841+0000 7f24721f0640 1 --2- 172.21.15.132:0/217042471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c06fe70 0x7f246c0c1a80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.841+0000 7f24721f0640 1 --2- 172.21.15.132:0/217042471 >> v2:172.21.15.161:3300/0 conn(0x7f246c0c5120 0x7f246c0c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.841+0000 7f24721f0640 1 -- 172.21.15.132:0/217042471 >> 172.21.15.132:0/217042471 conn(0x7f246c0c7e30 msgr2=0x7f246c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:34.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.841+0000 7f24721f0640 1 -- 172.21.15.132:0/217042471 shutdown_connections 2023-11-18T20:39:34.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.841+0000 7f24721f0640 1 -- 172.21.15.132:0/217042471 wait complete. 2023-11-18T20:39:34.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.843+0000 7f24721f0640 1 Processor -- start 2023-11-18T20:39:34.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.843+0000 7f24721f0640 1 -- start start 2023-11-18T20:39:34.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f24721f0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f246c06fe70 0x7f246c0abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f24721f0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f246c0c6990 0x7f246c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f24721f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c150560 0x7f246c14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f24721f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1578e0 con 0x7f246c150560 2023-11-18T20:39:34.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f24721f0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0aac40 con 0x7f246c06fe70 2023-11-18T20:39:34.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f24721f0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0aaf20 con 0x7f246c0c6990 2023-11-18T20:39:34.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f246bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c150560 0x7f246c14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f246bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c150560 0x7f246c14f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48936/0 (socket says 172.21.15.132:48936) 2023-11-18T20:39:34.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.844+0000 7f246bfff640 1 -- 172.21.15.132:0/1447206269 learned_addr learned my addr 172.21.15.132:0/1447206269 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f246bfff640 1 -- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f246c0c6990 msgr2=0x7f246c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f246bfff640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f246c0c6990 0x7f246c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f246bfff640 1 -- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f246c06fe70 msgr2=0x7f246c0abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f246bfff640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f246c06fe70 0x7f246c0abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f246bfff640 1 -- 172.21.15.132:0/1447206269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2464009400 con 0x7f246c150560 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f246bfff640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c150560 0x7f246c14f8d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2464009890 tx=0x7f24640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f2463fff640 1 -- 172.21.15.132:0/1447206269 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246403c8d0 con 0x7f246c150560 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f2463fff640 1 -- 172.21.15.132:0/1447206269 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246403ca30 con 0x7f246c150560 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f2463fff640 1 -- 172.21.15.132:0/1447206269 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246403cda0 con 0x7f246c150560 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c155ae0 con 0x7f246c150560 2023-11-18T20:39:34.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.845+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c157b30 con 0x7f246c150560 2023-11-18T20:39:34.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.846+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c068350 con 0x7f246c150560 2023-11-18T20:39:34.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.847+0000 7f2463fff640 1 -- 172.21.15.132:0/1447206269 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f246403a040 con 0x7f246c150560 2023-11-18T20:39:34.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.849+0000 7f2463fff640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f244c06ae40 0x7f244c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:34.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.849+0000 7f2463fff640 1 -- 172.21.15.132:0/1447206269 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f24640ab2c0 con 0x7f246c150560 2023-11-18T20:39:34.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.849+0000 7f246b7fe640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f244c06ae40 0x7f244c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:34.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.851+0000 7f246b7fe640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f244c06ae40 0x7f244c06d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f245c0012e0 tx=0x7f245c0015b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:34.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:34.853+0000 7f2463fff640 1 -- 172.21.15.132:0/1447206269 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2464076120 con 0x7f246c150560 2023-11-18T20:39:35.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.042+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f246c0c2340 con 0x7f246c150560 2023-11-18T20:39:35.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.042+0000 7f2463fff640 1 -- 172.21.15.132:0/1447206269 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2464079740 con 0x7f246c150560 2023-11-18T20:39:35.044 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:39:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f244c06ae40 msgr2=0x7f244c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f244c06ae40 0x7f244c06d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f245c0012e0 tx=0x7f245c0015b0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c150560 msgr2=0x7f246c14f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c150560 0x7f246c14f8d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2464009890 tx=0x7f24640046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 shutdown_connections 2023-11-18T20:39:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f244c06ae40 0x7f244c06d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f246c150560 0x7f246c14f8d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f246c0c6990 0x7f246c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 --2- 172.21.15.132:0/1447206269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f246c06fe70 0x7f246c0abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 >> 172.21.15.132:0/1447206269 conn(0x7f246c0c7e30 msgr2=0x7f246c06c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 shutdown_connections 2023-11-18T20:39:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.045+0000 7f24721f0640 1 -- 172.21.15.132:0/1447206269 wait complete. 2023-11-18T20:39:35.066 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:39:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.278+0000 7fd246bfb640 1 Processor -- start 2023-11-18T20:39:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.278+0000 7fd246bfb640 1 -- start start 2023-11-18T20:39:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd246bfb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2400c1500 0x7fd2400c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd246bfb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2400c06c0 con 0x7fd240155490 2023-11-18T20:39:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd246bfb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2400c1020 con 0x7fd2400a9b40 2023-11-18T20:39:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd246bfb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400a5820 con 0x7fd2400c1500 2023-11-18T20:39:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd244997640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd240155490 0x7fd2400a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33964/0 (socket says 172.21.15.132:33964) 2023-11-18T20:39:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd244997640 1 -- 172.21.15.132:0/2335408494 learned_addr learned my addr 172.21.15.132:0/2335408494 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd245198640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2400c1500 0x7fd2400c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388769646 0 0) 0x7fd2400c06c0 con 0x7fd240155490 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.280+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c005730 con 0x7fd240155490 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183410068 0 0) 0x7fd22c005730 con 0x7fd240155490 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2400c1500 msgr2=0x7fd2400c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2400c1500 0x7fd2400c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 >> v1:172.21.15.161:6789/0 conn(0x7fd2400a9b40 legacy=0x7fd2400c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400c0910 con 0x7fd240155490 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fd2300019f0 con 0x7fd240155490 2023-11-18T20:39:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 >> v1:172.21.15.132:6789/0 conn(0x7fd240155490 legacy=0x7fd2400a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c005bb0 0x7fd22c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2400c1500 0x7fd22c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd22c006f10 0x7fd22c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c00dd20 con 0x7fd22c005bb0 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c00de60 con 0x7fd22c006f10 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c00e020 con 0x7fd2400c1500 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.281+0000 7fd244997640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c005bb0 0x7fd22c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.282+0000 7fd244997640 1 -- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2400c1500 msgr2=0x7fd22c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.282+0000 7fd244997640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2400c1500 0x7fd22c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.282+0000 7fd244997640 1 -- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd22c006f10 msgr2=0x7fd22c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.282+0000 7fd244997640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd22c006f10 0x7fd22c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.282+0000 7fd244997640 1 -- 172.21.15.132:0/2335408494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c005730 con 0x7fd22c005bb0 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.283+0000 7fd244997640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c005bb0 0x7fd22c005fd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd23000a820 tx=0x7fd22c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5e7f849a956c57 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.283+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300072d0 con 0x7fd22c005bb0 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.283+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23002f070 con 0x7fd22c005bb0 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.283+0000 7fd23f7fe640 1 -- 172.21.15.132:0/2335408494 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300076b0 con 0x7fd22c005bb0 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.284+0000 7fd246bfb640 1 -- 172.21.15.132:0/2335408494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c005bb0 msgr2=0x7fd22c005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.284+0000 7fd246bfb640 1 --2- 172.21.15.132:0/2335408494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c005bb0 0x7fd22c005fd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd23000a820 tx=0x7fd22c007a00 comp rx=0 tx=0).stop 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.284+0000 7fd245198640 1 -- 172.21.15.132:0/2335408494 reap_dead start 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.284+0000 7fd246bfb640 1 -- 172.21.15.132:0/2335408494 shutdown_connections 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.284+0000 7fd246bfb640 1 -- 172.21.15.132:0/2335408494 >> 172.21.15.132:0/2335408494 conn(0x7fd24006a500 msgr2=0x7fd24006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.284+0000 7fd246bfb640 1 -- 172.21.15.132:0/2335408494 shutdown_connections 2023-11-18T20:39:35.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.284+0000 7fd246bfb640 1 -- 172.21.15.132:0/2335408494 wait complete. 2023-11-18T20:39:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.286+0000 7fd246bfb640 1 Processor -- start 2023-11-18T20:39:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.286+0000 7fd246bfb640 1 -- start start 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.286+0000 7fd246bfb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd22c005bb0 0x7fd240154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.286+0000 7fd246bfb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2401e6070 0x7fd240151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.286+0000 7fd246bfb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2400a7180 0x7fd2401519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.286+0000 7fd246bfb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24009c550 con 0x7fd2401e6070 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd246bfb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401e6570 con 0x7fd2400a7180 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd246bfb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401e8b80 con 0x7fd22c005bb0 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd23ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2401e6070 0x7fd240151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd23ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2401e6070 0x7fd240151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48962/0 (socket says 172.21.15.132:48962) 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd23ffff640 1 -- 172.21.15.132:0/3686917969 learned_addr learned my addr 172.21.15.132:0/3686917969 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd244997640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd22c005bb0 0x7fd240154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd245198640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2400a7180 0x7fd2401519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd23ffff640 1 -- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd22c005bb0 msgr2=0x7fd240154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd23ffff640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd22c005bb0 0x7fd240154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd23ffff640 1 -- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2400a7180 msgr2=0x7fd2401519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd23ffff640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2400a7180 0x7fd2401519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd23ffff640 1 -- 172.21.15.132:0/3686917969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400bf1d0 con 0x7fd2401e6070 2023-11-18T20:39:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd244997640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd22c005bb0 0x7fd240154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.287+0000 7fd245198640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2400a7180 0x7fd2401519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.288+0000 7fd23ffff640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2401e6070 0x7fd240151470 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c500 tx=0x7fd22800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.288+0000 7fd23d7fa640 1 -- 172.21.15.132:0/3686917969 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2280052d0 con 0x7fd2401e6070 2023-11-18T20:39:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.288+0000 7fd23d7fa640 1 -- 172.21.15.132:0/3686917969 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd228005430 con 0x7fd2401e6070 2023-11-18T20:39:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.288+0000 7fd23d7fa640 1 -- 172.21.15.132:0/3686917969 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228012870 con 0x7fd2401e6070 2023-11-18T20:39:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.288+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2400bf4b0 con 0x7fd2401e6070 2023-11-18T20:39:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.288+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd240154980 con 0x7fd2401e6070 2023-11-18T20:39:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.289+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd240068350 con 0x7fd2401e6070 2023-11-18T20:39:35.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.290+0000 7fd23d7fa640 1 -- 172.21.15.132:0/3686917969 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2280129d0 con 0x7fd2401e6070 2023-11-18T20:39:35.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.291+0000 7fd23d7fa640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd22006ae70 0x7fd22006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.291+0000 7fd23d7fa640 1 -- 172.21.15.132:0/3686917969 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd2280894f0 con 0x7fd2401e6070 2023-11-18T20:39:35.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.292+0000 7fd244997640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd22006ae70 0x7fd22006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.293+0000 7fd244997640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd22006ae70 0x7fd22006d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd23000a820 tx=0x7fd230007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:35.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.295+0000 7fd23d7fa640 1 -- 172.21.15.132:0/3686917969 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd228054230 con 0x7fd2401e6070 2023-11-18T20:39:35.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.485+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2400674d0 con 0x7fd2401e6070 2023-11-18T20:39:35.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.487+0000 7fd23d7fa640 1 -- 172.21.15.132:0/3686917969 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd228057850 con 0x7fd2401e6070 2023-11-18T20:39:35.488 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:35.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd22006ae70 msgr2=0x7fd22006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd22006ae70 0x7fd22006d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd23000a820 tx=0x7fd230007000 comp rx=0 tx=0).stop 2023-11-18T20:39:35.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2401e6070 msgr2=0x7fd240151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2401e6070 0x7fd240151470 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c500 tx=0x7fd22800c9c0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 shutdown_connections 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd22006ae70 0x7fd22006d330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2400a7180 0x7fd2401519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2401e6070 0x7fd240151470 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 --2- 172.21.15.132:0/3686917969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd22c005bb0 0x7fd240154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 >> 172.21.15.132:0/3686917969 conn(0x7fd24006a500 msgr2=0x7fd2400aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 shutdown_connections 2023-11-18T20:39:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.490+0000 7fd246bfb640 1 -- 172.21.15.132:0/3686917969 wait complete. 2023-11-18T20:39:35.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:39:35.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.721+0000 7f6a7133a640 1 Processor -- start 2023-11-18T20:39:35.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.721+0000 7f6a7133a640 1 -- start start 2023-11-18T20:39:35.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.723+0000 7f6a7133a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a6c0c1ca0 0x7f6a6c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.723+0000 7f6a7133a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c071e30 0x7f6a6c0c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.723+0000 7f6a7133a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c06d580 con 0x7f6a6c155fc0 2023-11-18T20:39:35.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.723+0000 7f6a7133a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c06dd60 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.723+0000 7f6a7133a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0c6580 con 0x7f6a6c071e30 2023-11-18T20:39:35.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.724+0000 7f6a6b7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c071e30 0x7f6a6c0c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.724+0000 7f6a6b7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c071e30 0x7f6a6c0c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:34824/0 (socket says 172.21.15.132:34824) 2023-11-18T20:39:35.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.724+0000 7f6a6affd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6a6c155fc0 0x7f6a6c159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:53788/0 (socket says 172.21.15.132:53788) 2023-11-18T20:39:35.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.724+0000 7f6a6b7fe640 1 -- 172.21.15.132:0/2131515983 learned_addr learned my addr 172.21.15.132:0/2131515983 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:35.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.724+0000 7f6a627fc640 1 --2- 172.21.15.132:0/2131515983 >> v2:172.21.15.161:3300/0 conn(0x7f6a6c0c1ca0 0x7f6a6c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.725+0000 7f6a627fc640 1 -- 172.21.15.132:0/2131515983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c071e30 msgr2=0x7f6a6c0c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:35.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.725+0000 7f6a627fc640 1 --2- 172.21.15.132:0/2131515983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c071e30 0x7f6a6c0c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.725+0000 7f6a627fc640 1 -- 172.21.15.132:0/2131515983 >> v1:172.21.15.161:6789/0 conn(0x7f6a6c155fc0 legacy=0x7f6a6c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.725+0000 7f6a627fc640 1 -- 172.21.15.132:0/2131515983 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0726d0 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.726+0000 7f6a627fc640 1 --2- 172.21.15.132:0/2131515983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c0c2750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a540097d0 tx=0x7f6a5402b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58e4e1145157ef35 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:35.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.727+0000 7f6a6a7fc640 1 -- 172.21.15.132:0/2131515983 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54030710 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.727+0000 7f6a6a7fc640 1 -- 172.21.15.132:0/2131515983 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5402e050 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.727+0000 7f6a6a7fc640 1 -- 172.21.15.132:0/2131515983 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54030a90 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.727+0000 7f6a7133a640 1 -- 172.21.15.132:0/2131515983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c0c1ca0 msgr2=0x7f6a6c0c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.727+0000 7f6a7133a640 1 --2- 172.21.15.132:0/2131515983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c0c2750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a540097d0 tx=0x7f6a5402b780 comp rx=0 tx=0).stop 2023-11-18T20:39:35.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.728+0000 7f6a7133a640 1 -- 172.21.15.132:0/2131515983 shutdown_connections 2023-11-18T20:39:35.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.728+0000 7f6a7133a640 1 --2- 172.21.15.132:0/2131515983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c071e30 0x7f6a6c0c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.728+0000 7f6a7133a640 1 --2- 172.21.15.132:0/2131515983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c0c2750 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.728+0000 7f6a7133a640 1 -- 172.21.15.132:0/2131515983 >> 172.21.15.132:0/2131515983 conn(0x7f6a6c06a500 msgr2=0x7f6a6c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:35.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.728+0000 7f6a7133a640 1 -- 172.21.15.132:0/2131515983 shutdown_connections 2023-11-18T20:39:35.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.728+0000 7f6a7133a640 1 -- 172.21.15.132:0/2131515983 wait complete. 2023-11-18T20:39:35.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.729+0000 7f6a7133a640 1 Processor -- start 2023-11-18T20:39:35.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.730+0000 7f6a7133a640 1 -- start start 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.730+0000 7f6a7133a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c071e30 0x7f6a6c1f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.730+0000 7f6a7133a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c1f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.730+0000 7f6a7133a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c155fc0 0x7f6a6c1f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.730+0000 7f6a7133a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c1e27a0 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.730+0000 7f6a7133a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c15a090 con 0x7f6a6c071e30 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.730+0000 7f6a7133a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c1f00f0 con 0x7f6a6c155fc0 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c1f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c1f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48976/0 (socket says 172.21.15.132:48976) 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 -- 172.21.15.132:0/1497353976 learned_addr learned my addr 172.21.15.132:0/1497353976 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a6affd640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c071e30 0x7f6a6c1f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a6b7fe640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c155fc0 0x7f6a6c1f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 -- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c155fc0 msgr2=0x7f6a6c1f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c155fc0 0x7f6a6c1f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 -- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c071e30 msgr2=0x7f6a6c1f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c071e30 0x7f6a6c1f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 -- 172.21.15.132:0/1497353976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54009400 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.731+0000 7f6a627fc640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c1f21b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6a540098f0 tx=0x7f6a540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.732+0000 7f6a63fff640 1 -- 172.21.15.132:0/1497353976 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5403b8d0 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.732+0000 7f6a63fff640 1 -- 172.21.15.132:0/1497353976 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5403ba50 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.732+0000 7f6a63fff640 1 -- 172.21.15.132:0/1497353976 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5403be00 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.732+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6c1f26f0 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.732+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c1efaa0 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.733+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6c1ef900 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.734+0000 7f6a63fff640 1 -- 172.21.15.132:0/1497353976 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a54039040 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.735+0000 7f6a63fff640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a4c06ae70 0x7f6a4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:35.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.735+0000 7f6a63fff640 1 -- 172.21.15.132:0/1497353976 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6a540ab190 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.735+0000 7f6a6affd640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a4c06ae70 0x7f6a4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:35.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.736+0000 7f6a6affd640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a4c06ae70 0x7f6a4c06d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000f60 tx=0x7f6a5c007c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.739+0000 7f6a63fff640 1 -- 172.21.15.132:0/1497353976 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a6c1ef900 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.927+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a6c1ef900 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.928+0000 7f6a63fff640 1 -- 172.21.15.132:0/1497353976 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a6c1ef900 con 0x7f6a6c0c1ca0 2023-11-18T20:39:35.929 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:35.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a4c06ae70 msgr2=0x7f6a4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a4c06ae70 0x7f6a4c06d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000f60 tx=0x7f6a5c007c80 comp rx=0 tx=0).stop 2023-11-18T20:39:35.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c0c1ca0 msgr2=0x7f6a6c1f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:35.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c1f21b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6a540098f0 tx=0x7f6a540046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 shutdown_connections 2023-11-18T20:39:35.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6a4c06ae70 0x7f6a4c06d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a6c155fc0 0x7f6a6c1f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c0c1ca0 0x7f6a6c1f21b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 --2- 172.21.15.132:0/1497353976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a6c071e30 0x7f6a6c1f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:35.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 >> 172.21.15.132:0/1497353976 conn(0x7f6a6c06a500 msgr2=0x7f6a6c070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:35.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 shutdown_connections 2023-11-18T20:39:35.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:35.931+0000 7f6a7133a640 1 -- 172.21.15.132:0/1497353976 wait complete. 2023-11-18T20:39:35.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:39:36.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.163+0000 7f616997c640 1 Processor -- start 2023-11-18T20:39:36.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.163+0000 7f616997c640 1 -- start start 2023-11-18T20:39:36.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.165+0000 7f616997c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f61640c45d0 0x7f6164155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.165+0000 7f616997c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c3340 0x7f6164156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.165+0000 7f616997c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640bfdc0 con 0x7f61640c5ec0 2023-11-18T20:39:36.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.165+0000 7f616997c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616406e390 con 0x7f61640c45d0 2023-11-18T20:39:36.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.165+0000 7f616997c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616406ddd0 con 0x7f61640c3340 2023-11-18T20:39:36.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.165+0000 7f6162ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f61640c5ec0 0x7f61640c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33966/0 (socket says 172.21.15.132:33966) 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.165+0000 7f6162ffd640 1 -- 172.21.15.132:0/1978730747 learned_addr learned my addr 172.21.15.132:0/1978730747 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.165+0000 7f61627fc640 1 --2- 172.21.15.132:0/1978730747 >> v2:172.21.15.132:3300/0 conn(0x7f61640c45d0 0x7f6164155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.166+0000 7f61637fe640 1 --2- 172.21.15.132:0/1978730747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c3340 0x7f6164156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.166+0000 7f6161ffb640 1 -- 172.21.15.132:0/1978730747 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917317726 0 0) 0x7f61640bfdc0 con 0x7f61640c5ec0 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.166+0000 7f6161ffb640 1 -- 172.21.15.132:0/1978730747 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614c003520 con 0x7f61640c5ec0 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.166+0000 7f61627fc640 1 -- 172.21.15.132:0/1978730747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c3340 msgr2=0x7f6164156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.166+0000 7f61627fc640 1 --2- 172.21.15.132:0/1978730747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c3340 0x7f6164156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.166+0000 7f61627fc640 1 -- 172.21.15.132:0/1978730747 >> v1:172.21.15.132:6789/0 conn(0x7f61640c5ec0 legacy=0x7f61640c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.166+0000 7f61627fc640 1 -- 172.21.15.132:0/1978730747 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616406e0b0 con 0x7f61640c45d0 2023-11-18T20:39:36.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.167+0000 7f61627fc640 1 --2- 172.21.15.132:0/1978730747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c45d0 0x7f6164155e30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f61580097d0 tx=0x7f615802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923bbc1fd68b22cb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:36.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.167+0000 7f6161ffb640 1 -- 172.21.15.132:0/1978730747 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580316f0 con 0x7f61640c45d0 2023-11-18T20:39:36.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.167+0000 7f6161ffb640 1 -- 172.21.15.132:0/1978730747 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158031850 con 0x7f61640c45d0 2023-11-18T20:39:36.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.167+0000 7f6161ffb640 1 -- 172.21.15.132:0/1978730747 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158031be0 con 0x7f61640c45d0 2023-11-18T20:39:36.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.168+0000 7f616997c640 1 -- 172.21.15.132:0/1978730747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c45d0 msgr2=0x7f6164155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.168+0000 7f616997c640 1 --2- 172.21.15.132:0/1978730747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c45d0 0x7f6164155e30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f61580097d0 tx=0x7f615802b790 comp rx=0 tx=0).stop 2023-11-18T20:39:36.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.168+0000 7f616997c640 1 -- 172.21.15.132:0/1978730747 shutdown_connections 2023-11-18T20:39:36.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.168+0000 7f616997c640 1 --2- 172.21.15.132:0/1978730747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c3340 0x7f6164156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.168+0000 7f616997c640 1 --2- 172.21.15.132:0/1978730747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c45d0 0x7f6164155e30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.168+0000 7f616997c640 1 -- 172.21.15.132:0/1978730747 >> 172.21.15.132:0/1978730747 conn(0x7f616406a500 msgr2=0x7f616406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:36.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.168+0000 7f616997c640 1 -- 172.21.15.132:0/1978730747 shutdown_connections 2023-11-18T20:39:36.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.168+0000 7f616997c640 1 -- 172.21.15.132:0/1978730747 wait complete. 2023-11-18T20:39:36.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.170+0000 7f616997c640 1 Processor -- start 2023-11-18T20:39:36.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.170+0000 7f616997c640 1 -- start start 2023-11-18T20:39:36.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f616997c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c3340 0x7f61640a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f616997c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c45d0 0x7f616414b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f616997c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61640c5ec0 0x7f616414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f616997c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61641eaa50 con 0x7f61640c3340 2023-11-18T20:39:36.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f616997c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6164150f90 con 0x7f61640c5ec0 2023-11-18T20:39:36.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f616997c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6164151270 con 0x7f61640c45d0 2023-11-18T20:39:36.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f6162ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c3340 0x7f61640a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f6162ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c3340 0x7f61640a6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48988/0 (socket says 172.21.15.132:48988) 2023-11-18T20:39:36.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f6162ffd640 1 -- 172.21.15.132:0/622929055 learned_addr learned my addr 172.21.15.132:0/622929055 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:36.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f6162ffd640 1 -- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c45d0 msgr2=0x7f616414b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f6162ffd640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c45d0 0x7f616414b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f6162ffd640 1 -- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61640c5ec0 msgr2=0x7f616414d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f6162ffd640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61640c5ec0 0x7f616414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.171+0000 7f6162ffd640 1 -- 172.21.15.132:0/622929055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009400 con 0x7f61640c3340 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.172+0000 7f6162ffd640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c3340 0x7f61640a6e60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f615400c410 tx=0x7f615400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.172+0000 7f614bfff640 1 -- 172.21.15.132:0/622929055 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154005ce0 con 0x7f61640c3340 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.172+0000 7f614bfff640 1 -- 172.21.15.132:0/622929055 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154005e40 con 0x7f61640c3340 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.172+0000 7f614bfff640 1 -- 172.21.15.132:0/622929055 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540072f0 con 0x7f61640c3340 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.172+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61641ead30 con 0x7f61640c3340 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.172+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61640c0a80 con 0x7f61640c3340 2023-11-18T20:39:36.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.173+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6164068350 con 0x7f61640c3340 2023-11-18T20:39:36.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.174+0000 7f614bfff640 1 -- 172.21.15.132:0/622929055 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6154007510 con 0x7f61640c3340 2023-11-18T20:39:36.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.175+0000 7f614bfff640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f615006ae40 0x7f615006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.175+0000 7f614bfff640 1 -- 172.21.15.132:0/622929055 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6154088ff0 con 0x7f61640c3340 2023-11-18T20:39:36.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.176+0000 7f61627fc640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f615006ae40 0x7f615006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.176+0000 7f61627fc640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f615006ae40 0x7f615006d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6158036000 tx=0x7f6158030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:36.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.179+0000 7f614bfff640 1 -- 172.21.15.132:0/622929055 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61540bbe90 con 0x7f61640c3340 2023-11-18T20:39:36.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.368+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61641eab90 con 0x7f61640c3340 2023-11-18T20:39:36.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.369+0000 7f614bfff640 1 -- 172.21.15.132:0/622929055 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7f61641eab90 con 0x7f61640c3340 2023-11-18T20:39:36.371 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:36.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f615006ae40 msgr2=0x7f615006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f615006ae40 0x7f615006d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6158036000 tx=0x7f6158030000 comp rx=0 tx=0).stop 2023-11-18T20:39:36.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c3340 msgr2=0x7f61640a6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c3340 0x7f61640a6e60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f615400c410 tx=0x7f615400c8d0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 shutdown_connections 2023-11-18T20:39:36.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f615006ae40 0x7f615006d300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61640c5ec0 0x7f616414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61640c45d0 0x7f616414b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 --2- 172.21.15.132:0/622929055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61640c3340 0x7f61640a6e60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 >> 172.21.15.132:0/622929055 conn(0x7f616406a500 msgr2=0x7f6164070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:36.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 shutdown_connections 2023-11-18T20:39:36.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.372+0000 7f616997c640 1 -- 172.21.15.132:0/622929055 wait complete. 2023-11-18T20:39:36.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:39:36.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.606+0000 7f518af7c640 1 Processor -- start 2023-11-18T20:39:36.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.606+0000 7f518af7c640 1 -- start start 2023-11-18T20:39:36.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.607+0000 7f518af7c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f518414fd30 0x7f5184152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.607+0000 7f518af7c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518406d0a0 0x7f51840a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f518af7c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51840a5260 0x7f51840c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f518af7c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51840c64a0 con 0x7f518414fd30 2023-11-18T20:39:36.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f518af7c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51840c5c00 con 0x7f51840a5260 2023-11-18T20:39:36.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f518af7c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51840c5ee0 con 0x7f518406d0a0 2023-11-18T20:39:36.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f5188d18640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f518414fd30 0x7f5184152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f5188d18640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f518414fd30 0x7f5184152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48994/0 (socket says 172.21.15.132:48994) 2023-11-18T20:39:36.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f5188d18640 1 -- 172.21.15.132:0/820190908 learned_addr learned my addr 172.21.15.132:0/820190908 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:36.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f5189519640 1 --2- 172.21.15.132:0/820190908 >> v2:172.21.15.161:3300/0 conn(0x7f51840a5260 0x7f51840c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.608+0000 7f5183fff640 1 --2- 172.21.15.132:0/820190908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518406d0a0 0x7f51840a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.609+0000 7f5188d18640 1 -- 172.21.15.132:0/820190908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518406d0a0 msgr2=0x7f51840a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:36.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.609+0000 7f5188d18640 1 --2- 172.21.15.132:0/820190908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518406d0a0 0x7f51840a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.609+0000 7f5188d18640 1 -- 172.21.15.132:0/820190908 >> v2:172.21.15.161:3300/0 conn(0x7f51840a5260 msgr2=0x7f51840c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:36.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.609+0000 7f5188d18640 1 --2- 172.21.15.132:0/820190908 >> v2:172.21.15.161:3300/0 conn(0x7f51840a5260 0x7f51840c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.609+0000 7f5188d18640 1 -- 172.21.15.132:0/820190908 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51840c61c0 con 0x7f518414fd30 2023-11-18T20:39:36.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.610+0000 7f5188d18640 1 --2- 172.21.15.132:0/820190908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518414fd30 0x7f5184152f20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f518406d990 tx=0x7f517802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7438d2e12c57d77f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:36.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.610+0000 7f51837fe640 1 -- 172.21.15.132:0/820190908 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178031860 con 0x7f518414fd30 2023-11-18T20:39:36.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.610+0000 7f51837fe640 1 -- 172.21.15.132:0/820190908 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51780319c0 con 0x7f518414fd30 2023-11-18T20:39:36.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.610+0000 7f51837fe640 1 -- 172.21.15.132:0/820190908 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178031d50 con 0x7f518414fd30 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 -- 172.21.15.132:0/820190908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518414fd30 msgr2=0x7f5184152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 --2- 172.21.15.132:0/820190908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518414fd30 0x7f5184152f20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f518406d990 tx=0x7f517802b900 comp rx=0 tx=0).stop 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 -- 172.21.15.132:0/820190908 shutdown_connections 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 --2- 172.21.15.132:0/820190908 >> v2:172.21.15.161:3300/0 conn(0x7f51840a5260 0x7f51840c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 --2- 172.21.15.132:0/820190908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f518406d0a0 0x7f51840a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 --2- 172.21.15.132:0/820190908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518414fd30 0x7f5184152f20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 -- 172.21.15.132:0/820190908 >> 172.21.15.132:0/820190908 conn(0x7f518406a500 msgr2=0x7f518406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 -- 172.21.15.132:0/820190908 shutdown_connections 2023-11-18T20:39:36.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.611+0000 7f518af7c640 1 -- 172.21.15.132:0/820190908 wait complete. 2023-11-18T20:39:36.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.613+0000 7f518af7c640 1 Processor -- start 2023-11-18T20:39:36.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.613+0000 7f518af7c640 1 -- start start 2023-11-18T20:39:36.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f518af7c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518406d0a0 0x7f5184156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f518af7c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51840a5260 0x7f518414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f518af7c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51841565b0 0x7f518414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f518af7c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51841de970 con 0x7f518406d0a0 2023-11-18T20:39:36.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f518af7c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518414b760 con 0x7f51841565b0 2023-11-18T20:39:36.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f518af7c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51841539f0 con 0x7f51840a5260 2023-11-18T20:39:36.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f5188d18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518406d0a0 0x7f5184156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f5188d18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518406d0a0 0x7f5184156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48996/0 (socket says 172.21.15.132:48996) 2023-11-18T20:39:36.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.614+0000 7f5188d18640 1 -- 172.21.15.132:0/3843064186 learned_addr learned my addr 172.21.15.132:0/3843064186 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:36.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.615+0000 7f5189519640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51841565b0 0x7f518414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.615+0000 7f5183fff640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51840a5260 0x7f518414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.615+0000 7f5188d18640 1 -- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51840a5260 msgr2=0x7f518414ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.615+0000 7f5188d18640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51840a5260 0x7f518414ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.615+0000 7f5188d18640 1 -- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51841565b0 msgr2=0x7f518414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.615+0000 7f5188d18640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51841565b0 0x7f518414b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.615+0000 7f5188d18640 1 -- 172.21.15.132:0/3843064186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780094d0 con 0x7f518406d0a0 2023-11-18T20:39:36.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.615+0000 7f5188d18640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518406d0a0 0x7f5184156070 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f517802be90 tx=0x7f51780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:36.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.616+0000 7f51817fa640 1 -- 172.21.15.132:0/3843064186 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517803ad30 con 0x7f518406d0a0 2023-11-18T20:39:36.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.616+0000 7f51817fa640 1 -- 172.21.15.132:0/3843064186 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517803ae90 con 0x7f518406d0a0 2023-11-18T20:39:36.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.616+0000 7f51817fa640 1 -- 172.21.15.132:0/3843064186 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178044630 con 0x7f518406d0a0 2023-11-18T20:39:36.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.616+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51841ea120 con 0x7f518406d0a0 2023-11-18T20:39:36.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.616+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51841ea6e0 con 0x7f518406d0a0 2023-11-18T20:39:36.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.617+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5184068350 con 0x7f518406d0a0 2023-11-18T20:39:36.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.618+0000 7f51817fa640 1 -- 172.21.15.132:0/3843064186 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f517804d450 con 0x7f518406d0a0 2023-11-18T20:39:36.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.619+0000 7f51817fa640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:36.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.619+0000 7f51817fa640 1 -- 172.21.15.132:0/3843064186 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f51780abe30 con 0x7f518406d0a0 2023-11-18T20:39:36.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.620+0000 7f5183fff640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:36.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.621+0000 7f5183fff640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516806ae70 0x7f516806d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f51840a4d10 tx=0x7f5170008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:36.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.624+0000 7f51817fa640 1 -- 172.21.15.132:0/3843064186 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5178076c10 con 0x7f518406d0a0 2023-11-18T20:39:36.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.820+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f51840c66d0 con 0x7f518406d0a0 2023-11-18T20:39:36.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.820+0000 7f51817fa640 1 -- 172.21.15.132:0/3843064186 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7f51780350a0 con 0x7f518406d0a0 2023-11-18T20:39:36.821 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:36.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516806ae70 msgr2=0x7f516806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516806ae70 0x7f516806d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f51840a4d10 tx=0x7f5170008040 comp rx=0 tx=0).stop 2023-11-18T20:39:36.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518406d0a0 msgr2=0x7f5184156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:36.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518406d0a0 0x7f5184156070 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f517802be90 tx=0x7f51780046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 shutdown_connections 2023-11-18T20:39:36.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51841565b0 0x7f518414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51840a5260 0x7f518414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 --2- 172.21.15.132:0/3843064186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518406d0a0 0x7f5184156070 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:36.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 >> 172.21.15.132:0/3843064186 conn(0x7f518406a500 msgr2=0x7f518406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:36.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 shutdown_connections 2023-11-18T20:39:36.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:36.823+0000 7f518af7c640 1 -- 172.21.15.132:0/3843064186 wait complete. 2023-11-18T20:39:36.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:39:37.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.050+0000 7f2a4ab3e640 1 Processor -- start 2023-11-18T20:39:37.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.051+0000 7f2a4ab3e640 1 -- start start 2023-11-18T20:39:37.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.052+0000 7f2a4ab3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2a440c6680 0x7f2a440c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.052+0000 7f2a4ab3e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440c7950 0x7f2a440c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.052+0000 7f2a4ab3e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440c4220 con 0x7f2a440a6bc0 2023-11-18T20:39:37.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.052+0000 7f2a4ab3e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a440c2e80 con 0x7f2a440c6680 2023-11-18T20:39:37.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.052+0000 7f2a4ab3e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440c2ba0 con 0x7f2a440c7950 2023-11-18T20:39:37.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.052+0000 7f2a488da640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2a440c6680 0x7f2a440c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.052+0000 7f2a488da640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2a440c6680 0x7f2a440c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49002/0 (socket says 172.21.15.132:49002) 2023-11-18T20:39:37.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.052+0000 7f2a488da640 1 -- 172.21.15.132:0/3988898240 learned_addr learned my addr 172.21.15.132:0/3988898240 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:37.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.053+0000 7f2a488da640 1 -- 172.21.15.132:0/3988898240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440c7950 msgr2=0x7f2a440c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:37.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.053+0000 7f2a488da640 1 --2- 172.21.15.132:0/3988898240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440c7950 0x7f2a440c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.053+0000 7f2a488da640 1 -- 172.21.15.132:0/3988898240 >> v1:172.21.15.161:6789/0 conn(0x7f2a440a6bc0 legacy=0x7f2a440c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:37.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.053+0000 7f2a488da640 1 -- 172.21.15.132:0/3988898240 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440c32e0 con 0x7f2a440c6680 2023-11-18T20:39:37.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.054+0000 7f2a488da640 1 --2- 172.21.15.132:0/3988898240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a440c6a60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009870 tx=0x7f2a2c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34da2aaceb1efaa server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.054+0000 7f2a437fe640 1 -- 172.21.15.132:0/3988898240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c031740 con 0x7f2a440c6680 2023-11-18T20:39:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.054+0000 7f2a437fe640 1 -- 172.21.15.132:0/3988898240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0318a0 con 0x7f2a440c6680 2023-11-18T20:39:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.054+0000 7f2a437fe640 1 -- 172.21.15.132:0/3988898240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c031c30 con 0x7f2a440c6680 2023-11-18T20:39:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.055+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3988898240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 msgr2=0x7f2a440c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.055+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3988898240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a440c6a60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009870 tx=0x7f2a2c02b7e0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.055+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3988898240 shutdown_connections 2023-11-18T20:39:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.055+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3988898240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440c7950 0x7f2a440c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.055+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3988898240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a440c6a60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.055+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3988898240 >> 172.21.15.132:0/3988898240 conn(0x7f2a440c7e30 msgr2=0x7f2a440c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:37.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.055+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3988898240 shutdown_connections 2023-11-18T20:39:37.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.055+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3988898240 wait complete. 2023-11-18T20:39:37.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.057+0000 7f2a4ab3e640 1 Processor -- start 2023-11-18T20:39:37.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.057+0000 7f2a4ab3e640 1 -- start start 2023-11-18T20:39:37.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a4ab3e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440a6bc0 0x7f2a440a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a4ab3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a4406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a4ab3e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440c7950 0x7f2a441ea920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a4ab3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441ea440 con 0x7f2a440c6680 2023-11-18T20:39:37.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a4ab3e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441eda30 con 0x7f2a440c7950 2023-11-18T20:39:37.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a4ab3e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440a9f50 con 0x7f2a440a6bc0 2023-11-18T20:39:37.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a43fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a4406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a43fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a4406cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49004/0 (socket says 172.21.15.132:49004) 2023-11-18T20:39:37.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a43fff640 1 -- 172.21.15.132:0/3803487996 learned_addr learned my addr 172.21.15.132:0/3803487996 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:37.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a488da640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440a6bc0 0x7f2a440a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a43fff640 1 -- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440a6bc0 msgr2=0x7f2a440a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a43fff640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440a6bc0 0x7f2a440a7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a43fff640 1 -- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440c7950 msgr2=0x7f2a441ea920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.058+0000 7f2a490db640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440c7950 0x7f2a441ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a43fff640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440c7950 0x7f2a441ea920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a43fff640 1 -- 172.21.15.132:0/3803487996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0094d0 con 0x7f2a440c6680 2023-11-18T20:39:37.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a490db640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440c7950 0x7f2a441ea920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:37.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a43fff640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a4406cd40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400ba50 tx=0x7f2a3400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:37.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a417fa640 1 -- 172.21.15.132:0/3803487996 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400cc10 con 0x7f2a440c6680 2023-11-18T20:39:37.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a417fa640 1 -- 172.21.15.132:0/3803487996 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400cd70 con 0x7f2a440c6680 2023-11-18T20:39:37.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a417fa640 1 -- 172.21.15.132:0/3803487996 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34014680 con 0x7f2a440c6680 2023-11-18T20:39:37.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a44156d60 con 0x7f2a440c6680 2023-11-18T20:39:37.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.059+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4406d280 con 0x7f2a440c6680 2023-11-18T20:39:37.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.060+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44068350 con 0x7f2a440c6680 2023-11-18T20:39:37.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.061+0000 7f2a417fa640 1 -- 172.21.15.132:0/3803487996 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a3401d3b0 con 0x7f2a440c6680 2023-11-18T20:39:37.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.062+0000 7f2a417fa640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.062+0000 7f2a417fa640 1 -- 172.21.15.132:0/3803487996 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2a34089970 con 0x7f2a440c6680 2023-11-18T20:39:37.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.063+0000 7f2a488da640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.064+0000 7f2a488da640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a2406ae40 0x7f2a2406d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c035000 tx=0x7f2a2c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:37.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.067+0000 7f2a417fa640 1 -- 172.21.15.132:0/3803487996 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a340546b0 con 0x7f2a440c6680 2023-11-18T20:39:37.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.270+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a440c5f10 con 0x7f2a440c6680 2023-11-18T20:39:37.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.271+0000 7f2a417fa640 1 -- 172.21.15.132:0/3803487996 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a34019080 con 0x7f2a440c6680 2023-11-18T20:39:37.272 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:39:37.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.273+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a2406ae40 msgr2=0x7f2a2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.273+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a2406ae40 0x7f2a2406d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c035000 tx=0x7f2a2c008030 comp rx=0 tx=0).stop 2023-11-18T20:39:37.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.273+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 msgr2=0x7f2a4406cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.273+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a4406cd40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400ba50 tx=0x7f2a3400bf10 comp rx=0 tx=0).stop 2023-11-18T20:39:37.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.274+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 shutdown_connections 2023-11-18T20:39:37.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.274+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.274+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440c7950 0x7f2a441ea920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.274+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a440c6680 0x7f2a4406cd40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.274+0000 7f2a4ab3e640 1 --2- 172.21.15.132:0/3803487996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a440a6bc0 0x7f2a440a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.274+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 >> 172.21.15.132:0/3803487996 conn(0x7f2a440c7e30 msgr2=0x7f2a44153d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:37.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.274+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 shutdown_connections 2023-11-18T20:39:37.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.274+0000 7f2a4ab3e640 1 -- 172.21.15.132:0/3803487996 wait complete. 2023-11-18T20:39:37.292 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-18T20:39:37.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:37.293 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:37.407 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:39:37.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:37.407 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T20:39:37.459 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:39:37.460 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:37.508 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-18T20:39:37.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:39:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.728+0000 7f53538bb640 1 Processor -- start 2023-11-18T20:39:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.728+0000 7f53538bb640 1 -- start start 2023-11-18T20:39:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.729+0000 7f53538bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f534c14fd30 0x7f534c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.729+0000 7f53538bb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 0x7f534c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.729+0000 7f53538bb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f534c0a5260 0x7f534c0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.729+0000 7f53538bb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0c64a0 con 0x7f534c14fd30 2023-11-18T20:39:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f53538bb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0c5c00 con 0x7f534c0a5260 2023-11-18T20:39:37.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f53538bb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0c5ee0 con 0x7f534c06d0a0 2023-11-18T20:39:37.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351657640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f534c14fd30 0x7f534c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351657640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f534c14fd30 0x7f534c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49016/0 (socket says 172.21.15.132:49016) 2023-11-18T20:39:37.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351657640 1 -- 172.21.15.132:0/2980305865 learned_addr learned my addr 172.21.15.132:0/2980305865 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351657640 1 -- 172.21.15.132:0/2980305865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 msgr2=0x7f534c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351657640 1 --2- 172.21.15.132:0/2980305865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 0x7f534c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351657640 1 -- 172.21.15.132:0/2980305865 >> v2:172.21.15.161:3300/0 conn(0x7f534c0a5260 msgr2=0x7f534c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351e58640 1 --2- 172.21.15.132:0/2980305865 >> v2:172.21.15.161:3300/0 conn(0x7f534c0a5260 0x7f534c0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351657640 1 --2- 172.21.15.132:0/2980305865 >> v2:172.21.15.161:3300/0 conn(0x7f534c0a5260 0x7f534c0c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.730+0000 7f5351657640 1 -- 172.21.15.132:0/2980305865 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0c61c0 con 0x7f534c14fd30 2023-11-18T20:39:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.731+0000 7f5351657640 1 --2- 172.21.15.132:0/2980305865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c14fd30 0x7f534c152f20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f534c06d990 tx=0x7f534802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ed0e7122ebb389 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.732+0000 7f533ffff640 1 -- 172.21.15.132:0/2980305865 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348031870 con 0x7f534c14fd30 2023-11-18T20:39:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.732+0000 7f533ffff640 1 -- 172.21.15.132:0/2980305865 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480319d0 con 0x7f534c14fd30 2023-11-18T20:39:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.732+0000 7f533ffff640 1 -- 172.21.15.132:0/2980305865 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348031d60 con 0x7f534c14fd30 2023-11-18T20:39:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.732+0000 7f53538bb640 1 -- 172.21.15.132:0/2980305865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c14fd30 msgr2=0x7f534c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.732+0000 7f53538bb640 1 --2- 172.21.15.132:0/2980305865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c14fd30 0x7f534c152f20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f534c06d990 tx=0x7f534802b910 comp rx=0 tx=0).stop 2023-11-18T20:39:37.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.733+0000 7f53538bb640 1 -- 172.21.15.132:0/2980305865 shutdown_connections 2023-11-18T20:39:37.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.733+0000 7f53538bb640 1 --2- 172.21.15.132:0/2980305865 >> v2:172.21.15.161:3300/0 conn(0x7f534c0a5260 0x7f534c0c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.733+0000 7f53538bb640 1 --2- 172.21.15.132:0/2980305865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 0x7f534c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.733+0000 7f53538bb640 1 --2- 172.21.15.132:0/2980305865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c14fd30 0x7f534c152f20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.733+0000 7f53538bb640 1 -- 172.21.15.132:0/2980305865 >> 172.21.15.132:0/2980305865 conn(0x7f534c06a500 msgr2=0x7f534c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:37.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.733+0000 7f53538bb640 1 -- 172.21.15.132:0/2980305865 shutdown_connections 2023-11-18T20:39:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.733+0000 7f53538bb640 1 -- 172.21.15.132:0/2980305865 wait complete. 2023-11-18T20:39:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.734+0000 7f53538bb640 1 Processor -- start 2023-11-18T20:39:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.734+0000 7f53538bb640 1 -- start start 2023-11-18T20:39:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.735+0000 7f53538bb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 0x7f534c1ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.735+0000 7f53538bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c0a5260 0x7f534c1df3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.735+0000 7f53538bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534c14fd30 0x7f534c0a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.735+0000 7f53538bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0aaf40 con 0x7f534c0a5260 2023-11-18T20:39:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.735+0000 7f53538bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1df8e0 con 0x7f534c14fd30 2023-11-18T20:39:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.735+0000 7f53538bb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1dcc40 con 0x7f534c06d0a0 2023-11-18T20:39:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5350e56640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c0a5260 0x7f534c1df3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5350e56640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c0a5260 0x7f534c1df3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49030/0 (socket says 172.21.15.132:49030) 2023-11-18T20:39:37.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5350e56640 1 -- 172.21.15.132:0/2782727222 learned_addr learned my addr 172.21.15.132:0/2782727222 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:37.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5351657640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 0x7f534c1ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5351e58640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534c14fd30 0x7f534c0a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5350e56640 1 -- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 msgr2=0x7f534c1ea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5350e56640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 0x7f534c1ea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5350e56640 1 -- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534c14fd30 msgr2=0x7f534c0a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5350e56640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534c14fd30 0x7f534c0a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.736+0000 7f5350e56640 1 -- 172.21.15.132:0/2782727222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480094d0 con 0x7f534c0a5260 2023-11-18T20:39:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.737+0000 7f5350e56640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c0a5260 0x7f534c1df3a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f534000b480 tx=0x7f534000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.737+0000 7f533dffb640 1 -- 172.21.15.132:0/2782727222 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340010870 con 0x7f534c0a5260 2023-11-18T20:39:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.737+0000 7f533dffb640 1 -- 172.21.15.132:0/2782727222 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53400109d0 con 0x7f534c0a5260 2023-11-18T20:39:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.737+0000 7f533dffb640 1 -- 172.21.15.132:0/2782727222 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340010d80 con 0x7f534c0a5260 2023-11-18T20:39:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.737+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c0aa980 con 0x7f534c0a5260 2023-11-18T20:39:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.737+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c1ed850 con 0x7f534c0a5260 2023-11-18T20:39:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.738+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c1ed6b0 con 0x7f534c0a5260 2023-11-18T20:39:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.739+0000 7f533dffb640 1 -- 172.21.15.132:0/2782727222 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f534000f3c0 con 0x7f534c0a5260 2023-11-18T20:39:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.740+0000 7f533dffb640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f533006ae40 0x7f533006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.740+0000 7f533dffb640 1 -- 172.21.15.132:0/2782727222 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5340089960 con 0x7f534c0a5260 2023-11-18T20:39:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.741+0000 7f5351657640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f533006ae40 0x7f533006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:37.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.742+0000 7f5351657640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f533006ae40 0x7f533006d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5348036000 tx=0x7f534803c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:37.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.744+0000 7f533dffb640 1 -- 172.21.15.132:0/2782727222 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f534c1ed6b0 con 0x7f534c0a5260 2023-11-18T20:39:37.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.974+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f534c1ed6b0 con 0x7f534c0a5260 2023-11-18T20:39:37.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.975+0000 7f533dffb640 1 -- 172.21.15.132:0/2782727222 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+149 (secure 0 0 0) 0x7f53400140b0 con 0x7f534c0a5260 2023-11-18T20:39:37.976 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:39:37.976 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-18T20:39:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f533006ae40 msgr2=0x7f533006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f533006ae40 0x7f533006d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5348036000 tx=0x7f534803c040 comp rx=0 tx=0).stop 2023-11-18T20:39:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c0a5260 msgr2=0x7f534c1df3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c0a5260 0x7f534c1df3a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f534000b480 tx=0x7f534000b940 comp rx=0 tx=0).stop 2023-11-18T20:39:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 shutdown_connections 2023-11-18T20:39:37.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f533006ae40 0x7f533006d300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534c14fd30 0x7f534c0a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f534c0a5260 0x7f534c1df3a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 --2- 172.21.15.132:0/2782727222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534c06d0a0 0x7f534c1ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:37.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.977+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 >> 172.21.15.132:0/2782727222 conn(0x7f534c06a500 msgr2=0x7f534c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:37.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.978+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 shutdown_connections 2023-11-18T20:39:37.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:37.978+0000 7f53538bb640 1 -- 172.21.15.132:0/2782727222 wait complete. 2023-11-18T20:39:37.997 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-18T20:39:37.997 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:39:37.997 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-18T20:39:37.997 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T20:39:37.997 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:37.998 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-18T20:39:37.998 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:39:37.998 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:39:37.998 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:39:37.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:37.998 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-18T20:39:38.059 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:39:38.059 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:39:38.060 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:39:38.060 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:38.060 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-18T20:39:38.060 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:38.061 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:38.061 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:38.061 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-18T20:39:38.061 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:38.061 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:38.062 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-18T20:39:38.062 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:38.062 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:38.062 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:39:38.063 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:38.063 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:39:38.063 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42331sec preferred_lft 42331sec 2023-11-18T20:39:38.063 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-18T20:39:38.064 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:38.064 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:39:38.064 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:38.064 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:39:38.064 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:38.065 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::78f3:28ff:fe93:897/64 scope link 2023-11-18T20:39:38.065 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:38.065 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:39:38.065 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:39:38.066 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::442e:5aff:fe28:3e67/64 scope link 2023-11-18T20:39:38.066 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:38.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:38.068 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:39:38.166 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:39:38.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:38.170 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-18T20:39:38.227 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-18T20:39:38.228 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:39:38.228 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:39:38.228 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:39:38.228 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:39:38.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:38.228 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:39:38.228 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:39:38.228 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:39:38.228 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:39:38.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:39:38.229 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:39:38.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:38.412 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:39:38.466 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T20:39:38.467 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:39:38.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:38.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-18T20:39:38.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:39:38.562 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:38.611 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:39:38.612 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:39:38.612 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:38.659 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:39:38.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:38.659 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:39:38.797 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:39:38.797 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:39:38.797 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:39:38.819 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:39:38.819 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:39:38.819 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:39:38.819 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:39:38.819 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:39:38.845 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:39:38.846 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:39:38.846 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:39:38.846 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:39:38.846 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:39:38.846 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:39:38.846 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:39:38.846 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:39:38.847 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T20:39:38.847 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:39:38.848 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:39:38.848 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:39:38.848 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:39:38.851 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:39:38.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:38.851 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:38.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:38.934 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:39:38.993 INFO:teuthology.orchestra.run.smithi161.stdout:client5415 2023-11-18T20:39:38.994 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:39:38.994 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:39.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-11-18T20:39:39.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.269+0000 7f1c41ccf640 1 Processor -- start 2023-11-18T20:39:39.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.270+0000 7f1c41ccf640 1 -- start start 2023-11-18T20:39:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.271+0000 7f1c41ccf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.271+0000 7f1c41ccf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1c3c071f70 0x7f1c3c0c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.271+0000 7f1c41ccf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c0c0980 con 0x7f1c3c14fa80 2023-11-18T20:39:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.271+0000 7f1c41ccf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c06d160 con 0x7f1c3c071f70 2023-11-18T20:39:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.271+0000 7f1c41ccf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c06c070 con 0x7f1c3c072530 2023-11-18T20:39:39.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.272+0000 7f1c33fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:39.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.272+0000 7f1c3b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1c3c14fa80 0x7f1c3c06d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:45570/0 (socket says 172.21.15.132:45570) 2023-11-18T20:39:39.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.272+0000 7f1c3b7fe640 1 -- 172.21.15.132:0/4251004553 learned_addr learned my addr 172.21.15.132:0/4251004553 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:39.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.272+0000 7f1c3bfff640 1 --2- 172.21.15.132:0/4251004553 >> v2:172.21.15.161:3300/0 conn(0x7f1c3c071f70 0x7f1c3c0c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.273+0000 7f1c33fff640 1 -- 172.21.15.132:0/4251004553 >> v2:172.21.15.161:3300/0 conn(0x7f1c3c071f70 msgr2=0x7f1c3c0c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.273+0000 7f1c33fff640 1 --2- 172.21.15.132:0/4251004553 >> v2:172.21.15.161:3300/0 conn(0x7f1c3c071f70 0x7f1c3c0c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.273+0000 7f1c33fff640 1 -- 172.21.15.132:0/4251004553 >> v1:172.21.15.161:6789/0 conn(0x7f1c3c14fa80 legacy=0x7f1c3c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.273+0000 7f1c33fff640 1 -- 172.21.15.132:0/4251004553 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0c20d0 con 0x7f1c3c072530 2023-11-18T20:39:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.274+0000 7f1c33fff640 1 --2- 172.21.15.132:0/4251004553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0c5380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c240097a0 tx=0x7f1c2402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=993314f16c7f94f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.275+0000 7f1c3affd640 1 -- 172.21.15.132:0/4251004553 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2402d040 con 0x7f1c3c072530 2023-11-18T20:39:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.275+0000 7f1c3affd640 1 -- 172.21.15.132:0/4251004553 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24031810 con 0x7f1c3c072530 2023-11-18T20:39:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.275+0000 7f1c3affd640 1 -- 172.21.15.132:0/4251004553 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24031ba0 con 0x7f1c3c072530 2023-11-18T20:39:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.275+0000 7f1c41ccf640 1 -- 172.21.15.132:0/4251004553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 msgr2=0x7f1c3c0c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.275+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/4251004553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0c5380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c240097a0 tx=0x7f1c2402b8b0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.276+0000 7f1c41ccf640 1 -- 172.21.15.132:0/4251004553 shutdown_connections 2023-11-18T20:39:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.276+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/4251004553 >> v2:172.21.15.161:3300/0 conn(0x7f1c3c071f70 0x7f1c3c0c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.276+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/4251004553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0c5380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.276+0000 7f1c41ccf640 1 -- 172.21.15.132:0/4251004553 >> 172.21.15.132:0/4251004553 conn(0x7f1c3c0c5bc0 msgr2=0x7f1c3c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.276+0000 7f1c41ccf640 1 -- 172.21.15.132:0/4251004553 shutdown_connections 2023-11-18T20:39:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.276+0000 7f1c41ccf640 1 -- 172.21.15.132:0/4251004553 wait complete. 2023-11-18T20:39:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.278+0000 7f1c41ccf640 1 Processor -- start 2023-11-18T20:39:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.278+0000 7f1c41ccf640 1 -- start start 2023-11-18T20:39:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.279+0000 7f1c41ccf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c3c071f70 0x7f1c3c0bf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.279+0000 7f1c41ccf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.279+0000 7f1c41ccf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c3c14fa80 0x7f1c3c0aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.279+0000 7f1c41ccf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c151ec0 con 0x7f1c3c071f70 2023-11-18T20:39:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.279+0000 7f1c41ccf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c151bc0 con 0x7f1c3c14fa80 2023-11-18T20:39:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.279+0000 7f1c41ccf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0707d0 con 0x7f1c3c072530 2023-11-18T20:39:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c3c071f70 0x7f1c3c0bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c3c071f70 0x7f1c3c0bf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41848/0 (socket says 172.21.15.132:41848) 2023-11-18T20:39:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3b7fe640 1 -- 172.21.15.132:0/1430708148 learned_addr learned my addr 172.21.15.132:0/1430708148 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:39.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3bfff640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c3c14fa80 0x7f1c3c0aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:39.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c33fff640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:39.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3b7fe640 1 -- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 msgr2=0x7f1c3c0aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3b7fe640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3b7fe640 1 -- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c3c14fa80 msgr2=0x7f1c3c0aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3b7fe640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c3c14fa80 0x7f1c3c0aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3b7fe640 1 -- 172.21.15.132:0/1430708148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24009400 con 0x7f1c3c071f70 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.280+0000 7f1c3bfff640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c3c14fa80 0x7f1c3c0aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.281+0000 7f1c3b7fe640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c3c071f70 0x7f1c3c0bf260 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00c3f0 tx=0x7f1c2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.281+0000 7f1c38ff9640 1 -- 172.21.15.132:0/1430708148 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c005ce0 con 0x7f1c3c071f70 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.281+0000 7f1c38ff9640 1 -- 172.21.15.132:0/1430708148 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c005e40 con 0x7f1c3c071f70 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.281+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c070ab0 con 0x7f1c3c071f70 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.281+0000 7f1c38ff9640 1 -- 172.21.15.132:0/1430708148 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0072f0 con 0x7f1c3c071f70 2023-11-18T20:39:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.281+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c0bf7a0 con 0x7f1c3c071f70 2023-11-18T20:39:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.282+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c151d00 con 0x7f1c3c071f70 2023-11-18T20:39:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.283+0000 7f1c38ff9640 1 -- 172.21.15.132:0/1430708148 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c2c007450 con 0x7f1c3c071f70 2023-11-18T20:39:39.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.284+0000 7f1c38ff9640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1c06ae70 0x7f1c1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:39.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.284+0000 7f1c38ff9640 1 -- 172.21.15.132:0/1430708148 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1c2c088f50 con 0x7f1c3c071f70 2023-11-18T20:39:39.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.285+0000 7f1c33fff640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1c06ae70 0x7f1c1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:39.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.286+0000 7f1c33fff640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1c06ae70 0x7f1c1c06d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c24036000 tx=0x7f1c2403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:39.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.289+0000 7f1c38ff9640 1 -- 172.21.15.132:0/1430708148 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c3c151d00 con 0x7f1c3c071f70 2023-11-18T20:39:39.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.522+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f1c3c151d00 con 0x7f1c3c071f70 2023-11-18T20:39:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.528+0000 7f1c38ff9640 1 -- 172.21.15.132:0/1430708148 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7f1c3c151d00 con 0x7f1c3c071f70 2023-11-18T20:39:39.529 INFO:teuthology.orchestra.run.smithi132.stdout:[client.testuser] 2023-11-18T20:39:39.529 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQALIVlloodCHxAAM/G+/vw1/PYk7C2D2ZFYoQ== 2023-11-18T20:39:39.529 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow rw fsname=cephfs" 2023-11-18T20:39:39.529 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r fsname=cephfs" 2023-11-18T20:39:39.530 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-18T20:39:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1c06ae70 msgr2=0x7f1c1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1c06ae70 0x7f1c1c06d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c24036000 tx=0x7f1c2403c040 comp rx=0 tx=0).stop 2023-11-18T20:39:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c3c071f70 msgr2=0x7f1c3c0bf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c3c071f70 0x7f1c3c0bf260 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00c3f0 tx=0x7f1c2c00c8b0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 shutdown_connections 2023-11-18T20:39:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1c06ae70 0x7f1c1c06d330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c3c14fa80 0x7f1c3c0aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c3c072530 0x7f1c3c0aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 --2- 172.21.15.132:0/1430708148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c3c071f70 0x7f1c3c0bf260 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 >> 172.21.15.132:0/1430708148 conn(0x7f1c3c0c5bc0 msgr2=0x7f1c3c14d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 shutdown_connections 2023-11-18T20:39:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:39.531+0000 7f1c41ccf640 1 -- 172.21.15.132:0/1430708148 wait complete. 2023-11-18T20:39:39.552 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-18T20:39:39.603 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.kM9lnalBwu 2023-11-18T20:39:39.603 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:39:39.603 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/tmp/tmp.kM9lnalBwu 2023-11-18T20:39:39.654 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:39:39.654 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:39.753 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:39:39.753 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:39.805 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:40.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.009+0000 7f1ced46e640 1 Processor -- start 2023-11-18T20:39:40.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.009+0000 7f1ced46e640 1 -- start start 2023-11-18T20:39:40.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.010+0000 7f1ced46e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1ce814e7f0 0x7f1ce80c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.010+0000 7f1ced46e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1ce80c52e0 0x7f1ce806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ced46e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80a8380 con 0x7f1ce806cd20 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ced46e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce81510b0 con 0x7f1ce80c52e0 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ced46e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce806bf60 con 0x7f1ce814e7f0 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1cecc6d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1ce806cd20 0x7f1ce81546a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47234/0 (socket says 172.21.15.132:47234) 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1cecc6d640 1 -- 172.21.15.132:0/1458028460 learned_addr learned my addr 172.21.15.132:0/1458028460 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ce77fe640 1 --2- 172.21.15.132:0/1458028460 >> v2:172.21.15.132:3300/0 conn(0x7f1ce80c52e0 0x7f1ce806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ce7fff640 1 --2- 172.21.15.132:0/1458028460 >> v2:172.21.15.161:3300/0 conn(0x7f1ce814e7f0 0x7f1ce80c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ce6ffd640 1 -- 172.21.15.132:0/1458028460 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541583657 0 0) 0x7f1ce80a8380 con 0x7f1ce806cd20 2023-11-18T20:39:40.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ce6ffd640 1 -- 172.21.15.132:0/1458028460 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd0005730 con 0x7f1ce806cd20 2023-11-18T20:39:40.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ce77fe640 1 -- 172.21.15.132:0/1458028460 >> v2:172.21.15.161:3300/0 conn(0x7f1ce814e7f0 msgr2=0x7f1ce80c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:40.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ce77fe640 1 --2- 172.21.15.132:0/1458028460 >> v2:172.21.15.161:3300/0 conn(0x7f1ce814e7f0 0x7f1ce80c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.011+0000 7f1ce77fe640 1 -- 172.21.15.132:0/1458028460 >> v1:172.21.15.132:6789/0 conn(0x7f1ce806cd20 legacy=0x7f1ce81546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.012+0000 7f1ce77fe640 1 -- 172.21.15.132:0/1458028460 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce806c240 con 0x7f1ce80c52e0 2023-11-18T20:39:40.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.013+0000 7f1ce77fe640 1 --2- 172.21.15.132:0/1458028460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce80c52e0 0x7f1ce806d1e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8067910 tx=0x7f1cdc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3687d4f5456acb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.013+0000 7f1ce6ffd640 1 -- 172.21.15.132:0/1458028460 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc02e070 con 0x7f1ce80c52e0 2023-11-18T20:39:40.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.013+0000 7f1ce6ffd640 1 -- 172.21.15.132:0/1458028460 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc0315a0 con 0x7f1ce80c52e0 2023-11-18T20:39:40.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.013+0000 7f1ce6ffd640 1 -- 172.21.15.132:0/1458028460 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc031930 con 0x7f1ce80c52e0 2023-11-18T20:39:40.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.013+0000 7f1ced46e640 1 -- 172.21.15.132:0/1458028460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce80c52e0 msgr2=0x7f1ce806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.013+0000 7f1ced46e640 1 --2- 172.21.15.132:0/1458028460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce80c52e0 0x7f1ce806d1e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8067910 tx=0x7f1cdc02b840 comp rx=0 tx=0).stop 2023-11-18T20:39:40.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.014+0000 7f1ced46e640 1 -- 172.21.15.132:0/1458028460 shutdown_connections 2023-11-18T20:39:40.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.014+0000 7f1ced46e640 1 --2- 172.21.15.132:0/1458028460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce80c52e0 0x7f1ce806d1e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.014+0000 7f1ced46e640 1 --2- 172.21.15.132:0/1458028460 >> v2:172.21.15.161:3300/0 conn(0x7f1ce814e7f0 0x7f1ce80c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.014+0000 7f1ced46e640 1 -- 172.21.15.132:0/1458028460 >> 172.21.15.132:0/1458028460 conn(0x7f1ce80a77f0 msgr2=0x7f1ce80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:40.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.014+0000 7f1ced46e640 1 -- 172.21.15.132:0/1458028460 shutdown_connections 2023-11-18T20:39:40.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.014+0000 7f1ced46e640 1 -- 172.21.15.132:0/1458028460 wait complete. 2023-11-18T20:39:40.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.015+0000 7f1ced46e640 1 Processor -- start 2023-11-18T20:39:40.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.015+0000 7f1ced46e640 1 -- start start 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.016+0000 7f1ced46e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce806cd20 0x7f1ce8149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.016+0000 7f1ced46e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce80c52e0 0x7f1ce80a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.016+0000 7f1ced46e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce814e7f0 0x7f1ce8147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.016+0000 7f1ced46e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce814a430 con 0x7f1ce806cd20 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.016+0000 7f1ced46e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce81494a0 con 0x7f1ce80c52e0 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.016+0000 7f1ced46e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8149a60 con 0x7f1ce814e7f0 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce806cd20 0x7f1ce8149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce806cd20 0x7f1ce8149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41862/0 (socket says 172.21.15.132:41862) 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 -- 172.21.15.132:0/3815256971 learned_addr learned my addr 172.21.15.132:0/3815256971 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 -- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce814e7f0 msgr2=0x7f1ce8147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce814e7f0 0x7f1ce8147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 -- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce80c52e0 msgr2=0x7f1ce80a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce77fe640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce80c52e0 0x7f1ce80a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce80c52e0 0x7f1ce80a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 -- 172.21.15.132:0/3815256971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc009400 con 0x7f1ce806cd20 2023-11-18T20:39:40.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.017+0000 7f1ce7fff640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce806cd20 0x7f1ce8149ef0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800d620 tx=0x7f1cd800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.018+0000 7f1ce4ff9640 1 -- 172.21.15.132:0/3815256971 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800b620 con 0x7f1ce806cd20 2023-11-18T20:39:40.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.018+0000 7f1ce4ff9640 1 -- 172.21.15.132:0/3815256971 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd800b780 con 0x7f1ce806cd20 2023-11-18T20:39:40.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.018+0000 7f1ce4ff9640 1 -- 172.21.15.132:0/3815256971 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800bb30 con 0x7f1ce806cd20 2023-11-18T20:39:40.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.018+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce814b660 con 0x7f1ce806cd20 2023-11-18T20:39:40.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.018+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce81496f0 con 0x7f1ce806cd20 2023-11-18T20:39:40.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.019+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce8152030 con 0x7f1ce806cd20 2023-11-18T20:39:40.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.020+0000 7f1ce4ff9640 1 -- 172.21.15.132:0/3815256971 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1cd800bc90 con 0x7f1ce806cd20 2023-11-18T20:39:40.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.021+0000 7f1ce4ff9640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1cd406ae40 0x7f1cd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.021+0000 7f1ce4ff9640 1 -- 172.21.15.132:0/3815256971 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1cd8089db0 con 0x7f1ce806cd20 2023-11-18T20:39:40.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.021+0000 7f1ce77fe640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1cd406ae40 0x7f1cd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.022+0000 7f1ce77fe640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1cd406ae40 0x7f1cd406d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc036000 tx=0x7f1cdc03d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.025+0000 7f1ce4ff9640 1 -- 172.21.15.132:0/3815256971 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1cd8054b90 con 0x7f1ce806cd20 2023-11-18T20:39:40.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.220+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce804e840 con 0x7f1ce806cd20 2023-11-18T20:39:40.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.224+0000 7f1ce4ff9640 1 -- 172.21.15.132:0/3815256971 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20201 (secure 0 0 0) 0x7f1cd80581b0 con 0x7f1ce806cd20 2023-11-18T20:39:40.226 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:40.226 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":39,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:24.407150+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:40.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1cd406ae40 msgr2=0x7f1cd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1cd406ae40 0x7f1cd406d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc036000 tx=0x7f1cdc03d040 comp rx=0 tx=0).stop 2023-11-18T20:39:40.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce806cd20 msgr2=0x7f1ce8149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce806cd20 0x7f1ce8149ef0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800d620 tx=0x7f1cd800dae0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 shutdown_connections 2023-11-18T20:39:40.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1cd406ae40 0x7f1cd406d300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce814e7f0 0x7f1ce8147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce80c52e0 0x7f1ce80a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 --2- 172.21.15.132:0/3815256971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ce806cd20 0x7f1ce8149ef0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 >> 172.21.15.132:0/3815256971 conn(0x7f1ce80a77f0 msgr2=0x7f1ce80a7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:40.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 shutdown_connections 2023-11-18T20:39:40.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.227+0000 7f1ced46e640 1 -- 172.21.15.132:0/3815256971 wait complete. 2023-11-18T20:39:40.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:39:00.655880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:39:01.207461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:39:20.671493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:39:21.849411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:39:40.248 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:39:40.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.461+0000 7f22f2f0f640 1 Processor -- start 2023-11-18T20:39:40.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.461+0000 7f22f2f0f640 1 -- start start 2023-11-18T20:39:40.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f2f0f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22ec14fd30 0x7f22ec152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f2f0f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22ec06d0a0 0x7f22ec0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f2f0f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec0c64a0 con 0x7f22ec0a5260 2023-11-18T20:39:40.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f2f0f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0c5c00 con 0x7f22ec14fd30 2023-11-18T20:39:40.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f2f0f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0c5ee0 con 0x7f22ec06d0a0 2023-11-18T20:39:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f0cab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22ec14fd30 0x7f22ec152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f14ac640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f22ec0a5260 0x7f22ec0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47236/0 (socket says 172.21.15.132:47236) 2023-11-18T20:39:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f14ac640 1 -- 172.21.15.132:0/1192920225 learned_addr learned my addr 172.21.15.132:0/1192920225 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.463+0000 7f22f0cab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22ec14fd30 0x7f22ec152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41866/0 (socket says 172.21.15.132:41866) 2023-11-18T20:39:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.464+0000 7f22ebfff640 1 --2- 172.21.15.132:0/1192920225 >> v2:172.21.15.161:3300/0 conn(0x7f22ec06d0a0 0x7f22ec0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.464+0000 7f22f0cab640 1 -- 172.21.15.132:0/1192920225 >> v2:172.21.15.161:3300/0 conn(0x7f22ec06d0a0 msgr2=0x7f22ec0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.464+0000 7f22f0cab640 1 --2- 172.21.15.132:0/1192920225 >> v2:172.21.15.161:3300/0 conn(0x7f22ec06d0a0 0x7f22ec0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.464+0000 7f22f0cab640 1 -- 172.21.15.132:0/1192920225 >> v1:172.21.15.132:6789/0 conn(0x7f22ec0a5260 legacy=0x7f22ec0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.464+0000 7f22f0cab640 1 -- 172.21.15.132:0/1192920225 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0c61c0 con 0x7f22ec14fd30 2023-11-18T20:39:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.465+0000 7f22f0cab640 1 --2- 172.21.15.132:0/1192920225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec152f20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f22ec06b460 tx=0x7f22d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec821e4af3310f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.465+0000 7f22eb7fe640 1 -- 172.21.15.132:0/1192920225 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4031830 con 0x7f22ec14fd30 2023-11-18T20:39:40.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.465+0000 7f22eb7fe640 1 -- 172.21.15.132:0/1192920225 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4031990 con 0x7f22ec14fd30 2023-11-18T20:39:40.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.465+0000 7f22eb7fe640 1 -- 172.21.15.132:0/1192920225 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4031d20 con 0x7f22ec14fd30 2023-11-18T20:39:40.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.466+0000 7f22f2f0f640 1 -- 172.21.15.132:0/1192920225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 msgr2=0x7f22ec152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.466+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/1192920225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec152f20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f22ec06b460 tx=0x7f22d402b8d0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.466+0000 7f22f2f0f640 1 -- 172.21.15.132:0/1192920225 shutdown_connections 2023-11-18T20:39:40.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.466+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/1192920225 >> v2:172.21.15.161:3300/0 conn(0x7f22ec06d0a0 0x7f22ec0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.466+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/1192920225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec152f20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.466+0000 7f22f2f0f640 1 -- 172.21.15.132:0/1192920225 >> 172.21.15.132:0/1192920225 conn(0x7f22ec06a500 msgr2=0x7f22ec06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:40.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.466+0000 7f22f2f0f640 1 -- 172.21.15.132:0/1192920225 shutdown_connections 2023-11-18T20:39:40.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.466+0000 7f22f2f0f640 1 -- 172.21.15.132:0/1192920225 wait complete. 2023-11-18T20:39:40.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.468+0000 7f22f2f0f640 1 Processor -- start 2023-11-18T20:39:40.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.468+0000 7f22f2f0f640 1 -- start start 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f2f0f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22ec06d0a0 0x7f22ec1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f2f0f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22ec0a5260 0x7f22ec14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f2f0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f2f0f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec151f60 con 0x7f22ec14fd30 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f2f0f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec151940 con 0x7f22ec06d0a0 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f2f0f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec1eabc0 con 0x7f22ec0a5260 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f14ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f14ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec14a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41870/0 (socket says 172.21.15.132:41870) 2023-11-18T20:39:40.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f14ac640 1 -- 172.21.15.132:0/3644882263 learned_addr learned my addr 172.21.15.132:0/3644882263 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:40.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f14ac640 1 -- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22ec0a5260 msgr2=0x7f22ec14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f14ac640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22ec0a5260 0x7f22ec14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f14ac640 1 -- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22ec06d0a0 msgr2=0x7f22ec1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f14ac640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22ec06d0a0 0x7f22ec1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.469+0000 7f22f14ac640 1 -- 172.21.15.132:0/3644882263 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4009400 con 0x7f22ec14fd30 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.470+0000 7f22f14ac640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec14a090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c420 tx=0x7f22e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.470+0000 7f22e97fa640 1 -- 172.21.15.132:0/3644882263 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4005ce0 con 0x7f22ec14fd30 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.470+0000 7f22e97fa640 1 -- 172.21.15.132:0/3644882263 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e4005e40 con 0x7f22ec14fd30 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.470+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec1eaea0 con 0x7f22ec14fd30 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.470+0000 7f22e97fa640 1 -- 172.21.15.132:0/3644882263 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e40072d0 con 0x7f22ec14fd30 2023-11-18T20:39:40.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.470+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec1507c0 con 0x7f22ec14fd30 2023-11-18T20:39:40.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.471+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec1520d0 con 0x7f22ec14fd30 2023-11-18T20:39:40.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.472+0000 7f22e97fa640 1 -- 172.21.15.132:0/3644882263 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22e40074f0 con 0x7f22ec14fd30 2023-11-18T20:39:40.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.473+0000 7f22e97fa640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f22cc06ae40 0x7f22cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.473+0000 7f22e97fa640 1 -- 172.21.15.132:0/3644882263 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f22e4088f20 con 0x7f22ec14fd30 2023-11-18T20:39:40.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.474+0000 7f22f0cab640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f22cc06ae40 0x7f22cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.475+0000 7f22f0cab640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f22cc06ae40 0x7f22cc06d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f22d4036000 tx=0x7f22d4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.477+0000 7f22e97fa640 1 -- 172.21.15.132:0/3644882263 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22ec1520d0 con 0x7f22ec14fd30 2023-11-18T20:39:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.666+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22ec1520d0 con 0x7f22ec14fd30 2023-11-18T20:39:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.667+0000 7f22e97fa640 1 -- 172.21.15.132:0/3644882263 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22ec1520d0 con 0x7f22ec14fd30 2023-11-18T20:39:40.669 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:39:40.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f22cc06ae40 msgr2=0x7f22cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f22cc06ae40 0x7f22cc06d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f22d4036000 tx=0x7f22d4030000 comp rx=0 tx=0).stop 2023-11-18T20:39:40.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 msgr2=0x7f22ec14a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec14a090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c420 tx=0x7f22e400c8e0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 shutdown_connections 2023-11-18T20:39:40.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f22cc06ae40 0x7f22cc06d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22ec14fd30 0x7f22ec14a090 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22ec0a5260 0x7f22ec14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 --2- 172.21.15.132:0/3644882263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22ec06d0a0 0x7f22ec1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.670+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 >> 172.21.15.132:0/3644882263 conn(0x7f22ec06a500 msgr2=0x7f22ec0c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:40.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.671+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 shutdown_connections 2023-11-18T20:39:40.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.671+0000 7f22f2f0f640 1 -- 172.21.15.132:0/3644882263 wait complete. 2023-11-18T20:39:40.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:39:40.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.905+0000 7f15f94dc640 1 Processor -- start 2023-11-18T20:39:40.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.905+0000 7f15f94dc640 1 -- start start 2023-11-18T20:39:40.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.906+0000 7f15f94dc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f40c0c80 0x7f15f40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.906+0000 7f15f94dc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f4071e80 con 0x7f15f40c0440 2023-11-18T20:39:40.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.906+0000 7f15f94dc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f4072a20 con 0x7f15f414c2e0 2023-11-18T20:39:40.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.906+0000 7f15f94dc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4071470 con 0x7f15f40c0c80 2023-11-18T20:39:40.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15ebfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f15f40c0440 0x7f15f4072310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47250/0 (socket says 172.21.15.132:47250) 2023-11-18T20:39:40.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15ebfff640 1 -- 172.21.15.132:0/3369260333 learned_addr learned my addr 172.21.15.132:0/3369260333 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:40.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15f8cdb640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f40c0c80 0x7f15f40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749383602 0 0) 0x7f15f4071e80 con 0x7f15f40c0440 2023-11-18T20:39:40.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e0003520 con 0x7f15f40c0440 2023-11-18T20:39:40.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3340838231 0 0) 0x7f15e0003520 con 0x7f15f40c0440 2023-11-18T20:39:40.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f40c0c80 msgr2=0x7f15f40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:40.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15f37fe640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f40c0c80 0x7f15f40a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 >> v1:172.21.15.161:6789/0 conn(0x7f15f414c2e0 legacy=0x7f15f4152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.907+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f414c6c0 con 0x7f15f40c0440 2023-11-18T20:39:40.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f15dc001670 con 0x7f15f40c0440 2023-11-18T20:39:40.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 >> v1:172.21.15.132:6789/0 conn(0x7f15f40c0440 legacy=0x7f15f4072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f37fe640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f37fe640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15e00047c0 0x7f15e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f37fe640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f40c0c80 0x7f15e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00054d0 con 0x7f15e00039a0 2023-11-18T20:39:40.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e0005640 con 0x7f15e00047c0 2023-11-18T20:39:40.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e000bef0 con 0x7f15f40c0c80 2023-11-18T20:39:40.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f3fff640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15ebfff640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15e00047c0 0x7f15e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f3fff640 1 -- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f40c0c80 msgr2=0x7f15e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:40.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f3fff640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f40c0c80 0x7f15e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f3fff640 1 -- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15e00047c0 msgr2=0x7f15e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:40.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f3fff640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15e00047c0 0x7f15e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15f3fff640 1 -- 172.21.15.132:0/3369260333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0003520 con 0x7f15e00039a0 2023-11-18T20:39:40.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.908+0000 7f15ebfff640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15e00047c0 0x7f15e0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:40.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f3fff640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15e0003dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f15e4001750 tx=0x7f15e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8585778fe4c5527b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40052d0 con 0x7f15e00039a0 2023-11-18T20:39:40.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e402e050 con 0x7f15e00039a0 2023-11-18T20:39:40.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f37fe640 1 -- 172.21.15.132:0/3369260333 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40035f0 con 0x7f15e00039a0 2023-11-18T20:39:40.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f94dc640 1 -- 172.21.15.132:0/3369260333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 msgr2=0x7f15e0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f94dc640 1 --2- 172.21.15.132:0/3369260333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15e0003dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f15e4001750 tx=0x7f15e00057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f8cdb640 1 -- 172.21.15.132:0/3369260333 reap_dead start 2023-11-18T20:39:40.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f94dc640 1 -- 172.21.15.132:0/3369260333 shutdown_connections 2023-11-18T20:39:40.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f94dc640 1 -- 172.21.15.132:0/3369260333 >> 172.21.15.132:0/3369260333 conn(0x7f15f40a77f0 msgr2=0x7f15f40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:40.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f94dc640 1 -- 172.21.15.132:0/3369260333 shutdown_connections 2023-11-18T20:39:40.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.910+0000 7f15f94dc640 1 -- 172.21.15.132:0/3369260333 wait complete. 2023-11-18T20:39:40.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.912+0000 7f15f94dc640 1 Processor -- start 2023-11-18T20:39:40.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.912+0000 7f15f94dc640 1 -- start start 2023-11-18T20:39:40.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f94dc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15f4149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f94dc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d2c0 0x7f15f4152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f94dc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f4152c80 0x7f15f406c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f94dc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f41e97a0 con 0x7f15e00039a0 2023-11-18T20:39:40.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f94dc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4155a50 con 0x7f15f406d2c0 2023-11-18T20:39:40.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f94dc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4149670 con 0x7f15f4152c80 2023-11-18T20:39:40.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15f4149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15f4149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41892/0 (socket says 172.21.15.132:41892) 2023-11-18T20:39:40.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.913+0000 7f15f3fff640 1 -- 172.21.15.132:0/2499137104 learned_addr learned my addr 172.21.15.132:0/2499137104 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:40.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15ebfff640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d2c0 0x7f15f4152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15f8cdb640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f4152c80 0x7f15f406c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15f3fff640 1 -- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f4152c80 msgr2=0x7f15f406c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15f3fff640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f4152c80 0x7f15f406c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15f3fff640 1 -- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d2c0 msgr2=0x7f15f4152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:40.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15f3fff640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d2c0 0x7f15f4152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:40.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15f3fff640 1 -- 172.21.15.132:0/2499137104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4155cc0 con 0x7f15e00039a0 2023-11-18T20:39:40.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15ebfff640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d2c0 0x7f15f4152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:40.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.914+0000 7f15f3fff640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15f4149130 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f15e4008fd0 tx=0x7f15e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.915+0000 7f15f17fa640 1 -- 172.21.15.132:0/2499137104 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40076c0 con 0x7f15e00039a0 2023-11-18T20:39:40.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.915+0000 7f15f17fa640 1 -- 172.21.15.132:0/2499137104 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e4007a30 con 0x7f15e00039a0 2023-11-18T20:39:40.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.915+0000 7f15f17fa640 1 -- 172.21.15.132:0/2499137104 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4006c00 con 0x7f15e00039a0 2023-11-18T20:39:40.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.915+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f4155fa0 con 0x7f15e00039a0 2023-11-18T20:39:40.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.915+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f4156560 con 0x7f15e00039a0 2023-11-18T20:39:40.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.916+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f404e840 con 0x7f15e00039a0 2023-11-18T20:39:40.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.917+0000 7f15f17fa640 1 -- 172.21.15.132:0/2499137104 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15e40035f0 con 0x7f15e00039a0 2023-11-18T20:39:40.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.918+0000 7f15f17fa640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f15d406ae70 0x7f15d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:40.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.918+0000 7f15f17fa640 1 -- 172.21.15.132:0/2499137104 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f15e40ab710 con 0x7f15e00039a0 2023-11-18T20:39:40.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.918+0000 7f15ebfff640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f15d406ae70 0x7f15d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:40.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.919+0000 7f15ebfff640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f15d406ae70 0x7f15d406d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15f40aba30 tx=0x7f15dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:40.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:40.922+0000 7f15f17fa640 1 -- 172.21.15.132:0/2499137104 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15e4079f70 con 0x7f15e00039a0 2023-11-18T20:39:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.111+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15f406de50 con 0x7f15e00039a0 2023-11-18T20:39:41.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.112+0000 7f15f17fa640 1 -- 172.21.15.132:0/2499137104 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15e4079b00 con 0x7f15e00039a0 2023-11-18T20:39:41.113 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f15d406ae70 msgr2=0x7f15d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f15d406ae70 0x7f15d406d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15f40aba30 tx=0x7f15dc009040 comp rx=0 tx=0).stop 2023-11-18T20:39:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 msgr2=0x7f15f4149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15f4149130 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f15e4008fd0 tx=0x7f15e4001120 comp rx=0 tx=0).stop 2023-11-18T20:39:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 shutdown_connections 2023-11-18T20:39:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f15d406ae70 0x7f15d406d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f4152c80 0x7f15f406c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d2c0 0x7f15f4152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 --2- 172.21.15.132:0/2499137104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15e00039a0 0x7f15f4149130 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 >> 172.21.15.132:0/2499137104 conn(0x7f15f40a77f0 msgr2=0x7f15f40c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 shutdown_connections 2023-11-18T20:39:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.115+0000 7f15f94dc640 1 -- 172.21.15.132:0/2499137104 wait complete. 2023-11-18T20:39:41.134 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:39:41.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.345+0000 7f2ac2e21640 1 Processor -- start 2023-11-18T20:39:41.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.345+0000 7f2ac2e21640 1 -- start start 2023-11-18T20:39:41.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.346+0000 7f2ac2e21640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2abc0a9b40 0x7f2abc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.346+0000 7f2ac2e21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc0c1500 0x7f2abc0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.346+0000 7f2ac2e21640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc0c06c0 con 0x7f2abc155490 2023-11-18T20:39:41.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.346+0000 7f2ac2e21640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc0a5820 con 0x7f2abc0a9b40 2023-11-18T20:39:41.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.346+0000 7f2ac2e21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0c1020 con 0x7f2abc0c1500 2023-11-18T20:39:41.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.347+0000 7f2abbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2abc0a9b40 0x7f2abc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.347+0000 7f2abbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2abc0a9b40 0x7f2abc0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41898/0 (socket says 172.21.15.132:41898) 2023-11-18T20:39:41.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.347+0000 7f2abbfff640 1 -- 172.21.15.132:0/3197305117 learned_addr learned my addr 172.21.15.132:0/3197305117 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:41.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.347+0000 7f2ac13be640 1 --2- 172.21.15.132:0/3197305117 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc0c1500 0x7f2abc0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.347+0000 7f2abbfff640 1 -- 172.21.15.132:0/3197305117 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc0c1500 msgr2=0x7f2abc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:41.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.347+0000 7f2abbfff640 1 --2- 172.21.15.132:0/3197305117 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc0c1500 0x7f2abc0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.347+0000 7f2abbfff640 1 -- 172.21.15.132:0/3197305117 >> v1:172.21.15.161:6789/0 conn(0x7f2abc155490 legacy=0x7f2abc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:41.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.347+0000 7f2abbfff640 1 -- 172.21.15.132:0/3197305117 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0c0910 con 0x7f2abc0a9b40 2023-11-18T20:39:41.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.349+0000 7f2abbfff640 1 --2- 172.21.15.132:0/3197305117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc0a9b40 0x7f2abc0a51b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5a6f7eb7334e0f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:41.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.349+0000 7f2abb7fe640 1 -- 172.21.15.132:0/3197305117 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8031640 con 0x7f2abc0a9b40 2023-11-18T20:39:41.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.349+0000 7f2abb7fe640 1 -- 172.21.15.132:0/3197305117 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa80317a0 con 0x7f2abc0a9b40 2023-11-18T20:39:41.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.349+0000 7f2abb7fe640 1 -- 172.21.15.132:0/3197305117 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8031b30 con 0x7f2abc0a9b40 2023-11-18T20:39:41.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.350+0000 7f2ac2e21640 1 -- 172.21.15.132:0/3197305117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc0a9b40 msgr2=0x7f2abc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.350+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/3197305117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc0a9b40 0x7f2abc0a51b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa802b8f0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.350+0000 7f2ac2e21640 1 -- 172.21.15.132:0/3197305117 shutdown_connections 2023-11-18T20:39:41.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.350+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/3197305117 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc0c1500 0x7f2abc0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.350+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/3197305117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc0a9b40 0x7f2abc0a51b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.350+0000 7f2ac2e21640 1 -- 172.21.15.132:0/3197305117 >> 172.21.15.132:0/3197305117 conn(0x7f2abc06a500 msgr2=0x7f2abc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:41.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.350+0000 7f2ac2e21640 1 -- 172.21.15.132:0/3197305117 shutdown_connections 2023-11-18T20:39:41.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.350+0000 7f2ac2e21640 1 -- 172.21.15.132:0/3197305117 wait complete. 2023-11-18T20:39:41.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.352+0000 7f2ac2e21640 1 Processor -- start 2023-11-18T20:39:41.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.352+0000 7f2ac2e21640 1 -- start start 2023-11-18T20:39:41.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac2e21640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2abc0c1500 0x7f2abc154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac2e21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc155490 0x7f2abc1ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac2e21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc14d1c0 0x7f2abc1eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac2e21640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0a54d0 con 0x7f2abc14d1c0 2023-11-18T20:39:41.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac2e21640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0a4f50 con 0x7f2abc0c1500 2023-11-18T20:39:41.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac2e21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0a51f0 con 0x7f2abc155490 2023-11-18T20:39:41.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac13be640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc14d1c0 0x7f2abc1eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac13be640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc14d1c0 0x7f2abc1eddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41912/0 (socket says 172.21.15.132:41912) 2023-11-18T20:39:41.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac13be640 1 -- 172.21.15.132:0/1139369331 learned_addr learned my addr 172.21.15.132:0/1139369331 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:41.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2abbfff640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc155490 0x7f2abc1ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac13be640 1 -- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc155490 msgr2=0x7f2abc1ed890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac13be640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc155490 0x7f2abc1ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac0bbd640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2abc0c1500 0x7f2abc154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.353+0000 7f2ac13be640 1 -- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2abc0c1500 msgr2=0x7f2abc154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ac13be640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2abc0c1500 0x7f2abc154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ac13be640 1 -- 172.21.15.132:0/1139369331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa80094d0 con 0x7f2abc14d1c0 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ac0bbd640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2abc0c1500 0x7f2abc154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ac13be640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc14d1c0 0x7f2abc1eddd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4007de0 tx=0x7f2ab400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ab97fa640 1 -- 172.21.15.132:0/1139369331 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4014620 con 0x7f2abc14d1c0 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ab97fa640 1 -- 172.21.15.132:0/1139369331 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab400ee90 con 0x7f2abc14d1c0 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc1ed370 con 0x7f2abc14d1c0 2023-11-18T20:39:41.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ab97fa640 1 -- 172.21.15.132:0/1139369331 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab40149e0 con 0x7f2abc14d1c0 2023-11-18T20:39:41.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.354+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc14ea00 con 0x7f2abc14d1c0 2023-11-18T20:39:41.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.355+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc1ed5b0 con 0x7f2abc14d1c0 2023-11-18T20:39:41.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.356+0000 7f2ab97fa640 1 -- 172.21.15.132:0/1139369331 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ab4014b40 con 0x7f2abc14d1c0 2023-11-18T20:39:41.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.357+0000 7f2ab97fa640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2aa006ae70 0x7f2aa006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.357+0000 7f2ab97fa640 1 -- 172.21.15.132:0/1139369331 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2ab408a2d0 con 0x7f2abc14d1c0 2023-11-18T20:39:41.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.358+0000 7f2ac0bbd640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2aa006ae70 0x7f2aa006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.359+0000 7f2ac0bbd640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2aa006ae70 0x7f2aa006d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000a830 tx=0x7f2ab0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:41.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.361+0000 7f2ab97fa640 1 -- 172.21.15.132:0/1139369331 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2abc1ed5b0 con 0x7f2abc14d1c0 2023-11-18T20:39:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.551+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2abc1ed5b0 con 0x7f2abc14d1c0 2023-11-18T20:39:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.552+0000 7f2ab97fa640 1 -- 172.21.15.132:0/1139369331 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2abc1ed5b0 con 0x7f2abc14d1c0 2023-11-18T20:39:41.553 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.554+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2aa006ae70 msgr2=0x7f2aa006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.554+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2aa006ae70 0x7f2aa006d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000a830 tx=0x7f2ab0008040 comp rx=0 tx=0).stop 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.554+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc14d1c0 msgr2=0x7f2abc1eddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.554+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc14d1c0 0x7f2abc1eddd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4007de0 tx=0x7f2ab400e4b0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.555+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 shutdown_connections 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.555+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2aa006ae70 0x7f2aa006d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.555+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2abc14d1c0 0x7f2abc1eddd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.555+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2abc155490 0x7f2abc1ed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.555+0000 7f2ac2e21640 1 --2- 172.21.15.132:0/1139369331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2abc0c1500 0x7f2abc154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.555+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 >> 172.21.15.132:0/1139369331 conn(0x7f2abc06a500 msgr2=0x7f2abc0c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:41.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.555+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 shutdown_connections 2023-11-18T20:39:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.555+0000 7f2ac2e21640 1 -- 172.21.15.132:0/1139369331 wait complete. 2023-11-18T20:39:41.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:39:41.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.792+0000 7f7550f67640 1 Processor -- start 2023-11-18T20:39:41.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.792+0000 7f7550f67640 1 -- start start 2023-11-18T20:39:41.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f7550f67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c071c90 0x7f754c1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f7550f67640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f754c0c1110 0x7f754c15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f7550f67640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0c15a0 con 0x7f754c0c0d30 2023-11-18T20:39:41.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f7550f67640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c06df50 con 0x7f754c0c1110 2023-11-18T20:39:41.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f7550f67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0724c0 con 0x7f754c071c90 2023-11-18T20:39:41.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f754bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f754c0c1110 0x7f754c15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f754b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f754c0c0d30 0x7f754c0c1eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:45592/0 (socket says 172.21.15.132:45592) 2023-11-18T20:39:41.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f754b7fe640 1 -- 172.21.15.132:0/851136652 learned_addr learned my addr 172.21.15.132:0/851136652 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:41.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.794+0000 7f754affd640 1 --2- 172.21.15.132:0/851136652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c071c90 0x7f754c1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.795+0000 7f754bfff640 1 -- 172.21.15.132:0/851136652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c071c90 msgr2=0x7f754c1521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:41.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.795+0000 7f754bfff640 1 --2- 172.21.15.132:0/851136652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c071c90 0x7f754c1521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.795+0000 7f754bfff640 1 -- 172.21.15.132:0/851136652 >> v1:172.21.15.161:6789/0 conn(0x7f754c0c0d30 legacy=0x7f754c0c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.795+0000 7f754bfff640 1 -- 172.21.15.132:0/851136652 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0727a0 con 0x7f754c0c1110 2023-11-18T20:39:41.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.796+0000 7f754bfff640 1 --2- 172.21.15.132:0/851136652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c1110 0x7f754c15cb50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f75440097a0 tx=0x7f754402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acb92704ac9fe49 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:41.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.796+0000 7f754a7fc640 1 -- 172.21.15.132:0/851136652 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440316f0 con 0x7f754c0c1110 2023-11-18T20:39:41.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.796+0000 7f754a7fc640 1 -- 172.21.15.132:0/851136652 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7544031850 con 0x7f754c0c1110 2023-11-18T20:39:41.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.796+0000 7f754a7fc640 1 -- 172.21.15.132:0/851136652 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544031be0 con 0x7f754c0c1110 2023-11-18T20:39:41.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.797+0000 7f7550f67640 1 -- 172.21.15.132:0/851136652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c1110 msgr2=0x7f754c15cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.797+0000 7f7550f67640 1 --2- 172.21.15.132:0/851136652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c1110 0x7f754c15cb50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f75440097a0 tx=0x7f754402b790 comp rx=0 tx=0).stop 2023-11-18T20:39:41.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.797+0000 7f7550f67640 1 -- 172.21.15.132:0/851136652 shutdown_connections 2023-11-18T20:39:41.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.797+0000 7f7550f67640 1 --2- 172.21.15.132:0/851136652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c1110 0x7f754c15cb50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.797+0000 7f7550f67640 1 --2- 172.21.15.132:0/851136652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c071c90 0x7f754c1521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.797+0000 7f7550f67640 1 -- 172.21.15.132:0/851136652 >> 172.21.15.132:0/851136652 conn(0x7f754c0c6510 msgr2=0x7f754c0c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:41.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.797+0000 7f7550f67640 1 -- 172.21.15.132:0/851136652 shutdown_connections 2023-11-18T20:39:41.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.797+0000 7f7550f67640 1 -- 172.21.15.132:0/851136652 wait complete. 2023-11-18T20:39:41.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.799+0000 7f7550f67640 1 Processor -- start 2023-11-18T20:39:41.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.799+0000 7f7550f67640 1 -- start start 2023-11-18T20:39:41.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f7550f67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f754c071c90 0x7f754c1eae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f7550f67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c0d30 0x7f754c1ee230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f7550f67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c0c1110 0x7f754c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f7550f67640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1ea9a0 con 0x7f754c0c0d30 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f7550f67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1ee770 con 0x7f754c071c90 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f7550f67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1559b0 con 0x7f754c0c1110 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f754affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c0d30 0x7f754c1ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f754affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c0d30 0x7f754c1ee230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41922/0 (socket says 172.21.15.132:41922) 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.800+0000 7f754affd640 1 -- 172.21.15.132:0/3609379667 learned_addr learned my addr 172.21.15.132:0/3609379667 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f754bfff640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c0c1110 0x7f754c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f754b7fe640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f754c071c90 0x7f754c1eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f754affd640 1 -- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c0c1110 msgr2=0x7f754c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f754affd640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c0c1110 0x7f754c150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f754affd640 1 -- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f754c071c90 msgr2=0x7f754c1eae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f754affd640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f754c071c90 0x7f754c1eae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f754affd640 1 -- 172.21.15.132:0/3609379667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009400 con 0x7f754c0c0d30 2023-11-18T20:39:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f754affd640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c0d30 0x7f754c1ee230 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f753400d5f0 tx=0x7f753400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f7543fff640 1 -- 172.21.15.132:0/3609379667 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75340125f0 con 0x7f754c0c0d30 2023-11-18T20:39:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f7543fff640 1 -- 172.21.15.132:0/3609379667 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7534012750 con 0x7f754c0c0d30 2023-11-18T20:39:41.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f7543fff640 1 -- 172.21.15.132:0/3609379667 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534012b00 con 0x7f754c0c0d30 2023-11-18T20:39:41.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.801+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c155c90 con 0x7f754c0c0d30 2023-11-18T20:39:41.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.802+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c151250 con 0x7f754c0c0d30 2023-11-18T20:39:41.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.803+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c04e840 con 0x7f754c0c0d30 2023-11-18T20:39:41.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.803+0000 7f7543fff640 1 -- 172.21.15.132:0/3609379667 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7534012c60 con 0x7f754c0c0d30 2023-11-18T20:39:41.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.804+0000 7f7543fff640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f752c06ae40 0x7f752c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:41.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.804+0000 7f7543fff640 1 -- 172.21.15.132:0/3609379667 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7534089e20 con 0x7f754c0c0d30 2023-11-18T20:39:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.805+0000 7f754b7fe640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f752c06ae40 0x7f752c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.806+0000 7f754b7fe640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f752c06ae40 0x7f752c06d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f753c005c00 tx=0x7f753c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.809+0000 7f7543fff640 1 -- 172.21.15.132:0/3609379667 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7534054b60 con 0x7f754c0c0d30 2023-11-18T20:39:41.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.998+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f754c06ede0 con 0x7f754c0c0d30 2023-11-18T20:39:42.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:41.999+0000 7f7543fff640 1 -- 172.21.15.132:0/3609379667 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7534058180 con 0x7f754c0c0d30 2023-11-18T20:39:42.000 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:42.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.001+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f752c06ae40 msgr2=0x7f752c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.001+0000 7f7550f67640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f752c06ae40 0x7f752c06d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f753c005c00 tx=0x7f753c009040 comp rx=0 tx=0).stop 2023-11-18T20:39:42.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c0d30 msgr2=0x7f754c1ee230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c0d30 0x7f754c1ee230 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f753400d5f0 tx=0x7f753400dab0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 shutdown_connections 2023-11-18T20:39:42.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f752c06ae40 0x7f752c06d300 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f754c0c1110 0x7f754c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f754c0c0d30 0x7f754c1ee230 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 --2- 172.21.15.132:0/3609379667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f754c071c90 0x7f754c1eae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 >> 172.21.15.132:0/3609379667 conn(0x7f754c0c6510 msgr2=0x7f754c0c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:42.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 shutdown_connections 2023-11-18T20:39:42.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.002+0000 7f7550f67640 1 -- 172.21.15.132:0/3609379667 wait complete. 2023-11-18T20:39:42.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:39:42.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.230+0000 7fb8d3f47640 1 Processor -- start 2023-11-18T20:39:42.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.230+0000 7fb8d3f47640 1 -- start start 2023-11-18T20:39:42.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.232+0000 7fb8d3f47640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc155490 0x7fb8cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.232+0000 7fb8d3f47640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8cc0c1500 0x7fb8cc0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.232+0000 7fb8d3f47640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc0c06c0 con 0x7fb8cc0c4080 2023-11-18T20:39:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.232+0000 7fb8d3f47640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0a5820 con 0x7fb8cc0c1500 2023-11-18T20:39:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.232+0000 7fb8d3f47640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c1020 con 0x7fb8cc155490 2023-11-18T20:39:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.232+0000 7fb8d14e2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8cc0c1500 0x7fb8cc0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.232+0000 7fb8d14e2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8cc0c1500 0x7fb8cc0a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41926/0 (socket says 172.21.15.132:41926) 2023-11-18T20:39:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.232+0000 7fb8d14e2640 1 -- 172.21.15.132:0/1382318465 learned_addr learned my addr 172.21.15.132:0/1382318465 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.233+0000 7fb8d1ce3640 1 --2- 172.21.15.132:0/1382318465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc155490 0x7fb8cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.233+0000 7fb8d14e2640 1 -- 172.21.15.132:0/1382318465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc155490 msgr2=0x7fb8cc0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:42.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.233+0000 7fb8d14e2640 1 --2- 172.21.15.132:0/1382318465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc155490 0x7fb8cc0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.233+0000 7fb8d14e2640 1 -- 172.21.15.132:0/1382318465 >> v1:172.21.15.161:6789/0 conn(0x7fb8cc0c4080 legacy=0x7fb8cc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.233+0000 7fb8d14e2640 1 -- 172.21.15.132:0/1382318465 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0c0910 con 0x7fb8cc0c1500 2023-11-18T20:39:42.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.234+0000 7fb8d14e2640 1 --2- 172.21.15.132:0/1382318465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc0c1500 0x7fb8cc0a9430 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46d0db7558e5857 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.234+0000 7fb8d0ce1640 1 -- 172.21.15.132:0/1382318465 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8031640 con 0x7fb8cc0c1500 2023-11-18T20:39:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.234+0000 7fb8d0ce1640 1 -- 172.21.15.132:0/1382318465 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b80317a0 con 0x7fb8cc0c1500 2023-11-18T20:39:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.234+0000 7fb8d0ce1640 1 -- 172.21.15.132:0/1382318465 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8031b30 con 0x7fb8cc0c1500 2023-11-18T20:39:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.235+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1382318465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc0c1500 msgr2=0x7fb8cc0a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.235+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1382318465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc0c1500 0x7fb8cc0a9430 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b802b8f0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.235+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1382318465 shutdown_connections 2023-11-18T20:39:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.235+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1382318465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc0c1500 0x7fb8cc0a9430 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.235+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1382318465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc155490 0x7fb8cc0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.235+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1382318465 >> 172.21.15.132:0/1382318465 conn(0x7fb8cc06a500 msgr2=0x7fb8cc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.235+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1382318465 shutdown_connections 2023-11-18T20:39:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.235+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1382318465 wait complete. 2023-11-18T20:39:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.237+0000 7fb8d3f47640 1 Processor -- start 2023-11-18T20:39:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.237+0000 7fb8d3f47640 1 -- start start 2023-11-18T20:39:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d3f47640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc0c1500 0x7fb8cc0a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d3f47640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8cc0c4080 0x7fb8cc070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d3f47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc155490 0x7fb8cc14ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d3f47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc09bc60 con 0x7fb8cc155490 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d3f47640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc071230 con 0x7fb8cc0c4080 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d3f47640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0716c0 con 0x7fb8cc0c1500 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d24e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc155490 0x7fb8cc14ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d24e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc155490 0x7fb8cc14ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41934/0 (socket says 172.21.15.132:41934) 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d24e4640 1 -- 172.21.15.132:0/1264517465 learned_addr learned my addr 172.21.15.132:0/1264517465 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d1ce3640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc0c1500 0x7fb8cc0a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.238+0000 7fb8d14e2640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8cc0c4080 0x7fb8cc070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8d24e4640 1 -- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc0c1500 msgr2=0x7fb8cc0a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8d24e4640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc0c1500 0x7fb8cc0a6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8d24e4640 1 -- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8cc0c4080 msgr2=0x7fb8cc070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8d24e4640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8cc0c4080 0x7fb8cc070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8d24e4640 1 -- 172.21.15.132:0/1264517465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b80094d0 con 0x7fb8cc155490 2023-11-18T20:39:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8d24e4640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc155490 0x7fb8cc14ef00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4001eb0 tx=0x7fb8c400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8ca7fc640 1 -- 172.21.15.132:0/1264517465 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40052d0 con 0x7fb8cc155490 2023-11-18T20:39:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8ca7fc640 1 -- 172.21.15.132:0/1264517465 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4005430 con 0x7fb8cc155490 2023-11-18T20:39:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc1ed9b0 con 0x7fb8cc155490 2023-11-18T20:39:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8ca7fc640 1 -- 172.21.15.132:0/1264517465 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4003810 con 0x7fb8cc155490 2023-11-18T20:39:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.239+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc1edc70 con 0x7fb8cc155490 2023-11-18T20:39:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.241+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc0713a0 con 0x7fb8cc155490 2023-11-18T20:39:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.241+0000 7fb8ca7fc640 1 -- 172.21.15.132:0/1264517465 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8c4003970 con 0x7fb8cc155490 2023-11-18T20:39:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.242+0000 7fb8ca7fc640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b006ae70 0x7fb8b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.242+0000 7fb8ca7fc640 1 -- 172.21.15.132:0/1264517465 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb8c4088ef0 con 0x7fb8cc155490 2023-11-18T20:39:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.243+0000 7fb8d1ce3640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b006ae70 0x7fb8b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.244+0000 7fb8d1ce3640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b006ae70 0x7fb8b006d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00099c0 tx=0x7fb8c0003990 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:42.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.247+0000 7fb8ca7fc640 1 -- 172.21.15.132:0/1264517465 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8c4053c40 con 0x7fb8cc155490 2023-11-18T20:39:42.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.441+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb8cc071020 con 0x7fb8cc155490 2023-11-18T20:39:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.442+0000 7fb8ca7fc640 1 -- 172.21.15.132:0/1264517465 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb8c40170a0 con 0x7fb8cc155490 2023-11-18T20:39:42.443 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:42.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.444+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b006ae70 msgr2=0x7fb8b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.444+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b006ae70 0x7fb8b006d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00099c0 tx=0x7fb8c0003990 comp rx=0 tx=0).stop 2023-11-18T20:39:42.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.444+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc155490 msgr2=0x7fb8cc14ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.444+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc155490 0x7fb8cc14ef00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4001eb0 tx=0x7fb8c400c890 comp rx=0 tx=0).stop 2023-11-18T20:39:42.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.444+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 shutdown_connections 2023-11-18T20:39:42.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.444+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8b006ae70 0x7fb8b006d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.444+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8cc155490 0x7fb8cc14ef00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.444+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8cc0c4080 0x7fb8cc070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.445+0000 7fb8d3f47640 1 --2- 172.21.15.132:0/1264517465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8cc0c1500 0x7fb8cc0a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.445+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 >> 172.21.15.132:0/1264517465 conn(0x7fb8cc06a500 msgr2=0x7fb8cc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:42.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.445+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 shutdown_connections 2023-11-18T20:39:42.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.445+0000 7fb8d3f47640 1 -- 172.21.15.132:0/1264517465 wait complete. 2023-11-18T20:39:42.464 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:39:42.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.667+0000 7f6e6e3b0640 1 Processor -- start 2023-11-18T20:39:42.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.667+0000 7f6e6e3b0640 1 -- start start 2023-11-18T20:39:42.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.668+0000 7f6e6e3b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6e6806d0a0 0x7f6e68152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.668+0000 7f6e6e3b0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e680c3ea0 0x7f6e680c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.668+0000 7f6e6e3b0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e680c64a0 con 0x7f6e6814fd30 2023-11-18T20:39:42.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.669+0000 7f6e6e3b0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680c5c00 con 0x7f6e680c3ea0 2023-11-18T20:39:42.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.669+0000 7f6e6e3b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680c5ee0 con 0x7f6e6806d0a0 2023-11-18T20:39:42.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.669+0000 7f6e6c94d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e680c3ea0 0x7f6e680c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.669+0000 7f6e6c94d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e680c3ea0 0x7f6e680c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41944/0 (socket says 172.21.15.132:41944) 2023-11-18T20:39:42.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.669+0000 7f6e6c94d640 1 -- 172.21.15.132:0/1029545171 learned_addr learned my addr 172.21.15.132:0/1029545171 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:42.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.669+0000 7f6e5ffff640 1 --2- 172.21.15.132:0/1029545171 >> v2:172.21.15.161:3300/0 conn(0x7f6e6806d0a0 0x7f6e68152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.670+0000 7f6e6c94d640 1 -- 172.21.15.132:0/1029545171 >> v2:172.21.15.161:3300/0 conn(0x7f6e6806d0a0 msgr2=0x7f6e68152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:42.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.670+0000 7f6e6c94d640 1 --2- 172.21.15.132:0/1029545171 >> v2:172.21.15.161:3300/0 conn(0x7f6e6806d0a0 0x7f6e68152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.670+0000 7f6e6c94d640 1 -- 172.21.15.132:0/1029545171 >> v1:172.21.15.161:6789/0 conn(0x7f6e6814fd30 legacy=0x7f6e680a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.670+0000 7f6e6c94d640 1 -- 172.21.15.132:0/1029545171 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680c61c0 con 0x7f6e680c3ea0 2023-11-18T20:39:42.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.671+0000 7f6e6c94d640 1 --2- 172.21.15.132:0/1029545171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e680c3ea0 0x7f6e680c4330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6e6806b460 tx=0x7f6e6002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e81c71e5a7eeb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:42.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.671+0000 7f6e677fe640 1 -- 172.21.15.132:0/1029545171 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6002cb20 con 0x7f6e680c3ea0 2023-11-18T20:39:42.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.671+0000 7f6e677fe640 1 -- 172.21.15.132:0/1029545171 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6002cc80 con 0x7f6e680c3ea0 2023-11-18T20:39:42.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.671+0000 7f6e677fe640 1 -- 172.21.15.132:0/1029545171 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600343f0 con 0x7f6e680c3ea0 2023-11-18T20:39:42.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.672+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/1029545171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e680c3ea0 msgr2=0x7f6e680c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.672+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/1029545171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e680c3ea0 0x7f6e680c4330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6e6806b460 tx=0x7f6e6002bf80 comp rx=0 tx=0).stop 2023-11-18T20:39:42.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.672+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/1029545171 shutdown_connections 2023-11-18T20:39:42.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.672+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/1029545171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e680c3ea0 0x7f6e680c4330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.672+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/1029545171 >> v2:172.21.15.161:3300/0 conn(0x7f6e6806d0a0 0x7f6e68152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.672+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/1029545171 >> 172.21.15.132:0/1029545171 conn(0x7f6e6806a500 msgr2=0x7f6e6806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:42.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.672+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/1029545171 shutdown_connections 2023-11-18T20:39:42.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.672+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/1029545171 wait complete. 2023-11-18T20:39:42.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.674+0000 7f6e6e3b0640 1 Processor -- start 2023-11-18T20:39:42.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.674+0000 7f6e6e3b0640 1 -- start start 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.674+0000 7f6e6e3b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6806d0a0 0x7f6e681ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.674+0000 7f6e6e3b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e680c3ea0 0x7f6e681e0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e6e3b0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e6814fd30 0x7f6e68071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e6e3b0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681dbe60 con 0x7f6e6806d0a0 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e6e3b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681e1320 con 0x7f6e680c3ea0 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e6e3b0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681e15c0 con 0x7f6e6814fd30 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6806d0a0 0x7f6e681ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e67fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6806d0a0 0x7f6e681ee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41958/0 (socket says 172.21.15.132:41958) 2023-11-18T20:39:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e67fff640 1 -- 172.21.15.132:0/2392648221 learned_addr learned my addr 172.21.15.132:0/2392648221 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:42.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e67fff640 1 -- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e6814fd30 msgr2=0x7f6e68071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e6c94d640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e6814fd30 0x7f6e68071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e67fff640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e6814fd30 0x7f6e68071730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e67fff640 1 -- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e680c3ea0 msgr2=0x7f6e681e0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e67fff640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e680c3ea0 0x7f6e681e0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.675+0000 7f6e67fff640 1 -- 172.21.15.132:0/2392648221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60009b30 con 0x7f6e6806d0a0 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.676+0000 7f6e67fff640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6806d0a0 0x7f6e681ee0c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800c450 tx=0x7f6e5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.676+0000 7f6e657fa640 1 -- 172.21.15.132:0/2392648221 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e580052d0 con 0x7f6e6806d0a0 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.676+0000 7f6e657fa640 1 -- 172.21.15.132:0/2392648221 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e58005430 con 0x7f6e6806d0a0 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.676+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e681ed5e0 con 0x7f6e6806d0a0 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.676+0000 7f6e657fa640 1 -- 172.21.15.132:0/2392648221 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58012870 con 0x7f6e6806d0a0 2023-11-18T20:39:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.676+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e681edba0 con 0x7f6e6806d0a0 2023-11-18T20:39:42.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.677+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e68068350 con 0x7f6e6806d0a0 2023-11-18T20:39:42.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.678+0000 7f6e657fa640 1 -- 172.21.15.132:0/2392648221 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e580129d0 con 0x7f6e6806d0a0 2023-11-18T20:39:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.679+0000 7f6e657fa640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6e4806ae40 0x7f6e4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.680+0000 7f6e657fa640 1 -- 172.21.15.132:0/2392648221 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6e580894c0 con 0x7f6e6806d0a0 2023-11-18T20:39:42.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.680+0000 7f6e5ffff640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6e4806ae40 0x7f6e4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:42.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.681+0000 7f6e5ffff640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6e4806ae40 0x7f6e4806d300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e50006fd0 tx=0x7f6e50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:42.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.684+0000 7f6e657fa640 1 -- 172.21.15.132:0/2392648221 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e58054200 con 0x7f6e6806d0a0 2023-11-18T20:39:42.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.894+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6e680c66d0 con 0x7f6e6806d0a0 2023-11-18T20:39:42.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.895+0000 7f6e657fa640 1 -- 172.21.15.132:0/2392648221 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6e58057820 con 0x7f6e6806d0a0 2023-11-18T20:39:42.896 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.897+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6e4806ae40 msgr2=0x7f6e4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.897+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6e4806ae40 0x7f6e4806d300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e50006fd0 tx=0x7f6e50008040 comp rx=0 tx=0).stop 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.897+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6806d0a0 msgr2=0x7f6e681ee0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.897+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6806d0a0 0x7f6e681ee0c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800c450 tx=0x7f6e5800c910 comp rx=0 tx=0).stop 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.898+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 shutdown_connections 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.898+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6e4806ae40 0x7f6e4806d300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.898+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e6814fd30 0x7f6e68071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.898+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e680c3ea0 0x7f6e681e0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.898+0000 7f6e6e3b0640 1 --2- 172.21.15.132:0/2392648221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6806d0a0 0x7f6e681ee0c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:42.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.898+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 >> 172.21.15.132:0/2392648221 conn(0x7f6e6806a500 msgr2=0x7f6e6806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:42.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.898+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 shutdown_connections 2023-11-18T20:39:42.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:42.898+0000 7f6e6e3b0640 1 -- 172.21.15.132:0/2392648221 wait complete. 2023-11-18T20:39:42.916 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-18T20:39:42.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:42.916 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-18T20:39:43.011 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:39:43.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:43.012 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-18T20:39:43.062 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:39:43.062 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:43.112 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:39:43.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:39:43.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.369+0000 7fada17bf640 1 Processor -- start 2023-11-18T20:39:43.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.369+0000 7fada17bf640 1 -- start start 2023-11-18T20:39:43.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.370+0000 7fada17bf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 0x7fad9c154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:43.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.370+0000 7fada17bf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c0c1d30 con 0x7fad9c14e170 2023-11-18T20:39:43.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.370+0000 7fada17bf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c06c350 con 0x7fad9c06bec0 2023-11-18T20:39:43.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.370+0000 7fada17bf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1519e0 con 0x7fad9c0a4eb0 2023-11-18T20:39:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.371+0000 7fad9bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fad9c14e170 0x7fad9c1512d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47252/0 (socket says 172.21.15.132:47252) 2023-11-18T20:39:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.371+0000 7fad9bfff640 1 -- 172.21.15.132:0/2693279852 learned_addr learned my addr 172.21.15.132:0/2693279852 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.371+0000 7fad93fff640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 0x7fad9c154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.371+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242857826 0 0) 0x7fad9c0c1d30 con 0x7fad9c14e170 2023-11-18T20:39:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.371+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad88003520 con 0x7fad9c14e170 2023-11-18T20:39:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127098905 0 0) 0x7fad88003520 con 0x7fad9c14e170 2023-11-18T20:39:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 msgr2=0x7fad9c154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 0x7fad9c154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 >> v1:172.21.15.161:6789/0 conn(0x7fad9c06bec0 legacy=0x7fad9c0c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0c51f0 con 0x7fad9c14e170 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fad8c001670 con 0x7fad9c14e170 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 >> v1:172.21.15.132:6789/0 conn(0x7fad9c14e170 legacy=0x7fad9c1512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880039a0 0x7fad88003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad880047c0 0x7fad88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 0x7fad8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1519e0 con 0x7fad880047c0 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad880054e0 con 0x7fad880039a0 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad88005620 con 0x7fad9c0a4eb0 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad93fff640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad880047c0 0x7fad88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad9bfff640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880039a0 0x7fad88003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fada0fbe640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 0x7fad8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad93fff640 1 -- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 msgr2=0x7fad8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad93fff640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 0x7fad8800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad93fff640 1 -- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880039a0 msgr2=0x7fad88003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad93fff640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880039a0 0x7fad88003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.372+0000 7fad93fff640 1 -- 172.21.15.132:0/2693279852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88003520 con 0x7fad880047c0 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.373+0000 7fada0fbe640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c0a4eb0 0x7fad8800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.374+0000 7fad93fff640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad880047c0 0x7fad88004c40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fad8400ba30 tx=0x7fad880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1495e58927c9cb5e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.374+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84032630 con 0x7fad880047c0 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.374+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad84032790 con 0x7fad880047c0 2023-11-18T20:39:43.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.374+0000 7fad9b7fe640 1 -- 172.21.15.132:0/2693279852 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84032b20 con 0x7fad880047c0 2023-11-18T20:39:43.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.374+0000 7fada17bf640 1 -- 172.21.15.132:0/2693279852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad880047c0 msgr2=0x7fad88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:43.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.375+0000 7fada17bf640 1 --2- 172.21.15.132:0/2693279852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad880047c0 0x7fad88004c40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fad8400ba30 tx=0x7fad880057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.375+0000 7fada0fbe640 1 -- 172.21.15.132:0/2693279852 reap_dead start 2023-11-18T20:39:43.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.375+0000 7fada17bf640 1 -- 172.21.15.132:0/2693279852 shutdown_connections 2023-11-18T20:39:43.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.375+0000 7fada17bf640 1 -- 172.21.15.132:0/2693279852 >> 172.21.15.132:0/2693279852 conn(0x7fad9c0a77f0 msgr2=0x7fad9c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:43.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.375+0000 7fada17bf640 1 -- 172.21.15.132:0/2693279852 shutdown_connections 2023-11-18T20:39:43.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.375+0000 7fada17bf640 1 -- 172.21.15.132:0/2693279852 wait complete. 2023-11-18T20:39:43.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.376+0000 7fada17bf640 1 Processor -- start 2023-11-18T20:39:43.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.377+0000 7fada17bf640 1 -- start start 2023-11-18T20:39:43.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.377+0000 7fada17bf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880047c0 0x7fad9c0c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:43.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.377+0000 7fada17bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9c14b3b0 0x7fad9c147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.377+0000 7fada17bf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c14ae60 0x7fad9c1480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.377+0000 7fada17bf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1e8d70 con 0x7fad9c14b3b0 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.377+0000 7fada17bf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1e9050 con 0x7fad880047c0 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.377+0000 7fada17bf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1e9330 con 0x7fad9c14ae60 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9c14b3b0 0x7fad9c147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9c14b3b0 0x7fad9c147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41976/0 (socket says 172.21.15.132:41976) 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 -- 172.21.15.132:0/43363841 learned_addr learned my addr 172.21.15.132:0/43363841 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fada0fbe640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c14ae60 0x7fad9c1480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 -- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c14ae60 msgr2=0x7fad9c1480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c14ae60 0x7fad9c1480e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad9bfff640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880047c0 0x7fad9c0c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:43.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 -- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880047c0 msgr2=0x7fad9c0c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:43.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880047c0 0x7fad9c0c3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 -- 172.21.15.132:0/43363841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c1e9610 con 0x7fad9c14b3b0 2023-11-18T20:39:43.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.378+0000 7fad93fff640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9c14b3b0 0x7fad9c147ba0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fad8400bb50 tx=0x7fad84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:43.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.379+0000 7fad997fa640 1 -- 172.21.15.132:0/43363841 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8403ca80 con 0x7fad9c14b3b0 2023-11-18T20:39:43.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.379+0000 7fad997fa640 1 -- 172.21.15.132:0/43363841 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8403cbe0 con 0x7fad9c14b3b0 2023-11-18T20:39:43.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.379+0000 7fad997fa640 1 -- 172.21.15.132:0/43363841 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84030400 con 0x7fad9c14b3b0 2023-11-18T20:39:43.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.379+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c1e98f0 con 0x7fad9c14b3b0 2023-11-18T20:39:43.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.379+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c0c4580 con 0x7fad9c14b3b0 2023-11-18T20:39:43.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.380+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c1e9a80 con 0x7fad9c14b3b0 2023-11-18T20:39:43.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.381+0000 7fad997fa640 1 -- 172.21.15.132:0/43363841 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad84030560 con 0x7fad9c14b3b0 2023-11-18T20:39:43.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.382+0000 7fad997fa640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad7c06ae40 0x7fad7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:43.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.382+0000 7fad997fa640 1 -- 172.21.15.132:0/43363841 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fad840ac270 con 0x7fad9c14b3b0 2023-11-18T20:39:43.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.382+0000 7fad9bfff640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad7c06ae40 0x7fad7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:43.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.383+0000 7fad9bfff640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad7c06ae40 0x7fad7c06d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad8c001050 tx=0x7fad8c001d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:43.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.386+0000 7fad997fa640 1 -- 172.21.15.132:0/43363841 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad84076f20 con 0x7fad9c14b3b0 2023-11-18T20:39:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.616+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fad9c04e840 con 0x7fad9c14b3b0 2023-11-18T20:39:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.617+0000 7fad997fa640 1 -- 172.21.15.132:0/43363841 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+149 (secure 0 0 0) 0x7fad8407a540 con 0x7fad9c14b3b0 2023-11-18T20:39:43.618 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:39:43.619 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-18T20:39:43.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad7c06ae40 msgr2=0x7fad7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:43.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad7c06ae40 0x7fad7c06d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad8c001050 tx=0x7fad8c001d30 comp rx=0 tx=0).stop 2023-11-18T20:39:43.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9c14b3b0 msgr2=0x7fad9c147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:43.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9c14b3b0 0x7fad9c147ba0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fad8400bb50 tx=0x7fad84004730 comp rx=0 tx=0).stop 2023-11-18T20:39:43.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 shutdown_connections 2023-11-18T20:39:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fad7c06ae40 0x7fad7c06d300 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad9c14ae60 0x7fad9c1480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9c14b3b0 0x7fad9c147ba0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 --2- 172.21.15.132:0/43363841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad880047c0 0x7fad9c0c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 >> 172.21.15.132:0/43363841 conn(0x7fad9c0a77f0 msgr2=0x7fad9c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 shutdown_connections 2023-11-18T20:39:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:43.620+0000 7fada17bf640 1 -- 172.21.15.132:0/43363841 wait complete. 2023-11-18T20:39:43.640 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-18T20:39:43.640 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:39:43.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-18T20:39:43.640 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-18T20:39:43.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:39:43.641 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-18T20:39:43.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:39:43.641 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.kM9lnalBwu 2023-11-18T20:39:43.641 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-18T20:39:43.691 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.Egpzubz9wg 2023-11-18T20:39:43.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /tmp/tmp.kM9lnalBwu /tmp/tmp.Egpzubz9wg 2023-11-18T20:39:43.785 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.Egpzubz9wg 2023-11-18T20:39:43.939 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.Egpzubz9wg is 185B 2023-11-18T20:39:44.004 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.Egpzubz9wg 2023-11-18T20:39:44.057 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQALIVlloodCHxAAM/G+/vw1/PYk7C2D2ZFYoQ== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-11-18T20:39:44.057 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:39:44.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:44.057 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-18T20:39:44.109 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:39:44.109 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-18T20:39:44.110 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:39:44.111 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:44.112 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::84fc:84ff:fe41:e5e7/64 scope link 2023-11-18T20:39:44.112 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:44.112 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:39:44.112 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T20:39:44.112 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a88f:ebff:fe95:c612/64 scope link 2023-11-18T20:39:44.112 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:39:44.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:44.113 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:39:44.205 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-18T20:39:44.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:44.209 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-18T20:39:44.261 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-18T20:39:44.261 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:39:44.261 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:39:44.262 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:39:44.262 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:39:44.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:44.263 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:39:44.263 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:39:44.263 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:39:44.263 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:39:44.263 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:39:44.263 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:39:44.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:44.450 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:39:44.500 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T20:39:44.501 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:39:44.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:44.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-18T20:39:44.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:39:44.598 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T20:39:44.655 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:39:44.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:39:44.655 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:39:44.710 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:39:44.710 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/tmp/tmp.kM9lnalBwu of=/dev/stdout 2023-11-18T20:39:44.761 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:39:44.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:44.761 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQALIVlloodCHxAAM/G+/vw1/PYk7C2D2ZFYoQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:39:44.900 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQALIVlloodCHxAAM/G+/vw1/PYk7C2D2ZFYoQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:39:44.900 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:39:44.900 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:39:44.900 INFO:teuthology.orchestra.run.smithi132.stdout:keyring.get_secret failed 2023-11-18T20:39:44.921 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQALIVlloodCHxAAM/G+/vw1/PYk7C2D2ZFYoQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:39:44.922 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:39:44.922 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:39:44.922 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:39:44.922 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:39:44.922 INFO:teuthology.orchestra.run.smithi132.stdout:keyring.get_secret failed 2023-11-18T20:39:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:mount error: no mds server is up or the cluster is laggy 2023-11-18T20:39:44.950 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQALIVlloodCHxAAM/G+/vw1/PYk7C2D2ZFYoQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:39:44.950 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:39:44.950 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:39:44.951 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:39:44.951 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:39:44.951 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:39:44.951 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:39:44.951 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:39:44.955 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-18T20:39:44.956 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-11-18T20:39:44.956 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-18T20:39:44.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:39:45.063 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:39:45.188 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-18T20:39:45.188 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:39:45.188 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:45.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:39:45.248 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:39:45.248 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:45.308 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:39:45.308 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:39:45.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:45.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.595+0000 7fa79fdce640 1 Processor -- start 2023-11-18T20:39:45.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.595+0000 7fa79fdce640 1 -- start start 2023-11-18T20:39:45.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79fdce640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa79813d0d0 0x7fa79806e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79fdce640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa79813d6e0 0x7fa79806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79fdce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa798157cb0 con 0x7fa79813dc30 2023-11-18T20:39:45.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79fdce640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79806b350 con 0x7fa79813d0d0 2023-11-18T20:39:45.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79fdce640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79806ef10 con 0x7fa79813d6e0 2023-11-18T20:39:45.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79e36b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa79813dc30 0x7fa798158140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47266/0 (socket says 172.21.15.132:47266) 2023-11-18T20:39:45.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79e36b640 1 -- 172.21.15.132:0/3743776338 learned_addr learned my addr 172.21.15.132:0/3743776338 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:45.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79db6a640 1 --2- 172.21.15.132:0/3743776338 >> v2:172.21.15.161:3300/0 conn(0x7fa79813d0d0 0x7fa79806e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:45.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79d369640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa79813d6e0 0x7fa79806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:45.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.597+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808122413 0 0) 0x7fa798157cb0 con 0x7fa79813dc30 2023-11-18T20:39:45.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa784003520 con 0x7fa79813dc30 2023-11-18T20:39:45.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255778025 0 0) 0x7fa784003520 con 0x7fa79813dc30 2023-11-18T20:39:45.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa79813d6e0 msgr2=0x7fa79806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:45.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa79813d6e0 0x7fa79806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 >> v2:172.21.15.161:3300/0 conn(0x7fa79813d0d0 msgr2=0x7fa79806e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:45.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 --2- 172.21.15.132:0/3743776338 >> v2:172.21.15.161:3300/0 conn(0x7fa79813d0d0 0x7fa79806e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79806b0b0 con 0x7fa79813dc30 2023-11-18T20:39:45.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fa7900019f0 con 0x7fa79813dc30 2023-11-18T20:39:45.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 >> v1:172.21.15.132:6789/0 conn(0x7fa79813dc30 legacy=0x7fa798158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa784003970 0x7fa784003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840047c0 0x7fa784004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa79813d6e0 0x7fa784005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79806b350 con 0x7fa7840047c0 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79806ef10 con 0x7fa784003970 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78400ba30 con 0x7fa79813d6e0 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79db6a640 1 --2- 172.21.15.132:0/3743776338 >> v2:172.21.15.161:3300/0 conn(0x7fa79813d0d0 0x7fa79806e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.598+0000 7fa79d369640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840047c0 0x7fa784004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.599+0000 7fa79e36b640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa79813d6e0 0x7fa784005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.599+0000 7fa79d369640 1 -- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa79813d6e0 msgr2=0x7fa784005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.599+0000 7fa79d369640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa79813d6e0 0x7fa784005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.599+0000 7fa79d369640 1 -- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa784003970 msgr2=0x7fa784003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.599+0000 7fa79d369640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa784003970 0x7fa784003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.599+0000 7fa79d369640 1 -- 172.21.15.132:0/3743776338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784003520 con 0x7fa7840047c0 2023-11-18T20:39:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.600+0000 7fa79d369640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840047c0 0x7fa784004c40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa78800ba00 tx=0x7fa7840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5a657e281289dc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.600+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7880325f0 con 0x7fa7840047c0 2023-11-18T20:39:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.600+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788032750 con 0x7fa7840047c0 2023-11-18T20:39:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.600+0000 7fa79cb68640 1 -- 172.21.15.132:0/3743776338 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788032ae0 con 0x7fa7840047c0 2023-11-18T20:39:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.601+0000 7fa79fdce640 1 -- 172.21.15.132:0/3743776338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840047c0 msgr2=0x7fa784004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.601+0000 7fa79fdce640 1 --2- 172.21.15.132:0/3743776338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840047c0 0x7fa784004c40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa78800ba00 tx=0x7fa7840057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.601+0000 7fa79e36b640 1 -- 172.21.15.132:0/3743776338 reap_dead start 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.601+0000 7fa79fdce640 1 -- 172.21.15.132:0/3743776338 shutdown_connections 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.601+0000 7fa79fdce640 1 -- 172.21.15.132:0/3743776338 >> 172.21.15.132:0/3743776338 conn(0x7fa7980c39e0 msgr2=0x7fa7980c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.601+0000 7fa79fdce640 1 -- 172.21.15.132:0/3743776338 shutdown_connections 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.601+0000 7fa79fdce640 1 -- 172.21.15.132:0/3743776338 wait complete. 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.603+0000 7fa79fdce640 1 Processor -- start 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.603+0000 7fa79fdce640 1 -- start start 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79fdce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7840047c0 0x7fa7981edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79fdce640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7980c6a20 0x7fa7981ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79fdce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7981564b0 0x7fa798156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79fdce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa798157750 con 0x7fa7981564b0 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79fdce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa798139520 con 0x7fa7840047c0 2023-11-18T20:39:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79fdce640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7981ee790 con 0x7fa7980c6a20 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79e36b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7981564b0 0x7fa798156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79e36b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7981564b0 0x7fa798156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42004/0 (socket says 172.21.15.132:42004) 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79e36b640 1 -- 172.21.15.132:0/1942353692 learned_addr learned my addr 172.21.15.132:0/1942353692 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79db6a640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7840047c0 0x7fa7981edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79d369640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7980c6a20 0x7fa7981ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79e36b640 1 -- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7980c6a20 msgr2=0x7fa7981ee250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79e36b640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7980c6a20 0x7fa7981ee250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79e36b640 1 -- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7840047c0 msgr2=0x7fa7981edd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79e36b640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7840047c0 0x7fa7981edd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.604+0000 7fa79e36b640 1 -- 172.21.15.132:0/1942353692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7980c5ab0 con 0x7fa7981564b0 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.605+0000 7fa79e36b640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7981564b0 0x7fa798156940 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa790007c40 tx=0x7fa79000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.605+0000 7fa78e7fc640 1 -- 172.21.15.132:0/1942353692 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790004d60 con 0x7fa7981564b0 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.605+0000 7fa78e7fc640 1 -- 172.21.15.132:0/1942353692 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79000bb80 con 0x7fa7981564b0 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.605+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7980c5d90 con 0x7fa7981564b0 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.605+0000 7fa78e7fc640 1 -- 172.21.15.132:0/1942353692 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790007110 con 0x7fa7981564b0 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.605+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa798137500 con 0x7fa7981564b0 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.606+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79804e840 con 0x7fa7981564b0 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.607+0000 7fa78e7fc640 1 -- 172.21.15.132:0/1942353692 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa790007270 con 0x7fa7981564b0 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.608+0000 7fa78e7fc640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa77c06ae40 0x7fa77c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.608+0000 7fa78e7fc640 1 -- 172.21.15.132:0/1942353692 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fa790089d10 con 0x7fa7981564b0 2023-11-18T20:39:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.609+0000 7fa79db6a640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa77c06ae40 0x7fa77c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:45.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.610+0000 7fa79db6a640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa77c06ae40 0x7fa77c06d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa794006a90 tx=0x7fa794008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:45.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.613+0000 7fa78e7fc640 1 -- 172.21.15.132:0/1942353692 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa7900549f0 con 0x7fa7981564b0 2023-11-18T20:39:45.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.804+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa798139690 con 0x7fa7981564b0 2023-11-18T20:39:45.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.809+0000 7fa78e7fc640 1 -- 172.21.15.132:0/1942353692 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+20678 (secure 0 0 0) 0x7fa790058010 con 0x7fa7981564b0 2023-11-18T20:39:45.810 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:45.810 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":40,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:45.548581+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.811+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa77c06ae40 msgr2=0x7fa77c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.811+0000 7fa79fdce640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa77c06ae40 0x7fa77c06d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa794006a90 tx=0x7fa794008040 comp rx=0 tx=0).stop 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.811+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7981564b0 msgr2=0x7fa798156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.811+0000 7fa79fdce640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7981564b0 0x7fa798156940 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa790007c40 tx=0x7fa79000b4a0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.812+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 shutdown_connections 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.812+0000 7fa79fdce640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa77c06ae40 0x7fa77c06d300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.812+0000 7fa79fdce640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7981564b0 0x7fa798156940 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.812+0000 7fa79fdce640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7980c6a20 0x7fa7981ee250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.812+0000 7fa79fdce640 1 --2- 172.21.15.132:0/1942353692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7840047c0 0x7fa7981edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.812+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 >> 172.21.15.132:0/1942353692 conn(0x7fa7980c39e0 msgr2=0x7fa798135700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.812+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 shutdown_connections 2023-11-18T20:39:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:45.812+0000 7fa79fdce640 1 -- 172.21.15.132:0/1942353692 wait complete. 2023-11-18T20:39:45.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:39:00.655880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:39:01.207461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:39:20.671493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:39:21.849411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:39:45.833 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:39:46.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.051+0000 7f3b02d73640 1 Processor -- start 2023-11-18T20:39:46.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.051+0000 7f3b02d73640 1 -- start start 2023-11-18T20:39:46.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.053+0000 7f3b02d73640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3afc06b7d0 0x7f3afc06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.053+0000 7f3b02d73640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc0bd8d0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.053+0000 7f3b02d73640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc0c6e60 con 0x7f3afc14e810 2023-11-18T20:39:46.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.053+0000 7f3b02d73640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0c70d0 con 0x7f3afc06b7d0 2023-11-18T20:39:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.053+0000 7f3afbfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3afc0c7e90 0x7f3afc0c4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47280/0 (socket says 172.21.15.132:47280) 2023-11-18T20:39:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.053+0000 7f3afbfff640 1 -- 172.21.15.132:0/3302960970 learned_addr learned my addr 172.21.15.132:0/3302960970 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.053+0000 7f3b01310640 1 --2- 172.21.15.132:0/3302960970 >> v2:172.21.15.132:3300/0 conn(0x7f3afc06b7d0 0x7f3afc06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.054+0000 7f3afb7fe640 1 -- 172.21.15.132:0/3302960970 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558569914 0 0) 0x7f3afc0bd8d0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.054+0000 7f3afb7fe640 1 -- 172.21.15.132:0/3302960970 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec003520 con 0x7f3afc0c7e90 2023-11-18T20:39:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.054+0000 7f3b01310640 1 -- 172.21.15.132:0/3302960970 >> v1:172.21.15.161:6789/0 conn(0x7f3afc14e810 legacy=0x7f3afc1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.054+0000 7f3b01310640 1 -- 172.21.15.132:0/3302960970 >> v1:172.21.15.132:6789/0 conn(0x7f3afc0c7e90 legacy=0x7f3afc0c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.054+0000 7f3b01310640 1 -- 172.21.15.132:0/3302960970 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0c73b0 con 0x7f3afc06b7d0 2023-11-18T20:39:46.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.056+0000 7f3b01310640 1 --2- 172.21.15.132:0/3302960970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc06b7d0 0x7f3afc06bc20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009d90 tx=0x7f3af402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d807bcaa67ec4b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.056+0000 7f3afb7fe640 1 -- 172.21.15.132:0/3302960970 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af402cc60 con 0x7f3afc06b7d0 2023-11-18T20:39:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.056+0000 7f3afb7fe640 1 -- 172.21.15.132:0/3302960970 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af402cdc0 con 0x7f3afc06b7d0 2023-11-18T20:39:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.056+0000 7f3afb7fe640 1 -- 172.21.15.132:0/3302960970 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4034660 con 0x7f3afc06b7d0 2023-11-18T20:39:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.057+0000 7f3b02d73640 1 -- 172.21.15.132:0/3302960970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc06b7d0 msgr2=0x7f3afc06bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.057+0000 7f3b02d73640 1 --2- 172.21.15.132:0/3302960970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc06b7d0 0x7f3afc06bc20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009d90 tx=0x7f3af402beb0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.057+0000 7f3b02d73640 1 -- 172.21.15.132:0/3302960970 shutdown_connections 2023-11-18T20:39:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.057+0000 7f3b02d73640 1 --2- 172.21.15.132:0/3302960970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc06b7d0 0x7f3afc06bc20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.057+0000 7f3b02d73640 1 -- 172.21.15.132:0/3302960970 >> 172.21.15.132:0/3302960970 conn(0x7f3afc0ca170 msgr2=0x7f3afc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.057+0000 7f3b02d73640 1 -- 172.21.15.132:0/3302960970 shutdown_connections 2023-11-18T20:39:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.057+0000 7f3b02d73640 1 -- 172.21.15.132:0/3302960970 wait complete. 2023-11-18T20:39:46.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.059+0000 7f3b02d73640 1 Processor -- start 2023-11-18T20:39:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.059+0000 7f3b02d73640 1 -- start start 2023-11-18T20:39:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3b02d73640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3afc06b7d0 0x7f3afc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3b02d73640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0c7e90 0x7f3afc150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3b02d73640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3afc14e810 0x7f3afc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3b02d73640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1543f0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3b02d73640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1eac70 con 0x7f3afc14e810 2023-11-18T20:39:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3b02d73640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc152ae0 con 0x7f3afc06b7d0 2023-11-18T20:39:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3afbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0c7e90 0x7f3afc150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3afbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0c7e90 0x7f3afc150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42026/0 (socket says 172.21.15.132:42026) 2023-11-18T20:39:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3afbfff640 1 -- 172.21.15.132:0/4024195142 learned_addr learned my addr 172.21.15.132:0/4024195142 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:46.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3b00b0f640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3afc06b7d0 0x7f3afc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.060+0000 7f3b01310640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3afc14e810 0x7f3afc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3afbfff640 1 -- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3afc06b7d0 msgr2=0x7f3afc154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3afbfff640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3afc06b7d0 0x7f3afc154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3afbfff640 1 -- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3afc14e810 msgr2=0x7f3afc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3afbfff640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3afc14e810 0x7f3afc1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3afbfff640 1 -- 172.21.15.132:0/4024195142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4009a70 con 0x7f3afc0c7e90 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3b00b0f640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3afc06b7d0 0x7f3afc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3b01310640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3afc14e810 0x7f3afc1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3afbfff640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0c7e90 0x7f3afc150fa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800c4d0 tx=0x7f3ae800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3af97fa640 1 -- 172.21.15.132:0/4024195142 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8005ce0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3af97fa640 1 -- 172.21.15.132:0/4024195142 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8005e40 con 0x7f3afc0c7e90 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc152dc0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3af97fa640 1 -- 172.21.15.132:0/4024195142 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8007270 con 0x7f3afc0c7e90 2023-11-18T20:39:46.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.061+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc1553e0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.063+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc1545a0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.064+0000 7f3af97fa640 1 -- 172.21.15.132:0/4024195142 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ae8007490 con 0x7f3afc0c7e90 2023-11-18T20:39:46.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.065+0000 7f3af97fa640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ae006ae40 0x7f3ae006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.065+0000 7f3af97fa640 1 -- 172.21.15.132:0/4024195142 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f3ae8088ea0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.066+0000 7f3b00b0f640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ae006ae40 0x7f3ae006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.067+0000 7f3b00b0f640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ae006ae40 0x7f3ae006d300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3af0000f60 tx=0x7f3af0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.069+0000 7f3af97fa640 1 -- 172.21.15.132:0/4024195142 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ae8053ba0 con 0x7f3afc0c7e90 2023-11-18T20:39:46.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.288+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3afc068350 con 0x7f3afc0c7e90 2023-11-18T20:39:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.289+0000 7f3af97fa640 1 -- 172.21.15.132:0/4024195142 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ae8017020 con 0x7f3afc0c7e90 2023-11-18T20:39:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:39:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ae006ae40 msgr2=0x7f3ae006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ae006ae40 0x7f3ae006d300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3af0000f60 tx=0x7f3af0009040 comp rx=0 tx=0).stop 2023-11-18T20:39:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0c7e90 msgr2=0x7f3afc150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0c7e90 0x7f3afc150fa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800c4d0 tx=0x7f3ae800c990 comp rx=0 tx=0).stop 2023-11-18T20:39:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 shutdown_connections 2023-11-18T20:39:46.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ae006ae40 0x7f3ae006d300 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3afc14e810 0x7f3afc1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0c7e90 0x7f3afc150fa0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 --2- 172.21.15.132:0/4024195142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3afc06b7d0 0x7f3afc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 >> 172.21.15.132:0/4024195142 conn(0x7f3afc0ca170 msgr2=0x7f3afc157870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 shutdown_connections 2023-11-18T20:39:46.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.292+0000 7f3b02d73640 1 -- 172.21.15.132:0/4024195142 wait complete. 2023-11-18T20:39:46.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:39:46.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.513+0000 7fda68190640 1 Processor -- start 2023-11-18T20:39:46.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.513+0000 7fda68190640 1 -- start start 2023-11-18T20:39:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.514+0000 7fda68190640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fda6006d0a0 0x7fda60152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda68190640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda600c64a0 con 0x7fda6014fd30 2023-11-18T20:39:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda68190640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda600c5c00 con 0x7fda600c3ea0 2023-11-18T20:39:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda68190640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda600c5ee0 con 0x7fda6006d0a0 2023-11-18T20:39:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda65f2c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fda6014fd30 0x7fda600a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47292/0 (socket says 172.21.15.132:47292) 2023-11-18T20:39:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda65f2c640 1 -- 172.21.15.132:0/2766940718 learned_addr learned my addr 172.21.15.132:0/2766940718 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda6572b640 1 --2- 172.21.15.132:0/2766940718 >> v2:172.21.15.132:3300/0 conn(0x7fda6006d0a0 0x7fda60152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda6572b640 1 -- 172.21.15.132:0/2766940718 >> v1:172.21.15.161:6789/0 conn(0x7fda600c3ea0 legacy=0x7fda600c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:46.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda6572b640 1 -- 172.21.15.132:0/2766940718 >> v1:172.21.15.132:6789/0 conn(0x7fda6014fd30 legacy=0x7fda600a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda6572b640 1 -- 172.21.15.132:0/2766940718 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600c61c0 con 0x7fda6006d0a0 2023-11-18T20:39:46.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.515+0000 7fda64f2a640 1 -- 172.21.15.132:0/2766940718 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381715537 0 0) 0x7fda600c64a0 con 0x7fda6014fd30 2023-11-18T20:39:46.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.516+0000 7fda6572b640 1 --2- 172.21.15.132:0/2766940718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6006d0a0 0x7fda60152f20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fda500097a0 tx=0x7fda5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd60389e7acc48c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.517+0000 7fda64f2a640 1 -- 172.21.15.132:0/2766940718 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50031830 con 0x7fda6006d0a0 2023-11-18T20:39:46.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.517+0000 7fda64f2a640 1 -- 172.21.15.132:0/2766940718 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda50031990 con 0x7fda6006d0a0 2023-11-18T20:39:46.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.517+0000 7fda64f2a640 1 -- 172.21.15.132:0/2766940718 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50031d20 con 0x7fda6006d0a0 2023-11-18T20:39:46.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.517+0000 7fda68190640 1 -- 172.21.15.132:0/2766940718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6006d0a0 msgr2=0x7fda60152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.517+0000 7fda68190640 1 --2- 172.21.15.132:0/2766940718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6006d0a0 0x7fda60152f20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fda500097a0 tx=0x7fda5002b8d0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.517+0000 7fda68190640 1 -- 172.21.15.132:0/2766940718 shutdown_connections 2023-11-18T20:39:46.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.517+0000 7fda68190640 1 --2- 172.21.15.132:0/2766940718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6006d0a0 0x7fda60152f20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.517+0000 7fda68190640 1 -- 172.21.15.132:0/2766940718 >> 172.21.15.132:0/2766940718 conn(0x7fda6006a500 msgr2=0x7fda6006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:46.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.518+0000 7fda68190640 1 -- 172.21.15.132:0/2766940718 shutdown_connections 2023-11-18T20:39:46.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.518+0000 7fda68190640 1 -- 172.21.15.132:0/2766940718 wait complete. 2023-11-18T20:39:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.519+0000 7fda68190640 1 Processor -- start 2023-11-18T20:39:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.519+0000 7fda68190640 1 -- start start 2023-11-18T20:39:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda68190640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda6006d0a0 0x7fda60151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda68190640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda600c3ea0 0x7fda6014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda68190640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda6014fd30 0x7fda6014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda68190640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda601dce10 con 0x7fda600c3ea0 2023-11-18T20:39:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda68190640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda601dc3e0 con 0x7fda6014fd30 2023-11-18T20:39:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda68190640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda601dc680 con 0x7fda6006d0a0 2023-11-18T20:39:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda6572b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda600c3ea0 0x7fda6014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda6572b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda600c3ea0 0x7fda6014c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42034/0 (socket says 172.21.15.132:42034) 2023-11-18T20:39:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.520+0000 7fda6572b640 1 -- 172.21.15.132:0/922793743 learned_addr learned my addr 172.21.15.132:0/922793743 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda65f2c640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda6006d0a0 0x7fda60151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda6672d640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda6014fd30 0x7fda6014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda6572b640 1 -- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda6006d0a0 msgr2=0x7fda60151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda6572b640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda6006d0a0 0x7fda60151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda6572b640 1 -- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda6014fd30 msgr2=0x7fda6014c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda6572b640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda6014fd30 0x7fda6014c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda6572b640 1 -- 172.21.15.132:0/922793743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50009400 con 0x7fda600c3ea0 2023-11-18T20:39:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda6672d640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda6014fd30 0x7fda6014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.521+0000 7fda6572b640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda600c3ea0 0x7fda6014c3b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fda50000c00 tx=0x7fda500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.522+0000 7fda567fc640 1 -- 172.21.15.132:0/922793743 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5003aa60 con 0x7fda600c3ea0 2023-11-18T20:39:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.522+0000 7fda567fc640 1 -- 172.21.15.132:0/922793743 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5003abc0 con 0x7fda600c3ea0 2023-11-18T20:39:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.522+0000 7fda567fc640 1 -- 172.21.15.132:0/922793743 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda500443f0 con 0x7fda600c3ea0 2023-11-18T20:39:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.522+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda601563f0 con 0x7fda600c3ea0 2023-11-18T20:39:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.522+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda601e8930 con 0x7fda600c3ea0 2023-11-18T20:39:46.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.523+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda60068350 con 0x7fda600c3ea0 2023-11-18T20:39:46.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.524+0000 7fda567fc640 1 -- 172.21.15.132:0/922793743 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda5004d450 con 0x7fda600c3ea0 2023-11-18T20:39:46.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.525+0000 7fda567fc640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda4406f250 0x7fda44071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.525+0000 7fda567fc640 1 -- 172.21.15.132:0/922793743 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fda500abcf0 con 0x7fda600c3ea0 2023-11-18T20:39:46.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.526+0000 7fda65f2c640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda4406f250 0x7fda44071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.527+0000 7fda65f2c640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda4406f250 0x7fda44071710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda5c000f60 tx=0x7fda5c007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.530+0000 7fda567fc640 1 -- 172.21.15.132:0/922793743 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda50076930 con 0x7fda600c3ea0 2023-11-18T20:39:46.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.735+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda601dc7c0 con 0x7fda600c3ea0 2023-11-18T20:39:46.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.736+0000 7fda567fc640 1 -- 172.21.15.132:0/922793743 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda50079f50 con 0x7fda600c3ea0 2023-11-18T20:39:46.737 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda4406f250 msgr2=0x7fda44071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda4406f250 0x7fda44071710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda5c000f60 tx=0x7fda5c007b50 comp rx=0 tx=0).stop 2023-11-18T20:39:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda600c3ea0 msgr2=0x7fda6014c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda600c3ea0 0x7fda6014c3b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fda50000c00 tx=0x7fda500046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 shutdown_connections 2023-11-18T20:39:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda4406f250 0x7fda44071710 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda6014fd30 0x7fda6014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda600c3ea0 0x7fda6014c3b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 --2- 172.21.15.132:0/922793743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda6006d0a0 0x7fda60151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.738+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 >> 172.21.15.132:0/922793743 conn(0x7fda6006a500 msgr2=0x7fda600c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.739+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 shutdown_connections 2023-11-18T20:39:46.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.739+0000 7fda68190640 1 -- 172.21.15.132:0/922793743 wait complete. 2023-11-18T20:39:46.757 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:39:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.962+0000 7fc572567640 1 Processor -- start 2023-11-18T20:39:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.963+0000 7fc572567640 1 -- start start 2023-11-18T20:39:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.964+0000 7fc572567640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc56c154b40 0x7fc56c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.964+0000 7fc572567640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c0c1450 0x7fc56c15ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.964+0000 7fc572567640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c157ad0 con 0x7fc56c0a4d20 2023-11-18T20:39:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.964+0000 7fc572567640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c154fd0 con 0x7fc56c154b40 2023-11-18T20:39:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.964+0000 7fc572567640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c158890 con 0x7fc56c0c1450 2023-11-18T20:39:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.965+0000 7fc571d66640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c0c1450 0x7fc56c15ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.965+0000 7fc570d64640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc56c154b40 0x7fc56c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.965+0000 7fc571d66640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c0c1450 0x7fc56c15ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:57546/0 (socket says 172.21.15.132:57546) 2023-11-18T20:39:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.965+0000 7fc571d66640 1 -- 172.21.15.132:0/763032061 learned_addr learned my addr 172.21.15.132:0/763032061 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.966+0000 7fc571d66640 1 -- 172.21.15.132:0/763032061 >> v2:172.21.15.161:3300/0 conn(0x7fc56c154b40 msgr2=0x7fc56c0a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.966+0000 7fc571d66640 1 --2- 172.21.15.132:0/763032061 >> v2:172.21.15.161:3300/0 conn(0x7fc56c154b40 0x7fc56c0a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.966+0000 7fc571d66640 1 -- 172.21.15.132:0/763032061 >> v1:172.21.15.161:6789/0 conn(0x7fc56c0a4d20 legacy=0x7fc56c154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.966+0000 7fc571d66640 1 -- 172.21.15.132:0/763032061 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c157db0 con 0x7fc56c0c1450 2023-11-18T20:39:46.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.967+0000 7fc571d66640 1 --2- 172.21.15.132:0/763032061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c0c1450 0x7fc56c15ecd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc564009e50 tx=0x7fc56402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f103d657a1ce8526 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.968+0000 7fc563fff640 1 -- 172.21.15.132:0/763032061 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56402ca80 con 0x7fc56c0c1450 2023-11-18T20:39:46.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.968+0000 7fc563fff640 1 -- 172.21.15.132:0/763032061 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56402cbe0 con 0x7fc56c0c1450 2023-11-18T20:39:46.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.968+0000 7fc563fff640 1 -- 172.21.15.132:0/763032061 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640343f0 con 0x7fc56c0c1450 2023-11-18T20:39:46.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.968+0000 7fc572567640 1 -- 172.21.15.132:0/763032061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c0c1450 msgr2=0x7fc56c15ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.968+0000 7fc572567640 1 --2- 172.21.15.132:0/763032061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c0c1450 0x7fc56c15ecd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc564009e50 tx=0x7fc56402bee0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.969+0000 7fc572567640 1 -- 172.21.15.132:0/763032061 shutdown_connections 2023-11-18T20:39:46.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.969+0000 7fc572567640 1 --2- 172.21.15.132:0/763032061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c0c1450 0x7fc56c15ecd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.969+0000 7fc572567640 1 --2- 172.21.15.132:0/763032061 >> v2:172.21.15.161:3300/0 conn(0x7fc56c154b40 0x7fc56c0a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.969+0000 7fc572567640 1 -- 172.21.15.132:0/763032061 >> 172.21.15.132:0/763032061 conn(0x7fc56c0a77f0 msgr2=0x7fc56c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:46.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.969+0000 7fc572567640 1 -- 172.21.15.132:0/763032061 shutdown_connections 2023-11-18T20:39:46.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.969+0000 7fc572567640 1 -- 172.21.15.132:0/763032061 wait complete. 2023-11-18T20:39:46.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.971+0000 7fc572567640 1 Processor -- start 2023-11-18T20:39:46.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.971+0000 7fc572567640 1 -- start start 2023-11-18T20:39:46.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc572567640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c0a4d20 0x7fc56c1edff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc572567640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56c0c1450 0x7fc56c14efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc572567640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c154b40 0x7fc56c14ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc572567640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c152e80 con 0x7fc56c0a4d20 2023-11-18T20:39:46.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc572567640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c1ee530 con 0x7fc56c0c1450 2023-11-18T20:39:46.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc572567640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0710b0 con 0x7fc56c154b40 2023-11-18T20:39:46.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc571565640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c0a4d20 0x7fc56c1edff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc571565640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c0a4d20 0x7fc56c1edff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42042/0 (socket says 172.21.15.132:42042) 2023-11-18T20:39:46.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.972+0000 7fc571565640 1 -- 172.21.15.132:0/1639417621 learned_addr learned my addr 172.21.15.132:0/1639417621 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc570d64640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56c0c1450 0x7fc56c14efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc571d66640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c154b40 0x7fc56c14ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc571565640 1 -- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c154b40 msgr2=0x7fc56c14ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc571565640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c154b40 0x7fc56c14ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc571565640 1 -- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56c0c1450 msgr2=0x7fc56c14efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:46.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc571565640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56c0c1450 0x7fc56c14efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc571565640 1 -- 172.21.15.132:0/1639417621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc564009b30 con 0x7fc56c0a4d20 2023-11-18T20:39:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc570d64640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56c0c1450 0x7fc56c14efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc571565640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c0a4d20 0x7fc56c1edff0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c450 tx=0x7fc56800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc561ffb640 1 -- 172.21.15.132:0/1639417621 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5680052d0 con 0x7fc56c0a4d20 2023-11-18T20:39:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.973+0000 7fc561ffb640 1 -- 172.21.15.132:0/1639417621 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568005430 con 0x7fc56c0a4d20 2023-11-18T20:39:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.974+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c0718c0 con 0x7fc56c0a4d20 2023-11-18T20:39:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.974+0000 7fc561ffb640 1 -- 172.21.15.132:0/1639417621 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568012870 con 0x7fc56c0a4d20 2023-11-18T20:39:46.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.974+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c0715e0 con 0x7fc56c0a4d20 2023-11-18T20:39:46.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.975+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c0c4b50 con 0x7fc56c0a4d20 2023-11-18T20:39:46.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.976+0000 7fc561ffb640 1 -- 172.21.15.132:0/1639417621 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5680129d0 con 0x7fc56c0a4d20 2023-11-18T20:39:46.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.977+0000 7fc561ffb640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc55006ae40 0x7fc55006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:46.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.977+0000 7fc561ffb640 1 -- 172.21.15.132:0/1639417621 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fc568089570 con 0x7fc56c0a4d20 2023-11-18T20:39:46.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.977+0000 7fc570d64640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc55006ae40 0x7fc55006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:46.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.978+0000 7fc570d64640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc55006ae40 0x7fc55006d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc56c1eb1a0 tx=0x7fc55c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:46.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:46.981+0000 7fc561ffb640 1 -- 172.21.15.132:0/1639417621 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc568054250 con 0x7fc56c0a4d20 2023-11-18T20:39:47.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.169+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc56c04e840 con 0x7fc56c0a4d20 2023-11-18T20:39:47.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.169+0000 7fc561ffb640 1 -- 172.21.15.132:0/1639417621 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc568057870 con 0x7fc56c0a4d20 2023-11-18T20:39:47.171 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:47.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc55006ae40 msgr2=0x7fc55006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc55006ae40 0x7fc55006d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc56c1eb1a0 tx=0x7fc55c008040 comp rx=0 tx=0).stop 2023-11-18T20:39:47.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c0a4d20 msgr2=0x7fc56c1edff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c0a4d20 0x7fc56c1edff0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c450 tx=0x7fc56800c910 comp rx=0 tx=0).stop 2023-11-18T20:39:47.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 shutdown_connections 2023-11-18T20:39:47.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc55006ae40 0x7fc55006d300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc56c154b40 0x7fc56c14ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56c0c1450 0x7fc56c14efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 --2- 172.21.15.132:0/1639417621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c0a4d20 0x7fc56c1edff0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 >> 172.21.15.132:0/1639417621 conn(0x7fc56c0a77f0 msgr2=0x7fc56c0a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:47.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.172+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 shutdown_connections 2023-11-18T20:39:47.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.173+0000 7fc572567640 1 -- 172.21.15.132:0/1639417621 wait complete. 2023-11-18T20:39:47.193 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:39:47.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.406+0000 7fd5c00a2640 1 Processor -- start 2023-11-18T20:39:47.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.406+0000 7fd5c00a2640 1 -- start start 2023-11-18T20:39:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5c00a2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd5b814e810 0x7fd5b81550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5c00a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd5b80c7e90 0x7fd5b80c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5c00a2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b80bd8d0 con 0x7fd5b80c4e50 2023-11-18T20:39:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5c00a2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b80c6e60 con 0x7fd5b80c7e90 2023-11-18T20:39:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5c00a2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b8155600 con 0x7fd5b814e810 2023-11-18T20:39:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5bd63d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd5b80c7e90 0x7fd5b80c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5be63f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd5b80c4e50 0x7fd5b806b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47294/0 (socket says 172.21.15.132:47294) 2023-11-18T20:39:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5be63f640 1 -- 172.21.15.132:0/2332445070 learned_addr learned my addr 172.21.15.132:0/2332445070 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.408+0000 7fd5bde3e640 1 --2- 172.21.15.132:0/2332445070 >> v2:172.21.15.161:3300/0 conn(0x7fd5b814e810 0x7fd5b81550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.409+0000 7fd5bd63d640 1 -- 172.21.15.132:0/2332445070 >> v2:172.21.15.161:3300/0 conn(0x7fd5b814e810 msgr2=0x7fd5b81550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.409+0000 7fd5bd63d640 1 --2- 172.21.15.132:0/2332445070 >> v2:172.21.15.161:3300/0 conn(0x7fd5b814e810 0x7fd5b81550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.409+0000 7fd5bd63d640 1 -- 172.21.15.132:0/2332445070 >> v1:172.21.15.132:6789/0 conn(0x7fd5b80c4e50 legacy=0x7fd5b806b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.409+0000 7fd5bd63d640 1 -- 172.21.15.132:0/2332445070 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80c70d0 con 0x7fd5b80c7e90 2023-11-18T20:39:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.410+0000 7fd5bd63d640 1 --2- 172.21.15.132:0/2332445070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c7e90 0x7fd5b80c4910 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80a98f0 tx=0x7fd5a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b24449cc7b573c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.410+0000 7fd5bce3c640 1 -- 172.21.15.132:0/2332445070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a802e070 con 0x7fd5b80c7e90 2023-11-18T20:39:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.410+0000 7fd5bce3c640 1 -- 172.21.15.132:0/2332445070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a80315a0 con 0x7fd5b80c7e90 2023-11-18T20:39:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.410+0000 7fd5bce3c640 1 -- 172.21.15.132:0/2332445070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8031930 con 0x7fd5b80c7e90 2023-11-18T20:39:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.411+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2332445070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c7e90 msgr2=0x7fd5b80c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.411+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2332445070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c7e90 0x7fd5b80c4910 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80a98f0 tx=0x7fd5a802b840 comp rx=0 tx=0).stop 2023-11-18T20:39:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.411+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2332445070 shutdown_connections 2023-11-18T20:39:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.411+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2332445070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c7e90 0x7fd5b80c4910 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.411+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2332445070 >> v2:172.21.15.161:3300/0 conn(0x7fd5b814e810 0x7fd5b81550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.411+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2332445070 >> 172.21.15.132:0/2332445070 conn(0x7fd5b80ca170 msgr2=0x7fd5b80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.411+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2332445070 shutdown_connections 2023-11-18T20:39:47.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.411+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2332445070 wait complete. 2023-11-18T20:39:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.413+0000 7fd5c00a2640 1 Processor -- start 2023-11-18T20:39:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.413+0000 7fd5c00a2640 1 -- start start 2023-11-18T20:39:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5c00a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c4e50 0x7fd5b81ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5c00a2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5b80c7e90 0x7fd5b8147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5c00a2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5b814e810 0x7fd5b81483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5c00a2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8148e00 con 0x7fd5b80c4e50 2023-11-18T20:39:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5c00a2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80bda60 con 0x7fd5b814e810 2023-11-18T20:39:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5c00a2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8148b20 con 0x7fd5b80c7e90 2023-11-18T20:39:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5bde3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c4e50 0x7fd5b81ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:47.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5bde3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c4e50 0x7fd5b81ed490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42060/0 (socket says 172.21.15.132:42060) 2023-11-18T20:39:47.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5bde3e640 1 -- 172.21.15.132:0/2380176785 learned_addr learned my addr 172.21.15.132:0/2380176785 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:47.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5bde3e640 1 -- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5b80c7e90 msgr2=0x7fd5b8147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5bde3e640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5b80c7e90 0x7fd5b8147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5bde3e640 1 -- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5b814e810 msgr2=0x7fd5b81483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5bde3e640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5b814e810 0x7fd5b81483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.414+0000 7fd5bde3e640 1 -- 172.21.15.132:0/2380176785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009400 con 0x7fd5b80c4e50 2023-11-18T20:39:47.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.415+0000 7fd5bde3e640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c4e50 0x7fd5b81ed490 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400d5f0 tx=0x7fd5b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:47.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.415+0000 7fd5ae7fc640 1 -- 172.21.15.132:0/2380176785 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40125f0 con 0x7fd5b80c4e50 2023-11-18T20:39:47.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.415+0000 7fd5ae7fc640 1 -- 172.21.15.132:0/2380176785 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b4012750 con 0x7fd5b80c4e50 2023-11-18T20:39:47.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.415+0000 7fd5ae7fc640 1 -- 172.21.15.132:0/2380176785 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4012b00 con 0x7fd5b80c4e50 2023-11-18T20:39:47.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.415+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b81eddd0 con 0x7fd5b80c4e50 2023-11-18T20:39:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.415+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b80bdf90 con 0x7fd5b80c4e50 2023-11-18T20:39:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.416+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b80be300 con 0x7fd5b80c4e50 2023-11-18T20:39:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.417+0000 7fd5ae7fc640 1 -- 172.21.15.132:0/2380176785 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5b4012c60 con 0x7fd5b80c4e50 2023-11-18T20:39:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.419+0000 7fd5ae7fc640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd59c06ae40 0x7fd59c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.419+0000 7fd5ae7fc640 1 -- 172.21.15.132:0/2380176785 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fd5b4089ed0 con 0x7fd5b80c4e50 2023-11-18T20:39:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.419+0000 7fd5bd63d640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd59c06ae40 0x7fd59c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.421+0000 7fd5bd63d640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd59c06ae40 0x7fd59c06d300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8036000 tx=0x7fd5a8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.424+0000 7fd5ae7fc640 1 -- 172.21.15.132:0/2380176785 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5b4054bb0 con 0x7fd5b80c4e50 2023-11-18T20:39:47.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.616+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5b8068350 con 0x7fd5b80c4e50 2023-11-18T20:39:47.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.617+0000 7fd5ae7fc640 1 -- 172.21.15.132:0/2380176785 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v41) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd5b40581d0 con 0x7fd5b80c4e50 2023-11-18T20:39:47.618 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd59c06ae40 msgr2=0x7fd59c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd59c06ae40 0x7fd59c06d300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8036000 tx=0x7fd5a8030000 comp rx=0 tx=0).stop 2023-11-18T20:39:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c4e50 msgr2=0x7fd5b81ed490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c4e50 0x7fd5b81ed490 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400d5f0 tx=0x7fd5b400dab0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 shutdown_connections 2023-11-18T20:39:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd59c06ae40 0x7fd59c06d300 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5b814e810 0x7fd5b81483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5b80c7e90 0x7fd5b8147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 --2- 172.21.15.132:0/2380176785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5b80c4e50 0x7fd5b81ed490 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 >> 172.21.15.132:0/2380176785 conn(0x7fd5b80ca170 msgr2=0x7fd5b80ab230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 shutdown_connections 2023-11-18T20:39:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.620+0000 7fd5c00a2640 1 -- 172.21.15.132:0/2380176785 wait complete. 2023-11-18T20:39:47.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:39:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.842+0000 7f6f80547640 1 Processor -- start 2023-11-18T20:39:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.842+0000 7f6f80547640 1 -- start start 2023-11-18T20:39:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.844+0000 7f6f80547640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6f780c2e60 0x7f6f78164380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.844+0000 7f6f80547640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7806d580 con 0x7f6f780c1ca0 2023-11-18T20:39:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.844+0000 7f6f80547640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780726d0 con 0x7f6f78155fc0 2023-11-18T20:39:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.844+0000 7f6f80547640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7806dd60 con 0x7f6f780c2e60 2023-11-18T20:39:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.844+0000 7f6f7dae2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6f780c1ca0 0x7f6f780c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47302/0 (socket says 172.21.15.132:47302) 2023-11-18T20:39:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.844+0000 7f6f7eae4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6f780c2e60 0x7f6f78164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.844+0000 7f6f7dae2640 1 -- 172.21.15.132:0/2580956725 learned_addr learned my addr 172.21.15.132:0/2580956725 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.845+0000 7f6f7eae4640 1 -- 172.21.15.132:0/2580956725 >> v1:172.21.15.161:6789/0 conn(0x7f6f78155fc0 legacy=0x7f6f78159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.845+0000 7f6f7eae4640 1 -- 172.21.15.132:0/2580956725 >> v1:172.21.15.132:6789/0 conn(0x7f6f780c1ca0 legacy=0x7f6f780c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.845+0000 7f6f7eae4640 1 -- 172.21.15.132:0/2580956725 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7806da80 con 0x7f6f780c2e60 2023-11-18T20:39:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.846+0000 7f6f7eae4640 1 --2- 172.21.15.132:0/2580956725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f78164380 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009dc0 tx=0x7f6f7002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a376df7414b7a865 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.846+0000 7f6f7d2e1640 1 -- 172.21.15.132:0/2580956725 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7002cb20 con 0x7f6f780c2e60 2023-11-18T20:39:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.846+0000 7f6f7d2e1640 1 -- 172.21.15.132:0/2580956725 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7002cc80 con 0x7f6f780c2e60 2023-11-18T20:39:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.846+0000 7f6f7d2e1640 1 -- 172.21.15.132:0/2580956725 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70034440 con 0x7f6f780c2e60 2023-11-18T20:39:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.847+0000 7f6f80547640 1 -- 172.21.15.132:0/2580956725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 msgr2=0x7f6f78164380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.847+0000 7f6f80547640 1 --2- 172.21.15.132:0/2580956725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f78164380 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009dc0 tx=0x7f6f7002bd70 comp rx=0 tx=0).stop 2023-11-18T20:39:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.847+0000 7f6f80547640 1 -- 172.21.15.132:0/2580956725 shutdown_connections 2023-11-18T20:39:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.847+0000 7f6f80547640 1 --2- 172.21.15.132:0/2580956725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f78164380 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.847+0000 7f6f80547640 1 -- 172.21.15.132:0/2580956725 >> 172.21.15.132:0/2580956725 conn(0x7f6f7806a500 msgr2=0x7f6f7806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:47.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.847+0000 7f6f80547640 1 -- 172.21.15.132:0/2580956725 shutdown_connections 2023-11-18T20:39:47.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.847+0000 7f6f80547640 1 -- 172.21.15.132:0/2580956725 wait complete. 2023-11-18T20:39:47.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.849+0000 7f6f80547640 1 Processor -- start 2023-11-18T20:39:47.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.849+0000 7f6f80547640 1 -- start start 2023-11-18T20:39:47.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f80547640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f780c1ca0 0x7f6f781f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f80547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f781586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f80547640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f78155fc0 0x7f6f78143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f80547640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780a2650 con 0x7f6f780c2e60 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f80547640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781f2690 con 0x7f6f780c1ca0 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f80547640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780a7ac0 con 0x7f6f78155fc0 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7dae2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f781586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7dae2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f781586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42078/0 (socket says 172.21.15.132:42078) 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7dae2640 1 -- 172.21.15.132:0/1069976863 learned_addr learned my addr 172.21.15.132:0/1069976863 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7dae2640 1 -- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f78155fc0 msgr2=0x7f6f78143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7dae2640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f78155fc0 0x7f6f78143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7e2e3640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f780c1ca0 0x7f6f781f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:47.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7dae2640 1 -- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f780c1ca0 msgr2=0x7f6f781f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:47.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7dae2640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f780c1ca0 0x7f6f781f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:47.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.850+0000 7f6f7dae2640 1 -- 172.21.15.132:0/1069976863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70009a70 con 0x7f6f780c2e60 2023-11-18T20:39:47.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.851+0000 7f6f7dae2640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f781586c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c4a0 tx=0x7f6f6800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:47.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.851+0000 7f6f6effd640 1 -- 172.21.15.132:0/1069976863 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68005ce0 con 0x7f6f780c2e60 2023-11-18T20:39:47.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.851+0000 7f6f6effd640 1 -- 172.21.15.132:0/1069976863 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68005e40 con 0x7f6f780c2e60 2023-11-18T20:39:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.851+0000 7f6f6effd640 1 -- 172.21.15.132:0/1069976863 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68007270 con 0x7f6f780c2e60 2023-11-18T20:39:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.851+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f780a7da0 con 0x7f6f780c2e60 2023-11-18T20:39:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.851+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f780a2270 con 0x7f6f780c2e60 2023-11-18T20:39:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.852+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f780a2790 con 0x7f6f780c2e60 2023-11-18T20:39:47.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.853+0000 7f6f6effd640 1 -- 172.21.15.132:0/1069976863 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f68007490 con 0x7f6f780c2e60 2023-11-18T20:39:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.854+0000 7f6f6effd640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f5c06ae40 0x7f6f5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.854+0000 7f6f6effd640 1 -- 172.21.15.132:0/1069976863 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f6f68088ed0 con 0x7f6f780c2e60 2023-11-18T20:39:47.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.855+0000 7f6f7e2e3640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f5c06ae40 0x7f6f5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:47.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.856+0000 7f6f7e2e3640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f5c06ae40 0x7f6f5c06d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400a750 tx=0x7f6f74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:47.858+0000 7f6f6effd640 1 -- 172.21.15.132:0/1069976863 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f780a2790 con 0x7f6f780c2e60 2023-11-18T20:39:48.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.046+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6f780a2790 con 0x7f6f780c2e60 2023-11-18T20:39:48.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.047+0000 7f6f6effd640 1 -- 172.21.15.132:0/1069976863 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v41) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6f780a2790 con 0x7f6f780c2e60 2023-11-18T20:39:48.048 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:48.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f5c06ae40 msgr2=0x7f6f5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f5c06ae40 0x7f6f5c06d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400a750 tx=0x7f6f74008040 comp rx=0 tx=0).stop 2023-11-18T20:39:48.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 msgr2=0x7f6f781586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f781586c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c4a0 tx=0x7f6f6800c960 comp rx=0 tx=0).stop 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 shutdown_connections 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f5c06ae40 0x7f6f5c06d300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f78155fc0 0x7f6f78143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f780c2e60 0x7f6f781586c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 --2- 172.21.15.132:0/1069976863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f780c1ca0 0x7f6f781f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 >> 172.21.15.132:0/1069976863 conn(0x7f6f7806a500 msgr2=0x7f6f780c4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 shutdown_connections 2023-11-18T20:39:48.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.049+0000 7f6f80547640 1 -- 172.21.15.132:0/1069976863 wait complete. 2023-11-18T20:39:48.068 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:39:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.272+0000 7fd16f741640 1 Processor -- start 2023-11-18T20:39:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.272+0000 7fd16f741640 1 -- start start 2023-11-18T20:39:48.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.274+0000 7fd16f741640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1680c5ec0 0x7fd1680c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.274+0000 7fd16f741640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c45d0 0x7fd1680c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.274+0000 7fd16f741640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1680bfdc0 con 0x7fd1680721a0 2023-11-18T20:39:48.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.274+0000 7fd16f741640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16806e390 con 0x7fd1680c5ec0 2023-11-18T20:39:48.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.274+0000 7fd16f741640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16806ddd0 con 0x7fd1680c45d0 2023-11-18T20:39:48.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.274+0000 7fd16d4dd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1680c5ec0 0x7fd1680c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.274+0000 7fd16d4dd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1680c5ec0 0x7fd1680c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42080/0 (socket says 172.21.15.132:42080) 2023-11-18T20:39:48.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.274+0000 7fd16d4dd640 1 -- 172.21.15.132:0/1382591353 learned_addr learned my addr 172.21.15.132:0/1382591353 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:48.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.275+0000 7fd16ccdc640 1 --2- 172.21.15.132:0/1382591353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c45d0 0x7fd1680c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.275+0000 7fd16d4dd640 1 -- 172.21.15.132:0/1382591353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c45d0 msgr2=0x7fd1680c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.275+0000 7fd16d4dd640 1 --2- 172.21.15.132:0/1382591353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c45d0 0x7fd1680c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.275+0000 7fd16d4dd640 1 -- 172.21.15.132:0/1382591353 >> v1:172.21.15.161:6789/0 conn(0x7fd1680721a0 legacy=0x7fd168155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.275+0000 7fd16d4dd640 1 -- 172.21.15.132:0/1382591353 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16806e0b0 con 0x7fd1680c5ec0 2023-11-18T20:39:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.276+0000 7fd16d4dd640 1 --2- 172.21.15.132:0/1382591353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680c5ec0 0x7fd1680c2c30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd164009870 tx=0x7fd16402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd079cb8c9696bb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.276+0000 7fd15ffff640 1 -- 172.21.15.132:0/1382591353 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164031740 con 0x7fd1680c5ec0 2023-11-18T20:39:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.276+0000 7fd15ffff640 1 -- 172.21.15.132:0/1382591353 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1640318a0 con 0x7fd1680c5ec0 2023-11-18T20:39:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.276+0000 7fd15ffff640 1 -- 172.21.15.132:0/1382591353 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164031c30 con 0x7fd1680c5ec0 2023-11-18T20:39:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.277+0000 7fd16f741640 1 -- 172.21.15.132:0/1382591353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680c5ec0 msgr2=0x7fd1680c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.277+0000 7fd16f741640 1 --2- 172.21.15.132:0/1382591353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680c5ec0 0x7fd1680c2c30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd164009870 tx=0x7fd16402b7e0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.277+0000 7fd16f741640 1 -- 172.21.15.132:0/1382591353 shutdown_connections 2023-11-18T20:39:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.277+0000 7fd16f741640 1 --2- 172.21.15.132:0/1382591353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c45d0 0x7fd1680c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.277+0000 7fd16f741640 1 --2- 172.21.15.132:0/1382591353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680c5ec0 0x7fd1680c2c30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.277+0000 7fd16f741640 1 -- 172.21.15.132:0/1382591353 >> 172.21.15.132:0/1382591353 conn(0x7fd16806a500 msgr2=0x7fd16806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.277+0000 7fd16f741640 1 -- 172.21.15.132:0/1382591353 shutdown_connections 2023-11-18T20:39:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.277+0000 7fd16f741640 1 -- 172.21.15.132:0/1382591353 wait complete. 2023-11-18T20:39:48.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.279+0000 7fd16f741640 1 Processor -- start 2023-11-18T20:39:48.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.280+0000 7fd16f741640 1 -- start start 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16f741640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680721a0 0x7fd1681e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16f741640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1680c45d0 0x7fd1681e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16f741640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c5ec0 0x7fd1681ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16f741640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16814a490 con 0x7fd1680721a0 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16f741640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1681e79e0 con 0x7fd1680c45d0 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16f741640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16814f8b0 con 0x7fd1680c5ec0 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16d4dd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680721a0 0x7fd1681e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16d4dd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680721a0 0x7fd1681e6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42086/0 (socket says 172.21.15.132:42086) 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16d4dd640 1 -- 172.21.15.132:0/2034062196 learned_addr learned my addr 172.21.15.132:0/2034062196 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16dcde640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c5ec0 0x7fd1681ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16ccdc640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1680c45d0 0x7fd1681e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16d4dd640 1 -- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c5ec0 msgr2=0x7fd1681ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16d4dd640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c5ec0 0x7fd1681ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16d4dd640 1 -- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1680c45d0 msgr2=0x7fd1681e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16d4dd640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1680c45d0 0x7fd1681e74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16d4dd640 1 -- 172.21.15.132:0/2034062196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640094d0 con 0x7fd1680721a0 2023-11-18T20:39:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.281+0000 7fd16dcde640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c5ec0 0x7fd1681ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.282+0000 7fd16d4dd640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680721a0 0x7fd1681e6f60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd164009870 tx=0x7fd1640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.282+0000 7fd15dffb640 1 -- 172.21.15.132:0/2034062196 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164033c70 con 0x7fd1680721a0 2023-11-18T20:39:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.282+0000 7fd15dffb640 1 -- 172.21.15.132:0/2034062196 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164033dd0 con 0x7fd1680721a0 2023-11-18T20:39:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.282+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16814b330 con 0x7fd1680721a0 2023-11-18T20:39:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.282+0000 7fd15dffb640 1 -- 172.21.15.132:0/2034062196 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16403c640 con 0x7fd1680721a0 2023-11-18T20:39:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.282+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16814b8f0 con 0x7fd1680721a0 2023-11-18T20:39:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.283+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd168068350 con 0x7fd1680721a0 2023-11-18T20:39:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.284+0000 7fd15dffb640 1 -- 172.21.15.132:0/2034062196 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd16403a040 con 0x7fd1680721a0 2023-11-18T20:39:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.285+0000 7fd15dffb640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd14c06ae40 0x7fd14c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.285+0000 7fd15dffb640 1 -- 172.21.15.132:0/2034062196 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fd1640ab410 con 0x7fd1680721a0 2023-11-18T20:39:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.286+0000 7fd16ccdc640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd14c06ae40 0x7fd14c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.287+0000 7fd16ccdc640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd14c06ae40 0x7fd14c06d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd1680c1cd0 tx=0x7fd158008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.289+0000 7fd15dffb640 1 -- 172.21.15.132:0/2034062196 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd164076050 con 0x7fd1680721a0 2023-11-18T20:39:48.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.492+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd1680bfa00 con 0x7fd1680721a0 2023-11-18T20:39:48.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.493+0000 7fd15dffb640 1 -- 172.21.15.132:0/2034062196 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd164079670 con 0x7fd1680721a0 2023-11-18T20:39:48.494 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:39:48.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd14c06ae40 msgr2=0x7fd14c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd14c06ae40 0x7fd14c06d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd1680c1cd0 tx=0x7fd158008040 comp rx=0 tx=0).stop 2023-11-18T20:39:48.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680721a0 msgr2=0x7fd1681e6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680721a0 0x7fd1681e6f60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd164009870 tx=0x7fd1640046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 shutdown_connections 2023-11-18T20:39:48.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd14c06ae40 0x7fd14c06d300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1680c5ec0 0x7fd1681ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1680c45d0 0x7fd1681e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.495+0000 7fd16f741640 1 --2- 172.21.15.132:0/2034062196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1680721a0 0x7fd1681e6f60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.496+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 >> 172.21.15.132:0/2034062196 conn(0x7fd16806a500 msgr2=0x7fd1680c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:48.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.496+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 shutdown_connections 2023-11-18T20:39:48.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.496+0000 7fd16f741640 1 -- 172.21.15.132:0/2034062196 wait complete. 2023-11-18T20:39:48.516 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-18T20:39:48.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:48.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-18T20:39:48.631 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:39:48.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:39:48.632 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T20:39:48.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:39:48.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.898+0000 7fa99a147640 1 Processor -- start 2023-11-18T20:39:48.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.899+0000 7fa99a147640 1 -- start start 2023-11-18T20:39:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.900+0000 7fa99a147640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa99414fd30 0x7fa994152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.900+0000 7fa99a147640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 0x7fa9940a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.900+0000 7fa99a147640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9940c64a0 con 0x7fa9940a5260 2023-11-18T20:39:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.900+0000 7fa99a147640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9940c5c00 con 0x7fa99414fd30 2023-11-18T20:39:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.900+0000 7fa99a147640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940c5ee0 con 0x7fa99406d0a0 2023-11-18T20:39:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.900+0000 7fa993fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa9940a5260 0x7fa9940c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54006/0 (socket says 172.21.15.132:54006) 2023-11-18T20:39:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.900+0000 7fa993fff640 1 -- 172.21.15.132:0/1939665340 learned_addr learned my addr 172.21.15.132:0/1939665340 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:48.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa98bfff640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 0x7fa9940a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa9937fe640 1 --2- 172.21.15.132:0/1939665340 >> v2:172.21.15.161:3300/0 conn(0x7fa99414fd30 0x7fa994152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880181780 0 0) 0x7fa9940c64a0 con 0x7fa9940a5260 2023-11-18T20:39:48.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa980003520 con 0x7fa9940a5260 2023-11-18T20:39:48.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 833236045 0 0) 0x7fa980003520 con 0x7fa9940a5260 2023-11-18T20:39:48.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 msgr2=0x7fa9940a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:48.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 0x7fa9940a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 >> v2:172.21.15.161:3300/0 conn(0x7fa99414fd30 msgr2=0x7fa994152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:48.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 --2- 172.21.15.132:0/1939665340 >> v2:172.21.15.161:3300/0 conn(0x7fa99414fd30 0x7fa994152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9940c61c0 con 0x7fa9940a5260 2023-11-18T20:39:48.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.901+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fa98c0019f0 con 0x7fa9940a5260 2023-11-18T20:39:48.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 >> v1:172.21.15.132:6789/0 conn(0x7fa9940a5260 legacy=0x7fa9940c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa992ffd640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 0x7fa980003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa992ffd640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa9800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa992ffd640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa980004d00 0x7fa980005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940c5c00 con 0x7fa980003ef0 2023-11-18T20:39:48.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940c5ee0 con 0x7fa980004d00 2023-11-18T20:39:48.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98000b980 con 0x7fa99406d0a0 2023-11-18T20:39:48.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa98bfff640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa9800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa993fff640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa980004d00 0x7fa980005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa9937fe640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 0x7fa980003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa98bfff640 1 -- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 msgr2=0x7fa980003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:48.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.902+0000 7fa98bfff640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 0x7fa980003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.903+0000 7fa98bfff640 1 -- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa980004d00 msgr2=0x7fa980005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.903+0000 7fa98bfff640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa980004d00 0x7fa980005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.903+0000 7fa98bfff640 1 -- 172.21.15.132:0/1939665340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980003520 con 0x7fa980003ef0 2023-11-18T20:39:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.903+0000 7fa9937fe640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa99406d0a0 0x7fa980003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:48.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.904+0000 7fa98bfff640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa9800047c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009a90 tx=0x7fa9800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe518bcf3e44d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:48.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.904+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c02c6b0 con 0x7fa980003ef0 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.904+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c02c810 con 0x7fa980003ef0 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.904+0000 7fa992ffd640 1 -- 172.21.15.132:0/1939665340 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c02cba0 con 0x7fa980003ef0 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.905+0000 7fa99a147640 1 -- 172.21.15.132:0/1939665340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 msgr2=0x7fa9800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.905+0000 7fa99a147640 1 --2- 172.21.15.132:0/1939665340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa9800047c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009a90 tx=0x7fa9800057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.905+0000 7fa993fff640 1 -- 172.21.15.132:0/1939665340 reap_dead start 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.905+0000 7fa99a147640 1 -- 172.21.15.132:0/1939665340 shutdown_connections 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.905+0000 7fa99a147640 1 -- 172.21.15.132:0/1939665340 >> 172.21.15.132:0/1939665340 conn(0x7fa99406a500 msgr2=0x7fa99406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.905+0000 7fa99a147640 1 -- 172.21.15.132:0/1939665340 shutdown_connections 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.905+0000 7fa99a147640 1 -- 172.21.15.132:0/1939665340 wait complete. 2023-11-18T20:39:48.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.907+0000 7fa99a147640 1 Processor -- start 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.907+0000 7fa99a147640 1 -- start start 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa99a147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa994151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa99a147640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa994071cd0 0x7fa994148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa99a147640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9941564b0 0x7fa994148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa99a147640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994149660 con 0x7fa980003ef0 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa99a147640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994153c10 con 0x7fa994071cd0 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa99a147640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940aa9b0 con 0x7fa9941564b0 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa994151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa994151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49278/0 (socket says 172.21.15.132:49278) 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.908+0000 7fa9937fe640 1 -- 172.21.15.132:0/3538208541 learned_addr learned my addr 172.21.15.132:0/3538208541 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa98bfff640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa994071cd0 0x7fa994148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa993fff640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9941564b0 0x7fa994148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa9937fe640 1 -- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9941564b0 msgr2=0x7fa994148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa9937fe640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9941564b0 0x7fa994148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa9937fe640 1 -- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa994071cd0 msgr2=0x7fa994148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa9937fe640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa994071cd0 0x7fa994148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa9937fe640 1 -- 172.21.15.132:0/3538208541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa994151b60 con 0x7fa980003ef0 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa98bfff640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa994071cd0 0x7fa994148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa9937fe640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa994151620 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa9840109d0 tx=0x7fa984010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa990ff9640 1 -- 172.21.15.132:0/3538208541 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400ec20 con 0x7fa980003ef0 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa990ff9640 1 -- 172.21.15.132:0/3538208541 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400ed80 con 0x7fa980003ef0 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa990ff9640 1 -- 172.21.15.132:0/3538208541 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98401c620 con 0x7fa980003ef0 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.909+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa994149190 con 0x7fa980003ef0 2023-11-18T20:39:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.910+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9941ea2d0 con 0x7fa980003ef0 2023-11-18T20:39:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.911+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9940aa810 con 0x7fa980003ef0 2023-11-18T20:39:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.912+0000 7fa990ff9640 1 -- 172.21.15.132:0/3538208541 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa98401c780 con 0x7fa980003ef0 2023-11-18T20:39:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.913+0000 7fa990ff9640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa97406ae40 0x7fa97406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.913+0000 7fa990ff9640 1 -- 172.21.15.132:0/3538208541 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fa98408a0c0 con 0x7fa980003ef0 2023-11-18T20:39:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.913+0000 7fa98bfff640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa97406ae40 0x7fa97406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.914+0000 7fa98bfff640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa97406ae40 0x7fa97406d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa97c036000 tx=0x7fa97c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:48.918+0000 7fa990ff9640 1 -- 172.21.15.132:0/3538208541 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9940aa810 con 0x7fa980003ef0 2023-11-18T20:39:49.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.146+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9940aa810 con 0x7fa980003ef0 2023-11-18T20:39:49.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.147+0000 7fa990ff9640 1 -- 172.21.15.132:0/3538208541 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6142 (secure 0 0 0) 0x7fa9940aa810 con 0x7fa980003ef0 2023-11-18T20:39:49.148 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:49.149 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:02.182181+0000","modified":"2023-11-18T20:39:05.261751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6834/4266315561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4266315561},{"type":"v1","addr":"172.21.15.132:6834","nonce":4266315561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:22.835223+0000","modified":"2023-11-18T20:39:25.904986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4562":{"gid":4562,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-18T20:39:49.149 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-11-18T20:39:49.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa97406ae40 msgr2=0x7fa97406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa97406ae40 0x7fa97406d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa97c036000 tx=0x7fa97c030000 comp rx=0 tx=0).stop 2023-11-18T20:39:49.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 msgr2=0x7fa994151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa994151620 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa9840109d0 tx=0x7fa984010e90 comp rx=0 tx=0).stop 2023-11-18T20:39:49.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 shutdown_connections 2023-11-18T20:39:49.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa97406ae40 0x7fa97406d300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9941564b0 0x7fa994148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa994071cd0 0x7fa994148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 --2- 172.21.15.132:0/3538208541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa980003ef0 0x7fa994151620 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.149+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 >> 172.21.15.132:0/3538208541 conn(0x7fa99406a500 msgr2=0x7fa9940c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:49.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.150+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 shutdown_connections 2023-11-18T20:39:49.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.150+0000 7fa99a147640 1 -- 172.21.15.132:0/3538208541 wait complete. 2023-11-18T20:39:49.171 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:49.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.381+0000 7f17e4821640 1 Processor -- start 2023-11-18T20:39:49.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.381+0000 7f17e4821640 1 -- start start 2023-11-18T20:39:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.382+0000 7f17e4821640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f17e014e7f0 0x7f17e00c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17e4821640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17e006cd20 0x7f17e015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17e4821640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e00a8380 con 0x7f17e00c52e0 2023-11-18T20:39:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17e4821640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e01510b0 con 0x7f17e006cd20 2023-11-18T20:39:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17e4821640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e006bf60 con 0x7f17e014e7f0 2023-11-18T20:39:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17dffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17e006cd20 0x7f17e015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17dffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17e006cd20 0x7f17e015ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49294/0 (socket says 172.21.15.132:49294) 2023-11-18T20:39:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17dffff640 1 -- 172.21.15.132:0/3252096355 learned_addr learned my addr 172.21.15.132:0/3252096355 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17df7fe640 1 --2- 172.21.15.132:0/3252096355 >> v2:172.21.15.161:3300/0 conn(0x7f17e014e7f0 0x7f17e00c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17dffff640 1 -- 172.21.15.132:0/3252096355 >> v2:172.21.15.161:3300/0 conn(0x7f17e014e7f0 msgr2=0x7f17e00c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17dffff640 1 --2- 172.21.15.132:0/3252096355 >> v2:172.21.15.161:3300/0 conn(0x7f17e014e7f0 0x7f17e00c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17dffff640 1 -- 172.21.15.132:0/3252096355 >> v1:172.21.15.161:6789/0 conn(0x7f17e00c52e0 legacy=0x7f17e006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.383+0000 7f17dffff640 1 -- 172.21.15.132:0/3252096355 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e006c240 con 0x7f17e006cd20 2023-11-18T20:39:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.385+0000 7f17dffff640 1 --2- 172.21.15.132:0/3252096355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e015ba30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f17e0067910 tx=0x7f17d802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469cba911cc76ff1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.385+0000 7f17de7fc640 1 -- 172.21.15.132:0/3252096355 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d802c9f0 con 0x7f17e006cd20 2023-11-18T20:39:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.385+0000 7f17de7fc640 1 -- 172.21.15.132:0/3252096355 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d802cb50 con 0x7f17e006cd20 2023-11-18T20:39:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.385+0000 7f17de7fc640 1 -- 172.21.15.132:0/3252096355 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80343f0 con 0x7f17e006cd20 2023-11-18T20:39:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.385+0000 7f17e4821640 1 -- 172.21.15.132:0/3252096355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 msgr2=0x7f17e015ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.385+0000 7f17e4821640 1 --2- 172.21.15.132:0/3252096355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e015ba30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f17e0067910 tx=0x7f17d802be50 comp rx=0 tx=0).stop 2023-11-18T20:39:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.386+0000 7f17e4821640 1 -- 172.21.15.132:0/3252096355 shutdown_connections 2023-11-18T20:39:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.386+0000 7f17e4821640 1 --2- 172.21.15.132:0/3252096355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e015ba30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.386+0000 7f17e4821640 1 --2- 172.21.15.132:0/3252096355 >> v2:172.21.15.161:3300/0 conn(0x7f17e014e7f0 0x7f17e00c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.386+0000 7f17e4821640 1 -- 172.21.15.132:0/3252096355 >> 172.21.15.132:0/3252096355 conn(0x7f17e00a77f0 msgr2=0x7f17e00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.386+0000 7f17e4821640 1 -- 172.21.15.132:0/3252096355 shutdown_connections 2023-11-18T20:39:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.386+0000 7f17e4821640 1 -- 172.21.15.132:0/3252096355 wait complete. 2023-11-18T20:39:49.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.387+0000 7f17e4821640 1 Processor -- start 2023-11-18T20:39:49.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.387+0000 7f17e4821640 1 -- start start 2023-11-18T20:39:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.388+0000 7f17e4821640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e01de850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.388+0000 7f17e4821640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17e00c52e0 0x7f17e01da710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.388+0000 7f17e4821640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17e014e7f0 0x7f17e01dac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.388+0000 7f17e4821640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e014ef20 con 0x7f17e006cd20 2023-11-18T20:39:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.388+0000 7f17e4821640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e01e8860 con 0x7f17e00c52e0 2023-11-18T20:39:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.388+0000 7f17e4821640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e01e8b00 con 0x7f17e014e7f0 2023-11-18T20:39:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.388+0000 7f17df7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e01de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17df7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e01de850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49300/0 (socket says 172.21.15.132:49300) 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17df7fe640 1 -- 172.21.15.132:0/1124986765 learned_addr learned my addr 172.21.15.132:0/1124986765 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17df7fe640 1 -- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17e014e7f0 msgr2=0x7f17e01dac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17df7fe640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17e014e7f0 0x7f17e01dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17df7fe640 1 -- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17e00c52e0 msgr2=0x7f17e01da710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17deffd640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17e00c52e0 0x7f17e01da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17df7fe640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17e00c52e0 0x7f17e01da710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17df7fe640 1 -- 172.21.15.132:0/1124986765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8009b30 con 0x7f17e006cd20 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17df7fe640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e01de850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f17d000d5f0 tx=0x7f17d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.389+0000 7f17c7fff640 1 -- 172.21.15.132:0/1124986765 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d00125f0 con 0x7f17e006cd20 2023-11-18T20:39:49.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.390+0000 7f17c7fff640 1 -- 172.21.15.132:0/1124986765 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d0012750 con 0x7f17e006cd20 2023-11-18T20:39:49.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.390+0000 7f17c7fff640 1 -- 172.21.15.132:0/1124986765 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0012b00 con 0x7f17e006cd20 2023-11-18T20:39:49.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.390+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e014f170 con 0x7f17e006cd20 2023-11-18T20:39:49.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.390+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e00c0650 con 0x7f17e006cd20 2023-11-18T20:39:49.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.391+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e004e840 con 0x7f17e006cd20 2023-11-18T20:39:49.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.392+0000 7f17c7fff640 1 -- 172.21.15.132:0/1124986765 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17d0012c60 con 0x7f17e006cd20 2023-11-18T20:39:49.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.393+0000 7f17c7fff640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17cc06aec0 0x7f17cc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.393+0000 7f17c7fff640 1 -- 172.21.15.132:0/1124986765 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f17d0089d90 con 0x7f17e006cd20 2023-11-18T20:39:49.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.393+0000 7f17deffd640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17cc06aec0 0x7f17cc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.394+0000 7f17deffd640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17cc06aec0 0x7f17cc06d380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17d4003d90 tx=0x7f17d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:49.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.397+0000 7f17c7fff640 1 -- 172.21.15.132:0/1124986765 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17d0054b50 con 0x7f17e006cd20 2023-11-18T20:39:49.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.597+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17e00704d0 con 0x7f17e006cd20 2023-11-18T20:39:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.600+0000 7f17c7fff640 1 -- 172.21.15.132:0/1124986765 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+20678 (secure 0 0 0) 0x7f17d0058170 con 0x7f17e006cd20 2023-11-18T20:39:49.601 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:49.602 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":41,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:46.561578+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:49.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.602+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17cc06aec0 msgr2=0x7f17cc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17cc06aec0 0x7f17cc06d380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17d4003d90 tx=0x7f17d4009040 comp rx=0 tx=0).stop 2023-11-18T20:39:49.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 msgr2=0x7f17e01de850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e01de850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f17d000d5f0 tx=0x7f17d000dab0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 shutdown_connections 2023-11-18T20:39:49.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17cc06aec0 0x7f17cc06d380 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17e014e7f0 0x7f17e01dac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17e00c52e0 0x7f17e01da710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 --2- 172.21.15.132:0/1124986765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17e006cd20 0x7f17e01de850 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 >> 172.21.15.132:0/1124986765 conn(0x7f17e00a77f0 msgr2=0x7f17e014b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 shutdown_connections 2023-11-18T20:39:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.603+0000 7f17e4821640 1 -- 172.21.15.132:0/1124986765 wait complete. 2023-11-18T20:39:49.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:39:00.655880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:39:01.207461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:39:20.671493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:39:21.849411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:39:49.626 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:39:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.840+0000 7f42e775a640 1 Processor -- start 2023-11-18T20:39:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.840+0000 7f42e775a640 1 -- start start 2023-11-18T20:39:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.841+0000 7f42e775a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42e014fd30 0x7f42e0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e775a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 0x7f42e00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e775a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e00c64a0 con 0x7f42e006d0a0 2023-11-18T20:39:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e775a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e00c5c00 con 0x7f42e014fd30 2023-11-18T20:39:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e775a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00c5ee0 con 0x7f42e00c3ea0 2023-11-18T20:39:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e54f6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42e014fd30 0x7f42e0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e54f6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42e014fd30 0x7f42e0152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49302/0 (socket says 172.21.15.132:49302) 2023-11-18T20:39:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e54f6640 1 -- 172.21.15.132:0/2747612051 learned_addr learned my addr 172.21.15.132:0/2747612051 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e54f6640 1 -- 172.21.15.132:0/2747612051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 msgr2=0x7f42e00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e54f6640 1 --2- 172.21.15.132:0/2747612051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 0x7f42e00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e54f6640 1 -- 172.21.15.132:0/2747612051 >> v1:172.21.15.161:6789/0 conn(0x7f42e006d0a0 legacy=0x7f42e00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.842+0000 7f42e54f6640 1 -- 172.21.15.132:0/2747612051 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e00c61c0 con 0x7f42e014fd30 2023-11-18T20:39:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.843+0000 7f42e54f6640 1 --2- 172.21.15.132:0/2747612051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e0152f20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009870 tx=0x7f42dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f208fca68fffaae server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.844+0000 7f42d7fff640 1 -- 172.21.15.132:0/2747612051 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc031640 con 0x7f42e014fd30 2023-11-18T20:39:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.844+0000 7f42d7fff640 1 -- 172.21.15.132:0/2747612051 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc0317a0 con 0x7f42e014fd30 2023-11-18T20:39:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.844+0000 7f42d7fff640 1 -- 172.21.15.132:0/2747612051 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc031b30 con 0x7f42e014fd30 2023-11-18T20:39:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.844+0000 7f42e775a640 1 -- 172.21.15.132:0/2747612051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 msgr2=0x7f42e0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.844+0000 7f42e775a640 1 --2- 172.21.15.132:0/2747612051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e0152f20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009870 tx=0x7f42dc02b8f0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.845+0000 7f42e775a640 1 -- 172.21.15.132:0/2747612051 shutdown_connections 2023-11-18T20:39:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.845+0000 7f42e775a640 1 --2- 172.21.15.132:0/2747612051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 0x7f42e00c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.845+0000 7f42e775a640 1 --2- 172.21.15.132:0/2747612051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e0152f20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.845+0000 7f42e775a640 1 -- 172.21.15.132:0/2747612051 >> 172.21.15.132:0/2747612051 conn(0x7f42e006a500 msgr2=0x7f42e006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.845+0000 7f42e775a640 1 -- 172.21.15.132:0/2747612051 shutdown_connections 2023-11-18T20:39:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.845+0000 7f42e775a640 1 -- 172.21.15.132:0/2747612051 wait complete. 2023-11-18T20:39:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.846+0000 7f42e775a640 1 Processor -- start 2023-11-18T20:39:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.846+0000 7f42e775a640 1 -- start start 2023-11-18T20:39:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.847+0000 7f42e775a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e006d0a0 0x7f42e01ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.847+0000 7f42e775a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 0x7f42e00bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.847+0000 7f42e775a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.847+0000 7f42e775a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01ddbb0 con 0x7f42e014fd30 2023-11-18T20:39:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.847+0000 7f42e775a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00aa770 con 0x7f42e006d0a0 2023-11-18T20:39:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.847+0000 7f42e775a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00aaa50 con 0x7f42e00c3ea0 2023-11-18T20:39:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e014f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49310/0 (socket says 172.21.15.132:49310) 2023-11-18T20:39:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 -- 172.21.15.132:0/348501259 learned_addr learned my addr 172.21.15.132:0/348501259 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e54f6640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e006d0a0 0x7f42e01ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e4cf5640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 0x7f42e00bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 -- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 msgr2=0x7f42e00bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 0x7f42e00bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 -- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e006d0a0 msgr2=0x7f42e01ee2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e006d0a0 0x7f42e01ee2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 -- 172.21.15.132:0/348501259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0094d0 con 0x7f42e014fd30 2023-11-18T20:39:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e4cf5640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 0x7f42e00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e54f6640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e006d0a0 0x7f42e01ee2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.848+0000 7f42e5cf7640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e014f000 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f42d800b970 tx=0x7f42d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.849+0000 7f42d5ffb640 1 -- 172.21.15.132:0/348501259 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d800cb40 con 0x7f42e014fd30 2023-11-18T20:39:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.849+0000 7f42d5ffb640 1 -- 172.21.15.132:0/348501259 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d800ccc0 con 0x7f42e014fd30 2023-11-18T20:39:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.849+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e00aad30 con 0x7f42e014fd30 2023-11-18T20:39:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.849+0000 7f42d5ffb640 1 -- 172.21.15.132:0/348501259 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8014680 con 0x7f42e014fd30 2023-11-18T20:39:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.849+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e01dc630 con 0x7f42e014fd30 2023-11-18T20:39:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.850+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e01dc850 con 0x7f42e014fd30 2023-11-18T20:39:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.851+0000 7f42d5ffb640 1 -- 172.21.15.132:0/348501259 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42d801d3b0 con 0x7f42e014fd30 2023-11-18T20:39:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.852+0000 7f42d5ffb640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42c406ae40 0x7f42c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.852+0000 7f42d5ffb640 1 -- 172.21.15.132:0/348501259 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f42d8089990 con 0x7f42e014fd30 2023-11-18T20:39:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.852+0000 7f42e54f6640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42c406ae40 0x7f42c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.853+0000 7f42e54f6640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42c406ae40 0x7f42c406d300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f42dc036000 tx=0x7f42dc03c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:49.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:49.857+0000 7f42d5ffb640 1 -- 172.21.15.132:0/348501259 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42d8054670 con 0x7f42e014fd30 2023-11-18T20:39:50.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.046+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42e0068350 con 0x7f42e014fd30 2023-11-18T20:39:50.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.047+0000 7f42d5ffb640 1 -- 172.21.15.132:0/348501259 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42d80190a0 con 0x7f42e014fd30 2023-11-18T20:39:50.049 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:39:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.050+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42c406ae40 msgr2=0x7f42c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.050+0000 7f42e775a640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42c406ae40 0x7f42c406d300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f42dc036000 tx=0x7f42dc03c040 comp rx=0 tx=0).stop 2023-11-18T20:39:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.050+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 msgr2=0x7f42e014f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.050+0000 7f42e775a640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e014f000 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f42d800b970 tx=0x7f42d800be30 comp rx=0 tx=0).stop 2023-11-18T20:39:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.051+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 shutdown_connections 2023-11-18T20:39:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.051+0000 7f42e775a640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f42c406ae40 0x7f42c406d300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.051+0000 7f42e775a640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42e014fd30 0x7f42e014f000 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.051+0000 7f42e775a640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42e00c3ea0 0x7f42e00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.051+0000 7f42e775a640 1 --2- 172.21.15.132:0/348501259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e006d0a0 0x7f42e01ee2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.051+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 >> 172.21.15.132:0/348501259 conn(0x7f42e006a500 msgr2=0x7f42e00c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:50.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.051+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 shutdown_connections 2023-11-18T20:39:50.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.051+0000 7f42e775a640 1 -- 172.21.15.132:0/348501259 wait complete. 2023-11-18T20:39:50.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:39:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.287+0000 7fe4a4451640 1 Processor -- start 2023-11-18T20:39:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.287+0000 7fe4a4451640 1 -- start start 2023-11-18T20:39:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.288+0000 7fe4a4451640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe49c155490 0x7fe49c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.288+0000 7fe4a4451640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe49c0c1500 0x7fe49c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.288+0000 7fe4a4451640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0c06c0 con 0x7fe49c0c4080 2023-11-18T20:39:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.288+0000 7fe4a4451640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0a5820 con 0x7fe49c0c1500 2023-11-18T20:39:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.288+0000 7fe4a4451640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0c1020 con 0x7fe49c155490 2023-11-18T20:39:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.289+0000 7fe4a19ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe49c0c1500 0x7fe49c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.289+0000 7fe4a19ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe49c0c1500 0x7fe49c0a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49318/0 (socket says 172.21.15.132:49318) 2023-11-18T20:39:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.289+0000 7fe4a19ec640 1 -- 172.21.15.132:0/1861792418 learned_addr learned my addr 172.21.15.132:0/1861792418 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.289+0000 7fe4a19ec640 1 -- 172.21.15.132:0/1861792418 >> v2:172.21.15.161:3300/0 conn(0x7fe49c155490 msgr2=0x7fe49c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.289+0000 7fe4a19ec640 1 --2- 172.21.15.132:0/1861792418 >> v2:172.21.15.161:3300/0 conn(0x7fe49c155490 0x7fe49c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.289+0000 7fe4a19ec640 1 -- 172.21.15.132:0/1861792418 >> v1:172.21.15.161:6789/0 conn(0x7fe49c0c4080 legacy=0x7fe49c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.289+0000 7fe4a19ec640 1 -- 172.21.15.132:0/1861792418 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0c0910 con 0x7fe49c0c1500 2023-11-18T20:39:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.291+0000 7fe4a19ec640 1 --2- 172.21.15.132:0/1861792418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c0a9430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe49c06dff0 tx=0x7fe48c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fadbb878f6bb48 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.291+0000 7fe4a11eb640 1 -- 172.21.15.132:0/1861792418 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c031870 con 0x7fe49c0c1500 2023-11-18T20:39:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.291+0000 7fe4a11eb640 1 -- 172.21.15.132:0/1861792418 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c0319d0 con 0x7fe49c0c1500 2023-11-18T20:39:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.291+0000 7fe4a11eb640 1 -- 172.21.15.132:0/1861792418 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c031d60 con 0x7fe49c0c1500 2023-11-18T20:39:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.292+0000 7fe4a4451640 1 -- 172.21.15.132:0/1861792418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 msgr2=0x7fe49c0a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.292+0000 7fe4a4451640 1 --2- 172.21.15.132:0/1861792418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c0a9430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe49c06dff0 tx=0x7fe48c02b910 comp rx=0 tx=0).stop 2023-11-18T20:39:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.292+0000 7fe4a4451640 1 -- 172.21.15.132:0/1861792418 shutdown_connections 2023-11-18T20:39:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.292+0000 7fe4a4451640 1 --2- 172.21.15.132:0/1861792418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c0a9430 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.292+0000 7fe4a4451640 1 --2- 172.21.15.132:0/1861792418 >> v2:172.21.15.161:3300/0 conn(0x7fe49c155490 0x7fe49c0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.292+0000 7fe4a4451640 1 -- 172.21.15.132:0/1861792418 >> 172.21.15.132:0/1861792418 conn(0x7fe49c06a500 msgr2=0x7fe49c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.292+0000 7fe4a4451640 1 -- 172.21.15.132:0/1861792418 shutdown_connections 2023-11-18T20:39:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.292+0000 7fe4a4451640 1 -- 172.21.15.132:0/1861792418 wait complete. 2023-11-18T20:39:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.294+0000 7fe4a4451640 1 Processor -- start 2023-11-18T20:39:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.294+0000 7fe4a4451640 1 -- start start 2023-11-18T20:39:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a4451640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c1df030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a4451640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe49c0c4080 0x7fe49c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a4451640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe49c155490 0x7fe49c150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a4451640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1dd970 con 0x7fe49c0c1500 2023-11-18T20:39:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a4451640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1de930 con 0x7fe49c0c4080 2023-11-18T20:39:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a4451640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c071dc0 con 0x7fe49c155490 2023-11-18T20:39:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a21ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c1df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a21ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c1df030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49330/0 (socket says 172.21.15.132:49330) 2023-11-18T20:39:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a21ed640 1 -- 172.21.15.132:0/707656097 learned_addr learned my addr 172.21.15.132:0/707656097 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a21ed640 1 -- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe49c155490 msgr2=0x7fe49c150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a21ed640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe49c155490 0x7fe49c150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a21ed640 1 -- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe49c0c4080 msgr2=0x7fe49c14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a21ed640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe49c0c4080 0x7fe49c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.295+0000 7fe4a21ed640 1 -- 172.21.15.132:0/707656097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0094d0 con 0x7fe49c0c1500 2023-11-18T20:39:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.296+0000 7fe4a21ed640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c1df030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe49800b410 tx=0x7fe49800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.296+0000 7fe492ffd640 1 -- 172.21.15.132:0/707656097 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498011830 con 0x7fe49c0c1500 2023-11-18T20:39:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.296+0000 7fe492ffd640 1 -- 172.21.15.132:0/707656097 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4980119b0 con 0x7fe49c0c1500 2023-11-18T20:39:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.296+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c1ea9f0 con 0x7fe49c0c1500 2023-11-18T20:39:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.296+0000 7fe492ffd640 1 -- 172.21.15.132:0/707656097 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498011d60 con 0x7fe49c0c1500 2023-11-18T20:39:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.296+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c1eac90 con 0x7fe49c0c1500 2023-11-18T20:39:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.298+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c1de420 con 0x7fe49c0c1500 2023-11-18T20:39:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.298+0000 7fe492ffd640 1 -- 172.21.15.132:0/707656097 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe49801a400 con 0x7fe49c0c1500 2023-11-18T20:39:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.299+0000 7fe492ffd640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe48006ae40 0x7fe48006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.299+0000 7fe492ffd640 1 -- 172.21.15.132:0/707656097 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fe498089b60 con 0x7fe49c0c1500 2023-11-18T20:39:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.300+0000 7fe4a19ec640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe48006ae40 0x7fe48006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.301+0000 7fe4a19ec640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe48006ae40 0x7fe48006d300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe48c036000 tx=0x7fe48c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.304+0000 7fe492ffd640 1 -- 172.21.15.132:0/707656097 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe49c1de420 con 0x7fe49c0c1500 2023-11-18T20:39:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.495+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe49c1de420 con 0x7fe49c0c1500 2023-11-18T20:39:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.496+0000 7fe492ffd640 1 -- 172.21.15.132:0/707656097 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe49c1de420 con 0x7fe49c0c1500 2023-11-18T20:39:50.497 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe48006ae40 msgr2=0x7fe48006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe48006ae40 0x7fe48006d300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe48c036000 tx=0x7fe48c030000 comp rx=0 tx=0).stop 2023-11-18T20:39:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 msgr2=0x7fe49c1df030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c1df030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe49800b410 tx=0x7fe49800b8d0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 shutdown_connections 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe48006ae40 0x7fe48006d300 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe49c155490 0x7fe49c150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe49c0c4080 0x7fe49c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 --2- 172.21.15.132:0/707656097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49c0c1500 0x7fe49c1df030 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 >> 172.21.15.132:0/707656097 conn(0x7fe49c06a500 msgr2=0x7fe49c151250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 shutdown_connections 2023-11-18T20:39:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.499+0000 7fe4a4451640 1 -- 172.21.15.132:0/707656097 wait complete. 2023-11-18T20:39:50.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:39:50.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.734+0000 7efcf944b640 1 Processor -- start 2023-11-18T20:39:50.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.735+0000 7efcf944b640 1 -- start start 2023-11-18T20:39:50.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.736+0000 7efcf944b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf4155d40 0x7efcf40c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.736+0000 7efcf944b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40c8510 con 0x7efcf40c6c60 2023-11-18T20:39:50.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.736+0000 7efcf944b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40c5ea0 con 0x7efcf40c7a20 2023-11-18T20:39:50.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.736+0000 7efcf944b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c5cc0 con 0x7efcf4155d40 2023-11-18T20:39:50.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.737+0000 7efcf37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7efcf40c6c60 0x7efcf40a6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54012/0 (socket says 172.21.15.132:54012) 2023-11-18T20:39:50.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.737+0000 7efcf37fe640 1 -- 172.21.15.132:0/4159614314 learned_addr learned my addr 172.21.15.132:0/4159614314 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.737+0000 7efcf27fc640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf4155d40 0x7efcf40c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.737+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212320449 0 0) 0x7efcf40c8510 con 0x7efcf40c6c60 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.737+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce0003520 con 0x7efcf40c6c60 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 752457469 0 0) 0x7efce0003520 con 0x7efcf40c6c60 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf4155d40 msgr2=0x7efcf40c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf4155d40 0x7efcf40c1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 >> v1:172.21.15.161:6789/0 conn(0x7efcf40c7a20 legacy=0x7efcf40c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40c6180 con 0x7efcf40c6c60 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7efcec001670 con 0x7efcf40c6c60 2023-11-18T20:39:50.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 >> v1:172.21.15.132:6789/0 conn(0x7efcf40c6c60 legacy=0x7efcf40a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf4155d40 0x7efce00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce0003f70 0x7efce00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efce0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c5cc0 con 0x7efce0004d00 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce000bac0 con 0x7efce0003f70 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce000bc80 con 0x7efcf4155d40 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf37fe640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efce0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.738+0000 7efcf37fe640 1 -- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf4155d40 msgr2=0x7efce00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.739+0000 7efcf37fe640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf4155d40 0x7efce00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.739+0000 7efcf37fe640 1 -- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce0003f70 msgr2=0x7efce00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.739+0000 7efcf27fc640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce0003f70 0x7efce00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.739+0000 7efcf37fe640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efce0003f70 0x7efce00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.739+0000 7efcf37fe640 1 -- 172.21.15.132:0/4159614314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0003520 con 0x7efce0004d00 2023-11-18T20:39:50.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.740+0000 7efcf37fe640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efce0005180 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c0e0 tx=0x7efce00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d6621cda2d9ad2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.740+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec005ad0 con 0x7efce0004d00 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.740+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec005c30 con 0x7efce0004d00 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.740+0000 7efcf1ffb640 1 -- 172.21.15.132:0/4159614314 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec02ca50 con 0x7efce0004d00 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.740+0000 7efcf944b640 1 -- 172.21.15.132:0/4159614314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 msgr2=0x7efce0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.740+0000 7efcf944b640 1 --2- 172.21.15.132:0/4159614314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efce0005180 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c0e0 tx=0x7efce00057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.740+0000 7efcf37fe640 1 -- 172.21.15.132:0/4159614314 reap_dead start 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.741+0000 7efcf944b640 1 -- 172.21.15.132:0/4159614314 shutdown_connections 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.741+0000 7efcf944b640 1 -- 172.21.15.132:0/4159614314 >> 172.21.15.132:0/4159614314 conn(0x7efcf40a9b70 msgr2=0x7efcf40a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.741+0000 7efcf944b640 1 -- 172.21.15.132:0/4159614314 shutdown_connections 2023-11-18T20:39:50.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.741+0000 7efcf944b640 1 -- 172.21.15.132:0/4159614314 wait complete. 2023-11-18T20:39:50.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.742+0000 7efcf944b640 1 Processor -- start 2023-11-18T20:39:50.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.742+0000 7efcf944b640 1 -- start start 2023-11-18T20:39:50.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.743+0000 7efcf944b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efcf4152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.743+0000 7efcf944b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf406fc90 0x7efcf4148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.743+0000 7efcf944b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41490b0 0x7efcf41ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.743+0000 7efcf944b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4151070 con 0x7efce0004d00 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.743+0000 7efcf944b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41e77c0 con 0x7efcf41490b0 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.743+0000 7efcf944b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf414de90 con 0x7efcf406fc90 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efcf4152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efcf4152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49350/0 (socket says 172.21.15.132:49350) 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 -- 172.21.15.132:0/3586783336 learned_addr learned my addr 172.21.15.132:0/3586783336 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf27fc640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf406fc90 0x7efcf4148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 -- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf406fc90 msgr2=0x7efcf4148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf406fc90 0x7efcf4148b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 -- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41490b0 msgr2=0x7efcf41ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41490b0 0x7efcf41ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 -- 172.21.15.132:0/3586783336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4152040 con 0x7efce0004d00 2023-11-18T20:39:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.744+0000 7efcf2ffd640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efcf4152460 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c450 tx=0x7efcdc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.745+0000 7efceb7fe640 1 -- 172.21.15.132:0/3586783336 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0052d0 con 0x7efce0004d00 2023-11-18T20:39:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.745+0000 7efceb7fe640 1 -- 172.21.15.132:0/3586783336 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc005430 con 0x7efce0004d00 2023-11-18T20:39:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.745+0000 7efceb7fe640 1 -- 172.21.15.132:0/3586783336 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc003830 con 0x7efce0004d00 2023-11-18T20:39:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.745+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf41ea8d0 con 0x7efce0004d00 2023-11-18T20:39:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.745+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf414e3c0 con 0x7efce0004d00 2023-11-18T20:39:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.746+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf414e580 con 0x7efce0004d00 2023-11-18T20:39:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.747+0000 7efceb7fe640 1 -- 172.21.15.132:0/3586783336 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcdc003990 con 0x7efce0004d00 2023-11-18T20:39:50.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.748+0000 7efceb7fe640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efcd406ae40 0x7efcd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:50.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.748+0000 7efceb7fe640 1 -- 172.21.15.132:0/3586783336 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7efcdc088fe0 con 0x7efce0004d00 2023-11-18T20:39:50.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.749+0000 7efcf27fc640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efcd406ae40 0x7efcd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:50.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.750+0000 7efcf27fc640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efcd406ae40 0x7efcd406d300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efcf414d720 tx=0x7efce400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:50.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.752+0000 7efceb7fe640 1 -- 172.21.15.132:0/3586783336 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcdc053c80 con 0x7efce0004d00 2023-11-18T20:39:50.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.947+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efcf4068350 con 0x7efce0004d00 2023-11-18T20:39:50.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.948+0000 7efceb7fe640 1 -- 172.21.15.132:0/3586783336 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7efcdc0170a0 con 0x7efce0004d00 2023-11-18T20:39:50.949 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:50.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.950+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efcd406ae40 msgr2=0x7efcd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.950+0000 7efcf944b640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efcd406ae40 0x7efcd406d300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efcf414d720 tx=0x7efce400b040 comp rx=0 tx=0).stop 2023-11-18T20:39:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.950+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 msgr2=0x7efcf4152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.950+0000 7efcf944b640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efcf4152460 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c450 tx=0x7efcdc00c910 comp rx=0 tx=0).stop 2023-11-18T20:39:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.950+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 shutdown_connections 2023-11-18T20:39:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.950+0000 7efcf944b640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efcd406ae40 0x7efcd406d300 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.950+0000 7efcf944b640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcf41490b0 0x7efcf41ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.950+0000 7efcf944b640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efcf406fc90 0x7efcf4148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.951+0000 7efcf944b640 1 --2- 172.21.15.132:0/3586783336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce0004d00 0x7efcf4152460 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.951+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 >> 172.21.15.132:0/3586783336 conn(0x7efcf40a9b70 msgr2=0x7efcf40ab270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.951+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 shutdown_connections 2023-11-18T20:39:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:50.951+0000 7efcf944b640 1 -- 172.21.15.132:0/3586783336 wait complete. 2023-11-18T20:39:50.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:39:51.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.183+0000 7f2172790640 1 Processor -- start 2023-11-18T20:39:51.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.183+0000 7f2172790640 1 -- start start 2023-11-18T20:39:51.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f2172790640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f216c0c5ec0 0x7f216c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f2172790640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0721a0 0x7f216c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f2172790640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0bfdc0 con 0x7f216c0c45d0 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f2172790640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c06e390 con 0x7f216c0c5ec0 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f2172790640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c06ddd0 con 0x7f216c0721a0 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f216bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f216c0c5ec0 0x7f216c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f216bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f216c0c5ec0 0x7f216c0c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49364/0 (socket says 172.21.15.132:49364) 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f216bfff640 1 -- 172.21.15.132:0/4015419353 learned_addr learned my addr 172.21.15.132:0/4015419353 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f2170d2d640 1 --2- 172.21.15.132:0/4015419353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0721a0 0x7f216c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f216bfff640 1 -- 172.21.15.132:0/4015419353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0721a0 msgr2=0x7f216c0c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f216bfff640 1 --2- 172.21.15.132:0/4015419353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0721a0 0x7f216c0c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.185+0000 7f216bfff640 1 -- 172.21.15.132:0/4015419353 >> v1:172.21.15.161:6789/0 conn(0x7f216c0c45d0 legacy=0x7f216c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:51.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.186+0000 7f216bfff640 1 -- 172.21.15.132:0/4015419353 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c06e0b0 con 0x7f216c0c5ec0 2023-11-18T20:39:51.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.187+0000 7f216bfff640 1 --2- 172.21.15.132:0/4015419353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0c5ec0 0x7f216c0c2c30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f215c0098a0 tx=0x7f215c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfa7dbd44c2bcd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:51.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.187+0000 7f216b7fe640 1 -- 172.21.15.132:0/4015419353 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c031520 con 0x7f216c0c5ec0 2023-11-18T20:39:51.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.187+0000 7f216b7fe640 1 -- 172.21.15.132:0/4015419353 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c031680 con 0x7f216c0c5ec0 2023-11-18T20:39:51.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.187+0000 7f216b7fe640 1 -- 172.21.15.132:0/4015419353 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c031a10 con 0x7f216c0c5ec0 2023-11-18T20:39:51.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.188+0000 7f2172790640 1 -- 172.21.15.132:0/4015419353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0c5ec0 msgr2=0x7f216c0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.188+0000 7f2172790640 1 --2- 172.21.15.132:0/4015419353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0c5ec0 0x7f216c0c2c30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f215c0098a0 tx=0x7f215c02b7c0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.188+0000 7f2172790640 1 -- 172.21.15.132:0/4015419353 shutdown_connections 2023-11-18T20:39:51.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.188+0000 7f2172790640 1 --2- 172.21.15.132:0/4015419353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0721a0 0x7f216c0c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.188+0000 7f2172790640 1 --2- 172.21.15.132:0/4015419353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0c5ec0 0x7f216c0c2c30 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.188+0000 7f2172790640 1 -- 172.21.15.132:0/4015419353 >> 172.21.15.132:0/4015419353 conn(0x7f216c06a500 msgr2=0x7f216c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:51.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.188+0000 7f2172790640 1 -- 172.21.15.132:0/4015419353 shutdown_connections 2023-11-18T20:39:51.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.188+0000 7f2172790640 1 -- 172.21.15.132:0/4015419353 wait complete. 2023-11-18T20:39:51.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.190+0000 7f2172790640 1 Processor -- start 2023-11-18T20:39:51.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.190+0000 7f2172790640 1 -- start start 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.190+0000 7f2172790640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0721a0 0x7f216c0aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.190+0000 7f2172790640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0c45d0 0x7f216c14d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.190+0000 7f2172790640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f216c0c5ec0 0x7f216c1ea740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f2172790640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c156d20 con 0x7f216c0721a0 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f2172790640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c157f30 con 0x7f216c0c5ec0 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f2172790640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c158210 con 0x7f216c0c45d0 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f216bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0721a0 0x7f216c0aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f216bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0721a0 0x7f216c0aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49372/0 (socket says 172.21.15.132:49372) 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f216bfff640 1 -- 172.21.15.132:0/4137973974 learned_addr learned my addr 172.21.15.132:0/4137973974 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f2170d2d640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f216c0c5ec0 0x7f216c1ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f2163fff640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0c45d0 0x7f216c14d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f216bfff640 1 -- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0c45d0 msgr2=0x7f216c14d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f216bfff640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0c45d0 0x7f216c14d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f216bfff640 1 -- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f216c0c5ec0 msgr2=0x7f216c1ea740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f216bfff640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f216c0c5ec0 0x7f216c1ea740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f216bfff640 1 -- 172.21.15.132:0/4137973974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c0094d0 con 0x7f216c0721a0 2023-11-18T20:39:51.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.191+0000 7f2170d2d640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f216c0c5ec0 0x7f216c1ea740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:51.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.192+0000 7f216bfff640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0721a0 0x7f216c0aa560 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f215c0098a0 tx=0x7f215c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:51.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.192+0000 7f21697fa640 1 -- 172.21.15.132:0/4137973974 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c031520 con 0x7f216c0721a0 2023-11-18T20:39:51.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.192+0000 7f21697fa640 1 -- 172.21.15.132:0/4137973974 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c033c50 con 0x7f216c0721a0 2023-11-18T20:39:51.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.192+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c1584f0 con 0x7f216c0721a0 2023-11-18T20:39:51.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.192+0000 7f21697fa640 1 -- 172.21.15.132:0/4137973974 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c03c400 con 0x7f216c0721a0 2023-11-18T20:39:51.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.192+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c158ab0 con 0x7f216c0721a0 2023-11-18T20:39:51.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.193+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c158ca0 con 0x7f216c0721a0 2023-11-18T20:39:51.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.194+0000 7f21697fa640 1 -- 172.21.15.132:0/4137973974 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f215c03a040 con 0x7f216c0721a0 2023-11-18T20:39:51.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.195+0000 7f21697fa640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f214c06ae70 0x7f214c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.195+0000 7f21697fa640 1 -- 172.21.15.132:0/4137973974 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f215c0ab220 con 0x7f216c0721a0 2023-11-18T20:39:51.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.196+0000 7f2163fff640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f214c06ae70 0x7f214c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.197+0000 7f2163fff640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f214c06ae70 0x7f214c06d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f216c06d920 tx=0x7f2154009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:51.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.199+0000 7f21697fa640 1 -- 172.21.15.132:0/4137973974 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f215c075f00 con 0x7f216c0721a0 2023-11-18T20:39:51.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.389+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f216c068350 con 0x7f216c0721a0 2023-11-18T20:39:51.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.390+0000 7f21697fa640 1 -- 172.21.15.132:0/4137973974 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v41) v1 ==== 105+0+11 (secure 0 0 0) 0x7f215c079520 con 0x7f216c0721a0 2023-11-18T20:39:51.391 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:51.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f214c06ae70 msgr2=0x7f214c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f214c06ae70 0x7f214c06d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f216c06d920 tx=0x7f2154009040 comp rx=0 tx=0).stop 2023-11-18T20:39:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0721a0 msgr2=0x7f216c0aa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0721a0 0x7f216c0aa560 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f215c0098a0 tx=0x7f215c0046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 shutdown_connections 2023-11-18T20:39:51.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f214c06ae70 0x7f214c06d330 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f216c0c5ec0 0x7f216c1ea740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f216c0c45d0 0x7f216c14d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 --2- 172.21.15.132:0/4137973974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0721a0 0x7f216c0aa560 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 >> 172.21.15.132:0/4137973974 conn(0x7f216c06a500 msgr2=0x7f216c070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:51.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.392+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 shutdown_connections 2023-11-18T20:39:51.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.393+0000 7f2172790640 1 -- 172.21.15.132:0/4137973974 wait complete. 2023-11-18T20:39:51.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:39:51.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.615+0000 7f6a162af640 1 Processor -- start 2023-11-18T20:39:51.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.616+0000 7f6a162af640 1 -- start start 2023-11-18T20:39:51.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.617+0000 7f6a162af640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a1014fd30 0x7f6a10152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.617+0000 7f6a162af640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a1006d0a0 0x7f6a100a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.617+0000 7f6a162af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100c64a0 con 0x7f6a100a5260 2023-11-18T20:39:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.617+0000 7f6a162af640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a100c5c00 con 0x7f6a1014fd30 2023-11-18T20:39:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.617+0000 7f6a162af640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100c5ee0 con 0x7f6a1006d0a0 2023-11-18T20:39:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.617+0000 7f6a1484c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6a100a5260 0x7f6a100c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54022/0 (socket says 172.21.15.132:54022) 2023-11-18T20:39:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a1484c640 1 -- 172.21.15.132:0/3393111389 learned_addr learned my addr 172.21.15.132:0/3393111389 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0ffff640 1 --2- 172.21.15.132:0/3393111389 >> v2:172.21.15.161:3300/0 conn(0x7f6a1014fd30 0x7f6a10152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a07fff640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a1006d0a0 0x7f6a100a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208612786 0 0) 0x7f6a100c64a0 con 0x7f6a100a5260 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69fc003520 con 0x7f6a100a5260 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1345756782 0 0) 0x7f69fc003520 con 0x7f6a100a5260 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a1006d0a0 msgr2=0x7f6a100a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a1006d0a0 0x7f6a100a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 >> v2:172.21.15.161:3300/0 conn(0x7f6a1014fd30 msgr2=0x7f6a10152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 --2- 172.21.15.132:0/3393111389 >> v2:172.21.15.161:3300/0 conn(0x7f6a1014fd30 0x7f6a10152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100c61c0 con 0x7f6a100a5260 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.618+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f6a080019f0 con 0x7f6a100a5260 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 >> v1:172.21.15.132:6789/0 conn(0x7f6a100a5260 legacy=0x7f6a100c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a0f7fe640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a1006d0a0 0x7f69fc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a0f7fe640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69fc003ef0 0x7f69fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a0f7fe640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69fc004d00 0x7f69fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100c5c00 con 0x7f69fc004d00 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100c5ee0 con 0x7f69fc003ef0 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc00b980 con 0x7f6a1006d0a0 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a1484c640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69fc004d00 0x7f69fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a07fff640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69fc003ef0 0x7f69fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a0ffff640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a1006d0a0 0x7f69fc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a1484c640 1 -- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a1006d0a0 msgr2=0x7f69fc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:51.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a1484c640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a1006d0a0 0x7f69fc003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a1484c640 1 -- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69fc003ef0 msgr2=0x7f69fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:51.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a1484c640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69fc003ef0 0x7f69fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a1484c640 1 -- 172.21.15.132:0/3393111389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc003520 con 0x7f69fc004d00 2023-11-18T20:39:51.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.619+0000 7f6a07fff640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69fc003ef0 0x7f69fc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:51.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.620+0000 7f6a1484c640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69fc004d00 0x7f69fc005180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800a860 tx=0x7f69fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387c85cd0c77517f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:51.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.621+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08034630 con 0x7f69fc004d00 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.621+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0802f070 con 0x7f69fc004d00 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.621+0000 7f6a0f7fe640 1 -- 172.21.15.132:0/3393111389 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08034a30 con 0x7f69fc004d00 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.621+0000 7f6a162af640 1 -- 172.21.15.132:0/3393111389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69fc004d00 msgr2=0x7f69fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.621+0000 7f6a162af640 1 --2- 172.21.15.132:0/3393111389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69fc004d00 0x7f69fc005180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800a860 tx=0x7f69fc0057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.621+0000 7f6a1484c640 1 -- 172.21.15.132:0/3393111389 reap_dead start 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.622+0000 7f6a162af640 1 -- 172.21.15.132:0/3393111389 shutdown_connections 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.622+0000 7f6a162af640 1 -- 172.21.15.132:0/3393111389 >> 172.21.15.132:0/3393111389 conn(0x7f6a1006a500 msgr2=0x7f6a1006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.622+0000 7f6a162af640 1 -- 172.21.15.132:0/3393111389 shutdown_connections 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.622+0000 7f6a162af640 1 -- 172.21.15.132:0/3393111389 wait complete. 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.623+0000 7f6a162af640 1 Processor -- start 2023-11-18T20:39:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.624+0000 7f6a162af640 1 -- start start 2023-11-18T20:39:51.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.624+0000 7f6a162af640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69fc004d00 0x7f6a10151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.624+0000 7f6a162af640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a100a9ee0 0x7f6a100aa340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.624+0000 7f6a162af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a1014cd50 0x7f6a1014d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.624+0000 7f6a162af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10155ba0 con 0x7f6a1014cd50 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.624+0000 7f6a162af640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100a9600 con 0x7f6a100a9ee0 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.624+0000 7f6a162af640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100a8a30 con 0x7f69fc004d00 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a1014cd50 0x7f6a1014d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a1014cd50 0x7f6a1014d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49398/0 (socket says 172.21.15.132:49398) 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 -- 172.21.15.132:0/2997672433 learned_addr learned my addr 172.21.15.132:0/2997672433 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a0ffff640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69fc004d00 0x7f6a10151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a07fff640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a100a9ee0 0x7f6a100aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 -- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69fc004d00 msgr2=0x7f6a10151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69fc004d00 0x7f6a10151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 -- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a100a9ee0 msgr2=0x7f6a100aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a100a9ee0 0x7f6a100aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 -- 172.21.15.132:0/2997672433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100a8cd0 con 0x7f6a1014cd50 2023-11-18T20:39:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a07fff640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a100a9ee0 0x7f6a100aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:51.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.625+0000 7f6a1484c640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a1014cd50 0x7f6a1014d1d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6a0802cbf0 tx=0x7f6a08001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:51.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.626+0000 7f6a0d7fa640 1 -- 172.21.15.132:0/2997672433 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08034840 con 0x7f6a1014cd50 2023-11-18T20:39:51.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.626+0000 7f6a0d7fa640 1 -- 172.21.15.132:0/2997672433 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080349a0 con 0x7f6a1014cd50 2023-11-18T20:39:51.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.626+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a100a8fb0 con 0x7f6a1014cd50 2023-11-18T20:39:51.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.626+0000 7f6a0d7fa640 1 -- 172.21.15.132:0/2997672433 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08034d50 con 0x7f6a1014cd50 2023-11-18T20:39:51.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.626+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1014d710 con 0x7f6a1014cd50 2023-11-18T20:39:51.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.627+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a100a97b0 con 0x7f6a1014cd50 2023-11-18T20:39:51.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.628+0000 7f6a0d7fa640 1 -- 172.21.15.132:0/2997672433 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a08031030 con 0x7f6a1014cd50 2023-11-18T20:39:51.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.629+0000 7f6a0d7fa640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f69f006ae40 0x7f69f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:51.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.629+0000 7f6a0d7fa640 1 -- 172.21.15.132:0/2997672433 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f6a080ab3b0 con 0x7f6a1014cd50 2023-11-18T20:39:51.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.629+0000 7f6a0ffff640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f69f006ae40 0x7f69f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:51.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.630+0000 7f6a0ffff640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f69f006ae40 0x7f69f006d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009990 tx=0x7f6a00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.637+0000 7f6a0d7fa640 1 -- 172.21.15.132:0/2997672433 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a100a97b0 con 0x7f6a1014cd50 2023-11-18T20:39:51.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.820+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6a100a97b0 con 0x7f6a1014cd50 2023-11-18T20:39:51.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.821+0000 7f6a0d7fa640 1 -- 172.21.15.132:0/2997672433 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v41) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6a100a97b0 con 0x7f6a1014cd50 2023-11-18T20:39:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:51.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f69f006ae40 msgr2=0x7f69f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f69f006ae40 0x7f69f006d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009990 tx=0x7f6a00008040 comp rx=0 tx=0).stop 2023-11-18T20:39:51.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a1014cd50 msgr2=0x7f6a1014d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a1014cd50 0x7f6a1014d1d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6a0802cbf0 tx=0x7f6a08001d80 comp rx=0 tx=0).stop 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 shutdown_connections 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f69f006ae40 0x7f69f006d300 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a1014cd50 0x7f6a1014d1d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a100a9ee0 0x7f6a100aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 --2- 172.21.15.132:0/2997672433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69fc004d00 0x7f6a10151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 >> 172.21.15.132:0/2997672433 conn(0x7f6a1006a500 msgr2=0x7f6a100a5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.823+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 shutdown_connections 2023-11-18T20:39:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:51.824+0000 7f6a162af640 1 -- 172.21.15.132:0/2997672433 wait complete. 2023-11-18T20:39:51.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:39:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.034+0000 7f31db59e640 1 Processor -- start 2023-11-18T20:39:52.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.034+0000 7f31db59e640 1 -- start start 2023-11-18T20:39:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.035+0000 7f31db59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31dc14e7c0 0x7f31dc0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.035+0000 7f31db59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31dc0c4c00 0x7f31dc0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31db59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31dc158a60 con 0x7f31dc0ca990 2023-11-18T20:39:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31db59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31dc0c5b10 con 0x7f31dc14e7c0 2023-11-18T20:39:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31db59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc157ca0 con 0x7f31dc0c4c00 2023-11-18T20:39:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31da59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31dc14e7c0 0x7f31dc0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31da59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31dc14e7c0 0x7f31dc0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49412/0 (socket says 172.21.15.132:49412) 2023-11-18T20:39:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31da59c640 1 -- 172.21.15.132:0/1082607916 learned_addr learned my addr 172.21.15.132:0/1082607916 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31dad9d640 1 --1- 172.21.15.132:0/1082607916 >> v1:172.21.15.132:6789/0 conn(0x7f31dc0ca990 0x7f31dc154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54038/0 (socket says 172.21.15.132:54038) 2023-11-18T20:39:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31da59c640 1 -- 172.21.15.132:0/1082607916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31dc0c4c00 msgr2=0x7f31dc0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31da59c640 1 --2- 172.21.15.132:0/1082607916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31dc0c4c00 0x7f31dc0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31da59c640 1 -- 172.21.15.132:0/1082607916 >> v1:172.21.15.132:6789/0 conn(0x7f31dc0ca990 legacy=0x7f31dc154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.036+0000 7f31da59c640 1 -- 172.21.15.132:0/1082607916 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc157f80 con 0x7f31dc14e7c0 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.037+0000 7f31da59c640 1 --2- 172.21.15.132:0/1082607916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc14e7c0 0x7f31dc0c46c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009870 tx=0x7f31cc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d110e30e131532fc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31d9d9b640 1 -- 172.21.15.132:0/1082607916 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0317c0 con 0x7f31dc14e7c0 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31d9d9b640 1 -- 172.21.15.132:0/1082607916 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc031920 con 0x7f31dc14e7c0 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31d9d9b640 1 -- 172.21.15.132:0/1082607916 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc031cb0 con 0x7f31dc14e7c0 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31db59e640 1 -- 172.21.15.132:0/1082607916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc14e7c0 msgr2=0x7f31dc0c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31db59e640 1 --2- 172.21.15.132:0/1082607916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc14e7c0 0x7f31dc0c46c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009870 tx=0x7f31cc02b860 comp rx=0 tx=0).stop 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31db59e640 1 -- 172.21.15.132:0/1082607916 shutdown_connections 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31db59e640 1 --2- 172.21.15.132:0/1082607916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31dc0c4c00 0x7f31dc0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31db59e640 1 --2- 172.21.15.132:0/1082607916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc14e7c0 0x7f31dc0c46c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31db59e640 1 -- 172.21.15.132:0/1082607916 >> 172.21.15.132:0/1082607916 conn(0x7f31dc0abf00 msgr2=0x7f31dc0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31db59e640 1 -- 172.21.15.132:0/1082607916 shutdown_connections 2023-11-18T20:39:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.038+0000 7f31db59e640 1 -- 172.21.15.132:0/1082607916 wait complete. 2023-11-18T20:39:52.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.040+0000 7f31db59e640 1 Processor -- start 2023-11-18T20:39:52.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.040+0000 7f31db59e640 1 -- start start 2023-11-18T20:39:52.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31db59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31dc0c4c00 0x7f31dc1eab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31db59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc0ca990 0x7f31dc0c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31db59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31dc14e7c0 0x7f31dc156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31db59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc14cb00 con 0x7f31dc0ca990 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31db59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc1ea6f0 con 0x7f31dc14e7c0 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31db59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc1554a0 con 0x7f31dc0c4c00 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31d3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc0ca990 0x7f31dc0c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31d3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc0ca990 0x7f31dc0c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49428/0 (socket says 172.21.15.132:49428) 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31d3fff640 1 -- 172.21.15.132:0/911538411 learned_addr learned my addr 172.21.15.132:0/911538411 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:52.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31d3fff640 1 -- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31dc0c4c00 msgr2=0x7f31dc1eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31d3fff640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31dc0c4c00 0x7f31dc1eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31d3fff640 1 -- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31dc14e7c0 msgr2=0x7f31dc156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31d3fff640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31dc14e7c0 0x7f31dc156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.041+0000 7f31d3fff640 1 -- 172.21.15.132:0/911538411 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0094d0 con 0x7f31dc0ca990 2023-11-18T20:39:52.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.042+0000 7f31d3fff640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc0ca990 0x7f31dc0c13e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f31c400b4a0 tx=0x7f31c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.042+0000 7f31d2ffd640 1 -- 172.21.15.132:0/911538411 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4010610 con 0x7f31dc0ca990 2023-11-18T20:39:52.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.042+0000 7f31d2ffd640 1 -- 172.21.15.132:0/911538411 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c4010770 con 0x7f31dc0ca990 2023-11-18T20:39:52.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.042+0000 7f31d2ffd640 1 -- 172.21.15.132:0/911538411 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4010b20 con 0x7f31dc0ca990 2023-11-18T20:39:52.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.042+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc14c2f0 con 0x7f31dc0ca990 2023-11-18T20:39:52.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.042+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc0c1920 con 0x7f31dc0ca990 2023-11-18T20:39:52.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.043+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc1ea830 con 0x7f31dc0ca990 2023-11-18T20:39:52.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.044+0000 7f31d2ffd640 1 -- 172.21.15.132:0/911538411 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31c4010c80 con 0x7f31dc0ca990 2023-11-18T20:39:52.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.045+0000 7f31d2ffd640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f31bc06ae40 0x7f31bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.045+0000 7f31d2ffd640 1 -- 172.21.15.132:0/911538411 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f31c4089640 con 0x7f31dc0ca990 2023-11-18T20:39:52.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.046+0000 7f31da59c640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f31bc06ae40 0x7f31bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.047+0000 7f31da59c640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f31bc06ae40 0x7f31bc06d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f31cc036000 tx=0x7f31cc030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.049+0000 7f31d2ffd640 1 -- 172.21.15.132:0/911538411 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31dc1ea830 con 0x7f31dc0ca990 2023-11-18T20:39:52.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.276+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31dc1ea830 con 0x7f31dc0ca990 2023-11-18T20:39:52.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.277+0000 7f31d2ffd640 1 -- 172.21.15.132:0/911538411 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6142 (secure 0 0 0) 0x7f31dc1ea830 con 0x7f31dc0ca990 2023-11-18T20:39:52.279 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:52.279 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:02.182181+0000","modified":"2023-11-18T20:39:05.261751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6834/4266315561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4266315561},{"type":"v1","addr":"172.21.15.132:6834","nonce":4266315561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:22.835223+0000","modified":"2023-11-18T20:39:25.904986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4562":{"gid":4562,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-18T20:39:52.279 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-11-18T20:39:52.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f31bc06ae40 msgr2=0x7f31bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f31bc06ae40 0x7f31bc06d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f31cc036000 tx=0x7f31cc030000 comp rx=0 tx=0).stop 2023-11-18T20:39:52.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc0ca990 msgr2=0x7f31dc0c13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc0ca990 0x7f31dc0c13e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f31c400b4a0 tx=0x7f31c400b960 comp rx=0 tx=0).stop 2023-11-18T20:39:52.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 shutdown_connections 2023-11-18T20:39:52.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f31bc06ae40 0x7f31bc06d300 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31dc14e7c0 0x7f31dc156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31dc0ca990 0x7f31dc0c13e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 --2- 172.21.15.132:0/911538411 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31dc0c4c00 0x7f31dc1eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 >> 172.21.15.132:0/911538411 conn(0x7f31dc0abf00 msgr2=0x7f31dc14d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:52.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 shutdown_connections 2023-11-18T20:39:52.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.280+0000 7f31db59e640 1 -- 172.21.15.132:0/911538411 wait complete. 2023-11-18T20:39:52.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:52.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.491+0000 7f922101f640 1 Processor -- start 2023-11-18T20:39:52.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.491+0000 7f922101f640 1 -- start start 2023-11-18T20:39:52.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.493+0000 7f922101f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 0x7f921c073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.493+0000 7f922101f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c0c4010 con 0x7f921c0a9660 2023-11-18T20:39:52.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.493+0000 7f922101f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c0ac230 con 0x7f921c0ab6c0 2023-11-18T20:39:52.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.493+0000 7f922101f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0aa480 con 0x7f921c14faf0 2023-11-18T20:39:52.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.493+0000 7f921a59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f921c0a9660 0x7f921c0aafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54050/0 (socket says 172.21.15.132:54050) 2023-11-18T20:39:52.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.493+0000 7f921a59c640 1 -- 172.21.15.132:0/2890456662 learned_addr learned my addr 172.21.15.132:0/2890456662 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:52.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.493+0000 7f921ad9d640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 0x7f921c073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.493+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683108767 0 0) 0x7f921c0c4010 con 0x7f921c0a9660 2023-11-18T20:39:52.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9204003520 con 0x7f921c0a9660 2023-11-18T20:39:52.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 316544546 0 0) 0x7f9204003520 con 0x7f921c0a9660 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 msgr2=0x7f921c073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 0x7f921c073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 >> v1:172.21.15.161:6789/0 conn(0x7f921c0ab6c0 legacy=0x7f921c15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0c2a40 con 0x7f921c0a9660 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f9210001670 con 0x7f921c0a9660 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f921ad9d640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 0x7f921c073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 >> v1:172.21.15.132:6789/0 conn(0x7f921c0a9660 legacy=0x7f921c0aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040039a0 0x7f9204003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 0x7f92040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f9204005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920400bb10 con 0x7f9204004d00 2023-11-18T20:39:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920400bc50 con 0x7f92040039a0 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920400bde0 con 0x7f921c14faf0 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.494+0000 7f921b59e640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f9204005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.495+0000 7f921ad9d640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040039a0 0x7f9204003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.495+0000 7f921a59c640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 0x7f92040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.495+0000 7f921b59e640 1 -- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 msgr2=0x7f92040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.495+0000 7f921b59e640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14faf0 0x7f92040047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.495+0000 7f921b59e640 1 -- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040039a0 msgr2=0x7f9204003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.495+0000 7f921b59e640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040039a0 0x7f9204003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.495+0000 7f921b59e640 1 -- 172.21.15.132:0/2890456662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9204003520 con 0x7f9204004d00 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.496+0000 7f921b59e640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f9204005180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9214001e50 tx=0x7f92040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c43c8c77b57d777 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.496+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214003b70 con 0x7f9204004d00 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.496+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9214003cd0 con 0x7f9204004d00 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.496+0000 7f9219d9b640 1 -- 172.21.15.132:0/2890456662 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214005310 con 0x7f9204004d00 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.497+0000 7f922101f640 1 -- 172.21.15.132:0/2890456662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 msgr2=0x7f9204005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.497+0000 7f922101f640 1 --2- 172.21.15.132:0/2890456662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f9204005180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9214001e50 tx=0x7f92040057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.497+0000 7f921b59e640 1 -- 172.21.15.132:0/2890456662 reap_dead start 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.497+0000 7f922101f640 1 -- 172.21.15.132:0/2890456662 shutdown_connections 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.497+0000 7f922101f640 1 -- 172.21.15.132:0/2890456662 >> 172.21.15.132:0/2890456662 conn(0x7f921c0c30b0 msgr2=0x7f921c0c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.497+0000 7f922101f640 1 -- 172.21.15.132:0/2890456662 shutdown_connections 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.497+0000 7f922101f640 1 -- 172.21.15.132:0/2890456662 wait complete. 2023-11-18T20:39:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.499+0000 7f922101f640 1 Processor -- start 2023-11-18T20:39:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.499+0000 7f922101f640 1 -- start start 2023-11-18T20:39:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f922101f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f921c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f922101f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14b240 0x7f921c071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f922101f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f921c1ed290 0x7f921c149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f922101f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c070820 con 0x7f9204004d00 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f922101f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c070b00 con 0x7f921c1ed290 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f922101f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c070de0 con 0x7f921c14b240 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f921ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f921c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f921ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f921c0718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49448/0 (socket says 172.21.15.132:49448) 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f921ad9d640 1 -- 172.21.15.132:0/2393315323 learned_addr learned my addr 172.21.15.132:0/2393315323 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f921ad9d640 1 -- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14b240 msgr2=0x7f921c071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f921ad9d640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14b240 0x7f921c071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f921ad9d640 1 -- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f921c1ed290 msgr2=0x7f921c149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f921ad9d640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f921c1ed290 0x7f921c149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.500+0000 7f921ad9d640 1 -- 172.21.15.132:0/2393315323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0710c0 con 0x7f9204004d00 2023-11-18T20:39:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.501+0000 7f921ad9d640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f921c0718c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f920c010860 tx=0x7f920c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.501+0000 7f92037fe640 1 -- 172.21.15.132:0/2393315323 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c00cac0 con 0x7f9204004d00 2023-11-18T20:39:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.501+0000 7f92037fe640 1 -- 172.21.15.132:0/2393315323 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c00cc20 con 0x7f9204004d00 2023-11-18T20:39:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.501+0000 7f92037fe640 1 -- 172.21.15.132:0/2393315323 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c010e50 con 0x7f9204004d00 2023-11-18T20:39:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.501+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c0713a0 con 0x7f9204004d00 2023-11-18T20:39:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.501+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c14a4b0 con 0x7f9204004d00 2023-11-18T20:39:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.502+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c068350 con 0x7f9204004d00 2023-11-18T20:39:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.503+0000 7f92037fe640 1 -- 172.21.15.132:0/2393315323 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f920c015470 con 0x7f9204004d00 2023-11-18T20:39:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.504+0000 7f92037fe640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f920806ae70 0x7f920806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.504+0000 7f92037fe640 1 -- 172.21.15.132:0/2393315323 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f920c089f30 con 0x7f9204004d00 2023-11-18T20:39:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.505+0000 7f921a59c640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f920806ae70 0x7f920806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.506+0000 7f921a59c640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f920806ae70 0x7f920806d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f921c14adf0 tx=0x7f9210009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.508+0000 7f92037fe640 1 -- 172.21.15.132:0/2393315323 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f920c054b70 con 0x7f9204004d00 2023-11-18T20:39:52.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.699+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f921c0c1430 con 0x7f9204004d00 2023-11-18T20:39:52.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.701+0000 7f92037fe640 1 -- 172.21.15.132:0/2393315323 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+20678 (secure 0 0 0) 0x7f920c058190 con 0x7f9204004d00 2023-11-18T20:39:52.703 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:52.703 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":41,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:46.561578+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:52.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f920806ae70 msgr2=0x7f920806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f920806ae70 0x7f920806d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f921c14adf0 tx=0x7f9210009040 comp rx=0 tx=0).stop 2023-11-18T20:39:52.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 msgr2=0x7f921c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f921c0718c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f920c010860 tx=0x7f920c010d20 comp rx=0 tx=0).stop 2023-11-18T20:39:52.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 shutdown_connections 2023-11-18T20:39:52.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f920806ae70 0x7f920806d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f921c1ed290 0x7f921c149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f921c14b240 0x7f921c071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 --2- 172.21.15.132:0/2393315323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9204004d00 0x7f921c0718c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 >> 172.21.15.132:0/2393315323 conn(0x7f921c0c30b0 msgr2=0x7f921c06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:52.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 shutdown_connections 2023-11-18T20:39:52.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.704+0000 7f922101f640 1 -- 172.21.15.132:0/2393315323 wait complete. 2023-11-18T20:39:52.724 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-18T20:39:52.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:39:52.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.916+0000 7fb4eea83640 1 Processor -- start 2023-11-18T20:39:52.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.916+0000 7fb4eea83640 1 -- start start 2023-11-18T20:39:52.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.917+0000 7fb4eea83640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e80c45d0 0x7fb4e8155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.918+0000 7fb4eea83640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e80bfdc0 con 0x7fb4e80c5ec0 2023-11-18T20:39:52.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.918+0000 7fb4eea83640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e8156a80 con 0x7fb4e80c3340 2023-11-18T20:39:52.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.918+0000 7fb4eea83640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e806e390 con 0x7fb4e80c45d0 2023-11-18T20:39:52.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.918+0000 7fb4ec81f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb4e80c5ec0 0x7fb4e80c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54054/0 (socket says 172.21.15.132:54054) 2023-11-18T20:39:52.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.918+0000 7fb4ec81f640 1 -- 172.21.15.132:0/3629003900 learned_addr learned my addr 172.21.15.132:0/3629003900 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:52.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.918+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064129397 0 0) 0x7fb4e80bfdc0 con 0x7fb4e80c5ec0 2023-11-18T20:39:52.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.918+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e80c45d0 0x7fb4e8155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.918+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d8003520 con 0x7fb4e80c5ec0 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 562805935 0 0) 0x7fb4d8003520 con 0x7fb4e80c5ec0 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e80c45d0 msgr2=0x7fb4e8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e80c45d0 0x7fb4e8155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 >> v1:172.21.15.161:6789/0 conn(0x7fb4e80c3340 legacy=0x7fb4e8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e806ddd0 con 0x7fb4e80c5ec0 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fb4dc001670 con 0x7fb4e80c5ec0 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 >> v1:172.21.15.132:6789/0 conn(0x7fb4e80c5ec0 legacy=0x7fb4e80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4d80039a0 0x7fb4d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e80c45d0 0x7fb4d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e806e390 con 0x7fb4d8004d00 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800bb90 con 0x7fb4d80039a0 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800bd50 con 0x7fb4e80c45d0 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.919+0000 7fb4ed020640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.920+0000 7fb4ec81f640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4d80039a0 0x7fb4d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.920+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e80c45d0 0x7fb4d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.920+0000 7fb4ed020640 1 -- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e80c45d0 msgr2=0x7fb4d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.920+0000 7fb4ed020640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e80c45d0 0x7fb4d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.920+0000 7fb4ed020640 1 -- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4d80039a0 msgr2=0x7fb4d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.920+0000 7fb4ed020640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4d80039a0 0x7fb4d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.920+0000 7fb4ed020640 1 -- 172.21.15.132:0/3629003900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d8003520 con 0x7fb4d8004d00 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.921+0000 7fb4ed020640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4d8005180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0001e50 tx=0x7fb4d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a516bf58dc804f9c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.921+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0003b70 con 0x7fb4d8004d00 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.921+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e0003cd0 con 0x7fb4d8004d00 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.921+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3629003900 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0005310 con 0x7fb4d8004d00 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.922+0000 7fb4eea83640 1 -- 172.21.15.132:0/3629003900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 msgr2=0x7fb4d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.922+0000 7fb4eea83640 1 --2- 172.21.15.132:0/3629003900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4d8005180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0001e50 tx=0x7fb4d80057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.922+0000 7fb4ed020640 1 -- 172.21.15.132:0/3629003900 reap_dead start 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.922+0000 7fb4eea83640 1 -- 172.21.15.132:0/3629003900 shutdown_connections 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.922+0000 7fb4eea83640 1 -- 172.21.15.132:0/3629003900 >> 172.21.15.132:0/3629003900 conn(0x7fb4e806a500 msgr2=0x7fb4e806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:52.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.922+0000 7fb4eea83640 1 -- 172.21.15.132:0/3629003900 shutdown_connections 2023-11-18T20:39:52.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.922+0000 7fb4eea83640 1 -- 172.21.15.132:0/3629003900 wait complete. 2023-11-18T20:39:52.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.924+0000 7fb4eea83640 1 Processor -- start 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.924+0000 7fb4eea83640 1 -- start start 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4eea83640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4e80a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4eea83640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e81ea620 0x7fb4e814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4eea83640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e81588c0 0x7fb4e81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4eea83640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c0c40 con 0x7fb4d8004d00 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4eea83640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8150a20 con 0x7fb4e81ea620 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4eea83640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e81eab20 con 0x7fb4e81588c0 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4ec81f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4e80a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4ec81f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4e80a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49474/0 (socket says 172.21.15.132:49474) 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4ec81f640 1 -- 172.21.15.132:0/1706978059 learned_addr learned my addr 172.21.15.132:0/1706978059 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:52.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4ec81f640 1 -- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e81588c0 msgr2=0x7fb4e81504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4ec81f640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e81588c0 0x7fb4e81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4ec81f640 1 -- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e81ea620 msgr2=0x7fb4e814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4ec81f640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e81ea620 0x7fb4e814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.925+0000 7fb4ec81f640 1 -- 172.21.15.132:0/1706978059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8157b40 con 0x7fb4d8004d00 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.926+0000 7fb4ec81f640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4e80a9ff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e730 tx=0x7fb4dc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.926+0000 7fb4e57fa640 1 -- 172.21.15.132:0/1706978059 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00ee40 con 0x7fb4d8004d00 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.926+0000 7fb4e57fa640 1 -- 172.21.15.132:0/1706978059 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00c850 con 0x7fb4d8004d00 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.926+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e8157e20 con 0x7fb4d8004d00 2023-11-18T20:39:52.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.926+0000 7fb4e57fa640 1 -- 172.21.15.132:0/1706978059 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00cc00 con 0x7fb4d8004d00 2023-11-18T20:39:52.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.926+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e80a8ae0 con 0x7fb4d8004d00 2023-11-18T20:39:52.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.927+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e8068350 con 0x7fb4d8004d00 2023-11-18T20:39:52.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.928+0000 7fb4e57fa640 1 -- 172.21.15.132:0/1706978059 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4dc01d460 con 0x7fb4d8004d00 2023-11-18T20:39:52.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.929+0000 7fb4e57fa640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4cc06ae40 0x7fb4cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:52.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.929+0000 7fb4e57fa640 1 -- 172.21.15.132:0/1706978059 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fb4dc089960 con 0x7fb4d8004d00 2023-11-18T20:39:52.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.929+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4cc06ae40 0x7fb4cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:52.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.930+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4cc06ae40 0x7fb4cc06d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80c44a0 tx=0x7fb4d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:52.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:52.933+0000 7fb4e57fa640 1 -- 172.21.15.132:0/1706978059 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4dc0580d0 con 0x7fb4d8004d00 2023-11-18T20:39:53.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.142+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4e80bfa00 con 0x7fb4d8004d00 2023-11-18T20:39:53.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.144+0000 7fb4e57fa640 1 -- 172.21.15.132:0/1706978059 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6142 (secure 0 0 0) 0x7fb4dc057c60 con 0x7fb4d8004d00 2023-11-18T20:39:53.145 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:53.145 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:02.182181+0000","modified":"2023-11-18T20:39:05.261751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6834/4266315561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4266315561},{"type":"v1","addr":"172.21.15.132:6834","nonce":4266315561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:22.835223+0000","modified":"2023-11-18T20:39:25.904986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4562":{"gid":4562,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-18T20:39:53.145 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-11-18T20:39:53.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4cc06ae40 msgr2=0x7fb4cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4cc06ae40 0x7fb4cc06d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80c44a0 tx=0x7fb4d4008040 comp rx=0 tx=0).stop 2023-11-18T20:39:53.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 msgr2=0x7fb4e80a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4e80a9ff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e730 tx=0x7fb4dc00ebf0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 shutdown_connections 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb4cc06ae40 0x7fb4cc06d300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4e81588c0 0x7fb4e81504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4e81ea620 0x7fb4e814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 --2- 172.21.15.132:0/1706978059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d8004d00 0x7fb4e80a9ff0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 >> 172.21.15.132:0/1706978059 conn(0x7fb4e806a500 msgr2=0x7fb4e80a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 shutdown_connections 2023-11-18T20:39:53.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.148+0000 7fb4eea83640 1 -- 172.21.15.132:0/1706978059 wait complete. 2023-11-18T20:39:53.167 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:39:53.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.370+0000 7fa19e10a640 1 Processor -- start 2023-11-18T20:39:53.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.370+0000 7fa19e10a640 1 -- start start 2023-11-18T20:39:53.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.371+0000 7fa19e10a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa19814e7f0 0x7fa1980c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.371+0000 7fa19e10a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa19806cd20 0x7fa19815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.372+0000 7fa19e10a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1980a8380 con 0x7fa1980c52e0 2023-11-18T20:39:53.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.372+0000 7fa19e10a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1981510b0 con 0x7fa19806cd20 2023-11-18T20:39:53.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.372+0000 7fa19e10a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19806bf60 con 0x7fa19814e7f0 2023-11-18T20:39:53.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.372+0000 7fa19d909640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa19806cd20 0x7fa19815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.372+0000 7fa19d108640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa19814e7f0 0x7fa1980c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.372+0000 7fa19d909640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa19806cd20 0x7fa19815ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:57522/0 (socket says 172.21.15.132:57522) 2023-11-18T20:39:53.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.372+0000 7fa19d909640 1 -- 172.21.15.132:0/2459177417 learned_addr learned my addr 172.21.15.132:0/2459177417 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:53.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.373+0000 7fa19d108640 1 -- 172.21.15.132:0/2459177417 >> v2:172.21.15.161:3300/0 conn(0x7fa19806cd20 msgr2=0x7fa19815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:53.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.373+0000 7fa19d108640 1 --2- 172.21.15.132:0/2459177417 >> v2:172.21.15.161:3300/0 conn(0x7fa19806cd20 0x7fa19815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.373+0000 7fa19d108640 1 -- 172.21.15.132:0/2459177417 >> v1:172.21.15.161:6789/0 conn(0x7fa1980c52e0 legacy=0x7fa19806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.373+0000 7fa19d108640 1 -- 172.21.15.132:0/2459177417 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19806c240 con 0x7fa19814e7f0 2023-11-18T20:39:53.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.374+0000 7fa19d108640 1 --2- 172.21.15.132:0/2459177417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa19814e7f0 0x7fa1980c0440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1940097a0 tx=0x7fa19402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=858432683e041e8f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:53.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa18ffff640 1 -- 172.21.15.132:0/2459177417 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194031780 con 0x7fa19814e7f0 2023-11-18T20:39:53.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa18ffff640 1 -- 172.21.15.132:0/2459177417 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1940318e0 con 0x7fa19814e7f0 2023-11-18T20:39:53.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa18ffff640 1 -- 172.21.15.132:0/2459177417 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194031c70 con 0x7fa19814e7f0 2023-11-18T20:39:53.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa19e10a640 1 -- 172.21.15.132:0/2459177417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa19814e7f0 msgr2=0x7fa1980c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2459177417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa19814e7f0 0x7fa1980c0440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1940097a0 tx=0x7fa19402b820 comp rx=0 tx=0).stop 2023-11-18T20:39:53.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa19e10a640 1 -- 172.21.15.132:0/2459177417 shutdown_connections 2023-11-18T20:39:53.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2459177417 >> v2:172.21.15.161:3300/0 conn(0x7fa19806cd20 0x7fa19815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2459177417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa19814e7f0 0x7fa1980c0440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.375+0000 7fa19e10a640 1 -- 172.21.15.132:0/2459177417 >> 172.21.15.132:0/2459177417 conn(0x7fa1980a77f0 msgr2=0x7fa1980a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:53.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.376+0000 7fa19e10a640 1 -- 172.21.15.132:0/2459177417 shutdown_connections 2023-11-18T20:39:53.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.376+0000 7fa19e10a640 1 -- 172.21.15.132:0/2459177417 wait complete. 2023-11-18T20:39:53.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.377+0000 7fa19e10a640 1 Processor -- start 2023-11-18T20:39:53.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.377+0000 7fa19e10a640 1 -- start start 2023-11-18T20:39:53.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.378+0000 7fa19e10a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa19806cd20 0x7fa1980bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.378+0000 7fa19e10a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980c52e0 0x7fa198154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.378+0000 7fa19e10a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19814e7f0 0x7fa198147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.378+0000 7fa19e10a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980ab6b0 con 0x7fa19814e7f0 2023-11-18T20:39:53.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.378+0000 7fa19e10a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980aab70 con 0x7fa19806cd20 2023-11-18T20:39:53.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.378+0000 7fa19e10a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1980aae10 con 0x7fa1980c52e0 2023-11-18T20:39:53.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.378+0000 7fa19d909640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19814e7f0 0x7fa198147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d909640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19814e7f0 0x7fa198147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49484/0 (socket says 172.21.15.132:49484) 2023-11-18T20:39:53.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d909640 1 -- 172.21.15.132:0/2090366285 learned_addr learned my addr 172.21.15.132:0/2090366285 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:53.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19c907640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980c52e0 0x7fa198154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d108640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa19806cd20 0x7fa1980bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d909640 1 -- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980c52e0 msgr2=0x7fa198154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d909640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980c52e0 0x7fa198154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d909640 1 -- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa19806cd20 msgr2=0x7fa1980bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d909640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa19806cd20 0x7fa1980bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d909640 1 -- 172.21.15.132:0/2090366285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194009400 con 0x7fa19814e7f0 2023-11-18T20:39:53.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d108640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa19806cd20 0x7fa1980bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:53.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19d909640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19814e7f0 0x7fa198147b10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa190009400 tx=0x7fa19000e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:53.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa18dffb640 1 -- 172.21.15.132:0/2090366285 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190010040 con 0x7fa19814e7f0 2023-11-18T20:39:53.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa18dffb640 1 -- 172.21.15.132:0/2090366285 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19000b110 con 0x7fa19814e7f0 2023-11-18T20:39:53.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1980ab0f0 con 0x7fa19814e7f0 2023-11-18T20:39:53.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.379+0000 7fa18dffb640 1 -- 172.21.15.132:0/2090366285 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19000b480 con 0x7fa19814e7f0 2023-11-18T20:39:53.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.380+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1980bf620 con 0x7fa19814e7f0 2023-11-18T20:39:53.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.381+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19806fc70 con 0x7fa19814e7f0 2023-11-18T20:39:53.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.382+0000 7fa18dffb640 1 -- 172.21.15.132:0/2090366285 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa190009050 con 0x7fa19814e7f0 2023-11-18T20:39:53.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.382+0000 7fa18dffb640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa17c06ae40 0x7fa17c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.383+0000 7fa18dffb640 1 -- 172.21.15.132:0/2090366285 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fa190089aa0 con 0x7fa19814e7f0 2023-11-18T20:39:53.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.383+0000 7fa19d108640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa17c06ae40 0x7fa17c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.384+0000 7fa19d108640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa17c06ae40 0x7fa17c06d300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa194036000 tx=0x7fa19403d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:53.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.387+0000 7fa18dffb640 1 -- 172.21.15.132:0/2090366285 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa190054780 con 0x7fa19814e7f0 2023-11-18T20:39:53.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.612+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa198067d50 con 0x7fa19814e7f0 2023-11-18T20:39:53.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.615+0000 7fa18dffb640 1 -- 172.21.15.132:0/2090366285 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6142 (secure 0 0 0) 0x7fa190057da0 con 0x7fa19814e7f0 2023-11-18T20:39:53.617 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:53.617 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:02.182181+0000","modified":"2023-11-18T20:39:05.261751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6834/4266315561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4266315561},{"type":"v1","addr":"172.21.15.132:6834","nonce":4266315561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:22.835223+0000","modified":"2023-11-18T20:39:25.904986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4562":{"gid":4562,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-18T20:39:53.618 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-11-18T20:39:53.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa17c06ae40 msgr2=0x7fa17c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa17c06ae40 0x7fa17c06d300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa194036000 tx=0x7fa19403d040 comp rx=0 tx=0).stop 2023-11-18T20:39:53.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19814e7f0 msgr2=0x7fa198147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19814e7f0 0x7fa198147b10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa190009400 tx=0x7fa19000e490 comp rx=0 tx=0).stop 2023-11-18T20:39:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 shutdown_connections 2023-11-18T20:39:53.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa17c06ae40 0x7fa17c06d300 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19814e7f0 0x7fa198147b10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1980c52e0 0x7fa198154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 --2- 172.21.15.132:0/2090366285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa19806cd20 0x7fa1980bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.618+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 >> 172.21.15.132:0/2090366285 conn(0x7fa1980a77f0 msgr2=0x7fa19814f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:53.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.619+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 shutdown_connections 2023-11-18T20:39:53.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.619+0000 7fa19e10a640 1 -- 172.21.15.132:0/2090366285 wait complete. 2023-11-18T20:39:53.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:53.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.842+0000 7f11113c0640 1 Processor -- start 2023-11-18T20:39:53.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.842+0000 7f11113c0640 1 -- start start 2023-11-18T20:39:53.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.843+0000 7f11113c0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f110c06d0a0 0x7f110c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.844+0000 7f11113c0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0c64a0 con 0x7f110c14fd30 2023-11-18T20:39:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.844+0000 7f11113c0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0c5c00 con 0x7f110c0c3ea0 2023-11-18T20:39:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.844+0000 7f11113c0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c0c5ee0 con 0x7f110c06d0a0 2023-11-18T20:39:53.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.844+0000 7f110affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f110c14fd30 0x7f110c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54060/0 (socket says 172.21.15.132:54060) 2023-11-18T20:39:53.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.844+0000 7f110affd640 1 -- 172.21.15.132:0/267946332 learned_addr learned my addr 172.21.15.132:0/267946332 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:53.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.844+0000 7f110a7fc640 1 --2- 172.21.15.132:0/267946332 >> v2:172.21.15.161:3300/0 conn(0x7f110c06d0a0 0x7f110c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.844+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659765649 0 0) 0x7f110c0c64a0 con 0x7f110c14fd30 2023-11-18T20:39:53.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.844+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f4003520 con 0x7f110c14fd30 2023-11-18T20:39:53.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829301770 0 0) 0x7f10f4003520 con 0x7f110c14fd30 2023-11-18T20:39:53.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 >> v2:172.21.15.161:3300/0 conn(0x7f110c06d0a0 msgr2=0x7f110c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:53.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 --2- 172.21.15.132:0/267946332 >> v2:172.21.15.161:3300/0 conn(0x7f110c06d0a0 0x7f110c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 >> v1:172.21.15.161:6789/0 conn(0x7f110c0c3ea0 legacy=0x7f110c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0c61c0 con 0x7f110c14fd30 2023-11-18T20:39:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f10fc001670 con 0x7f110c14fd30 2023-11-18T20:39:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 >> v1:172.21.15.132:6789/0 conn(0x7f110c14fd30 legacy=0x7f110c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4003970 0x7f10f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f10f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10f4005180 0x7f10f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0c5ee0 con 0x7f10f40047c0 2023-11-18T20:39:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f400c020 con 0x7f10f4003970 2023-11-18T20:39:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f400c1e0 con 0x7f10f4005180 2023-11-18T20:39:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.845+0000 7f110a7fc640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f10f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.846+0000 7f110affd640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4003970 0x7f10f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.846+0000 7f110a7fc640 1 -- 172.21.15.132:0/267946332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10f4005180 msgr2=0x7f10f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.846+0000 7f110a7fc640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10f4005180 0x7f10f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.846+0000 7f110a7fc640 1 -- 172.21.15.132:0/267946332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4003970 msgr2=0x7f10f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:53.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.846+0000 7f110a7fc640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10f4003970 0x7f10f4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.846+0000 7f110a7fc640 1 -- 172.21.15.132:0/267946332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4003520 con 0x7f10f40047c0 2023-11-18T20:39:53.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.846+0000 7f110b7fe640 1 -- 172.21.15.132:0/267946332 reap_dead start 2023-11-18T20:39:53.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.847+0000 7f110a7fc640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f10f4004c40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1100009a90 tx=0x7f10f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d288e2b76798d7fd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:53.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.847+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110002c680 con 0x7f10f40047c0 2023-11-18T20:39:53.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.847+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110002c7e0 con 0x7f10f40047c0 2023-11-18T20:39:53.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.847+0000 7f1109ffb640 1 -- 172.21.15.132:0/267946332 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110002cb70 con 0x7f10f40047c0 2023-11-18T20:39:53.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.848+0000 7f11113c0640 1 -- 172.21.15.132:0/267946332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 msgr2=0x7f10f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.848+0000 7f11113c0640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f10f4004c40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1100009a90 tx=0x7f10f40057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.848+0000 7f11113c0640 1 -- 172.21.15.132:0/267946332 shutdown_connections 2023-11-18T20:39:53.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.848+0000 7f11113c0640 1 --2- 172.21.15.132:0/267946332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f10f4004c40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.848+0000 7f11113c0640 1 -- 172.21.15.132:0/267946332 >> 172.21.15.132:0/267946332 conn(0x7f110c06a500 msgr2=0x7f110c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.848+0000 7f11113c0640 1 -- 172.21.15.132:0/267946332 shutdown_connections 2023-11-18T20:39:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.848+0000 7f11113c0640 1 -- 172.21.15.132:0/267946332 wait complete. 2023-11-18T20:39:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.849+0000 7f11113c0640 1 Processor -- start 2023-11-18T20:39:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.850+0000 7f11113c0640 1 -- start start 2023-11-18T20:39:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.850+0000 7f11113c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f110c1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.850+0000 7f11113c0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f110c14f5a0 0x7f110c151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.850+0000 7f11113c0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f110c1edba0 0x7f110c1ee020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.850+0000 7f11113c0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1ee870 con 0x7f10f40047c0 2023-11-18T20:39:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.850+0000 7f11113c0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c150d70 con 0x7f110c1edba0 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.850+0000 7f11113c0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1527f0 con 0x7f110c14f5a0 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f110c1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f110c1514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49490/0 (socket says 172.21.15.132:49490) 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 -- 172.21.15.132:0/2170304312 learned_addr learned my addr 172.21.15.132:0/2170304312 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110a7fc640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f110c14f5a0 0x7f110c151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110b7fe640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f110c1edba0 0x7f110c1ee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 -- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f110c14f5a0 msgr2=0x7f110c151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f110c14f5a0 0x7f110c151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 -- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f110c1edba0 msgr2=0x7f110c1ee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f110c1edba0 0x7f110c1ee020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 -- 172.21.15.132:0/2170304312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c152ad0 con 0x7f10f40047c0 2023-11-18T20:39:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.851+0000 7f110affd640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f110c1514e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00d8b0 tx=0x7f10fc00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.852+0000 7f10f37fe640 1 -- 172.21.15.132:0/2170304312 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0074e0 con 0x7f10f40047c0 2023-11-18T20:39:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.852+0000 7f10f37fe640 1 -- 172.21.15.132:0/2170304312 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc007640 con 0x7f10f40047c0 2023-11-18T20:39:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.852+0000 7f10f37fe640 1 -- 172.21.15.132:0/2170304312 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0049e0 con 0x7f10f40047c0 2023-11-18T20:39:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.852+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c150fc0 con 0x7f10f40047c0 2023-11-18T20:39:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.852+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c1539a0 con 0x7f10f40047c0 2023-11-18T20:39:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.853+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c1511b0 con 0x7f10f40047c0 2023-11-18T20:39:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.854+0000 7f10f37fe640 1 -- 172.21.15.132:0/2170304312 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10fc004b40 con 0x7f10f40047c0 2023-11-18T20:39:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.854+0000 7f10f37fe640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f10f806ae40 0x7f10f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.855+0000 7f10f37fe640 1 -- 172.21.15.132:0/2170304312 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f10fc089520 con 0x7f10f40047c0 2023-11-18T20:39:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.855+0000 7f110a7fc640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f10f806ae40 0x7f10f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.856+0000 7f110a7fc640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f10f806ae40 0x7f10f806d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1100036000 tx=0x7f1100030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:53.859+0000 7f10f37fe640 1 -- 172.21.15.132:0/2170304312 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10fc054160 con 0x7f10f40047c0 2023-11-18T20:39:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.045+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f110c068350 con 0x7f10f40047c0 2023-11-18T20:39:54.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.048+0000 7f10f37fe640 1 -- 172.21.15.132:0/2170304312 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+20678 (secure 0 0 0) 0x7f10fc057780 con 0x7f10f40047c0 2023-11-18T20:39:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:54.051 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":41,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:46.561578+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:39:00.655880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T20:39:01.207461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:54.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f10f806ae40 msgr2=0x7f10f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f10f806ae40 0x7f10f806d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1100036000 tx=0x7f1100030000 comp rx=0 tx=0).stop 2023-11-18T20:39:54.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 msgr2=0x7f110c1514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f110c1514e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00d8b0 tx=0x7f10fc00dd70 comp rx=0 tx=0).stop 2023-11-18T20:39:54.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 shutdown_connections 2023-11-18T20:39:54.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f10f806ae40 0x7f10f806d300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f110c1edba0 0x7f110c1ee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f110c14f5a0 0x7f110c151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 --2- 172.21.15.132:0/2170304312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10f40047c0 0x7f110c1514e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.051+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 >> 172.21.15.132:0/2170304312 conn(0x7f110c06a500 msgr2=0x7f110c0bfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:54.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.052+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 shutdown_connections 2023-11-18T20:39:54.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.052+0000 7f11113c0640 1 -- 172.21.15.132:0/2170304312 wait complete. 2023-11-18T20:39:54.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-18T20:39:54.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.280+0000 7fb8ffb0f640 1 Processor -- start 2023-11-18T20:39:54.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.280+0000 7fb8ffb0f640 1 -- start start 2023-11-18T20:39:54.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.281+0000 7fb8ffb0f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f814fd30 0x7fb8f8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.281+0000 7fb8ffb0f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8f806d0a0 0x7fb8f80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.281+0000 7fb8ffb0f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f80c64a0 con 0x7fb8f80a5260 2023-11-18T20:39:54.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.281+0000 7fb8ffb0f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80c5c00 con 0x7fb8f806d0a0 2023-11-18T20:39:54.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.281+0000 7fb8ffb0f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c5ee0 con 0x7fb8f814fd30 2023-11-18T20:39:54.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.282+0000 7fb8fe0ac640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb8f80a5260 0x7fb8f80c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54068/0 (socket says 172.21.15.132:54068) 2023-11-18T20:39:54.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.282+0000 7fb8fe0ac640 1 -- 172.21.15.132:0/2614625328 learned_addr learned my addr 172.21.15.132:0/2614625328 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:54.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.282+0000 7fb8fd8ab640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f814fd30 0x7fb8f8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.282+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928901621 0 0) 0x7fb8f80c64a0 con 0x7fb8f80a5260 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.282+0000 7fb8fd0aa640 1 --2- 172.21.15.132:0/2614625328 >> v2:172.21.15.161:3300/0 conn(0x7fb8f806d0a0 0x7fb8f80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.282+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e4007930 con 0x7fb8f80a5260 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1839910436 0 0) 0x7fb8e4007930 con 0x7fb8f80a5260 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f814fd30 msgr2=0x7fb8f8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f814fd30 0x7fb8f8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 >> v2:172.21.15.161:3300/0 conn(0x7fb8f806d0a0 msgr2=0x7fb8f80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 --2- 172.21.15.132:0/2614625328 >> v2:172.21.15.161:3300/0 conn(0x7fb8f806d0a0 0x7fb8f80a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80c61c0 con 0x7fb8f80a5260 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fb8f00019f0 con 0x7fb8f80a5260 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 >> v1:172.21.15.132:6789/0 conn(0x7fb8f80a5260 legacy=0x7fb8f80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f814fd30 0x7fb8e4007d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e4008350 0x7fb8e4008bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8e4009590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c5c00 con 0x7fb8e4009110 2023-11-18T20:39:54.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c5ee0 con 0x7fb8e4008350 2023-11-18T20:39:54.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e400fd90 con 0x7fb8f814fd30 2023-11-18T20:39:54.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.283+0000 7fb8fe0ac640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8e4009590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.284+0000 7fb8fd8ab640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f814fd30 0x7fb8e4007d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.284+0000 7fb8fd0aa640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e4008350 0x7fb8e4008bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.284+0000 7fb8fe0ac640 1 -- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f814fd30 msgr2=0x7fb8e4007d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.284+0000 7fb8fe0ac640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f814fd30 0x7fb8e4007d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.284+0000 7fb8fe0ac640 1 -- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e4008350 msgr2=0x7fb8e4008bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.284+0000 7fb8fe0ac640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e4008350 0x7fb8e4008bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.284+0000 7fb8fe0ac640 1 -- 172.21.15.132:0/2614625328 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4007930 con 0x7fb8e4009110 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.284+0000 7fb8fd0aa640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e4008350 0x7fb8e4008bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.285+0000 7fb8fe0ac640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8e4009590 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000a7c0 tx=0x7fb8e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1feef1f4810af51 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.285+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0034630 con 0x7fb8e4009110 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.285+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f002f070 con 0x7fb8e4009110 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.285+0000 7fb8fc8a9640 1 -- 172.21.15.132:0/2614625328 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0034a30 con 0x7fb8e4009110 2023-11-18T20:39:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.286+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2614625328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 msgr2=0x7fb8e4009590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.286+0000 7fb8ffb0f640 1 --2- 172.21.15.132:0/2614625328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8e4009590 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000a7c0 tx=0x7fb8e4009c00 comp rx=0 tx=0).stop 2023-11-18T20:39:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.286+0000 7fb8fe0ac640 1 -- 172.21.15.132:0/2614625328 reap_dead start 2023-11-18T20:39:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.286+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2614625328 shutdown_connections 2023-11-18T20:39:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.286+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2614625328 >> 172.21.15.132:0/2614625328 conn(0x7fb8f806a500 msgr2=0x7fb8f806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.286+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2614625328 shutdown_connections 2023-11-18T20:39:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.286+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2614625328 wait complete. 2023-11-18T20:39:54.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.288+0000 7fb8ffb0f640 1 Processor -- start 2023-11-18T20:39:54.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.288+0000 7fb8ffb0f640 1 -- start start 2023-11-18T20:39:54.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8ffb0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8f8151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8ffb0f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f80aac70 0x7fb8f80a8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8ffb0f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f80a85a0 0x7fb8f81e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8ffb0f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f81e62d0 con 0x7fb8e4009110 2023-11-18T20:39:54.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8ffb0f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f81e65b0 con 0x7fb8f80a85a0 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8ffb0f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f81e6890 con 0x7fb8f80aac70 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8fd8ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8f8151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8fd8ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8f8151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49510/0 (socket says 172.21.15.132:49510) 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8fd8ab640 1 -- 172.21.15.132:0/2396416662 learned_addr learned my addr 172.21.15.132:0/2396416662 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8fd8ab640 1 -- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f80aac70 msgr2=0x7fb8f80a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8fd8ab640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f80aac70 0x7fb8f80a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8fd8ab640 1 -- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f80a85a0 msgr2=0x7fb8f81e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8fd8ab640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f80a85a0 0x7fb8f81e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.289+0000 7fb8fd8ab640 1 -- 172.21.15.132:0/2396416662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f81e6b70 con 0x7fb8e4009110 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.290+0000 7fb8fd8ab640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8f8151620 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4011600 tx=0x7fb8f4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.290+0000 7fb8ee7fc640 1 -- 172.21.15.132:0/2396416662 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4015870 con 0x7fb8e4009110 2023-11-18T20:39:54.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.290+0000 7fb8ee7fc640 1 -- 172.21.15.132:0/2396416662 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f40159d0 con 0x7fb8e4009110 2023-11-18T20:39:54.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.290+0000 7fb8ee7fc640 1 -- 172.21.15.132:0/2396416662 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4015d40 con 0x7fb8e4009110 2023-11-18T20:39:54.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.290+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f8151b60 con 0x7fb8e4009110 2023-11-18T20:39:54.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.290+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f81e6060 con 0x7fb8e4009110 2023-11-18T20:39:54.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.291+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f80ac060 con 0x7fb8e4009110 2023-11-18T20:39:54.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.292+0000 7fb8ee7fc640 1 -- 172.21.15.132:0/2396416662 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8f400f490 con 0x7fb8e4009110 2023-11-18T20:39:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.293+0000 7fb8ee7fc640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8dc06ae70 0x7fb8dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.293+0000 7fb8ee7fc640 1 -- 172.21.15.132:0/2396416662 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6826+0+0 (secure 0 0 0) 0x7fb8f4089e40 con 0x7fb8e4009110 2023-11-18T20:39:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.294+0000 7fb8fd0aa640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8dc06ae70 0x7fb8dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.295+0000 7fb8fd0aa640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8dc06ae70 0x7fb8dc06d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80c37d0 tx=0x7fb8e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:54.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.300+0000 7fb8ee7fc640 1 -- 172.21.15.132:0/2396416662 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8f4054a80 con 0x7fb8e4009110 2023-11-18T20:39:54.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.533+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8f8068350 con 0x7fb8e4009110 2023-11-18T20:39:54.536 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-11-18T20:39:54.534+0000 7feee5f07640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-18T20:39:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.538+0000 7fb8ee7fc640 1 -- 172.21.15.132:0/2396416662 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb8f4022090 con 0x7fb8e4009110 2023-11-18T20:39:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T20:39:54.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.540+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8dc06ae70 msgr2=0x7fb8dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.540+0000 7fb8ffb0f640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8dc06ae70 0x7fb8dc06d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80c37d0 tx=0x7fb8e8008040 comp rx=0 tx=0).stop 2023-11-18T20:39:54.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.540+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 msgr2=0x7fb8f8151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.540+0000 7fb8ffb0f640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8f8151620 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4011600 tx=0x7fb8f4011ac0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.541+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 shutdown_connections 2023-11-18T20:39:54.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.541+0000 7fb8ffb0f640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb8dc06ae70 0x7fb8dc06d330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.541+0000 7fb8ffb0f640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f80a85a0 0x7fb8f81e93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.541+0000 7fb8ffb0f640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8f80aac70 0x7fb8f80a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.541+0000 7fb8ffb0f640 1 --2- 172.21.15.132:0/2396416662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8e4009110 0x7fb8f8151620 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.541+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 >> 172.21.15.132:0/2396416662 conn(0x7fb8f806a500 msgr2=0x7fb8f814c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:54.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.541+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 shutdown_connections 2023-11-18T20:39:54.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.541+0000 7fb8ffb0f640 1 -- 172.21.15.132:0/2396416662 wait complete. 2023-11-18T20:39:54.556 INFO:tasks.ceph.mds.a.smithi132.stderr: -3385> 2023-11-18T20:39:04.603+0000 7f9cddaf5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:39:54.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-18T20:39:54.613 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-11-18T20:39:54.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.757+0000 7fd91c676640 1 Processor -- start 2023-11-18T20:39:54.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.757+0000 7fd91c676640 1 -- start start 2023-11-18T20:39:54.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.758+0000 7fd91c676640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd91414e810 0x7fd9141550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91c676640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 0x7fd9140c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91c676640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9140bd8d0 con 0x7fd9140c4e50 2023-11-18T20:39:54.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91c676640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9140c6e60 con 0x7fd91414e810 2023-11-18T20:39:54.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91c676640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd914155600 con 0x7fd9140c7e90 2023-11-18T20:39:54.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91a412640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd91414e810 0x7fd9141550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91a412640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd91414e810 0x7fd9141550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49534/0 (socket says 172.21.15.132:49534) 2023-11-18T20:39:54.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91a412640 1 -- 172.21.15.132:0/3696048834 learned_addr learned my addr 172.21.15.132:0/3696048834 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:54.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd919c11640 1 --2- 172.21.15.132:0/3696048834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 0x7fd9140c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91a412640 1 -- 172.21.15.132:0/3696048834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 msgr2=0x7fd9140c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:54.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.759+0000 7fd91a412640 1 --2- 172.21.15.132:0/3696048834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 0x7fd9140c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.760+0000 7fd91a412640 1 -- 172.21.15.132:0/3696048834 >> v1:172.21.15.161:6789/0 conn(0x7fd9140c4e50 legacy=0x7fd91406b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:54.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.760+0000 7fd91a412640 1 -- 172.21.15.132:0/3696048834 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140c70d0 con 0x7fd91414e810 2023-11-18T20:39:54.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.761+0000 7fd91a412640 1 --2- 172.21.15.132:0/3696048834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9141550c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd910009870 tx=0x7fd91002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65af1ad3ff59edd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:54.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.761+0000 7fd919410640 1 -- 172.21.15.132:0/3696048834 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100317c0 con 0x7fd91414e810 2023-11-18T20:39:54.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.761+0000 7fd919410640 1 -- 172.21.15.132:0/3696048834 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910031920 con 0x7fd91414e810 2023-11-18T20:39:54.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.761+0000 7fd919410640 1 -- 172.21.15.132:0/3696048834 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910031cb0 con 0x7fd91414e810 2023-11-18T20:39:54.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.762+0000 7fd91c676640 1 -- 172.21.15.132:0/3696048834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 msgr2=0x7fd9141550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.762+0000 7fd91c676640 1 --2- 172.21.15.132:0/3696048834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9141550c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd910009870 tx=0x7fd91002b860 comp rx=0 tx=0).stop 2023-11-18T20:39:54.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.762+0000 7fd91c676640 1 -- 172.21.15.132:0/3696048834 shutdown_connections 2023-11-18T20:39:54.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.762+0000 7fd91c676640 1 --2- 172.21.15.132:0/3696048834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 0x7fd9140c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.762+0000 7fd91c676640 1 --2- 172.21.15.132:0/3696048834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9141550c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.762+0000 7fd91c676640 1 -- 172.21.15.132:0/3696048834 >> 172.21.15.132:0/3696048834 conn(0x7fd9140ca170 msgr2=0x7fd9140ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:54.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.762+0000 7fd91c676640 1 -- 172.21.15.132:0/3696048834 shutdown_connections 2023-11-18T20:39:54.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.762+0000 7fd91c676640 1 -- 172.21.15.132:0/3696048834 wait complete. 2023-11-18T20:39:54.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.764+0000 7fd91c676640 1 Processor -- start 2023-11-18T20:39:54.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.764+0000 7fd91c676640 1 -- start start 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91c676640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9140c4e50 0x7fd9140bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91c676640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 0x7fd9140c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91c676640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9140be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91c676640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140c09d0 con 0x7fd91414e810 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91c676640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd914155d30 con 0x7fd9140c4e50 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91c676640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141ea950 con 0x7fd9140c7e90 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91ac13640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9140be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91ac13640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9140be8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49550/0 (socket says 172.21.15.132:49550) 2023-11-18T20:39:54.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91ac13640 1 -- 172.21.15.132:0/2090493137 learned_addr learned my addr 172.21.15.132:0/2090493137 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:54.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91ac13640 1 -- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 msgr2=0x7fd9140c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91ac13640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 0x7fd9140c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91a412640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9140c4e50 0x7fd9140bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91ac13640 1 -- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9140c4e50 msgr2=0x7fd9140bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91ac13640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9140c4e50 0x7fd9140bff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.765+0000 7fd91ac13640 1 -- 172.21.15.132:0/2090493137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100094d0 con 0x7fd91414e810 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.766+0000 7fd91ac13640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9140be8c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c780 tx=0x7fd90c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.766+0000 7fd90affd640 1 -- 172.21.15.132:0/2090493137 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c004b60 con 0x7fd91414e810 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.766+0000 7fd90affd640 1 -- 172.21.15.132:0/2090493137 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c00ce90 con 0x7fd91414e810 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.766+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9140bdb00 con 0x7fd91414e810 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.766+0000 7fd90affd640 1 -- 172.21.15.132:0/2090493137 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00a850 con 0x7fd91414e810 2023-11-18T20:39:54.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.766+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9140be0c0 con 0x7fd91414e810 2023-11-18T20:39:54.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.767+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd914068350 con 0x7fd91414e810 2023-11-18T20:39:54.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.768+0000 7fd90affd640 1 -- 172.21.15.132:0/2090493137 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd90c00a9b0 con 0x7fd91414e810 2023-11-18T20:39:54.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.769+0000 7fd90affd640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd8f806ae70 0x7fd8f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:54.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.770+0000 7fd90affd640 1 -- 172.21.15.132:0/2090493137 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6912+0+0 (secure 0 0 0) 0x7fd90c089db0 con 0x7fd91414e810 2023-11-18T20:39:54.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.770+0000 7fd91a412640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd8f806ae70 0x7fd8f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:54.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.771+0000 7fd91a412640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd8f806ae70 0x7fd8f806d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd910036000 tx=0x7fd91003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:54.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:54.774+0000 7fd90affd640 1 -- 172.21.15.132:0/2090493137 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd90c08e070 con 0x7fd91414e810 2023-11-18T20:39:55.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.007+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd91406ca30 con 0x7fd91414e810 2023-11-18T20:39:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.614+0000 7fd90affd640 1 -- 172.21.15.132:0/2090493137 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd90c0548a0 con 0x7fd91414e810 2023-11-18T20:39:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.619+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd8f806ae70 msgr2=0x7fd8f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.619+0000 7fd91c676640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd8f806ae70 0x7fd8f806d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd910036000 tx=0x7fd91003d040 comp rx=0 tx=0).stop 2023-11-18T20:39:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.619+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 msgr2=0x7fd9140be8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.619+0000 7fd91c676640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9140be8c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c780 tx=0x7fd90c00cc40 comp rx=0 tx=0).stop 2023-11-18T20:39:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.620+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 shutdown_connections 2023-11-18T20:39:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.620+0000 7fd91c676640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd8f806ae70 0x7fd8f806d330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.620+0000 7fd91c676640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd91414e810 0x7fd9140be8c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.620+0000 7fd91c676640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9140c7e90 0x7fd9140c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.620+0000 7fd91c676640 1 --2- 172.21.15.132:0/2090493137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9140c4e50 0x7fd9140bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.620+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 >> 172.21.15.132:0/2090493137 conn(0x7fd9140ca170 msgr2=0x7fd91414c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.620+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 shutdown_connections 2023-11-18T20:39:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.620+0000 7fd91c676640 1 -- 172.21.15.132:0/2090493137 wait complete. 2023-11-18T20:39:55.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-18T20:39:55.784 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:39:55.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:39:55.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.906+0000 7fd9a5640640 1 Processor -- start 2023-11-18T20:39:55.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.906+0000 7fd9a5640640 1 -- start start 2023-11-18T20:39:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.908+0000 7fd9a5640640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a00c2df0 0x7fd9a00c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.908+0000 7fd9a5640640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a00c3c50 con 0x7fd9a00a5420 2023-11-18T20:39:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.908+0000 7fd9a5640640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a0153280 con 0x7fd9a0152d30 2023-11-18T20:39:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.908+0000 7fd9a5640640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a006cee0 con 0x7fd9a00c2df0 2023-11-18T20:39:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.908+0000 7fd9a4e3f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd9a00a5420 0x7fd9a00c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54074/0 (socket says 172.21.15.132:54074) 2023-11-18T20:39:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.908+0000 7fd9a4e3f640 1 -- 172.21.15.132:0/904141915 learned_addr learned my addr 172.21.15.132:0/904141915 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.908+0000 7fd99ffff640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a00c2df0 0x7fd9a00c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583477808 0 0) 0x7fd9a00c3c50 con 0x7fd9a00a5420 2023-11-18T20:39:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd988003520 con 0x7fd9a00a5420 2023-11-18T20:39:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516572058 0 0) 0x7fd9a0153280 con 0x7fd9a0152d30 2023-11-18T20:39:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a00c3c50 con 0x7fd9a0152d30 2023-11-18T20:39:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 302266593 0 0) 0x7fd988003520 con 0x7fd9a00a5420 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a00c2df0 msgr2=0x7fd9a00c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a00c2df0 0x7fd9a00c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 >> v1:172.21.15.161:6789/0 conn(0x7fd9a0152d30 legacy=0x7fd9a0071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a006d180 con 0x7fd9a00a5420 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fd9980019f0 con 0x7fd9a00a5420 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 >> v1:172.21.15.132:6789/0 conn(0x7fd9a00a5420 legacy=0x7fd9a00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd988003b30 0x7fd988003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880047c0 0x7fd988004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9880051d0 0x7fd98800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a006cee0 con 0x7fd9880051d0 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98800c100 con 0x7fd988003b30 2023-11-18T20:39:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98800c2c0 con 0x7fd9880047c0 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd99ffff640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a00c2df0 0x7fd9a00c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.909+0000 7fd9a4e3f640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9880051d0 0x7fd98800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.910+0000 7fd99f7fe640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880047c0 0x7fd988004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.910+0000 7fd99ffff640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd988003b30 0x7fd988003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.910+0000 7fd9a4e3f640 1 -- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880047c0 msgr2=0x7fd988004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.910+0000 7fd9a4e3f640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880047c0 0x7fd988004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.910+0000 7fd9a4e3f640 1 -- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd988003b30 msgr2=0x7fd988003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.910+0000 7fd9a4e3f640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd988003b30 0x7fd988003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.910+0000 7fd9a4e3f640 1 -- 172.21.15.132:0/904141915 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988003520 con 0x7fd9880051d0 2023-11-18T20:39:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.910+0000 7fd99ffff640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd988003b30 0x7fd988003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:39:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.911+0000 7fd9a4e3f640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9880051d0 0x7fd98800b980 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd99800a700 tx=0x7fd9880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2008a256ad91d4a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.911+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998034630 con 0x7fd9880051d0 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.911+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99802f070 con 0x7fd9880051d0 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.911+0000 7fd99effd640 1 -- 172.21.15.132:0/904141915 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980349f0 con 0x7fd9880051d0 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.912+0000 7fd9a5640640 1 -- 172.21.15.132:0/904141915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9880051d0 msgr2=0x7fd98800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.912+0000 7fd9a5640640 1 --2- 172.21.15.132:0/904141915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9880051d0 0x7fd98800b980 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd99800a700 tx=0x7fd9880057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.912+0000 7fd9a4e3f640 1 -- 172.21.15.132:0/904141915 reap_dead start 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.912+0000 7fd9a5640640 1 -- 172.21.15.132:0/904141915 shutdown_connections 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.912+0000 7fd9a5640640 1 -- 172.21.15.132:0/904141915 >> 172.21.15.132:0/904141915 conn(0x7fd9a00c5cc0 msgr2=0x7fd9a00c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.912+0000 7fd9a5640640 1 -- 172.21.15.132:0/904141915 shutdown_connections 2023-11-18T20:39:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.912+0000 7fd9a5640640 1 -- 172.21.15.132:0/904141915 wait complete. 2023-11-18T20:39:55.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.914+0000 7fd9a5640640 1 Processor -- start 2023-11-18T20:39:55.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.915+0000 7fd9a5640640 1 -- start start 2023-11-18T20:39:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd9a5640640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880051d0 0x7fd9a014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd9a5640640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a00a5d60 0x7fd9a014daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd9a5640640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a0153860 0x7fd9a0153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd9a5640640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a00a9ef0 con 0x7fd9a00a5d60 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd9a5640640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01566d0 con 0x7fd9a0153860 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd9a5640640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01ea6d0 con 0x7fd9880051d0 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a00a5d60 0x7fd9a014daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a00a5d60 0x7fd9a014daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49580/0 (socket says 172.21.15.132:49580) 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99f7fe640 1 -- 172.21.15.132:0/987793974 learned_addr learned my addr 172.21.15.132:0/987793974 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99ffff640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880051d0 0x7fd9a014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd9a4e3f640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a0153860 0x7fd9a0153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99f7fe640 1 -- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880051d0 msgr2=0x7fd9a014e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99f7fe640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880051d0 0x7fd9a014e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99f7fe640 1 -- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a0153860 msgr2=0x7fd9a0153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99f7fe640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a0153860 0x7fd9a0153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd99f7fe640 1 -- 172.21.15.132:0/987793974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a014e440 con 0x7fd9a00a5d60 2023-11-18T20:39:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.916+0000 7fd9a4e3f640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a0153860 0x7fd9a0153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.917+0000 7fd99f7fe640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a00a5d60 0x7fd9a014daa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd99400e480 tx=0x7fd99400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.917+0000 7fd99cff9640 1 -- 172.21.15.132:0/987793974 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940052e0 con 0x7fd9a00a5d60 2023-11-18T20:39:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.917+0000 7fd99cff9640 1 -- 172.21.15.132:0/987793974 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994005460 con 0x7fd9a00a5d60 2023-11-18T20:39:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.917+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a01ea990 con 0x7fd9a00a5d60 2023-11-18T20:39:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.917+0000 7fd99cff9640 1 -- 172.21.15.132:0/987793974 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994003830 con 0x7fd9a00a5d60 2023-11-18T20:39:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.917+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a014dfe0 con 0x7fd9a00a5d60 2023-11-18T20:39:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.918+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a0067fd0 con 0x7fd9a00a5d60 2023-11-18T20:39:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.919+0000 7fd99cff9640 1 -- 172.21.15.132:0/987793974 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd994003990 con 0x7fd9a00a5d60 2023-11-18T20:39:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.920+0000 7fd99cff9640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd98c06ae40 0x7fd98c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.920+0000 7fd99cff9640 1 -- 172.21.15.132:0/987793974 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6912+0+0 (secure 0 0 0) 0x7fd994089910 con 0x7fd9a00a5d60 2023-11-18T20:39:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.921+0000 7fd99ffff640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd98c06ae40 0x7fd98c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:55.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.922+0000 7fd99ffff640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd98c06ae40 0x7fd98c06d300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00c3830 tx=0x7fd990008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:55.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:55.924+0000 7fd99cff9640 1 -- 172.21.15.132:0/987793974 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd994054520 con 0x7fd9a00a5d60 2023-11-18T20:39:56.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.113+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd9a004e840 con 0x7fd9a00a5d60 2023-11-18T20:39:56.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.634+0000 7fd99cff9640 1 -- 172.21.15.132:0/987793974 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd994057b40 con 0x7fd9a00a5d60 2023-11-18T20:39:56.636 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-11-18T20:39:56.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd98c06ae40 msgr2=0x7fd98c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:56.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd98c06ae40 0x7fd98c06d300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00c3830 tx=0x7fd990008040 comp rx=0 tx=0).stop 2023-11-18T20:39:56.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a00a5d60 msgr2=0x7fd9a014daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:56.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a00a5d60 0x7fd9a014daa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd99400e480 tx=0x7fd99400e940 comp rx=0 tx=0).stop 2023-11-18T20:39:56.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 shutdown_connections 2023-11-18T20:39:56.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd98c06ae40 0x7fd98c06d300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a0153860 0x7fd9a0153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a00a5d60 0x7fd9a014daa0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 --2- 172.21.15.132:0/987793974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9880051d0 0x7fd9a014e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 >> 172.21.15.132:0/987793974 conn(0x7fd9a00c5cc0 msgr2=0x7fd9a00a69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:56.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 shutdown_connections 2023-11-18T20:39:56.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.638+0000 7fd9a5640640 1 -- 172.21.15.132:0/987793974 wait complete. 2023-11-18T20:39:56.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-18T20:39:56.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.924+0000 7f5294f89640 1 Processor -- start 2023-11-18T20:39:56.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.924+0000 7f5294f89640 1 -- start start 2023-11-18T20:39:56.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.925+0000 7f5294f89640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5290071f70 0x7f52900c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:56.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.925+0000 7f5294f89640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52900c0980 con 0x7f529014fa80 2023-11-18T20:39:56.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.925+0000 7f5294f89640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529006c070 con 0x7f5290072530 2023-11-18T20:39:56.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.925+0000 7f5294f89640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529006d160 con 0x7f5290071f70 2023-11-18T20:39:56.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.926+0000 7f528e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f529014fa80 0x7f529006d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54090/0 (socket says 172.21.15.132:54090) 2023-11-18T20:39:56.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.926+0000 7f528e59c640 1 -- 172.21.15.132:0/2340895845 learned_addr learned my addr 172.21.15.132:0/2340895845 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:56.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.926+0000 7f528ed9d640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5290071f70 0x7f52900c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:56.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.926+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955622186 0 0) 0x7f52900c0980 con 0x7f529014fa80 2023-11-18T20:39:56.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.926+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5278003520 con 0x7f529014fa80 2023-11-18T20:39:56.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3606751795 0 0) 0x7f5278003520 con 0x7f529014fa80 2023-11-18T20:39:56.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5290071f70 msgr2=0x7f52900c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:56.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5290071f70 0x7f52900c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 >> v1:172.21.15.161:6789/0 conn(0x7f5290072530 legacy=0x7f52900c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52900c20d0 con 0x7f529014fa80 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f5280001670 con 0x7f529014fa80 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 >> v1:172.21.15.132:6789/0 conn(0x7f529014fa80 legacy=0x7f529006d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780039a0 0x7f5278003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5290071f70 0x7f52780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5278004d00 0x7f5278005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529006d160 con 0x7f52780039a0 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527800bb40 con 0x7f5278004d00 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527800bd00 con 0x7f5290071f70 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.927+0000 7f528e59c640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780039a0 0x7f5278003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:56.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.928+0000 7f528ed9d640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5278004d00 0x7f5278005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.928+0000 7f528dd9b640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5290071f70 0x7f52780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.928+0000 7f528e59c640 1 -- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5290071f70 msgr2=0x7f52780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.928+0000 7f528e59c640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5290071f70 0x7f52780047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.928+0000 7f528e59c640 1 -- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5278004d00 msgr2=0x7f5278005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.928+0000 7f528e59c640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5278004d00 0x7f5278005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.928+0000 7f528e59c640 1 -- 172.21.15.132:0/2340895845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278003520 con 0x7f52780039a0 2023-11-18T20:39:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.928+0000 7f528ed9d640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5278004d00 0x7f5278005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.929+0000 7f528e59c640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780039a0 0x7f5278003dc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f528000c0e0 tx=0x7f52780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2481f67b8eb31af2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.929+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280005ad0 con 0x7f52780039a0 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.929+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5280005c50 con 0x7f52780039a0 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.929+0000 7f528d59a640 1 -- 172.21.15.132:0/2340895845 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528002c810 con 0x7f52780039a0 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.930+0000 7f5294f89640 1 -- 172.21.15.132:0/2340895845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780039a0 msgr2=0x7f5278003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.930+0000 7f5294f89640 1 --2- 172.21.15.132:0/2340895845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780039a0 0x7f5278003dc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f528000c0e0 tx=0x7f52780057f0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.930+0000 7f528ed9d640 1 -- 172.21.15.132:0/2340895845 reap_dead start 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.930+0000 7f5294f89640 1 -- 172.21.15.132:0/2340895845 shutdown_connections 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.930+0000 7f5294f89640 1 -- 172.21.15.132:0/2340895845 >> 172.21.15.132:0/2340895845 conn(0x7f52900c5bc0 msgr2=0x7f52900c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.930+0000 7f5294f89640 1 -- 172.21.15.132:0/2340895845 shutdown_connections 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.930+0000 7f5294f89640 1 -- 172.21.15.132:0/2340895845 wait complete. 2023-11-18T20:39:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.931+0000 7f5294f89640 1 Processor -- start 2023-11-18T20:39:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.932+0000 7f5294f89640 1 -- start start 2023-11-18T20:39:56.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.932+0000 7f5294f89640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52780039a0 0x7f5290152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.932+0000 7f5294f89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5290071080 0x7f52900a5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.932+0000 7f5294f89640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52901e7e40 0x7f52901eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.932+0000 7f5294f89640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5290156160 con 0x7f5290071080 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.932+0000 7f5294f89640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900a7ea0 con 0x7f52780039a0 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.932+0000 7f5294f89640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52900a8420 con 0x7f52901e7e40 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5290071080 0x7f52900a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5290071080 0x7f52900a5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49604/0 (socket says 172.21.15.132:49604) 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 -- 172.21.15.132:0/1353314868 learned_addr learned my addr 172.21.15.132:0/1353314868 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528e59c640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52780039a0 0x7f5290152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 -- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52901e7e40 msgr2=0x7f52901eb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52901e7e40 0x7f52901eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 -- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52780039a0 msgr2=0x7f5290152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52780039a0 0x7f5290152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 -- 172.21.15.132:0/1353314868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290156400 con 0x7f5290071080 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528e59c640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52780039a0 0x7f5290152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.933+0000 7f528dd9b640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5290071080 0x7f52900a5500 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5284001eb0 tx=0x7f528400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.934+0000 7f527effd640 1 -- 172.21.15.132:0/1353314868 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284005480 con 0x7f5290071080 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.934+0000 7f527effd640 1 -- 172.21.15.132:0/1353314868 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284003610 con 0x7f5290071080 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.934+0000 7f527effd640 1 -- 172.21.15.132:0/1353314868 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284003980 con 0x7f5290071080 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.934+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52900a8140 con 0x7f5290071080 2023-11-18T20:39:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.934+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52900c00f0 con 0x7f5290071080 2023-11-18T20:39:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.935+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5290068350 con 0x7f5290071080 2023-11-18T20:39:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.936+0000 7f527effd640 1 -- 172.21.15.132:0/1353314868 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5284003ae0 con 0x7f5290071080 2023-11-18T20:39:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.937+0000 7f527effd640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f527006ae70 0x7f527006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.937+0000 7f527effd640 1 -- 172.21.15.132:0/1353314868 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6474+0+0 (secure 0 0 0) 0x7f52840897f0 con 0x7f5290071080 2023-11-18T20:39:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.937+0000 7f528e59c640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f527006ae70 0x7f527006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.938+0000 7f528e59c640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f527006ae70 0x7f527006d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5280034000 tx=0x7f5280009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:56.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:56.941+0000 7f527effd640 1 -- 172.21.15.132:0/1353314868 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5284054500 con 0x7f5290071080 2023-11-18T20:39:57.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.129+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52900c4fb0 con 0x7f5290071080 2023-11-18T20:39:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.645+0000 7f527effd640 1 -- 172.21.15.132:0/1353314868 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5284057b20 con 0x7f5290071080 2023-11-18T20:39:57.647 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-11-18T20:39:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f527006ae70 msgr2=0x7f527006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f527006ae70 0x7f527006d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5280034000 tx=0x7f5280009030 comp rx=0 tx=0).stop 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5290071080 msgr2=0x7f52900a5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5290071080 0x7f52900a5500 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5284001eb0 tx=0x7f528400d9d0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 shutdown_connections 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f527006ae70 0x7f527006d330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52901e7e40 0x7f52901eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5290071080 0x7f52900a5500 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 --2- 172.21.15.132:0/1353314868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52780039a0 0x7f5290152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 >> 172.21.15.132:0/1353314868 conn(0x7f52900c5bc0 msgr2=0x7f52900c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.650+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 shutdown_connections 2023-11-18T20:39:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.651+0000 7f5294f89640 1 -- 172.21.15.132:0/1353314868 wait complete. 2023-11-18T20:39:57.678 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:39:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.879+0000 7fe0cbd01640 1 Processor -- start 2023-11-18T20:39:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.879+0000 7fe0cbd01640 1 -- start start 2023-11-18T20:39:57.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.881+0000 7fe0cbd01640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe0c414fd30 0x7fe0c4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:57.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.881+0000 7fe0cbd01640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0c406d0a0 0x7fe0c40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:57.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.881+0000 7fe0cbd01640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c40c64a0 con 0x7fe0c40a5260 2023-11-18T20:39:57.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.881+0000 7fe0cbd01640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c40c5c00 con 0x7fe0c406d0a0 2023-11-18T20:39:57.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.881+0000 7fe0cbd01640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c40c5ee0 con 0x7fe0c414fd30 2023-11-18T20:39:57.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.881+0000 7fe0c929c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0c406d0a0 0x7fe0c40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:57.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.881+0000 7fe0ca29e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe0c40a5260 0x7fe0c40c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54094/0 (socket says 172.21.15.132:54094) 2023-11-18T20:39:57.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.881+0000 7fe0ca29e640 1 -- 172.21.15.132:0/3883948335 learned_addr learned my addr 172.21.15.132:0/3883948335 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:57.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.882+0000 7fe0c9a9d640 1 --2- 172.21.15.132:0/3883948335 >> v2:172.21.15.161:3300/0 conn(0x7fe0c414fd30 0x7fe0c4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:57.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.882+0000 7fe0c8a9b640 1 -- 172.21.15.132:0/3883948335 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380584688 0 0) 0x7fe0c40c64a0 con 0x7fe0c40a5260 2023-11-18T20:39:57.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.882+0000 7fe0c929c640 1 -- 172.21.15.132:0/3883948335 >> v2:172.21.15.161:3300/0 conn(0x7fe0c414fd30 msgr2=0x7fe0c4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:57.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.882+0000 7fe0c929c640 1 --2- 172.21.15.132:0/3883948335 >> v2:172.21.15.161:3300/0 conn(0x7fe0c414fd30 0x7fe0c4152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.882+0000 7fe0c929c640 1 -- 172.21.15.132:0/3883948335 >> v1:172.21.15.132:6789/0 conn(0x7fe0c40a5260 legacy=0x7fe0c40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:57.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.882+0000 7fe0c929c640 1 -- 172.21.15.132:0/3883948335 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40c61c0 con 0x7fe0c406d0a0 2023-11-18T20:39:57.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.883+0000 7fe0c929c640 1 --2- 172.21.15.132:0/3883948335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c406d0a0 0x7fe0c40a4d20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe0c406b200 tx=0x7fe0b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b27b5712b55f201 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:57.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.883+0000 7fe0c8a9b640 1 -- 172.21.15.132:0/3883948335 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8031830 con 0x7fe0c406d0a0 2023-11-18T20:39:57.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.883+0000 7fe0c8a9b640 1 -- 172.21.15.132:0/3883948335 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8031990 con 0x7fe0c406d0a0 2023-11-18T20:39:57.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.883+0000 7fe0c8a9b640 1 -- 172.21.15.132:0/3883948335 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8031d20 con 0x7fe0c406d0a0 2023-11-18T20:39:57.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.884+0000 7fe0cbd01640 1 -- 172.21.15.132:0/3883948335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c406d0a0 msgr2=0x7fe0c40a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:57.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.884+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/3883948335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c406d0a0 0x7fe0c40a4d20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe0c406b200 tx=0x7fe0b802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.884+0000 7fe0cbd01640 1 -- 172.21.15.132:0/3883948335 shutdown_connections 2023-11-18T20:39:57.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.884+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/3883948335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c406d0a0 0x7fe0c40a4d20 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.884+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/3883948335 >> v2:172.21.15.161:3300/0 conn(0x7fe0c414fd30 0x7fe0c4152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.884+0000 7fe0cbd01640 1 -- 172.21.15.132:0/3883948335 >> 172.21.15.132:0/3883948335 conn(0x7fe0c406a500 msgr2=0x7fe0c406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:57.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.884+0000 7fe0cbd01640 1 -- 172.21.15.132:0/3883948335 shutdown_connections 2023-11-18T20:39:57.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.884+0000 7fe0cbd01640 1 -- 172.21.15.132:0/3883948335 wait complete. 2023-11-18T20:39:57.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.885+0000 7fe0cbd01640 1 Processor -- start 2023-11-18T20:39:57.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.886+0000 7fe0cbd01640 1 -- start start 2023-11-18T20:39:57.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.886+0000 7fe0cbd01640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0c406d0a0 0x7fe0c414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:57.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.886+0000 7fe0cbd01640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0c40a5260 0x7fe0c41513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:57.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.886+0000 7fe0cbd01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c414fd30 0x7fe0c41de5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:57.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.886+0000 7fe0cbd01640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c41df4a0 con 0x7fe0c414fd30 2023-11-18T20:39:57.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.886+0000 7fe0cbd01640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c41de1b0 con 0x7fe0c40a5260 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.886+0000 7fe0cbd01640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c406acb0 con 0x7fe0c406d0a0 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c414fd30 0x7fe0c41de5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c414fd30 0x7fe0c41de5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49624/0 (socket says 172.21.15.132:49624) 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 -- 172.21.15.132:0/2172599059 learned_addr learned my addr 172.21.15.132:0/2172599059 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 -- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0c406d0a0 msgr2=0x7fe0c414c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0c406d0a0 0x7fe0c414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0c929c640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0c40a5260 0x7fe0c41513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 -- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0c40a5260 msgr2=0x7fe0c41513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0c40a5260 0x7fe0c41513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:57.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 -- 172.21.15.132:0/2172599059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8009400 con 0x7fe0c414fd30 2023-11-18T20:39:57.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.887+0000 7fe0ca29e640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c414fd30 0x7fe0c41de5d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00c7a0 tx=0x7fe0bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:57.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.888+0000 7fe0b67fc640 1 -- 172.21.15.132:0/2172599059 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00a5e0 con 0x7fe0c414fd30 2023-11-18T20:39:57.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.888+0000 7fe0b67fc640 1 -- 172.21.15.132:0/2172599059 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc00a740 con 0x7fe0c414fd30 2023-11-18T20:39:57.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.888+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c41564d0 con 0x7fe0c414fd30 2023-11-18T20:39:57.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.888+0000 7fe0b67fc640 1 -- 172.21.15.132:0/2172599059 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00ab70 con 0x7fe0c414fd30 2023-11-18T20:39:57.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.888+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c41dddd0 con 0x7fe0c414fd30 2023-11-18T20:39:57.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.889+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c41de2f0 con 0x7fe0c414fd30 2023-11-18T20:39:57.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.890+0000 7fe0b67fc640 1 -- 172.21.15.132:0/2172599059 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0bc00acd0 con 0x7fe0c414fd30 2023-11-18T20:39:57.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.891+0000 7fe0b67fc640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0a806ae40 0x7fe0a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:57.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.891+0000 7fe0b67fc640 1 -- 172.21.15.132:0/2172599059 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7fe0bc088e10 con 0x7fe0c414fd30 2023-11-18T20:39:57.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.892+0000 7fe0c9a9d640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0a806ae40 0x7fe0a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:57.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.893+0000 7fe0c9a9d640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0a806ae40 0x7fe0a806d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0006fd0 tx=0x7fe0c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:57.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:57.895+0000 7fe0b67fc640 1 -- 172.21.15.132:0/2172599059 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe0c41de2f0 con 0x7fe0c414fd30 2023-11-18T20:39:58.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.091+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0c41de2f0 con 0x7fe0c414fd30 2023-11-18T20:39:58.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.094+0000 7fe0b67fc640 1 -- 172.21.15.132:0/2172599059 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16910 (secure 0 0 0) 0x7fe0c41de2f0 con 0x7fe0c414fd30 2023-11-18T20:39:58.096 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:58.096 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":44,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:57.636585+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6834/4266315561":"2023-11-19T20:39:54.536061+0000","172.21.15.132:6832/4266315561":"2023-11-19T20:39:54.536061+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:39:58.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0a806ae40 msgr2=0x7fe0a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0a806ae40 0x7fe0a806d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0006fd0 tx=0x7fe0c0008040 comp rx=0 tx=0).stop 2023-11-18T20:39:58.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c414fd30 msgr2=0x7fe0c41de5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c414fd30 0x7fe0c41de5d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00c7a0 tx=0x7fe0bc00cc60 comp rx=0 tx=0).stop 2023-11-18T20:39:58.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 shutdown_connections 2023-11-18T20:39:58.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe0a806ae40 0x7fe0a806d300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c414fd30 0x7fe0c41de5d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0c40a5260 0x7fe0c41513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 --2- 172.21.15.132:0/2172599059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0c406d0a0 0x7fe0c414c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 >> 172.21.15.132:0/2172599059 conn(0x7fe0c406a500 msgr2=0x7fe0c40c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:58.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 shutdown_connections 2023-11-18T20:39:58.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.097+0000 7fe0cbd01640 1 -- 172.21.15.132:0/2172599059 wait complete. 2023-11-18T20:39:58.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:39:20.671493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:39:21.849411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:39:58.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:39:58.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.329+0000 7faed770f640 1 Processor -- start 2023-11-18T20:39:58.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.329+0000 7faed770f640 1 -- start start 2023-11-18T20:39:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed770f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faed014fd30 0x7faed0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed770f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed00c3ea0 0x7faed00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed770f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed00c64a0 con 0x7faed006d0a0 2023-11-18T20:39:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed770f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00c5c00 con 0x7faed014fd30 2023-11-18T20:39:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed770f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00c5ee0 con 0x7faed00c3ea0 2023-11-18T20:39:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed4caa640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7faed006d0a0 0x7faed00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54096/0 (socket says 172.21.15.132:54096) 2023-11-18T20:39:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed4caa640 1 -- 172.21.15.132:0/1477904449 learned_addr learned my addr 172.21.15.132:0/1477904449 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:39:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed54ab640 1 --2- 172.21.15.132:0/1477904449 >> v2:172.21.15.161:3300/0 conn(0x7faed014fd30 0x7faed0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.331+0000 7faed5cac640 1 --2- 172.21.15.132:0/1477904449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed00c3ea0 0x7faed00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.332+0000 7faec7fff640 1 -- 172.21.15.132:0/1477904449 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157223705 0 0) 0x7faed00c64a0 con 0x7faed006d0a0 2023-11-18T20:39:58.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.332+0000 7faec7fff640 1 -- 172.21.15.132:0/1477904449 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faebc003520 con 0x7faed006d0a0 2023-11-18T20:39:58.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.332+0000 7faed54ab640 1 -- 172.21.15.132:0/1477904449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed00c3ea0 msgr2=0x7faed00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:58.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.332+0000 7faed54ab640 1 --2- 172.21.15.132:0/1477904449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed00c3ea0 0x7faed00c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.332+0000 7faed54ab640 1 -- 172.21.15.132:0/1477904449 >> v1:172.21.15.132:6789/0 conn(0x7faed006d0a0 legacy=0x7faed00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.332+0000 7faec7fff640 1 -- 172.21.15.132:0/1477904449 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2991152460 0 0) 0x7faebc003520 con 0x7faed006d0a0 2023-11-18T20:39:58.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.332+0000 7faed54ab640 1 -- 172.21.15.132:0/1477904449 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00c61c0 con 0x7faed014fd30 2023-11-18T20:39:58.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.333+0000 7faed54ab640 1 --2- 172.21.15.132:0/1477904449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faed014fd30 0x7faed0152f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faecc0097a0 tx=0x7faecc02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=725750113b37d717 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:58.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.334+0000 7faec7fff640 1 -- 172.21.15.132:0/1477904449 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0001670 con 0x7faed014fd30 2023-11-18T20:39:58.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.334+0000 7faec7fff640 1 -- 172.21.15.132:0/1477904449 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc02e050 con 0x7faed014fd30 2023-11-18T20:39:58.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.334+0000 7faec7fff640 1 -- 172.21.15.132:0/1477904449 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc030730 con 0x7faed014fd30 2023-11-18T20:39:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.334+0000 7faed770f640 1 -- 172.21.15.132:0/1477904449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faed014fd30 msgr2=0x7faed0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.334+0000 7faed770f640 1 --2- 172.21.15.132:0/1477904449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faed014fd30 0x7faed0152f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faecc0097a0 tx=0x7faecc02b790 comp rx=0 tx=0).stop 2023-11-18T20:39:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.335+0000 7faed770f640 1 -- 172.21.15.132:0/1477904449 shutdown_connections 2023-11-18T20:39:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.335+0000 7faed770f640 1 --2- 172.21.15.132:0/1477904449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed00c3ea0 0x7faed00c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.335+0000 7faed770f640 1 --2- 172.21.15.132:0/1477904449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faed014fd30 0x7faed0152f20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.335+0000 7faed770f640 1 -- 172.21.15.132:0/1477904449 >> 172.21.15.132:0/1477904449 conn(0x7faed006a500 msgr2=0x7faed006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.335+0000 7faed770f640 1 -- 172.21.15.132:0/1477904449 shutdown_connections 2023-11-18T20:39:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.335+0000 7faed770f640 1 -- 172.21.15.132:0/1477904449 wait complete. 2023-11-18T20:39:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.337+0000 7faed770f640 1 Processor -- start 2023-11-18T20:39:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.337+0000 7faed770f640 1 -- start start 2023-11-18T20:39:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed770f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faed006d0a0 0x7faed0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed770f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faed00c3ea0 0x7faed014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed770f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed014fd30 0x7faed014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed770f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed01dc460 con 0x7faed006d0a0 2023-11-18T20:39:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed770f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed014f160 con 0x7faed00c3ea0 2023-11-18T20:39:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed770f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed01ee150 con 0x7faed014fd30 2023-11-18T20:39:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed54ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faed006d0a0 0x7faed0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed54ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faed006d0a0 0x7faed0151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49626/0 (socket says 172.21.15.132:49626) 2023-11-18T20:39:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed54ab640 1 -- 172.21.15.132:0/2697842290 learned_addr learned my addr 172.21.15.132:0/2697842290 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed54ab640 1 -- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed014fd30 msgr2=0x7faed014ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed54ab640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed014fd30 0x7faed014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed54ab640 1 -- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faed00c3ea0 msgr2=0x7faed014e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed54ab640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faed00c3ea0 0x7faed014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.338+0000 7faed54ab640 1 -- 172.21.15.132:0/2697842290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009400 con 0x7faed006d0a0 2023-11-18T20:39:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.339+0000 7faed54ab640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faed006d0a0 0x7faed0151b40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faecc0098c0 tx=0x7faecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.339+0000 7faec5ffb640 1 -- 172.21.15.132:0/2697842290 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc03c820 con 0x7faed006d0a0 2023-11-18T20:39:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.339+0000 7faec5ffb640 1 -- 172.21.15.132:0/2697842290 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc03c9a0 con 0x7faed006d0a0 2023-11-18T20:39:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.339+0000 7faec5ffb640 1 -- 172.21.15.132:0/2697842290 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc03cd50 con 0x7faed006d0a0 2023-11-18T20:39:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.339+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed01ed540 con 0x7faed006d0a0 2023-11-18T20:39:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.339+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed01edb00 con 0x7faed006d0a0 2023-11-18T20:39:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.340+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0068350 con 0x7faed006d0a0 2023-11-18T20:39:58.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.341+0000 7faec5ffb640 1 -- 172.21.15.132:0/2697842290 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faecc039070 con 0x7faed006d0a0 2023-11-18T20:39:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.342+0000 7faec5ffb640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeb406ae70 0x7faeb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.342+0000 7faec5ffb640 1 -- 172.21.15.132:0/2697842290 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7faecc0ab070 con 0x7faed006d0a0 2023-11-18T20:39:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.343+0000 7faed4caa640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeb406ae70 0x7faeb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.344+0000 7faed4caa640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeb406ae70 0x7faeb406d330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faec00011e0 tx=0x7faec0001960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:58.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.346+0000 7faec5ffb640 1 -- 172.21.15.132:0/2697842290 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faecc0dde90 con 0x7faed006d0a0 2023-11-18T20:39:58.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.537+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faed006d540 con 0x7faed006d0a0 2023-11-18T20:39:58.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.538+0000 7faec5ffb640 1 -- 172.21.15.132:0/2697842290 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7faecc076020 con 0x7faed006d0a0 2023-11-18T20:39:58.539 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeb406ae70 msgr2=0x7faeb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeb406ae70 0x7faeb406d330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faec00011e0 tx=0x7faec0001960 comp rx=0 tx=0).stop 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faed006d0a0 msgr2=0x7faed0151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faed006d0a0 0x7faed0151b40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faecc0098c0 tx=0x7faecc0046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 shutdown_connections 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeb406ae70 0x7faeb406d330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faed014fd30 0x7faed014ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faed00c3ea0 0x7faed014e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 --2- 172.21.15.132:0/2697842290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faed006d0a0 0x7faed0151b40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 >> 172.21.15.132:0/2697842290 conn(0x7faed006a500 msgr2=0x7faed00c2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:58.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 shutdown_connections 2023-11-18T20:39:58.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.541+0000 7faed770f640 1 -- 172.21.15.132:0/2697842290 wait complete. 2023-11-18T20:39:58.561 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:39:58.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.778+0000 7f9782885640 1 Processor -- start 2023-11-18T20:39:58.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.778+0000 7f9782885640 1 -- start start 2023-11-18T20:39:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.779+0000 7f9782885640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f977c0ca450 0x7f977c0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.779+0000 7f9782885640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f977c154580 0x7f977c1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782885640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c158a60 con 0x7f977c14e7c0 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782885640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0c5b10 con 0x7f977c154580 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782885640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0c4dd0 con 0x7f977c0ca450 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782084640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f977c154580 0x7f977c1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782084640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f977c154580 0x7f977c1549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38264/0 (socket says 172.21.15.132:38264) 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782084640 1 -- 172.21.15.132:0/2842301554 learned_addr learned my addr 172.21.15.132:0/2842301554 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9781082640 1 --2- 172.21.15.132:0/2842301554 >> v2:172.21.15.161:3300/0 conn(0x7f977c0ca450 0x7f977c0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782084640 1 -- 172.21.15.132:0/2842301554 >> v2:172.21.15.161:3300/0 conn(0x7f977c0ca450 msgr2=0x7f977c0ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782084640 1 --2- 172.21.15.132:0/2842301554 >> v2:172.21.15.161:3300/0 conn(0x7f977c0ca450 0x7f977c0ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782084640 1 -- 172.21.15.132:0/2842301554 >> v1:172.21.15.161:6789/0 conn(0x7f977c14e7c0 legacy=0x7f977c0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:58.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9782084640 1 -- 172.21.15.132:0/2842301554 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c157ca0 con 0x7f977c154580 2023-11-18T20:39:58.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.780+0000 7f9781082640 1 --2- 172.21.15.132:0/2842301554 >> v2:172.21.15.161:3300/0 conn(0x7f977c0ca450 0x7f977c0ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:58.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.781+0000 7f9782084640 1 --2- 172.21.15.132:0/2842301554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c154580 0x7f977c1549f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f977c0ac990 tx=0x7f977402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90601e336b3f7506 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:58.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.782+0000 7f9780881640 1 -- 172.21.15.132:0/2842301554 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977402c960 con 0x7f977c154580 2023-11-18T20:39:58.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.782+0000 7f9780881640 1 -- 172.21.15.132:0/2842301554 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977402cac0 con 0x7f977c154580 2023-11-18T20:39:58.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.782+0000 7f9780881640 1 -- 172.21.15.132:0/2842301554 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977402ce50 con 0x7f977c154580 2023-11-18T20:39:58.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.782+0000 7f9782885640 1 -- 172.21.15.132:0/2842301554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c154580 msgr2=0x7f977c1549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.782+0000 7f9782885640 1 --2- 172.21.15.132:0/2842301554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c154580 0x7f977c1549f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f977c0ac990 tx=0x7f977402bdc0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.783+0000 7f9782885640 1 -- 172.21.15.132:0/2842301554 shutdown_connections 2023-11-18T20:39:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.783+0000 7f9782885640 1 --2- 172.21.15.132:0/2842301554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c154580 0x7f977c1549f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.783+0000 7f9782885640 1 --2- 172.21.15.132:0/2842301554 >> v2:172.21.15.161:3300/0 conn(0x7f977c0ca450 0x7f977c0ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.783+0000 7f9782885640 1 -- 172.21.15.132:0/2842301554 >> 172.21.15.132:0/2842301554 conn(0x7f977c0abf00 msgr2=0x7f977c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.783+0000 7f9782885640 1 -- 172.21.15.132:0/2842301554 shutdown_connections 2023-11-18T20:39:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.783+0000 7f9782885640 1 -- 172.21.15.132:0/2842301554 wait complete. 2023-11-18T20:39:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.784+0000 7f9782885640 1 Processor -- start 2023-11-18T20:39:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.785+0000 7f9782885640 1 -- start start 2023-11-18T20:39:58.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.785+0000 7f9782885640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f977c0ca450 0x7f977c0aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.785+0000 7f9782885640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c14e7c0 0x7f977c1ea480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9782885640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f977c154580 0x7f977c1ea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9782885640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c14f1b0 con 0x7f977c14e7c0 2023-11-18T20:39:58.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9782885640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1edb20 con 0x7f977c0ca450 2023-11-18T20:39:58.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9782885640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1ede00 con 0x7f977c154580 2023-11-18T20:39:58.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781082640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c14e7c0 0x7f977c1ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781082640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c14e7c0 0x7f977c1ea480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38280/0 (socket says 172.21.15.132:38280) 2023-11-18T20:39:58.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781082640 1 -- 172.21.15.132:0/2569198709 learned_addr learned my addr 172.21.15.132:0/2569198709 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:58.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781883640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f977c0ca450 0x7f977c0aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781082640 1 -- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f977c154580 msgr2=0x7f977c1ea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781082640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f977c154580 0x7f977c1ea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781082640 1 -- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f977c0ca450 msgr2=0x7f977c0aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781082640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f977c0ca450 0x7f977c0aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.786+0000 7f9781082640 1 -- 172.21.15.132:0/2569198709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009b30 con 0x7f977c14e7c0 2023-11-18T20:39:58.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.787+0000 7f9781082640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c14e7c0 0x7f977c1ea480 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c7f0 tx=0x7f976c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:58.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.787+0000 7f97727fc640 1 -- 172.21.15.132:0/2569198709 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c007820 con 0x7f977c14e7c0 2023-11-18T20:39:58.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.787+0000 7f97727fc640 1 -- 172.21.15.132:0/2569198709 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c007980 con 0x7f977c14e7c0 2023-11-18T20:39:58.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.787+0000 7f97727fc640 1 -- 172.21.15.132:0/2569198709 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c007cf0 con 0x7f977c14e7c0 2023-11-18T20:39:58.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.787+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c1ee0e0 con 0x7f977c14e7c0 2023-11-18T20:39:58.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.787+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c0ab530 con 0x7f977c14e7c0 2023-11-18T20:39:58.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.788+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c14d700 con 0x7f977c14e7c0 2023-11-18T20:39:58.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.789+0000 7f97727fc640 1 -- 172.21.15.132:0/2569198709 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f976c0113f0 con 0x7f977c14e7c0 2023-11-18T20:39:58.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.790+0000 7f97727fc640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f976006ae40 0x7f976006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:58.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.790+0000 7f97727fc640 1 -- 172.21.15.132:0/2569198709 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7f976c089a50 con 0x7f977c14e7c0 2023-11-18T20:39:58.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.791+0000 7f9781883640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f976006ae40 0x7f976006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:58.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.792+0000 7f9781883640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f976006ae40 0x7f976006d300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f977800a730 tx=0x7f9778008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:58.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.794+0000 7f97727fc640 1 -- 172.21.15.132:0/2569198709 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f976c054a00 con 0x7f977c14e7c0 2023-11-18T20:39:58.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.982+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f977c1ee270 con 0x7f977c14e7c0 2023-11-18T20:39:58.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.984+0000 7f97727fc640 1 -- 172.21.15.132:0/2569198709 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f976c01f0b0 con 0x7f977c14e7c0 2023-11-18T20:39:58.985 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:39:58.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f976006ae40 msgr2=0x7f976006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f976006ae40 0x7f976006d300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f977800a730 tx=0x7f9778008040 comp rx=0 tx=0).stop 2023-11-18T20:39:58.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c14e7c0 msgr2=0x7f977c1ea480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:58.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c14e7c0 0x7f977c1ea480 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c7f0 tx=0x7f976c00ccb0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 shutdown_connections 2023-11-18T20:39:58.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f976006ae40 0x7f976006d300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f977c154580 0x7f977c1ea9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f977c14e7c0 0x7f977c1ea480 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 --2- 172.21.15.132:0/2569198709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f977c0ca450 0x7f977c0aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:58.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 >> 172.21.15.132:0/2569198709 conn(0x7f977c0abf00 msgr2=0x7f977c06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:58.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 shutdown_connections 2023-11-18T20:39:58.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:58.986+0000 7f9782885640 1 -- 172.21.15.132:0/2569198709 wait complete. 2023-11-18T20:39:59.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:39:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.209+0000 7f72d45fc640 1 Processor -- start 2023-11-18T20:39:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.210+0000 7f72d45fc640 1 -- start start 2023-11-18T20:39:59.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.211+0000 7f72d45fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f72cc14fd30 0x7f72cc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.211+0000 7f72d45fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72cc06d0a0 0x7f72cc0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.211+0000 7f72d45fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc0a5260 0x7f72cc0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.211+0000 7f72d45fc640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0c64a0 con 0x7f72cc06d0a0 2023-11-18T20:39:59.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.211+0000 7f72d45fc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0c5c00 con 0x7f72cc14fd30 2023-11-18T20:39:59.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.211+0000 7f72d45fc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c5ee0 con 0x7f72cc0a5260 2023-11-18T20:39:59.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.211+0000 7f72d1b97640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72cc06d0a0 0x7f72cc0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d1b97640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72cc06d0a0 0x7f72cc0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38292/0 (socket says 172.21.15.132:38292) 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d1b97640 1 -- 172.21.15.132:0/1798409127 learned_addr learned my addr 172.21.15.132:0/1798409127 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d2b99640 1 --2- 172.21.15.132:0/1798409127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc0a5260 0x7f72cc0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d2398640 1 --2- 172.21.15.132:0/1798409127 >> v2:172.21.15.161:3300/0 conn(0x7f72cc14fd30 0x7f72cc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d1b97640 1 -- 172.21.15.132:0/1798409127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc0a5260 msgr2=0x7f72cc0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d1b97640 1 --2- 172.21.15.132:0/1798409127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc0a5260 0x7f72cc0c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d1b97640 1 -- 172.21.15.132:0/1798409127 >> v2:172.21.15.161:3300/0 conn(0x7f72cc14fd30 msgr2=0x7f72cc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d1b97640 1 --2- 172.21.15.132:0/1798409127 >> v2:172.21.15.161:3300/0 conn(0x7f72cc14fd30 0x7f72cc152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d1b97640 1 -- 172.21.15.132:0/1798409127 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0c61c0 con 0x7f72cc06d0a0 2023-11-18T20:39:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.212+0000 7f72d2398640 1 --2- 172.21.15.132:0/1798409127 >> v2:172.21.15.161:3300/0 conn(0x7f72cc14fd30 0x7f72cc152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:59.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.213+0000 7f72d1b97640 1 --2- 172.21.15.132:0/1798409127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc06d0a0 0x7f72cc0a4d20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f72cc06b200 tx=0x7f72bc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9497cc6c217ebf2e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:59.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.214+0000 7f72d1396640 1 -- 172.21.15.132:0/1798409127 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc031860 con 0x7f72cc06d0a0 2023-11-18T20:39:59.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.214+0000 7f72d1396640 1 -- 172.21.15.132:0/1798409127 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0319c0 con 0x7f72cc06d0a0 2023-11-18T20:39:59.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.214+0000 7f72d1396640 1 -- 172.21.15.132:0/1798409127 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc031d50 con 0x7f72cc06d0a0 2023-11-18T20:39:59.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 -- 172.21.15.132:0/1798409127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc06d0a0 msgr2=0x7f72cc0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 --2- 172.21.15.132:0/1798409127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc06d0a0 0x7f72cc0a4d20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f72cc06b200 tx=0x7f72bc02b900 comp rx=0 tx=0).stop 2023-11-18T20:39:59.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 -- 172.21.15.132:0/1798409127 shutdown_connections 2023-11-18T20:39:59.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 --2- 172.21.15.132:0/1798409127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc0a5260 0x7f72cc0c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 --2- 172.21.15.132:0/1798409127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc06d0a0 0x7f72cc0a4d20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 --2- 172.21.15.132:0/1798409127 >> v2:172.21.15.161:3300/0 conn(0x7f72cc14fd30 0x7f72cc152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 -- 172.21.15.132:0/1798409127 >> 172.21.15.132:0/1798409127 conn(0x7f72cc06a500 msgr2=0x7f72cc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:59.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 -- 172.21.15.132:0/1798409127 shutdown_connections 2023-11-18T20:39:59.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.215+0000 7f72d45fc640 1 -- 172.21.15.132:0/1798409127 wait complete. 2023-11-18T20:39:59.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.216+0000 7f72d45fc640 1 Processor -- start 2023-11-18T20:39:59.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.217+0000 7f72d45fc640 1 -- start start 2023-11-18T20:39:59.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.217+0000 7f72d45fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc06d0a0 0x7f72cc0a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.217+0000 7f72d45fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0a5260 0x7f72cc0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d45fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72cc14fd30 0x7f72cc1dda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d45fc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1dccc0 con 0x7f72cc0a5260 2023-11-18T20:39:59.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d45fc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1dcfa0 con 0x7f72cc14fd30 2023-11-18T20:39:59.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d45fc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1dd280 con 0x7f72cc06d0a0 2023-11-18T20:39:59.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d1b97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0a5260 0x7f72cc0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d1b97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0a5260 0x7f72cc0bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38308/0 (socket says 172.21.15.132:38308) 2023-11-18T20:39:59.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d1b97640 1 -- 172.21.15.132:0/3389818975 learned_addr learned my addr 172.21.15.132:0/3389818975 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:59.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d2398640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc06d0a0 0x7f72cc0a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d1b97640 1 -- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc06d0a0 msgr2=0x7f72cc0a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d2b99640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72cc14fd30 0x7f72cc1dda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d1b97640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc06d0a0 0x7f72cc0a9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d1b97640 1 -- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72cc14fd30 msgr2=0x7f72cc1dda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d1b97640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72cc14fd30 0x7f72cc1dda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d1b97640 1 -- 172.21.15.132:0/3389818975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc0094d0 con 0x7f72cc0a5260 2023-11-18T20:39:59.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.218+0000 7f72d2398640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc06d0a0 0x7f72cc0a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:39:59.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.219+0000 7f72d1b97640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0a5260 0x7f72cc0bf360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f72bc02b940 tx=0x7f72bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:59.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.219+0000 7f72c2ffd640 1 -- 172.21.15.132:0/3389818975 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc03ad30 con 0x7f72cc0a5260 2023-11-18T20:39:59.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.219+0000 7f72c2ffd640 1 -- 172.21.15.132:0/3389818975 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0443f0 con 0x7f72cc0a5260 2023-11-18T20:39:59.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.219+0000 7f72c2ffd640 1 -- 172.21.15.132:0/3389818975 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0447a0 con 0x7f72cc0a5260 2023-11-18T20:39:59.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.219+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc1dd560 con 0x7f72cc0a5260 2023-11-18T20:39:59.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.219+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc0bf8a0 con 0x7f72cc0a5260 2023-11-18T20:39:59.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.220+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc066af0 con 0x7f72cc0a5260 2023-11-18T20:39:59.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.221+0000 7f72c2ffd640 1 -- 172.21.15.132:0/3389818975 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72bc04d450 con 0x7f72cc0a5260 2023-11-18T20:39:59.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.222+0000 7f72c2ffd640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f72b006ae40 0x7f72b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.223+0000 7f72c2ffd640 1 -- 172.21.15.132:0/3389818975 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7f72bc0abc10 con 0x7f72cc0a5260 2023-11-18T20:39:59.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.223+0000 7f72d2398640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f72b006ae40 0x7f72b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.224+0000 7f72d2398640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f72b006ae40 0x7f72b006d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72c8006fd0 tx=0x7f72c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:59.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.227+0000 7f72c2ffd640 1 -- 172.21.15.132:0/3389818975 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72cc066af0 con 0x7f72cc0a5260 2023-11-18T20:39:59.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.423+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f72cc066af0 con 0x7f72cc0a5260 2023-11-18T20:39:59.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.424+0000 7f72c2ffd640 1 -- 172.21.15.132:0/3389818975 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f72cc066af0 con 0x7f72cc0a5260 2023-11-18T20:39:59.425 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:39:59.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f72b006ae40 msgr2=0x7f72b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f72b006ae40 0x7f72b006d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72c8006fd0 tx=0x7f72c8008040 comp rx=0 tx=0).stop 2023-11-18T20:39:59.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0a5260 msgr2=0x7f72cc0bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0a5260 0x7f72cc0bf360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f72bc02b940 tx=0x7f72bc0046c0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 shutdown_connections 2023-11-18T20:39:59.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f72b006ae40 0x7f72b006d300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72cc14fd30 0x7f72cc1dda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0a5260 0x7f72cc0bf360 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 --2- 172.21.15.132:0/3389818975 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72cc06d0a0 0x7f72cc0a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 >> 172.21.15.132:0/3389818975 conn(0x7f72cc06a500 msgr2=0x7f72cc0c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:59.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 shutdown_connections 2023-11-18T20:39:59.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.426+0000 7f72d45fc640 1 -- 172.21.15.132:0/3389818975 wait complete. 2023-11-18T20:39:59.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:39:59.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.643+0000 7fee98aff640 1 Processor -- start 2023-11-18T20:39:59.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.643+0000 7fee98aff640 1 -- start start 2023-11-18T20:39:59.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee98aff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee940ca450 0x7fee940ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee98aff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee94154580 0x7fee94154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee98aff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee94158a60 con 0x7fee9414e7c0 2023-11-18T20:39:59.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee98aff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee940c5b10 con 0x7fee940ca450 2023-11-18T20:39:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee98aff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee940c4dd0 con 0x7fee94154580 2023-11-18T20:39:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee92ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee940ca450 0x7fee940ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee92ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee940ca450 0x7fee940ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38324/0 (socket says 172.21.15.132:38324) 2023-11-18T20:39:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee92ffd640 1 -- 172.21.15.132:0/1293106327 learned_addr learned my addr 172.21.15.132:0/1293106327 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.645+0000 7fee92ffd640 1 -- 172.21.15.132:0/1293106327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee94154580 msgr2=0x7fee94154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.646+0000 7fee93fff640 1 --2- 172.21.15.132:0/1293106327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee94154580 0x7fee94154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.646+0000 7fee92ffd640 1 --2- 172.21.15.132:0/1293106327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee94154580 0x7fee94154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.646+0000 7fee92ffd640 1 -- 172.21.15.132:0/1293106327 >> v1:172.21.15.161:6789/0 conn(0x7fee9414e7c0 legacy=0x7fee940c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:39:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.646+0000 7fee92ffd640 1 -- 172.21.15.132:0/1293106327 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94157ca0 con 0x7fee940ca450 2023-11-18T20:39:59.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.647+0000 7fee92ffd640 1 --2- 172.21.15.132:0/1293106327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee940ca8d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fee88009870 tx=0x7fee8802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e143aa7ebdf49d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.647+0000 7fee927fc640 1 -- 172.21.15.132:0/1293106327 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88031740 con 0x7fee940ca450 2023-11-18T20:39:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee927fc640 1 -- 172.21.15.132:0/1293106327 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee880318a0 con 0x7fee940ca450 2023-11-18T20:39:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee927fc640 1 -- 172.21.15.132:0/1293106327 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88031c30 con 0x7fee940ca450 2023-11-18T20:39:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee98aff640 1 -- 172.21.15.132:0/1293106327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 msgr2=0x7fee940ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee98aff640 1 --2- 172.21.15.132:0/1293106327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee940ca8d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fee88009870 tx=0x7fee8802b7e0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee98aff640 1 -- 172.21.15.132:0/1293106327 shutdown_connections 2023-11-18T20:39:59.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee98aff640 1 --2- 172.21.15.132:0/1293106327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee94154580 0x7fee94154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee98aff640 1 --2- 172.21.15.132:0/1293106327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee940ca8d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee98aff640 1 -- 172.21.15.132:0/1293106327 >> 172.21.15.132:0/1293106327 conn(0x7fee940abf00 msgr2=0x7fee940c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:59.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee98aff640 1 -- 172.21.15.132:0/1293106327 shutdown_connections 2023-11-18T20:39:59.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.648+0000 7fee98aff640 1 -- 172.21.15.132:0/1293106327 wait complete. 2023-11-18T20:39:59.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.650+0000 7fee98aff640 1 Processor -- start 2023-11-18T20:39:59.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.650+0000 7fee98aff640 1 -- start start 2023-11-18T20:39:59.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.651+0000 7fee98aff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee9414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.651+0000 7fee98aff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee9414e7c0 0x7fee94156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.651+0000 7fee98aff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee94154580 0x7fee941eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.651+0000 7fee98aff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94153bc0 con 0x7fee940ca450 2023-11-18T20:39:59.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.651+0000 7fee98aff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94157880 con 0x7fee94154580 2023-11-18T20:39:59.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.651+0000 7fee98aff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee941ed600 con 0x7fee9414e7c0 2023-11-18T20:39:59.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee9414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee9414c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38340/0 (socket says 172.21.15.132:38340) 2023-11-18T20:39:59.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 -- 172.21.15.132:0/621090446 learned_addr learned my addr 172.21.15.132:0/621090446 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:39:59.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee92ffd640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee9414e7c0 0x7fee94156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 -- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee9414e7c0 msgr2=0x7fee94156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee9414e7c0 0x7fee94156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 -- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee94154580 msgr2=0x7fee941eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee94154580 0x7fee941eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 -- 172.21.15.132:0/621090446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880094d0 con 0x7fee940ca450 2023-11-18T20:39:59.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.652+0000 7fee937fe640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee9414c8b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fee8400b3f0 tx=0x7fee8400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:59.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.653+0000 7fee7bfff640 1 -- 172.21.15.132:0/621090446 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84011830 con 0x7fee940ca450 2023-11-18T20:39:59.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.653+0000 7fee7bfff640 1 -- 172.21.15.132:0/621090446 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee84011990 con 0x7fee940ca450 2023-11-18T20:39:59.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.653+0000 7fee7bfff640 1 -- 172.21.15.132:0/621090446 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84011d40 con 0x7fee940ca450 2023-11-18T20:39:59.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.653+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9414cdf0 con 0x7fee940ca450 2023-11-18T20:39:59.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.653+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee94152580 con 0x7fee940ca450 2023-11-18T20:39:59.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.654+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9404e840 con 0x7fee940ca450 2023-11-18T20:39:59.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.655+0000 7fee7bfff640 1 -- 172.21.15.132:0/621090446 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee8401a400 con 0x7fee940ca450 2023-11-18T20:39:59.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.656+0000 7fee7bfff640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8006ae40 0x7fee8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:39:59.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.656+0000 7fee7bfff640 1 -- 172.21.15.132:0/621090446 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7fee840894b0 con 0x7fee940ca450 2023-11-18T20:39:59.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.657+0000 7fee92ffd640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8006ae40 0x7fee8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:39:59.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.658+0000 7fee92ffd640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8006ae40 0x7fee8006d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee88035000 tx=0x7fee88008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:39:59.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.663+0000 7fee7bfff640 1 -- 172.21.15.132:0/621090446 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee84054500 con 0x7fee940ca450 2023-11-18T20:39:59.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.892+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee940c7c40 con 0x7fee940ca450 2023-11-18T20:39:59.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.893+0000 7fee7bfff640 1 -- 172.21.15.132:0/621090446 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fee84057b20 con 0x7fee940ca450 2023-11-18T20:39:59.894 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:39:59.895 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/71697180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":71697180},{"type":"v1","addr":"172.21.15.132:6834","nonce":71697180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:22.835223+0000","modified":"2023-11-18T20:39:25.904986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4562":{"gid":4562,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-18T20:39:59.895 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 21 2023-11-18T20:39:59.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8006ae40 msgr2=0x7fee8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8006ae40 0x7fee8006d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee88035000 tx=0x7fee88008030 comp rx=0 tx=0).stop 2023-11-18T20:39:59.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 msgr2=0x7fee9414c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:39:59.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee9414c8b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fee8400b3f0 tx=0x7fee8400b8b0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 shutdown_connections 2023-11-18T20:39:59.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8006ae40 0x7fee8006d300 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee94154580 0x7fee941eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee9414e7c0 0x7fee94156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 --2- 172.21.15.132:0/621090446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee940ca450 0x7fee9414c8b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:39:59.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 >> 172.21.15.132:0/621090446 conn(0x7fee940abf00 msgr2=0x7fee940c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:39:59.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 shutdown_connections 2023-11-18T20:39:59.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:39:59.896+0000 7fee98aff640 1 -- 172.21.15.132:0/621090446 wait complete. 2023-11-18T20:39:59.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:00.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.122+0000 7f220da67640 1 Processor -- start 2023-11-18T20:40:00.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.122+0000 7f220da67640 1 -- start start 2023-11-18T20:40:00.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.123+0000 7f220da67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22080c52e0 0x7f220806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.123+0000 7f220da67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f220806cd20 0x7f220815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.123+0000 7f220da67640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22080a8380 con 0x7f220814e7f0 2023-11-18T20:40:00.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.123+0000 7f220da67640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22081510b0 con 0x7f220806cd20 2023-11-18T20:40:00.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.123+0000 7f220da67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220806bf60 con 0x7f22080c52e0 2023-11-18T20:40:00.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.124+0000 7f220d266640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f220806cd20 0x7f220815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.124+0000 7f2207fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22080c52e0 0x7f220806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.124+0000 7f2207fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22080c52e0 0x7f220806d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:37546/0 (socket says 172.21.15.132:37546) 2023-11-18T20:40:00.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.124+0000 7f2207fff640 1 -- 172.21.15.132:0/2187885316 learned_addr learned my addr 172.21.15.132:0/2187885316 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:00.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.125+0000 7f220d266640 1 -- 172.21.15.132:0/2187885316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22080c52e0 msgr2=0x7f220806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:00.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.125+0000 7f220d266640 1 --2- 172.21.15.132:0/2187885316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22080c52e0 0x7f220806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.125+0000 7f220d266640 1 -- 172.21.15.132:0/2187885316 >> v1:172.21.15.161:6789/0 conn(0x7f220814e7f0 legacy=0x7f22080c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.125+0000 7f220d266640 1 -- 172.21.15.132:0/2187885316 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220806c240 con 0x7f220806cd20 2023-11-18T20:40:00.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.126+0000 7f220d266640 1 --2- 172.21.15.132:0/2187885316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220806cd20 0x7f220815ba30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2200009d90 tx=0x7f220002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fdb82f86993c11 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:00.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.127+0000 7f22077fe640 1 -- 172.21.15.132:0/2187885316 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220002cbc0 con 0x7f220806cd20 2023-11-18T20:40:00.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.127+0000 7f22077fe640 1 -- 172.21.15.132:0/2187885316 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220002cd20 con 0x7f220806cd20 2023-11-18T20:40:00.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.127+0000 7f22077fe640 1 -- 172.21.15.132:0/2187885316 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200034660 con 0x7f220806cd20 2023-11-18T20:40:00.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.128+0000 7f220da67640 1 -- 172.21.15.132:0/2187885316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220806cd20 msgr2=0x7f220815ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.128+0000 7f220da67640 1 --2- 172.21.15.132:0/2187885316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220806cd20 0x7f220815ba30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2200009d90 tx=0x7f220002be10 comp rx=0 tx=0).stop 2023-11-18T20:40:00.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.128+0000 7f220da67640 1 -- 172.21.15.132:0/2187885316 shutdown_connections 2023-11-18T20:40:00.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.128+0000 7f220da67640 1 --2- 172.21.15.132:0/2187885316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220806cd20 0x7f220815ba30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.128+0000 7f220da67640 1 --2- 172.21.15.132:0/2187885316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22080c52e0 0x7f220806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.128+0000 7f220da67640 1 -- 172.21.15.132:0/2187885316 >> 172.21.15.132:0/2187885316 conn(0x7f22080a77f0 msgr2=0x7f22080a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:00.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.128+0000 7f220da67640 1 -- 172.21.15.132:0/2187885316 shutdown_connections 2023-11-18T20:40:00.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.128+0000 7f220da67640 1 -- 172.21.15.132:0/2187885316 wait complete. 2023-11-18T20:40:00.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.130+0000 7f220da67640 1 Processor -- start 2023-11-18T20:40:00.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.130+0000 7f220da67640 1 -- start start 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.131+0000 7f220da67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f220806cd20 0x7f22081ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220da67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22080c52e0 0x7f220814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220da67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f220814e7f0 0x7f2208142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220da67640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080bf310 con 0x7f220814e7f0 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220da67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22081ee580 con 0x7f22080c52e0 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220da67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080a58e0 con 0x7f220806cd20 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220d266640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f220814e7f0 0x7f2208142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220d266640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f220814e7f0 0x7f2208142cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38342/0 (socket says 172.21.15.132:38342) 2023-11-18T20:40:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220d266640 1 -- 172.21.15.132:0/823275342 learned_addr learned my addr 172.21.15.132:0/823275342 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f2207fff640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22080c52e0 0x7f220814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220ca65640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f220806cd20 0x7f22081ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220d266640 1 -- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f220806cd20 msgr2=0x7f22081ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220d266640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f220806cd20 0x7f22081ee040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220d266640 1 -- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22080c52e0 msgr2=0x7f220814da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220d266640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22080c52e0 0x7f220814da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.132+0000 7f220d266640 1 -- 172.21.15.132:0/823275342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009a70 con 0x7f220814e7f0 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.133+0000 7f220d266640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f220814e7f0 0x7f2208142cc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2200009eb0 tx=0x7f2200004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.133+0000 7f22057fa640 1 -- 172.21.15.132:0/823275342 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220003e610 con 0x7f220814e7f0 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.133+0000 7f22057fa640 1 -- 172.21.15.132:0/823275342 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220002ce90 con 0x7f220814e7f0 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.133+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2208072020 con 0x7f220814e7f0 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.133+0000 7f22057fa640 1 -- 172.21.15.132:0/823275342 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220003e9b0 con 0x7f220814e7f0 2023-11-18T20:40:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.133+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22080725e0 con 0x7f220814e7f0 2023-11-18T20:40:00.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.134+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220804e840 con 0x7f220814e7f0 2023-11-18T20:40:00.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.136+0000 7f22057fa640 1 -- 172.21.15.132:0/823275342 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f220003b050 con 0x7f220814e7f0 2023-11-18T20:40:00.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.137+0000 7f22057fa640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f21ec06ae40 0x7f21ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.137+0000 7f22057fa640 1 -- 172.21.15.132:0/823275342 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7f22000abe10 con 0x7f220814e7f0 2023-11-18T20:40:00.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.138+0000 7f220ca65640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f21ec06ae40 0x7f21ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.139+0000 7f220ca65640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f21ec06ae40 0x7f21ec06d300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f21fc007fd0 tx=0x7f21fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:00.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.142+0000 7f22057fa640 1 -- 172.21.15.132:0/823275342 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22000af030 con 0x7f220814e7f0 2023-11-18T20:40:00.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.334+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22080a5a20 con 0x7f220814e7f0 2023-11-18T20:40:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.337+0000 7f22057fa640 1 -- 172.21.15.132:0/823275342 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16910 (secure 0 0 0) 0x7f2200076dc0 con 0x7f220814e7f0 2023-11-18T20:40:00.339 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:00.339 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":44,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:57.636585+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6834/4266315561":"2023-11-19T20:39:54.536061+0000","172.21.15.132:6832/4266315561":"2023-11-19T20:39:54.536061+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:00.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f21ec06ae40 msgr2=0x7f21ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f21ec06ae40 0x7f21ec06d300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f21fc007fd0 tx=0x7f21fc009040 comp rx=0 tx=0).stop 2023-11-18T20:40:00.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f220814e7f0 msgr2=0x7f2208142cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f220814e7f0 0x7f2208142cc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2200009eb0 tx=0x7f2200004a40 comp rx=0 tx=0).stop 2023-11-18T20:40:00.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 shutdown_connections 2023-11-18T20:40:00.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f21ec06ae40 0x7f21ec06d300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f220814e7f0 0x7f2208142cc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22080c52e0 0x7f220814da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 --2- 172.21.15.132:0/823275342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f220806cd20 0x7f22081ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 >> 172.21.15.132:0/823275342 conn(0x7f22080a77f0 msgr2=0x7f22080662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:00.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 shutdown_connections 2023-11-18T20:40:00.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.340+0000 7f220da67640 1 -- 172.21.15.132:0/823275342 wait complete. 2023-11-18T20:40:00.359 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-18T20:40:00.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:00.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.572+0000 7f2eea7b0640 1 Processor -- start 2023-11-18T20:40:00.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.572+0000 7f2eea7b0640 1 -- start start 2023-11-18T20:40:00.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.573+0000 7f2eea7b0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee406d0a0 0x7f2ee4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.573+0000 7f2eea7b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ee40c3ea0 0x7f2ee40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.573+0000 7f2eea7b0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40c64a0 con 0x7f2ee414fd30 2023-11-18T20:40:00.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.573+0000 7f2eea7b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee40c5c00 con 0x7f2ee40c3ea0 2023-11-18T20:40:00.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.573+0000 7f2eea7b0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40c5ee0 con 0x7f2ee406d0a0 2023-11-18T20:40:00.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.574+0000 7f2ee3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2ee414fd30 0x7f2ee40a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37908/0 (socket says 172.21.15.132:37908) 2023-11-18T20:40:00.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.574+0000 7f2ee3fff640 1 -- 172.21.15.132:0/2957704058 learned_addr learned my addr 172.21.15.132:0/2957704058 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:00.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.574+0000 7f2ee8d4d640 1 --2- 172.21.15.132:0/2957704058 >> v2:172.21.15.161:3300/0 conn(0x7f2ee40c3ea0 0x7f2ee40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.574+0000 7f2ee37fe640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee406d0a0 0x7f2ee4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.574+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584412440 0 0) 0x7f2ee40c64a0 con 0x7f2ee414fd30 2023-11-18T20:40:00.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.574+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed0003520 con 0x7f2ee414fd30 2023-11-18T20:40:00.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1618984969 0 0) 0x7f2ed0003520 con 0x7f2ee414fd30 2023-11-18T20:40:00.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee406d0a0 msgr2=0x7f2ee4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:00.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee406d0a0 0x7f2ee4152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 >> v2:172.21.15.161:3300/0 conn(0x7f2ee40c3ea0 msgr2=0x7f2ee40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:00.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 --2- 172.21.15.132:0/2957704058 >> v2:172.21.15.161:3300/0 conn(0x7f2ee40c3ea0 0x7f2ee40c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40c61c0 con 0x7f2ee414fd30 2023-11-18T20:40:00.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f2ed40019f0 con 0x7f2ee414fd30 2023-11-18T20:40:00.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 >> v1:172.21.15.132:6789/0 conn(0x7f2ee414fd30 legacy=0x7f2ee40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed0003970 0x7f2ed0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee406d0a0 0x7f2ed00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ed0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40c5c00 con 0x7f2ed0004d00 2023-11-18T20:40:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40c5ee0 con 0x7f2ed0003970 2023-11-18T20:40:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed000b980 con 0x7f2ee406d0a0 2023-11-18T20:40:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee8d4d640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ed0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee3fff640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed0003970 0x7f2ed0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee8d4d640 1 -- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee406d0a0 msgr2=0x7f2ed00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:00.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee8d4d640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee406d0a0 0x7f2ed00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee8d4d640 1 -- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed0003970 msgr2=0x7f2ed0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:00.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee8d4d640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ed0003970 0x7f2ed0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.575+0000 7f2ee8d4d640 1 -- 172.21.15.132:0/2957704058 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0003520 con 0x7f2ed0004d00 2023-11-18T20:40:00.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.577+0000 7f2ee8d4d640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ed0005180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009ac0 tx=0x7f2ed00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1c694b00188033 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:00.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.577+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc02c6f0 con 0x7f2ed0004d00 2023-11-18T20:40:00.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.577+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc02c850 con 0x7f2ed0004d00 2023-11-18T20:40:00.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.577+0000 7f2ee2ffd640 1 -- 172.21.15.132:0/2957704058 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc02cbe0 con 0x7f2ed0004d00 2023-11-18T20:40:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.577+0000 7f2eea7b0640 1 -- 172.21.15.132:0/2957704058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 msgr2=0x7f2ed0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.577+0000 7f2eea7b0640 1 --2- 172.21.15.132:0/2957704058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ed0005180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009ac0 tx=0x7f2ed00057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.577+0000 7f2ee8d4d640 1 -- 172.21.15.132:0/2957704058 reap_dead start 2023-11-18T20:40:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.578+0000 7f2eea7b0640 1 -- 172.21.15.132:0/2957704058 shutdown_connections 2023-11-18T20:40:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.578+0000 7f2eea7b0640 1 -- 172.21.15.132:0/2957704058 >> 172.21.15.132:0/2957704058 conn(0x7f2ee406a500 msgr2=0x7f2ee406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.578+0000 7f2eea7b0640 1 -- 172.21.15.132:0/2957704058 shutdown_connections 2023-11-18T20:40:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.578+0000 7f2eea7b0640 1 -- 172.21.15.132:0/2957704058 wait complete. 2023-11-18T20:40:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.579+0000 7f2eea7b0640 1 Processor -- start 2023-11-18T20:40:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.580+0000 7f2eea7b0640 1 -- start start 2023-11-18T20:40:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.580+0000 7f2eea7b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ee4150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.580+0000 7f2eea7b0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee414ed00 0x7f2ee41e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.580+0000 7f2eea7b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ee41e93f0 0x7f2ee414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.580+0000 7f2eea7b0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41dca70 con 0x7f2ed0004d00 2023-11-18T20:40:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.580+0000 7f2eea7b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40bad70 con 0x7f2ee41e93f0 2023-11-18T20:40:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2eea7b0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41dc720 con 0x7f2ee414ed00 2023-11-18T20:40:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ee4150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ee4150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38362/0 (socket says 172.21.15.132:38362) 2023-11-18T20:40:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee3fff640 1 -- 172.21.15.132:0/3511959074 learned_addr learned my addr 172.21.15.132:0/3511959074 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee37fe640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee414ed00 0x7f2ee41e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee8d4d640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ee41e93f0 0x7f2ee414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee3fff640 1 -- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee414ed00 msgr2=0x7f2ee41e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee3fff640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee414ed00 0x7f2ee41e8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee3fff640 1 -- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ee41e93f0 msgr2=0x7f2ee414daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee3fff640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ee41e93f0 0x7f2ee414daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.581+0000 7f2ee3fff640 1 -- 172.21.15.132:0/3511959074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee414eab0 con 0x7f2ed0004d00 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.582+0000 7f2ee3fff640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ee4150d90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400b100 tx=0x7f2ed400b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.582+0000 7f2ee0ff9640 1 -- 172.21.15.132:0/3511959074 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4004d60 con 0x7f2ed0004d00 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.582+0000 7f2ee0ff9640 1 -- 172.21.15.132:0/3511959074 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed40070d0 con 0x7f2ed0004d00 2023-11-18T20:40:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.582+0000 7f2ee0ff9640 1 -- 172.21.15.132:0/3511959074 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4007440 con 0x7f2ed0004d00 2023-11-18T20:40:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.582+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee41dce90 con 0x7f2ed0004d00 2023-11-18T20:40:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.582+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee41eb9f0 con 0x7f2ed0004d00 2023-11-18T20:40:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.583+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee4068350 con 0x7f2ed0004d00 2023-11-18T20:40:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.584+0000 7f2ee0ff9640 1 -- 172.21.15.132:0/3511959074 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ed40075a0 con 0x7f2ed0004d00 2023-11-18T20:40:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.585+0000 7f2ee0ff9640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ec406ae40 0x7f2ec406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.585+0000 7f2ee0ff9640 1 -- 172.21.15.132:0/3511959074 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7f2ed40897d0 con 0x7f2ed0004d00 2023-11-18T20:40:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.586+0000 7f2ee37fe640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ec406ae40 0x7f2ec406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.587+0000 7f2ee37fe640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ec406ae40 0x7f2ec406d300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004770 tx=0x7f2ecc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.589+0000 7f2ee0ff9640 1 -- 172.21.15.132:0/3511959074 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ed4054820 con 0x7f2ed0004d00 2023-11-18T20:40:00.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.817+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ee40c66d0 con 0x7f2ed0004d00 2023-11-18T20:40:00.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.818+0000 7f2ee0ff9640 1 -- 172.21.15.132:0/3511959074 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f2ed4019020 con 0x7f2ed0004d00 2023-11-18T20:40:00.819 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:00.820 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/71697180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":71697180},{"type":"v1","addr":"172.21.15.132:6834","nonce":71697180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:22.835223+0000","modified":"2023-11-18T20:39:25.904986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4562":{"gid":4562,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-18T20:40:00.820 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 21 2023-11-18T20:40:00.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.820+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ec406ae40 msgr2=0x7f2ec406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.820+0000 7f2eea7b0640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ec406ae40 0x7f2ec406d300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004770 tx=0x7f2ecc008040 comp rx=0 tx=0).stop 2023-11-18T20:40:00.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.820+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 msgr2=0x7f2ee4150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:00.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.820+0000 7f2eea7b0640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ee4150d90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400b100 tx=0x7f2ed400b5c0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.821+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 shutdown_connections 2023-11-18T20:40:00.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.821+0000 7f2eea7b0640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ec406ae40 0x7f2ec406d300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.821+0000 7f2eea7b0640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ee41e93f0 0x7f2ee414daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.821+0000 7f2eea7b0640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ee414ed00 0x7f2ee41e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.821+0000 7f2eea7b0640 1 --2- 172.21.15.132:0/3511959074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed0004d00 0x7f2ee4150d90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:00.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.821+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 >> 172.21.15.132:0/3511959074 conn(0x7f2ee406a500 msgr2=0x7f2ee406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:00.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.821+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 shutdown_connections 2023-11-18T20:40:00.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:00.821+0000 7f2eea7b0640 1 -- 172.21.15.132:0/3511959074 wait complete. 2023-11-18T20:40:00.839 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:01.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.046+0000 7f9a1b36c640 1 Processor -- start 2023-11-18T20:40:01.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.046+0000 7f9a1b36c640 1 -- start start 2023-11-18T20:40:01.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.048+0000 7f9a1b36c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a14152f20 0x7f9a140c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.048+0000 7f9a1b36c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140c64a0 con 0x7f9a1414fd30 2023-11-18T20:40:01.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.048+0000 7f9a1b36c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140c5c00 con 0x7f9a1406d0a0 2023-11-18T20:40:01.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.048+0000 7f9a1b36c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140c5ee0 con 0x7f9a14152f20 2023-11-18T20:40:01.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.048+0000 7f9a19909640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a14152f20 0x7f9a140c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.048+0000 7f9a19108640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9a1414fd30 0x7f9a140a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37910/0 (socket says 172.21.15.132:37910) 2023-11-18T20:40:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.048+0000 7f9a19108640 1 -- 172.21.15.132:0/546200299 learned_addr learned my addr 172.21.15.132:0/546200299 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.049+0000 7f9a19909640 1 -- 172.21.15.132:0/546200299 >> v1:172.21.15.161:6789/0 conn(0x7f9a1406d0a0 legacy=0x7f9a140c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.049+0000 7f9a19909640 1 -- 172.21.15.132:0/546200299 >> v1:172.21.15.132:6789/0 conn(0x7f9a1414fd30 legacy=0x7f9a140a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.049+0000 7f9a19909640 1 -- 172.21.15.132:0/546200299 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140c61c0 con 0x7f9a14152f20 2023-11-18T20:40:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.049+0000 7f9a0bfff640 1 -- 172.21.15.132:0/546200299 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786064172 0 0) 0x7f9a140c64a0 con 0x7f9a1414fd30 2023-11-18T20:40:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.050+0000 7f9a19909640 1 --2- 172.21.15.132:0/546200299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a14152f20 0x7f9a140c45b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0097a0 tx=0x7f9a0c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ddd152e23c4df2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.050+0000 7f9a0bfff640 1 -- 172.21.15.132:0/546200299 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c030610 con 0x7f9a14152f20 2023-11-18T20:40:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.050+0000 7f9a0bfff640 1 -- 172.21.15.132:0/546200299 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c030770 con 0x7f9a14152f20 2023-11-18T20:40:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.050+0000 7f9a0bfff640 1 -- 172.21.15.132:0/546200299 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c030b00 con 0x7f9a14152f20 2023-11-18T20:40:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.051+0000 7f9a1b36c640 1 -- 172.21.15.132:0/546200299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a14152f20 msgr2=0x7f9a140c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.051+0000 7f9a1b36c640 1 --2- 172.21.15.132:0/546200299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a14152f20 0x7f9a140c45b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0097a0 tx=0x7f9a0c02b960 comp rx=0 tx=0).stop 2023-11-18T20:40:01.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.051+0000 7f9a1b36c640 1 -- 172.21.15.132:0/546200299 shutdown_connections 2023-11-18T20:40:01.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.051+0000 7f9a1b36c640 1 --2- 172.21.15.132:0/546200299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a14152f20 0x7f9a140c45b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.051+0000 7f9a1b36c640 1 -- 172.21.15.132:0/546200299 >> 172.21.15.132:0/546200299 conn(0x7f9a1406a500 msgr2=0x7f9a1406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:01.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.051+0000 7f9a1b36c640 1 -- 172.21.15.132:0/546200299 shutdown_connections 2023-11-18T20:40:01.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.051+0000 7f9a1b36c640 1 -- 172.21.15.132:0/546200299 wait complete. 2023-11-18T20:40:01.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.053+0000 7f9a1b36c640 1 Processor -- start 2023-11-18T20:40:01.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.053+0000 7f9a1b36c640 1 -- start start 2023-11-18T20:40:01.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a1b36c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1406d0a0 0x7f9a141eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a1b36c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1414fd30 0x7f9a141eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a1b36c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a14152f20 0x7f9a14156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a1b36c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a141ea860 con 0x7f9a1406d0a0 2023-11-18T20:40:01.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a1b36c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a141dcdc0 con 0x7f9a14152f20 2023-11-18T20:40:01.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a1b36c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a141ea290 con 0x7f9a1414fd30 2023-11-18T20:40:01.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a19108640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1406d0a0 0x7f9a141eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a19108640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1406d0a0 0x7f9a141eb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38386/0 (socket says 172.21.15.132:38386) 2023-11-18T20:40:01.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a19108640 1 -- 172.21.15.132:0/2953405386 learned_addr learned my addr 172.21.15.132:0/2953405386 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:01.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a19909640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a14152f20 0x7f9a14156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a19108640 1 -- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1414fd30 msgr2=0x7f9a141eac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.054+0000 7f9a18907640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1414fd30 0x7f9a141eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a19108640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1414fd30 0x7f9a141eac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a19108640 1 -- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a14152f20 msgr2=0x7f9a14156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a19108640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a14152f20 0x7f9a14156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a19108640 1 -- 172.21.15.132:0/2953405386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c009400 con 0x7f9a1406d0a0 2023-11-18T20:40:01.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a19909640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a14152f20 0x7f9a14156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a18907640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1414fd30 0x7f9a141eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a19108640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1406d0a0 0x7f9a141eb700 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c8c0 tx=0x7f9a1000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a09ffb640 1 -- 172.21.15.132:0/2953405386 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000a5e0 con 0x7f9a1406d0a0 2023-11-18T20:40:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a09ffb640 1 -- 172.21.15.132:0/2953405386 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000a740 con 0x7f9a1406d0a0 2023-11-18T20:40:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a141dca00 con 0x7f9a1406d0a0 2023-11-18T20:40:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a09ffb640 1 -- 172.21.15.132:0/2953405386 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000ab30 con 0x7f9a1406d0a0 2023-11-18T20:40:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.055+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a141ebc40 con 0x7f9a1406d0a0 2023-11-18T20:40:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.057+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a14068350 con 0x7f9a1406d0a0 2023-11-18T20:40:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.057+0000 7f9a09ffb640 1 -- 172.21.15.132:0/2953405386 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a1000ac90 con 0x7f9a1406d0a0 2023-11-18T20:40:01.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.058+0000 7f9a09ffb640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99f806ae40 0x7f99f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.058+0000 7f9a09ffb640 1 -- 172.21.15.132:0/2953405386 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7f9a10088d00 con 0x7f9a1406d0a0 2023-11-18T20:40:01.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.059+0000 7f9a18907640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99f806ae40 0x7f99f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.060+0000 7f9a18907640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99f806ae40 0x7f99f806d300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9a140c1b20 tx=0x7f9a04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.063+0000 7f9a09ffb640 1 -- 172.21.15.132:0/2953405386 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a10053cb0 con 0x7f9a1406d0a0 2023-11-18T20:40:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.290+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a1406d540 con 0x7f9a1406d0a0 2023-11-18T20:40:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.291+0000 7f9a09ffb640 1 -- 172.21.15.132:0/2953405386 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f9a10018070 con 0x7f9a1406d0a0 2023-11-18T20:40:01.293 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:01.293 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/71697180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":71697180},{"type":"v1","addr":"172.21.15.132:6834","nonce":71697180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:39:22.835223+0000","modified":"2023-11-18T20:39:25.904986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4562":{"gid":4562,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.161:6837/1926819956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1926819956},{"type":"v1","addr":"172.21.15.161:6837","nonce":1926819956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-18T20:40:01.293 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 21 2023-11-18T20:40:01.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99f806ae40 msgr2=0x7f99f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99f806ae40 0x7f99f806d300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9a140c1b20 tx=0x7f9a04009040 comp rx=0 tx=0).stop 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1406d0a0 msgr2=0x7f9a141eb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1406d0a0 0x7f9a141eb700 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c8c0 tx=0x7f9a1000cd80 comp rx=0 tx=0).stop 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 shutdown_connections 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f99f806ae40 0x7f99f806d300 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a14152f20 0x7f9a14156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1414fd30 0x7f9a141eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 --2- 172.21.15.132:0/2953405386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1406d0a0 0x7f9a141eb700 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 >> 172.21.15.132:0/2953405386 conn(0x7f9a1406a500 msgr2=0x7f9a140c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.294+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 shutdown_connections 2023-11-18T20:40:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.295+0000 7f9a1b36c640 1 -- 172.21.15.132:0/2953405386 wait complete. 2023-11-18T20:40:01.315 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:01.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.520+0000 7f23ffdd5640 1 Processor -- start 2023-11-18T20:40:01.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.520+0000 7f23ffdd5640 1 -- start start 2023-11-18T20:40:01.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23ffdd5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23f814fd30 0x7f23f8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23ffdd5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 0x7f23f80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23ffdd5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23f80a5260 0x7f23f80c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23ffdd5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f80c64a0 con 0x7f23f80a5260 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23ffdd5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f80c5c00 con 0x7f23f814fd30 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23ffdd5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80c5ee0 con 0x7f23f806d0a0 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23fe372640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23f80a5260 0x7f23f80c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23fe372640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23f80a5260 0x7f23f80c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38394/0 (socket says 172.21.15.132:38394) 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23fe372640 1 -- 172.21.15.132:0/115955132 learned_addr learned my addr 172.21.15.132:0/115955132 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23fdb71640 1 --2- 172.21.15.132:0/115955132 >> v2:172.21.15.161:3300/0 conn(0x7f23f814fd30 0x7f23f8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.522+0000 7f23fd370640 1 --2- 172.21.15.132:0/115955132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 0x7f23f80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.523+0000 7f23fe372640 1 -- 172.21.15.132:0/115955132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 msgr2=0x7f23f80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:01.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.523+0000 7f23fe372640 1 --2- 172.21.15.132:0/115955132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 0x7f23f80a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.523+0000 7f23fe372640 1 -- 172.21.15.132:0/115955132 >> v2:172.21.15.161:3300/0 conn(0x7f23f814fd30 msgr2=0x7f23f8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:01.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.523+0000 7f23fe372640 1 --2- 172.21.15.132:0/115955132 >> v2:172.21.15.161:3300/0 conn(0x7f23f814fd30 0x7f23f8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.523+0000 7f23fe372640 1 -- 172.21.15.132:0/115955132 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80c61c0 con 0x7f23f80a5260 2023-11-18T20:40:01.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.524+0000 7f23fe372640 1 --2- 172.21.15.132:0/115955132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f80a5260 0x7f23f80c3ea0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f23f806b200 tx=0x7f23f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97aac4fe3a6912a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.524+0000 7f23fcb6f640 1 -- 172.21.15.132:0/115955132 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f002ca80 con 0x7f23f80a5260 2023-11-18T20:40:01.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.524+0000 7f23fcb6f640 1 -- 172.21.15.132:0/115955132 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f002cbe0 con 0x7f23f80a5260 2023-11-18T20:40:01.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.524+0000 7f23fcb6f640 1 -- 172.21.15.132:0/115955132 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00343f0 con 0x7f23f80a5260 2023-11-18T20:40:01.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 -- 172.21.15.132:0/115955132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f80a5260 msgr2=0x7f23f80c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/115955132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f80a5260 0x7f23f80c3ea0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f23f806b200 tx=0x7f23f002bee0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 -- 172.21.15.132:0/115955132 shutdown_connections 2023-11-18T20:40:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/115955132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f80a5260 0x7f23f80c3ea0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/115955132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 0x7f23f80a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/115955132 >> v2:172.21.15.161:3300/0 conn(0x7f23f814fd30 0x7f23f8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 -- 172.21.15.132:0/115955132 >> 172.21.15.132:0/115955132 conn(0x7f23f806a500 msgr2=0x7f23f806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 -- 172.21.15.132:0/115955132 shutdown_connections 2023-11-18T20:40:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.525+0000 7f23ffdd5640 1 -- 172.21.15.132:0/115955132 wait complete. 2023-11-18T20:40:01.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.527+0000 7f23ffdd5640 1 Processor -- start 2023-11-18T20:40:01.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.528+0000 7f23ffdd5640 1 -- start start 2023-11-18T20:40:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23ffdd5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 0x7f23f80aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23ffdd5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23f80a5260 0x7f23f814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23ffdd5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f814fd30 0x7f23f814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23ffdd5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f81557f0 con 0x7f23f814fd30 2023-11-18T20:40:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23ffdd5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f81e8ff0 con 0x7f23f80a5260 2023-11-18T20:40:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23ffdd5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f81e6940 con 0x7f23f806d0a0 2023-11-18T20:40:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23fe372640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f814fd30 0x7f23f814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23fe372640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f814fd30 0x7f23f814f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38402/0 (socket says 172.21.15.132:38402) 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23fe372640 1 -- 172.21.15.132:0/636842932 learned_addr learned my addr 172.21.15.132:0/636842932 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23fdb71640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 0x7f23f80aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.529+0000 7f23fd370640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23f80a5260 0x7f23f814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23fe372640 1 -- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 msgr2=0x7f23f80aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23fe372640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 0x7f23f80aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23fe372640 1 -- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23f80a5260 msgr2=0x7f23f814ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23fe372640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23f80a5260 0x7f23f814ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23fe372640 1 -- 172.21.15.132:0/636842932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0009b30 con 0x7f23f814fd30 2023-11-18T20:40:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23fe372640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f814fd30 0x7f23f814f4b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f23f0036040 tx=0x7f23f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23ee7fc640 1 -- 172.21.15.132:0/636842932 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0009510 con 0x7f23f814fd30 2023-11-18T20:40:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23ee7fc640 1 -- 172.21.15.132:0/636842932 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f003e450 con 0x7f23f814fd30 2023-11-18T20:40:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23ee7fc640 1 -- 172.21.15.132:0/636842932 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f003e800 con 0x7f23f814fd30 2023-11-18T20:40:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.530+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f81e6380 con 0x7f23f814fd30 2023-11-18T20:40:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.531+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f81559d0 con 0x7f23f814fd30 2023-11-18T20:40:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.532+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f81e9130 con 0x7f23f814fd30 2023-11-18T20:40:01.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.533+0000 7f23ee7fc640 1 -- 172.21.15.132:0/636842932 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f23f002cd50 con 0x7f23f814fd30 2023-11-18T20:40:01.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.534+0000 7f23ee7fc640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f23dc06ae40 0x7f23dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.534+0000 7f23ee7fc640 1 -- 172.21.15.132:0/636842932 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7f23f00ac220 con 0x7f23f814fd30 2023-11-18T20:40:01.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.534+0000 7f23fdb71640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f23dc06ae40 0x7f23dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.536+0000 7f23fdb71640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f23dc06ae40 0x7f23dc06d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23f4006fd0 tx=0x7f23f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.539+0000 7f23ee7fc640 1 -- 172.21.15.132:0/636842932 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23f81e9130 con 0x7f23f814fd30 2023-11-18T20:40:01.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.738+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23f81e9130 con 0x7f23f814fd30 2023-11-18T20:40:01.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.741+0000 7f23ee7fc640 1 -- 172.21.15.132:0/636842932 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16910 (secure 0 0 0) 0x7f23f81e9130 con 0x7f23f814fd30 2023-11-18T20:40:01.743 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:01.743 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":44,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:39:57.636585+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:39:20.671493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:39:21.849411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.5","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6834/4266315561":"2023-11-19T20:39:54.536061+0000","172.21.15.132:6832/4266315561":"2023-11-19T20:39:54.536061+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:01.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f23dc06ae40 msgr2=0x7f23dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f23dc06ae40 0x7f23dc06d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23f4006fd0 tx=0x7f23f4008040 comp rx=0 tx=0).stop 2023-11-18T20:40:01.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f814fd30 msgr2=0x7f23f814f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f814fd30 0x7f23f814f4b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f23f0036040 tx=0x7f23f0004a40 comp rx=0 tx=0).stop 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 shutdown_connections 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f23dc06ae40 0x7f23dc06d300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f814fd30 0x7f23f814f4b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23f80a5260 0x7f23f814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 --2- 172.21.15.132:0/636842932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23f806d0a0 0x7f23f80aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.744+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 >> 172.21.15.132:0/636842932 conn(0x7f23f806a500 msgr2=0x7f23f80c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.745+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 shutdown_connections 2023-11-18T20:40:01.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.745+0000 7f23ffdd5640 1 -- 172.21.15.132:0/636842932 wait complete. 2023-11-18T20:40:01.765 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-18T20:40:01.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.970+0000 7fd6306f2640 1 Processor -- start 2023-11-18T20:40:01.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.970+0000 7fd6306f2640 1 -- start start 2023-11-18T20:40:01.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.972+0000 7fd6306f2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6280a9b40 0x7fd6280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.972+0000 7fd6306f2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6280c06c0 con 0x7fd6280c1500 2023-11-18T20:40:01.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.972+0000 7fd6306f2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6280c1020 con 0x7fd628155490 2023-11-18T20:40:01.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.972+0000 7fd6306f2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6280a5820 con 0x7fd6280a9b40 2023-11-18T20:40:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.972+0000 7fd62ec8f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd6280c1500 0x7fd6280c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37916/0 (socket says 172.21.15.132:37916) 2023-11-18T20:40:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.972+0000 7fd62ec8f640 1 -- 172.21.15.132:0/77285998 learned_addr learned my addr 172.21.15.132:0/77285998 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.972+0000 7fd62dc8d640 1 --2- 172.21.15.132:0/77285998 >> v2:172.21.15.161:3300/0 conn(0x7fd6280a9b40 0x7fd6280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466175918 0 0) 0x7fd6280c06c0 con 0x7fd6280c1500 2023-11-18T20:40:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd618003520 con 0x7fd6280c1500 2023-11-18T20:40:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 380472620 0 0) 0x7fd618003520 con 0x7fd6280c1500 2023-11-18T20:40:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 >> v2:172.21.15.161:3300/0 conn(0x7fd6280a9b40 msgr2=0x7fd6280a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 --2- 172.21.15.132:0/77285998 >> v2:172.21.15.161:3300/0 conn(0x7fd6280a9b40 0x7fd6280a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 >> v1:172.21.15.161:6789/0 conn(0x7fd628155490 legacy=0x7fd6280a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280c0910 con 0x7fd6280c1500 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fd620001670 con 0x7fd6280c1500 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 >> v1:172.21.15.132:6789/0 conn(0x7fd6280c1500 legacy=0x7fd6280c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd618003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6180047c0 0x7fd618004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd618005180 0x7fd61800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61800c050 con 0x7fd6180039c0 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61800e3d0 con 0x7fd6180047c0 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.973+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61800e590 con 0x7fd618005180 2023-11-18T20:40:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.974+0000 7fd62e48e640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd618003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.974+0000 7fd62ec8f640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd618005180 0x7fd61800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.974+0000 7fd62e48e640 1 -- 172.21.15.132:0/77285998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd618005180 msgr2=0x7fd61800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.974+0000 7fd62e48e640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd618005180 0x7fd61800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.974+0000 7fd62e48e640 1 -- 172.21.15.132:0/77285998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6180047c0 msgr2=0x7fd618004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.974+0000 7fd62e48e640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6180047c0 0x7fd618004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.974+0000 7fd62e48e640 1 -- 172.21.15.132:0/77285998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618003520 con 0x7fd6180039c0 2023-11-18T20:40:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.974+0000 7fd62ec8f640 1 -- 172.21.15.132:0/77285998 reap_dead start 2023-11-18T20:40:01.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.975+0000 7fd62e48e640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd618003de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd61c001e50 tx=0x7fd6180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58482df47462c754 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.975+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c003b70 con 0x7fd6180039c0 2023-11-18T20:40:01.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.975+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c003cd0 con 0x7fd6180039c0 2023-11-18T20:40:01.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.975+0000 7fd62d48c640 1 -- 172.21.15.132:0/77285998 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c005310 con 0x7fd6180039c0 2023-11-18T20:40:01.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.976+0000 7fd6306f2640 1 -- 172.21.15.132:0/77285998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 msgr2=0x7fd618003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.976+0000 7fd6306f2640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd618003de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd61c001e50 tx=0x7fd6180057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.976+0000 7fd6306f2640 1 -- 172.21.15.132:0/77285998 shutdown_connections 2023-11-18T20:40:01.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.976+0000 7fd6306f2640 1 --2- 172.21.15.132:0/77285998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd618003de0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.976+0000 7fd6306f2640 1 -- 172.21.15.132:0/77285998 >> 172.21.15.132:0/77285998 conn(0x7fd62806a500 msgr2=0x7fd62806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:01.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.976+0000 7fd6306f2640 1 -- 172.21.15.132:0/77285998 shutdown_connections 2023-11-18T20:40:01.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.976+0000 7fd6306f2640 1 -- 172.21.15.132:0/77285998 wait complete. 2023-11-18T20:40:01.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.978+0000 7fd6306f2640 1 Processor -- start 2023-11-18T20:40:01.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.978+0000 7fd6306f2640 1 -- start start 2023-11-18T20:40:01.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd6306f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd6281e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd6306f2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6281e63d0 0x7fd628071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd6306f2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280bace0 0x7fd62814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd6306f2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280bccb0 con 0x7fd6180039c0 2023-11-18T20:40:01.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd6306f2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6281e95d0 con 0x7fd6280bace0 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd6306f2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280a7300 con 0x7fd6281e63d0 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd62e48e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd6281e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd62e48e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd6281e9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38416/0 (socket says 172.21.15.132:38416) 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd62e48e640 1 -- 172.21.15.132:0/1807064942 learned_addr learned my addr 172.21.15.132:0/1807064942 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd62e48e640 1 -- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6281e63d0 msgr2=0x7fd628071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd62e48e640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6281e63d0 0x7fd628071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd62e48e640 1 -- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280bace0 msgr2=0x7fd62814e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd62e48e640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280bace0 0x7fd62814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.979+0000 7fd62e48e640 1 -- 172.21.15.132:0/1807064942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6281e8f80 con 0x7fd6180039c0 2023-11-18T20:40:01.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.980+0000 7fd62e48e640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd6281e9a60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd61c005040 tx=0x7fd61c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.980+0000 7fd626ffd640 1 -- 172.21.15.132:0/1807064942 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c03e070 con 0x7fd6180039c0 2023-11-18T20:40:01.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.980+0000 7fd626ffd640 1 -- 172.21.15.132:0/1807064942 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c006b50 con 0x7fd6180039c0 2023-11-18T20:40:01.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.980+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6281e9260 con 0x7fd6180039c0 2023-11-18T20:40:01.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.980+0000 7fd626ffd640 1 -- 172.21.15.132:0/1807064942 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c007030 con 0x7fd6180039c0 2023-11-18T20:40:01.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.980+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6280715a0 con 0x7fd6180039c0 2023-11-18T20:40:01.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.981+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd628068350 con 0x7fd6180039c0 2023-11-18T20:40:01.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.982+0000 7fd626ffd640 1 -- 172.21.15.132:0/1807064942 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd61c007190 con 0x7fd6180039c0 2023-11-18T20:40:01.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.983+0000 7fd626ffd640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd60c06ae40 0x7fd60c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:01.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.983+0000 7fd626ffd640 1 -- 172.21.15.132:0/1807064942 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5944+0+0 (secure 0 0 0) 0x7fd61c0ab290 con 0x7fd6180039c0 2023-11-18T20:40:01.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.984+0000 7fd62dc8d640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd60c06ae40 0x7fd60c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:01.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.985+0000 7fd62dc8d640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd60c06ae40 0x7fd60c06d300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd614006e80 tx=0x7fd614006dd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:01.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:01.988+0000 7fd626ffd640 1 -- 172.21.15.132:0/1807064942 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd61c0762e0 con 0x7fd6180039c0 2023-11-18T20:40:02.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.219+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fd628152960 con 0x7fd6180039c0 2023-11-18T20:40:02.221 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-11-18T20:40:02.220+0000 7feee5f07640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-18T20:40:02.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.223+0000 7fd626ffd640 1 -- 172.21.15.132:0/1807064942 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd61c079900 con 0x7fd6180039c0 2023-11-18T20:40:02.224 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd60c06ae40 msgr2=0x7fd60c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd60c06ae40 0x7fd60c06d300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd614006e80 tx=0x7fd614006dd0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 msgr2=0x7fd6281e9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd6281e9a60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd61c005040 tx=0x7fd61c0014a0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 shutdown_connections 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd60c06ae40 0x7fd60c06d300 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280bace0 0x7fd62814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6281e63d0 0x7fd628071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.225+0000 7fd6306f2640 1 --2- 172.21.15.132:0/1807064942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6180039c0 0x7fd6281e9a60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.226+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 >> 172.21.15.132:0/1807064942 conn(0x7fd62806a500 msgr2=0x7fd628154000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:02.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.226+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 shutdown_connections 2023-11-18T20:40:02.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.226+0000 7fd6306f2640 1 -- 172.21.15.132:0/1807064942 wait complete. 2023-11-18T20:40:02.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-18T20:40:02.251 INFO:tasks.ceph.mds.d.smithi161.stderr: -2344> 2023-11-18T20:39:24.605+0000 7fc711c9c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:40:02.346 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-11-18T20:40:02.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.455+0000 7fda3b015640 1 Processor -- start 2023-11-18T20:40:02.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.455+0000 7fda3b015640 1 -- start start 2023-11-18T20:40:02.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.456+0000 7fda3b015640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda3414fd30 0x7fda34152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:02.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.456+0000 7fda3b015640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340c64a0 con 0x7fda340c3ea0 2023-11-18T20:40:02.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.457+0000 7fda3b015640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340c5c00 con 0x7fda3406d0a0 2023-11-18T20:40:02.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.457+0000 7fda3b015640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c5ee0 con 0x7fda3414fd30 2023-11-18T20:40:02.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.457+0000 7fda395b2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fda340c3ea0 0x7fda340c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37928/0 (socket says 172.21.15.132:37928) 2023-11-18T20:40:02.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.457+0000 7fda395b2640 1 -- 172.21.15.132:0/2578458900 learned_addr learned my addr 172.21.15.132:0/2578458900 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.457+0000 7fda38db1640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda3414fd30 0x7fda34152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.457+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103740235 0 0) 0x7fda340c64a0 con 0x7fda340c3ea0 2023-11-18T20:40:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.457+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda24003520 con 0x7fda340c3ea0 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2036849484 0 0) 0x7fda24003520 con 0x7fda340c3ea0 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda3414fd30 msgr2=0x7fda34152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda3414fd30 0x7fda34152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 >> v1:172.21.15.161:6789/0 conn(0x7fda3406d0a0 legacy=0x7fda340a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340c61c0 con 0x7fda340c3ea0 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fda2c0019f0 con 0x7fda340c3ea0 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 >> v1:172.21.15.132:6789/0 conn(0x7fda340c3ea0 legacy=0x7fda340c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda3414fd30 0x7fda240039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda24004d00 0x7fda24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c5ee0 con 0x7fda24003f70 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2400bac0 con 0x7fda24004d00 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2400bc80 con 0x7fda3414fd30 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.458+0000 7fda33fff640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.459+0000 7fda38db1640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda3414fd30 0x7fda240039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.459+0000 7fda33fff640 1 -- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda3414fd30 msgr2=0x7fda240039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.459+0000 7fda33fff640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda3414fd30 0x7fda240039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.459+0000 7fda395b2640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda24004d00 0x7fda24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.459+0000 7fda33fff640 1 -- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda24004d00 msgr2=0x7fda24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.459+0000 7fda33fff640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda24004d00 0x7fda24005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.459+0000 7fda33fff640 1 -- 172.21.15.132:0/2578458900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24003520 con 0x7fda24003f70 2023-11-18T20:40:02.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.460+0000 7fda33fff640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda240047c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fda20001720 tx=0x7fda240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dc8959fa09776f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:02.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.460+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda200052d0 con 0x7fda24003f70 2023-11-18T20:40:02.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.460+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2002e050 con 0x7fda24003f70 2023-11-18T20:40:02.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.460+0000 7fda337fe640 1 -- 172.21.15.132:0/2578458900 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20003830 con 0x7fda24003f70 2023-11-18T20:40:02.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.461+0000 7fda3b015640 1 -- 172.21.15.132:0/2578458900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 msgr2=0x7fda240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:02.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.461+0000 7fda3b015640 1 --2- 172.21.15.132:0/2578458900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda240047c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fda20001720 tx=0x7fda240057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.461+0000 7fda395b2640 1 -- 172.21.15.132:0/2578458900 reap_dead start 2023-11-18T20:40:02.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.461+0000 7fda3b015640 1 -- 172.21.15.132:0/2578458900 shutdown_connections 2023-11-18T20:40:02.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.461+0000 7fda3b015640 1 -- 172.21.15.132:0/2578458900 >> 172.21.15.132:0/2578458900 conn(0x7fda3406a500 msgr2=0x7fda3406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:02.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.461+0000 7fda3b015640 1 -- 172.21.15.132:0/2578458900 shutdown_connections 2023-11-18T20:40:02.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.461+0000 7fda3b015640 1 -- 172.21.15.132:0/2578458900 wait complete. 2023-11-18T20:40:02.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.463+0000 7fda3b015640 1 Processor -- start 2023-11-18T20:40:02.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.463+0000 7fda3b015640 1 -- start start 2023-11-18T20:40:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda3b015640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda340a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda3b015640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda340bf0f0 0x7fda340bf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda3b015640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda341ed8e0 0x7fda341edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda3b015640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda341eb7e0 con 0x7fda24003f70 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda3b015640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340aa4e0 con 0x7fda340bf0f0 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda3b015640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340aa730 con 0x7fda341ed8e0 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda38db1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda340a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda38db1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda340a9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38436/0 (socket says 172.21.15.132:38436) 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.464+0000 7fda38db1640 1 -- 172.21.15.132:0/2868005186 learned_addr learned my addr 172.21.15.132:0/2868005186 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda395b2640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda341ed8e0 0x7fda341edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda38db1640 1 -- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda341ed8e0 msgr2=0x7fda341edd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda38db1640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda341ed8e0 0x7fda341edd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda33fff640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda340bf0f0 0x7fda340bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda38db1640 1 -- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda340bf0f0 msgr2=0x7fda340bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda38db1640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda340bf0f0 0x7fda340bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda38db1640 1 -- 172.21.15.132:0/2868005186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340aaa10 con 0x7fda24003f70 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda395b2640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda341ed8e0 0x7fda341edd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda38db1640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda340a9880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fda28011600 tx=0x7fda28011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda317fa640 1 -- 172.21.15.132:0/2868005186 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2800f8c0 con 0x7fda24003f70 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda317fa640 1 -- 172.21.15.132:0/2868005186 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2800fa20 con 0x7fda24003f70 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda317fa640 1 -- 172.21.15.132:0/2868005186 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2800fd90 con 0x7fda24003f70 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.465+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda340aacf0 con 0x7fda24003f70 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.466+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda340a9dc0 con 0x7fda24003f70 2023-11-18T20:40:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.466+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda34068350 con 0x7fda24003f70 2023-11-18T20:40:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.467+0000 7fda317fa640 1 -- 172.21.15.132:0/2868005186 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda28015460 con 0x7fda24003f70 2023-11-18T20:40:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.468+0000 7fda317fa640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda1806ae40 0x7fda1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.469+0000 7fda317fa640 1 -- 172.21.15.132:0/2868005186 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6030+0+0 (secure 0 0 0) 0x7fda28089c60 con 0x7fda24003f70 2023-11-18T20:40:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.469+0000 7fda33fff640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda1806ae40 0x7fda1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.470+0000 7fda33fff640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda1806ae40 0x7fda1806d300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fda20033000 tx=0x7fda20009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:02.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.473+0000 7fda317fa640 1 -- 172.21.15.132:0/2868005186 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda28054bc0 con 0x7fda24003f70 2023-11-18T20:40:02.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:02.709+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fda340c66d0 con 0x7fda24003f70 2023-11-18T20:40:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.226+0000 7fda317fa640 1 -- 172.21.15.132:0/2868005186 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 105+0+0 (secure 0 0 0) 0x7fda280220b0 con 0x7fda24003f70 2023-11-18T20:40:03.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.230+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda1806ae40 msgr2=0x7fda1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:03.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.230+0000 7fda3b015640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda1806ae40 0x7fda1806d300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fda20033000 tx=0x7fda20009030 comp rx=0 tx=0).stop 2023-11-18T20:40:03.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.230+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 msgr2=0x7fda340a9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:03.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.230+0000 7fda3b015640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda340a9880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fda28011600 tx=0x7fda28011ac0 comp rx=0 tx=0).stop 2023-11-18T20:40:03.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.231+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 shutdown_connections 2023-11-18T20:40:03.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.231+0000 7fda3b015640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda1806ae40 0x7fda1806d300 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:03.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.231+0000 7fda3b015640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda341ed8e0 0x7fda341edd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:03.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.231+0000 7fda3b015640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda340bf0f0 0x7fda340bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:03.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.231+0000 7fda3b015640 1 --2- 172.21.15.132:0/2868005186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda24003f70 0x7fda340a9880 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:03.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.231+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 >> 172.21.15.132:0/2868005186 conn(0x7fda3406a500 msgr2=0x7fda340c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:03.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.231+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 shutdown_connections 2023-11-18T20:40:03.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.231+0000 7fda3b015640 1 -- 172.21.15.132:0/2868005186 wait complete. 2023-11-18T20:40:03.256 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-18T20:40:03.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.480+0000 7f899a8ec640 1 Processor -- start 2023-11-18T20:40:03.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.480+0000 7f899a8ec640 1 -- start start 2023-11-18T20:40:03.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.481+0000 7f899a8ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89940c48a0 0x7f89940c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:03.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.481+0000 7f899a8ec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8994155680 con 0x7f899406b660 2023-11-18T20:40:03.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.481+0000 7f899a8ec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8994154a70 con 0x7f8994151d20 2023-11-18T20:40:03.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.481+0000 7f899a8ec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8994154d50 con 0x7f89940c48a0 2023-11-18T20:40:03.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.482+0000 7f89937fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89940c48a0 0x7f89940c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:03.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.482+0000 7f8998e89640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f899406b660 0x7f899406bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37934/0 (socket says 172.21.15.132:37934) 2023-11-18T20:40:03.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.482+0000 7f8998e89640 1 -- 172.21.15.132:0/3731104687 learned_addr learned my addr 172.21.15.132:0/3731104687 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:03.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.482+0000 7f89937fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89940c48a0 0x7f89940c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38438/0 (socket says 172.21.15.132:38438) 2023-11-18T20:40:03.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.482+0000 7f89937fe640 1 -- 172.21.15.132:0/3731104687 >> v1:172.21.15.161:6789/0 conn(0x7f8994151d20 legacy=0x7f89940c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:03.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.482+0000 7f89937fe640 1 -- 172.21.15.132:0/3731104687 >> v1:172.21.15.132:6789/0 conn(0x7f899406b660 legacy=0x7f899406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:03.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.482+0000 7f89937fe640 1 -- 172.21.15.132:0/3731104687 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8994155030 con 0x7f89940c48a0 2023-11-18T20:40:03.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.482+0000 7f8992ffd640 1 -- 172.21.15.132:0/3731104687 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968362465 0 0) 0x7f8994155680 con 0x7f899406b660 2023-11-18T20:40:03.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.483+0000 7f89937fe640 1 --2- 172.21.15.132:0/3731104687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89940c48a0 0x7f89940c4d00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f897c009790 tx=0x7f897c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99eed757b76900e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:03.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f8992ffd640 1 -- 172.21.15.132:0/3731104687 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c02e070 con 0x7f89940c48a0 2023-11-18T20:40:03.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f8992ffd640 1 -- 172.21.15.132:0/3731104687 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c0315a0 con 0x7f89940c48a0 2023-11-18T20:40:03.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f8992ffd640 1 -- 172.21.15.132:0/3731104687 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c031930 con 0x7f89940c48a0 2023-11-18T20:40:03.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f899a8ec640 1 -- 172.21.15.132:0/3731104687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89940c48a0 msgr2=0x7f89940c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:03.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f899a8ec640 1 --2- 172.21.15.132:0/3731104687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89940c48a0 0x7f89940c4d00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f897c009790 tx=0x7f897c02b840 comp rx=0 tx=0).stop 2023-11-18T20:40:03.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f899a8ec640 1 -- 172.21.15.132:0/3731104687 shutdown_connections 2023-11-18T20:40:03.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f899a8ec640 1 --2- 172.21.15.132:0/3731104687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89940c48a0 0x7f89940c4d00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:03.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f899a8ec640 1 -- 172.21.15.132:0/3731104687 >> 172.21.15.132:0/3731104687 conn(0x7f89940abcf0 msgr2=0x7f89940ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:03.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f899a8ec640 1 -- 172.21.15.132:0/3731104687 shutdown_connections 2023-11-18T20:40:03.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.484+0000 7f899a8ec640 1 -- 172.21.15.132:0/3731104687 wait complete. 2023-11-18T20:40:03.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.486+0000 7f899a8ec640 1 Processor -- start 2023-11-18T20:40:03.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.486+0000 7f899a8ec640 1 -- start start 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f899a8ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899406b660 0x7f89940c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f899a8ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c48a0 0x7f89941eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f899a8ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8994151d20 0x7f89941e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f899a8ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89940c1c90 con 0x7f8994151d20 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f899a8ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89941e77f0 con 0x7f899406b660 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f899a8ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89940aa420 con 0x7f89940c48a0 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f8998e89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8994151d20 0x7f89941e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f8998e89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8994151d20 0x7f89941e72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38444/0 (socket says 172.21.15.132:38444) 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.487+0000 7f8998e89640 1 -- 172.21.15.132:0/304110133 learned_addr learned my addr 172.21.15.132:0/304110133 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8993fff640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899406b660 0x7f89940c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8998e89640 1 -- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c48a0 msgr2=0x7f89941eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:03.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8998e89640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c48a0 0x7f89941eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:03.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8998e89640 1 -- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899406b660 msgr2=0x7f89940c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:03.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8998e89640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899406b660 0x7f89940c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:03.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8998e89640 1 -- 172.21.15.132:0/304110133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0093a0 con 0x7f8994151d20 2023-11-18T20:40:03.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8998e89640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8994151d20 0x7f89941e72b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f898c00c480 tx=0x7f898c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:03.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8990ff9640 1 -- 172.21.15.132:0/304110133 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c0074e0 con 0x7f8994151d20 2023-11-18T20:40:03.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8990ff9640 1 -- 172.21.15.132:0/304110133 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c007660 con 0x7f8994151d20 2023-11-18T20:40:03.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f8990ff9640 1 -- 172.21.15.132:0/304110133 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c004a20 con 0x7f8994151d20 2023-11-18T20:40:03.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.488+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89940aa9e0 con 0x7f8994151d20 2023-11-18T20:40:03.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.489+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89940c1370 con 0x7f8994151d20 2023-11-18T20:40:03.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.490+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89940aab70 con 0x7f8994151d20 2023-11-18T20:40:03.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.491+0000 7f8990ff9640 1 -- 172.21.15.132:0/304110133 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f898c004b80 con 0x7f8994151d20 2023-11-18T20:40:03.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.491+0000 7f8990ff9640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f897406ae40 0x7f897406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:03.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.492+0000 7f8990ff9640 1 -- 172.21.15.132:0/304110133 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6030+0+0 (secure 0 0 0) 0x7f898c088940 con 0x7f8994151d20 2023-11-18T20:40:03.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.492+0000 7f8993fff640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f897406ae40 0x7f897406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:03.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.493+0000 7f8993fff640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f897406ae40 0x7f897406d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8984009f20 tx=0x7f89840094d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:03.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.496+0000 7f8990ff9640 1 -- 172.21.15.132:0/304110133 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f898c0538a0 con 0x7f8994151d20 2023-11-18T20:40:03.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:03.688+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8994152100 con 0x7f8994151d20 2023-11-18T20:40:04.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.697+0000 7f8990ff9640 1 -- 172.21.15.132:0/304110133 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7f898c018020 con 0x7f8994151d20 2023-11-18T20:40:04.699 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_metadata' removed 2023-11-18T20:40:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f897406ae40 msgr2=0x7f897406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f897406ae40 0x7f897406d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8984009f20 tx=0x7f89840094d0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8994151d20 msgr2=0x7f89941e72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8994151d20 0x7f89941e72b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f898c00c480 tx=0x7f898c00c940 comp rx=0 tx=0).stop 2023-11-18T20:40:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 shutdown_connections 2023-11-18T20:40:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f897406ae40 0x7f897406d300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8994151d20 0x7f89941e72b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c48a0 0x7f89941eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 --2- 172.21.15.132:0/304110133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899406b660 0x7f89940c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.700+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 >> 172.21.15.132:0/304110133 conn(0x7f89940abcf0 msgr2=0x7f89940ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:04.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.701+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 shutdown_connections 2023-11-18T20:40:04.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.701+0000 7f899a8ec640 1 -- 172.21.15.132:0/304110133 wait complete. 2023-11-18T20:40:04.725 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-18T20:40:04.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.938+0000 7fcb3b1a9640 1 Processor -- start 2023-11-18T20:40:04.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.938+0000 7fcb3b1a9640 1 -- start start 2023-11-18T20:40:04.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.939+0000 7fcb3b1a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 0x7fcb340c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:04.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.939+0000 7fcb3b1a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb340c0980 con 0x7fcb34071f70 2023-11-18T20:40:04.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.939+0000 7fcb3b1a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3406c070 con 0x7fcb3414fa80 2023-11-18T20:40:04.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.939+0000 7fcb3b1a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3406d160 con 0x7fcb34072530 2023-11-18T20:40:04.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.939+0000 7fcb39746640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcb34071f70 0x7fcb340c2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37938/0 (socket says 172.21.15.132:37938) 2023-11-18T20:40:04.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.939+0000 7fcb39746640 1 -- 172.21.15.132:0/2291361992 learned_addr learned my addr 172.21.15.132:0/2291361992 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:04.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb33fff640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 0x7fcb340c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:04.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373037015 0 0) 0x7fcb340c0980 con 0x7fcb34071f70 2023-11-18T20:40:04.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb24003520 con 0x7fcb34071f70 2023-11-18T20:40:04.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1232809447 0 0) 0x7fcb24003520 con 0x7fcb34071f70 2023-11-18T20:40:04.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 msgr2=0x7fcb340c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 0x7fcb340c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 >> v1:172.21.15.161:6789/0 conn(0x7fcb3414fa80 legacy=0x7fcb3406d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb340c20d0 con 0x7fcb34071f70 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fcb2c0019f0 con 0x7fcb34071f70 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 >> v1:172.21.15.132:6789/0 conn(0x7fcb34071f70 legacy=0x7fcb340c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb240039a0 0x7fcb24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.940+0000 7fcb337fe640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 0x7fcb240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb337fe640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3406d160 con 0x7fcb24004d00 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2400bb10 con 0x7fcb240039a0 2023-11-18T20:40:04.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2400bca0 con 0x7fcb34072530 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb39746640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb33fff640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 0x7fcb240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb38f45640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb240039a0 0x7fcb24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb39746640 1 -- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 msgr2=0x7fcb240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb39746640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 0x7fcb240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb39746640 1 -- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb240039a0 msgr2=0x7fcb24003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb39746640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb240039a0 0x7fcb24003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb39746640 1 -- 172.21.15.132:0/2291361992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24003520 con 0x7fcb24004d00 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb33fff640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb34072530 0x7fcb240047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.941+0000 7fcb38f45640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb240039a0 0x7fcb24003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:04.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.942+0000 7fcb39746640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb24005180 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00a860 tx=0x7fcb240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5fc34d94a071d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:04.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.942+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0072d0 con 0x7fcb24004d00 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c02f070 con 0x7fcb24004d00 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb337fe640 1 -- 172.21.15.132:0/2291361992 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0076b0 con 0x7fcb24004d00 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/2291361992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 msgr2=0x7fcb24005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb3b1a9640 1 --2- 172.21.15.132:0/2291361992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb24005180 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00a860 tx=0x7fcb240057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb39746640 1 -- 172.21.15.132:0/2291361992 reap_dead start 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/2291361992 shutdown_connections 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/2291361992 >> 172.21.15.132:0/2291361992 conn(0x7fcb340c5bc0 msgr2=0x7fcb340c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/2291361992 shutdown_connections 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.943+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/2291361992 wait complete. 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.945+0000 7fcb3b1a9640 1 Processor -- start 2023-11-18T20:40:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.945+0000 7fcb3b1a9640 1 -- start start 2023-11-18T20:40:04.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb3b1a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb341e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:04.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb3b1a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb340a4d20 0x7fcb340beff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:04.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb3b1a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb340bf530 0x7fcb341eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:04.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb3b1a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34147830 con 0x7fcb24004d00 2023-11-18T20:40:04.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb3b1a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb340a51a0 con 0x7fcb340bf530 2023-11-18T20:40:04.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb3b1a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb340aa5d0 con 0x7fcb340a4d20 2023-11-18T20:40:04.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb38f45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb341e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb38f45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb341e9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38454/0 (socket says 172.21.15.132:38454) 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.946+0000 7fcb38f45640 1 -- 172.21.15.132:0/1448606424 learned_addr learned my addr 172.21.15.132:0/1448606424 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb39746640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb340bf530 0x7fcb341eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb38f45640 1 -- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb340a4d20 msgr2=0x7fcb340beff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb38f45640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb340a4d20 0x7fcb340beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb38f45640 1 -- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb340bf530 msgr2=0x7fcb341eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb38f45640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb340bf530 0x7fcb341eda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb38f45640 1 -- 172.21.15.132:0/1448606424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb340aa8b0 con 0x7fcb24004d00 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb38f45640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb341e9e60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800d7a0 tx=0x7fcb2800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb317fa640 1 -- 172.21.15.132:0/1448606424 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28017070 con 0x7fcb24004d00 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb317fa640 1 -- 172.21.15.132:0/1448606424 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb28005070 con 0x7fcb24004d00 2023-11-18T20:40:04.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb317fa640 1 -- 172.21.15.132:0/1448606424 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28005420 con 0x7fcb24004d00 2023-11-18T20:40:04.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.947+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb340aab90 con 0x7fcb24004d00 2023-11-18T20:40:04.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.948+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb341edfd0 con 0x7fcb24004d00 2023-11-18T20:40:04.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.949+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb341ed3d0 con 0x7fcb24004d00 2023-11-18T20:40:04.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.950+0000 7fcb317fa640 1 -- 172.21.15.132:0/1448606424 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb28007030 con 0x7fcb24004d00 2023-11-18T20:40:04.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.951+0000 7fcb317fa640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb1806ae70 0x7fcb1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:04.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.951+0000 7fcb317fa640 1 -- 172.21.15.132:0/1448606424 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5590+0+0 (secure 0 0 0) 0x7fcb28088cf0 con 0x7fcb24004d00 2023-11-18T20:40:04.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.951+0000 7fcb33fff640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb1806ae70 0x7fcb1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:04.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.952+0000 7fcb33fff640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb1806ae70 0x7fcb1806d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcb20006fd0 tx=0x7fcb20009350 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:04.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:04.955+0000 7fcb317fa640 1 -- 172.21.15.132:0/1448606424 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb341ed3d0 con 0x7fcb24004d00 2023-11-18T20:40:05.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.148+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb341ed3d0 con 0x7fcb24004d00 2023-11-18T20:40:05.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.700+0000 7fcb317fa640 1 -- 172.21.15.132:0/1448606424 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v47) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcb341ed3d0 con 0x7fcb24004d00 2023-11-18T20:40:05.702 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_data' removed 2023-11-18T20:40:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.703+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb1806ae70 msgr2=0x7fcb1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.703+0000 7fcb3b1a9640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb1806ae70 0x7fcb1806d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcb20006fd0 tx=0x7fcb20009350 comp rx=0 tx=0).stop 2023-11-18T20:40:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.703+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 msgr2=0x7fcb341e9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.703+0000 7fcb3b1a9640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb341e9e60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800d7a0 tx=0x7fcb2800dc60 comp rx=0 tx=0).stop 2023-11-18T20:40:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.703+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 shutdown_connections 2023-11-18T20:40:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.703+0000 7fcb3b1a9640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb1806ae70 0x7fcb1806d330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.703+0000 7fcb3b1a9640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb340bf530 0x7fcb341eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.704+0000 7fcb3b1a9640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb340a4d20 0x7fcb340beff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.704+0000 7fcb3b1a9640 1 --2- 172.21.15.132:0/1448606424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb24004d00 0x7fcb341e9e60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.704+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 >> 172.21.15.132:0/1448606424 conn(0x7fcb340c5bc0 msgr2=0x7fcb3414d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.704+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 shutdown_connections 2023-11-18T20:40:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.704+0000 7fcb3b1a9640 1 -- 172.21.15.132:0/1448606424 wait complete. 2023-11-18T20:40:05.729 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-18T20:40:05.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.917+0000 7f8589997640 1 Processor -- start 2023-11-18T20:40:05.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.917+0000 7f8589997640 1 -- start start 2023-11-18T20:40:05.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.918+0000 7f8589997640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f858406d0a0 0x7f8584152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:05.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.918+0000 7f8589997640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85840c64a0 con 0x7f858414fd30 2023-11-18T20:40:05.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.918+0000 7f8589997640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85840c5c00 con 0x7f85840c3ea0 2023-11-18T20:40:05.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.918+0000 7f8589997640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85840c5ee0 con 0x7f858406d0a0 2023-11-18T20:40:05.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.919+0000 7f857bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f858406d0a0 0x7f8584152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:05.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.919+0000 7f857bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f858406d0a0 0x7f8584152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38458/0 (socket says 172.21.15.132:38458) 2023-11-18T20:40:05.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.919+0000 7f857bfff640 1 -- 172.21.15.132:0/3588617569 learned_addr learned my addr 172.21.15.132:0/3588617569 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:05.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.919+0000 7f857bfff640 1 -- 172.21.15.132:0/3588617569 >> v1:172.21.15.161:6789/0 conn(0x7f85840c3ea0 legacy=0x7f85840c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:05.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.919+0000 7f857bfff640 1 -- 172.21.15.132:0/3588617569 >> v1:172.21.15.132:6789/0 conn(0x7f858414fd30 legacy=0x7f85840a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:05.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.919+0000 7f857bfff640 1 -- 172.21.15.132:0/3588617569 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85840c61c0 con 0x7f858406d0a0 2023-11-18T20:40:05.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.920+0000 7f857bfff640 1 --2- 172.21.15.132:0/3588617569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858406d0a0 0x7f8584152f20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f856c009870 tx=0x7f856c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38072c4eddbff89b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:05.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.920+0000 7f85827fc640 1 -- 172.21.15.132:0/3588617569 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c030860 con 0x7f858406d0a0 2023-11-18T20:40:05.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.920+0000 7f85827fc640 1 -- 172.21.15.132:0/3588617569 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c0309c0 con 0x7f858406d0a0 2023-11-18T20:40:05.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.920+0000 7f85827fc640 1 -- 172.21.15.132:0/3588617569 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c030d50 con 0x7f858406d0a0 2023-11-18T20:40:05.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.921+0000 7f8589997640 1 -- 172.21.15.132:0/3588617569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858406d0a0 msgr2=0x7f8584152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:05.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.921+0000 7f8589997640 1 --2- 172.21.15.132:0/3588617569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858406d0a0 0x7f8584152f20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f856c009870 tx=0x7f856c02b9a0 comp rx=0 tx=0).stop 2023-11-18T20:40:05.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.921+0000 7f8589997640 1 -- 172.21.15.132:0/3588617569 shutdown_connections 2023-11-18T20:40:05.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.921+0000 7f8589997640 1 --2- 172.21.15.132:0/3588617569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858406d0a0 0x7f8584152f20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:05.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.921+0000 7f8589997640 1 -- 172.21.15.132:0/3588617569 >> 172.21.15.132:0/3588617569 conn(0x7f858406a500 msgr2=0x7f858406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:05.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.921+0000 7f8589997640 1 -- 172.21.15.132:0/3588617569 shutdown_connections 2023-11-18T20:40:05.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.921+0000 7f8589997640 1 -- 172.21.15.132:0/3588617569 wait complete. 2023-11-18T20:40:05.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.923+0000 7f8589997640 1 Processor -- start 2023-11-18T20:40:05.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.923+0000 7f8589997640 1 -- start start 2023-11-18T20:40:05.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.923+0000 7f8589997640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f858406d0a0 0x7f85841e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:05.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.923+0000 7f8589997640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85840c3ea0 0x7f8584156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:05.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.923+0000 7f8589997640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858414fd30 0x7f85841555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:05.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.923+0000 7f8589997640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8584154090 con 0x7f858414fd30 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f8589997640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85841e90e0 con 0x7f85840c3ea0 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f8589997640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8584153db0 con 0x7f858406d0a0 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858414fd30 0x7f85841555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858414fd30 0x7f85841555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38466/0 (socket says 172.21.15.132:38466) 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 -- 172.21.15.132:0/841250987 learned_addr learned my addr 172.21.15.132:0/841250987 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 -- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f858406d0a0 msgr2=0x7f85841e8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f858406d0a0 0x7f85841e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 -- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85840c3ea0 msgr2=0x7f8584156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85840c3ea0 0x7f8584156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 -- 172.21.15.132:0/841250987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0094d0 con 0x7f858414fd30 2023-11-18T20:40:05.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.924+0000 7f85837fe640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858414fd30 0x7f85841555b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c780 tx=0x7f857c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:05.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.925+0000 7f8580ff9640 1 -- 172.21.15.132:0/841250987 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c003d80 con 0x7f858414fd30 2023-11-18T20:40:05.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.925+0000 7f8580ff9640 1 -- 172.21.15.132:0/841250987 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c00ce30 con 0x7f858414fd30 2023-11-18T20:40:05.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.925+0000 7f8580ff9640 1 -- 172.21.15.132:0/841250987 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c005290 con 0x7f858414fd30 2023-11-18T20:40:05.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.925+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8584154ad0 con 0x7f858414fd30 2023-11-18T20:40:05.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.925+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8584155090 con 0x7f858414fd30 2023-11-18T20:40:05.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.926+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8584154930 con 0x7f858414fd30 2023-11-18T20:40:05.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.927+0000 7f8580ff9640 1 -- 172.21.15.132:0/841250987 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f857c0053f0 con 0x7f858414fd30 2023-11-18T20:40:05.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.928+0000 7f8580ff9640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f856406ae40 0x7f856406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:05.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.928+0000 7f8580ff9640 1 -- 172.21.15.132:0/841250987 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f857c088810 con 0x7f858414fd30 2023-11-18T20:40:05.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.928+0000 7f8582ffd640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f856406ae40 0x7f856406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:05.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.929+0000 7f8582ffd640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f856406ae40 0x7f856406d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8574000f60 tx=0x7f85740079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:05.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:05.932+0000 7f8580ff9640 1 -- 172.21.15.132:0/841250987 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8584154930 con 0x7f858414fd30 2023-11-18T20:40:06.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.109+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8584154930 con 0x7f858414fd30 2023-11-18T20:40:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.116+0000 7f8580ff9640 1 -- 172.21.15.132:0/841250987 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8584154930 con 0x7f858414fd30 2023-11-18T20:40:06.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f856406ae40 msgr2=0x7f856406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f856406ae40 0x7f856406d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8574000f60 tx=0x7f85740079b0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858414fd30 msgr2=0x7f85841555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858414fd30 0x7f85841555b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c780 tx=0x7f857c00cc40 comp rx=0 tx=0).stop 2023-11-18T20:40:06.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 shutdown_connections 2023-11-18T20:40:06.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f856406ae40 0x7f856406d300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858414fd30 0x7f85841555b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85840c3ea0 0x7f8584156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 --2- 172.21.15.132:0/841250987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f858406d0a0 0x7f85841e8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 >> 172.21.15.132:0/841250987 conn(0x7f858406a500 msgr2=0x7f85840c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:06.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 shutdown_connections 2023-11-18T20:40:06.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.119+0000 7f8589997640 1 -- 172.21.15.132:0/841250987 wait complete. 2023-11-18T20:40:06.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-11-18T20:40:06.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.329+0000 7f28525d7640 1 Processor -- start 2023-11-18T20:40:06.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.329+0000 7f28525d7640 1 -- start start 2023-11-18T20:40:06.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.331+0000 7f28525d7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c14e7c0 0x7f284c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.331+0000 7f28525d7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f284c0c4c00 0x7f284c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.331+0000 7f28525d7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c158a60 con 0x7f284c0ca990 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.331+0000 7f28525d7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0c5b10 con 0x7f284c0c4c00 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.331+0000 7f28525d7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c157ca0 con 0x7f284c14e7c0 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.331+0000 7f28515d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c14e7c0 0x7f284c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.331+0000 7f2850dd4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f284c0c4c00 0x7f284c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.332+0000 7f2850dd4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f284c0c4c00 0x7f284c0ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:54508/0 (socket says 172.21.15.132:54508) 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.332+0000 7f2850dd4640 1 -- 172.21.15.132:0/540210201 learned_addr learned my addr 172.21.15.132:0/540210201 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:06.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.332+0000 7f28515d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c14e7c0 0x7f284c0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:37700/0 (socket says 172.21.15.132:37700) 2023-11-18T20:40:06.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.332+0000 7f28515d5640 1 -- 172.21.15.132:0/540210201 >> v2:172.21.15.161:3300/0 conn(0x7f284c0c4c00 msgr2=0x7f284c0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:06.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.332+0000 7f28515d5640 1 --2- 172.21.15.132:0/540210201 >> v2:172.21.15.161:3300/0 conn(0x7f284c0c4c00 0x7f284c0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.332+0000 7f28515d5640 1 -- 172.21.15.132:0/540210201 >> v1:172.21.15.161:6789/0 conn(0x7f284c0ca990 legacy=0x7f284c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.332+0000 7f28515d5640 1 -- 172.21.15.132:0/540210201 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c157f80 con 0x7f284c14e7c0 2023-11-18T20:40:06.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.332+0000 7f2850dd4640 1 --2- 172.21.15.132:0/540210201 >> v2:172.21.15.161:3300/0 conn(0x7f284c0c4c00 0x7f284c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:40:06.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.334+0000 7f28515d5640 1 --2- 172.21.15.132:0/540210201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c14e7c0 0x7f284c0c46c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097a0 tx=0x7f283c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74fe20015bd7c52f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:06.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f284bfff640 1 -- 172.21.15.132:0/540210201 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0316f0 con 0x7f284c14e7c0 2023-11-18T20:40:06.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f284bfff640 1 -- 172.21.15.132:0/540210201 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c031850 con 0x7f284c14e7c0 2023-11-18T20:40:06.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f284bfff640 1 -- 172.21.15.132:0/540210201 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c031be0 con 0x7f284c14e7c0 2023-11-18T20:40:06.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f28525d7640 1 -- 172.21.15.132:0/540210201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c14e7c0 msgr2=0x7f284c0c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f28525d7640 1 --2- 172.21.15.132:0/540210201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c14e7c0 0x7f284c0c46c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097a0 tx=0x7f283c02b790 comp rx=0 tx=0).stop 2023-11-18T20:40:06.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f28525d7640 1 -- 172.21.15.132:0/540210201 shutdown_connections 2023-11-18T20:40:06.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f28525d7640 1 --2- 172.21.15.132:0/540210201 >> v2:172.21.15.161:3300/0 conn(0x7f284c0c4c00 0x7f284c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f28525d7640 1 --2- 172.21.15.132:0/540210201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c14e7c0 0x7f284c0c46c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f28525d7640 1 -- 172.21.15.132:0/540210201 >> 172.21.15.132:0/540210201 conn(0x7f284c0abf00 msgr2=0x7f284c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:06.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f28525d7640 1 -- 172.21.15.132:0/540210201 shutdown_connections 2023-11-18T20:40:06.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.335+0000 7f28525d7640 1 -- 172.21.15.132:0/540210201 wait complete. 2023-11-18T20:40:06.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.337+0000 7f28525d7640 1 Processor -- start 2023-11-18T20:40:06.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.337+0000 7f28525d7640 1 -- start start 2023-11-18T20:40:06.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28525d7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0c4c00 0x7f284c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28525d7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c0ca990 0x7f284c0c02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28525d7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f284c14e7c0 0x7f284c0bd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28525d7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c1ac0 con 0x7f284c0c4c00 2023-11-18T20:40:06.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28525d7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c17e0 con 0x7f284c14e7c0 2023-11-18T20:40:06.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28525d7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c157790 con 0x7f284c0ca990 2023-11-18T20:40:06.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28515d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0c4c00 0x7f284c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28515d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0c4c00 0x7f284c154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38476/0 (socket says 172.21.15.132:38476) 2023-11-18T20:40:06.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.338+0000 7f28515d5640 1 -- 172.21.15.132:0/861514929 learned_addr learned my addr 172.21.15.132:0/861514929 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f2850dd4640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c0ca990 0x7f284c0c02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f28515d5640 1 -- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c0ca990 msgr2=0x7f284c0c02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f2851dd6640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f284c14e7c0 0x7f284c0bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f28515d5640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c0ca990 0x7f284c0c02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f28515d5640 1 -- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f284c14e7c0 msgr2=0x7f284c0bd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f28515d5640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f284c14e7c0 0x7f284c0bd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f28515d5640 1 -- 172.21.15.132:0/861514929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28400094d0 con 0x7f284c0c4c00 2023-11-18T20:40:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f2851dd6640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f284c14e7c0 0x7f284c0bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:06.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f28515d5640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0c4c00 0x7f284c154b20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f283c0098c0 tx=0x7f283c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:06.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f2849ffb640 1 -- 172.21.15.132:0/861514929 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c034680 con 0x7f284c0c4c00 2023-11-18T20:40:06.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f2849ffb640 1 -- 172.21.15.132:0/861514929 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c0347e0 con 0x7f284c0c4c00 2023-11-18T20:40:06.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f2849ffb640 1 -- 172.21.15.132:0/861514929 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c034b90 con 0x7f284c0c4c00 2023-11-18T20:40:06.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.339+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c009400 con 0x7f284c0c4c00 2023-11-18T20:40:06.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.340+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c0c0eb0 con 0x7f284c0c4c00 2023-11-18T20:40:06.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.341+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c04e840 con 0x7f284c0c4c00 2023-11-18T20:40:06.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.342+0000 7f2849ffb640 1 -- 172.21.15.132:0/861514929 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f283c03b040 con 0x7f284c0c4c00 2023-11-18T20:40:06.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.343+0000 7f2849ffb640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f283806ae40 0x7f283806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.343+0000 7f2849ffb640 1 -- 172.21.15.132:0/861514929 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f283c0aaf90 con 0x7f284c0c4c00 2023-11-18T20:40:06.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.344+0000 7f2850dd4640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f283806ae40 0x7f283806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.345+0000 7f2850dd4640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f283806ae40 0x7f283806d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f284c149a70 tx=0x7f2840008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:06.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.347+0000 7f2849ffb640 1 -- 172.21.15.132:0/861514929 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f283c0dde90 con 0x7f284c0c4c00 2023-11-18T20:40:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.609+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f284c0c7c40 con 0x7f284c0c4c00 2023-11-18T20:40:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.716+0000 7f2849ffb640 1 -- 172.21.15.132:0/861514929 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v136) v1 ==== 159+0+0 (secure 0 0 0) 0x7f283c0762d0 con 0x7f284c0c4c00 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.719+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f283806ae40 msgr2=0x7f283806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.719+0000 7f28525d7640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f283806ae40 0x7f283806d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f284c149a70 tx=0x7f2840008040 comp rx=0 tx=0).stop 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.719+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0c4c00 msgr2=0x7f284c154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.719+0000 7f28525d7640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0c4c00 0x7f284c154b20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f283c0098c0 tx=0x7f283c0046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.720+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 shutdown_connections 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.720+0000 7f28525d7640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f283806ae40 0x7f283806d300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.720+0000 7f28525d7640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f284c14e7c0 0x7f284c0bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.720+0000 7f28525d7640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f284c0ca990 0x7f284c0c02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.720+0000 7f28525d7640 1 --2- 172.21.15.132:0/861514929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0c4c00 0x7f284c154b20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.720+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 >> 172.21.15.132:0/861514929 conn(0x7f284c0abf00 msgr2=0x7f284c14b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:06.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.720+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 shutdown_connections 2023-11-18T20:40:06.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.720+0000 7f28525d7640 1 -- 172.21.15.132:0/861514929 wait complete. 2023-11-18T20:40:06.740 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-11-18T20:40:06.741 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-11-18T20:40:06.741 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.951+0000 7f1a2f90f640 1 Processor -- start 2023-11-18T20:40:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.951+0000 7f1a2f90f640 1 -- start start 2023-11-18T20:40:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.953+0000 7f1a2f90f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a28155490 0x7f1a280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.953+0000 7f1a2f90f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a280a9b40 0x7f1a280c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.953+0000 7f1a2f90f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280c06c0 con 0x7f1a280c1500 2023-11-18T20:40:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.953+0000 7f1a2f90f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a280a5820 con 0x7f1a280a9b40 2023-11-18T20:40:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.953+0000 7f1a2f90f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280c1020 con 0x7f1a28155490 2023-11-18T20:40:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.953+0000 7f1a2ceaa640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1a280c1500 0x7f1a280a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37952/0 (socket says 172.21.15.132:37952) 2023-11-18T20:40:06.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.953+0000 7f1a2ceaa640 1 -- 172.21.15.132:0/1586544665 learned_addr learned my addr 172.21.15.132:0/1586544665 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.953+0000 7f1a2deac640 1 --2- 172.21.15.132:0/1586544665 >> v2:172.21.15.161:3300/0 conn(0x7f1a280a9b40 0x7f1a280c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a2d6ab640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a28155490 0x7f1a280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407638623 0 0) 0x7f1a280c06c0 con 0x7f1a280c1500 2023-11-18T20:40:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a14003520 con 0x7f1a280c1500 2023-11-18T20:40:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1305267201 0 0) 0x7f1a14003520 con 0x7f1a280c1500 2023-11-18T20:40:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a28155490 msgr2=0x7f1a280a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a28155490 0x7f1a280a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 >> v2:172.21.15.161:3300/0 conn(0x7f1a280a9b40 msgr2=0x7f1a280c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 --2- 172.21.15.132:0/1586544665 >> v2:172.21.15.161:3300/0 conn(0x7f1a280a9b40 0x7f1a280c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a280c0910 con 0x7f1a280c1500 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f1a18001670 con 0x7f1a280c1500 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 >> v1:172.21.15.132:6789/0 conn(0x7f1a280c1500 legacy=0x7f1a280a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a28155490 0x7f1a14003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a14004d00 0x7f1a14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280c1020 con 0x7f1a14003ef0 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1400db90 con 0x7f1a14004d00 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.954+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1400dcd0 con 0x7f1a28155490 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.955+0000 7f1a2ceaa640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.955+0000 7f1a2d6ab640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a28155490 0x7f1a14003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.955+0000 7f1a2deac640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a14004d00 0x7f1a14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.955+0000 7f1a2ceaa640 1 -- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a28155490 msgr2=0x7f1a14003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.955+0000 7f1a2ceaa640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a28155490 0x7f1a14003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.955+0000 7f1a2ceaa640 1 -- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a14004d00 msgr2=0x7f1a14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.955+0000 7f1a2ceaa640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a14004d00 0x7f1a14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.955+0000 7f1a2ceaa640 1 -- 172.21.15.132:0/1586544665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14003520 con 0x7f1a14003ef0 2023-11-18T20:40:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.956+0000 7f1a2ceaa640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a140047c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c240 tx=0x7f1a140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe35565cc6cb381 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.956+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1802cae0 con 0x7f1a14003ef0 2023-11-18T20:40:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.956+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1802cc40 con 0x7f1a14003ef0 2023-11-18T20:40:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.956+0000 7f1a1ffff640 1 -- 172.21.15.132:0/1586544665 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18005af0 con 0x7f1a14003ef0 2023-11-18T20:40:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.957+0000 7f1a2f90f640 1 -- 172.21.15.132:0/1586544665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 msgr2=0x7f1a140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.957+0000 7f1a2f90f640 1 --2- 172.21.15.132:0/1586544665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a140047c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c240 tx=0x7f1a140057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.957+0000 7f1a2deac640 1 -- 172.21.15.132:0/1586544665 reap_dead start 2023-11-18T20:40:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.957+0000 7f1a2f90f640 1 -- 172.21.15.132:0/1586544665 shutdown_connections 2023-11-18T20:40:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.957+0000 7f1a2f90f640 1 -- 172.21.15.132:0/1586544665 >> 172.21.15.132:0/1586544665 conn(0x7f1a2806a500 msgr2=0x7f1a2806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.957+0000 7f1a2f90f640 1 -- 172.21.15.132:0/1586544665 shutdown_connections 2023-11-18T20:40:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.957+0000 7f1a2f90f640 1 -- 172.21.15.132:0/1586544665 wait complete. 2023-11-18T20:40:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.959+0000 7f1a2f90f640 1 Processor -- start 2023-11-18T20:40:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.959+0000 7f1a2f90f640 1 -- start start 2023-11-18T20:40:06.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.959+0000 7f1a2f90f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a281e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.959+0000 7f1a2f90f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a2809b920 0x7f1a2809a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2f90f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a280a67c0 0x7f1a281e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2f90f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280a6330 con 0x7f1a14003ef0 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2f90f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28151d60 con 0x7f1a2809b920 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2f90f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280a5720 con 0x7f1a280a67c0 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2d6ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a281e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2d6ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a281e9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38508/0 (socket says 172.21.15.132:38508) 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2d6ab640 1 -- 172.21.15.132:0/3164735540 learned_addr learned my addr 172.21.15.132:0/3164735540 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2ceaa640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a2809b920 0x7f1a2809a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2deac640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a280a67c0 0x7f1a281e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2d6ab640 1 -- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a280a67c0 msgr2=0x7f1a281e6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2d6ab640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a280a67c0 0x7f1a281e6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2d6ab640 1 -- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a2809b920 msgr2=0x7f1a2809a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2d6ab640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a2809b920 0x7f1a2809a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:06.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2d6ab640 1 -- 172.21.15.132:0/3164735540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a280a5a00 con 0x7f1a14003ef0 2023-11-18T20:40:06.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.960+0000 7f1a2ceaa640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a2809b920 0x7f1a2809a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:06.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.961+0000 7f1a2d6ab640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a281e9ba0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1a24007f30 tx=0x7f1a24011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:06.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.961+0000 7f1a1dffb640 1 -- 172.21.15.132:0/3164735540 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400e030 con 0x7f1a14003ef0 2023-11-18T20:40:06.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.961+0000 7f1a1dffb640 1 -- 172.21.15.132:0/3164735540 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a24016470 con 0x7f1a14003ef0 2023-11-18T20:40:06.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.961+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a280a5ce0 con 0x7f1a14003ef0 2023-11-18T20:40:06.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.961+0000 7f1a1dffb640 1 -- 172.21.15.132:0/3164735540 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24016820 con 0x7f1a14003ef0 2023-11-18T20:40:06.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.961+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2809ac00 con 0x7f1a14003ef0 2023-11-18T20:40:06.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.962+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a280c0d10 con 0x7f1a14003ef0 2023-11-18T20:40:06.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.963+0000 7f1a1dffb640 1 -- 172.21.15.132:0/3164735540 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a24016980 con 0x7f1a14003ef0 2023-11-18T20:40:06.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.964+0000 7f1a1dffb640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a0c06ae70 0x7f1a0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:06.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.965+0000 7f1a1dffb640 1 -- 172.21.15.132:0/3164735540 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1a2400f070 con 0x7f1a14003ef0 2023-11-18T20:40:06.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.965+0000 7f1a2ceaa640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a0c06ae70 0x7f1a0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:06.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.966+0000 7f1a2ceaa640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a0c06ae70 0x7f1a0c06d330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a18034000 tx=0x7f1a18007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:06.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:06.969+0000 7f1a1dffb640 1 -- 172.21.15.132:0/3164735540 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a240bce90 con 0x7f1a14003ef0 2023-11-18T20:40:07.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.161+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a28068350 con 0x7f1a14003ef0 2023-11-18T20:40:07.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.162+0000 7f1a1dffb640 1 -- 172.21.15.132:0/3164735540 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+13156 (secure 0 0 0) 0x7f1a24055580 con 0x7f1a14003ef0 2023-11-18T20:40:07.164 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:07.165 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":47,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:05.697761+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6836/1926819956":"2023-11-19T20:40:02.220793+0000","172.21.15.161:6837/1926819956":"2023-11-19T20:40:02.220793+0000","172.21.15.132:6834/4266315561":"2023-11-19T20:39:54.536061+0000","172.21.15.132:6832/4266315561":"2023-11-19T20:39:54.536061+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:07.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a0c06ae70 msgr2=0x7f1a0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a0c06ae70 0x7f1a0c06d330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a18034000 tx=0x7f1a18007000 comp rx=0 tx=0).stop 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 msgr2=0x7f1a281e9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a281e9ba0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1a24007f30 tx=0x7f1a24011660 comp rx=0 tx=0).stop 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 shutdown_connections 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a0c06ae70 0x7f1a0c06d330 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a280a67c0 0x7f1a281e6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a2809b920 0x7f1a2809a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 --2- 172.21.15.132:0/3164735540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a14003ef0 0x7f1a281e9ba0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 >> 172.21.15.132:0/3164735540 conn(0x7f1a2806a500 msgr2=0x7f1a28071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 shutdown_connections 2023-11-18T20:40:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.165+0000 7f1a2f90f640 1 -- 172.21.15.132:0/3164735540 wait complete. 2023-11-18T20:40:07.185 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:40:07.186 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:40:07.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.391+0000 7f94ed3fc640 1 Processor -- start 2023-11-18T20:40:07.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.392+0000 7f94ed3fc640 1 -- start start 2023-11-18T20:40:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.393+0000 7f94ed3fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94e806d0a0 0x7f94e8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.393+0000 7f94ed3fc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80c64a0 con 0x7f94e80c3ea0 2023-11-18T20:40:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.393+0000 7f94ed3fc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80c5c00 con 0x7f94e814fd30 2023-11-18T20:40:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.393+0000 7f94ed3fc640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e80c5ee0 con 0x7f94e806d0a0 2023-11-18T20:40:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.393+0000 7f94de7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94e806d0a0 0x7f94e8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.393+0000 7f94de7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94e806d0a0 0x7f94e8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38520/0 (socket says 172.21.15.132:38520) 2023-11-18T20:40:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.393+0000 7f94de7fc640 1 -- 172.21.15.132:0/1460102726 learned_addr learned my addr 172.21.15.132:0/1460102726 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.393+0000 7f94e77fe640 1 --1- 172.21.15.132:0/1460102726 >> v1:172.21.15.132:6789/0 conn(0x7f94e80c3ea0 0x7f94e80c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37962/0 (socket says 172.21.15.132:37962) 2023-11-18T20:40:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.394+0000 7f94de7fc640 1 -- 172.21.15.132:0/1460102726 >> v1:172.21.15.161:6789/0 conn(0x7f94e814fd30 legacy=0x7f94e80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.394+0000 7f94de7fc640 1 -- 172.21.15.132:0/1460102726 >> v1:172.21.15.132:6789/0 conn(0x7f94e80c3ea0 legacy=0x7f94e80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.394+0000 7f94de7fc640 1 -- 172.21.15.132:0/1460102726 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e80c61c0 con 0x7f94e806d0a0 2023-11-18T20:40:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.395+0000 7f94de7fc640 1 --2- 172.21.15.132:0/1460102726 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e806d0a0 0x7f94e8152f20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009870 tx=0x7f94d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497ca245051188ec server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.395+0000 7f94e67fc640 1 -- 172.21.15.132:0/1460102726 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0030860 con 0x7f94e806d0a0 2023-11-18T20:40:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.395+0000 7f94e67fc640 1 -- 172.21.15.132:0/1460102726 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d00309c0 con 0x7f94e806d0a0 2023-11-18T20:40:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.395+0000 7f94e67fc640 1 -- 172.21.15.132:0/1460102726 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0030d50 con 0x7f94e806d0a0 2023-11-18T20:40:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.396+0000 7f94ed3fc640 1 -- 172.21.15.132:0/1460102726 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e806d0a0 msgr2=0x7f94e8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.396+0000 7f94ed3fc640 1 --2- 172.21.15.132:0/1460102726 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e806d0a0 0x7f94e8152f20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009870 tx=0x7f94d002b9a0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.396+0000 7f94ed3fc640 1 -- 172.21.15.132:0/1460102726 shutdown_connections 2023-11-18T20:40:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.396+0000 7f94ed3fc640 1 --2- 172.21.15.132:0/1460102726 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e806d0a0 0x7f94e8152f20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.396+0000 7f94ed3fc640 1 -- 172.21.15.132:0/1460102726 >> 172.21.15.132:0/1460102726 conn(0x7f94e806a500 msgr2=0x7f94e806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.396+0000 7f94ed3fc640 1 -- 172.21.15.132:0/1460102726 shutdown_connections 2023-11-18T20:40:07.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.396+0000 7f94ed3fc640 1 -- 172.21.15.132:0/1460102726 wait complete. 2023-11-18T20:40:07.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.398+0000 7f94ed3fc640 1 Processor -- start 2023-11-18T20:40:07.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.398+0000 7f94ed3fc640 1 -- start start 2023-11-18T20:40:07.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94ed3fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94e806d0a0 0x7f94e80c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94ed3fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e80c3ea0 0x7f94e81548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94ed3fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94e814fd30 0x7f94e814cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94ed3fc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e81e8450 con 0x7f94e80c3ea0 2023-11-18T20:40:07.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94ed3fc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80c2440 con 0x7f94e814fd30 2023-11-18T20:40:07.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94ed3fc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e81e8c90 con 0x7f94e806d0a0 2023-11-18T20:40:07.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94de7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e80c3ea0 0x7f94e81548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94de7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e80c3ea0 0x7f94e81548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38534/0 (socket says 172.21.15.132:38534) 2023-11-18T20:40:07.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94de7fc640 1 -- 172.21.15.132:0/2541427480 learned_addr learned my addr 172.21.15.132:0/2541427480 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94e6ffd640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94e806d0a0 0x7f94e80c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94de7fc640 1 -- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94e806d0a0 msgr2=0x7f94e80c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94e77fe640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94e814fd30 0x7f94e814cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94de7fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94e806d0a0 0x7f94e80c1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94de7fc640 1 -- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94e814fd30 msgr2=0x7f94e814cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94de7fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94e814fd30 0x7f94e814cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.399+0000 7f94de7fc640 1 -- 172.21.15.132:0/2541427480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00094d0 con 0x7f94e80c3ea0 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.400+0000 7f94e6ffd640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94e806d0a0 0x7f94e80c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.400+0000 7f94de7fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e80c3ea0 0x7f94e81548b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f94d0000c00 tx=0x7f94d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.400+0000 7f94dffff640 1 -- 172.21.15.132:0/2541427480 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0030830 con 0x7f94e80c3ea0 2023-11-18T20:40:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.400+0000 7f94dffff640 1 -- 172.21.15.132:0/2541427480 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0039d90 con 0x7f94e80c3ea0 2023-11-18T20:40:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.400+0000 7f94dffff640 1 -- 172.21.15.132:0/2541427480 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0043670 con 0x7f94e80c3ea0 2023-11-18T20:40:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.400+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e81ec6b0 con 0x7f94e80c3ea0 2023-11-18T20:40:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.400+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e81e8920 con 0x7f94e80c3ea0 2023-11-18T20:40:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.401+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e81e8ab0 con 0x7f94e80c3ea0 2023-11-18T20:40:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.402+0000 7f94dffff640 1 -- 172.21.15.132:0/2541427480 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94d002f3b0 con 0x7f94e80c3ea0 2023-11-18T20:40:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.403+0000 7f94dffff640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94c806ae40 0x7f94c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.403+0000 7f94dffff640 1 -- 172.21.15.132:0/2541427480 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f94d00ab830 con 0x7f94e80c3ea0 2023-11-18T20:40:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.404+0000 7f94e6ffd640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94c806ae40 0x7f94c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.405+0000 7f94e6ffd640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94c806ae40 0x7f94c806d300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f94e80a87a0 tx=0x7f94d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:07.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.407+0000 7f94dffff640 1 -- 172.21.15.132:0/2541427480 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94d0076c00 con 0x7f94e80c3ea0 2023-11-18T20:40:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.597+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94e8068350 con 0x7f94e80c3ea0 2023-11-18T20:40:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.598+0000 7f94dffff640 1 -- 172.21.15.132:0/2541427480 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94d0034020 con 0x7f94e80c3ea0 2023-11-18T20:40:07.599 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94c806ae40 msgr2=0x7f94c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94c806ae40 0x7f94c806d300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f94e80a87a0 tx=0x7f94d8009040 comp rx=0 tx=0).stop 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e80c3ea0 msgr2=0x7f94e81548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e80c3ea0 0x7f94e81548b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f94d0000c00 tx=0x7f94d0004730 comp rx=0 tx=0).stop 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 shutdown_connections 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94c806ae40 0x7f94c806d300 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94e814fd30 0x7f94e814cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e80c3ea0 0x7f94e81548b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 --2- 172.21.15.132:0/2541427480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94e806d0a0 0x7f94e80c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.600+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 >> 172.21.15.132:0/2541427480 conn(0x7f94e806a500 msgr2=0x7f94e8152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:07.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.601+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 shutdown_connections 2023-11-18T20:40:07.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.601+0000 7f94ed3fc640 1 -- 172.21.15.132:0/2541427480 wait complete. 2023-11-18T20:40:07.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-11-18T20:40:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.821+0000 7f9cbb9e7640 1 Processor -- start 2023-11-18T20:40:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.822+0000 7f9cbb9e7640 1 -- start start 2023-11-18T20:40:07.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.823+0000 7f9cbb9e7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb406d0a0 0x7f9cb4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.823+0000 7f9cbb9e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cb40c3ea0 0x7f9cb40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.823+0000 7f9cbb9e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb40c64a0 con 0x7f9cb414fd30 2023-11-18T20:40:07.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.823+0000 7f9cbb9e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40c5c00 con 0x7f9cb40c3ea0 2023-11-18T20:40:07.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.823+0000 7f9cbb9e7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40c5ee0 con 0x7f9cb406d0a0 2023-11-18T20:40:07.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.823+0000 7f9cb9783640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9cb414fd30 0x7f9cb40a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37972/0 (socket says 172.21.15.132:37972) 2023-11-18T20:40:07.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.823+0000 7f9cb9783640 1 -- 172.21.15.132:0/3301812650 learned_addr learned my addr 172.21.15.132:0/3301812650 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:07.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.823+0000 7f9cb9f84640 1 --2- 172.21.15.132:0/3301812650 >> v2:172.21.15.132:3300/0 conn(0x7f9cb40c3ea0 0x7f9cb40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.824+0000 7f9cb8f82640 1 --2- 172.21.15.132:0/3301812650 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb406d0a0 0x7f9cb4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.824+0000 7f9cb9f84640 1 -- 172.21.15.132:0/3301812650 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb406d0a0 msgr2=0x7f9cb4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:07.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.824+0000 7f9cb9f84640 1 --2- 172.21.15.132:0/3301812650 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb406d0a0 0x7f9cb4152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.824+0000 7f9cabfff640 1 -- 172.21.15.132:0/3301812650 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103782154 0 0) 0x7f9cb40c64a0 con 0x7f9cb414fd30 2023-11-18T20:40:07.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.824+0000 7f9cb9f84640 1 -- 172.21.15.132:0/3301812650 >> v1:172.21.15.132:6789/0 conn(0x7f9cb414fd30 legacy=0x7f9cb40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.824+0000 7f9cb9f84640 1 -- 172.21.15.132:0/3301812650 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40c61c0 con 0x7f9cb40c3ea0 2023-11-18T20:40:07.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.824+0000 7f9cb8f82640 1 --2- 172.21.15.132:0/3301812650 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb406d0a0 0x7f9cb4152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:07.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.825+0000 7f9cb9f84640 1 --2- 172.21.15.132:0/3301812650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb40c3ea0 0x7f9cb40c4330 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009d90 tx=0x7f9cac02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7301d5bb2ee97f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:07.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.825+0000 7f9cabfff640 1 -- 172.21.15.132:0/3301812650 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac02cc50 con 0x7f9cb40c3ea0 2023-11-18T20:40:07.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.825+0000 7f9cabfff640 1 -- 172.21.15.132:0/3301812650 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac02cdb0 con 0x7f9cb40c3ea0 2023-11-18T20:40:07.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.825+0000 7f9cabfff640 1 -- 172.21.15.132:0/3301812650 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac034660 con 0x7f9cb40c3ea0 2023-11-18T20:40:07.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.826+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3301812650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb40c3ea0 msgr2=0x7f9cb40c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.826+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3301812650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb40c3ea0 0x7f9cb40c4330 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009d90 tx=0x7f9cac02bea0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.826+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3301812650 shutdown_connections 2023-11-18T20:40:07.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.826+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3301812650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb40c3ea0 0x7f9cb40c4330 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.826+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3301812650 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb406d0a0 0x7f9cb4152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.826+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3301812650 >> 172.21.15.132:0/3301812650 conn(0x7f9cb406a500 msgr2=0x7f9cb406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:07.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.826+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3301812650 shutdown_connections 2023-11-18T20:40:07.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.826+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3301812650 wait complete. 2023-11-18T20:40:07.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.828+0000 7f9cbb9e7640 1 Processor -- start 2023-11-18T20:40:07.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.828+0000 7f9cbb9e7640 1 -- start start 2023-11-18T20:40:07.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.828+0000 7f9cbb9e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb406d0a0 0x7f9cb4151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cbb9e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40c3ea0 0x7f9cb41ea790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cbb9e7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb414fd30 0x7f9cb414e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cbb9e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb4155d60 con 0x7f9cb406d0a0 2023-11-18T20:40:07.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cbb9e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb41ea080 con 0x7f9cb40c3ea0 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cbb9e7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40aa1a0 con 0x7f9cb414fd30 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb406d0a0 0x7f9cb4151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb406d0a0 0x7f9cb4151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38554/0 (socket says 172.21.15.132:38554) 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 -- 172.21.15.132:0/3644826392 learned_addr learned my addr 172.21.15.132:0/3644826392 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 -- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb414fd30 msgr2=0x7f9cb414e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb414fd30 0x7f9cb414e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 -- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40c3ea0 msgr2=0x7f9cb41ea790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40c3ea0 0x7f9cb41ea790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 -- 172.21.15.132:0/3644826392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009a70 con 0x7f9cb406d0a0 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.829+0000 7f9cb9783640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb406d0a0 0x7f9cb4151160 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c4d0 tx=0x7f9cb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.830+0000 7f9ca9ffb640 1 -- 172.21.15.132:0/3644826392 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00074e0 con 0x7f9cb406d0a0 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.830+0000 7f9ca9ffb640 1 -- 172.21.15.132:0/3644826392 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0007660 con 0x7f9cb406d0a0 2023-11-18T20:40:07.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.830+0000 7f9ca9ffb640 1 -- 172.21.15.132:0/3644826392 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0004a20 con 0x7f9cb406d0a0 2023-11-18T20:40:07.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.830+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb40aa3f0 con 0x7f9cb406d0a0 2023-11-18T20:40:07.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.830+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb40aa9b0 con 0x7f9cb406d0a0 2023-11-18T20:40:07.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.831+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb4068350 con 0x7f9cb406d0a0 2023-11-18T20:40:07.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.832+0000 7f9ca9ffb640 1 -- 172.21.15.132:0/3644826392 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9cb0004b80 con 0x7f9cb406d0a0 2023-11-18T20:40:07.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.832+0000 7f9ca9ffb640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c9806ae70 0x7f9c9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:07.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.833+0000 7f9ca9ffb640 1 -- 172.21.15.132:0/3644826392 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9cb0088530 con 0x7f9cb406d0a0 2023-11-18T20:40:07.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.833+0000 7f9cb8f82640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c9806ae70 0x7f9c9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:07.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.834+0000 7f9cb8f82640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c9806ae70 0x7f9c9806d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4006fd0 tx=0x7f9ca4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:07.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:07.837+0000 7f9ca9ffb640 1 -- 172.21.15.132:0/3644826392 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9cb0053870 con 0x7f9cb406d0a0 2023-11-18T20:40:08.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.096+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f9cb40c66d0 con 0x7f9cb406d0a0 2023-11-18T20:40:08.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.730+0000 7f9ca9ffb640 1 -- 172.21.15.132:0/3644826392 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v138) v1 ==== 187+0+0 (secure 0 0 0) 0x7f9cb0018100 con 0x7f9cb406d0a0 2023-11-18T20:40:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c9806ae70 msgr2=0x7f9c9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c9806ae70 0x7f9c9806d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4006fd0 tx=0x7f9ca4008040 comp rx=0 tx=0).stop 2023-11-18T20:40:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb406d0a0 msgr2=0x7f9cb4151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb406d0a0 0x7f9cb4151160 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c4d0 tx=0x7f9cb000c990 comp rx=0 tx=0).stop 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 shutdown_connections 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c9806ae70 0x7f9c9806d330 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb414fd30 0x7f9cb414e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb40c3ea0 0x7f9cb41ea790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 --2- 172.21.15.132:0/3644826392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb406d0a0 0x7f9cb4151160 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 >> 172.21.15.132:0/3644826392 conn(0x7f9cb406a500 msgr2=0x7f9cb406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 shutdown_connections 2023-11-18T20:40:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.734+0000 7f9cbb9e7640 1 -- 172.21.15.132:0/3644826392 wait complete. 2023-11-18T20:40:08.757 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-18T20:40:08.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.974+0000 7fbd0e440640 1 Processor -- start 2023-11-18T20:40:08.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.975+0000 7fbd0e440640 1 -- start start 2023-11-18T20:40:08.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.976+0000 7fbd0e440640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbd080a4db0 0x7fbd08154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:08.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.976+0000 7fbd0e440640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080c1240 con 0x7fbd08070c60 2023-11-18T20:40:08.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.976+0000 7fbd0e440640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080c0f30 con 0x7fbd081546d0 2023-11-18T20:40:08.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.976+0000 7fbd0e440640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd08070130 con 0x7fbd080a4db0 2023-11-18T20:40:08.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbd0dc3f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbd08070c60 0x7fbd0815ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49012/0 (socket says 172.21.15.132:49012) 2023-11-18T20:40:08.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbd0dc3f640 1 -- 172.21.15.132:0/104284721 learned_addr learned my addr 172.21.15.132:0/104284721 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:08.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbd0cc3d640 1 --2- 172.21.15.132:0/104284721 >> v2:172.21.15.161:3300/0 conn(0x7fbd080a4db0 0x7fbd08154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:08.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780276286 0 0) 0x7fbd080c1240 con 0x7fbd08070c60 2023-11-18T20:40:08.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf4003520 con 0x7fbd08070c60 2023-11-18T20:40:08.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 351084270 0 0) 0x7fbcf4003520 con 0x7fbd08070c60 2023-11-18T20:40:08.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 >> v2:172.21.15.161:3300/0 conn(0x7fbd080a4db0 msgr2=0x7fbd08154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:08.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbcfffff640 1 --2- 172.21.15.132:0/104284721 >> v2:172.21.15.161:3300/0 conn(0x7fbd080a4db0 0x7fbd08154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 >> v1:172.21.15.161:6789/0 conn(0x7fbd081546d0 legacy=0x7fbd080c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.977+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080a55e0 con 0x7fbd08070c60 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fbd000019f0 con 0x7fbd08070c60 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 >> v1:172.21.15.132:6789/0 conn(0x7fbd08070c60 legacy=0x7fbd0815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbcfffff640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf4003970 0x7fbcf4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbcfffff640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbcfffff640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcf4005180 0x7fbcf400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf400c0f0 con 0x7fbcf40047c0 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf400c260 con 0x7fbcf4005180 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf400c420 con 0x7fbcf4003970 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbd0cc3d640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbd0dc3f640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcf4005180 0x7fbcf400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:08.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbd0d43e640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf4003970 0x7fbcf4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:08.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbd0cc3d640 1 -- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf4003970 msgr2=0x7fbcf4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:08.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbd0cc3d640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf4003970 0x7fbcf4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbd0cc3d640 1 -- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcf4005180 msgr2=0x7fbcf400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:08.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbd0cc3d640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcf4005180 0x7fbcf400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.978+0000 7fbd0cc3d640 1 -- 172.21.15.132:0/104284721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4003520 con 0x7fbcf40047c0 2023-11-18T20:40:08.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.979+0000 7fbd0dc3f640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcf4005180 0x7fbcf400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:08.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.979+0000 7fbd0dc3f640 1 -- 172.21.15.132:0/104284721 reap_dead start 2023-11-18T20:40:08.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.980+0000 7fbd0cc3d640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009ac0 tx=0x7fbcf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec517beb01fad778 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:08.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.980+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf802c6b0 con 0x7fbcf40047c0 2023-11-18T20:40:08.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.980+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf802c810 con 0x7fbcf40047c0 2023-11-18T20:40:08.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.980+0000 7fbcfffff640 1 -- 172.21.15.132:0/104284721 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf802cba0 con 0x7fbcf40047c0 2023-11-18T20:40:08.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.980+0000 7fbd0e440640 1 -- 172.21.15.132:0/104284721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40047c0 msgr2=0x7fbcf4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:08.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.980+0000 7fbd0e440640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009ac0 tx=0x7fbcf40057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.981+0000 7fbd0e440640 1 -- 172.21.15.132:0/104284721 shutdown_connections 2023-11-18T20:40:08.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.981+0000 7fbd0e440640 1 --2- 172.21.15.132:0/104284721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.981+0000 7fbd0e440640 1 -- 172.21.15.132:0/104284721 >> 172.21.15.132:0/104284721 conn(0x7fbd080a7900 msgr2=0x7fbd080a7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:08.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.981+0000 7fbd0e440640 1 -- 172.21.15.132:0/104284721 shutdown_connections 2023-11-18T20:40:08.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.981+0000 7fbd0e440640 1 -- 172.21.15.132:0/104284721 wait complete. 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.983+0000 7fbd0e440640 1 Processor -- start 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.983+0000 7fbd0e440640 1 -- start start 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0e440640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf40047c0 0x7fbd08153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0e440640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0814be00 0x7fbd081ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0e440640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd081ea620 0x7fbd081ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0e440640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0814d5e0 con 0x7fbd081ea620 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0e440640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0814d810 con 0x7fbd0814be00 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0e440640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0814dab0 con 0x7fbcf40047c0 2023-11-18T20:40:08.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0dc3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd081ea620 0x7fbd081ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0dc3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd081ea620 0x7fbd081ed3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37518/0 (socket says 172.21.15.132:37518) 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0dc3f640 1 -- 172.21.15.132:0/930284637 learned_addr learned my addr 172.21.15.132:0/930284637 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0d43e640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf40047c0 0x7fbd08153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0dc3f640 1 -- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf40047c0 msgr2=0x7fbd08153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0dc3f640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf40047c0 0x7fbd08153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0cc3d640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0814be00 0x7fbd081ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0dc3f640 1 -- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0814be00 msgr2=0x7fbd081ea0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0dc3f640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0814be00 0x7fbd081ea0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.984+0000 7fbd0dc3f640 1 -- 172.21.15.132:0/930284637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0814dd90 con 0x7fbd081ea620 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.985+0000 7fbd0dc3f640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd081ea620 0x7fbd081ed3e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbd00000f80 tx=0x7fbd0000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.985+0000 7fbcfdffb640 1 -- 172.21.15.132:0/930284637 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0000bb80 con 0x7fbd081ea620 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.985+0000 7fbcfdffb640 1 -- 172.21.15.132:0/930284637 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0000bce0 con 0x7fbd081ea620 2023-11-18T20:40:08.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.985+0000 7fbcfdffb640 1 -- 172.21.15.132:0/930284637 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00007290 con 0x7fbd081ea620 2023-11-18T20:40:08.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.985+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0814e070 con 0x7fbd081ea620 2023-11-18T20:40:08.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.985+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd080719e0 con 0x7fbd081ea620 2023-11-18T20:40:08.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.986+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd081e9e70 con 0x7fbd081ea620 2023-11-18T20:40:08.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.987+0000 7fbcfdffb640 1 -- 172.21.15.132:0/930284637 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd000073f0 con 0x7fbd081ea620 2023-11-18T20:40:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.988+0000 7fbcfdffb640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcec06ae40 0x7fbcec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.988+0000 7fbcfdffb640 1 -- 172.21.15.132:0/930284637 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbd00089710 con 0x7fbd081ea620 2023-11-18T20:40:08.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.989+0000 7fbd0d43e640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcec06ae40 0x7fbcec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:08.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.990+0000 7fbd0d43e640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcec06ae40 0x7fbcec06d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd04000c00 tx=0x7fbd04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:08.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:08.994+0000 7fbcfdffb640 1 -- 172.21.15.132:0/930284637 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd000549c0 con 0x7fbd081ea620 2023-11-18T20:40:09.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.183+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbd0804e840 con 0x7fbd081ea620 2023-11-18T20:40:09.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.190+0000 7fbcfdffb640 1 -- 172.21.15.132:0/930284637 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbd00057fe0 con 0x7fbd081ea620 2023-11-18T20:40:09.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.192+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcec06ae40 msgr2=0x7fbcec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:09.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.192+0000 7fbd0e440640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcec06ae40 0x7fbcec06d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd04000c00 tx=0x7fbd04009040 comp rx=0 tx=0).stop 2023-11-18T20:40:09.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.192+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd081ea620 msgr2=0x7fbd081ed3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:09.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.192+0000 7fbd0e440640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd081ea620 0x7fbd081ed3e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbd00000f80 tx=0x7fbd0000b4a0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.193+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 shutdown_connections 2023-11-18T20:40:09.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.193+0000 7fbd0e440640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcec06ae40 0x7fbcec06d300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.193+0000 7fbd0e440640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd081ea620 0x7fbd081ed3e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.193+0000 7fbd0e440640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0814be00 0x7fbd081ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.193+0000 7fbd0e440640 1 --2- 172.21.15.132:0/930284637 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcf40047c0 0x7fbd08153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.193+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 >> 172.21.15.132:0/930284637 conn(0x7fbd080a7900 msgr2=0x7fbd080a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:09.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.193+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 shutdown_connections 2023-11-18T20:40:09.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.193+0000 7fbd0e440640 1 -- 172.21.15.132:0/930284637 wait complete. 2023-11-18T20:40:09.212 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-18T20:40:09.212 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:40:09.320 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:40:09.444 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-18T20:40:09.445 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:40:09.445 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:09.503 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:40:09.503 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:40:09.503 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:09.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-18T20:40:09.564 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-18T20:40:09.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:09.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.785+0000 7f01730de640 1 Processor -- start 2023-11-18T20:40:09.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.785+0000 7f01730de640 1 -- start start 2023-11-18T20:40:09.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.786+0000 7f01730de640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f016c14fd30 0x7f016c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:09.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.786+0000 7f01730de640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c06d0a0 0x7f016c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:09.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.786+0000 7f01730de640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f016c0a5260 0x7f016c0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:09.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.786+0000 7f01730de640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c0c64a0 con 0x7f016c0a5260 2023-11-18T20:40:09.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.786+0000 7f01730de640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c0c5c00 con 0x7f016c14fd30 2023-11-18T20:40:09.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.786+0000 7f01730de640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0c5ee0 con 0x7f016c06d0a0 2023-11-18T20:40:09.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f017167b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f016c0a5260 0x7f016c0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:09.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f017167b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f016c0a5260 0x7f016c0c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37532/0 (socket says 172.21.15.132:37532) 2023-11-18T20:40:09.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f017167b640 1 -- 172.21.15.132:0/548925886 learned_addr learned my addr 172.21.15.132:0/548925886 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:09.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f0170e7a640 1 --2- 172.21.15.132:0/548925886 >> v2:172.21.15.161:3300/0 conn(0x7f016c14fd30 0x7f016c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:09.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f016bfff640 1 --2- 172.21.15.132:0/548925886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c06d0a0 0x7f016c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:09.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f017167b640 1 -- 172.21.15.132:0/548925886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c06d0a0 msgr2=0x7f016c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:09.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f017167b640 1 --2- 172.21.15.132:0/548925886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c06d0a0 0x7f016c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f017167b640 1 -- 172.21.15.132:0/548925886 >> v2:172.21.15.161:3300/0 conn(0x7f016c14fd30 msgr2=0x7f016c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:09.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f017167b640 1 --2- 172.21.15.132:0/548925886 >> v2:172.21.15.161:3300/0 conn(0x7f016c14fd30 0x7f016c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.787+0000 7f017167b640 1 -- 172.21.15.132:0/548925886 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0c61c0 con 0x7f016c0a5260 2023-11-18T20:40:09.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.789+0000 7f017167b640 1 --2- 172.21.15.132:0/548925886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c0a5260 0x7f016c0c3ea0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f016c06b200 tx=0x7f016402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f3fc9072c986b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:09.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.789+0000 7f016b7fe640 1 -- 172.21.15.132:0/548925886 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016402ca70 con 0x7f016c0a5260 2023-11-18T20:40:09.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.789+0000 7f016b7fe640 1 -- 172.21.15.132:0/548925886 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016402cbd0 con 0x7f016c0a5260 2023-11-18T20:40:09.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.789+0000 7f016b7fe640 1 -- 172.21.15.132:0/548925886 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640343f0 con 0x7f016c0a5260 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 -- 172.21.15.132:0/548925886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c0a5260 msgr2=0x7f016c0c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 --2- 172.21.15.132:0/548925886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c0a5260 0x7f016c0c3ea0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f016c06b200 tx=0x7f016402bed0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 -- 172.21.15.132:0/548925886 shutdown_connections 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 --2- 172.21.15.132:0/548925886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c0a5260 0x7f016c0c3ea0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 --2- 172.21.15.132:0/548925886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c06d0a0 0x7f016c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 --2- 172.21.15.132:0/548925886 >> v2:172.21.15.161:3300/0 conn(0x7f016c14fd30 0x7f016c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 -- 172.21.15.132:0/548925886 >> 172.21.15.132:0/548925886 conn(0x7f016c06a500 msgr2=0x7f016c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 -- 172.21.15.132:0/548925886 shutdown_connections 2023-11-18T20:40:09.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.790+0000 7f01730de640 1 -- 172.21.15.132:0/548925886 wait complete. 2023-11-18T20:40:09.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.791+0000 7f01730de640 1 Processor -- start 2023-11-18T20:40:09.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.792+0000 7f01730de640 1 -- start start 2023-11-18T20:40:09.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.792+0000 7f01730de640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f016c06d0a0 0x7f016c071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:09.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.792+0000 7f01730de640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c0a5260 0x7f016c13cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:09.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.792+0000 7f01730de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c14fd30 0x7f016c13d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f01730de640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c153cb0 con 0x7f016c14fd30 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f01730de640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c1503f0 con 0x7f016c06d0a0 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f01730de640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c13d6d0 con 0x7f016c0a5260 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f017167b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c14fd30 0x7f016c13d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f017167b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c14fd30 0x7f016c13d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37534/0 (socket says 172.21.15.132:37534) 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f017167b640 1 -- 172.21.15.132:0/374086228 learned_addr learned my addr 172.21.15.132:0/374086228 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f0170e7a640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f016c06d0a0 0x7f016c071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f016bfff640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c0a5260 0x7f016c13cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f017167b640 1 -- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c0a5260 msgr2=0x7f016c13cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f017167b640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c0a5260 0x7f016c13cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f017167b640 1 -- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f016c06d0a0 msgr2=0x7f016c071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:09.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f017167b640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f016c06d0a0 0x7f016c071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:09.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.793+0000 7f017167b640 1 -- 172.21.15.132:0/374086228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164009b30 con 0x7f016c14fd30 2023-11-18T20:40:09.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.794+0000 7f017167b640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c14fd30 0x7f016c13d190 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0164036040 tx=0x7f0164004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:09.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.794+0000 7f01697fa640 1 -- 172.21.15.132:0/374086228 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164009510 con 0x7f016c14fd30 2023-11-18T20:40:09.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.794+0000 7f01697fa640 1 -- 172.21.15.132:0/374086228 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016403e450 con 0x7f016c14fd30 2023-11-18T20:40:09.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.794+0000 7f01697fa640 1 -- 172.21.15.132:0/374086228 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016403e800 con 0x7f016c14fd30 2023-11-18T20:40:09.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.794+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c1eb3f0 con 0x7f016c14fd30 2023-11-18T20:40:09.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.794+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c151b50 con 0x7f016c14fd30 2023-11-18T20:40:09.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.795+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c150560 con 0x7f016c14fd30 2023-11-18T20:40:09.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.796+0000 7f01697fa640 1 -- 172.21.15.132:0/374086228 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f016403e960 con 0x7f016c14fd30 2023-11-18T20:40:09.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.797+0000 7f01697fa640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f015006ae40 0x7f015006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:09.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.797+0000 7f01697fa640 1 -- 172.21.15.132:0/374086228 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f01640ac0e0 con 0x7f016c14fd30 2023-11-18T20:40:09.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.798+0000 7f0170e7a640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f015006ae40 0x7f015006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:09.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.799+0000 7f0170e7a640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f015006ae40 0x7f015006d300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0160006fd0 tx=0x7f0160008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:09.802+0000 7f01697fa640 1 -- 172.21.15.132:0/374086228 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f016c150560 con 0x7f016c14fd30 2023-11-18T20:40:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.035+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f016c150560 con 0x7f016c14fd30 2023-11-18T20:40:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.036+0000 7f01697fa640 1 -- 172.21.15.132:0/374086228 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f0164043e90 con 0x7f016c14fd30 2023-11-18T20:40:10.038 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:10.038 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3852367261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3852367261},{"type":"v1","addr":"172.21.15.132:6835","nonce":3852367261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2111424712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2111424712},{"type":"v1","addr":"172.21.15.161:6835","nonce":2111424712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/97637293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":97637293},{"type":"v1","addr":"172.21.15.161:6837","nonce":97637293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/71697180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":71697180},{"type":"v1","addr":"172.21.15.132:6834","nonce":71697180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2023-11-18T20:40:10.038 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 23 2023-11-18T20:40:10.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f015006ae40 msgr2=0x7f015006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f015006ae40 0x7f015006d300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0160006fd0 tx=0x7f0160008040 comp rx=0 tx=0).stop 2023-11-18T20:40:10.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c14fd30 msgr2=0x7f016c13d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c14fd30 0x7f016c13d190 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0164036040 tx=0x7f0164004a40 comp rx=0 tx=0).stop 2023-11-18T20:40:10.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 shutdown_connections 2023-11-18T20:40:10.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f015006ae40 0x7f015006d300 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f016c14fd30 0x7f016c13d190 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f016c0a5260 0x7f016c13cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 --2- 172.21.15.132:0/374086228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f016c06d0a0 0x7f016c071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 >> 172.21.15.132:0/374086228 conn(0x7f016c06a500 msgr2=0x7f016c1e0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:10.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 shutdown_connections 2023-11-18T20:40:10.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.039+0000 7f01730de640 1 -- 172.21.15.132:0/374086228 wait complete. 2023-11-18T20:40:10.060 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-18T20:40:10.060 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-18T20:40:10.060 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-18T20:40:10.060 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:40:10.060 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-18T20:40:10.061 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-18T20:40:10.061 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-18T20:40:10.061 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:40:10.061 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-18T20:40:10.061 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-18T20:40:10.061 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-18T20:40:10.061 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:40:10.062 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-18T20:40:10.062 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-18T20:40:10.062 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-18T20:40:10.062 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:40:10.076 INFO:tasks.ceph.mds.a:Stopped 2023-11-18T20:40:10.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-18T20:40:10.079 INFO:tasks.ceph.mds.c:Stopped 2023-11-18T20:40:10.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-18T20:40:10.081 INFO:tasks.ceph.mds.d:Stopped 2023-11-18T20:40:10.081 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-18T20:40:10.085 INFO:tasks.ceph.mds.b:Stopped 2023-11-18T20:40:10.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-18T20:40:10.127 INFO:tasks.ceph.mds.a:Started 2023-11-18T20:40:10.128 DEBUG:teuthology.parallel:result is None 2023-11-18T20:40:10.133 INFO:tasks.ceph.mds.d:Started 2023-11-18T20:40:10.134 DEBUG:teuthology.parallel:result is None 2023-11-18T20:40:10.135 INFO:tasks.ceph.mds.c:Started 2023-11-18T20:40:10.135 DEBUG:teuthology.parallel:result is None 2023-11-18T20:40:10.141 INFO:tasks.ceph.mds.b:Started 2023-11-18T20:40:10.141 DEBUG:teuthology.parallel:result is None 2023-11-18T20:40:10.141 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-18T20:40:10.283 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-11-18T20:40:10.289 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-11-18T20:40:10.302 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-11-18T20:40:10.304 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-11-18T20:40:10.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.330+0000 7fe0055e7640 1 Processor -- start 2023-11-18T20:40:10.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.330+0000 7fe0055e7640 1 -- start start 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fe0055e7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe00014fd30 0x7fe000152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fe0055e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0000c3ea0 0x7fe0000c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fe0055e7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000c64a0 con 0x7fe00006d0a0 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fe0055e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000c5c00 con 0x7fe0000c3ea0 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fe0055e7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000c5ee0 con 0x7fe00014fd30 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fdfff7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0000c3ea0 0x7fe0000c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fdfff7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0000c3ea0 0x7fe0000c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37576/0 (socket says 172.21.15.132:37576) 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fdfff7fe640 1 -- 172.21.15.132:0/451884639 learned_addr learned my addr 172.21.15.132:0/451884639 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.331+0000 7fdffeffd640 1 --2- 172.21.15.132:0/451884639 >> v2:172.21.15.161:3300/0 conn(0x7fe00014fd30 0x7fe000152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:10.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.332+0000 7fdfff7fe640 1 -- 172.21.15.132:0/451884639 >> v2:172.21.15.161:3300/0 conn(0x7fe00014fd30 msgr2=0x7fe000152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:10.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.332+0000 7fdfff7fe640 1 --2- 172.21.15.132:0/451884639 >> v2:172.21.15.161:3300/0 conn(0x7fe00014fd30 0x7fe000152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.332+0000 7fdfff7fe640 1 -- 172.21.15.132:0/451884639 >> v1:172.21.15.161:6789/0 conn(0x7fe00006d0a0 legacy=0x7fe0000a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.332+0000 7fdfff7fe640 1 -- 172.21.15.132:0/451884639 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000c61c0 con 0x7fe0000c3ea0 2023-11-18T20:40:10.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.333+0000 7fdfff7fe640 1 --2- 172.21.15.132:0/451884639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe0000c4330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe00006b200 tx=0x7fdff802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d460e991fb8ca48a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:10.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.333+0000 7fdffdffb640 1 -- 172.21.15.132:0/451884639 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff802cb20 con 0x7fe0000c3ea0 2023-11-18T20:40:10.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.333+0000 7fdffdffb640 1 -- 172.21.15.132:0/451884639 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff802cc80 con 0x7fe0000c3ea0 2023-11-18T20:40:10.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.333+0000 7fdffdffb640 1 -- 172.21.15.132:0/451884639 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80343f0 con 0x7fe0000c3ea0 2023-11-18T20:40:10.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.334+0000 7fe0055e7640 1 -- 172.21.15.132:0/451884639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 msgr2=0x7fe0000c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.334+0000 7fe0055e7640 1 --2- 172.21.15.132:0/451884639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe0000c4330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe00006b200 tx=0x7fdff802bf80 comp rx=0 tx=0).stop 2023-11-18T20:40:10.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.334+0000 7fe0055e7640 1 -- 172.21.15.132:0/451884639 shutdown_connections 2023-11-18T20:40:10.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.334+0000 7fe0055e7640 1 --2- 172.21.15.132:0/451884639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe0000c4330 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.334+0000 7fe0055e7640 1 --2- 172.21.15.132:0/451884639 >> v2:172.21.15.161:3300/0 conn(0x7fe00014fd30 0x7fe000152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.334+0000 7fe0055e7640 1 -- 172.21.15.132:0/451884639 >> 172.21.15.132:0/451884639 conn(0x7fe00006a500 msgr2=0x7fe00006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:10.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.334+0000 7fe0055e7640 1 -- 172.21.15.132:0/451884639 shutdown_connections 2023-11-18T20:40:10.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.334+0000 7fe0055e7640 1 -- 172.21.15.132:0/451884639 wait complete. 2023-11-18T20:40:10.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.335+0000 7fe0055e7640 1 Processor -- start 2023-11-18T20:40:10.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.336+0000 7fe0055e7640 1 -- start start 2023-11-18T20:40:10.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.336+0000 7fe0055e7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe00006d0a0 0x7fe0001eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.336+0000 7fe0055e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe000153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fe0055e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe00014fd30 0x7fe000155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fe0055e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0001e19d0 con 0x7fe0000c3ea0 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fe0055e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0001e11c0 con 0x7fe00014fd30 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fe0055e7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00006ffb0 con 0x7fe00006d0a0 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffe7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe000153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffe7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe000153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37590/0 (socket says 172.21.15.132:37590) 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffe7fc640 1 -- 172.21.15.132:0/3153697134 learned_addr learned my addr 172.21.15.132:0/3153697134 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffeffd640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe00006d0a0 0x7fe0001eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdfff7fe640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe00014fd30 0x7fe000155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffe7fc640 1 -- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe00006d0a0 msgr2=0x7fe0001eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffe7fc640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe00006d0a0 0x7fe0001eab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffe7fc640 1 -- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe00014fd30 msgr2=0x7fe000155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffe7fc640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe00014fd30 0x7fe000155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.337+0000 7fdffe7fc640 1 -- 172.21.15.132:0/3153697134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8009b30 con 0x7fe0000c3ea0 2023-11-18T20:40:10.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.338+0000 7fdffe7fc640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe000153c60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdff400c3c0 tx=0x7fdff400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.338+0000 7fdfe77fe640 1 -- 172.21.15.132:0/3153697134 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff40052d0 con 0x7fe0000c3ea0 2023-11-18T20:40:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.338+0000 7fdfe77fe640 1 -- 172.21.15.132:0/3153697134 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff4005450 con 0x7fe0000c3ea0 2023-11-18T20:40:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.338+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0001e1410 con 0x7fe0000c3ea0 2023-11-18T20:40:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.338+0000 7fdfe77fe640 1 -- 172.21.15.132:0/3153697134 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4003830 con 0x7fe0000c3ea0 2023-11-18T20:40:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.338+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0001541a0 con 0x7fe0000c3ea0 2023-11-18T20:40:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.339+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000070120 con 0x7fe0000c3ea0 2023-11-18T20:40:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.340+0000 7fdfe77fe640 1 -- 172.21.15.132:0/3153697134 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdff4003990 con 0x7fe0000c3ea0 2023-11-18T20:40:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.341+0000 7fdfe77fe640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdfec06ae70 0x7fdfec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.341+0000 7fdfe77fe640 1 -- 172.21.15.132:0/3153697134 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdff40886e0 con 0x7fe0000c3ea0 2023-11-18T20:40:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.341+0000 7fdffeffd640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdfec06ae70 0x7fdfec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:10.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.342+0000 7fdffeffd640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdfec06ae70 0x7fdfec06d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009b40 tx=0x7fdff0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.346+0000 7fdfe77fe640 1 -- 172.21.15.132:0/3153697134 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdff4053b50 con 0x7fe0000c3ea0 2023-11-18T20:40:10.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.536+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe000068350 con 0x7fe0000c3ea0 2023-11-18T20:40:10.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.759+0000 7fdfe77fe640 1 -- 172.21.15.132:0/3153697134 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v49) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdff4057170 con 0x7fe0000c3ea0 2023-11-18T20:40:10.761 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-11-18T20:40:10.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdfec06ae70 msgr2=0x7fdfec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdfec06ae70 0x7fdfec06d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009b40 tx=0x7fdff0009190 comp rx=0 tx=0).stop 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 msgr2=0x7fe000153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe000153c60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdff400c3c0 tx=0x7fdff400c880 comp rx=0 tx=0).stop 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 shutdown_connections 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdfec06ae70 0x7fdfec06d330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe00014fd30 0x7fe000155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0000c3ea0 0x7fe000153c60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 --2- 172.21.15.132:0/3153697134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe00006d0a0 0x7fe0001eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 >> 172.21.15.132:0/3153697134 conn(0x7fe00006a500 msgr2=0x7fe0000bfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.762+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 shutdown_connections 2023-11-18T20:40:10.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.763+0000 7fe0055e7640 1 -- 172.21.15.132:0/3153697134 wait complete. 2023-11-18T20:40:10.785 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-18T20:40:10.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.988+0000 7f8560fe9640 1 Processor -- start 2023-11-18T20:40:10.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.988+0000 7f8560fe9640 1 -- start start 2023-11-18T20:40:10.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.989+0000 7f8560fe9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f855c0c5ec0 0x7f855c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.989+0000 7f8560fe9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c0bfdc0 con 0x7f855c0c45d0 2023-11-18T20:40:10.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.989+0000 7f8560fe9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c06ddd0 con 0x7f855c0721a0 2023-11-18T20:40:10.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.989+0000 7f8560fe9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c06e390 con 0x7f855c0c5ec0 2023-11-18T20:40:10.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.990+0000 7f855a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f855c0c5ec0 0x7f855c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:10.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.990+0000 7f8553fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f855c0c45d0 0x7f855c155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49036/0 (socket says 172.21.15.132:49036) 2023-11-18T20:40:10.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.990+0000 7f8553fff640 1 -- 172.21.15.132:0/1197934404 learned_addr learned my addr 172.21.15.132:0/1197934404 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:10.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.990+0000 7f855a59c640 1 -- 172.21.15.132:0/1197934404 >> v1:172.21.15.161:6789/0 conn(0x7f855c0721a0 legacy=0x7f855c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:10.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.990+0000 7f855a59c640 1 -- 172.21.15.132:0/1197934404 >> v1:172.21.15.132:6789/0 conn(0x7f855c0c45d0 legacy=0x7f855c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.990+0000 7f855a59c640 1 -- 172.21.15.132:0/1197934404 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c06e0b0 con 0x7f855c0c5ec0 2023-11-18T20:40:10.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.990+0000 7f8559d9b640 1 -- 172.21.15.132:0/1197934404 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122309371 0 0) 0x7f855c0bfdc0 con 0x7f855c0c45d0 2023-11-18T20:40:10.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.991+0000 7f855a59c640 1 --2- 172.21.15.132:0/1197934404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0c5ec0 0x7f855c0c2c30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f854c0097d0 tx=0x7f854c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f63acc634566e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:10.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.991+0000 7f8559d9b640 1 -- 172.21.15.132:0/1197934404 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0316f0 con 0x7f855c0c5ec0 2023-11-18T20:40:10.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8559d9b640 1 -- 172.21.15.132:0/1197934404 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c031850 con 0x7f855c0c5ec0 2023-11-18T20:40:10.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8559d9b640 1 -- 172.21.15.132:0/1197934404 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c031be0 con 0x7f855c0c5ec0 2023-11-18T20:40:10.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8560fe9640 1 -- 172.21.15.132:0/1197934404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0c5ec0 msgr2=0x7f855c0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8560fe9640 1 --2- 172.21.15.132:0/1197934404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0c5ec0 0x7f855c0c2c30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f854c0097d0 tx=0x7f854c02b790 comp rx=0 tx=0).stop 2023-11-18T20:40:10.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8560fe9640 1 -- 172.21.15.132:0/1197934404 shutdown_connections 2023-11-18T20:40:10.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8560fe9640 1 --2- 172.21.15.132:0/1197934404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0c5ec0 0x7f855c0c2c30 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8560fe9640 1 -- 172.21.15.132:0/1197934404 >> 172.21.15.132:0/1197934404 conn(0x7f855c06a500 msgr2=0x7f855c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:10.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8560fe9640 1 -- 172.21.15.132:0/1197934404 shutdown_connections 2023-11-18T20:40:10.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.992+0000 7f8560fe9640 1 -- 172.21.15.132:0/1197934404 wait complete. 2023-11-18T20:40:10.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.994+0000 7f8560fe9640 1 Processor -- start 2023-11-18T20:40:10.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.994+0000 7f8560fe9640 1 -- start start 2023-11-18T20:40:10.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f8560fe9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0721a0 0x7f855c0a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f8560fe9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f855c0c45d0 0x7f855c0c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f8560fe9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f855c0c5ec0 0x7f855c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:10.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f8560fe9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0a6300 con 0x7f855c0721a0 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f8560fe9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c1ea720 con 0x7f855c0c45d0 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f8560fe9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c1eac10 con 0x7f855c0c5ec0 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f855a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0721a0 0x7f855c0a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f855a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0721a0 0x7f855c0a9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37606/0 (socket says 172.21.15.132:37606) 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f855a59c640 1 -- 172.21.15.132:0/3322865410 learned_addr learned my addr 172.21.15.132:0/3322865410 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f855a59c640 1 -- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f855c0c5ec0 msgr2=0x7f855c14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f855a59c640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f855c0c5ec0 0x7f855c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f855a59c640 1 -- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f855c0c45d0 msgr2=0x7f855c0c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f855a59c640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f855c0c45d0 0x7f855c0c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.996+0000 7f855a59c640 1 -- 172.21.15.132:0/3322865410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009400 con 0x7f855c0721a0 2023-11-18T20:40:10.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.997+0000 7f855a59c640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0721a0 0x7f855c0a9540 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f854c0097d0 tx=0x7f854c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:10.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.997+0000 7f8552ffd640 1 -- 172.21.15.132:0/3322865410 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c034890 con 0x7f855c0721a0 2023-11-18T20:40:10.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.997+0000 7f8552ffd640 1 -- 172.21.15.132:0/3322865410 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c031f00 con 0x7f855c0721a0 2023-11-18T20:40:10.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.997+0000 7f8552ffd640 1 -- 172.21.15.132:0/3322865410 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c034c30 con 0x7f855c0721a0 2023-11-18T20:40:10.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.997+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c0a8c90 con 0x7f855c0721a0 2023-11-18T20:40:10.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.997+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c0a8f30 con 0x7f855c0721a0 2023-11-18T20:40:11.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.998+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c0a9120 con 0x7f855c0721a0 2023-11-18T20:40:11.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:10.999+0000 7f8552ffd640 1 -- 172.21.15.132:0/3322865410 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f854c03b040 con 0x7f855c0721a0 2023-11-18T20:40:11.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.000+0000 7f8552ffd640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f853c06ae70 0x7f853c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.000+0000 7f8552ffd640 1 -- 172.21.15.132:0/3322865410 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f854c0ab060 con 0x7f855c0721a0 2023-11-18T20:40:11.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.000+0000 7f8553fff640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f853c06ae70 0x7f853c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:11.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.001+0000 7f8553fff640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f853c06ae70 0x7f853c06d330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f85440011e0 tx=0x7f8544007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:11.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.004+0000 7f8552ffd640 1 -- 172.21.15.132:0/3322865410 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f854c076610 con 0x7f855c0721a0 2023-11-18T20:40:11.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.244+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f855c068350 con 0x7f855c0721a0 2023-11-18T20:40:11.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.245+0000 7f8552ffd640 1 -- 172.21.15.132:0/3322865410 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5021 (secure 0 0 0) 0x7f854c079c30 con 0x7f855c0721a0 2023-11-18T20:40:11.246 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:11.247 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:40:11.247 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-11-18T20:40:11.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.247 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-11-18T20:40:11.247 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFll67UuNhAAzMjJzHfHuMEnOrySo5rWkg==", 2023-11-18T20:40:11.247 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.247 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:40:11.248 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:40:11.248 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:40:11.248 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.248 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.248 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.249 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.249 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-11-18T20:40:11.249 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllppoxHBAAFb6gynzzJK+cDc3jFhAACg==", 2023-11-18T20:40:11.249 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.249 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:40:11.250 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:40:11.250 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:40:11.250 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.250 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.250 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.251 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.251 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-11-18T20:40:11.251 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllLcurChAAvi5HiMzmlupLAkYw675TeQ==", 2023-11-18T20:40:11.251 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.251 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:40:11.251 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:40:11.252 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:40:11.252 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.252 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.252 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.252 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.253 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-11-18T20:40:11.253 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllGen8LBAAHV9S4/oQnKEkxUg+grOguA==", 2023-11-18T20:40:11.253 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.253 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:40:11.253 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:40:11.254 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:40:11.254 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.254 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.254 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.255 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.255 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-11-18T20:40:11.255 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBwIFlloVfzAhAAR8uyp9rDYiQV+BhFjIuJvA==", 2023-11-18T20:40:11.255 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.256 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:40:11.256 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:40:11.256 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.256 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.257 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.257 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-11-18T20:40:11.257 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBzIFlloNl8DhAAkyClLe7G9fDXgg+zgwNkWw==", 2023-11-18T20:40:11.257 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.258 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:40:11.258 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:40:11.258 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.258 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.258 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.259 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.259 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-11-18T20:40:11.259 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB2IFllDcRbJhAA6+fYI8hcxWhHNSpkw9vg0g==", 2023-11-18T20:40:11.259 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.259 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:40:11.260 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:40:11.260 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.260 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.260 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.260 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.260 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-11-18T20:40:11.261 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB5IFllOnBaMRAAvOwUIZn1Jt2tAoDiRC6Gqw==", 2023-11-18T20:40:11.261 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.261 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:40:11.261 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:40:11.261 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.262 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.262 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.262 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.262 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-11-18T20:40:11.262 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCAIFll5itZMBAASs5GAbUqVH0Xlrlqktz9xw==", 2023-11-18T20:40:11.263 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.263 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:40:11.263 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:40:11.263 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.263 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.263 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.264 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.264 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-11-18T20:40:11.264 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCEIFll5uYKDxAANaYuUAsrCvw1xO9CoKqd/A==", 2023-11-18T20:40:11.264 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.265 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:40:11.265 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:40:11.265 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.265 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.265 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.266 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.266 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-11-18T20:40:11.266 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCHIFllEZPyGRAASXuTF7aswO1KQfUH3BStpw==", 2023-11-18T20:40:11.266 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.266 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:40:11.267 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:40:11.267 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.267 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.267 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.267 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.268 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-11-18T20:40:11.268 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCKIFllDT/tMRAAh3c/95I9x0FMZGXZ//TuWw==", 2023-11-18T20:40:11.268 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.268 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:40:11.268 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:40:11.269 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.269 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.269 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.269 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.269 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-11-18T20:40:11.269 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllsbdTOxAAP60vfd0AqFNopXTOFb78Tw==", 2023-11-18T20:40:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:40:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-11-18T20:40:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-18T20:40:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-11-18T20:40:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBsIFllrycwCxAAI7OVXj40YLGlQ4/hWY+mTA==", 2023-11-18T20:40:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:40:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-11-18T20:40:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw pool=cephfs2_data" 2023-11-18T20:40:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-11-18T20:40:11.273 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBpIFllbT/WKBAAWaMN0vZkyb+SLPB29x0inw==", 2023-11-18T20:40:11.273 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.273 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:40:11.273 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:40:11.273 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:40:11.274 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.274 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.274 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.274 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.274 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.testuser", 2023-11-18T20:40:11.274 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQALIVlloodCHxAAM/G+/vw1/PYk7C2D2ZFYoQ==", 2023-11-18T20:40:11.275 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.275 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow rw fsname=cephfs", 2023-11-18T20:40:11.275 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r fsname=cephfs", 2023-11-18T20:40:11.275 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFllWW9dKhAAdaq1Wp1/FeVlv9IGXn6EhQ==", 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.276 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFllBY6bHRAApFJ5PvprGpoejUSSP7+hHw==", 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-11-18T20:40:11.278 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:40:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f853c06ae70 msgr2=0x7f853c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f853c06ae70 0x7f853c06d330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f85440011e0 tx=0x7f8544007920 comp rx=0 tx=0).stop 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0721a0 msgr2=0x7f855c0a9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0721a0 0x7f855c0a9540 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f854c0097d0 tx=0x7f854c0046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 shutdown_connections 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f853c06ae70 0x7f853c06d330 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f855c0c5ec0 0x7f855c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f855c0c45d0 0x7f855c0c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 --2- 172.21.15.132:0/3322865410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f855c0721a0 0x7f855c0a9540 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 >> 172.21.15.132:0/3322865410 conn(0x7f855c06a500 msgr2=0x7f855c0c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:11.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 shutdown_connections 2023-11-18T20:40:11.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.248+0000 7f8560fe9640 1 -- 172.21.15.132:0/3322865410 wait complete. 2023-11-18T20:40:11.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-11-18T20:40:11.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.489+0000 7f0a55a34640 1 Processor -- start 2023-11-18T20:40:11.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.489+0000 7f0a55a34640 1 -- start start 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.490+0000 7f0a55a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a5006d0a0 0x7f0a50152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.490+0000 7f0a55a34640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a500c3ea0 0x7f0a500c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.490+0000 7f0a55a34640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500c64a0 con 0x7f0a5014fd30 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.490+0000 7f0a55a34640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500c5c00 con 0x7f0a500c3ea0 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.490+0000 7f0a55a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500c5ee0 con 0x7f0a5006d0a0 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.491+0000 7f0a4effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0a5014fd30 0x7f0a500a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49040/0 (socket says 172.21.15.132:49040) 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.491+0000 7f0a4effd640 1 -- 172.21.15.132:0/543186972 learned_addr learned my addr 172.21.15.132:0/543186972 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.491+0000 7f0a4f7fe640 1 --2- 172.21.15.132:0/543186972 >> v2:172.21.15.132:3300/0 conn(0x7f0a500c3ea0 0x7f0a500c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:11.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.491+0000 7f0a4e7fc640 1 --2- 172.21.15.132:0/543186972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a5006d0a0 0x7f0a50152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:11.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.491+0000 7f0a4f7fe640 1 -- 172.21.15.132:0/543186972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a5006d0a0 msgr2=0x7f0a50152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:11.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.491+0000 7f0a4f7fe640 1 --2- 172.21.15.132:0/543186972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a5006d0a0 0x7f0a50152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.491+0000 7f0a4f7fe640 1 -- 172.21.15.132:0/543186972 >> v1:172.21.15.132:6789/0 conn(0x7f0a5014fd30 legacy=0x7f0a500a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.491+0000 7f0a4f7fe640 1 -- 172.21.15.132:0/543186972 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500c61c0 con 0x7f0a500c3ea0 2023-11-18T20:40:11.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.492+0000 7f0a4f7fe640 1 --2- 172.21.15.132:0/543186972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a500c3ea0 0x7f0a500c4330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009d90 tx=0x7f0a4802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2870ab58d8407ddc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:11.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a4dffb640 1 -- 172.21.15.132:0/543186972 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4802cc60 con 0x7f0a500c3ea0 2023-11-18T20:40:11.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a4dffb640 1 -- 172.21.15.132:0/543186972 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4802cdc0 con 0x7f0a500c3ea0 2023-11-18T20:40:11.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a4dffb640 1 -- 172.21.15.132:0/543186972 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48034660 con 0x7f0a500c3ea0 2023-11-18T20:40:11.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a55a34640 1 -- 172.21.15.132:0/543186972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a500c3ea0 msgr2=0x7f0a500c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a55a34640 1 --2- 172.21.15.132:0/543186972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a500c3ea0 0x7f0a500c4330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009d90 tx=0x7f0a4802beb0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a55a34640 1 -- 172.21.15.132:0/543186972 shutdown_connections 2023-11-18T20:40:11.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a55a34640 1 --2- 172.21.15.132:0/543186972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a500c3ea0 0x7f0a500c4330 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a55a34640 1 --2- 172.21.15.132:0/543186972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a5006d0a0 0x7f0a50152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a55a34640 1 -- 172.21.15.132:0/543186972 >> 172.21.15.132:0/543186972 conn(0x7f0a5006a500 msgr2=0x7f0a5006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:11.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a55a34640 1 -- 172.21.15.132:0/543186972 shutdown_connections 2023-11-18T20:40:11.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.493+0000 7f0a55a34640 1 -- 172.21.15.132:0/543186972 wait complete. 2023-11-18T20:40:11.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.495+0000 7f0a55a34640 1 Processor -- start 2023-11-18T20:40:11.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.495+0000 7f0a55a34640 1 -- start start 2023-11-18T20:40:11.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a55a34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a5006d0a0 0x7f0a5014ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a55a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a500c3ea0 0x7f0a500aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a55a34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5014fd30 0x7f0a5014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a55a34640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500aae30 con 0x7f0a5006d0a0 2023-11-18T20:40:11.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a55a34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501dbce0 con 0x7f0a5014fd30 2023-11-18T20:40:11.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a55a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5014ea50 con 0x7f0a500c3ea0 2023-11-18T20:40:11.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a4effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a5006d0a0 0x7f0a5014ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a4effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a5006d0a0 0x7f0a5014ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37624/0 (socket says 172.21.15.132:37624) 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a4effd640 1 -- 172.21.15.132:0/2603132180 learned_addr learned my addr 172.21.15.132:0/2603132180 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a4effd640 1 -- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a500c3ea0 msgr2=0x7f0a500aa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a4effd640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a500c3ea0 0x7f0a500aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a4effd640 1 -- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5014fd30 msgr2=0x7f0a5014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a4effd640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5014fd30 0x7f0a5014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.496+0000 7f0a4effd640 1 -- 172.21.15.132:0/2603132180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48009a70 con 0x7f0a5006d0a0 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.497+0000 7f0a4effd640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a5006d0a0 0x7f0a5014ed30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c4a0 tx=0x7f0a4000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.497+0000 7f0a37fff640 1 -- 172.21.15.132:0/2603132180 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40005ce0 con 0x7f0a5006d0a0 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.497+0000 7f0a37fff640 1 -- 172.21.15.132:0/2603132180 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40005e40 con 0x7f0a5006d0a0 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.497+0000 7f0a37fff640 1 -- 172.21.15.132:0/2603132180 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40007270 con 0x7f0a5006d0a0 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.497+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a50071e60 con 0x7f0a5006d0a0 2023-11-18T20:40:11.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.497+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a500aa5e0 con 0x7f0a5006d0a0 2023-11-18T20:40:11.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.498+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a501dbad0 con 0x7f0a5006d0a0 2023-11-18T20:40:11.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.499+0000 7f0a37fff640 1 -- 172.21.15.132:0/2603132180 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a400073d0 con 0x7f0a5006d0a0 2023-11-18T20:40:11.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.500+0000 7f0a37fff640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0a3c06ae70 0x7f0a3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.500+0000 7f0a37fff640 1 -- 172.21.15.132:0/2603132180 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a40088710 con 0x7f0a5006d0a0 2023-11-18T20:40:11.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.501+0000 7f0a4e7fc640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0a3c06ae70 0x7f0a3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:11.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.502+0000 7f0a4e7fc640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0a3c06ae70 0x7f0a3c06d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0a44006fd0 tx=0x7f0a44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:11.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.504+0000 7f0a37fff640 1 -- 172.21.15.132:0/2603132180 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a40053bb0 con 0x7f0a5006d0a0 2023-11-18T20:40:11.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.764+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f0a50068350 con 0x7f0a5006d0a0 2023-11-18T20:40:11.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.768+0000 7f0a37fff640 1 -- 172.21.15.132:0/2603132180 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v14) v1 ==== 85+0+0 (secure 0 0 0) 0x7f0a40017090 con 0x7f0a5006d0a0 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.770+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0a3c06ae70 msgr2=0x7f0a3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.770+0000 7f0a55a34640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0a3c06ae70 0x7f0a3c06d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0a44006fd0 tx=0x7f0a44008040 comp rx=0 tx=0).stop 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.770+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a5006d0a0 msgr2=0x7f0a5014ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.770+0000 7f0a55a34640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a5006d0a0 0x7f0a5014ed30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c4a0 tx=0x7f0a4000c960 comp rx=0 tx=0).stop 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.771+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 shutdown_connections 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.771+0000 7f0a55a34640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0a3c06ae70 0x7f0a3c06d330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.771+0000 7f0a55a34640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5014fd30 0x7f0a5014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.771+0000 7f0a55a34640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a500c3ea0 0x7f0a500aa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.771+0000 7f0a55a34640 1 --2- 172.21.15.132:0/2603132180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a5006d0a0 0x7f0a5014ed30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.771+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 >> 172.21.15.132:0/2603132180 conn(0x7f0a5006a500 msgr2=0x7f0a500c2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:11.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.771+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 shutdown_connections 2023-11-18T20:40:11.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.771+0000 7f0a55a34640 1 -- 172.21.15.132:0/2603132180 wait complete. 2023-11-18T20:40:11.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:11.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.989+0000 7feb2850a640 1 Processor -- start 2023-11-18T20:40:11.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.989+0000 7feb2850a640 1 -- start start 2023-11-18T20:40:11.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.990+0000 7feb2850a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb2014fd30 0x7feb20152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.990+0000 7feb2850a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb200c64a0 con 0x7feb200c3ea0 2023-11-18T20:40:11.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.990+0000 7feb2850a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb200c5c00 con 0x7feb2006d0a0 2023-11-18T20:40:11.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.990+0000 7feb2850a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb200c5ee0 con 0x7feb2014fd30 2023-11-18T20:40:11.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.990+0000 7feb262a6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb2014fd30 0x7feb20152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:11.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.990+0000 7feb26aa7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feb200c3ea0 0x7feb200c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49052/0 (socket says 172.21.15.132:49052) 2023-11-18T20:40:11.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.991+0000 7feb26aa7640 1 -- 172.21.15.132:0/222782383 learned_addr learned my addr 172.21.15.132:0/222782383 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:11.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.991+0000 7feb262a6640 1 -- 172.21.15.132:0/222782383 >> v1:172.21.15.161:6789/0 conn(0x7feb2006d0a0 legacy=0x7feb200a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:11.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.991+0000 7feb262a6640 1 -- 172.21.15.132:0/222782383 >> v1:172.21.15.132:6789/0 conn(0x7feb200c3ea0 legacy=0x7feb200c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.991+0000 7feb262a6640 1 -- 172.21.15.132:0/222782383 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb200c61c0 con 0x7feb2014fd30 2023-11-18T20:40:11.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.991+0000 7feb252a4640 1 -- 172.21.15.132:0/222782383 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804718373 0 0) 0x7feb200c64a0 con 0x7feb200c3ea0 2023-11-18T20:40:11.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.992+0000 7feb262a6640 1 --2- 172.21.15.132:0/222782383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb20152f20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0097a0 tx=0x7feb1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a6b30a7dd176b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:11.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.992+0000 7feb252a4640 1 -- 172.21.15.132:0/222782383 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c031830 con 0x7feb2014fd30 2023-11-18T20:40:11.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.992+0000 7feb252a4640 1 -- 172.21.15.132:0/222782383 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c031990 con 0x7feb2014fd30 2023-11-18T20:40:11.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.992+0000 7feb252a4640 1 -- 172.21.15.132:0/222782383 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c031d20 con 0x7feb2014fd30 2023-11-18T20:40:11.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.993+0000 7feb2850a640 1 -- 172.21.15.132:0/222782383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 msgr2=0x7feb20152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:11.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.993+0000 7feb2850a640 1 --2- 172.21.15.132:0/222782383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb20152f20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0097a0 tx=0x7feb1c02b8d0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.993+0000 7feb2850a640 1 -- 172.21.15.132:0/222782383 shutdown_connections 2023-11-18T20:40:11.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.993+0000 7feb2850a640 1 --2- 172.21.15.132:0/222782383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb20152f20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:11.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.993+0000 7feb2850a640 1 -- 172.21.15.132:0/222782383 >> 172.21.15.132:0/222782383 conn(0x7feb2006a500 msgr2=0x7feb2006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:11.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.993+0000 7feb2850a640 1 -- 172.21.15.132:0/222782383 shutdown_connections 2023-11-18T20:40:11.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.993+0000 7feb2850a640 1 -- 172.21.15.132:0/222782383 wait complete. 2023-11-18T20:40:11.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.995+0000 7feb2850a640 1 Processor -- start 2023-11-18T20:40:11.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.995+0000 7feb2850a640 1 -- start start 2023-11-18T20:40:11.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb2850a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb2006d0a0 0x7feb200bff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb2850a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb200c3ea0 0x7feb200c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb2850a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb2014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:11.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb2850a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2014e820 con 0x7feb2014fd30 2023-11-18T20:40:11.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb2850a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb20151f90 con 0x7feb2006d0a0 2023-11-18T20:40:11.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb2850a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb20150330 con 0x7feb200c3ea0 2023-11-18T20:40:11.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb26aa7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb2014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb26aa7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb2014ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37632/0 (socket says 172.21.15.132:37632) 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.996+0000 7feb26aa7640 1 -- 172.21.15.132:0/3667081266 learned_addr learned my addr 172.21.15.132:0/3667081266 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb262a6640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb2006d0a0 0x7feb200bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb26aa7640 1 -- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb200c3ea0 msgr2=0x7feb200c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb25aa5640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb200c3ea0 0x7feb200c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb26aa7640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb200c3ea0 0x7feb200c2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb26aa7640 1 -- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb2006d0a0 msgr2=0x7feb200bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb26aa7640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb2006d0a0 0x7feb200bff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb26aa7640 1 -- 172.21.15.132:0/3667081266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c009400 con 0x7feb2014fd30 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb262a6640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb2006d0a0 0x7feb200bff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:12.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb26aa7640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb2014ec40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c810 tx=0x7feb1800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:12.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb16ffd640 1 -- 172.21.15.132:0/3667081266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800a640 con 0x7feb2014fd30 2023-11-18T20:40:12.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb16ffd640 1 -- 172.21.15.132:0/3667081266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1800a7c0 con 0x7feb2014fd30 2023-11-18T20:40:12.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb20150580 con 0x7feb2014fd30 2023-11-18T20:40:12.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb16ffd640 1 -- 172.21.15.132:0/3667081266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800ab70 con 0x7feb2014fd30 2023-11-18T20:40:12.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.997+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb20150b40 con 0x7feb2014fd30 2023-11-18T20:40:12.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:11.998+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2014e960 con 0x7feb2014fd30 2023-11-18T20:40:12.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.000+0000 7feb16ffd640 1 -- 172.21.15.132:0/3667081266 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb1800acd0 con 0x7feb2014fd30 2023-11-18T20:40:12.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.000+0000 7feb16ffd640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb0406ae40 0x7feb0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.001+0000 7feb16ffd640 1 -- 172.21.15.132:0/3667081266 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb18088b20 con 0x7feb2014fd30 2023-11-18T20:40:12.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.001+0000 7feb262a6640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb0406ae40 0x7feb0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.002+0000 7feb262a6640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb0406ae40 0x7feb0406d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feb1c036000 tx=0x7feb1c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:12.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.005+0000 7feb16ffd640 1 -- 172.21.15.132:0/3667081266 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb18053f10 con 0x7feb2014fd30 2023-11-18T20:40:12.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.193+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb20068350 con 0x7feb2014fd30 2023-11-18T20:40:12.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.195+0000 7feb16ffd640 1 -- 172.21.15.132:0/3667081266 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+12893 (secure 0 0 0) 0x7feb18018020 con 0x7feb2014fd30 2023-11-18T20:40:12.196 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:12.197 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:10.773901+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:12.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb0406ae40 msgr2=0x7feb0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb0406ae40 0x7feb0406d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feb1c036000 tx=0x7feb1c008030 comp rx=0 tx=0).stop 2023-11-18T20:40:12.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 msgr2=0x7feb2014ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb2014ec40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c810 tx=0x7feb1800ccd0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 shutdown_connections 2023-11-18T20:40:12.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feb0406ae40 0x7feb0406d300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb2014fd30 0x7feb2014ec40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb200c3ea0 0x7feb200c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 --2- 172.21.15.132:0/3667081266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb2006d0a0 0x7feb200bff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.198+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 >> 172.21.15.132:0/3667081266 conn(0x7feb2006a500 msgr2=0x7feb200a7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:12.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.199+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 shutdown_connections 2023-11-18T20:40:12.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.199+0000 7feb2850a640 1 -- 172.21.15.132:0/3667081266 wait complete. 2023-11-18T20:40:12.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:40:12.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:40:12.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.419+0000 7ff96de15640 1 Processor -- start 2023-11-18T20:40:12.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.420+0000 7ff96de15640 1 -- start start 2023-11-18T20:40:12.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.421+0000 7ff96de15640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96814fd30 0x7ff968152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.421+0000 7ff96de15640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680c64a0 con 0x7ff96806d0a0 2023-11-18T20:40:12.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.421+0000 7ff96de15640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680c5c00 con 0x7ff9680c3ea0 2023-11-18T20:40:12.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.421+0000 7ff96de15640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680c5ee0 con 0x7ff96814fd30 2023-11-18T20:40:12.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.421+0000 7ff966ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff96806d0a0 0x7ff9680a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49066/0 (socket says 172.21.15.132:49066) 2023-11-18T20:40:12.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.421+0000 7ff966ffd640 1 -- 172.21.15.132:0/2006427507 learned_addr learned my addr 172.21.15.132:0/2006427507 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:12.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.421+0000 7ff9677fe640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96814fd30 0x7ff968152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029884916 0 0) 0x7ff9680c64a0 con 0x7ff96806d0a0 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff954003520 con 0x7ff96806d0a0 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3983907891 0 0) 0x7ff954003520 con 0x7ff96806d0a0 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96814fd30 msgr2=0x7ff968152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96814fd30 0x7ff968152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 >> v1:172.21.15.161:6789/0 conn(0x7ff9680c3ea0 legacy=0x7ff9680c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680c61c0 con 0x7ff96806d0a0 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7ff950001670 con 0x7ff96806d0a0 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 >> v1:172.21.15.132:6789/0 conn(0x7ff96806d0a0 legacy=0x7ff9680a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9540039a0 0x7ff954003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540047c0 0x7ff954004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96814fd30 0x7ff954005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680c5ee0 con 0x7ff9540039a0 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95400ba30 con 0x7ff9540047c0 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.422+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95400bbf0 con 0x7ff96814fd30 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.423+0000 7ff9677fe640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9540039a0 0x7ff954003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.423+0000 7ff966ffd640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540047c0 0x7ff954004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.423+0000 7ff967fff640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96814fd30 0x7ff954005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.423+0000 7ff9677fe640 1 -- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96814fd30 msgr2=0x7ff954005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.423+0000 7ff9677fe640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96814fd30 0x7ff954005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.423+0000 7ff9677fe640 1 -- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540047c0 msgr2=0x7ff954004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.423+0000 7ff9677fe640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540047c0 0x7ff954004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.423+0000 7ff9677fe640 1 -- 172.21.15.132:0/2006427507 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954003520 con 0x7ff9540039a0 2023-11-18T20:40:12.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.424+0000 7ff9677fe640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9540039a0 0x7ff954003dc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff958009f90 tx=0x7ff9540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b8611eeb004f83 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:12.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.424+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95802cba0 con 0x7ff9540039a0 2023-11-18T20:40:12.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.424+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800f040 con 0x7ff9540039a0 2023-11-18T20:40:12.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.424+0000 7ff9667fc640 1 -- 172.21.15.132:0/2006427507 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958034440 con 0x7ff9540039a0 2023-11-18T20:40:12.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.425+0000 7ff96de15640 1 -- 172.21.15.132:0/2006427507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9540039a0 msgr2=0x7ff954003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.425+0000 7ff96de15640 1 --2- 172.21.15.132:0/2006427507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9540039a0 0x7ff954003dc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff958009f90 tx=0x7ff9540057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.425+0000 7ff967fff640 1 -- 172.21.15.132:0/2006427507 reap_dead start 2023-11-18T20:40:12.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.425+0000 7ff96de15640 1 -- 172.21.15.132:0/2006427507 shutdown_connections 2023-11-18T20:40:12.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.425+0000 7ff96de15640 1 -- 172.21.15.132:0/2006427507 >> 172.21.15.132:0/2006427507 conn(0x7ff96806a500 msgr2=0x7ff96806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:12.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.425+0000 7ff96de15640 1 -- 172.21.15.132:0/2006427507 shutdown_connections 2023-11-18T20:40:12.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.425+0000 7ff96de15640 1 -- 172.21.15.132:0/2006427507 wait complete. 2023-11-18T20:40:12.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.427+0000 7ff96de15640 1 Processor -- start 2023-11-18T20:40:12.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.427+0000 7ff96de15640 1 -- start start 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff96de15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540039a0 0x7ff9681515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff96de15640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9681e69e0 0x7ff9680be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff96de15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680bedd0 0x7ff96814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff96de15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9681e6ee0 con 0x7ff9680bedd0 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff96de15640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9681549e0 con 0x7ff9540039a0 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff96de15640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff968154cc0 con 0x7ff9681e69e0 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff967fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680bedd0 0x7ff96814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff967fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680bedd0 0x7ff96814ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37644/0 (socket says 172.21.15.132:37644) 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.428+0000 7ff967fff640 1 -- 172.21.15.132:0/760381769 learned_addr learned my addr 172.21.15.132:0/760381769 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff966ffd640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9681e69e0 0x7ff9680be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff9677fe640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540039a0 0x7ff9681515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff967fff640 1 -- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9681e69e0 msgr2=0x7ff9680be890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff967fff640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9681e69e0 0x7ff9680be890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff967fff640 1 -- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540039a0 msgr2=0x7ff9681515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff967fff640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540039a0 0x7ff9681515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff967fff640 1 -- 172.21.15.132:0/760381769 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff968154fa0 con 0x7ff9680bedd0 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff967fff640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680bedd0 0x7ff96814ecc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff960000c00 tx=0x7ff96000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff95ffff640 1 -- 172.21.15.132:0/760381769 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600052e0 con 0x7ff9680bedd0 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff95ffff640 1 -- 172.21.15.132:0/760381769 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff960005440 con 0x7ff9680bedd0 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff95ffff640 1 -- 172.21.15.132:0/760381769 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960003830 con 0x7ff9680bedd0 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.429+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff968155280 con 0x7ff9680bedd0 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.430+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff968151eb0 con 0x7ff9680bedd0 2023-11-18T20:40:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.431+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff968072980 con 0x7ff9680bedd0 2023-11-18T20:40:12.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.432+0000 7ff95ffff640 1 -- 172.21.15.132:0/760381769 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff960003990 con 0x7ff9680bedd0 2023-11-18T20:40:12.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.432+0000 7ff95ffff640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94806ae70 0x7ff94806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.433+0000 7ff95ffff640 1 -- 172.21.15.132:0/760381769 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff9600888f0 con 0x7ff9680bedd0 2023-11-18T20:40:12.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.433+0000 7ff9677fe640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94806ae70 0x7ff94806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.434+0000 7ff9677fe640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94806ae70 0x7ff94806d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff958036000 tx=0x7ff95802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.437+0000 7ff95ffff640 1 -- 172.21.15.132:0/760381769 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff960053ce0 con 0x7ff9680bedd0 2023-11-18T20:40:12.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.625+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff968068350 con 0x7ff9680bedd0 2023-11-18T20:40:12.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.626+0000 7ff95ffff640 1 -- 172.21.15.132:0/760381769 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff960019020 con 0x7ff9680bedd0 2023-11-18T20:40:12.627 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:40:12.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.628+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94806ae70 msgr2=0x7ff94806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.628+0000 7ff96de15640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94806ae70 0x7ff94806d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff958036000 tx=0x7ff95802e000 comp rx=0 tx=0).stop 2023-11-18T20:40:12.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.628+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680bedd0 msgr2=0x7ff96814ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.628+0000 7ff96de15640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680bedd0 0x7ff96814ecc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff960000c00 tx=0x7ff96000e8a0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.629+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 shutdown_connections 2023-11-18T20:40:12.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.629+0000 7ff96de15640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff94806ae70 0x7ff94806d330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.629+0000 7ff96de15640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9680bedd0 0x7ff96814ecc0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.629+0000 7ff96de15640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9681e69e0 0x7ff9680be890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.629+0000 7ff96de15640 1 --2- 172.21.15.132:0/760381769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9540039a0 0x7ff9681515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.629+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 >> 172.21.15.132:0/760381769 conn(0x7ff96806a500 msgr2=0x7ff9680c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:12.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.629+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 shutdown_connections 2023-11-18T20:40:12.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.629+0000 7ff96de15640 1 -- 172.21.15.132:0/760381769 wait complete. 2023-11-18T20:40:12.649 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T20:40:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.867+0000 7fb0d691d640 1 Processor -- start 2023-11-18T20:40:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.867+0000 7fb0d691d640 1 -- start start 2023-11-18T20:40:12.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.868+0000 7fb0d691d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c7a20 0x7fb0d00c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.868+0000 7fb0d691d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d0155d40 0x7fb0d00c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.868+0000 7fb0d691d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb0d00c6c60 0x7fb0d00a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.868+0000 7fb0d691d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d00c5cc0 con 0x7fb0d00c6c60 2023-11-18T20:40:12.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.868+0000 7fb0d691d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d00c5ea0 con 0x7fb0d0155d40 2023-11-18T20:40:12.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.868+0000 7fb0d691d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00c6180 con 0x7fb0d00c7a20 2023-11-18T20:40:12.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.868+0000 7fb0d4eba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb0d00c6c60 0x7fb0d00a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0d4eba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb0d00c6c60 0x7fb0d00a6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37650/0 (socket says 172.21.15.132:37650) 2023-11-18T20:40:12.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0d4eba640 1 -- 172.21.15.132:0/3750428612 learned_addr learned my addr 172.21.15.132:0/3750428612 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:12.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0cffff640 1 --2- 172.21.15.132:0/3750428612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c7a20 0x7fb0d00c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0cf7fe640 1 --2- 172.21.15.132:0/3750428612 >> v2:172.21.15.161:3300/0 conn(0x7fb0d0155d40 0x7fb0d00c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0d4eba640 1 -- 172.21.15.132:0/3750428612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c7a20 msgr2=0x7fb0d00c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:12.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0d4eba640 1 --2- 172.21.15.132:0/3750428612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c7a20 0x7fb0d00c1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0d4eba640 1 -- 172.21.15.132:0/3750428612 >> v2:172.21.15.161:3300/0 conn(0x7fb0d0155d40 msgr2=0x7fb0d00c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:12.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0d4eba640 1 --2- 172.21.15.132:0/3750428612 >> v2:172.21.15.161:3300/0 conn(0x7fb0d0155d40 0x7fb0d00c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0d4eba640 1 -- 172.21.15.132:0/3750428612 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d00c6460 con 0x7fb0d00c6c60 2023-11-18T20:40:12.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.869+0000 7fb0cffff640 1 --2- 172.21.15.132:0/3750428612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c7a20 0x7fb0d00c1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.870+0000 7fb0d4eba640 1 --2- 172.21.15.132:0/3750428612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d00c6c60 0x7fb0d00a6d40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009e50 tx=0x7fb0c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3bf1b120041ea3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.870+0000 7fb0ceffd640 1 -- 172.21.15.132:0/3750428612 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c802ca70 con 0x7fb0d00c6c60 2023-11-18T20:40:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.870+0000 7fb0ceffd640 1 -- 172.21.15.132:0/3750428612 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c802cbd0 con 0x7fb0d00c6c60 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.870+0000 7fb0ceffd640 1 -- 172.21.15.132:0/3750428612 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80343f0 con 0x7fb0d00c6c60 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 -- 172.21.15.132:0/3750428612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d00c6c60 msgr2=0x7fb0d00a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 --2- 172.21.15.132:0/3750428612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d00c6c60 0x7fb0d00a6d40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009e50 tx=0x7fb0c802bed0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 -- 172.21.15.132:0/3750428612 shutdown_connections 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 --2- 172.21.15.132:0/3750428612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d00c6c60 0x7fb0d00a6d40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 --2- 172.21.15.132:0/3750428612 >> v2:172.21.15.161:3300/0 conn(0x7fb0d0155d40 0x7fb0d00c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 --2- 172.21.15.132:0/3750428612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c7a20 0x7fb0d00c1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 -- 172.21.15.132:0/3750428612 >> 172.21.15.132:0/3750428612 conn(0x7fb0d00a9b70 msgr2=0x7fb0d00a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:12.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 -- 172.21.15.132:0/3750428612 shutdown_connections 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.871+0000 7fb0d691d640 1 -- 172.21.15.132:0/3750428612 wait complete. 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.873+0000 7fb0d691d640 1 Processor -- start 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.873+0000 7fb0d691d640 1 -- start start 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d691d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c6c60 0x7fb0d014fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d691d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d00c7a20 0x7fb0d0150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d691d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d0155d40 0x7fb0d0099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d691d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01ea220 con 0x7fb0d0155d40 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d691d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00a95e0 con 0x7fb0d00c7a20 2023-11-18T20:40:12.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d691d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01ea490 con 0x7fb0d00c6c60 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d4eba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d0155d40 0x7fb0d0099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d4eba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d0155d40 0x7fb0d0099cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37656/0 (socket says 172.21.15.132:37656) 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d4eba640 1 -- 172.21.15.132:0/2590078583 learned_addr learned my addr 172.21.15.132:0/2590078583 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0cffff640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c6c60 0x7fb0d014fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d4eba640 1 -- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c6c60 msgr2=0x7fb0d014fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d4eba640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c6c60 0x7fb0d014fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d4eba640 1 -- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d00c7a20 msgr2=0x7fb0d0150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.874+0000 7fb0d4eba640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d00c7a20 0x7fb0d0150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.875+0000 7fb0d4eba640 1 -- 172.21.15.132:0/2590078583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009b30 con 0x7fb0d0155d40 2023-11-18T20:40:12.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.875+0000 7fb0d4eba640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d0155d40 0x7fb0d0099cd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009e50 tx=0x7fb0c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:12.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.875+0000 7fb0ccff9640 1 -- 172.21.15.132:0/2590078583 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8009510 con 0x7fb0d0155d40 2023-11-18T20:40:12.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.875+0000 7fb0ccff9640 1 -- 172.21.15.132:0/2590078583 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c803e450 con 0x7fb0d0155d40 2023-11-18T20:40:12.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.875+0000 7fb0ccff9640 1 -- 172.21.15.132:0/2590078583 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c803e800 con 0x7fb0d0155d40 2023-11-18T20:40:12.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.875+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d0156c30 con 0x7fb0d0155d40 2023-11-18T20:40:12.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.875+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d0150710 con 0x7fb0d0155d40 2023-11-18T20:40:12.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.876+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d01ea600 con 0x7fb0d0155d40 2023-11-18T20:40:12.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.877+0000 7fb0ccff9640 1 -- 172.21.15.132:0/2590078583 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0c803e960 con 0x7fb0d0155d40 2023-11-18T20:40:12.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.878+0000 7fb0ccff9640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0bc06ae40 0x7fb0bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:12.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.878+0000 7fb0ccff9640 1 -- 172.21.15.132:0/2590078583 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0c80ac1d0 con 0x7fb0d0155d40 2023-11-18T20:40:12.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.879+0000 7fb0cffff640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0bc06ae40 0x7fb0bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:12.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.880+0000 7fb0cffff640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0bc06ae40 0x7fb0bc06d300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0006fd0 tx=0x7fb0c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:12.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:12.883+0000 7fb0ccff9640 1 -- 172.21.15.132:0/2590078583 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0c8077670 con 0x7fb0d0155d40 2023-11-18T20:40:13.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.073+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb0d0068350 con 0x7fb0d0155d40 2023-11-18T20:40:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.074+0000 7fb0ccff9640 1 -- 172.21.15.132:0/2590078583 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb0c807ac90 con 0x7fb0d0155d40 2023-11-18T20:40:13.075 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:13.075 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-11-18T20:40:13.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:13.075 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-11-18T20:40:13.075 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-11-18T20:40:13.075 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:13.075 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-11-18T20:40:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.076+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0bc06ae40 msgr2=0x7fb0bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.076+0000 7fb0d691d640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0bc06ae40 0x7fb0bc06d300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0006fd0 tx=0x7fb0c0008040 comp rx=0 tx=0).stop 2023-11-18T20:40:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.076+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d0155d40 msgr2=0x7fb0d0099cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.076+0000 7fb0d691d640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d0155d40 0x7fb0d0099cd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009e50 tx=0x7fb0c8004a40 comp rx=0 tx=0).stop 2023-11-18T20:40:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.077+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 shutdown_connections 2023-11-18T20:40:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.077+0000 7fb0d691d640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0bc06ae40 0x7fb0bc06d300 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.077+0000 7fb0d691d640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d0155d40 0x7fb0d0099cd0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.077+0000 7fb0d691d640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d00c7a20 0x7fb0d0150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.077+0000 7fb0d691d640 1 --2- 172.21.15.132:0/2590078583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d00c6c60 0x7fb0d014fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.077+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 >> 172.21.15.132:0/2590078583 conn(0x7fb0d00a9b70 msgr2=0x7fb0d00c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.077+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 shutdown_connections 2023-11-18T20:40:13.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.077+0000 7fb0d691d640 1 -- 172.21.15.132:0/2590078583 wait complete. 2023-11-18T20:40:13.096 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-18T20:40:13.096 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-18T20:40:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.312+0000 7f14b13a9640 1 Processor -- start 2023-11-18T20:40:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.312+0000 7f14b13a9640 1 -- start start 2023-11-18T20:40:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14b13a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14ac0a5370 0x7f14ac0c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14b13a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 0x7f14ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14b13a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14ac0a8c70 0x7f14ac06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14b13a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac0a5750 con 0x7f14ac0a5370 2023-11-18T20:40:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14b13a9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac0c3380 con 0x7f14ac0a8c70 2023-11-18T20:40:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14b13a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac06c570 con 0x7f14ac0c5110 2023-11-18T20:40:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14aaffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14ac0a5370 0x7f14ac0c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14aaffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14ac0a5370 0x7f14ac0c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37668/0 (socket says 172.21.15.132:37668) 2023-11-18T20:40:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14aaffd640 1 -- 172.21.15.132:0/1833305083 learned_addr learned my addr 172.21.15.132:0/1833305083 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14aaffd640 1 -- 172.21.15.132:0/1833305083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 msgr2=0x7f14ac06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14aaffd640 1 --2- 172.21.15.132:0/1833305083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 0x7f14ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14aaffd640 1 -- 172.21.15.132:0/1833305083 >> v2:172.21.15.161:3300/0 conn(0x7f14ac0a8c70 msgr2=0x7f14ac06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14aaffd640 1 --2- 172.21.15.132:0/1833305083 >> v2:172.21.15.161:3300/0 conn(0x7f14ac0a8c70 0x7f14ac06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.314+0000 7f14aaffd640 1 -- 172.21.15.132:0/1833305083 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac06c850 con 0x7f14ac0a5370 2023-11-18T20:40:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.315+0000 7f14aaffd640 1 --2- 172.21.15.132:0/1833305083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0c4bd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f14ac06bf70 tx=0x7f149c02e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f73dae9e0bee60 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14aa7fc640 1 -- 172.21.15.132:0/1833305083 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c02ee80 con 0x7f14ac0a5370 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14aa7fc640 1 -- 172.21.15.132:0/1833305083 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c036440 con 0x7f14ac0a5370 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14aa7fc640 1 -- 172.21.15.132:0/1833305083 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c0367b0 con 0x7f14ac0a5370 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14b13a9640 1 -- 172.21.15.132:0/1833305083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 msgr2=0x7f14ac0c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1833305083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0c4bd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f14ac06bf70 tx=0x7f149c02e0d0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14b13a9640 1 -- 172.21.15.132:0/1833305083 shutdown_connections 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1833305083 >> v2:172.21.15.161:3300/0 conn(0x7f14ac0a8c70 0x7f14ac06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1833305083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 0x7f14ac06d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1833305083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0c4bd0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14b13a9640 1 -- 172.21.15.132:0/1833305083 >> 172.21.15.132:0/1833305083 conn(0x7f14ac0c5bc0 msgr2=0x7f14ac0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:13.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.316+0000 7f14b13a9640 1 -- 172.21.15.132:0/1833305083 shutdown_connections 2023-11-18T20:40:13.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.317+0000 7f14b13a9640 1 -- 172.21.15.132:0/1833305083 wait complete. 2023-11-18T20:40:13.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.318+0000 7f14b13a9640 1 Processor -- start 2023-11-18T20:40:13.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.318+0000 7f14b13a9640 1 -- start start 2023-11-18T20:40:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14b13a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0bf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14b13a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ac0a8c70 0x7f14ac1ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14b13a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 0x7f14ac1eaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14b13a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0c0160 con 0x7f14ac0a5370 2023-11-18T20:40:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14b13a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac1ee020 con 0x7f14ac0a8c70 2023-11-18T20:40:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14b13a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac1ee550 con 0x7f14ac0c5110 2023-11-18T20:40:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14aaffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14aaffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0bf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37676/0 (socket says 172.21.15.132:37676) 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.319+0000 7f14aaffd640 1 -- 172.21.15.132:0/1262564275 learned_addr learned my addr 172.21.15.132:0/1262564275 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14ab7fe640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 0x7f14ac1eaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14aaffd640 1 -- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 msgr2=0x7f14ac1eaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14a27fc640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ac0a8c70 0x7f14ac1ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14aaffd640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 0x7f14ac1eaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14aaffd640 1 -- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ac0a8c70 msgr2=0x7f14ac1ea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14aaffd640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ac0a8c70 0x7f14ac1ea5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14aaffd640 1 -- 172.21.15.132:0/1262564275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c00b770 con 0x7f14ac0a5370 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14ab7fe640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 0x7f14ac1eaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14aaffd640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0bf260 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f149c02e110 tx=0x7f149c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:13.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14a3fff640 1 -- 172.21.15.132:0/1262564275 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c034950 con 0x7f14ac0a5370 2023-11-18T20:40:13.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14a3fff640 1 -- 172.21.15.132:0/1262564275 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c034ab0 con 0x7f14ac0a5370 2023-11-18T20:40:13.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.320+0000 7f14a3fff640 1 -- 172.21.15.132:0/1262564275 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c034e60 con 0x7f14ac0a5370 2023-11-18T20:40:13.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.321+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac1eb020 con 0x7f14ac0a5370 2023-11-18T20:40:13.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.321+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac1ee270 con 0x7f14ac0a5370 2023-11-18T20:40:13.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.322+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac072b80 con 0x7f14ac0a5370 2023-11-18T20:40:13.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.323+0000 7f14a3fff640 1 -- 172.21.15.132:0/1262564275 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f149c041480 con 0x7f14ac0a5370 2023-11-18T20:40:13.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.323+0000 7f14a3fff640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f148c06ae40 0x7f148c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:13.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.323+0000 7f14a3fff640 1 -- 172.21.15.132:0/1262564275 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f149c0ac580 con 0x7f14ac0a5370 2023-11-18T20:40:13.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.324+0000 7f14a27fc640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f148c06ae40 0x7f148c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:13.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.325+0000 7f14a27fc640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f148c06ae40 0x7f148c06d300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f14ac152570 tx=0x7f14940072f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:13.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.328+0000 7f14a3fff640 1 -- 172.21.15.132:0/1262564275 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f149c077970 con 0x7f14ac0a5370 2023-11-18T20:40:13.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.519+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f14ac0c0330 con 0x7f14ac0a5370 2023-11-18T20:40:13.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.788+0000 7f14a3fff640 1 -- 172.21.15.132:0/1262564275 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7f149c03b0b0 con 0x7f14ac0a5370 2023-11-18T20:40:13.789 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-11-18T20:40:13.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f148c06ae40 msgr2=0x7f148c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:13.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f148c06ae40 0x7f148c06d300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f14ac152570 tx=0x7f14940072f0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 msgr2=0x7f14ac0bf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:13.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0bf260 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f149c02e110 tx=0x7f149c004730 comp rx=0 tx=0).stop 2023-11-18T20:40:13.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 shutdown_connections 2023-11-18T20:40:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f148c06ae40 0x7f148c06d300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14ac0c5110 0x7f14ac1eaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ac0a8c70 0x7f14ac1ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 --2- 172.21.15.132:0/1262564275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ac0a5370 0x7f14ac0bf260 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.791+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 >> 172.21.15.132:0/1262564275 conn(0x7f14ac0c5bc0 msgr2=0x7f14ac0c2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.792+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 shutdown_connections 2023-11-18T20:40:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:13.792+0000 7f14b13a9640 1 -- 172.21.15.132:0/1262564275 wait complete. 2023-11-18T20:40:13.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T20:40:14.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.018+0000 7f6c23f97640 1 Processor -- start 2023-11-18T20:40:14.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.018+0000 7f6c23f97640 1 -- start start 2023-11-18T20:40:14.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.019+0000 7f6c23f97640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6c1c14f9f0 0x7f6c1c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:14.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c23f97640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c1c0c7540 0x7f6c1c0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:14.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c23f97640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 0x7f6c1c152600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:14.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c23f97640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c0a7740 con 0x7f6c1c0c7540 2023-11-18T20:40:14.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c23f97640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c0a6de0 con 0x7f6c1c14f9f0 2023-11-18T20:40:14.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c23f97640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c0a7080 con 0x7f6c1c0c4d20 2023-11-18T20:40:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21532640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c1c0c7540 0x7f6c1c0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21532640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c1c0c7540 0x7f6c1c0c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37682/0 (socket says 172.21.15.132:37682) 2023-11-18T20:40:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21532640 1 -- 172.21.15.132:0/114461596 learned_addr learned my addr 172.21.15.132:0/114461596 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21d33640 1 --2- 172.21.15.132:0/114461596 >> v2:172.21.15.161:3300/0 conn(0x7f6c1c14f9f0 0x7f6c1c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c22534640 1 --2- 172.21.15.132:0/114461596 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 0x7f6c1c152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21532640 1 -- 172.21.15.132:0/114461596 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 msgr2=0x7f6c1c152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21532640 1 --2- 172.21.15.132:0/114461596 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 0x7f6c1c152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21532640 1 -- 172.21.15.132:0/114461596 >> v2:172.21.15.161:3300/0 conn(0x7f6c1c14f9f0 msgr2=0x7f6c1c06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21532640 1 --2- 172.21.15.132:0/114461596 >> v2:172.21.15.161:3300/0 conn(0x7f6c1c14f9f0 0x7f6c1c06dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.020+0000 7f6c21532640 1 -- 172.21.15.132:0/114461596 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c0a7360 con 0x7f6c1c0c7540 2023-11-18T20:40:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.022+0000 7f6c21532640 1 --2- 172.21.15.132:0/114461596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c47e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c070990 tx=0x7f6c1002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314531b1a66ee7a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:14.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.022+0000 7f6c20d31640 1 -- 172.21.15.132:0/114461596 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10031750 con 0x7f6c1c0c7540 2023-11-18T20:40:14.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.022+0000 7f6c20d31640 1 -- 172.21.15.132:0/114461596 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c100318b0 con 0x7f6c1c0c7540 2023-11-18T20:40:14.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.022+0000 7f6c20d31640 1 -- 172.21.15.132:0/114461596 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10031c40 con 0x7f6c1c0c7540 2023-11-18T20:40:14.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 -- 172.21.15.132:0/114461596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 msgr2=0x7f6c1c0c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 --2- 172.21.15.132:0/114461596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c47e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c070990 tx=0x7f6c1002b7f0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 -- 172.21.15.132:0/114461596 shutdown_connections 2023-11-18T20:40:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 --2- 172.21.15.132:0/114461596 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 0x7f6c1c152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 --2- 172.21.15.132:0/114461596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c47e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 --2- 172.21.15.132:0/114461596 >> v2:172.21.15.161:3300/0 conn(0x7f6c1c14f9f0 0x7f6c1c06dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 -- 172.21.15.132:0/114461596 >> 172.21.15.132:0/114461596 conn(0x7f6c1c0c7dc0 msgr2=0x7f6c1c0c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 -- 172.21.15.132:0/114461596 shutdown_connections 2023-11-18T20:40:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.023+0000 7f6c23f97640 1 -- 172.21.15.132:0/114461596 wait complete. 2023-11-18T20:40:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.025+0000 7f6c23f97640 1 Processor -- start 2023-11-18T20:40:14.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.025+0000 7f6c23f97640 1 -- start start 2023-11-18T20:40:14.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.026+0000 7f6c23f97640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 0x7f6c1c147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:14.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.026+0000 7f6c23f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:14.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.026+0000 7f6c23f97640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c1c14f9f0 0x7f6c1c1ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:14.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.026+0000 7f6c23f97640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1ee420 con 0x7f6c1c0c7540 2023-11-18T20:40:14.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.026+0000 7f6c23f97640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c06c9f0 con 0x7f6c1c14f9f0 2023-11-18T20:40:14.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.026+0000 7f6c23f97640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c06ccd0 con 0x7f6c1c0c4d20 2023-11-18T20:40:14.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21532640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:14.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21532640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37696/0 (socket says 172.21.15.132:37696) 2023-11-18T20:40:14.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21532640 1 -- 172.21.15.132:0/2569449022 learned_addr learned my addr 172.21.15.132:0/2569449022 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:14.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21d33640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 0x7f6c1c147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:14.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21532640 1 -- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 msgr2=0x7f6c1c147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:14.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21532640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 0x7f6c1c147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21532640 1 -- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c1c14f9f0 msgr2=0x7f6c1c1ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:14.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21532640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c1c14f9f0 0x7f6c1c1ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.027+0000 7f6c21532640 1 -- 172.21.15.132:0/2569449022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c100094d0 con 0x7f6c1c0c7540 2023-11-18T20:40:14.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.028+0000 7f6c21532640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c1460 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6c1002b830 tx=0x7f6c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:14.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.028+0000 7f6c1a7fc640 1 -- 172.21.15.132:0/2569449022 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10033c80 con 0x7f6c1c0c7540 2023-11-18T20:40:14.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.028+0000 7f6c1a7fc640 1 -- 172.21.15.132:0/2569449022 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c10033e00 con 0x7f6c1c0c7540 2023-11-18T20:40:14.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.028+0000 7f6c1a7fc640 1 -- 172.21.15.132:0/2569449022 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1003c640 con 0x7f6c1c0c7540 2023-11-18T20:40:14.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.028+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c06cfb0 con 0x7f6c1c0c7540 2023-11-18T20:40:14.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.028+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c0c19a0 con 0x7f6c1c0c7540 2023-11-18T20:40:14.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.029+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c1ea310 con 0x7f6c1c0c7540 2023-11-18T20:40:14.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.031+0000 7f6c1a7fc640 1 -- 172.21.15.132:0/2569449022 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c1003a040 con 0x7f6c1c0c7540 2023-11-18T20:40:14.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.032+0000 7f6c1a7fc640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6c0806ae40 0x7f6c0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:14.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.032+0000 7f6c1a7fc640 1 -- 172.21.15.132:0/2569449022 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6c100ab4c0 con 0x7f6c1c0c7540 2023-11-18T20:40:14.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.033+0000 7f6c21d33640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6c0806ae40 0x7f6c0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:14.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.034+0000 7f6c21d33640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6c0806ae40 0x7f6c0806d300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0070b0 tx=0x7f6c0c007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:14.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.037+0000 7f6c1a7fc640 1 -- 172.21.15.132:0/2569449022 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c100769e0 con 0x7f6c1c0c7540 2023-11-18T20:40:14.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.230+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6c1c1ea310 con 0x7f6c1c0c7540 2023-11-18T20:40:14.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.793+0000 7f6c1a7fc640 1 -- 172.21.15.132:0/2569449022 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6c1c1ea310 con 0x7f6c1c0c7540 2023-11-18T20:40:14.795 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-11-18T20:40:14.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6c0806ae40 msgr2=0x7f6c0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:14.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6c0806ae40 0x7f6c0806d300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0070b0 tx=0x7f6c0c007040 comp rx=0 tx=0).stop 2023-11-18T20:40:14.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 msgr2=0x7f6c1c0c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:14.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c1460 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6c1002b830 tx=0x7f6c100046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 shutdown_connections 2023-11-18T20:40:14.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6c0806ae40 0x7f6c0806d300 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c1c14f9f0 0x7f6c1c1ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c1c0c7540 0x7f6c1c0c1460 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 --2- 172.21.15.132:0/2569449022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c1c0c4d20 0x7f6c1c147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:14.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 >> 172.21.15.132:0/2569449022 conn(0x7f6c1c0c7dc0 msgr2=0x7f6c1c14d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:14.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 shutdown_connections 2023-11-18T20:40:14.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:14.797+0000 7f6c23f97640 1 -- 172.21.15.132:0/2569449022 wait complete. 2023-11-18T20:40:14.830 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-18T20:40:15.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.012+0000 7f236669f640 1 Processor -- start 2023-11-18T20:40:15.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.013+0000 7f236669f640 1 -- start start 2023-11-18T20:40:15.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.014+0000 7f236669f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f236014c2e0 0x7f23600c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.014+0000 7f236669f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23600c0440 0x7f2360152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.014+0000 7f236669f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2360071e80 con 0x7f2360072310 2023-11-18T20:40:15.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.014+0000 7f236669f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2360071470 con 0x7f236014c2e0 2023-11-18T20:40:15.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.014+0000 7f236669f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236014c6c0 con 0x7f23600c0440 2023-11-18T20:40:15.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.014+0000 7f2365e9e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2360072310 0x7f23600a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49074/0 (socket says 172.21.15.132:49074) 2023-11-18T20:40:15.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.014+0000 7f2365e9e640 1 -- 172.21.15.132:0/1190020461 learned_addr learned my addr 172.21.15.132:0/1190020461 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2364e9c640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23600c0440 0x7f2360152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f236569d640 1 --2- 172.21.15.132:0/1190020461 >> v2:172.21.15.161:3300/0 conn(0x7f236014c2e0 0x7f23600c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124293118 0 0) 0x7f2360071e80 con 0x7f2360072310 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f234c003520 con 0x7f2360072310 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991185546 0 0) 0x7f234c003520 con 0x7f2360072310 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23600c0440 msgr2=0x7f2360152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23600c0440 0x7f2360152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 >> v2:172.21.15.161:3300/0 conn(0x7f236014c2e0 msgr2=0x7f23600c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 --2- 172.21.15.132:0/1190020461 >> v2:172.21.15.161:3300/0 conn(0x7f236014c2e0 0x7f23600c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360153180 con 0x7f2360072310 2023-11-18T20:40:15.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f23580019f0 con 0x7f2360072310 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 >> v1:172.21.15.132:6789/0 conn(0x7f2360072310 legacy=0x7f23600a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f234c003970 0x7f234c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23600c0440 0x7f234c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.015+0000 7f2357fff640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f234c004d00 0x7f234c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236014c6c0 con 0x7f234c003970 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00b980 con 0x7f234c004d00 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00bb40 con 0x7f23600c0440 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f236569d640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f234c003970 0x7f234c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f2364e9c640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23600c0440 0x7f234c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f236569d640 1 -- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23600c0440 msgr2=0x7f234c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f236569d640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23600c0440 0x7f234c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f236569d640 1 -- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f234c004d00 msgr2=0x7f234c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f236569d640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f234c004d00 0x7f234c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.016+0000 7f236569d640 1 -- 172.21.15.132:0/1190020461 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c003520 con 0x7f234c003970 2023-11-18T20:40:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.017+0000 7f236569d640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f234c003970 0x7f234c003d90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f235c009ac0 tx=0x7f234c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3aa2d78048086f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.017+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c02c710 con 0x7f234c003970 2023-11-18T20:40:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.017+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c02c870 con 0x7f234c003970 2023-11-18T20:40:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.017+0000 7f2357fff640 1 -- 172.21.15.132:0/1190020461 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c02cc00 con 0x7f234c003970 2023-11-18T20:40:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.018+0000 7f236669f640 1 -- 172.21.15.132:0/1190020461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f234c003970 msgr2=0x7f234c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.018+0000 7f236669f640 1 --2- 172.21.15.132:0/1190020461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f234c003970 0x7f234c003d90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f235c009ac0 tx=0x7f234c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.018+0000 7f2365e9e640 1 -- 172.21.15.132:0/1190020461 reap_dead start 2023-11-18T20:40:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.018+0000 7f236669f640 1 -- 172.21.15.132:0/1190020461 shutdown_connections 2023-11-18T20:40:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.018+0000 7f236669f640 1 -- 172.21.15.132:0/1190020461 >> 172.21.15.132:0/1190020461 conn(0x7f23600a77f0 msgr2=0x7f23600a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.018+0000 7f236669f640 1 -- 172.21.15.132:0/1190020461 shutdown_connections 2023-11-18T20:40:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.018+0000 7f236669f640 1 -- 172.21.15.132:0/1190020461 wait complete. 2023-11-18T20:40:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.020+0000 7f236669f640 1 Processor -- start 2023-11-18T20:40:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.020+0000 7f236669f640 1 -- start start 2023-11-18T20:40:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f236669f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f234c003970 0x7f236014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f236669f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2360149490 0x7f2360148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f236669f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2360148fc0 0x7f23601e9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f236669f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601485f0 con 0x7f2360148fc0 2023-11-18T20:40:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f236669f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601479e0 con 0x7f2360149490 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f236669f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2360147cc0 con 0x7f234c003970 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f2365e9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2360148fc0 0x7f23601e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f2365e9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2360148fc0 0x7f23601e9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37718/0 (socket says 172.21.15.132:37718) 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f2365e9e640 1 -- 172.21.15.132:0/588652032 learned_addr learned my addr 172.21.15.132:0/588652032 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f2364e9c640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2360149490 0x7f2360148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f2365e9e640 1 -- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f234c003970 msgr2=0x7f236014f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.021+0000 7f2365e9e640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f234c003970 0x7f236014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f2365e9e640 1 -- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2360149490 msgr2=0x7f2360148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f2365e9e640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2360149490 0x7f2360148a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f2365e9e640 1 -- 172.21.15.132:0/588652032 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360147fa0 con 0x7f2360148fc0 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f2365e9e640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2360148fc0 0x7f23601e9220 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f23580012e0 tx=0x7f235800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f2355ffb640 1 -- 172.21.15.132:0/588652032 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235800a610 con 0x7f2360148fc0 2023-11-18T20:40:15.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f2355ffb640 1 -- 172.21.15.132:0/588652032 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800a790 con 0x7f2360148fc0 2023-11-18T20:40:15.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2360148280 con 0x7f2360148fc0 2023-11-18T20:40:15.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f2355ffb640 1 -- 172.21.15.132:0/588652032 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235800ab40 con 0x7f2360148fc0 2023-11-18T20:40:15.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.022+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23600ab560 con 0x7f2360148fc0 2023-11-18T20:40:15.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.023+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2360148410 con 0x7f2360148fc0 2023-11-18T20:40:15.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.025+0000 7f2355ffb640 1 -- 172.21.15.132:0/588652032 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f235800aca0 con 0x7f2360148fc0 2023-11-18T20:40:15.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.026+0000 7f2355ffb640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f234406ae40 0x7f234406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:15.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.026+0000 7f2355ffb640 1 -- 172.21.15.132:0/588652032 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2358088f40 con 0x7f2360148fc0 2023-11-18T20:40:15.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.027+0000 7f236569d640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f234406ae40 0x7f234406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:15.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.028+0000 7f236569d640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f234406ae40 0x7f234406d300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f235c036000 tx=0x7f235c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:15.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.033+0000 7f2355ffb640 1 -- 172.21.15.132:0/588652032 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2358054040 con 0x7f2360148fc0 2023-11-18T20:40:15.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.243+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2360148730 con 0x7f2360148fc0 2023-11-18T20:40:15.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.825+0000 7f2355ffb640 1 -- 172.21.15.132:0/588652032 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2360148730 con 0x7f2360148fc0 2023-11-18T20:40:15.826 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 8 and data pool 9 2023-11-18T20:40:15.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.828+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f234406ae40 msgr2=0x7f234406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:15.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.828+0000 7f236669f640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f234406ae40 0x7f234406d300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f235c036000 tx=0x7f235c02e000 comp rx=0 tx=0).stop 2023-11-18T20:40:15.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.828+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2360148fc0 msgr2=0x7f23601e9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:15.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.828+0000 7f236669f640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2360148fc0 0x7f23601e9220 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f23580012e0 tx=0x7f235800cf00 comp rx=0 tx=0).stop 2023-11-18T20:40:15.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.829+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 shutdown_connections 2023-11-18T20:40:15.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.829+0000 7f236669f640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f234406ae40 0x7f234406d300 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.829+0000 7f236669f640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2360148fc0 0x7f23601e9220 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.829+0000 7f236669f640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2360149490 0x7f2360148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.829+0000 7f236669f640 1 --2- 172.21.15.132:0/588652032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f234c003970 0x7f236014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:15.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.829+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 >> 172.21.15.132:0/588652032 conn(0x7f23600a77f0 msgr2=0x7f23600c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:15.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.829+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 shutdown_connections 2023-11-18T20:40:15.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:15.829+0000 7f236669f640 1 -- 172.21.15.132:0/588652032 wait complete. 2023-11-18T20:40:15.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:16.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.035+0000 7f3f47fff640 1 Processor -- start 2023-11-18T20:40:16.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.035+0000 7f3f47fff640 1 -- start start 2023-11-18T20:40:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.037+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f4814e7c0 0x7f3f480c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.037+0000 7f3f47fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f48154580 0x7f3f48154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.037+0000 7f3f47fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f48158a60 con 0x7f3f480c4c00 2023-11-18T20:40:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.037+0000 7f3f47fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f480c5b10 con 0x7f3f48154580 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.037+0000 7f3f47fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48157ca0 con 0x7f3f4814e7c0 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.037+0000 7f3f3e7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3f480c4c00 0x7f3f480ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49090/0 (socket says 172.21.15.132:49090) 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.037+0000 7f3f3e7fc640 1 -- 172.21.15.132:0/4133916270 learned_addr learned my addr 172.21.15.132:0/4133916270 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.037+0000 7f3f477fe640 1 --2- 172.21.15.132:0/4133916270 >> v2:172.21.15.132:3300/0 conn(0x7f3f48154580 0x7f3f48154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.038+0000 7f3f46ffd640 1 --2- 172.21.15.132:0/4133916270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f4814e7c0 0x7f3f480c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.038+0000 7f3f477fe640 1 -- 172.21.15.132:0/4133916270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f4814e7c0 msgr2=0x7f3f480c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.038+0000 7f3f477fe640 1 --2- 172.21.15.132:0/4133916270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f4814e7c0 0x7f3f480c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.038+0000 7f3f477fe640 1 -- 172.21.15.132:0/4133916270 >> v1:172.21.15.132:6789/0 conn(0x7f3f480c4c00 legacy=0x7f3f480ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.038+0000 7f3f477fe640 1 -- 172.21.15.132:0/4133916270 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48157f80 con 0x7f3f48154580 2023-11-18T20:40:16.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.038+0000 7f3f467fc640 1 -- 172.21.15.132:0/4133916270 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161233594 0 0) 0x7f3f48158a60 con 0x7f3f480c4c00 2023-11-18T20:40:16.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.039+0000 7f3f477fe640 1 --2- 172.21.15.132:0/4133916270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f48154a10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097a0 tx=0x7f3f4002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f6b0f463dcf9b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.039+0000 7f3f467fc640 1 -- 172.21.15.132:0/4133916270 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4002f050 con 0x7f3f48154580 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.039+0000 7f3f467fc640 1 -- 172.21.15.132:0/4133916270 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40031700 con 0x7f3f48154580 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.039+0000 7f3f467fc640 1 -- 172.21.15.132:0/4133916270 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40031a90 con 0x7f3f48154580 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.040+0000 7f3f47fff640 1 -- 172.21.15.132:0/4133916270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 msgr2=0x7f3f48154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.040+0000 7f3f47fff640 1 --2- 172.21.15.132:0/4133916270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f48154a10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097a0 tx=0x7f3f4002b7a0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.040+0000 7f3f47fff640 1 -- 172.21.15.132:0/4133916270 shutdown_connections 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.040+0000 7f3f47fff640 1 --2- 172.21.15.132:0/4133916270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f48154a10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.040+0000 7f3f47fff640 1 --2- 172.21.15.132:0/4133916270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f4814e7c0 0x7f3f480c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.040+0000 7f3f47fff640 1 -- 172.21.15.132:0/4133916270 >> 172.21.15.132:0/4133916270 conn(0x7f3f480abf00 msgr2=0x7f3f480c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.040+0000 7f3f47fff640 1 -- 172.21.15.132:0/4133916270 shutdown_connections 2023-11-18T20:40:16.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.040+0000 7f3f47fff640 1 -- 172.21.15.132:0/4133916270 wait complete. 2023-11-18T20:40:16.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.041+0000 7f3f47fff640 1 Processor -- start 2023-11-18T20:40:16.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.042+0000 7f3f47fff640 1 -- start start 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.042+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f480c4c00 0x7f3f481edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.042+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f4814e7c0 0x7f3f48155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.042+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f480aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.042+0000 7f3f47fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48149fc0 con 0x7f3f48154580 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.042+0000 7f3f47fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f481ed6f0 con 0x7f3f4814e7c0 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.042+0000 7f3f47fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4814b630 con 0x7f3f480c4c00 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f480aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f480aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37734/0 (socket says 172.21.15.132:37734) 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 -- 172.21.15.132:0/2262107973 learned_addr learned my addr 172.21.15.132:0/2262107973 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 -- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f480c4c00 msgr2=0x7f3f481edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f480c4c00 0x7f3f481edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 -- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f4814e7c0 msgr2=0x7f3f48155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f4814e7c0 0x7f3f48155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 -- 172.21.15.132:0/2262107973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f40009400 con 0x7f3f48154580 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.043+0000 7f3f477fe640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f480aa9e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097a0 tx=0x7f3f400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.044+0000 7f3f3ffff640 1 -- 172.21.15.132:0/2262107973 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400339b0 con 0x7f3f48154580 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.044+0000 7f3f3ffff640 1 -- 172.21.15.132:0/2262107973 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40033b30 con 0x7f3f48154580 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.044+0000 7f3f3ffff640 1 -- 172.21.15.132:0/2262107973 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4003c400 con 0x7f3f48154580 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.044+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f481ee050 con 0x7f3f48154580 2023-11-18T20:40:16.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.044+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4814b070 con 0x7f3f48154580 2023-11-18T20:40:16.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.045+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f481ed830 con 0x7f3f48154580 2023-11-18T20:40:16.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.046+0000 7f3f3ffff640 1 -- 172.21.15.132:0/2262107973 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f4003a040 con 0x7f3f48154580 2023-11-18T20:40:16.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.047+0000 7f3f3ffff640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f2806ae40 0x7f3f2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.047+0000 7f3f3ffff640 1 -- 172.21.15.132:0/2262107973 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f400aafb0 con 0x7f3f48154580 2023-11-18T20:40:16.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.047+0000 7f3f46ffd640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f2806ae40 0x7f3f2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.049+0000 7f3f46ffd640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f2806ae40 0x7f3f2806d300 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f38006fd0 tx=0x7f3f38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.051+0000 7f3f3ffff640 1 -- 172.21.15.132:0/2262107973 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3f481ed830 con 0x7f3f48154580 2023-11-18T20:40:16.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.231+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f481ed830 con 0x7f3f48154580 2023-11-18T20:40:16.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.234+0000 7f3f3ffff640 1 -- 172.21.15.132:0/2262107973 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16614 (secure 0 0 0) 0x7f3f481ed830 con 0x7f3f48154580 2023-11-18T20:40:16.236 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:16.236 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":54,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:15.245238+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:16.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f2806ae40 msgr2=0x7f3f2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f2806ae40 0x7f3f2806d300 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f38006fd0 tx=0x7f3f38008040 comp rx=0 tx=0).stop 2023-11-18T20:40:16.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 msgr2=0x7f3f480aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f480aa9e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097a0 tx=0x7f3f400046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 shutdown_connections 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3f2806ae40 0x7f3f2806d300 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48154580 0x7f3f480aa9e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f4814e7c0 0x7f3f48155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 --2- 172.21.15.132:0/2262107973 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f480c4c00 0x7f3f481edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 >> 172.21.15.132:0/2262107973 conn(0x7f3f480abf00 msgr2=0x7f3f480c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 shutdown_connections 2023-11-18T20:40:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.237+0000 7f3f47fff640 1 -- 172.21.15.132:0/2262107973 wait complete. 2023-11-18T20:40:16.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.443+0000 7f7fc50e6640 1 Processor -- start 2023-11-18T20:40:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.444+0000 7f7fc50e6640 1 -- start start 2023-11-18T20:40:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.445+0000 7f7fc50e6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7fc014c2e0 0x7f7fc00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.445+0000 7f7fc50e6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc0071e80 con 0x7f7fc00c0440 2023-11-18T20:40:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.445+0000 7f7fc50e6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc014c6c0 con 0x7f7fc0072310 2023-11-18T20:40:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.445+0000 7f7fc50e6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc0071470 con 0x7f7fc014c2e0 2023-11-18T20:40:16.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.445+0000 7f7fb7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7fc00c0440 0x7f7fc0152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49092/0 (socket says 172.21.15.132:49092) 2023-11-18T20:40:16.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.445+0000 7f7fb7fff640 1 -- 172.21.15.132:0/1564573153 learned_addr learned my addr 172.21.15.132:0/1564573153 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:16.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbffff640 1 --2- 172.21.15.132:0/1564573153 >> v2:172.21.15.161:3300/0 conn(0x7f7fc014c2e0 0x7f7fc00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936261291 0 0) 0x7f7fc0071e80 con 0x7f7fc00c0440 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fac003520 con 0x7f7fc00c0440 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2967613512 0 0) 0x7f7fac003520 con 0x7f7fc00c0440 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 >> v2:172.21.15.161:3300/0 conn(0x7f7fc014c2e0 msgr2=0x7f7fc00c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 --2- 172.21.15.132:0/1564573153 >> v2:172.21.15.161:3300/0 conn(0x7f7fc014c2e0 0x7f7fc00c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 >> v1:172.21.15.161:6789/0 conn(0x7f7fc0072310 legacy=0x7f7fc00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc006fdc0 con 0x7f7fc00c0440 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f7fa8001670 con 0x7f7fc00c0440 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 >> v1:172.21.15.132:6789/0 conn(0x7f7fc00c0440 legacy=0x7f7fc0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fac003970 0x7f7fac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0047c0 0x7f7fac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fac0052a0 0x7f7fac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac00c140 con 0x7f7fac0052a0 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac00c2b0 con 0x7f7fac0047c0 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.446+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac00c470 con 0x7f7fac003970 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.447+0000 7f7fc48e5640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fac0052a0 0x7f7fac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.447+0000 7f7fbffff640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fac003970 0x7f7fac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.447+0000 7f7fc48e5640 1 -- 172.21.15.132:0/1564573153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fac003970 msgr2=0x7f7fac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.447+0000 7f7fb7fff640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0047c0 0x7f7fac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.447+0000 7f7fc48e5640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fac003970 0x7f7fac003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.447+0000 7f7fc48e5640 1 -- 172.21.15.132:0/1564573153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0047c0 msgr2=0x7f7fac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.447+0000 7f7fc48e5640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0047c0 0x7f7fac004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.447+0000 7f7fc48e5640 1 -- 172.21.15.132:0/1564573153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac003520 con 0x7f7fac0052a0 2023-11-18T20:40:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.448+0000 7f7fc48e5640 1 -- 172.21.15.132:0/1564573153 reap_dead start 2023-11-18T20:40:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.448+0000 7f7fc48e5640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fac0052a0 0x7f7fac00b980 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8001e20 tx=0x7f7fac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a239e7c287e6fd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.448+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8003b70 con 0x7f7fac0052a0 2023-11-18T20:40:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.448+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8003cd0 con 0x7f7fac0052a0 2023-11-18T20:40:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.448+0000 7f7fbf7fe640 1 -- 172.21.15.132:0/1564573153 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8005310 con 0x7f7fac0052a0 2023-11-18T20:40:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.449+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1564573153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fac0052a0 msgr2=0x7f7fac00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.449+0000 7f7fc50e6640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fac0052a0 0x7f7fac00b980 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8001e20 tx=0x7f7fac0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.449+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1564573153 shutdown_connections 2023-11-18T20:40:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.449+0000 7f7fc50e6640 1 --2- 172.21.15.132:0/1564573153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fac0052a0 0x7f7fac00b980 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.449+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1564573153 >> 172.21.15.132:0/1564573153 conn(0x7f7fc00a77f0 msgr2=0x7f7fc00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.449+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1564573153 shutdown_connections 2023-11-18T20:40:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.449+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1564573153 wait complete. 2023-11-18T20:40:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.451+0000 7f7fc50e6640 1 Processor -- start 2023-11-18T20:40:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.451+0000 7f7fc50e6640 1 -- start start 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fc50e6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0052a0 0x7f7fc01559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fc50e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00a9060 0x7f7fc01ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fc50e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fc0145120 0x7f7fc0152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fc50e6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc01ea050 con 0x7f7fc00a9060 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fc50e6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc006dca0 con 0x7f7fac0052a0 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fc50e6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc006def0 con 0x7f7fc0145120 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00a9060 0x7f7fc01ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00a9060 0x7f7fc01ea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37756/0 (socket says 172.21.15.132:37756) 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.452+0000 7f7fb7fff640 1 -- 172.21.15.132:0/1700355024 learned_addr learned my addr 172.21.15.132:0/1700355024 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fbffff640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0052a0 0x7f7fc01559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fb7fff640 1 -- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fc0145120 msgr2=0x7f7fc0152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fb7fff640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fc0145120 0x7f7fc0152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fb7fff640 1 -- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0052a0 msgr2=0x7f7fc01559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fb7fff640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0052a0 0x7f7fc01559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fb7fff640 1 -- 172.21.15.132:0/1700355024 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc01edfd0 con 0x7f7fc00a9060 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fbffff640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0052a0 0x7f7fc01559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fb7fff640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00a9060 0x7f7fc01ea760 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800d770 tx=0x7f7fa800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fbd7fa640 1 -- 172.21.15.132:0/1700355024 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80072d0 con 0x7f7fc00a9060 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fbd7fa640 1 -- 172.21.15.132:0/1700355024 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa8007430 con 0x7f7fc00a9060 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc01ee2b0 con 0x7f7fc00a9060 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.453+0000 7f7fbd7fa640 1 -- 172.21.15.132:0/1700355024 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80047e0 con 0x7f7fc00a9060 2023-11-18T20:40:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.454+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc0155f10 con 0x7f7fc00a9060 2023-11-18T20:40:16.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.455+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc01ea480 con 0x7f7fc00a9060 2023-11-18T20:40:16.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.456+0000 7f7fbd7fa640 1 -- 172.21.15.132:0/1700355024 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fa8004940 con 0x7f7fc00a9060 2023-11-18T20:40:16.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.457+0000 7f7fbd7fa640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7fa006ae40 0x7f7fa006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.457+0000 7f7fbd7fa640 1 -- 172.21.15.132:0/1700355024 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fa8089170 con 0x7f7fc00a9060 2023-11-18T20:40:16.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.457+0000 7f7fbffff640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7fa006ae40 0x7f7fa006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.459+0000 7f7fbffff640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7fa006ae40 0x7f7fa006d300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00099e0 tx=0x7f7fb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.461+0000 7f7fbd7fa640 1 -- 172.21.15.132:0/1700355024 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fa8054210 con 0x7f7fc00a9060 2023-11-18T20:40:16.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.649+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fc004e840 con 0x7f7fc00a9060 2023-11-18T20:40:16.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.651+0000 7f7fbd7fa640 1 -- 172.21.15.132:0/1700355024 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f7fa8057830 con 0x7f7fc00a9060 2023-11-18T20:40:16.653 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:16.653 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":55,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:16.316858+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:16.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7fa006ae40 msgr2=0x7f7fa006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7fa006ae40 0x7f7fa006d300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00099e0 tx=0x7f7fb0008040 comp rx=0 tx=0).stop 2023-11-18T20:40:16.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00a9060 msgr2=0x7f7fc01ea760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00a9060 0x7f7fc01ea760 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800d770 tx=0x7f7fa800dc30 comp rx=0 tx=0).stop 2023-11-18T20:40:16.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 shutdown_connections 2023-11-18T20:40:16.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7fa006ae40 0x7f7fa006d300 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fc0145120 0x7f7fc0152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00a9060 0x7f7fc01ea760 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 --2- 172.21.15.132:0/1700355024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fac0052a0 0x7f7fc01559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 >> 172.21.15.132:0/1700355024 conn(0x7f7fc00a77f0 msgr2=0x7f7fc00c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 shutdown_connections 2023-11-18T20:40:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.654+0000 7f7fc50e6640 1 -- 172.21.15.132:0/1700355024 wait complete. 2023-11-18T20:40:16.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-18T20:40:16.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.881+0000 7f991caaf640 1 Processor -- start 2023-11-18T20:40:16.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.881+0000 7f991caaf640 1 -- start start 2023-11-18T20:40:16.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.882+0000 7f991caaf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99180a9b40 0x7f99180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.882+0000 7f991caaf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99180c1500 0x7f99180c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.882+0000 7f991caaf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180c06c0 con 0x7f9918155490 2023-11-18T20:40:16.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.882+0000 7f991caaf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99180a5820 con 0x7f99180c1500 2023-11-18T20:40:16.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.882+0000 7f991caaf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99180c1020 con 0x7f99180a9b40 2023-11-18T20:40:16.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.882+0000 7f991659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9918155490 0x7f99180a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49102/0 (socket says 172.21.15.132:49102) 2023-11-18T20:40:16.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.882+0000 7f991659c640 1 -- 172.21.15.132:0/2305653693 learned_addr learned my addr 172.21.15.132:0/2305653693 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:16.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.882+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141506355 0 0) 0x7f99180c06c0 con 0x7f9918155490 2023-11-18T20:40:16.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9904003520 con 0x7f9918155490 2023-11-18T20:40:16.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9916d9d640 1 --2- 172.21.15.132:0/2305653693 >> v2:172.21.15.161:3300/0 conn(0x7f99180c1500 0x7f99180c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f990dd9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99180a9b40 0x7f99180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 585462824 0 0) 0x7f9904003520 con 0x7f9918155490 2023-11-18T20:40:16.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99180a9b40 msgr2=0x7f99180a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99180a9b40 0x7f99180a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 >> v2:172.21.15.161:3300/0 conn(0x7f99180c1500 msgr2=0x7f99180c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 --2- 172.21.15.132:0/2305653693 >> v2:172.21.15.161:3300/0 conn(0x7f99180c1500 0x7f99180c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180c0910 con 0x7f9918155490 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f99080019f0 con 0x7f9918155490 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 >> v1:172.21.15.132:6789/0 conn(0x7f9918155490 legacy=0x7f99180a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9904003970 0x7f9904003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f9904004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9904005180 0x7f990400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180c1020 con 0x7f99040047c0 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990400bec0 con 0x7f9904005180 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990400c030 con 0x7f9904003970 2023-11-18T20:40:16.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.883+0000 7f990dd9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f9904004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.884+0000 7f991659c640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9904003970 0x7f9904003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.884+0000 7f9916d9d640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9904005180 0x7f990400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.884+0000 7f990dd9b640 1 -- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9904003970 msgr2=0x7f9904003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.884+0000 7f990dd9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9904003970 0x7f9904003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.884+0000 7f990dd9b640 1 -- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9904005180 msgr2=0x7f990400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.884+0000 7f990dd9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9904005180 0x7f990400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.884+0000 7f990dd9b640 1 -- 172.21.15.132:0/2305653693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904003520 con 0x7f99040047c0 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.884+0000 7f9916d9d640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9904005180 0x7f990400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.885+0000 7f990dd9b640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f9904004c40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f990000ba30 tx=0x7f99040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3d17a0b6c19dc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.885+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900032640 con 0x7f99040047c0 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.885+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99000327a0 con 0x7f99040047c0 2023-11-18T20:40:16.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.885+0000 7f9915d9b640 1 -- 172.21.15.132:0/2305653693 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900032b30 con 0x7f99040047c0 2023-11-18T20:40:16.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.886+0000 7f991caaf640 1 -- 172.21.15.132:0/2305653693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 msgr2=0x7f9904004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.886+0000 7f991caaf640 1 --2- 172.21.15.132:0/2305653693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f9904004c40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f990000ba30 tx=0x7f99040057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.886+0000 7f9916d9d640 1 -- 172.21.15.132:0/2305653693 reap_dead start 2023-11-18T20:40:16.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.886+0000 7f991caaf640 1 -- 172.21.15.132:0/2305653693 shutdown_connections 2023-11-18T20:40:16.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.886+0000 7f991caaf640 1 -- 172.21.15.132:0/2305653693 >> 172.21.15.132:0/2305653693 conn(0x7f991806a500 msgr2=0x7f991806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:16.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.886+0000 7f991caaf640 1 -- 172.21.15.132:0/2305653693 shutdown_connections 2023-11-18T20:40:16.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.886+0000 7f991caaf640 1 -- 172.21.15.132:0/2305653693 wait complete. 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.888+0000 7f991caaf640 1 Processor -- start 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.888+0000 7f991caaf640 1 -- start start 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.888+0000 7f991caaf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f99180bd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.888+0000 7f991caaf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99180be410 0x7f99180bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991caaf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99180bd910 0x7f99181eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991caaf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9918153190 con 0x7f99040047c0 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991caaf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180bb920 con 0x7f99180be410 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991caaf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991815be40 con 0x7f99180bd910 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f99180bd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f99180bd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37772/0 (socket says 172.21.15.132:37772) 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 -- 172.21.15.132:0/125032053 learned_addr learned my addr 172.21.15.132:0/125032053 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 -- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99180bd910 msgr2=0x7f99181eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99180bd910 0x7f99181eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 -- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99180be410 msgr2=0x7f99180bbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99180be410 0x7f99180bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 -- 172.21.15.132:0/125032053 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99181570d0 con 0x7f99040047c0 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.889+0000 7f991659c640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f99180bd3d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9908007a50 tx=0x7f990800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.890+0000 7f990f7fe640 1 -- 172.21.15.132:0/125032053 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800edf0 con 0x7f99040047c0 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.890+0000 7f990f7fe640 1 -- 172.21.15.132:0/125032053 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908013420 con 0x7f99040047c0 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.890+0000 7f990f7fe640 1 -- 172.21.15.132:0/125032053 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080137d0 con 0x7f99040047c0 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.890+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99180aa230 con 0x7f99040047c0 2023-11-18T20:40:16.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.890+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991815bb60 con 0x7f99040047c0 2023-11-18T20:40:16.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.891+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9918068350 con 0x7f99040047c0 2023-11-18T20:40:16.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.892+0000 7f990f7fe640 1 -- 172.21.15.132:0/125032053 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9908013930 con 0x7f99040047c0 2023-11-18T20:40:16.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.893+0000 7f990f7fe640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f98f806ae40 0x7f98f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:16.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.893+0000 7f990f7fe640 1 -- 172.21.15.132:0/125032053 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9908089e00 con 0x7f99040047c0 2023-11-18T20:40:16.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.894+0000 7f990dd9b640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f98f806ae40 0x7f98f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:16.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.895+0000 7f990dd9b640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f98f806ae40 0x7f98f806d300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f990000ba00 tx=0x7f9900032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:16.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:16.897+0000 7f990f7fe640 1 -- 172.21.15.132:0/125032053 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9908054ea0 con 0x7f99040047c0 2023-11-18T20:40:17.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.124+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9918068350 con 0x7f99040047c0 2023-11-18T20:40:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.850+0000 7f990f7fe640 1 -- 172.21.15.132:0/125032053 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f99080584c0 con 0x7f99040047c0 2023-11-18T20:40:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f98f806ae40 msgr2=0x7f98f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f98f806ae40 0x7f98f806d300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f990000ba00 tx=0x7f9900032000 comp rx=0 tx=0).stop 2023-11-18T20:40:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 msgr2=0x7f99180bd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f99180bd3d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9908007a50 tx=0x7f990800e530 comp rx=0 tx=0).stop 2023-11-18T20:40:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 shutdown_connections 2023-11-18T20:40:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f98f806ae40 0x7f98f806d300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99180bd910 0x7f99181eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99180be410 0x7f99180bbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 --2- 172.21.15.132:0/125032053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040047c0 0x7f99180bd3d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:17.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 >> 172.21.15.132:0/125032053 conn(0x7f991806a500 msgr2=0x7f99180c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:17.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.853+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 shutdown_connections 2023-11-18T20:40:17.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:17.854+0000 7f991caaf640 1 -- 172.21.15.132:0/125032053 wait complete. 2023-11-18T20:40:17.876 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T20:40:17.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-18T20:40:18.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.099+0000 7fa59a1ee640 1 Processor -- start 2023-11-18T20:40:18.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.099+0000 7fa59a1ee640 1 -- start start 2023-11-18T20:40:18.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.101+0000 7fa59a1ee640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa59406d0a0 0x7fa594152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:18.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.101+0000 7fa59a1ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5940c3ea0 0x7fa5940c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:18.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.101+0000 7fa59a1ee640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5940c64a0 con 0x7fa59414fd30 2023-11-18T20:40:18.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.101+0000 7fa59a1ee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5940c5c00 con 0x7fa5940c3ea0 2023-11-18T20:40:18.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.101+0000 7fa59a1ee640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5940c5ee0 con 0x7fa59406d0a0 2023-11-18T20:40:18.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.102+0000 7fa593fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5940c3ea0 0x7fa5940c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:18.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.102+0000 7fa593fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5940c3ea0 0x7fa5940c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37776/0 (socket says 172.21.15.132:37776) 2023-11-18T20:40:18.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.102+0000 7fa593fff640 1 -- 172.21.15.132:0/3116637194 learned_addr learned my addr 172.21.15.132:0/3116637194 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:18.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.102+0000 7fa58bfff640 1 --2- 172.21.15.132:0/3116637194 >> v2:172.21.15.161:3300/0 conn(0x7fa59406d0a0 0x7fa594152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:18.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.102+0000 7fa593fff640 1 -- 172.21.15.132:0/3116637194 >> v2:172.21.15.161:3300/0 conn(0x7fa59406d0a0 msgr2=0x7fa594152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:18.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.102+0000 7fa593fff640 1 --2- 172.21.15.132:0/3116637194 >> v2:172.21.15.161:3300/0 conn(0x7fa59406d0a0 0x7fa594152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.102+0000 7fa593fff640 1 -- 172.21.15.132:0/3116637194 >> v1:172.21.15.161:6789/0 conn(0x7fa59414fd30 legacy=0x7fa5940a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:18.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.102+0000 7fa593fff640 1 -- 172.21.15.132:0/3116637194 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940c61c0 con 0x7fa5940c3ea0 2023-11-18T20:40:18.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.103+0000 7fa593fff640 1 --2- 172.21.15.132:0/3116637194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5940c3ea0 0x7fa5940c4330 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa59406b460 tx=0x7fa58c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0446487d3391740 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:18.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa592ffd640 1 -- 172.21.15.132:0/3116637194 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c02ca80 con 0x7fa5940c3ea0 2023-11-18T20:40:18.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa592ffd640 1 -- 172.21.15.132:0/3116637194 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c02cbe0 con 0x7fa5940c3ea0 2023-11-18T20:40:18.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa592ffd640 1 -- 172.21.15.132:0/3116637194 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0343f0 con 0x7fa5940c3ea0 2023-11-18T20:40:18.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa59a1ee640 1 -- 172.21.15.132:0/3116637194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5940c3ea0 msgr2=0x7fa5940c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:18.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/3116637194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5940c3ea0 0x7fa5940c4330 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa59406b460 tx=0x7fa58c02bee0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa59a1ee640 1 -- 172.21.15.132:0/3116637194 shutdown_connections 2023-11-18T20:40:18.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/3116637194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5940c3ea0 0x7fa5940c4330 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/3116637194 >> v2:172.21.15.161:3300/0 conn(0x7fa59406d0a0 0x7fa594152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa59a1ee640 1 -- 172.21.15.132:0/3116637194 >> 172.21.15.132:0/3116637194 conn(0x7fa59406a500 msgr2=0x7fa59406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:18.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa59a1ee640 1 -- 172.21.15.132:0/3116637194 shutdown_connections 2023-11-18T20:40:18.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.104+0000 7fa59a1ee640 1 -- 172.21.15.132:0/3116637194 wait complete. 2023-11-18T20:40:18.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.106+0000 7fa59a1ee640 1 Processor -- start 2023-11-18T20:40:18.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.106+0000 7fa59a1ee640 1 -- start start 2023-11-18T20:40:18.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.107+0000 7fa59a1ee640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa59406d0a0 0x7fa594156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:18.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.107+0000 7fa59a1ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5940c3ea0 0x7fa594156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:18.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.107+0000 7fa59a1ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59414fd30 0x7fa59414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:18.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.107+0000 7fa59a1ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594153910 con 0x7fa59414fd30 2023-11-18T20:40:18.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.107+0000 7fa59a1ee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594153bf0 con 0x7fa5940c3ea0 2023-11-18T20:40:18.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.107+0000 7fa59a1ee640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa594153ed0 con 0x7fa59406d0a0 2023-11-18T20:40:18.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59414fd30 0x7fa59414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59414fd30 0x7fa59414dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37780/0 (socket says 172.21.15.132:37780) 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 -- 172.21.15.132:0/2394386276 learned_addr learned my addr 172.21.15.132:0/2394386276 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa58bfff640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5940c3ea0 0x7fa594156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 -- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa59406d0a0 msgr2=0x7fa594156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa5937fe640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa59406d0a0 0x7fa594156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa59406d0a0 0x7fa594156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 -- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5940c3ea0 msgr2=0x7fa594156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5940c3ea0 0x7fa594156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 -- 172.21.15.132:0/2394386276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c009b30 con 0x7fa59414fd30 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa58bfff640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5940c3ea0 0x7fa594156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa5937fe640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa59406d0a0 0x7fa594156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.108+0000 7fa593fff640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59414fd30 0x7fa59414dcd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa58c036040 tx=0x7fa58c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.109+0000 7fa590ff9640 1 -- 172.21.15.132:0/2394386276 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c009510 con 0x7fa59414fd30 2023-11-18T20:40:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.109+0000 7fa590ff9640 1 -- 172.21.15.132:0/2394386276 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c03e450 con 0x7fa59414fd30 2023-11-18T20:40:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.109+0000 7fa590ff9640 1 -- 172.21.15.132:0/2394386276 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c03e7e0 con 0x7fa59414fd30 2023-11-18T20:40:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.109+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa594155840 con 0x7fa59414fd30 2023-11-18T20:40:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.109+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5941dc990 con 0x7fa59414fd30 2023-11-18T20:40:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.110+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5941540f0 con 0x7fa59414fd30 2023-11-18T20:40:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.111+0000 7fa590ff9640 1 -- 172.21.15.132:0/2394386276 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa58c02cd50 con 0x7fa59414fd30 2023-11-18T20:40:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.112+0000 7fa590ff9640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57406ae40 0x7fa57406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.112+0000 7fa590ff9640 1 -- 172.21.15.132:0/2394386276 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa58c0ac0e0 con 0x7fa59414fd30 2023-11-18T20:40:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.112+0000 7fa5937fe640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57406ae40 0x7fa57406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:18.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.114+0000 7fa5937fe640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57406ae40 0x7fa57406d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa594152980 tx=0x7fa584009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:18.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.116+0000 7fa590ff9640 1 -- 172.21.15.132:0/2394386276 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa58c077220 con 0x7fa59414fd30 2023-11-18T20:40:18.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.343+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa594155d00 con 0x7fa59414fd30 2023-11-18T20:40:18.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.863+0000 7fa590ff9640 1 -- 172.21.15.132:0/2394386276 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa58c07a840 con 0x7fa59414fd30 2023-11-18T20:40:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57406ae40 msgr2=0x7fa57406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57406ae40 0x7fa57406d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa594152980 tx=0x7fa584009040 comp rx=0 tx=0).stop 2023-11-18T20:40:18.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59414fd30 msgr2=0x7fa59414dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59414fd30 0x7fa59414dcd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa58c036040 tx=0x7fa58c004a40 comp rx=0 tx=0).stop 2023-11-18T20:40:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 shutdown_connections 2023-11-18T20:40:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa57406ae40 0x7fa57406d300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59414fd30 0x7fa59414dcd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5940c3ea0 0x7fa594156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 --2- 172.21.15.132:0/2394386276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa59406d0a0 0x7fa594156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.866+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 >> 172.21.15.132:0/2394386276 conn(0x7fa59406a500 msgr2=0x7fa5940c1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.867+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 shutdown_connections 2023-11-18T20:40:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:18.867+0000 7fa59a1ee640 1 -- 172.21.15.132:0/2394386276 wait complete. 2023-11-18T20:40:18.889 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-18T20:40:18.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:19.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.100+0000 7f9cbd832640 1 Processor -- start 2023-11-18T20:40:19.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.100+0000 7f9cbd832640 1 -- start start 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.101+0000 7f9cbd832640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8155490 0x7f9cb80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.101+0000 7f9cbd832640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cb80a9b40 0x7f9cb80c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.101+0000 7f9cbd832640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb80c06c0 con 0x7f9cb80c1500 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.101+0000 7f9cbd832640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb80a5820 con 0x7f9cb80a9b40 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.101+0000 7f9cbd832640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80c1020 con 0x7f9cb8155490 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.102+0000 7f9cb77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cb80a9b40 0x7f9cb80c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.102+0000 7f9cb77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cb80a9b40 0x7f9cb80c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39098/0 (socket says 172.21.15.132:39098) 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.102+0000 7f9cb77fe640 1 -- 172.21.15.132:0/103001790 learned_addr learned my addr 172.21.15.132:0/103001790 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.102+0000 7f9cb6ffd640 1 --2- 172.21.15.132:0/103001790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8155490 0x7f9cb80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.102+0000 7f9cb77fe640 1 -- 172.21.15.132:0/103001790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8155490 msgr2=0x7f9cb80a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.102+0000 7f9cb77fe640 1 --2- 172.21.15.132:0/103001790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8155490 0x7f9cb80a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.102+0000 7f9cb77fe640 1 -- 172.21.15.132:0/103001790 >> v1:172.21.15.161:6789/0 conn(0x7f9cb80c1500 legacy=0x7f9cb80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.102+0000 7f9cb77fe640 1 -- 172.21.15.132:0/103001790 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb80c0910 con 0x7f9cb80a9b40 2023-11-18T20:40:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.103+0000 7f9cb77fe640 1 --2- 172.21.15.132:0/103001790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb80a9b40 0x7f9cb80c24d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009e50 tx=0x7f9cb002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874879e6315644cb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cb5ffb640 1 -- 172.21.15.132:0/103001790 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb002ca70 con 0x7f9cb80a9b40 2023-11-18T20:40:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cb5ffb640 1 -- 172.21.15.132:0/103001790 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb002cbd0 con 0x7f9cb80a9b40 2023-11-18T20:40:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cb5ffb640 1 -- 172.21.15.132:0/103001790 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00343f0 con 0x7f9cb80a9b40 2023-11-18T20:40:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cbd832640 1 -- 172.21.15.132:0/103001790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb80a9b40 msgr2=0x7f9cb80c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cbd832640 1 --2- 172.21.15.132:0/103001790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb80a9b40 0x7f9cb80c24d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009e50 tx=0x7f9cb002bed0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cbd832640 1 -- 172.21.15.132:0/103001790 shutdown_connections 2023-11-18T20:40:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cbd832640 1 --2- 172.21.15.132:0/103001790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb80a9b40 0x7f9cb80c24d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cbd832640 1 --2- 172.21.15.132:0/103001790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8155490 0x7f9cb80a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cbd832640 1 -- 172.21.15.132:0/103001790 >> 172.21.15.132:0/103001790 conn(0x7f9cb806a500 msgr2=0x7f9cb806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cbd832640 1 -- 172.21.15.132:0/103001790 shutdown_connections 2023-11-18T20:40:19.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.104+0000 7f9cbd832640 1 -- 172.21.15.132:0/103001790 wait complete. 2023-11-18T20:40:19.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.106+0000 7f9cbd832640 1 Processor -- start 2023-11-18T20:40:19.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.106+0000 7f9cbd832640 1 -- start start 2023-11-18T20:40:19.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cbd832640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb80c1500 0x7f9cb814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cbd832640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb8155490 0x7f9cb8153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cbd832640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8150c60 0x7f9cb81ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cbd832640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb814e720 con 0x7f9cb8155490 2023-11-18T20:40:19.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cbd832640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb814a920 con 0x7f9cb80c1500 2023-11-18T20:40:19.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cbd832640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb81510f0 con 0x7f9cb8150c60 2023-11-18T20:40:19.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cb67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb8155490 0x7f9cb8153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cb67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb8155490 0x7f9cb8153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39114/0 (socket says 172.21.15.132:39114) 2023-11-18T20:40:19.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.107+0000 7f9cb67fc640 1 -- 172.21.15.132:0/4169529642 learned_addr learned my addr 172.21.15.132:0/4169529642 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:19.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cb6ffd640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb80c1500 0x7f9cb814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cb77fe640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8150c60 0x7f9cb81ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cb67fc640 1 -- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8150c60 msgr2=0x7f9cb81ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cb67fc640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8150c60 0x7f9cb81ed2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cb67fc640 1 -- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb80c1500 msgr2=0x7f9cb814a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cb67fc640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb80c1500 0x7f9cb814a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cb67fc640 1 -- 172.21.15.132:0/4169529642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0009b30 con 0x7f9cb8155490 2023-11-18T20:40:19.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cb67fc640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb8155490 0x7f9cb8153ea0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c430 tx=0x7f9cac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:19.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9c9ffff640 1 -- 172.21.15.132:0/4169529642 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac011790 con 0x7f9cb8155490 2023-11-18T20:40:19.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9c9ffff640 1 -- 172.21.15.132:0/4169529642 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac0118f0 con 0x7f9cb8155490 2023-11-18T20:40:19.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb814bd60 con 0x7f9cb8155490 2023-11-18T20:40:19.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.108+0000 7f9c9ffff640 1 -- 172.21.15.132:0/4169529642 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac011ce0 con 0x7f9cb8155490 2023-11-18T20:40:19.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.109+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb8151450 con 0x7f9cb8155490 2023-11-18T20:40:19.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.110+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb8068350 con 0x7f9cb8155490 2023-11-18T20:40:19.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.111+0000 7f9c9ffff640 1 -- 172.21.15.132:0/4169529642 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9cac01c460 con 0x7f9cb8155490 2023-11-18T20:40:19.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.112+0000 7f9c9ffff640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ca406ae70 0x7f9ca406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.112+0000 7f9c9ffff640 1 -- 172.21.15.132:0/4169529642 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cac0895b0 con 0x7f9cb8155490 2023-11-18T20:40:19.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.113+0000 7f9cb6ffd640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ca406ae70 0x7f9ca406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.114+0000 7f9cb6ffd640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ca406ae70 0x7f9ca406d330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8006fd0 tx=0x7f9ca8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:19.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.117+0000 7f9c9ffff640 1 -- 172.21.15.132:0/4169529642 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9cac054650 con 0x7f9cb8155490 2023-11-18T20:40:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.342+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cb8151610 con 0x7f9cb8155490 2023-11-18T20:40:19.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.343+0000 7f9c9ffff640 1 -- 172.21.15.132:0/4169529642 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f9cac087e60 con 0x7f9cb8155490 2023-11-18T20:40:19.345 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:19.345 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:15.246098+0000","modified":"2023-11-18T20:40:18.344815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/3392191515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3392191515},{"type":"v1","addr":"172.21.15.132:6835","nonce":3392191515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-18T20:40:19.345 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 30 2023-11-18T20:40:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ca406ae70 msgr2=0x7f9ca406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ca406ae70 0x7f9ca406d330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8006fd0 tx=0x7f9ca8008040 comp rx=0 tx=0).stop 2023-11-18T20:40:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb8155490 msgr2=0x7f9cb8153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb8155490 0x7f9cb8153ea0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c430 tx=0x7f9cac00c8f0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 shutdown_connections 2023-11-18T20:40:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ca406ae70 0x7f9ca406d330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb8150c60 0x7f9cb81ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cb8155490 0x7f9cb8153ea0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 --2- 172.21.15.132:0/4169529642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cb80c1500 0x7f9cb814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 >> 172.21.15.132:0/4169529642 conn(0x7f9cb806a500 msgr2=0x7f9cb80bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 shutdown_connections 2023-11-18T20:40:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.346+0000 7f9cbd832640 1 -- 172.21.15.132:0/4169529642 wait complete. 2023-11-18T20:40:19.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:19.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.577+0000 7fb634e2b640 1 Processor -- start 2023-11-18T20:40:19.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.577+0000 7fb634e2b640 1 -- start start 2023-11-18T20:40:19.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb634e2b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb63014fd30 0x7fb630152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb634e2b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 0x7fb6300a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb634e2b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb6300a5260 0x7fb6300c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb634e2b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6300c64a0 con 0x7fb6300a5260 2023-11-18T20:40:19.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb634e2b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6300c5c00 con 0x7fb63014fd30 2023-11-18T20:40:19.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb634e2b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300c5ee0 con 0x7fb63006d0a0 2023-11-18T20:40:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb62ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb6300a5260 0x7fb6300c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb62ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb6300a5260 0x7fb6300c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39116/0 (socket says 172.21.15.132:39116) 2023-11-18T20:40:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb62ed9d640 1 -- 172.21.15.132:0/1007400114 learned_addr learned my addr 172.21.15.132:0/1007400114 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb62ed9d640 1 -- 172.21.15.132:0/1007400114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 msgr2=0x7fb6300a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb62ed9d640 1 --2- 172.21.15.132:0/1007400114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 0x7fb6300a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb62ed9d640 1 -- 172.21.15.132:0/1007400114 >> v2:172.21.15.161:3300/0 conn(0x7fb63014fd30 msgr2=0x7fb630152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb62ed9d640 1 --2- 172.21.15.132:0/1007400114 >> v2:172.21.15.161:3300/0 conn(0x7fb63014fd30 0x7fb630152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.579+0000 7fb62ed9d640 1 -- 172.21.15.132:0/1007400114 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300c61c0 con 0x7fb6300a5260 2023-11-18T20:40:19.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.580+0000 7fb62ed9d640 1 --2- 172.21.15.132:0/1007400114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6300a5260 0x7fb6300c3ea0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb63006b200 tx=0x7fb62802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c773200710ae3419 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:19.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb62dd9b640 1 -- 172.21.15.132:0/1007400114 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62802ca80 con 0x7fb6300a5260 2023-11-18T20:40:19.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb62dd9b640 1 -- 172.21.15.132:0/1007400114 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62802cbe0 con 0x7fb6300a5260 2023-11-18T20:40:19.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb62dd9b640 1 -- 172.21.15.132:0/1007400114 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280343f0 con 0x7fb6300a5260 2023-11-18T20:40:19.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb634e2b640 1 -- 172.21.15.132:0/1007400114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6300a5260 msgr2=0x7fb6300c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb634e2b640 1 --2- 172.21.15.132:0/1007400114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6300a5260 0x7fb6300c3ea0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb63006b200 tx=0x7fb62802bee0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb634e2b640 1 -- 172.21.15.132:0/1007400114 shutdown_connections 2023-11-18T20:40:19.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb634e2b640 1 --2- 172.21.15.132:0/1007400114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6300a5260 0x7fb6300c3ea0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb634e2b640 1 --2- 172.21.15.132:0/1007400114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 0x7fb6300a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb634e2b640 1 --2- 172.21.15.132:0/1007400114 >> v2:172.21.15.161:3300/0 conn(0x7fb63014fd30 0x7fb630152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.581+0000 7fb634e2b640 1 -- 172.21.15.132:0/1007400114 >> 172.21.15.132:0/1007400114 conn(0x7fb63006a500 msgr2=0x7fb63006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:19.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.582+0000 7fb634e2b640 1 -- 172.21.15.132:0/1007400114 shutdown_connections 2023-11-18T20:40:19.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.582+0000 7fb634e2b640 1 -- 172.21.15.132:0/1007400114 wait complete. 2023-11-18T20:40:19.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.583+0000 7fb634e2b640 1 Processor -- start 2023-11-18T20:40:19.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.583+0000 7fb634e2b640 1 -- start start 2023-11-18T20:40:19.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.584+0000 7fb634e2b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 0x7fb630151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.584+0000 7fb634e2b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6300a5260 0x7fb6301ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.584+0000 7fb634e2b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb63014fd30 0x7fb6301ea900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.584+0000 7fb634e2b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb630149d90 con 0x7fb63014fd30 2023-11-18T20:40:19.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.584+0000 7fb634e2b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb630071920 con 0x7fb6300a5260 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.584+0000 7fb634e2b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300712f0 con 0x7fb63006d0a0 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb63014fd30 0x7fb6301ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb63014fd30 0x7fb6301ea900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39132/0 (socket says 172.21.15.132:39132) 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 -- 172.21.15.132:0/4070370613 learned_addr learned my addr 172.21.15.132:0/4070370613 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb627fff640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6300a5260 0x7fb6301ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62e59c640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 0x7fb630151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 -- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 msgr2=0x7fb630151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 0x7fb630151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 -- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6300a5260 msgr2=0x7fb6301ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6300a5260 0x7fb6301ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 -- 172.21.15.132:0/4070370613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628009b30 con 0x7fb63014fd30 2023-11-18T20:40:19.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.585+0000 7fb62ed9d640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb63014fd30 0x7fb6301ea900 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb628009f40 tx=0x7fb628004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:19.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.586+0000 7fb626ffd640 1 -- 172.21.15.132:0/4070370613 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62803e450 con 0x7fb63014fd30 2023-11-18T20:40:19.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.586+0000 7fb626ffd640 1 -- 172.21.15.132:0/4070370613 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62803e5d0 con 0x7fb63014fd30 2023-11-18T20:40:19.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.586+0000 7fb626ffd640 1 -- 172.21.15.132:0/4070370613 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62803e980 con 0x7fb63014fd30 2023-11-18T20:40:19.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.586+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6300aae20 con 0x7fb63014fd30 2023-11-18T20:40:19.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.586+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb630070f70 con 0x7fb63014fd30 2023-11-18T20:40:19.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.587+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb630071a60 con 0x7fb63014fd30 2023-11-18T20:40:19.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.588+0000 7fb626ffd640 1 -- 172.21.15.132:0/4070370613 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb62802cd50 con 0x7fb63014fd30 2023-11-18T20:40:19.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.589+0000 7fb626ffd640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb61006ae40 0x7fb61006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:19.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.589+0000 7fb626ffd640 1 -- 172.21.15.132:0/4070370613 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6280ac250 con 0x7fb63014fd30 2023-11-18T20:40:19.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.589+0000 7fb62e59c640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb61006ae40 0x7fb61006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.590+0000 7fb62e59c640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb61006ae40 0x7fb61006d300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb6300a4d10 tx=0x7fb620008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:19.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.593+0000 7fb626ffd640 1 -- 172.21.15.132:0/4070370613 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb630071a60 con 0x7fb63014fd30 2023-11-18T20:40:19.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.786+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb630071a60 con 0x7fb63014fd30 2023-11-18T20:40:19.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.789+0000 7fb626ffd640 1 -- 172.21.15.132:0/4070370613 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16601 (secure 0 0 0) 0x7fb630071a60 con 0x7fb63014fd30 2023-11-18T20:40:19.791 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:19.791 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":55,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:16.316858+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:19.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.792+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb61006ae40 msgr2=0x7fb61006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.792+0000 7fb634e2b640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb61006ae40 0x7fb61006d300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb6300a4d10 tx=0x7fb620008040 comp rx=0 tx=0).stop 2023-11-18T20:40:19.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.792+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb63014fd30 msgr2=0x7fb6301ea900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:19.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.792+0000 7fb634e2b640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb63014fd30 0x7fb6301ea900 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb628009f40 tx=0x7fb628004a40 comp rx=0 tx=0).stop 2023-11-18T20:40:19.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.792+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 shutdown_connections 2023-11-18T20:40:19.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.792+0000 7fb634e2b640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb61006ae40 0x7fb61006d300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.792+0000 7fb634e2b640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb63014fd30 0x7fb6301ea900 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.793+0000 7fb634e2b640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6300a5260 0x7fb6301ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.793+0000 7fb634e2b640 1 --2- 172.21.15.132:0/4070370613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb63006d0a0 0x7fb630151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:19.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.793+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 >> 172.21.15.132:0/4070370613 conn(0x7fb63006a500 msgr2=0x7fb63006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:19.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.793+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 shutdown_connections 2023-11-18T20:40:19.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:19.793+0000 7fb634e2b640 1 -- 172.21.15.132:0/4070370613 wait complete. 2023-11-18T20:40:19.813 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T20:40:19.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:40:20.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.024+0000 7fa06dd27640 1 Processor -- start 2023-11-18T20:40:20.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.024+0000 7fa06dd27640 1 -- start start 2023-11-18T20:40:20.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa06dd27640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa068151c30 0x7fa0680a8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa06dd27640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa0680a5fe0 0x7fa068154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa06dd27640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa068158580 0x7fa0681550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa06dd27640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa068154790 con 0x7fa0680a5fe0 2023-11-18T20:40:20.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa06dd27640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa068152010 con 0x7fa068151c30 2023-11-18T20:40:20.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa06dd27640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa068070c60 con 0x7fa068158580 2023-11-18T20:40:20.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa067fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa0680a5fe0 0x7fa068154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa067fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa0680a5fe0 0x7fa068154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39144/0 (socket says 172.21.15.132:39144) 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.026+0000 7fa067fff640 1 -- 172.21.15.132:0/3726316070 learned_addr learned my addr 172.21.15.132:0/3726316070 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.027+0000 7fa067fff640 1 -- 172.21.15.132:0/3726316070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa068158580 msgr2=0x7fa0681550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.027+0000 7fa06d526640 1 --2- 172.21.15.132:0/3726316070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa068158580 0x7fa0681550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.027+0000 7fa067fff640 1 --2- 172.21.15.132:0/3726316070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa068158580 0x7fa0681550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.027+0000 7fa067fff640 1 -- 172.21.15.132:0/3726316070 >> v2:172.21.15.161:3300/0 conn(0x7fa068151c30 msgr2=0x7fa0680a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.027+0000 7fa06cd25640 1 --2- 172.21.15.132:0/3726316070 >> v2:172.21.15.161:3300/0 conn(0x7fa068151c30 0x7fa0680a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.027+0000 7fa067fff640 1 --2- 172.21.15.132:0/3726316070 >> v2:172.21.15.161:3300/0 conn(0x7fa068151c30 0x7fa0680a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.027+0000 7fa067fff640 1 -- 172.21.15.132:0/3726316070 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068070f00 con 0x7fa0680a5fe0 2023-11-18T20:40:20.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.027+0000 7fa06cd25640 1 --2- 172.21.15.132:0/3726316070 >> v2:172.21.15.161:3300/0 conn(0x7fa068151c30 0x7fa0680a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:20.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.028+0000 7fa067fff640 1 --2- 172.21.15.132:0/3726316070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0680a5fe0 0x7fa068154bb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa0680670f0 tx=0x7fa05402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591cdcb10747c02b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.028+0000 7fa0677fe640 1 -- 172.21.15.132:0/3726316070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540317d0 con 0x7fa0680a5fe0 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.028+0000 7fa0677fe640 1 -- 172.21.15.132:0/3726316070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054031930 con 0x7fa0680a5fe0 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.028+0000 7fa0677fe640 1 -- 172.21.15.132:0/3726316070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054031cc0 con 0x7fa0680a5fe0 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 -- 172.21.15.132:0/3726316070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0680a5fe0 msgr2=0x7fa068154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 --2- 172.21.15.132:0/3726316070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0680a5fe0 0x7fa068154bb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa0680670f0 tx=0x7fa05402b870 comp rx=0 tx=0).stop 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 -- 172.21.15.132:0/3726316070 shutdown_connections 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 --2- 172.21.15.132:0/3726316070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa068158580 0x7fa0681550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 --2- 172.21.15.132:0/3726316070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0680a5fe0 0x7fa068154bb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 --2- 172.21.15.132:0/3726316070 >> v2:172.21.15.161:3300/0 conn(0x7fa068151c30 0x7fa0680a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 -- 172.21.15.132:0/3726316070 >> 172.21.15.132:0/3726316070 conn(0x7fa06806b610 msgr2=0x7fa06806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:20.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 -- 172.21.15.132:0/3726316070 shutdown_connections 2023-11-18T20:40:20.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.029+0000 7fa06dd27640 1 -- 172.21.15.132:0/3726316070 wait complete. 2023-11-18T20:40:20.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.031+0000 7fa06dd27640 1 Processor -- start 2023-11-18T20:40:20.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.031+0000 7fa06dd27640 1 -- start start 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06dd27640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0680a5fe0 0x7fa0680c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06dd27640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa068151c30 0x7fa0681edd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06dd27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa068158580 0x7fa068156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06dd27640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0680c67d0 con 0x7fa068158580 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06dd27640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0680c2580 con 0x7fa068151c30 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06dd27640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681ee260 con 0x7fa0680a5fe0 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06d526640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa068158580 0x7fa068156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06d526640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa068158580 0x7fa068156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39156/0 (socket says 172.21.15.132:39156) 2023-11-18T20:40:20.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06d526640 1 -- 172.21.15.132:0/4177423782 learned_addr learned my addr 172.21.15.132:0/4177423782 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.032+0000 7fa06cd25640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0680a5fe0 0x7fa0680c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa067fff640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa068151c30 0x7fa0681edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa06d526640 1 -- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0680a5fe0 msgr2=0x7fa0680c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa06d526640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0680a5fe0 0x7fa0680c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa06d526640 1 -- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa068151c30 msgr2=0x7fa0681edd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa06d526640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa068151c30 0x7fa0681edd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa06d526640 1 -- 172.21.15.132:0/4177423782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540094d0 con 0x7fa068158580 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa067fff640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa068151c30 0x7fa0681edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa06d526640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa068158580 0x7fa068156d40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa06000cc30 tx=0x7fa06000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa0657fa640 1 -- 172.21.15.132:0/4177423782 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000ae80 con 0x7fa068158580 2023-11-18T20:40:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa0657fa640 1 -- 172.21.15.132:0/4177423782 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06000ce40 con 0x7fa068158580 2023-11-18T20:40:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0680c32c0 con 0x7fa068158580 2023-11-18T20:40:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.033+0000 7fa0657fa640 1 -- 172.21.15.132:0/4177423782 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060003b90 con 0x7fa068158580 2023-11-18T20:40:20.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.034+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0680c2d00 con 0x7fa068158580 2023-11-18T20:40:20.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.035+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06804e840 con 0x7fa068158580 2023-11-18T20:40:20.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.035+0000 7fa0657fa640 1 -- 172.21.15.132:0/4177423782 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa06000f3f0 con 0x7fa068158580 2023-11-18T20:40:20.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.036+0000 7fa0657fa640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa04c06ae40 0x7fa04c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.036+0000 7fa0657fa640 1 -- 172.21.15.132:0/4177423782 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa060089940 con 0x7fa068158580 2023-11-18T20:40:20.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.037+0000 7fa06cd25640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa04c06ae40 0x7fa04c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.038+0000 7fa06cd25640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa04c06ae40 0x7fa04c06d300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa05c006b10 tx=0x7fa05c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:20.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.041+0000 7fa0657fa640 1 -- 172.21.15.132:0/4177423782 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa0600549e0 con 0x7fa068158580 2023-11-18T20:40:20.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.227+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa068158a60 con 0x7fa04c06ae40 2023-11-18T20:40:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.250+0000 7fa0657fa640 1 -- 172.21.15.132:0/4177423782 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286855 (secure 0 0 0) 0x7fa05c00c050 con 0x7fa04c06ae40 2023-11-18T20:40:20.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:20.257 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:40:20.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.255+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa04c06ae40 msgr2=0x7fa04c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.255+0000 7fa06dd27640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa04c06ae40 0x7fa04c06d300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa05c006b10 tx=0x7fa05c008040 comp rx=0 tx=0).stop 2023-11-18T20:40:20.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.255+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa068158580 msgr2=0x7fa068156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.255+0000 7fa06dd27640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa068158580 0x7fa068156d40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa06000cc30 tx=0x7fa06000a5c0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.256+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 shutdown_connections 2023-11-18T20:40:20.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.256+0000 7fa06dd27640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa04c06ae40 0x7fa04c06d300 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.256+0000 7fa06dd27640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa068158580 0x7fa068156d40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.256+0000 7fa06dd27640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa068151c30 0x7fa0681edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.256+0000 7fa06dd27640 1 --2- 172.21.15.132:0/4177423782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0680a5fe0 0x7fa0680c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.256+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 >> 172.21.15.132:0/4177423782 conn(0x7fa06806b610 msgr2=0x7fa068150dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:20.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.256+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 shutdown_connections 2023-11-18T20:40:20.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.256+0000 7fa06dd27640 1 -- 172.21.15.132:0/4177423782 wait complete. 2023-11-18T20:40:20.277 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-11-18T20:40:18.688744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230800,"kb_used_data":6284,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743920,"statfs":{"total":773094113280,"available":772857774080,"internally_reserved":0,"allocated":6434816,"data_stored":3414416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.897810"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329485+0000","last_change":"2023-11-18T20:40:15.353470+0000","last_active":"2023-11-18T20:40:16.329485+0000","last_peered":"2023-11-18T20:40:16.329485+0000","last_clean":"2023-11-18T20:40:16.329485+0000","last_became_active":"2023-11-18T20:40:15.353123+0000","last_became_peered":"2023-11-18T20:40:15.353123+0000","last_unstale":"2023-11-18T20:40:16.329485+0000","last_undegraded":"2023-11-18T20:40:16.329485+0000","last_fullsized":"2023-11-18T20:40:16.329485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:17:38.972740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366569+0000","last_change":"2023-11-18T20:40:15.364843+0000","last_active":"2023-11-18T20:40:15.366569+0000","last_peered":"2023-11-18T20:40:15.366569+0000","last_clean":"2023-11-18T20:40:15.366569+0000","last_became_active":"2023-11-18T20:40:15.364551+0000","last_became_peered":"2023-11-18T20:40:15.364551+0000","last_unstale":"2023-11-18T20:40:15.366569+0000","last_undegraded":"2023-11-18T20:40:15.366569+0000","last_fullsized":"2023-11-18T20:40:15.366569+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:42:16.967079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.351367+0000","last_change":"2023-11-18T20:40:15.345424+0000","last_active":"2023-11-18T20:40:15.351367+0000","last_peered":"2023-11-18T20:40:15.351367+0000","last_clean":"2023-11-18T20:40:15.351367+0000","last_became_active":"2023-11-18T20:40:15.344537+0000","last_became_peered":"2023-11-18T20:40:15.344537+0000","last_unstale":"2023-11-18T20:40:15.351367+0000","last_undegraded":"2023-11-18T20:40:15.351367+0000","last_fullsized":"2023-11-18T20:40:15.351367+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:24:27.178244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326231+0000","last_change":"2023-11-18T20:40:15.356657+0000","last_active":"2023-11-18T20:40:16.326231+0000","last_peered":"2023-11-18T20:40:16.326231+0000","last_clean":"2023-11-18T20:40:16.326231+0000","last_became_active":"2023-11-18T20:40:15.356417+0000","last_became_peered":"2023-11-18T20:40:15.356417+0000","last_unstale":"2023-11-18T20:40:16.326231+0000","last_undegraded":"2023-11-18T20:40:16.326231+0000","last_fullsized":"2023-11-18T20:40:16.326231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:07:05.628953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.328726+0000","last_change":"2023-11-18T20:40:15.343983+0000","last_active":"2023-11-18T20:40:16.328726+0000","last_peered":"2023-11-18T20:40:16.328726+0000","last_clean":"2023-11-18T20:40:16.328726+0000","last_became_active":"2023-11-18T20:40:15.343720+0000","last_became_peered":"2023-11-18T20:40:15.343720+0000","last_unstale":"2023-11-18T20:40:16.328726+0000","last_undegraded":"2023-11-18T20:40:16.328726+0000","last_fullsized":"2023-11-18T20:40:16.328726+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:56:02.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.328330+0000","last_change":"2023-11-18T20:40:15.350938+0000","last_active":"2023-11-18T20:40:16.328330+0000","last_peered":"2023-11-18T20:40:16.328330+0000","last_clean":"2023-11-18T20:40:16.328330+0000","last_became_active":"2023-11-18T20:40:15.350551+0000","last_became_peered":"2023-11-18T20:40:15.350551+0000","last_unstale":"2023-11-18T20:40:16.328330+0000","last_undegraded":"2023-11-18T20:40:16.328330+0000","last_fullsized":"2023-11-18T20:40:16.328330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:32.423699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325723+0000","last_change":"2023-11-18T20:40:15.349771+0000","last_active":"2023-11-18T20:40:16.325723+0000","last_peered":"2023-11-18T20:40:16.325723+0000","last_clean":"2023-11-18T20:40:16.325723+0000","last_became_active":"2023-11-18T20:40:15.349537+0000","last_became_peered":"2023-11-18T20:40:15.349537+0000","last_unstale":"2023-11-18T20:40:16.325723+0000","last_undegraded":"2023-11-18T20:40:16.325723+0000","last_fullsized":"2023-11-18T20:40:16.325723+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:24:36.093151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663175+0000","last_change":"2023-11-18T20:40:15.348439+0000","last_active":"2023-11-18T20:40:17.663175+0000","last_peered":"2023-11-18T20:40:17.663175+0000","last_clean":"2023-11-18T20:40:17.663175+0000","last_became_active":"2023-11-18T20:40:15.348132+0000","last_became_peered":"2023-11-18T20:40:15.348132+0000","last_unstale":"2023-11-18T20:40:17.663175+0000","last_undegraded":"2023-11-18T20:40:17.663175+0000","last_fullsized":"2023-11-18T20:40:17.663175+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:15:18.987033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322183+0000","last_change":"2023-11-18T20:40:15.353406+0000","last_active":"2023-11-18T20:40:16.322183+0000","last_peered":"2023-11-18T20:40:16.322183+0000","last_clean":"2023-11-18T20:40:16.322183+0000","last_became_active":"2023-11-18T20:40:15.353034+0000","last_became_peered":"2023-11-18T20:40:15.353034+0000","last_unstale":"2023-11-18T20:40:16.322183+0000","last_undegraded":"2023-11-18T20:40:16.322183+0000","last_fullsized":"2023-11-18T20:40:16.322183+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:20:37.917813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329023+0000","last_change":"2023-11-18T20:40:15.342874+0000","last_active":"2023-11-18T20:40:16.329023+0000","last_peered":"2023-11-18T20:40:16.329023+0000","last_clean":"2023-11-18T20:40:16.329023+0000","last_became_active":"2023-11-18T20:40:15.342588+0000","last_became_peered":"2023-11-18T20:40:15.342588+0000","last_unstale":"2023-11-18T20:40:16.329023+0000","last_undegraded":"2023-11-18T20:40:16.329023+0000","last_fullsized":"2023-11-18T20:40:16.329023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:25:23.165385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.346454+0000","last_change":"2023-11-18T20:40:15.340398+0000","last_active":"2023-11-18T20:40:15.346454+0000","last_peered":"2023-11-18T20:40:15.346454+0000","last_clean":"2023-11-18T20:40:15.346454+0000","last_became_active":"2023-11-18T20:40:15.340055+0000","last_became_peered":"2023-11-18T20:40:15.340055+0000","last_unstale":"2023-11-18T20:40:15.346454+0000","last_undegraded":"2023-11-18T20:40:15.346454+0000","last_fullsized":"2023-11-18T20:40:15.346454+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:11.392335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322214+0000","last_change":"2023-11-18T20:40:15.344623+0000","last_active":"2023-11-18T20:40:16.322214+0000","last_peered":"2023-11-18T20:40:16.322214+0000","last_clean":"2023-11-18T20:40:16.322214+0000","last_became_active":"2023-11-18T20:40:15.344216+0000","last_became_peered":"2023-11-18T20:40:15.344216+0000","last_unstale":"2023-11-18T20:40:16.322214+0000","last_undegraded":"2023-11-18T20:40:16.322214+0000","last_fullsized":"2023-11-18T20:40:16.322214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:53.802513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196510+0000","last_change":"2023-11-18T20:40:15.352260+0000","last_active":"2023-11-18T20:40:17.196510+0000","last_peered":"2023-11-18T20:40:17.196510+0000","last_clean":"2023-11-18T20:40:17.196510+0000","last_became_active":"2023-11-18T20:40:15.351965+0000","last_became_peered":"2023-11-18T20:40:15.351965+0000","last_unstale":"2023-11-18T20:40:17.196510+0000","last_undegraded":"2023-11-18T20:40:17.196510+0000","last_fullsized":"2023-11-18T20:40:17.196510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:11.392335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.353328+0000","last_change":"2023-11-18T20:40:15.348662+0000","last_active":"2023-11-18T20:40:15.353328+0000","last_peered":"2023-11-18T20:40:15.353328+0000","last_clean":"2023-11-18T20:40:15.353328+0000","last_became_active":"2023-11-18T20:40:15.348091+0000","last_became_peered":"2023-11-18T20:40:15.348091+0000","last_unstale":"2023-11-18T20:40:15.353328+0000","last_undegraded":"2023-11-18T20:40:15.353328+0000","last_fullsized":"2023-11-18T20:40:15.353328+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:11.392335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196448+0000","last_change":"2023-11-18T20:40:15.356747+0000","last_active":"2023-11-18T20:40:17.196448+0000","last_peered":"2023-11-18T20:40:17.196448+0000","last_clean":"2023-11-18T20:40:17.196448+0000","last_became_active":"2023-11-18T20:40:15.356448+0000","last_became_peered":"2023-11-18T20:40:15.356448+0000","last_unstale":"2023-11-18T20:40:17.196448+0000","last_undegraded":"2023-11-18T20:40:17.196448+0000","last_fullsized":"2023-11-18T20:40:17.196448+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:44.689679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.327692+0000","last_change":"2023-11-18T20:40:15.349839+0000","last_active":"2023-11-18T20:40:16.327692+0000","last_peered":"2023-11-18T20:40:16.327692+0000","last_clean":"2023-11-18T20:40:16.327692+0000","last_became_active":"2023-11-18T20:40:15.349526+0000","last_became_peered":"2023-11-18T20:40:15.349526+0000","last_unstale":"2023-11-18T20:40:16.327692+0000","last_undegraded":"2023-11-18T20:40:16.327692+0000","last_fullsized":"2023-11-18T20:40:16.327692+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:54:40.657646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329600+0000","last_change":"2023-11-18T20:40:15.356534+0000","last_active":"2023-11-18T20:40:16.329600+0000","last_peered":"2023-11-18T20:40:16.329600+0000","last_clean":"2023-11-18T20:40:16.329600+0000","last_became_active":"2023-11-18T20:40:15.356211+0000","last_became_peered":"2023-11-18T20:40:15.356211+0000","last_unstale":"2023-11-18T20:40:16.329600+0000","last_undegraded":"2023-11-18T20:40:16.329600+0000","last_fullsized":"2023-11-18T20:40:16.329600+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:49.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358560+0000","last_change":"2023-11-18T20:40:15.357082+0000","last_active":"2023-11-18T20:40:15.358560+0000","last_peered":"2023-11-18T20:40:15.358560+0000","last_clean":"2023-11-18T20:40:15.358560+0000","last_became_active":"2023-11-18T20:40:15.356757+0000","last_became_peered":"2023-11-18T20:40:15.356757+0000","last_unstale":"2023-11-18T20:40:15.358560+0000","last_undegraded":"2023-11-18T20:40:15.358560+0000","last_fullsized":"2023-11-18T20:40:15.358560+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:12.691580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366395+0000","last_change":"2023-11-18T20:40:15.363178+0000","last_active":"2023-11-18T20:40:15.366395+0000","last_peered":"2023-11-18T20:40:15.366395+0000","last_clean":"2023-11-18T20:40:15.366395+0000","last_became_active":"2023-11-18T20:40:15.362454+0000","last_became_peered":"2023-11-18T20:40:15.362454+0000","last_unstale":"2023-11-18T20:40:15.366395+0000","last_undegraded":"2023-11-18T20:40:15.366395+0000","last_fullsized":"2023-11-18T20:40:15.366395+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:18.839789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.351282+0000","last_change":"2023-11-18T20:40:15.348980+0000","last_active":"2023-11-18T20:40:15.351282+0000","last_peered":"2023-11-18T20:40:15.351282+0000","last_clean":"2023-11-18T20:40:15.351282+0000","last_became_active":"2023-11-18T20:40:15.348714+0000","last_became_peered":"2023-11-18T20:40:15.348714+0000","last_unstale":"2023-11-18T20:40:15.351282+0000","last_undegraded":"2023-11-18T20:40:15.351282+0000","last_fullsized":"2023-11-18T20:40:15.351282+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:03.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196621+0000","last_change":"2023-11-18T20:40:15.349389+0000","last_active":"2023-11-18T20:40:17.196621+0000","last_peered":"2023-11-18T20:40:17.196621+0000","last_clean":"2023-11-18T20:40:17.196621+0000","last_became_active":"2023-11-18T20:40:15.348893+0000","last_became_peered":"2023-11-18T20:40:15.348893+0000","last_unstale":"2023-11-18T20:40:17.196621+0000","last_undegraded":"2023-11-18T20:40:17.196621+0000","last_fullsized":"2023-11-18T20:40:17.196621+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:40.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.361614+0000","last_change":"2023-11-18T20:40:15.357261+0000","last_active":"2023-11-18T20:40:15.361614+0000","last_peered":"2023-11-18T20:40:15.361614+0000","last_clean":"2023-11-18T20:40:15.361614+0000","last_became_active":"2023-11-18T20:40:15.356930+0000","last_became_peered":"2023-11-18T20:40:15.356930+0000","last_unstale":"2023-11-18T20:40:15.361614+0000","last_undegraded":"2023-11-18T20:40:15.361614+0000","last_fullsized":"2023-11-18T20:40:15.361614+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:40.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325775+0000","last_change":"2023-11-18T20:40:15.357312+0000","last_active":"2023-11-18T20:40:16.325775+0000","last_peered":"2023-11-18T20:40:16.325775+0000","last_clean":"2023-11-18T20:40:16.325775+0000","last_became_active":"2023-11-18T20:40:15.355941+0000","last_became_peered":"2023-11-18T20:40:15.355941+0000","last_unstale":"2023-11-18T20:40:16.325775+0000","last_undegraded":"2023-11-18T20:40:16.325775+0000","last_fullsized":"2023-11-18T20:40:16.325775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:58:33.591767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.321949+0000","last_change":"2023-11-18T20:40:15.352149+0000","last_active":"2023-11-18T20:40:16.321949+0000","last_peered":"2023-11-18T20:40:16.321949+0000","last_clean":"2023-11-18T20:40:16.321949+0000","last_became_active":"2023-11-18T20:40:15.351873+0000","last_became_peered":"2023-11-18T20:40:15.351873+0000","last_unstale":"2023-11-18T20:40:16.321949+0000","last_undegraded":"2023-11-18T20:40:16.321949+0000","last_fullsized":"2023-11-18T20:40:16.321949+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:18.839789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366426+0000","last_change":"2023-11-18T20:40:15.363235+0000","last_active":"2023-11-18T20:40:15.366426+0000","last_peered":"2023-11-18T20:40:15.366426+0000","last_clean":"2023-11-18T20:40:15.366426+0000","last_became_active":"2023-11-18T20:40:15.361152+0000","last_became_peered":"2023-11-18T20:40:15.361152+0000","last_unstale":"2023-11-18T20:40:15.366426+0000","last_undegraded":"2023-11-18T20:40:15.366426+0000","last_fullsized":"2023-11-18T20:40:15.366426+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:47:53.154785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196851+0000","last_change":"2023-11-18T20:40:15.341577+0000","last_active":"2023-11-18T20:40:17.196851+0000","last_peered":"2023-11-18T20:40:17.196851+0000","last_clean":"2023-11-18T20:40:17.196851+0000","last_became_active":"2023-11-18T20:40:15.341217+0000","last_became_peered":"2023-11-18T20:40:15.341217+0000","last_unstale":"2023-11-18T20:40:17.196851+0000","last_undegraded":"2023-11-18T20:40:17.196851+0000","last_fullsized":"2023-11-18T20:40:17.196851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:12.691580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366513+0000","last_change":"2023-11-18T20:40:15.364215+0000","last_active":"2023-11-18T20:40:15.366513+0000","last_peered":"2023-11-18T20:40:15.366513+0000","last_clean":"2023-11-18T20:40:15.366513+0000","last_became_active":"2023-11-18T20:40:15.363880+0000","last_became_peered":"2023-11-18T20:40:15.363880+0000","last_unstale":"2023-11-18T20:40:15.366513+0000","last_undegraded":"2023-11-18T20:40:15.366513+0000","last_fullsized":"2023-11-18T20:40:15.366513+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:18:39.504225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663896+0000","last_change":"2023-11-18T20:40:15.353818+0000","last_active":"2023-11-18T20:40:17.663896+0000","last_peered":"2023-11-18T20:40:17.663896+0000","last_clean":"2023-11-18T20:40:17.663896+0000","last_became_active":"2023-11-18T20:40:15.352248+0000","last_became_peered":"2023-11-18T20:40:15.352248+0000","last_unstale":"2023-11-18T20:40:17.663896+0000","last_undegraded":"2023-11-18T20:40:17.663896+0000","last_fullsized":"2023-11-18T20:40:17.663896+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:26:51.505142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663394+0000","last_change":"2023-11-18T20:40:15.354009+0000","last_active":"2023-11-18T20:40:17.663394+0000","last_peered":"2023-11-18T20:40:17.663394+0000","last_clean":"2023-11-18T20:40:17.663394+0000","last_became_active":"2023-11-18T20:40:15.352886+0000","last_became_peered":"2023-11-18T20:40:15.352886+0000","last_unstale":"2023-11-18T20:40:17.663394+0000","last_undegraded":"2023-11-18T20:40:17.663394+0000","last_fullsized":"2023-11-18T20:40:17.663394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:23.691704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325978+0000","last_change":"2023-11-18T20:40:15.342034+0000","last_active":"2023-11-18T20:40:16.325978+0000","last_peered":"2023-11-18T20:40:16.325978+0000","last_clean":"2023-11-18T20:40:16.325978+0000","last_became_active":"2023-11-18T20:40:15.341779+0000","last_became_peered":"2023-11-18T20:40:15.341779+0000","last_unstale":"2023-11-18T20:40:16.325978+0000","last_undegraded":"2023-11-18T20:40:16.325978+0000","last_fullsized":"2023-11-18T20:40:16.325978+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:13.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.364679+0000","last_change":"2023-11-18T20:40:15.356706+0000","last_active":"2023-11-18T20:40:15.364679+0000","last_peered":"2023-11-18T20:40:15.364679+0000","last_clean":"2023-11-18T20:40:15.364679+0000","last_became_active":"2023-11-18T20:40:15.356386+0000","last_became_peered":"2023-11-18T20:40:15.356386+0000","last_unstale":"2023-11-18T20:40:15.364679+0000","last_undegraded":"2023-11-18T20:40:15.364679+0000","last_fullsized":"2023-11-18T20:40:15.364679+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:55.872396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.356094+0000","last_change":"2023-11-18T20:40:15.352408+0000","last_active":"2023-11-18T20:40:15.356094+0000","last_peered":"2023-11-18T20:40:15.356094+0000","last_clean":"2023-11-18T20:40:15.356094+0000","last_became_active":"2023-11-18T20:40:15.351996+0000","last_became_peered":"2023-11-18T20:40:15.351996+0000","last_unstale":"2023-11-18T20:40:15.356094+0000","last_undegraded":"2023-11-18T20:40:15.356094+0000","last_fullsized":"2023-11-18T20:40:15.356094+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:12.691580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329203+0000","last_change":"2023-11-18T20:40:15.347869+0000","last_active":"2023-11-18T20:40:16.329203+0000","last_peered":"2023-11-18T20:40:16.329203+0000","last_clean":"2023-11-18T20:40:16.329203+0000","last_became_active":"2023-11-18T20:40:15.346533+0000","last_became_peered":"2023-11-18T20:40:15.346533+0000","last_unstale":"2023-11-18T20:40:16.329203+0000","last_undegraded":"2023-11-18T20:40:16.329203+0000","last_fullsized":"2023-11-18T20:40:16.329203+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:48.046712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.854796+0000","last_change":"2023-11-18T20:40:14.825864+0000","last_active":"2023-11-18T20:40:15.854796+0000","last_peered":"2023-11-18T20:40:15.854796+0000","last_clean":"2023-11-18T20:40:15.854796+0000","last_became_active":"2023-11-18T20:40:14.824070+0000","last_became_peered":"2023-11-18T20:40:14.824070+0000","last_unstale":"2023-11-18T20:40:15.854796+0000","last_undegraded":"2023-11-18T20:40:15.854796+0000","last_fullsized":"2023-11-18T20:40:15.854796+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:43.675287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329707+0000","last_change":"2023-11-18T20:40:15.351630+0000","last_active":"2023-11-18T20:40:16.329707+0000","last_peered":"2023-11-18T20:40:16.329707+0000","last_clean":"2023-11-18T20:40:16.329707+0000","last_became_active":"2023-11-18T20:40:15.351258+0000","last_became_peered":"2023-11-18T20:40:15.351258+0000","last_unstale":"2023-11-18T20:40:16.329707+0000","last_undegraded":"2023-11-18T20:40:16.329707+0000","last_fullsized":"2023-11-18T20:40:16.329707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:14.293907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.846268+0000","last_change":"2023-11-18T20:40:14.833864+0000","last_active":"2023-11-18T20:40:15.846268+0000","last_peered":"2023-11-18T20:40:15.846268+0000","last_clean":"2023-11-18T20:40:15.846268+0000","last_became_active":"2023-11-18T20:40:14.833570+0000","last_became_peered":"2023-11-18T20:40:14.833570+0000","last_unstale":"2023-11-18T20:40:15.846268+0000","last_undegraded":"2023-11-18T20:40:15.846268+0000","last_fullsized":"2023-11-18T20:40:15.846268+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:15.089130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664065+0000","last_change":"2023-11-18T20:40:15.361548+0000","last_active":"2023-11-18T20:40:17.664065+0000","last_peered":"2023-11-18T20:40:17.664065+0000","last_clean":"2023-11-18T20:40:17.664065+0000","last_became_active":"2023-11-18T20:40:15.361199+0000","last_became_peered":"2023-11-18T20:40:15.361199+0000","last_unstale":"2023-11-18T20:40:17.664065+0000","last_undegraded":"2023-11-18T20:40:17.664065+0000","last_fullsized":"2023-11-18T20:40:17.664065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:29.561471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329437+0000","last_change":"2023-11-18T20:40:14.833036+0000","last_active":"2023-11-18T20:40:16.329437+0000","last_peered":"2023-11-18T20:40:16.329437+0000","last_clean":"2023-11-18T20:40:16.329437+0000","last_became_active":"2023-11-18T20:40:14.831403+0000","last_became_peered":"2023-11-18T20:40:14.831403+0000","last_unstale":"2023-11-18T20:40:16.329437+0000","last_undegraded":"2023-11-18T20:40:16.329437+0000","last_fullsized":"2023-11-18T20:40:16.329437+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:51:45.803351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329109+0000","last_change":"2023-11-18T20:40:15.359834+0000","last_active":"2023-11-18T20:40:16.329109+0000","last_peered":"2023-11-18T20:40:16.329109+0000","last_clean":"2023-11-18T20:40:16.329109+0000","last_became_active":"2023-11-18T20:40:15.355953+0000","last_became_peered":"2023-11-18T20:40:15.355953+0000","last_unstale":"2023-11-18T20:40:16.329109+0000","last_undegraded":"2023-11-18T20:40:16.329109+0000","last_fullsized":"2023-11-18T20:40:16.329109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:37.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326304+0000","last_change":"2023-11-18T20:40:14.827337+0000","last_active":"2023-11-18T20:40:16.326304+0000","last_peered":"2023-11-18T20:40:16.326304+0000","last_clean":"2023-11-18T20:40:16.326304+0000","last_became_active":"2023-11-18T20:40:14.826653+0000","last_became_peered":"2023-11-18T20:40:14.826653+0000","last_unstale":"2023-11-18T20:40:16.326304+0000","last_undegraded":"2023-11-18T20:40:16.326304+0000","last_fullsized":"2023-11-18T20:40:16.326304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:25:30.247203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663305+0000","last_change":"2023-11-18T20:40:15.357662+0000","last_active":"2023-11-18T20:40:17.663305+0000","last_peered":"2023-11-18T20:40:17.663305+0000","last_clean":"2023-11-18T20:40:17.663305+0000","last_became_active":"2023-11-18T20:40:15.357033+0000","last_became_peered":"2023-11-18T20:40:15.357033+0000","last_unstale":"2023-11-18T20:40:17.663305+0000","last_undegraded":"2023-11-18T20:40:17.663305+0000","last_fullsized":"2023-11-18T20:40:17.663305+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:27.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.852510+0000","last_change":"2023-11-18T20:40:14.822926+0000","last_active":"2023-11-18T20:40:15.852510+0000","last_peered":"2023-11-18T20:40:15.852510+0000","last_clean":"2023-11-18T20:40:15.852510+0000","last_became_active":"2023-11-18T20:40:14.822593+0000","last_became_peered":"2023-11-18T20:40:14.822593+0000","last_unstale":"2023-11-18T20:40:15.852510+0000","last_undegraded":"2023-11-18T20:40:15.852510+0000","last_fullsized":"2023-11-18T20:40:15.852510+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:07:12.992214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.357986+0000","last_change":"2023-11-18T20:40:15.354490+0000","last_active":"2023-11-18T20:40:15.357986+0000","last_peered":"2023-11-18T20:40:15.357986+0000","last_clean":"2023-11-18T20:40:15.357986+0000","last_became_active":"2023-11-18T20:40:15.354207+0000","last_became_peered":"2023-11-18T20:40:15.354207+0000","last_unstale":"2023-11-18T20:40:15.357986+0000","last_undegraded":"2023-11-18T20:40:15.357986+0000","last_fullsized":"2023-11-18T20:40:15.357986+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:25.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.328635+0000","last_change":"2023-11-18T20:40:14.824769+0000","last_active":"2023-11-18T20:40:16.328635+0000","last_peered":"2023-11-18T20:40:16.328635+0000","last_clean":"2023-11-18T20:40:16.328635+0000","last_became_active":"2023-11-18T20:40:14.824476+0000","last_became_peered":"2023-11-18T20:40:14.824476+0000","last_unstale":"2023-11-18T20:40:16.328635+0000","last_undegraded":"2023-11-18T20:40:16.328635+0000","last_fullsized":"2023-11-18T20:40:16.328635+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:09:23.933844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.351268+0000","last_change":"2023-11-18T20:40:15.343792+0000","last_active":"2023-11-18T20:40:15.351268+0000","last_peered":"2023-11-18T20:40:15.351268+0000","last_clean":"2023-11-18T20:40:15.351268+0000","last_became_active":"2023-11-18T20:40:15.343641+0000","last_became_peered":"2023-11-18T20:40:15.343641+0000","last_unstale":"2023-11-18T20:40:15.351268+0000","last_undegraded":"2023-11-18T20:40:15.351268+0000","last_fullsized":"2023-11-18T20:40:15.351268+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:39:24.530336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322021+0000","last_change":"2023-11-18T20:40:14.824464+0000","last_active":"2023-11-18T20:40:16.322021+0000","last_peered":"2023-11-18T20:40:16.322021+0000","last_clean":"2023-11-18T20:40:16.322021+0000","last_became_active":"2023-11-18T20:40:14.824093+0000","last_became_peered":"2023-11-18T20:40:14.824093+0000","last_unstale":"2023-11-18T20:40:16.322021+0000","last_undegraded":"2023-11-18T20:40:16.322021+0000","last_fullsized":"2023-11-18T20:40:16.322021+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:29.994861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.327634+0000","last_change":"2023-11-18T20:40:15.355962+0000","last_active":"2023-11-18T20:40:16.327634+0000","last_peered":"2023-11-18T20:40:16.327634+0000","last_clean":"2023-11-18T20:40:16.327634+0000","last_became_active":"2023-11-18T20:40:15.355647+0000","last_became_peered":"2023-11-18T20:40:15.355647+0000","last_unstale":"2023-11-18T20:40:16.327634+0000","last_undegraded":"2023-11-18T20:40:16.327634+0000","last_fullsized":"2023-11-18T20:40:16.327634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:44.617490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196189+0000","last_change":"2023-11-18T20:40:14.826728+0000","last_active":"2023-11-18T20:40:17.196189+0000","last_peered":"2023-11-18T20:40:17.196189+0000","last_clean":"2023-11-18T20:40:17.196189+0000","last_became_active":"2023-11-18T20:40:14.826453+0000","last_became_peered":"2023-11-18T20:40:14.826453+0000","last_unstale":"2023-11-18T20:40:17.196189+0000","last_undegraded":"2023-11-18T20:40:17.196189+0000","last_fullsized":"2023-11-18T20:40:17.196189+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:39:23.515944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196840+0000","last_change":"2023-11-18T20:40:15.340229+0000","last_active":"2023-11-18T20:40:17.196840+0000","last_peered":"2023-11-18T20:40:17.196840+0000","last_clean":"2023-11-18T20:40:17.196840+0000","last_became_active":"2023-11-18T20:40:15.339486+0000","last_became_peered":"2023-11-18T20:40:15.339486+0000","last_unstale":"2023-11-18T20:40:17.196840+0000","last_undegraded":"2023-11-18T20:40:17.196840+0000","last_fullsized":"2023-11-18T20:40:17.196840+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:31.652533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322260+0000","last_change":"2023-11-18T20:40:14.827685+0000","last_active":"2023-11-18T20:40:16.322260+0000","last_peered":"2023-11-18T20:40:16.322260+0000","last_clean":"2023-11-18T20:40:16.322260+0000","last_became_active":"2023-11-18T20:40:14.827366+0000","last_became_peered":"2023-11-18T20:40:14.827366+0000","last_unstale":"2023-11-18T20:40:16.322260+0000","last_undegraded":"2023-11-18T20:40:16.322260+0000","last_fullsized":"2023-11-18T20:40:16.322260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:55.130516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358517+0000","last_change":"2023-11-18T20:40:15.355620+0000","last_active":"2023-11-18T20:40:15.358517+0000","last_peered":"2023-11-18T20:40:15.358517+0000","last_clean":"2023-11-18T20:40:15.358517+0000","last_became_active":"2023-11-18T20:40:15.355354+0000","last_became_peered":"2023-11-18T20:40:15.355354+0000","last_unstale":"2023-11-18T20:40:15.358517+0000","last_undegraded":"2023-11-18T20:40:15.358517+0000","last_fullsized":"2023-11-18T20:40:15.358517+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:03.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664198+0000","last_change":"2023-11-18T20:40:14.833810+0000","last_active":"2023-11-18T20:40:17.664198+0000","last_peered":"2023-11-18T20:40:17.664198+0000","last_clean":"2023-11-18T20:40:17.664198+0000","last_became_active":"2023-11-18T20:40:14.832447+0000","last_became_peered":"2023-11-18T20:40:14.832447+0000","last_unstale":"2023-11-18T20:40:17.664198+0000","last_undegraded":"2023-11-18T20:40:17.664198+0000","last_fullsized":"2023-11-18T20:40:17.664198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:02.417342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664252+0000","last_change":"2023-11-18T20:40:15.359505+0000","last_active":"2023-11-18T20:40:17.664252+0000","last_peered":"2023-11-18T20:40:17.664252+0000","last_clean":"2023-11-18T20:40:17.664252+0000","last_became_active":"2023-11-18T20:40:15.358966+0000","last_became_peered":"2023-11-18T20:40:15.358966+0000","last_unstale":"2023-11-18T20:40:17.664252+0000","last_undegraded":"2023-11-18T20:40:17.664252+0000","last_fullsized":"2023-11-18T20:40:17.664252+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:25:51.738059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326580+0000","last_change":"2023-11-18T20:40:14.827802+0000","last_active":"2023-11-18T20:40:16.326580+0000","last_peered":"2023-11-18T20:40:16.326580+0000","last_clean":"2023-11-18T20:40:16.326580+0000","last_became_active":"2023-11-18T20:40:14.827062+0000","last_became_peered":"2023-11-18T20:40:14.827062+0000","last_unstale":"2023-11-18T20:40:16.326580+0000","last_undegraded":"2023-11-18T20:40:16.326580+0000","last_fullsized":"2023-11-18T20:40:16.326580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:47:46.239729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326373+0000","last_change":"2023-11-18T20:40:15.350874+0000","last_active":"2023-11-18T20:40:16.326373+0000","last_peered":"2023-11-18T20:40:16.326373+0000","last_clean":"2023-11-18T20:40:16.326373+0000","last_became_active":"2023-11-18T20:40:15.350271+0000","last_became_peered":"2023-11-18T20:40:15.350271+0000","last_unstale":"2023-11-18T20:40:16.326373+0000","last_undegraded":"2023-11-18T20:40:16.326373+0000","last_fullsized":"2023-11-18T20:40:16.326373+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:51:14.162201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196673+0000","last_change":"2023-11-18T20:40:14.831009+0000","last_active":"2023-11-18T20:40:17.196673+0000","last_peered":"2023-11-18T20:40:17.196673+0000","last_clean":"2023-11-18T20:40:17.196673+0000","last_became_active":"2023-11-18T20:40:14.830639+0000","last_became_peered":"2023-11-18T20:40:14.830639+0000","last_unstale":"2023-11-18T20:40:17.196673+0000","last_undegraded":"2023-11-18T20:40:17.196673+0000","last_fullsized":"2023-11-18T20:40:17.196673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:20.007726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.321957+0000","last_change":"2023-11-18T20:40:15.354465+0000","last_active":"2023-11-18T20:40:16.321957+0000","last_peered":"2023-11-18T20:40:16.321957+0000","last_clean":"2023-11-18T20:40:16.321957+0000","last_became_active":"2023-11-18T20:40:15.354191+0000","last_became_peered":"2023-11-18T20:40:15.354191+0000","last_unstale":"2023-11-18T20:40:16.321957+0000","last_undegraded":"2023-11-18T20:40:16.321957+0000","last_fullsized":"2023-11-18T20:40:16.321957+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:18:39.504225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663838+0000","last_change":"2023-11-18T20:40:14.832793+0000","last_active":"2023-11-18T20:40:17.663838+0000","last_peered":"2023-11-18T20:40:17.663838+0000","last_clean":"2023-11-18T20:40:17.663838+0000","last_became_active":"2023-11-18T20:40:14.831869+0000","last_became_peered":"2023-11-18T20:40:14.831869+0000","last_unstale":"2023-11-18T20:40:17.663838+0000","last_undegraded":"2023-11-18T20:40:17.663838+0000","last_fullsized":"2023-11-18T20:40:17.663838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:54.843303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.351294+0000","last_change":"2023-11-18T20:40:15.343712+0000","last_active":"2023-11-18T20:40:15.351294+0000","last_peered":"2023-11-18T20:40:15.351294+0000","last_clean":"2023-11-18T20:40:15.351294+0000","last_became_active":"2023-11-18T20:40:15.343433+0000","last_became_peered":"2023-11-18T20:40:15.343433+0000","last_unstale":"2023-11-18T20:40:15.351294+0000","last_undegraded":"2023-11-18T20:40:15.351294+0000","last_fullsized":"2023-11-18T20:40:15.351294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:19.031862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326505+0000","last_change":"2023-11-18T20:40:14.821052+0000","last_active":"2023-11-18T20:40:16.326505+0000","last_peered":"2023-11-18T20:40:16.326505+0000","last_clean":"2023-11-18T20:40:16.326505+0000","last_became_active":"2023-11-18T20:40:14.820746+0000","last_became_peered":"2023-11-18T20:40:14.820746+0000","last_unstale":"2023-11-18T20:40:16.326505+0000","last_undegraded":"2023-11-18T20:40:16.326505+0000","last_fullsized":"2023-11-18T20:40:16.326505+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:48.332445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322072+0000","last_change":"2023-11-18T20:40:15.345010+0000","last_active":"2023-11-18T20:40:16.322072+0000","last_peered":"2023-11-18T20:40:16.322072+0000","last_clean":"2023-11-18T20:40:16.322072+0000","last_became_active":"2023-11-18T20:40:15.344217+0000","last_became_peered":"2023-11-18T20:40:15.344217+0000","last_unstale":"2023-11-18T20:40:16.322072+0000","last_undegraded":"2023-11-18T20:40:16.322072+0000","last_fullsized":"2023-11-18T20:40:16.322072+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:46:38.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325860+0000","last_change":"2023-11-18T20:40:14.819105+0000","last_active":"2023-11-18T20:40:16.325860+0000","last_peered":"2023-11-18T20:40:16.325860+0000","last_clean":"2023-11-18T20:40:16.325860+0000","last_became_active":"2023-11-18T20:40:14.818836+0000","last_became_peered":"2023-11-18T20:40:14.818836+0000","last_unstale":"2023-11-18T20:40:16.325860+0000","last_undegraded":"2023-11-18T20:40:16.325860+0000","last_fullsized":"2023-11-18T20:40:16.325860+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:45.745180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325878+0000","last_change":"2023-11-18T20:40:15.357869+0000","last_active":"2023-11-18T20:40:16.325878+0000","last_peered":"2023-11-18T20:40:16.325878+0000","last_clean":"2023-11-18T20:40:16.325878+0000","last_became_active":"2023-11-18T20:40:15.355608+0000","last_became_peered":"2023-11-18T20:40:15.355608+0000","last_unstale":"2023-11-18T20:40:16.325878+0000","last_undegraded":"2023-11-18T20:40:16.325878+0000","last_fullsized":"2023-11-18T20:40:16.325878+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.686758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326030+0000","last_change":"2023-11-18T20:40:14.816928+0000","last_active":"2023-11-18T20:40:16.326030+0000","last_peered":"2023-11-18T20:40:16.326030+0000","last_clean":"2023-11-18T20:40:16.326030+0000","last_became_active":"2023-11-18T20:40:14.816652+0000","last_became_peered":"2023-11-18T20:40:14.816652+0000","last_unstale":"2023-11-18T20:40:16.326030+0000","last_undegraded":"2023-11-18T20:40:16.326030+0000","last_fullsized":"2023-11-18T20:40:16.326030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:55.852659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358531+0000","last_change":"2023-11-18T20:40:15.355385+0000","last_active":"2023-11-18T20:40:15.358531+0000","last_peered":"2023-11-18T20:40:15.358531+0000","last_clean":"2023-11-18T20:40:15.358531+0000","last_became_active":"2023-11-18T20:40:15.355098+0000","last_became_peered":"2023-11-18T20:40:15.355098+0000","last_unstale":"2023-11-18T20:40:15.358531+0000","last_undegraded":"2023-11-18T20:40:15.358531+0000","last_fullsized":"2023-11-18T20:40:15.358531+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:06:10.018842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.853240+0000","last_change":"2023-11-18T20:40:14.834099+0000","last_active":"2023-11-18T20:40:15.853240+0000","last_peered":"2023-11-18T20:40:15.853240+0000","last_clean":"2023-11-18T20:40:15.853240+0000","last_became_active":"2023-11-18T20:40:14.833825+0000","last_became_peered":"2023-11-18T20:40:14.833825+0000","last_unstale":"2023-11-18T20:40:15.853240+0000","last_undegraded":"2023-11-18T20:40:15.853240+0000","last_fullsized":"2023-11-18T20:40:15.853240+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:29.994861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358565+0000","last_change":"2023-11-18T20:40:15.357460+0000","last_active":"2023-11-18T20:40:15.358565+0000","last_peered":"2023-11-18T20:40:15.358565+0000","last_clean":"2023-11-18T20:40:15.358565+0000","last_became_active":"2023-11-18T20:40:15.355817+0000","last_became_peered":"2023-11-18T20:40:15.355817+0000","last_unstale":"2023-11-18T20:40:15.358565+0000","last_undegraded":"2023-11-18T20:40:15.358565+0000","last_fullsized":"2023-11-18T20:40:15.358565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:40.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664292+0000","last_change":"2023-11-18T20:40:14.832158+0000","last_active":"2023-11-18T20:40:17.664292+0000","last_peered":"2023-11-18T20:40:17.664292+0000","last_clean":"2023-11-18T20:40:17.664292+0000","last_became_active":"2023-11-18T20:40:14.831853+0000","last_became_peered":"2023-11-18T20:40:14.831853+0000","last_unstale":"2023-11-18T20:40:17.664292+0000","last_undegraded":"2023-11-18T20:40:17.664292+0000","last_fullsized":"2023-11-18T20:40:17.664292+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:51:13.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.365433+0000","last_change":"2023-11-18T20:40:15.358307+0000","last_active":"2023-11-18T20:40:15.365433+0000","last_peered":"2023-11-18T20:40:15.365433+0000","last_clean":"2023-11-18T20:40:15.365433+0000","last_became_active":"2023-11-18T20:40:15.357876+0000","last_became_peered":"2023-11-18T20:40:15.357876+0000","last_unstale":"2023-11-18T20:40:15.365433+0000","last_undegraded":"2023-11-18T20:40:15.365433+0000","last_fullsized":"2023-11-18T20:40:15.365433+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:54.827659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.853733+0000","last_change":"2023-11-18T20:40:14.831548+0000","last_active":"2023-11-18T20:40:15.853733+0000","last_peered":"2023-11-18T20:40:15.853733+0000","last_clean":"2023-11-18T20:40:15.853733+0000","last_became_active":"2023-11-18T20:40:14.831302+0000","last_became_peered":"2023-11-18T20:40:14.831302+0000","last_unstale":"2023-11-18T20:40:15.853733+0000","last_undegraded":"2023-11-18T20:40:15.853733+0000","last_fullsized":"2023-11-18T20:40:15.853733+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:24.216427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326497+0000","last_change":"2023-11-18T20:40:15.357107+0000","last_active":"2023-11-18T20:40:16.326497+0000","last_peered":"2023-11-18T20:40:16.326497+0000","last_clean":"2023-11-18T20:40:16.326497+0000","last_became_active":"2023-11-18T20:40:15.356852+0000","last_became_peered":"2023-11-18T20:40:15.356852+0000","last_unstale":"2023-11-18T20:40:16.326497+0000","last_undegraded":"2023-11-18T20:40:16.326497+0000","last_fullsized":"2023-11-18T20:40:16.326497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:07.057091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664297+0000","last_change":"2023-11-18T20:40:14.830198+0000","last_active":"2023-11-18T20:40:17.664297+0000","last_peered":"2023-11-18T20:40:17.664297+0000","last_clean":"2023-11-18T20:40:17.664297+0000","last_became_active":"2023-11-18T20:40:14.829922+0000","last_became_peered":"2023-11-18T20:40:14.829922+0000","last_unstale":"2023-11-18T20:40:17.664297+0000","last_undegraded":"2023-11-18T20:40:17.664297+0000","last_fullsized":"2023-11-18T20:40:17.664297+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:37.429611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322156+0000","last_change":"2023-11-18T20:40:15.352716+0000","last_active":"2023-11-18T20:40:16.322156+0000","last_peered":"2023-11-18T20:40:16.322156+0000","last_clean":"2023-11-18T20:40:16.322156+0000","last_became_active":"2023-11-18T20:40:15.352413+0000","last_became_peered":"2023-11-18T20:40:15.352413+0000","last_unstale":"2023-11-18T20:40:16.322156+0000","last_undegraded":"2023-11-18T20:40:16.322156+0000","last_fullsized":"2023-11-18T20:40:16.322156+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:15:33.663727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.854435+0000","last_change":"2023-11-18T20:40:14.820194+0000","last_active":"2023-11-18T20:40:15.854435+0000","last_peered":"2023-11-18T20:40:15.854435+0000","last_clean":"2023-11-18T20:40:15.854435+0000","last_became_active":"2023-11-18T20:40:14.819684+0000","last_became_peered":"2023-11-18T20:40:14.819684+0000","last_unstale":"2023-11-18T20:40:15.854435+0000","last_undegraded":"2023-11-18T20:40:15.854435+0000","last_fullsized":"2023-11-18T20:40:15.854435+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:30.638140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663861+0000","last_change":"2023-11-18T20:40:15.352432+0000","last_active":"2023-11-18T20:40:17.663861+0000","last_peered":"2023-11-18T20:40:17.663861+0000","last_clean":"2023-11-18T20:40:17.663861+0000","last_became_active":"2023-11-18T20:40:15.352146+0000","last_became_peered":"2023-11-18T20:40:15.352146+0000","last_unstale":"2023-11-18T20:40:17.663861+0000","last_undegraded":"2023-11-18T20:40:17.663861+0000","last_fullsized":"2023-11-18T20:40:17.663861+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:47.494672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663387+0000","last_change":"2023-11-18T20:40:14.828458+0000","last_active":"2023-11-18T20:40:17.663387+0000","last_peered":"2023-11-18T20:40:17.663387+0000","last_clean":"2023-11-18T20:40:17.663387+0000","last_became_active":"2023-11-18T20:40:14.828170+0000","last_became_peered":"2023-11-18T20:40:14.828170+0000","last_unstale":"2023-11-18T20:40:17.663387+0000","last_undegraded":"2023-11-18T20:40:17.663387+0000","last_fullsized":"2023-11-18T20:40:17.663387+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:56:30.127554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663216+0000","last_change":"2023-11-18T20:40:15.349261+0000","last_active":"2023-11-18T20:40:17.663216+0000","last_peered":"2023-11-18T20:40:17.663216+0000","last_clean":"2023-11-18T20:40:17.663216+0000","last_became_active":"2023-11-18T20:40:15.346287+0000","last_became_peered":"2023-11-18T20:40:15.346287+0000","last_unstale":"2023-11-18T20:40:17.663216+0000","last_undegraded":"2023-11-18T20:40:17.663216+0000","last_fullsized":"2023-11-18T20:40:17.663216+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:43:17.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322071+0000","last_change":"2023-11-18T20:40:14.828962+0000","last_active":"2023-11-18T20:40:16.322071+0000","last_peered":"2023-11-18T20:40:16.322071+0000","last_clean":"2023-11-18T20:40:16.322071+0000","last_became_active":"2023-11-18T20:40:14.828681+0000","last_became_peered":"2023-11-18T20:40:14.828681+0000","last_unstale":"2023-11-18T20:40:16.322071+0000","last_undegraded":"2023-11-18T20:40:16.322071+0000","last_fullsized":"2023-11-18T20:40:16.322071+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:21:19.606979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358491+0000","last_change":"2023-11-18T20:40:15.354747+0000","last_active":"2023-11-18T20:40:15.358491+0000","last_peered":"2023-11-18T20:40:15.358491+0000","last_clean":"2023-11-18T20:40:15.358491+0000","last_became_active":"2023-11-18T20:40:15.354502+0000","last_became_peered":"2023-11-18T20:40:15.354502+0000","last_unstale":"2023-11-18T20:40:15.358491+0000","last_undegraded":"2023-11-18T20:40:15.358491+0000","last_fullsized":"2023-11-18T20:40:15.358491+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:42.601914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.854077+0000","last_change":"2023-11-18T20:40:14.834889+0000","last_active":"2023-11-18T20:40:15.854077+0000","last_peered":"2023-11-18T20:40:15.854077+0000","last_clean":"2023-11-18T20:40:15.854077+0000","last_became_active":"2023-11-18T20:40:14.834576+0000","last_became_peered":"2023-11-18T20:40:14.834576+0000","last_unstale":"2023-11-18T20:40:15.854077+0000","last_undegraded":"2023-11-18T20:40:15.854077+0000","last_fullsized":"2023-11-18T20:40:15.854077+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.353314+0000","last_change":"2023-11-18T20:40:15.348518+0000","last_active":"2023-11-18T20:40:15.353314+0000","last_peered":"2023-11-18T20:40:15.353314+0000","last_clean":"2023-11-18T20:40:15.353314+0000","last_became_active":"2023-11-18T20:40:15.348248+0000","last_became_peered":"2023-11-18T20:40:15.348248+0000","last_unstale":"2023-11-18T20:40:15.353314+0000","last_undegraded":"2023-11-18T20:40:15.353314+0000","last_fullsized":"2023-11-18T20:40:15.353314+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:44.689679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329316+0000","last_change":"2023-11-18T20:40:14.827087+0000","last_active":"2023-11-18T20:40:16.329316+0000","last_peered":"2023-11-18T20:40:16.329316+0000","last_clean":"2023-11-18T20:40:16.329316+0000","last_became_active":"2023-11-18T20:40:14.826756+0000","last_became_peered":"2023-11-18T20:40:14.826756+0000","last_unstale":"2023-11-18T20:40:16.329316+0000","last_undegraded":"2023-11-18T20:40:16.329316+0000","last_fullsized":"2023-11-18T20:40:16.329316+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:44:23.259634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366471+0000","last_change":"2023-11-18T20:40:15.363781+0000","last_active":"2023-11-18T20:40:15.366471+0000","last_peered":"2023-11-18T20:40:15.366471+0000","last_clean":"2023-11-18T20:40:15.366471+0000","last_became_active":"2023-11-18T20:40:15.363178+0000","last_became_peered":"2023-11-18T20:40:15.363178+0000","last_unstale":"2023-11-18T20:40:15.366471+0000","last_undegraded":"2023-11-18T20:40:15.366471+0000","last_fullsized":"2023-11-18T20:40:15.366471+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:21:20.621372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322041+0000","last_change":"2023-11-18T20:40:14.830237+0000","last_active":"2023-11-18T20:40:16.322041+0000","last_peered":"2023-11-18T20:40:16.322041+0000","last_clean":"2023-11-18T20:40:16.322041+0000","last_became_active":"2023-11-18T20:40:14.829895+0000","last_became_peered":"2023-11-18T20:40:14.829895+0000","last_unstale":"2023-11-18T20:40:16.322041+0000","last_undegraded":"2023-11-18T20:40:16.322041+0000","last_fullsized":"2023-11-18T20:40:16.322041+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664401+0000","last_change":"2023-11-18T20:40:15.346282+0000","last_active":"2023-11-18T20:40:17.664401+0000","last_peered":"2023-11-18T20:40:17.664401+0000","last_clean":"2023-11-18T20:40:17.664401+0000","last_became_active":"2023-11-18T20:40:15.345731+0000","last_became_peered":"2023-11-18T20:40:15.345731+0000","last_unstale":"2023-11-18T20:40:17.664401+0000","last_undegraded":"2023-11-18T20:40:17.664401+0000","last_fullsized":"2023-11-18T20:40:17.664401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:03.894891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.337645+0000","last_change":"2023-11-18T20:40:14.823740+0000","last_active":"2023-11-18T20:40:15.337645+0000","last_peered":"2023-11-18T20:40:15.337645+0000","last_clean":"2023-11-18T20:40:15.337645+0000","last_became_active":"2023-11-18T20:40:14.823071+0000","last_became_peered":"2023-11-18T20:40:14.823071+0000","last_unstale":"2023-11-18T20:40:15.337645+0000","last_undegraded":"2023-11-18T20:40:15.337645+0000","last_fullsized":"2023-11-18T20:40:15.337645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:30.638140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.328483+0000","last_change":"2023-11-18T20:40:15.345339+0000","last_active":"2023-11-18T20:40:16.328483+0000","last_peered":"2023-11-18T20:40:16.328483+0000","last_clean":"2023-11-18T20:40:16.328483+0000","last_became_active":"2023-11-18T20:40:15.345007+0000","last_became_peered":"2023-11-18T20:40:15.345007+0000","last_unstale":"2023-11-18T20:40:16.328483+0000","last_undegraded":"2023-11-18T20:40:16.328483+0000","last_fullsized":"2023-11-18T20:40:16.328483+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:30:28.760969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.347026+0000","last_change":"2023-11-18T20:40:14.833918+0000","last_active":"2023-11-18T20:40:15.347026+0000","last_peered":"2023-11-18T20:40:15.347026+0000","last_clean":"2023-11-18T20:40:15.347026+0000","last_became_active":"2023-11-18T20:40:14.833631+0000","last_became_peered":"2023-11-18T20:40:14.833631+0000","last_unstale":"2023-11-18T20:40:15.347026+0000","last_undegraded":"2023-11-18T20:40:15.347026+0000","last_fullsized":"2023-11-18T20:40:15.347026+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:42:45.782573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196773+0000","last_change":"2023-11-18T20:40:15.352662+0000","last_active":"2023-11-18T20:40:17.196773+0000","last_peered":"2023-11-18T20:40:17.196773+0000","last_clean":"2023-11-18T20:40:17.196773+0000","last_became_active":"2023-11-18T20:40:15.352389+0000","last_became_peered":"2023-11-18T20:40:15.352389+0000","last_unstale":"2023-11-18T20:40:17.196773+0000","last_undegraded":"2023-11-18T20:40:17.196773+0000","last_fullsized":"2023-11-18T20:40:17.196773+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:03.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.338163+0000","last_change":"2023-11-18T20:40:14.826072+0000","last_active":"2023-11-18T20:40:15.338163+0000","last_peered":"2023-11-18T20:40:15.338163+0000","last_clean":"2023-11-18T20:40:15.338163+0000","last_became_active":"2023-11-18T20:40:14.825599+0000","last_became_peered":"2023-11-18T20:40:14.825599+0000","last_unstale":"2023-11-18T20:40:15.338163+0000","last_undegraded":"2023-11-18T20:40:15.338163+0000","last_fullsized":"2023-11-18T20:40:15.338163+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:04.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663222+0000","last_change":"2023-11-18T20:40:15.352617+0000","last_active":"2023-11-18T20:40:17.663222+0000","last_peered":"2023-11-18T20:40:17.663222+0000","last_clean":"2023-11-18T20:40:17.663222+0000","last_became_active":"2023-11-18T20:40:15.350699+0000","last_became_peered":"2023-11-18T20:40:15.350699+0000","last_unstale":"2023-11-18T20:40:17.663222+0000","last_undegraded":"2023-11-18T20:40:17.663222+0000","last_fullsized":"2023-11-18T20:40:17.663222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:24.336068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.327819+0000","last_change":"2023-11-18T20:40:14.814908+0000","last_active":"2023-11-18T20:40:16.327819+0000","last_peered":"2023-11-18T20:40:16.327819+0000","last_clean":"2023-11-18T20:40:16.327819+0000","last_became_active":"2023-11-18T20:40:14.814486+0000","last_became_peered":"2023-11-18T20:40:14.814486+0000","last_unstale":"2023-11-18T20:40:16.327819+0000","last_undegraded":"2023-11-18T20:40:16.327819+0000","last_fullsized":"2023-11-18T20:40:16.327819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:10.795775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366435+0000","last_change":"2023-11-18T20:40:15.363267+0000","last_active":"2023-11-18T20:40:15.366435+0000","last_peered":"2023-11-18T20:40:15.366435+0000","last_clean":"2023-11-18T20:40:15.366435+0000","last_became_active":"2023-11-18T20:40:15.362302+0000","last_became_peered":"2023-11-18T20:40:15.362302+0000","last_unstale":"2023-11-18T20:40:15.366435+0000","last_undegraded":"2023-11-18T20:40:15.366435+0000","last_fullsized":"2023-11-18T20:40:15.366435+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:56.144908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663422+0000","last_change":"2023-11-18T20:40:14.830736+0000","last_active":"2023-11-18T20:40:17.663422+0000","last_peered":"2023-11-18T20:40:17.663422+0000","last_clean":"2023-11-18T20:40:17.663422+0000","last_became_active":"2023-11-18T20:40:14.830431+0000","last_became_peered":"2023-11-18T20:40:14.830431+0000","last_unstale":"2023-11-18T20:40:17.663422+0000","last_undegraded":"2023-11-18T20:40:17.663422+0000","last_fullsized":"2023-11-18T20:40:17.663422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:10:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663653+0000","last_change":"2023-11-18T20:40:15.355538+0000","last_active":"2023-11-18T20:40:17.663653+0000","last_peered":"2023-11-18T20:40:17.663653+0000","last_clean":"2023-11-18T20:40:17.663653+0000","last_became_active":"2023-11-18T20:40:15.355212+0000","last_became_peered":"2023-11-18T20:40:15.355212+0000","last_unstale":"2023-11-18T20:40:17.663653+0000","last_undegraded":"2023-11-18T20:40:17.663653+0000","last_fullsized":"2023-11-18T20:40:17.663653+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:15:19.819611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196729+0000","last_change":"2023-11-18T20:40:14.834678+0000","last_active":"2023-11-18T20:40:17.196729+0000","last_peered":"2023-11-18T20:40:17.196729+0000","last_clean":"2023-11-18T20:40:17.196729+0000","last_became_active":"2023-11-18T20:40:14.834152+0000","last_became_peered":"2023-11-18T20:40:14.834152+0000","last_unstale":"2023-11-18T20:40:17.196729+0000","last_undegraded":"2023-11-18T20:40:17.196729+0000","last_fullsized":"2023-11-18T20:40:17.196729+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:24:26.163852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.339884+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:40:15.339884+0000","last_peered":"2023-11-18T20:40:15.339884+0000","last_clean":"2023-11-18T20:40:15.339884+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:40:15.339884+0000","last_undegraded":"2023-11-18T20:40:15.339884+0000","last_fullsized":"2023-11-18T20:40:15.339884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542176,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":276337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.046,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0900000000000001,"15min":1.0940000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.0149999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.2110000000000001,"15min":1.214},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.599,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6180000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1180000000000001,"15min":1.1240000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.613,"15min":1.613},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0950000000000002,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.431}]},{"osd":3,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2490000000000001,"15min":1.244},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.661,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.4470000000000001,"15min":1.4550000000000001},"min":{"1min":0.95999999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8939999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.5389999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.577,"15min":1.5880000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":2.0750000000000002,"5min":2.601,"15min":2.601},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.542,"15min":1.554},"min":{"1min":1.135,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.883,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.96999999999999997}]},{"osd":5,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.6160000000000001,"15min":1.6259999999999999},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.218,"5min":3.02,"15min":3.02},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.728,"15min":1.7410000000000001},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":2.1640000000000001,"5min":3.488,"15min":3.488},"last":1.27}]},{"osd":6,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":1.7749999999999999,"15min":1.782},"min":{"1min":1.202,"5min":1.202,"15min":1.202},"max":{"1min":2.2290000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.7290000000000001,"15min":1.7470000000000001},"min":{"1min":1.1499999999999999,"5min":1.075,"15min":1.075},"max":{"1min":2.302,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.415}]}]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":659456,"data_stored":282567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.60899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.05},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":0.98099999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.995,"15min":0.998},"min":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.282},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.78600000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6399999999999999,"5min":1.653,"15min":1.653},"last":1.1890000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.163,"15min":1.1739999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4750000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.375},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2310000000000001,"15min":1.234},"min":{"1min":0.82099999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.744,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3340000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3220000000000001,"15min":1.341},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7130000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.218},{"interface":"front","average":{"1min":1.139,"5min":1.1830000000000001,"15min":1.1910000000000001},"min":{"1min":0.82899999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.4470000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3600000000000001,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.3700000000000001,"15min":1.373},"min":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7909999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.48}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3140000000000001,"15min":1.3109999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.847,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.534,"15min":1.5289999999999999},"min":{"1min":1.127,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.536}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.5509999999999999,"15min":1.5569999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9379999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.722},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.6379999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1241088,"data_stored":866647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.84199999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5640000000000001,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.1299999999999999,"15min":1.1140000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5780000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.81200000000000006,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3080000000000001,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.5580000000000001,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.359}]},{"osd":2,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.375,"15min":1.3999999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6259999999999999,"5min":2.004,"15min":2.004},"last":1.111},{"interface":"front","average":{"1min":1.25,"5min":1.214,"15min":1.208},"min":{"1min":0.78900000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.627,"5min":2.214,"15min":2.214},"last":1.048}]},{"osd":3,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.4850000000000001,"15min":1.5069999999999999},"min":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.958,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.534},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4590000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.827,"5min":2.024,"15min":2.024},"last":1.762}]},{"osd":4,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3959999999999999,"15min":1.4079999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0470000000000002,"5min":2.359,"15min":2.359},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.496,"5min":1.5069999999999999,"15min":1.5089999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.802}]},{"osd":6,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.645,"15min":1.667},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1720000000000002,"5min":2.181,"15min":2.181},"last":1.288},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5980000000000001,"15min":1.615},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.109,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.4410000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6619999999999999,"15min":1.671},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.629},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.746,"15min":1.7609999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.8480000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542176,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":276861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4850000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.95599999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1080000000000001,"15min":1.0900000000000001},"min":{"1min":0.73599999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.208,"15min":1.2350000000000001},"min":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4810000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.048}]},{"osd":2,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6040000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.377,"15min":1.407},"min":{"1min":0.81699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.601,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.081}]},{"osd":3,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.212,"15min":1.224},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.4370000000000001,"5min":1.823,"15min":1.823},"last":1.139},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.472,"15min":1.502},"min":{"1min":0.84699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.78,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.466}]},{"osd":5,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4490000000000001,"15min":1.4610000000000001},"min":{"1min":1.0680000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.843,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4410000000000001,"15min":1.4630000000000001},"min":{"1min":1.073,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5549999999999999,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.2290000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5489999999999999,"15min":1.5609999999999999},"min":{"1min":1.0489999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.893,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.615},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.605,"15min":1.617},"min":{"1min":1.2210000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.952,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.401}]},{"osd":7,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.4790000000000001,"15min":1.478},"min":{"1min":1.244,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.843,"5min":1.929,"15min":1.929},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.635,"5min":1.6459999999999999,"15min":1.6479999999999999},"min":{"1min":1.234,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5549999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542177,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":659456,"data_stored":282635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.432,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93400000000000005,"15min":0.93300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.84999999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.05,"15min":1.0600000000000001},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.9450000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.89200000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1599999999999999,"15min":1.1559999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.288},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1599999999999999,"15min":1.1559999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.167}]},{"osd":5,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2410000000000001,"15min":1.2390000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8979999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.024},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.8520000000000001,"5min":1.901,"15min":1.901},"last":1.4299999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2649999999999999,"15min":1.262},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.2629999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.349},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.327,"15min":1.319},"min":{"1min":0.88500000000000001,"5min":0.754,"15min":0.754},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.115}]}]},{"osd":2,"up_from":14,"seq":60129542176,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":278017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.256,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.875},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":1.0389999999999999},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.367,"5min":2.081,"15min":2.081},"last":0.97599999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":0.85999999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2769999999999999,"5min":1.919,"15min":1.919},"last":1.014},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.84399999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.204}]},{"osd":3,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.085,"15min":1.1060000000000001},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4419999999999999,"5min":2.024,"15min":2.024},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.04,"15min":1.046},"min":{"1min":0.52500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5620000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.94899999999999995}]},{"osd":4,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.3140000000000001,"15min":1.3320000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.1659999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.244},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6839999999999999,"5min":2.254,"15min":2.254},"last":1.0369999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3109999999999999,"15min":1.323},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9419999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.292},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.425,"15min":1.4490000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5569999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.675}]},{"osd":6,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4359999999999999,"15min":1.462},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.0030000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3069999999999999,"15min":1.327},"min":{"1min":0.82299999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2189999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.339}]},{"osd":7,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.4450000000000001,"15min":1.4670000000000001},"min":{"1min":0.85999999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8600000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0950000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.5289999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1253376,"data_stored":873495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.88700000000000001,"15min":0.90800000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.371,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.874},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.194,"5min":1.524,"15min":1.524},"last":1.288}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2290000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0349999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4730000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5589999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.111},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.115,"15min":1.129},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.595,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0620000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.206,"15min":1.22},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4199999999999999,"5min":1.927,"15min":1.927},"last":1.202},{"interface":"front","average":{"1min":1.258,"5min":1.4099999999999999,"15min":1.4350000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.619,"5min":3.343,"15min":3.343},"last":1.3089999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.4390000000000001,"15min":1.484},"min":{"1min":0.876,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.5429999999999999,"5min":3.206,"15min":3.206},"last":1.232},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.387,"15min":1.401},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6519999999999999,"5min":2.165,"15min":2.165},"last":1.444}]},{"osd":6,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.681,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.25},{"interface":"front","average":{"1min":1.331,"5min":1.5580000000000001,"15min":1.5960000000000001},"min":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.754,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.397}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.575,"15min":1.617},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.843,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.4430000000000001,"15min":1.4530000000000001},"min":{"1min":0.81399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.306,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.327}]}]},{"osd":0,"up_from":14,"seq":60129542176,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":277857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2390000000000001,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.347},{"interface":"front","average":{"1min":0.75,"5min":0.97399999999999998,"15min":1.0109999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.234}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.5529999999999999,"15min":1.663},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.331,"5min":14.169,"15min":14.169},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93000000000000005,"15min":0.94299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.133}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":1.506,"15min":1.6080000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2989999999999999,"5min":11.629,"15min":11.629},"last":1.47},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.351,"15min":1.413},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6459999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.524}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.4119999999999999,"15min":1.4410000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4119999999999999,"15min":1.423},"min":{"1min":0.90400000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.446}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.5589999999999999,"15min":1.625},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.659,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.71},{"interface":"front","average":{"1min":1.27,"5min":1.6180000000000001,"15min":1.6759999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.736,"5min":6.202,"15min":6.202},"last":1.627}]},{"osd":6,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4710000000000001,"15min":1.472},"min":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":5.085,"5min":5.085,"15min":5.085},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.6739999999999999,"15min":1.744},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7210000000000001,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.831}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.5820000000000001,"15min":1.6439999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.601,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.7310000000000001,"15min":1.798},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.6899999999999999,"5min":6.149,"15min":6.149},"last":1.8}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:40:20.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:40:20.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.532+0000 7f5b23316640 1 Processor -- start 2023-11-18T20:40:20.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.532+0000 7f5b23316640 1 -- start start 2023-11-18T20:40:20.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.533+0000 7f5b23316640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c06d0a0 0x7f5b1c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.533+0000 7f5b23316640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b1c0c3ea0 0x7f5b1c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.533+0000 7f5b23316640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c0c64a0 con 0x7f5b1c14fd30 2023-11-18T20:40:20.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.533+0000 7f5b23316640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c0c5c00 con 0x7f5b1c0c3ea0 2023-11-18T20:40:20.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.533+0000 7f5b23316640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0c5ee0 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.534+0000 7f5b218b3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b1c0c3ea0 0x7f5b1c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.534+0000 7f5b208b1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c06d0a0 0x7f5b1c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.534+0000 7f5b218b3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b1c0c3ea0 0x7f5b1c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:36428/0 (socket says 172.21.15.132:36428) 2023-11-18T20:40:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.534+0000 7f5b218b3640 1 -- 172.21.15.132:0/3812856464 learned_addr learned my addr 172.21.15.132:0/3812856464 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.535+0000 7f5b218b3640 1 -- 172.21.15.132:0/3812856464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c06d0a0 msgr2=0x7f5b1c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.535+0000 7f5b218b3640 1 --2- 172.21.15.132:0/3812856464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c06d0a0 0x7f5b1c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.535+0000 7f5b218b3640 1 -- 172.21.15.132:0/3812856464 >> v1:172.21.15.161:6789/0 conn(0x7f5b1c14fd30 legacy=0x7f5b1c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.535+0000 7f5b218b3640 1 -- 172.21.15.132:0/3812856464 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0c61c0 con 0x7f5b1c0c3ea0 2023-11-18T20:40:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.536+0000 7f5b218b3640 1 --2- 172.21.15.132:0/3812856464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 0x7f5b1c0c4330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009e50 tx=0x7f5b1402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed902e2b735160e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:20.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.537+0000 7f5b13fff640 1 -- 172.21.15.132:0/3812856464 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1402cb00 con 0x7f5b1c0c3ea0 2023-11-18T20:40:20.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.537+0000 7f5b13fff640 1 -- 172.21.15.132:0/3812856464 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1402cc60 con 0x7f5b1c0c3ea0 2023-11-18T20:40:20.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.537+0000 7f5b13fff640 1 -- 172.21.15.132:0/3812856464 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140343f0 con 0x7f5b1c0c3ea0 2023-11-18T20:40:20.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.538+0000 7f5b23316640 1 -- 172.21.15.132:0/3812856464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 msgr2=0x7f5b1c0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.538+0000 7f5b23316640 1 --2- 172.21.15.132:0/3812856464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 0x7f5b1c0c4330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009e50 tx=0x7f5b1402bf60 comp rx=0 tx=0).stop 2023-11-18T20:40:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.538+0000 7f5b23316640 1 -- 172.21.15.132:0/3812856464 shutdown_connections 2023-11-18T20:40:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.538+0000 7f5b23316640 1 --2- 172.21.15.132:0/3812856464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 0x7f5b1c0c4330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.538+0000 7f5b23316640 1 --2- 172.21.15.132:0/3812856464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c06d0a0 0x7f5b1c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.538+0000 7f5b23316640 1 -- 172.21.15.132:0/3812856464 >> 172.21.15.132:0/3812856464 conn(0x7f5b1c06a500 msgr2=0x7f5b1c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.538+0000 7f5b23316640 1 -- 172.21.15.132:0/3812856464 shutdown_connections 2023-11-18T20:40:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.538+0000 7f5b23316640 1 -- 172.21.15.132:0/3812856464 wait complete. 2023-11-18T20:40:20.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.540+0000 7f5b23316640 1 Processor -- start 2023-11-18T20:40:20.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.540+0000 7f5b23316640 1 -- start start 2023-11-18T20:40:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b23316640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b1c06d0a0 0x7f5b1c0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b23316640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 0x7f5b1c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b23316640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c14fd30 0x7f5b1c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b23316640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c1eaf00 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b23316640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c1561d0 con 0x7f5b1c0c3ea0 2023-11-18T20:40:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b23316640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c1564b0 con 0x7f5b1c14fd30 2023-11-18T20:40:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b210b2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b1c06d0a0 0x7f5b1c0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b210b2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b1c06d0a0 0x7f5b1c0bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39166/0 (socket says 172.21.15.132:39166) 2023-11-18T20:40:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b210b2640 1 -- 172.21.15.132:0/4169798679 learned_addr learned my addr 172.21.15.132:0/4169798679 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b208b1640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 0x7f5b1c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b218b3640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c14fd30 0x7f5b1c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b210b2640 1 -- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c14fd30 msgr2=0x7f5b1c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b210b2640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c14fd30 0x7f5b1c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b210b2640 1 -- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 msgr2=0x7f5b1c154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b210b2640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 0x7f5b1c154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b210b2640 1 -- 172.21.15.132:0/4169798679 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14009b30 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.541+0000 7f5b218b3640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c14fd30 0x7f5b1c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.542+0000 7f5b210b2640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b1c06d0a0 0x7f5b1c0bf360 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800c400 tx=0x7f5b1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.542+0000 7f5b11ffb640 1 -- 172.21.15.132:0/4169798679 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180052d0 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.542+0000 7f5b11ffb640 1 -- 172.21.15.132:0/4169798679 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18005450 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.542+0000 7f5b11ffb640 1 -- 172.21.15.132:0/4169798679 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b18007260 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.542+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c1dbc70 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.542+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c0bf8a0 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.543+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c1dc190 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.544+0000 7f5b11ffb640 1 -- 172.21.15.132:0/4169798679 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b180073c0 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.545+0000 7f5b11ffb640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b0006ae70 0x7f5b0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.545+0000 7f5b11ffb640 1 -- 172.21.15.132:0/4169798679 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b18088aa0 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.546+0000 7f5b208b1640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b0006ae70 0x7f5b0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.547+0000 7f5b208b1640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b0006ae70 0x7f5b0006d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c1ee540 tx=0x7f5b0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:20.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.550+0000 7f5b11ffb640 1 -- 172.21.15.132:0/4169798679 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b18053ab0 con 0x7f5b1c06d0a0 2023-11-18T20:40:20.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.738+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b1c072980 con 0x7f5b0006ae70 2023-11-18T20:40:20.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.761+0000 7f5b11ffb640 1 -- 172.21.15.132:0/4169798679 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286855 (secure 0 0 0) 0x7f5b0c0118b0 con 0x7f5b0006ae70 2023-11-18T20:40:20.766 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:20.768 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:40:20.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b0006ae70 msgr2=0x7f5b0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b0006ae70 0x7f5b0006d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c1ee540 tx=0x7f5b0c008040 comp rx=0 tx=0).stop 2023-11-18T20:40:20.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b1c06d0a0 msgr2=0x7f5b1c0bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:20.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b1c06d0a0 0x7f5b1c0bf360 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800c400 tx=0x7f5b1800c8c0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 shutdown_connections 2023-11-18T20:40:20.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5b0006ae70 0x7f5b0006d330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c14fd30 0x7f5b1c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c0c3ea0 0x7f5b1c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 --2- 172.21.15.132:0/4169798679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b1c06d0a0 0x7f5b1c0bf360 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:20.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 >> 172.21.15.132:0/4169798679 conn(0x7f5b1c06a500 msgr2=0x7f5b1c152120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:20.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 shutdown_connections 2023-11-18T20:40:20.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:20.768+0000 7f5b23316640 1 -- 172.21.15.132:0/4169798679 wait complete. 2023-11-18T20:40:20.789 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-11-18T20:40:20.689761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230800,"kb_used_data":6284,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743920,"statfs":{"total":773094113280,"available":772857774080,"internally_reserved":0,"allocated":6434816,"data_stored":3414416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002190"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329485+0000","last_change":"2023-11-18T20:40:15.353470+0000","last_active":"2023-11-18T20:40:16.329485+0000","last_peered":"2023-11-18T20:40:16.329485+0000","last_clean":"2023-11-18T20:40:16.329485+0000","last_became_active":"2023-11-18T20:40:15.353123+0000","last_became_peered":"2023-11-18T20:40:15.353123+0000","last_unstale":"2023-11-18T20:40:16.329485+0000","last_undegraded":"2023-11-18T20:40:16.329485+0000","last_fullsized":"2023-11-18T20:40:16.329485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:17:38.972740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366569+0000","last_change":"2023-11-18T20:40:15.364843+0000","last_active":"2023-11-18T20:40:15.366569+0000","last_peered":"2023-11-18T20:40:15.366569+0000","last_clean":"2023-11-18T20:40:15.366569+0000","last_became_active":"2023-11-18T20:40:15.364551+0000","last_became_peered":"2023-11-18T20:40:15.364551+0000","last_unstale":"2023-11-18T20:40:15.366569+0000","last_undegraded":"2023-11-18T20:40:15.366569+0000","last_fullsized":"2023-11-18T20:40:15.366569+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:42:16.967079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.351367+0000","last_change":"2023-11-18T20:40:15.345424+0000","last_active":"2023-11-18T20:40:15.351367+0000","last_peered":"2023-11-18T20:40:15.351367+0000","last_clean":"2023-11-18T20:40:15.351367+0000","last_became_active":"2023-11-18T20:40:15.344537+0000","last_became_peered":"2023-11-18T20:40:15.344537+0000","last_unstale":"2023-11-18T20:40:15.351367+0000","last_undegraded":"2023-11-18T20:40:15.351367+0000","last_fullsized":"2023-11-18T20:40:15.351367+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:24:27.178244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326231+0000","last_change":"2023-11-18T20:40:15.356657+0000","last_active":"2023-11-18T20:40:16.326231+0000","last_peered":"2023-11-18T20:40:16.326231+0000","last_clean":"2023-11-18T20:40:16.326231+0000","last_became_active":"2023-11-18T20:40:15.356417+0000","last_became_peered":"2023-11-18T20:40:15.356417+0000","last_unstale":"2023-11-18T20:40:16.326231+0000","last_undegraded":"2023-11-18T20:40:16.326231+0000","last_fullsized":"2023-11-18T20:40:16.326231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:07:05.628953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.328726+0000","last_change":"2023-11-18T20:40:15.343983+0000","last_active":"2023-11-18T20:40:16.328726+0000","last_peered":"2023-11-18T20:40:16.328726+0000","last_clean":"2023-11-18T20:40:16.328726+0000","last_became_active":"2023-11-18T20:40:15.343720+0000","last_became_peered":"2023-11-18T20:40:15.343720+0000","last_unstale":"2023-11-18T20:40:16.328726+0000","last_undegraded":"2023-11-18T20:40:16.328726+0000","last_fullsized":"2023-11-18T20:40:16.328726+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:56:02.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.328330+0000","last_change":"2023-11-18T20:40:15.350938+0000","last_active":"2023-11-18T20:40:16.328330+0000","last_peered":"2023-11-18T20:40:16.328330+0000","last_clean":"2023-11-18T20:40:16.328330+0000","last_became_active":"2023-11-18T20:40:15.350551+0000","last_became_peered":"2023-11-18T20:40:15.350551+0000","last_unstale":"2023-11-18T20:40:16.328330+0000","last_undegraded":"2023-11-18T20:40:16.328330+0000","last_fullsized":"2023-11-18T20:40:16.328330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:32.423699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325723+0000","last_change":"2023-11-18T20:40:15.349771+0000","last_active":"2023-11-18T20:40:16.325723+0000","last_peered":"2023-11-18T20:40:16.325723+0000","last_clean":"2023-11-18T20:40:16.325723+0000","last_became_active":"2023-11-18T20:40:15.349537+0000","last_became_peered":"2023-11-18T20:40:15.349537+0000","last_unstale":"2023-11-18T20:40:16.325723+0000","last_undegraded":"2023-11-18T20:40:16.325723+0000","last_fullsized":"2023-11-18T20:40:16.325723+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:24:36.093151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663175+0000","last_change":"2023-11-18T20:40:15.348439+0000","last_active":"2023-11-18T20:40:17.663175+0000","last_peered":"2023-11-18T20:40:17.663175+0000","last_clean":"2023-11-18T20:40:17.663175+0000","last_became_active":"2023-11-18T20:40:15.348132+0000","last_became_peered":"2023-11-18T20:40:15.348132+0000","last_unstale":"2023-11-18T20:40:17.663175+0000","last_undegraded":"2023-11-18T20:40:17.663175+0000","last_fullsized":"2023-11-18T20:40:17.663175+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:15:18.987033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322183+0000","last_change":"2023-11-18T20:40:15.353406+0000","last_active":"2023-11-18T20:40:16.322183+0000","last_peered":"2023-11-18T20:40:16.322183+0000","last_clean":"2023-11-18T20:40:16.322183+0000","last_became_active":"2023-11-18T20:40:15.353034+0000","last_became_peered":"2023-11-18T20:40:15.353034+0000","last_unstale":"2023-11-18T20:40:16.322183+0000","last_undegraded":"2023-11-18T20:40:16.322183+0000","last_fullsized":"2023-11-18T20:40:16.322183+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:20:37.917813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329023+0000","last_change":"2023-11-18T20:40:15.342874+0000","last_active":"2023-11-18T20:40:16.329023+0000","last_peered":"2023-11-18T20:40:16.329023+0000","last_clean":"2023-11-18T20:40:16.329023+0000","last_became_active":"2023-11-18T20:40:15.342588+0000","last_became_peered":"2023-11-18T20:40:15.342588+0000","last_unstale":"2023-11-18T20:40:16.329023+0000","last_undegraded":"2023-11-18T20:40:16.329023+0000","last_fullsized":"2023-11-18T20:40:16.329023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:25:23.165385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.346454+0000","last_change":"2023-11-18T20:40:15.340398+0000","last_active":"2023-11-18T20:40:15.346454+0000","last_peered":"2023-11-18T20:40:15.346454+0000","last_clean":"2023-11-18T20:40:15.346454+0000","last_became_active":"2023-11-18T20:40:15.340055+0000","last_became_peered":"2023-11-18T20:40:15.340055+0000","last_unstale":"2023-11-18T20:40:15.346454+0000","last_undegraded":"2023-11-18T20:40:15.346454+0000","last_fullsized":"2023-11-18T20:40:15.346454+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:11.392335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322214+0000","last_change":"2023-11-18T20:40:15.344623+0000","last_active":"2023-11-18T20:40:16.322214+0000","last_peered":"2023-11-18T20:40:16.322214+0000","last_clean":"2023-11-18T20:40:16.322214+0000","last_became_active":"2023-11-18T20:40:15.344216+0000","last_became_peered":"2023-11-18T20:40:15.344216+0000","last_unstale":"2023-11-18T20:40:16.322214+0000","last_undegraded":"2023-11-18T20:40:16.322214+0000","last_fullsized":"2023-11-18T20:40:16.322214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:53.802513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196510+0000","last_change":"2023-11-18T20:40:15.352260+0000","last_active":"2023-11-18T20:40:17.196510+0000","last_peered":"2023-11-18T20:40:17.196510+0000","last_clean":"2023-11-18T20:40:17.196510+0000","last_became_active":"2023-11-18T20:40:15.351965+0000","last_became_peered":"2023-11-18T20:40:15.351965+0000","last_unstale":"2023-11-18T20:40:17.196510+0000","last_undegraded":"2023-11-18T20:40:17.196510+0000","last_fullsized":"2023-11-18T20:40:17.196510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:11.392335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.353328+0000","last_change":"2023-11-18T20:40:15.348662+0000","last_active":"2023-11-18T20:40:15.353328+0000","last_peered":"2023-11-18T20:40:15.353328+0000","last_clean":"2023-11-18T20:40:15.353328+0000","last_became_active":"2023-11-18T20:40:15.348091+0000","last_became_peered":"2023-11-18T20:40:15.348091+0000","last_unstale":"2023-11-18T20:40:15.353328+0000","last_undegraded":"2023-11-18T20:40:15.353328+0000","last_fullsized":"2023-11-18T20:40:15.353328+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:11.392335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196448+0000","last_change":"2023-11-18T20:40:15.356747+0000","last_active":"2023-11-18T20:40:17.196448+0000","last_peered":"2023-11-18T20:40:17.196448+0000","last_clean":"2023-11-18T20:40:17.196448+0000","last_became_active":"2023-11-18T20:40:15.356448+0000","last_became_peered":"2023-11-18T20:40:15.356448+0000","last_unstale":"2023-11-18T20:40:17.196448+0000","last_undegraded":"2023-11-18T20:40:17.196448+0000","last_fullsized":"2023-11-18T20:40:17.196448+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:44.689679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.327692+0000","last_change":"2023-11-18T20:40:15.349839+0000","last_active":"2023-11-18T20:40:16.327692+0000","last_peered":"2023-11-18T20:40:16.327692+0000","last_clean":"2023-11-18T20:40:16.327692+0000","last_became_active":"2023-11-18T20:40:15.349526+0000","last_became_peered":"2023-11-18T20:40:15.349526+0000","last_unstale":"2023-11-18T20:40:16.327692+0000","last_undegraded":"2023-11-18T20:40:16.327692+0000","last_fullsized":"2023-11-18T20:40:16.327692+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:54:40.657646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329600+0000","last_change":"2023-11-18T20:40:15.356534+0000","last_active":"2023-11-18T20:40:16.329600+0000","last_peered":"2023-11-18T20:40:16.329600+0000","last_clean":"2023-11-18T20:40:16.329600+0000","last_became_active":"2023-11-18T20:40:15.356211+0000","last_became_peered":"2023-11-18T20:40:15.356211+0000","last_unstale":"2023-11-18T20:40:16.329600+0000","last_undegraded":"2023-11-18T20:40:16.329600+0000","last_fullsized":"2023-11-18T20:40:16.329600+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:49.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358560+0000","last_change":"2023-11-18T20:40:15.357082+0000","last_active":"2023-11-18T20:40:15.358560+0000","last_peered":"2023-11-18T20:40:15.358560+0000","last_clean":"2023-11-18T20:40:15.358560+0000","last_became_active":"2023-11-18T20:40:15.356757+0000","last_became_peered":"2023-11-18T20:40:15.356757+0000","last_unstale":"2023-11-18T20:40:15.358560+0000","last_undegraded":"2023-11-18T20:40:15.358560+0000","last_fullsized":"2023-11-18T20:40:15.358560+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:12.691580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366395+0000","last_change":"2023-11-18T20:40:15.363178+0000","last_active":"2023-11-18T20:40:15.366395+0000","last_peered":"2023-11-18T20:40:15.366395+0000","last_clean":"2023-11-18T20:40:15.366395+0000","last_became_active":"2023-11-18T20:40:15.362454+0000","last_became_peered":"2023-11-18T20:40:15.362454+0000","last_unstale":"2023-11-18T20:40:15.366395+0000","last_undegraded":"2023-11-18T20:40:15.366395+0000","last_fullsized":"2023-11-18T20:40:15.366395+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:18.839789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.351282+0000","last_change":"2023-11-18T20:40:15.348980+0000","last_active":"2023-11-18T20:40:15.351282+0000","last_peered":"2023-11-18T20:40:15.351282+0000","last_clean":"2023-11-18T20:40:15.351282+0000","last_became_active":"2023-11-18T20:40:15.348714+0000","last_became_peered":"2023-11-18T20:40:15.348714+0000","last_unstale":"2023-11-18T20:40:15.351282+0000","last_undegraded":"2023-11-18T20:40:15.351282+0000","last_fullsized":"2023-11-18T20:40:15.351282+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:03.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196621+0000","last_change":"2023-11-18T20:40:15.349389+0000","last_active":"2023-11-18T20:40:17.196621+0000","last_peered":"2023-11-18T20:40:17.196621+0000","last_clean":"2023-11-18T20:40:17.196621+0000","last_became_active":"2023-11-18T20:40:15.348893+0000","last_became_peered":"2023-11-18T20:40:15.348893+0000","last_unstale":"2023-11-18T20:40:17.196621+0000","last_undegraded":"2023-11-18T20:40:17.196621+0000","last_fullsized":"2023-11-18T20:40:17.196621+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:40.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.361614+0000","last_change":"2023-11-18T20:40:15.357261+0000","last_active":"2023-11-18T20:40:15.361614+0000","last_peered":"2023-11-18T20:40:15.361614+0000","last_clean":"2023-11-18T20:40:15.361614+0000","last_became_active":"2023-11-18T20:40:15.356930+0000","last_became_peered":"2023-11-18T20:40:15.356930+0000","last_unstale":"2023-11-18T20:40:15.361614+0000","last_undegraded":"2023-11-18T20:40:15.361614+0000","last_fullsized":"2023-11-18T20:40:15.361614+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:40.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325775+0000","last_change":"2023-11-18T20:40:15.357312+0000","last_active":"2023-11-18T20:40:16.325775+0000","last_peered":"2023-11-18T20:40:16.325775+0000","last_clean":"2023-11-18T20:40:16.325775+0000","last_became_active":"2023-11-18T20:40:15.355941+0000","last_became_peered":"2023-11-18T20:40:15.355941+0000","last_unstale":"2023-11-18T20:40:16.325775+0000","last_undegraded":"2023-11-18T20:40:16.325775+0000","last_fullsized":"2023-11-18T20:40:16.325775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:58:33.591767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.321949+0000","last_change":"2023-11-18T20:40:15.352149+0000","last_active":"2023-11-18T20:40:16.321949+0000","last_peered":"2023-11-18T20:40:16.321949+0000","last_clean":"2023-11-18T20:40:16.321949+0000","last_became_active":"2023-11-18T20:40:15.351873+0000","last_became_peered":"2023-11-18T20:40:15.351873+0000","last_unstale":"2023-11-18T20:40:16.321949+0000","last_undegraded":"2023-11-18T20:40:16.321949+0000","last_fullsized":"2023-11-18T20:40:16.321949+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:18.839789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366426+0000","last_change":"2023-11-18T20:40:15.363235+0000","last_active":"2023-11-18T20:40:15.366426+0000","last_peered":"2023-11-18T20:40:15.366426+0000","last_clean":"2023-11-18T20:40:15.366426+0000","last_became_active":"2023-11-18T20:40:15.361152+0000","last_became_peered":"2023-11-18T20:40:15.361152+0000","last_unstale":"2023-11-18T20:40:15.366426+0000","last_undegraded":"2023-11-18T20:40:15.366426+0000","last_fullsized":"2023-11-18T20:40:15.366426+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:47:53.154785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196851+0000","last_change":"2023-11-18T20:40:15.341577+0000","last_active":"2023-11-18T20:40:17.196851+0000","last_peered":"2023-11-18T20:40:17.196851+0000","last_clean":"2023-11-18T20:40:17.196851+0000","last_became_active":"2023-11-18T20:40:15.341217+0000","last_became_peered":"2023-11-18T20:40:15.341217+0000","last_unstale":"2023-11-18T20:40:17.196851+0000","last_undegraded":"2023-11-18T20:40:17.196851+0000","last_fullsized":"2023-11-18T20:40:17.196851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:12.691580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366513+0000","last_change":"2023-11-18T20:40:15.364215+0000","last_active":"2023-11-18T20:40:15.366513+0000","last_peered":"2023-11-18T20:40:15.366513+0000","last_clean":"2023-11-18T20:40:15.366513+0000","last_became_active":"2023-11-18T20:40:15.363880+0000","last_became_peered":"2023-11-18T20:40:15.363880+0000","last_unstale":"2023-11-18T20:40:15.366513+0000","last_undegraded":"2023-11-18T20:40:15.366513+0000","last_fullsized":"2023-11-18T20:40:15.366513+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:18:39.504225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663896+0000","last_change":"2023-11-18T20:40:15.353818+0000","last_active":"2023-11-18T20:40:17.663896+0000","last_peered":"2023-11-18T20:40:17.663896+0000","last_clean":"2023-11-18T20:40:17.663896+0000","last_became_active":"2023-11-18T20:40:15.352248+0000","last_became_peered":"2023-11-18T20:40:15.352248+0000","last_unstale":"2023-11-18T20:40:17.663896+0000","last_undegraded":"2023-11-18T20:40:17.663896+0000","last_fullsized":"2023-11-18T20:40:17.663896+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:26:51.505142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663394+0000","last_change":"2023-11-18T20:40:15.354009+0000","last_active":"2023-11-18T20:40:17.663394+0000","last_peered":"2023-11-18T20:40:17.663394+0000","last_clean":"2023-11-18T20:40:17.663394+0000","last_became_active":"2023-11-18T20:40:15.352886+0000","last_became_peered":"2023-11-18T20:40:15.352886+0000","last_unstale":"2023-11-18T20:40:17.663394+0000","last_undegraded":"2023-11-18T20:40:17.663394+0000","last_fullsized":"2023-11-18T20:40:17.663394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:23.691704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325978+0000","last_change":"2023-11-18T20:40:15.342034+0000","last_active":"2023-11-18T20:40:16.325978+0000","last_peered":"2023-11-18T20:40:16.325978+0000","last_clean":"2023-11-18T20:40:16.325978+0000","last_became_active":"2023-11-18T20:40:15.341779+0000","last_became_peered":"2023-11-18T20:40:15.341779+0000","last_unstale":"2023-11-18T20:40:16.325978+0000","last_undegraded":"2023-11-18T20:40:16.325978+0000","last_fullsized":"2023-11-18T20:40:16.325978+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:13.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.364679+0000","last_change":"2023-11-18T20:40:15.356706+0000","last_active":"2023-11-18T20:40:15.364679+0000","last_peered":"2023-11-18T20:40:15.364679+0000","last_clean":"2023-11-18T20:40:15.364679+0000","last_became_active":"2023-11-18T20:40:15.356386+0000","last_became_peered":"2023-11-18T20:40:15.356386+0000","last_unstale":"2023-11-18T20:40:15.364679+0000","last_undegraded":"2023-11-18T20:40:15.364679+0000","last_fullsized":"2023-11-18T20:40:15.364679+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:55.872396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.356094+0000","last_change":"2023-11-18T20:40:15.352408+0000","last_active":"2023-11-18T20:40:15.356094+0000","last_peered":"2023-11-18T20:40:15.356094+0000","last_clean":"2023-11-18T20:40:15.356094+0000","last_became_active":"2023-11-18T20:40:15.351996+0000","last_became_peered":"2023-11-18T20:40:15.351996+0000","last_unstale":"2023-11-18T20:40:15.356094+0000","last_undegraded":"2023-11-18T20:40:15.356094+0000","last_fullsized":"2023-11-18T20:40:15.356094+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:12.691580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329203+0000","last_change":"2023-11-18T20:40:15.347869+0000","last_active":"2023-11-18T20:40:16.329203+0000","last_peered":"2023-11-18T20:40:16.329203+0000","last_clean":"2023-11-18T20:40:16.329203+0000","last_became_active":"2023-11-18T20:40:15.346533+0000","last_became_peered":"2023-11-18T20:40:15.346533+0000","last_unstale":"2023-11-18T20:40:16.329203+0000","last_undegraded":"2023-11-18T20:40:16.329203+0000","last_fullsized":"2023-11-18T20:40:16.329203+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:48.046712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.854796+0000","last_change":"2023-11-18T20:40:14.825864+0000","last_active":"2023-11-18T20:40:15.854796+0000","last_peered":"2023-11-18T20:40:15.854796+0000","last_clean":"2023-11-18T20:40:15.854796+0000","last_became_active":"2023-11-18T20:40:14.824070+0000","last_became_peered":"2023-11-18T20:40:14.824070+0000","last_unstale":"2023-11-18T20:40:15.854796+0000","last_undegraded":"2023-11-18T20:40:15.854796+0000","last_fullsized":"2023-11-18T20:40:15.854796+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:43.675287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329707+0000","last_change":"2023-11-18T20:40:15.351630+0000","last_active":"2023-11-18T20:40:16.329707+0000","last_peered":"2023-11-18T20:40:16.329707+0000","last_clean":"2023-11-18T20:40:16.329707+0000","last_became_active":"2023-11-18T20:40:15.351258+0000","last_became_peered":"2023-11-18T20:40:15.351258+0000","last_unstale":"2023-11-18T20:40:16.329707+0000","last_undegraded":"2023-11-18T20:40:16.329707+0000","last_fullsized":"2023-11-18T20:40:16.329707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:14.293907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.846268+0000","last_change":"2023-11-18T20:40:14.833864+0000","last_active":"2023-11-18T20:40:15.846268+0000","last_peered":"2023-11-18T20:40:15.846268+0000","last_clean":"2023-11-18T20:40:15.846268+0000","last_became_active":"2023-11-18T20:40:14.833570+0000","last_became_peered":"2023-11-18T20:40:14.833570+0000","last_unstale":"2023-11-18T20:40:15.846268+0000","last_undegraded":"2023-11-18T20:40:15.846268+0000","last_fullsized":"2023-11-18T20:40:15.846268+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:15.089130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664065+0000","last_change":"2023-11-18T20:40:15.361548+0000","last_active":"2023-11-18T20:40:17.664065+0000","last_peered":"2023-11-18T20:40:17.664065+0000","last_clean":"2023-11-18T20:40:17.664065+0000","last_became_active":"2023-11-18T20:40:15.361199+0000","last_became_peered":"2023-11-18T20:40:15.361199+0000","last_unstale":"2023-11-18T20:40:17.664065+0000","last_undegraded":"2023-11-18T20:40:17.664065+0000","last_fullsized":"2023-11-18T20:40:17.664065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:29.561471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329437+0000","last_change":"2023-11-18T20:40:14.833036+0000","last_active":"2023-11-18T20:40:16.329437+0000","last_peered":"2023-11-18T20:40:16.329437+0000","last_clean":"2023-11-18T20:40:16.329437+0000","last_became_active":"2023-11-18T20:40:14.831403+0000","last_became_peered":"2023-11-18T20:40:14.831403+0000","last_unstale":"2023-11-18T20:40:16.329437+0000","last_undegraded":"2023-11-18T20:40:16.329437+0000","last_fullsized":"2023-11-18T20:40:16.329437+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:51:45.803351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329109+0000","last_change":"2023-11-18T20:40:15.359834+0000","last_active":"2023-11-18T20:40:16.329109+0000","last_peered":"2023-11-18T20:40:16.329109+0000","last_clean":"2023-11-18T20:40:16.329109+0000","last_became_active":"2023-11-18T20:40:15.355953+0000","last_became_peered":"2023-11-18T20:40:15.355953+0000","last_unstale":"2023-11-18T20:40:16.329109+0000","last_undegraded":"2023-11-18T20:40:16.329109+0000","last_fullsized":"2023-11-18T20:40:16.329109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:37.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326304+0000","last_change":"2023-11-18T20:40:14.827337+0000","last_active":"2023-11-18T20:40:16.326304+0000","last_peered":"2023-11-18T20:40:16.326304+0000","last_clean":"2023-11-18T20:40:16.326304+0000","last_became_active":"2023-11-18T20:40:14.826653+0000","last_became_peered":"2023-11-18T20:40:14.826653+0000","last_unstale":"2023-11-18T20:40:16.326304+0000","last_undegraded":"2023-11-18T20:40:16.326304+0000","last_fullsized":"2023-11-18T20:40:16.326304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:25:30.247203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663305+0000","last_change":"2023-11-18T20:40:15.357662+0000","last_active":"2023-11-18T20:40:17.663305+0000","last_peered":"2023-11-18T20:40:17.663305+0000","last_clean":"2023-11-18T20:40:17.663305+0000","last_became_active":"2023-11-18T20:40:15.357033+0000","last_became_peered":"2023-11-18T20:40:15.357033+0000","last_unstale":"2023-11-18T20:40:17.663305+0000","last_undegraded":"2023-11-18T20:40:17.663305+0000","last_fullsized":"2023-11-18T20:40:17.663305+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:27.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.852510+0000","last_change":"2023-11-18T20:40:14.822926+0000","last_active":"2023-11-18T20:40:15.852510+0000","last_peered":"2023-11-18T20:40:15.852510+0000","last_clean":"2023-11-18T20:40:15.852510+0000","last_became_active":"2023-11-18T20:40:14.822593+0000","last_became_peered":"2023-11-18T20:40:14.822593+0000","last_unstale":"2023-11-18T20:40:15.852510+0000","last_undegraded":"2023-11-18T20:40:15.852510+0000","last_fullsized":"2023-11-18T20:40:15.852510+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:07:12.992214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.357986+0000","last_change":"2023-11-18T20:40:15.354490+0000","last_active":"2023-11-18T20:40:15.357986+0000","last_peered":"2023-11-18T20:40:15.357986+0000","last_clean":"2023-11-18T20:40:15.357986+0000","last_became_active":"2023-11-18T20:40:15.354207+0000","last_became_peered":"2023-11-18T20:40:15.354207+0000","last_unstale":"2023-11-18T20:40:15.357986+0000","last_undegraded":"2023-11-18T20:40:15.357986+0000","last_fullsized":"2023-11-18T20:40:15.357986+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:25.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.328635+0000","last_change":"2023-11-18T20:40:14.824769+0000","last_active":"2023-11-18T20:40:16.328635+0000","last_peered":"2023-11-18T20:40:16.328635+0000","last_clean":"2023-11-18T20:40:16.328635+0000","last_became_active":"2023-11-18T20:40:14.824476+0000","last_became_peered":"2023-11-18T20:40:14.824476+0000","last_unstale":"2023-11-18T20:40:16.328635+0000","last_undegraded":"2023-11-18T20:40:16.328635+0000","last_fullsized":"2023-11-18T20:40:16.328635+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:09:23.933844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.351268+0000","last_change":"2023-11-18T20:40:15.343792+0000","last_active":"2023-11-18T20:40:15.351268+0000","last_peered":"2023-11-18T20:40:15.351268+0000","last_clean":"2023-11-18T20:40:15.351268+0000","last_became_active":"2023-11-18T20:40:15.343641+0000","last_became_peered":"2023-11-18T20:40:15.343641+0000","last_unstale":"2023-11-18T20:40:15.351268+0000","last_undegraded":"2023-11-18T20:40:15.351268+0000","last_fullsized":"2023-11-18T20:40:15.351268+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:39:24.530336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322021+0000","last_change":"2023-11-18T20:40:14.824464+0000","last_active":"2023-11-18T20:40:16.322021+0000","last_peered":"2023-11-18T20:40:16.322021+0000","last_clean":"2023-11-18T20:40:16.322021+0000","last_became_active":"2023-11-18T20:40:14.824093+0000","last_became_peered":"2023-11-18T20:40:14.824093+0000","last_unstale":"2023-11-18T20:40:16.322021+0000","last_undegraded":"2023-11-18T20:40:16.322021+0000","last_fullsized":"2023-11-18T20:40:16.322021+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:29.994861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.327634+0000","last_change":"2023-11-18T20:40:15.355962+0000","last_active":"2023-11-18T20:40:16.327634+0000","last_peered":"2023-11-18T20:40:16.327634+0000","last_clean":"2023-11-18T20:40:16.327634+0000","last_became_active":"2023-11-18T20:40:15.355647+0000","last_became_peered":"2023-11-18T20:40:15.355647+0000","last_unstale":"2023-11-18T20:40:16.327634+0000","last_undegraded":"2023-11-18T20:40:16.327634+0000","last_fullsized":"2023-11-18T20:40:16.327634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:44.617490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196189+0000","last_change":"2023-11-18T20:40:14.826728+0000","last_active":"2023-11-18T20:40:17.196189+0000","last_peered":"2023-11-18T20:40:17.196189+0000","last_clean":"2023-11-18T20:40:17.196189+0000","last_became_active":"2023-11-18T20:40:14.826453+0000","last_became_peered":"2023-11-18T20:40:14.826453+0000","last_unstale":"2023-11-18T20:40:17.196189+0000","last_undegraded":"2023-11-18T20:40:17.196189+0000","last_fullsized":"2023-11-18T20:40:17.196189+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:39:23.515944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196840+0000","last_change":"2023-11-18T20:40:15.340229+0000","last_active":"2023-11-18T20:40:17.196840+0000","last_peered":"2023-11-18T20:40:17.196840+0000","last_clean":"2023-11-18T20:40:17.196840+0000","last_became_active":"2023-11-18T20:40:15.339486+0000","last_became_peered":"2023-11-18T20:40:15.339486+0000","last_unstale":"2023-11-18T20:40:17.196840+0000","last_undegraded":"2023-11-18T20:40:17.196840+0000","last_fullsized":"2023-11-18T20:40:17.196840+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:31.652533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322260+0000","last_change":"2023-11-18T20:40:14.827685+0000","last_active":"2023-11-18T20:40:16.322260+0000","last_peered":"2023-11-18T20:40:16.322260+0000","last_clean":"2023-11-18T20:40:16.322260+0000","last_became_active":"2023-11-18T20:40:14.827366+0000","last_became_peered":"2023-11-18T20:40:14.827366+0000","last_unstale":"2023-11-18T20:40:16.322260+0000","last_undegraded":"2023-11-18T20:40:16.322260+0000","last_fullsized":"2023-11-18T20:40:16.322260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:55.130516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358517+0000","last_change":"2023-11-18T20:40:15.355620+0000","last_active":"2023-11-18T20:40:15.358517+0000","last_peered":"2023-11-18T20:40:15.358517+0000","last_clean":"2023-11-18T20:40:15.358517+0000","last_became_active":"2023-11-18T20:40:15.355354+0000","last_became_peered":"2023-11-18T20:40:15.355354+0000","last_unstale":"2023-11-18T20:40:15.358517+0000","last_undegraded":"2023-11-18T20:40:15.358517+0000","last_fullsized":"2023-11-18T20:40:15.358517+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:03.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664198+0000","last_change":"2023-11-18T20:40:14.833810+0000","last_active":"2023-11-18T20:40:17.664198+0000","last_peered":"2023-11-18T20:40:17.664198+0000","last_clean":"2023-11-18T20:40:17.664198+0000","last_became_active":"2023-11-18T20:40:14.832447+0000","last_became_peered":"2023-11-18T20:40:14.832447+0000","last_unstale":"2023-11-18T20:40:17.664198+0000","last_undegraded":"2023-11-18T20:40:17.664198+0000","last_fullsized":"2023-11-18T20:40:17.664198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:02.417342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664252+0000","last_change":"2023-11-18T20:40:15.359505+0000","last_active":"2023-11-18T20:40:17.664252+0000","last_peered":"2023-11-18T20:40:17.664252+0000","last_clean":"2023-11-18T20:40:17.664252+0000","last_became_active":"2023-11-18T20:40:15.358966+0000","last_became_peered":"2023-11-18T20:40:15.358966+0000","last_unstale":"2023-11-18T20:40:17.664252+0000","last_undegraded":"2023-11-18T20:40:17.664252+0000","last_fullsized":"2023-11-18T20:40:17.664252+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:25:51.738059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326580+0000","last_change":"2023-11-18T20:40:14.827802+0000","last_active":"2023-11-18T20:40:16.326580+0000","last_peered":"2023-11-18T20:40:16.326580+0000","last_clean":"2023-11-18T20:40:16.326580+0000","last_became_active":"2023-11-18T20:40:14.827062+0000","last_became_peered":"2023-11-18T20:40:14.827062+0000","last_unstale":"2023-11-18T20:40:16.326580+0000","last_undegraded":"2023-11-18T20:40:16.326580+0000","last_fullsized":"2023-11-18T20:40:16.326580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:47:46.239729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326373+0000","last_change":"2023-11-18T20:40:15.350874+0000","last_active":"2023-11-18T20:40:16.326373+0000","last_peered":"2023-11-18T20:40:16.326373+0000","last_clean":"2023-11-18T20:40:16.326373+0000","last_became_active":"2023-11-18T20:40:15.350271+0000","last_became_peered":"2023-11-18T20:40:15.350271+0000","last_unstale":"2023-11-18T20:40:16.326373+0000","last_undegraded":"2023-11-18T20:40:16.326373+0000","last_fullsized":"2023-11-18T20:40:16.326373+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:51:14.162201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196673+0000","last_change":"2023-11-18T20:40:14.831009+0000","last_active":"2023-11-18T20:40:17.196673+0000","last_peered":"2023-11-18T20:40:17.196673+0000","last_clean":"2023-11-18T20:40:17.196673+0000","last_became_active":"2023-11-18T20:40:14.830639+0000","last_became_peered":"2023-11-18T20:40:14.830639+0000","last_unstale":"2023-11-18T20:40:17.196673+0000","last_undegraded":"2023-11-18T20:40:17.196673+0000","last_fullsized":"2023-11-18T20:40:17.196673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:20.007726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.321957+0000","last_change":"2023-11-18T20:40:15.354465+0000","last_active":"2023-11-18T20:40:16.321957+0000","last_peered":"2023-11-18T20:40:16.321957+0000","last_clean":"2023-11-18T20:40:16.321957+0000","last_became_active":"2023-11-18T20:40:15.354191+0000","last_became_peered":"2023-11-18T20:40:15.354191+0000","last_unstale":"2023-11-18T20:40:16.321957+0000","last_undegraded":"2023-11-18T20:40:16.321957+0000","last_fullsized":"2023-11-18T20:40:16.321957+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:18:39.504225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663838+0000","last_change":"2023-11-18T20:40:14.832793+0000","last_active":"2023-11-18T20:40:17.663838+0000","last_peered":"2023-11-18T20:40:17.663838+0000","last_clean":"2023-11-18T20:40:17.663838+0000","last_became_active":"2023-11-18T20:40:14.831869+0000","last_became_peered":"2023-11-18T20:40:14.831869+0000","last_unstale":"2023-11-18T20:40:17.663838+0000","last_undegraded":"2023-11-18T20:40:17.663838+0000","last_fullsized":"2023-11-18T20:40:17.663838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:54.843303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.351294+0000","last_change":"2023-11-18T20:40:15.343712+0000","last_active":"2023-11-18T20:40:15.351294+0000","last_peered":"2023-11-18T20:40:15.351294+0000","last_clean":"2023-11-18T20:40:15.351294+0000","last_became_active":"2023-11-18T20:40:15.343433+0000","last_became_peered":"2023-11-18T20:40:15.343433+0000","last_unstale":"2023-11-18T20:40:15.351294+0000","last_undegraded":"2023-11-18T20:40:15.351294+0000","last_fullsized":"2023-11-18T20:40:15.351294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:19.031862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326505+0000","last_change":"2023-11-18T20:40:14.821052+0000","last_active":"2023-11-18T20:40:16.326505+0000","last_peered":"2023-11-18T20:40:16.326505+0000","last_clean":"2023-11-18T20:40:16.326505+0000","last_became_active":"2023-11-18T20:40:14.820746+0000","last_became_peered":"2023-11-18T20:40:14.820746+0000","last_unstale":"2023-11-18T20:40:16.326505+0000","last_undegraded":"2023-11-18T20:40:16.326505+0000","last_fullsized":"2023-11-18T20:40:16.326505+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:48.332445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322072+0000","last_change":"2023-11-18T20:40:15.345010+0000","last_active":"2023-11-18T20:40:16.322072+0000","last_peered":"2023-11-18T20:40:16.322072+0000","last_clean":"2023-11-18T20:40:16.322072+0000","last_became_active":"2023-11-18T20:40:15.344217+0000","last_became_peered":"2023-11-18T20:40:15.344217+0000","last_unstale":"2023-11-18T20:40:16.322072+0000","last_undegraded":"2023-11-18T20:40:16.322072+0000","last_fullsized":"2023-11-18T20:40:16.322072+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:46:38.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325860+0000","last_change":"2023-11-18T20:40:14.819105+0000","last_active":"2023-11-18T20:40:16.325860+0000","last_peered":"2023-11-18T20:40:16.325860+0000","last_clean":"2023-11-18T20:40:16.325860+0000","last_became_active":"2023-11-18T20:40:14.818836+0000","last_became_peered":"2023-11-18T20:40:14.818836+0000","last_unstale":"2023-11-18T20:40:16.325860+0000","last_undegraded":"2023-11-18T20:40:16.325860+0000","last_fullsized":"2023-11-18T20:40:16.325860+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:45.745180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.325878+0000","last_change":"2023-11-18T20:40:15.357869+0000","last_active":"2023-11-18T20:40:16.325878+0000","last_peered":"2023-11-18T20:40:16.325878+0000","last_clean":"2023-11-18T20:40:16.325878+0000","last_became_active":"2023-11-18T20:40:15.355608+0000","last_became_peered":"2023-11-18T20:40:15.355608+0000","last_unstale":"2023-11-18T20:40:16.325878+0000","last_undegraded":"2023-11-18T20:40:16.325878+0000","last_fullsized":"2023-11-18T20:40:16.325878+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.686758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326030+0000","last_change":"2023-11-18T20:40:14.816928+0000","last_active":"2023-11-18T20:40:16.326030+0000","last_peered":"2023-11-18T20:40:16.326030+0000","last_clean":"2023-11-18T20:40:16.326030+0000","last_became_active":"2023-11-18T20:40:14.816652+0000","last_became_peered":"2023-11-18T20:40:14.816652+0000","last_unstale":"2023-11-18T20:40:16.326030+0000","last_undegraded":"2023-11-18T20:40:16.326030+0000","last_fullsized":"2023-11-18T20:40:16.326030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:55.852659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358531+0000","last_change":"2023-11-18T20:40:15.355385+0000","last_active":"2023-11-18T20:40:15.358531+0000","last_peered":"2023-11-18T20:40:15.358531+0000","last_clean":"2023-11-18T20:40:15.358531+0000","last_became_active":"2023-11-18T20:40:15.355098+0000","last_became_peered":"2023-11-18T20:40:15.355098+0000","last_unstale":"2023-11-18T20:40:15.358531+0000","last_undegraded":"2023-11-18T20:40:15.358531+0000","last_fullsized":"2023-11-18T20:40:15.358531+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:06:10.018842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.853240+0000","last_change":"2023-11-18T20:40:14.834099+0000","last_active":"2023-11-18T20:40:15.853240+0000","last_peered":"2023-11-18T20:40:15.853240+0000","last_clean":"2023-11-18T20:40:15.853240+0000","last_became_active":"2023-11-18T20:40:14.833825+0000","last_became_peered":"2023-11-18T20:40:14.833825+0000","last_unstale":"2023-11-18T20:40:15.853240+0000","last_undegraded":"2023-11-18T20:40:15.853240+0000","last_fullsized":"2023-11-18T20:40:15.853240+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:29.994861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358565+0000","last_change":"2023-11-18T20:40:15.357460+0000","last_active":"2023-11-18T20:40:15.358565+0000","last_peered":"2023-11-18T20:40:15.358565+0000","last_clean":"2023-11-18T20:40:15.358565+0000","last_became_active":"2023-11-18T20:40:15.355817+0000","last_became_peered":"2023-11-18T20:40:15.355817+0000","last_unstale":"2023-11-18T20:40:15.358565+0000","last_undegraded":"2023-11-18T20:40:15.358565+0000","last_fullsized":"2023-11-18T20:40:15.358565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:40.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664292+0000","last_change":"2023-11-18T20:40:14.832158+0000","last_active":"2023-11-18T20:40:17.664292+0000","last_peered":"2023-11-18T20:40:17.664292+0000","last_clean":"2023-11-18T20:40:17.664292+0000","last_became_active":"2023-11-18T20:40:14.831853+0000","last_became_peered":"2023-11-18T20:40:14.831853+0000","last_unstale":"2023-11-18T20:40:17.664292+0000","last_undegraded":"2023-11-18T20:40:17.664292+0000","last_fullsized":"2023-11-18T20:40:17.664292+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:51:13.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.365433+0000","last_change":"2023-11-18T20:40:15.358307+0000","last_active":"2023-11-18T20:40:15.365433+0000","last_peered":"2023-11-18T20:40:15.365433+0000","last_clean":"2023-11-18T20:40:15.365433+0000","last_became_active":"2023-11-18T20:40:15.357876+0000","last_became_peered":"2023-11-18T20:40:15.357876+0000","last_unstale":"2023-11-18T20:40:15.365433+0000","last_undegraded":"2023-11-18T20:40:15.365433+0000","last_fullsized":"2023-11-18T20:40:15.365433+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:54.827659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.853733+0000","last_change":"2023-11-18T20:40:14.831548+0000","last_active":"2023-11-18T20:40:15.853733+0000","last_peered":"2023-11-18T20:40:15.853733+0000","last_clean":"2023-11-18T20:40:15.853733+0000","last_became_active":"2023-11-18T20:40:14.831302+0000","last_became_peered":"2023-11-18T20:40:14.831302+0000","last_unstale":"2023-11-18T20:40:15.853733+0000","last_undegraded":"2023-11-18T20:40:15.853733+0000","last_fullsized":"2023-11-18T20:40:15.853733+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:24.216427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.326497+0000","last_change":"2023-11-18T20:40:15.357107+0000","last_active":"2023-11-18T20:40:16.326497+0000","last_peered":"2023-11-18T20:40:16.326497+0000","last_clean":"2023-11-18T20:40:16.326497+0000","last_became_active":"2023-11-18T20:40:15.356852+0000","last_became_peered":"2023-11-18T20:40:15.356852+0000","last_unstale":"2023-11-18T20:40:16.326497+0000","last_undegraded":"2023-11-18T20:40:16.326497+0000","last_fullsized":"2023-11-18T20:40:16.326497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:07.057091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664297+0000","last_change":"2023-11-18T20:40:14.830198+0000","last_active":"2023-11-18T20:40:17.664297+0000","last_peered":"2023-11-18T20:40:17.664297+0000","last_clean":"2023-11-18T20:40:17.664297+0000","last_became_active":"2023-11-18T20:40:14.829922+0000","last_became_peered":"2023-11-18T20:40:14.829922+0000","last_unstale":"2023-11-18T20:40:17.664297+0000","last_undegraded":"2023-11-18T20:40:17.664297+0000","last_fullsized":"2023-11-18T20:40:17.664297+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:37.429611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322156+0000","last_change":"2023-11-18T20:40:15.352716+0000","last_active":"2023-11-18T20:40:16.322156+0000","last_peered":"2023-11-18T20:40:16.322156+0000","last_clean":"2023-11-18T20:40:16.322156+0000","last_became_active":"2023-11-18T20:40:15.352413+0000","last_became_peered":"2023-11-18T20:40:15.352413+0000","last_unstale":"2023-11-18T20:40:16.322156+0000","last_undegraded":"2023-11-18T20:40:16.322156+0000","last_fullsized":"2023-11-18T20:40:16.322156+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:15:33.663727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.854435+0000","last_change":"2023-11-18T20:40:14.820194+0000","last_active":"2023-11-18T20:40:15.854435+0000","last_peered":"2023-11-18T20:40:15.854435+0000","last_clean":"2023-11-18T20:40:15.854435+0000","last_became_active":"2023-11-18T20:40:14.819684+0000","last_became_peered":"2023-11-18T20:40:14.819684+0000","last_unstale":"2023-11-18T20:40:15.854435+0000","last_undegraded":"2023-11-18T20:40:15.854435+0000","last_fullsized":"2023-11-18T20:40:15.854435+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:30.638140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663861+0000","last_change":"2023-11-18T20:40:15.352432+0000","last_active":"2023-11-18T20:40:17.663861+0000","last_peered":"2023-11-18T20:40:17.663861+0000","last_clean":"2023-11-18T20:40:17.663861+0000","last_became_active":"2023-11-18T20:40:15.352146+0000","last_became_peered":"2023-11-18T20:40:15.352146+0000","last_unstale":"2023-11-18T20:40:17.663861+0000","last_undegraded":"2023-11-18T20:40:17.663861+0000","last_fullsized":"2023-11-18T20:40:17.663861+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:47.494672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663387+0000","last_change":"2023-11-18T20:40:14.828458+0000","last_active":"2023-11-18T20:40:17.663387+0000","last_peered":"2023-11-18T20:40:17.663387+0000","last_clean":"2023-11-18T20:40:17.663387+0000","last_became_active":"2023-11-18T20:40:14.828170+0000","last_became_peered":"2023-11-18T20:40:14.828170+0000","last_unstale":"2023-11-18T20:40:17.663387+0000","last_undegraded":"2023-11-18T20:40:17.663387+0000","last_fullsized":"2023-11-18T20:40:17.663387+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:56:30.127554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663216+0000","last_change":"2023-11-18T20:40:15.349261+0000","last_active":"2023-11-18T20:40:17.663216+0000","last_peered":"2023-11-18T20:40:17.663216+0000","last_clean":"2023-11-18T20:40:17.663216+0000","last_became_active":"2023-11-18T20:40:15.346287+0000","last_became_peered":"2023-11-18T20:40:15.346287+0000","last_unstale":"2023-11-18T20:40:17.663216+0000","last_undegraded":"2023-11-18T20:40:17.663216+0000","last_fullsized":"2023-11-18T20:40:17.663216+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:43:17.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322071+0000","last_change":"2023-11-18T20:40:14.828962+0000","last_active":"2023-11-18T20:40:16.322071+0000","last_peered":"2023-11-18T20:40:16.322071+0000","last_clean":"2023-11-18T20:40:16.322071+0000","last_became_active":"2023-11-18T20:40:14.828681+0000","last_became_peered":"2023-11-18T20:40:14.828681+0000","last_unstale":"2023-11-18T20:40:16.322071+0000","last_undegraded":"2023-11-18T20:40:16.322071+0000","last_fullsized":"2023-11-18T20:40:16.322071+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:21:19.606979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.358491+0000","last_change":"2023-11-18T20:40:15.354747+0000","last_active":"2023-11-18T20:40:15.358491+0000","last_peered":"2023-11-18T20:40:15.358491+0000","last_clean":"2023-11-18T20:40:15.358491+0000","last_became_active":"2023-11-18T20:40:15.354502+0000","last_became_peered":"2023-11-18T20:40:15.354502+0000","last_unstale":"2023-11-18T20:40:15.358491+0000","last_undegraded":"2023-11-18T20:40:15.358491+0000","last_fullsized":"2023-11-18T20:40:15.358491+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:42.601914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.854077+0000","last_change":"2023-11-18T20:40:14.834889+0000","last_active":"2023-11-18T20:40:15.854077+0000","last_peered":"2023-11-18T20:40:15.854077+0000","last_clean":"2023-11-18T20:40:15.854077+0000","last_became_active":"2023-11-18T20:40:14.834576+0000","last_became_peered":"2023-11-18T20:40:14.834576+0000","last_unstale":"2023-11-18T20:40:15.854077+0000","last_undegraded":"2023-11-18T20:40:15.854077+0000","last_fullsized":"2023-11-18T20:40:15.854077+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.353314+0000","last_change":"2023-11-18T20:40:15.348518+0000","last_active":"2023-11-18T20:40:15.353314+0000","last_peered":"2023-11-18T20:40:15.353314+0000","last_clean":"2023-11-18T20:40:15.353314+0000","last_became_active":"2023-11-18T20:40:15.348248+0000","last_became_peered":"2023-11-18T20:40:15.348248+0000","last_unstale":"2023-11-18T20:40:15.353314+0000","last_undegraded":"2023-11-18T20:40:15.353314+0000","last_fullsized":"2023-11-18T20:40:15.353314+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:44.689679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.329316+0000","last_change":"2023-11-18T20:40:14.827087+0000","last_active":"2023-11-18T20:40:16.329316+0000","last_peered":"2023-11-18T20:40:16.329316+0000","last_clean":"2023-11-18T20:40:16.329316+0000","last_became_active":"2023-11-18T20:40:14.826756+0000","last_became_peered":"2023-11-18T20:40:14.826756+0000","last_unstale":"2023-11-18T20:40:16.329316+0000","last_undegraded":"2023-11-18T20:40:16.329316+0000","last_fullsized":"2023-11-18T20:40:16.329316+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:44:23.259634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366471+0000","last_change":"2023-11-18T20:40:15.363781+0000","last_active":"2023-11-18T20:40:15.366471+0000","last_peered":"2023-11-18T20:40:15.366471+0000","last_clean":"2023-11-18T20:40:15.366471+0000","last_became_active":"2023-11-18T20:40:15.363178+0000","last_became_peered":"2023-11-18T20:40:15.363178+0000","last_unstale":"2023-11-18T20:40:15.366471+0000","last_undegraded":"2023-11-18T20:40:15.366471+0000","last_fullsized":"2023-11-18T20:40:15.366471+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:21:20.621372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.322041+0000","last_change":"2023-11-18T20:40:14.830237+0000","last_active":"2023-11-18T20:40:16.322041+0000","last_peered":"2023-11-18T20:40:16.322041+0000","last_clean":"2023-11-18T20:40:16.322041+0000","last_became_active":"2023-11-18T20:40:14.829895+0000","last_became_peered":"2023-11-18T20:40:14.829895+0000","last_unstale":"2023-11-18T20:40:16.322041+0000","last_undegraded":"2023-11-18T20:40:16.322041+0000","last_fullsized":"2023-11-18T20:40:16.322041+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.664401+0000","last_change":"2023-11-18T20:40:15.346282+0000","last_active":"2023-11-18T20:40:17.664401+0000","last_peered":"2023-11-18T20:40:17.664401+0000","last_clean":"2023-11-18T20:40:17.664401+0000","last_became_active":"2023-11-18T20:40:15.345731+0000","last_became_peered":"2023-11-18T20:40:15.345731+0000","last_unstale":"2023-11-18T20:40:17.664401+0000","last_undegraded":"2023-11-18T20:40:17.664401+0000","last_fullsized":"2023-11-18T20:40:17.664401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:03.894891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.337645+0000","last_change":"2023-11-18T20:40:14.823740+0000","last_active":"2023-11-18T20:40:15.337645+0000","last_peered":"2023-11-18T20:40:15.337645+0000","last_clean":"2023-11-18T20:40:15.337645+0000","last_became_active":"2023-11-18T20:40:14.823071+0000","last_became_peered":"2023-11-18T20:40:14.823071+0000","last_unstale":"2023-11-18T20:40:15.337645+0000","last_undegraded":"2023-11-18T20:40:15.337645+0000","last_fullsized":"2023-11-18T20:40:15.337645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:30.638140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.328483+0000","last_change":"2023-11-18T20:40:15.345339+0000","last_active":"2023-11-18T20:40:16.328483+0000","last_peered":"2023-11-18T20:40:16.328483+0000","last_clean":"2023-11-18T20:40:16.328483+0000","last_became_active":"2023-11-18T20:40:15.345007+0000","last_became_peered":"2023-11-18T20:40:15.345007+0000","last_unstale":"2023-11-18T20:40:16.328483+0000","last_undegraded":"2023-11-18T20:40:16.328483+0000","last_fullsized":"2023-11-18T20:40:16.328483+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:30:28.760969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.347026+0000","last_change":"2023-11-18T20:40:14.833918+0000","last_active":"2023-11-18T20:40:15.347026+0000","last_peered":"2023-11-18T20:40:15.347026+0000","last_clean":"2023-11-18T20:40:15.347026+0000","last_became_active":"2023-11-18T20:40:14.833631+0000","last_became_peered":"2023-11-18T20:40:14.833631+0000","last_unstale":"2023-11-18T20:40:15.347026+0000","last_undegraded":"2023-11-18T20:40:15.347026+0000","last_fullsized":"2023-11-18T20:40:15.347026+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:42:45.782573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196773+0000","last_change":"2023-11-18T20:40:15.352662+0000","last_active":"2023-11-18T20:40:17.196773+0000","last_peered":"2023-11-18T20:40:17.196773+0000","last_clean":"2023-11-18T20:40:17.196773+0000","last_became_active":"2023-11-18T20:40:15.352389+0000","last_became_peered":"2023-11-18T20:40:15.352389+0000","last_unstale":"2023-11-18T20:40:17.196773+0000","last_undegraded":"2023-11-18T20:40:17.196773+0000","last_fullsized":"2023-11-18T20:40:17.196773+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:03.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.338163+0000","last_change":"2023-11-18T20:40:14.826072+0000","last_active":"2023-11-18T20:40:15.338163+0000","last_peered":"2023-11-18T20:40:15.338163+0000","last_clean":"2023-11-18T20:40:15.338163+0000","last_became_active":"2023-11-18T20:40:14.825599+0000","last_became_peered":"2023-11-18T20:40:14.825599+0000","last_unstale":"2023-11-18T20:40:15.338163+0000","last_undegraded":"2023-11-18T20:40:15.338163+0000","last_fullsized":"2023-11-18T20:40:15.338163+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:04.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663222+0000","last_change":"2023-11-18T20:40:15.352617+0000","last_active":"2023-11-18T20:40:17.663222+0000","last_peered":"2023-11-18T20:40:17.663222+0000","last_clean":"2023-11-18T20:40:17.663222+0000","last_became_active":"2023-11-18T20:40:15.350699+0000","last_became_peered":"2023-11-18T20:40:15.350699+0000","last_unstale":"2023-11-18T20:40:17.663222+0000","last_undegraded":"2023-11-18T20:40:17.663222+0000","last_fullsized":"2023-11-18T20:40:17.663222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:24.336068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:16.327819+0000","last_change":"2023-11-18T20:40:14.814908+0000","last_active":"2023-11-18T20:40:16.327819+0000","last_peered":"2023-11-18T20:40:16.327819+0000","last_clean":"2023-11-18T20:40:16.327819+0000","last_became_active":"2023-11-18T20:40:14.814486+0000","last_became_peered":"2023-11-18T20:40:14.814486+0000","last_unstale":"2023-11-18T20:40:16.327819+0000","last_undegraded":"2023-11-18T20:40:16.327819+0000","last_fullsized":"2023-11-18T20:40:16.327819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:10.795775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.366435+0000","last_change":"2023-11-18T20:40:15.363267+0000","last_active":"2023-11-18T20:40:15.366435+0000","last_peered":"2023-11-18T20:40:15.366435+0000","last_clean":"2023-11-18T20:40:15.366435+0000","last_became_active":"2023-11-18T20:40:15.362302+0000","last_became_peered":"2023-11-18T20:40:15.362302+0000","last_unstale":"2023-11-18T20:40:15.366435+0000","last_undegraded":"2023-11-18T20:40:15.366435+0000","last_fullsized":"2023-11-18T20:40:15.366435+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:56.144908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663422+0000","last_change":"2023-11-18T20:40:14.830736+0000","last_active":"2023-11-18T20:40:17.663422+0000","last_peered":"2023-11-18T20:40:17.663422+0000","last_clean":"2023-11-18T20:40:17.663422+0000","last_became_active":"2023-11-18T20:40:14.830431+0000","last_became_peered":"2023-11-18T20:40:14.830431+0000","last_unstale":"2023-11-18T20:40:17.663422+0000","last_undegraded":"2023-11-18T20:40:17.663422+0000","last_fullsized":"2023-11-18T20:40:17.663422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:10:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.663653+0000","last_change":"2023-11-18T20:40:15.355538+0000","last_active":"2023-11-18T20:40:17.663653+0000","last_peered":"2023-11-18T20:40:17.663653+0000","last_clean":"2023-11-18T20:40:17.663653+0000","last_became_active":"2023-11-18T20:40:15.355212+0000","last_became_peered":"2023-11-18T20:40:15.355212+0000","last_unstale":"2023-11-18T20:40:17.663653+0000","last_undegraded":"2023-11-18T20:40:17.663653+0000","last_fullsized":"2023-11-18T20:40:17.663653+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:15:19.819611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-18T20:40:17.196729+0000","last_change":"2023-11-18T20:40:14.834678+0000","last_active":"2023-11-18T20:40:17.196729+0000","last_peered":"2023-11-18T20:40:17.196729+0000","last_clean":"2023-11-18T20:40:17.196729+0000","last_became_active":"2023-11-18T20:40:14.834152+0000","last_became_peered":"2023-11-18T20:40:14.834152+0000","last_unstale":"2023-11-18T20:40:17.196729+0000","last_undegraded":"2023-11-18T20:40:17.196729+0000","last_fullsized":"2023-11-18T20:40:17.196729+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:24:26.163852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-18T20:40:15.339884+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:40:15.339884+0000","last_peered":"2023-11-18T20:40:15.339884+0000","last_clean":"2023-11-18T20:40:15.339884+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:40:15.339884+0000","last_undegraded":"2023-11-18T20:40:15.339884+0000","last_fullsized":"2023-11-18T20:40:15.339884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542176,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":276337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.046,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0900000000000001,"15min":1.0940000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.0149999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.2110000000000001,"15min":1.214},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.599,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6180000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1180000000000001,"15min":1.1240000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.613,"15min":1.613},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0950000000000002,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.431}]},{"osd":3,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2490000000000001,"15min":1.244},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.661,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.4470000000000001,"15min":1.4550000000000001},"min":{"1min":0.95999999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8939999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.5389999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.577,"15min":1.5880000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":2.0750000000000002,"5min":2.601,"15min":2.601},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.542,"15min":1.554},"min":{"1min":1.135,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.883,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.96999999999999997}]},{"osd":5,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.6160000000000001,"15min":1.6259999999999999},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.218,"5min":3.02,"15min":3.02},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.728,"15min":1.7410000000000001},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":2.1640000000000001,"5min":3.488,"15min":3.488},"last":1.27}]},{"osd":6,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":1.7749999999999999,"15min":1.782},"min":{"1min":1.202,"5min":1.202,"15min":1.202},"max":{"1min":2.2290000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.7290000000000001,"15min":1.7470000000000001},"min":{"1min":1.1499999999999999,"5min":1.075,"15min":1.075},"max":{"1min":2.302,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.415}]}]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":659456,"data_stored":282567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.60899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.05},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":0.98099999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.995,"15min":0.998},"min":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.282},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.78600000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6399999999999999,"5min":1.653,"15min":1.653},"last":1.1890000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.163,"15min":1.1739999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4750000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.375},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2310000000000001,"15min":1.234},"min":{"1min":0.82099999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.744,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3340000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3220000000000001,"15min":1.341},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7130000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.218},{"interface":"front","average":{"1min":1.139,"5min":1.1830000000000001,"15min":1.1910000000000001},"min":{"1min":0.82899999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.4470000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3600000000000001,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.3700000000000001,"15min":1.373},"min":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7909999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.48}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3140000000000001,"15min":1.3109999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.847,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.534,"15min":1.5289999999999999},"min":{"1min":1.127,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.536}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.5509999999999999,"15min":1.5569999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9379999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.722},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.6379999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1241088,"data_stored":866647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.84199999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5640000000000001,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.1299999999999999,"15min":1.1140000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5780000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.81200000000000006,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3080000000000001,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.5580000000000001,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.359}]},{"osd":2,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.375,"15min":1.3999999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6259999999999999,"5min":2.004,"15min":2.004},"last":1.111},{"interface":"front","average":{"1min":1.25,"5min":1.214,"15min":1.208},"min":{"1min":0.78900000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.627,"5min":2.214,"15min":2.214},"last":1.048}]},{"osd":3,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.4850000000000001,"15min":1.5069999999999999},"min":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.958,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.534},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4590000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.827,"5min":2.024,"15min":2.024},"last":1.762}]},{"osd":4,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3959999999999999,"15min":1.4079999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0470000000000002,"5min":2.359,"15min":2.359},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.496,"5min":1.5069999999999999,"15min":1.5089999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.802}]},{"osd":6,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.645,"15min":1.667},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1720000000000002,"5min":2.181,"15min":2.181},"last":1.288},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5980000000000001,"15min":1.615},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.109,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.4410000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6619999999999999,"15min":1.671},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.629},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.746,"15min":1.7609999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.8480000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542176,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":276861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4850000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.95599999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1080000000000001,"15min":1.0900000000000001},"min":{"1min":0.73599999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.208,"15min":1.2350000000000001},"min":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4810000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.048}]},{"osd":2,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6040000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.377,"15min":1.407},"min":{"1min":0.81699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.601,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.081}]},{"osd":3,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.212,"15min":1.224},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.4370000000000001,"5min":1.823,"15min":1.823},"last":1.139},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.472,"15min":1.502},"min":{"1min":0.84699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.78,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.466}]},{"osd":5,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4490000000000001,"15min":1.4610000000000001},"min":{"1min":1.0680000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.843,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4410000000000001,"15min":1.4630000000000001},"min":{"1min":1.073,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5549999999999999,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.2290000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5489999999999999,"15min":1.5609999999999999},"min":{"1min":1.0489999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.893,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.615},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.605,"15min":1.617},"min":{"1min":1.2210000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.952,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.401}]},{"osd":7,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.4790000000000001,"15min":1.478},"min":{"1min":1.244,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.843,"5min":1.929,"15min":1.929},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.635,"5min":1.6459999999999999,"15min":1.6479999999999999},"min":{"1min":1.234,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5549999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542177,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":659456,"data_stored":282635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.432,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93400000000000005,"15min":0.93300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.84999999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.05,"15min":1.0600000000000001},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.9450000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.89200000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1599999999999999,"15min":1.1559999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.288},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1599999999999999,"15min":1.1559999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.167}]},{"osd":5,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2410000000000001,"15min":1.2390000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8979999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.024},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.8520000000000001,"5min":1.901,"15min":1.901},"last":1.4299999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2649999999999999,"15min":1.262},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.2629999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.349},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.327,"15min":1.319},"min":{"1min":0.88500000000000001,"5min":0.754,"15min":0.754},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.115}]}]},{"osd":2,"up_from":14,"seq":60129542176,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":278017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.256,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.875},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":1.0389999999999999},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.367,"5min":2.081,"15min":2.081},"last":0.97599999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":0.85999999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2769999999999999,"5min":1.919,"15min":1.919},"last":1.014},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.84399999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.204}]},{"osd":3,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.085,"15min":1.1060000000000001},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4419999999999999,"5min":2.024,"15min":2.024},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.04,"15min":1.046},"min":{"1min":0.52500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5620000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.94899999999999995}]},{"osd":4,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.3140000000000001,"15min":1.3320000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.1659999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.244},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6839999999999999,"5min":2.254,"15min":2.254},"last":1.0369999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3109999999999999,"15min":1.323},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9419999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.292},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.425,"15min":1.4490000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5569999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.675}]},{"osd":6,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4359999999999999,"15min":1.462},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.0030000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3069999999999999,"15min":1.327},"min":{"1min":0.82299999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2189999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.339}]},{"osd":7,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.4450000000000001,"15min":1.4670000000000001},"min":{"1min":0.85999999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8600000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0950000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.5289999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1253376,"data_stored":873495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.88700000000000001,"15min":0.90800000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.371,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.874},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.194,"5min":1.524,"15min":1.524},"last":1.288}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2290000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0349999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4730000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5589999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.111},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.115,"15min":1.129},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.595,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0620000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.206,"15min":1.22},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4199999999999999,"5min":1.927,"15min":1.927},"last":1.202},{"interface":"front","average":{"1min":1.258,"5min":1.4099999999999999,"15min":1.4350000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.619,"5min":3.343,"15min":3.343},"last":1.3089999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.4390000000000001,"15min":1.484},"min":{"1min":0.876,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.5429999999999999,"5min":3.206,"15min":3.206},"last":1.232},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.387,"15min":1.401},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6519999999999999,"5min":2.165,"15min":2.165},"last":1.444}]},{"osd":6,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.681,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.25},{"interface":"front","average":{"1min":1.331,"5min":1.5580000000000001,"15min":1.5960000000000001},"min":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.754,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.397}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.575,"15min":1.617},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.843,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.4430000000000001,"15min":1.4530000000000001},"min":{"1min":0.81399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.306,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.327}]}]},{"osd":0,"up_from":14,"seq":60129542176,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":277857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2390000000000001,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.347},{"interface":"front","average":{"1min":0.75,"5min":0.97399999999999998,"15min":1.0109999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.234}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.5529999999999999,"15min":1.663},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.331,"5min":14.169,"15min":14.169},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93000000000000005,"15min":0.94299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.133}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":1.506,"15min":1.6080000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2989999999999999,"5min":11.629,"15min":11.629},"last":1.47},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.351,"15min":1.413},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6459999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.524}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.4119999999999999,"15min":1.4410000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4119999999999999,"15min":1.423},"min":{"1min":0.90400000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.446}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.5589999999999999,"15min":1.625},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.659,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.71},{"interface":"front","average":{"1min":1.27,"5min":1.6180000000000001,"15min":1.6759999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.736,"5min":6.202,"15min":6.202},"last":1.627}]},{"osd":6,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4710000000000001,"15min":1.472},"min":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":5.085,"5min":5.085,"15min":5.085},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.6739999999999999,"15min":1.744},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7210000000000001,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.831}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.5820000000000001,"15min":1.6439999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.601,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.7310000000000001,"15min":1.798},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.6899999999999999,"5min":6.149,"15min":6.149},"last":1.8}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:40:20.797 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T20:40:20.797 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-18T20:40:21.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.052+0000 7f0d49615640 1 Processor -- start 2023-11-18T20:40:21.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.053+0000 7f0d49615640 1 -- start start 2023-11-18T20:40:21.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.054+0000 7f0d49615640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44072320 0x7f0d4406f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.054+0000 7f0d49615640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d44150000 con 0x7f0d4406f5c0 2023-11-18T20:40:21.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.054+0000 7f0d49615640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d44156800 con 0x7f0d4414fc20 2023-11-18T20:40:21.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.054+0000 7f0d49615640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440c2080 con 0x7f0d44072320 2023-11-18T20:40:21.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.055+0000 7f0d437fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0d4406f5c0 0x7f0d44152560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54836/0 (socket says 172.21.15.132:54836) 2023-11-18T20:40:21.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.055+0000 7f0d437fe640 1 -- 172.21.15.132:0/432487281 learned_addr learned my addr 172.21.15.132:0/432487281 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:21.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.055+0000 7f0d427fc640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44072320 0x7f0d4406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.055+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451910111 0 0) 0x7f0d3c001110 con 0x7f0d4406f5c0 2023-11-18T20:40:21.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.055+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d30003520 con 0x7f0d4406f5c0 2023-11-18T20:40:21.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325434138 0 0) 0x7f0d30003520 con 0x7f0d4406f5c0 2023-11-18T20:40:21.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44072320 msgr2=0x7f0d4406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44072320 0x7f0d4406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 >> v1:172.21.15.161:6789/0 conn(0x7f0d4414fc20 legacy=0x7f0d440c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44155bf0 con 0x7f0d4406f5c0 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f0d3c001800 con 0x7f0d4406f5c0 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 >> v1:172.21.15.132:6789/0 conn(0x7f0d4406f5c0 legacy=0x7f0d44152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d30003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44072320 0x7f0d300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d30004d00 0x7f0d30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440c2080 con 0x7f0d300039a0 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3000bb10 con 0x7f0d30004d00 2023-11-18T20:40:21.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3000bcd0 con 0x7f0d44072320 2023-11-18T20:40:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d42ffd640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d30003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.056+0000 7f0d427fc640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44072320 0x7f0d300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.057+0000 7f0d42ffd640 1 -- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44072320 msgr2=0x7f0d300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.057+0000 7f0d42ffd640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44072320 0x7f0d300047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.057+0000 7f0d42ffd640 1 -- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d30004d00 msgr2=0x7f0d30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.057+0000 7f0d42ffd640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d30004d00 0x7f0d30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.057+0000 7f0d42ffd640 1 -- 172.21.15.132:0/432487281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d30003520 con 0x7f0d300039a0 2023-11-18T20:40:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d42ffd640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d30003dc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0d34001e50 tx=0x7f0d300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd569bc28cc09ec6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:21.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34003b70 con 0x7f0d300039a0 2023-11-18T20:40:21.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34003cd0 con 0x7f0d300039a0 2023-11-18T20:40:21.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d41ffb640 1 -- 172.21.15.132:0/432487281 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34005310 con 0x7f0d300039a0 2023-11-18T20:40:21.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d49615640 1 -- 172.21.15.132:0/432487281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 msgr2=0x7f0d30003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d49615640 1 --2- 172.21.15.132:0/432487281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d30003dc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0d34001e50 tx=0x7f0d300057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d437fe640 1 -- 172.21.15.132:0/432487281 reap_dead start 2023-11-18T20:40:21.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d49615640 1 -- 172.21.15.132:0/432487281 shutdown_connections 2023-11-18T20:40:21.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.058+0000 7f0d49615640 1 -- 172.21.15.132:0/432487281 >> 172.21.15.132:0/432487281 conn(0x7f0d440c39e0 msgr2=0x7f0d440c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:21.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.059+0000 7f0d49615640 1 -- 172.21.15.132:0/432487281 shutdown_connections 2023-11-18T20:40:21.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.059+0000 7f0d49615640 1 -- 172.21.15.132:0/432487281 wait complete. 2023-11-18T20:40:21.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.060+0000 7f0d49615640 1 Processor -- start 2023-11-18T20:40:21.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.061+0000 7f0d49615640 1 -- start start 2023-11-18T20:40:21.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.061+0000 7f0d49615640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d4406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.061+0000 7f0d49615640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44154930 0x7f0d441e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.061+0000 7f0d49615640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d44154d90 0x7f0d441e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d49615640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44151480 con 0x7f0d300039a0 2023-11-18T20:40:21.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d49615640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d441ea030 con 0x7f0d44154d90 2023-11-18T20:40:21.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d49615640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d441511a0 con 0x7f0d44154930 2023-11-18T20:40:21.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d42ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d4406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d42ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d4406d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39192/0 (socket says 172.21.15.132:39192) 2023-11-18T20:40:21.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d42ffd640 1 -- 172.21.15.132:0/1560757534 learned_addr learned my addr 172.21.15.132:0/1560757534 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:21.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d427fc640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44154930 0x7f0d441e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d437fe640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d44154d90 0x7f0d441e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d42ffd640 1 -- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44154930 msgr2=0x7f0d441e95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d42ffd640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44154930 0x7f0d441e95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d42ffd640 1 -- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d44154d90 msgr2=0x7f0d441e9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d42ffd640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d44154d90 0x7f0d441e9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d42ffd640 1 -- 172.21.15.132:0/1560757534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44153e70 con 0x7f0d300039a0 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.062+0000 7f0d437fe640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d44154d90 0x7f0d441e9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.063+0000 7f0d42ffd640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d4406d260 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0d3402bf90 tx=0x7f0d340014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.063+0000 7f0d3b7fe640 1 -- 172.21.15.132:0/1560757534 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3403e070 con 0x7f0d300039a0 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.063+0000 7f0d3b7fe640 1 -- 172.21.15.132:0/1560757534 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34006b50 con 0x7f0d300039a0 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.063+0000 7f0d3b7fe640 1 -- 172.21.15.132:0/1560757534 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34007030 con 0x7f0d300039a0 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.063+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d44154150 con 0x7f0d300039a0 2023-11-18T20:40:21.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.063+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d44150ea0 con 0x7f0d300039a0 2023-11-18T20:40:21.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.064+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4404e840 con 0x7f0d300039a0 2023-11-18T20:40:21.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.065+0000 7f0d3b7fe640 1 -- 172.21.15.132:0/1560757534 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d34007190 con 0x7f0d300039a0 2023-11-18T20:40:21.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.066+0000 7f0d3b7fe640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d2406ae40 0x7f0d2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.066+0000 7f0d3b7fe640 1 -- 172.21.15.132:0/1560757534 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d340ab260 con 0x7f0d300039a0 2023-11-18T20:40:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.067+0000 7f0d427fc640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d2406ae40 0x7f0d2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.068+0000 7f0d427fc640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d2406ae40 0x7f0d2406d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406eee0 tx=0x7f0d2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:21.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.070+0000 7f0d3b7fe640 1 -- 172.21.15.132:0/1560757534 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d34076270 con 0x7f0d300039a0 2023-11-18T20:40:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.328+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0d44153cd0 con 0x7f0d300039a0 2023-11-18T20:40:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.334+0000 7f0d3b7fe640 1 -- 172.21.15.132:0/1560757534 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0d44153cd0 con 0x7f0d300039a0 2023-11-18T20:40:21.335 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-11-18T20:40:21.335 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBrIFllsbdTOxAAP60vfd0AqFNopXTOFb78Tw== 2023-11-18T20:40:21.335 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow" 2023-11-18T20:40:21.335 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2023-11-18T20:40:21.335 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-18T20:40:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-11-18T20:40:21.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d2406ae40 msgr2=0x7f0d2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d2406ae40 0x7f0d2406d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406eee0 tx=0x7f0d2c008040 comp rx=0 tx=0).stop 2023-11-18T20:40:21.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 msgr2=0x7f0d4406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d4406d260 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0d3402bf90 tx=0x7f0d340014a0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 shutdown_connections 2023-11-18T20:40:21.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0d2406ae40 0x7f0d2406d300 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d44154d90 0x7f0d441e9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d44154930 0x7f0d441e95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 --2- 172.21.15.132:0/1560757534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300039a0 0x7f0d4406d260 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.336+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 >> 172.21.15.132:0/1560757534 conn(0x7f0d440c39e0 msgr2=0x7f0d4406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:21.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.337+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 shutdown_connections 2023-11-18T20:40:21.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.337+0000 7f0d49615640 1 -- 172.21.15.132:0/1560757534 wait complete. 2023-11-18T20:40:21.357 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:21.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.567+0000 7f163a644640 1 Processor -- start 2023-11-18T20:40:21.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.568+0000 7f163a644640 1 -- start start 2023-11-18T20:40:21.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.569+0000 7f163a644640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f16340a6c50 0x7f16341571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.569+0000 7f163a644640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1634157710 0x7f1634157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.569+0000 7f163a644640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340c6390 con 0x7f16340c6830 2023-11-18T20:40:21.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.569+0000 7f163a644640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340c3900 con 0x7f16340a6c50 2023-11-18T20:40:21.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.569+0000 7f163a644640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1634157bc0 con 0x7f1634157710 2023-11-18T20:40:21.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.569+0000 7f1633fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f16340c6830 0x7f16340c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54844/0 (socket says 172.21.15.132:54844) 2023-11-18T20:40:21.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.569+0000 7f1633fff640 1 -- 172.21.15.132:0/2838231264 learned_addr learned my addr 172.21.15.132:0/2838231264 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:21.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1638be1640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1634157710 0x7f1634157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f16337fe640 1 --2- 172.21.15.132:0/2838231264 >> v2:172.21.15.161:3300/0 conn(0x7f16340a6c50 0x7f16341571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067702285 0 0) 0x7f16340c6390 con 0x7f16340c6830 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1614003520 con 0x7f16340c6830 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1382964890 0 0) 0x7f1614003520 con 0x7f16340c6830 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1634157710 msgr2=0x7f1634157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1634157710 0x7f1634157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 >> v2:172.21.15.161:3300/0 conn(0x7f16340a6c50 msgr2=0x7f16341571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 --2- 172.21.15.132:0/2838231264 >> v2:172.21.15.161:3300/0 conn(0x7f16340a6c50 0x7f16341571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16340c5dd0 con 0x7f16340c6830 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f1624001670 con 0x7f16340c6830 2023-11-18T20:40:21.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 >> v1:172.21.15.132:6789/0 conn(0x7f16340c6830 legacy=0x7f16340c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f1614003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16140047c0 0x7f1614004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1634157710 0x7f1614005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340c3900 con 0x7f1614003970 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1634157bc0 con 0x7f16140047c0 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.570+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161400ba00 con 0x7f1634157710 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.571+0000 7f1633fff640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f1614003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.571+0000 7f16337fe640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16140047c0 0x7f1614004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.571+0000 7f1638be1640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1634157710 0x7f1614005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.571+0000 7f1633fff640 1 -- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1634157710 msgr2=0x7f1614005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:21.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.571+0000 7f1633fff640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1634157710 0x7f1614005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.571+0000 7f1633fff640 1 -- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16140047c0 msgr2=0x7f1614004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:21.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.571+0000 7f1633fff640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16140047c0 0x7f1614004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.571+0000 7f1633fff640 1 -- 172.21.15.132:0/2838231264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614003520 con 0x7f1614003970 2023-11-18T20:40:21.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.573+0000 7f1633fff640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f1614003d90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f162400c240 tx=0x7f16140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d395f352e4df3884 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:21.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.573+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624005ad0 con 0x7f1614003970 2023-11-18T20:40:21.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.573+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624005c30 con 0x7f1614003970 2023-11-18T20:40:21.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.573+0000 7f1632ffd640 1 -- 172.21.15.132:0/2838231264 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162402c8b0 con 0x7f1614003970 2023-11-18T20:40:21.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.574+0000 7f163a644640 1 -- 172.21.15.132:0/2838231264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 msgr2=0x7f1614003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.574+0000 7f163a644640 1 --2- 172.21.15.132:0/2838231264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f1614003d90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f162400c240 tx=0x7f16140057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.574+0000 7f1638be1640 1 -- 172.21.15.132:0/2838231264 reap_dead start 2023-11-18T20:40:21.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.574+0000 7f163a644640 1 -- 172.21.15.132:0/2838231264 shutdown_connections 2023-11-18T20:40:21.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.574+0000 7f163a644640 1 -- 172.21.15.132:0/2838231264 >> 172.21.15.132:0/2838231264 conn(0x7f16340c7e30 msgr2=0x7f16340c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:21.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.574+0000 7f163a644640 1 -- 172.21.15.132:0/2838231264 shutdown_connections 2023-11-18T20:40:21.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.574+0000 7f163a644640 1 -- 172.21.15.132:0/2838231264 wait complete. 2023-11-18T20:40:21.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.576+0000 7f163a644640 1 Processor -- start 2023-11-18T20:40:21.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.576+0000 7f163a644640 1 -- start start 2023-11-18T20:40:21.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f163a644640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f16341ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f163a644640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1634150840 0x7f16341500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f163a644640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16340a83d0 0x7f16340a8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f163a644640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163406ddf0 con 0x7f1614003970 2023-11-18T20:40:21.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f163a644640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16341ed460 con 0x7f1634150840 2023-11-18T20:40:21.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f163a644640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16341505f0 con 0x7f16340a83d0 2023-11-18T20:40:21.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f1633fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f16341ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f1633fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f16341ecf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39204/0 (socket says 172.21.15.132:39204) 2023-11-18T20:40:21.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f1633fff640 1 -- 172.21.15.132:0/3420070998 learned_addr learned my addr 172.21.15.132:0/3420070998 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f1633fff640 1 -- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16340a83d0 msgr2=0x7f16340a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f1633fff640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16340a83d0 0x7f16340a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f16337fe640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1634150840 0x7f16341500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f1633fff640 1 -- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1634150840 msgr2=0x7f16341500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f1633fff640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1634150840 0x7f16341500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.577+0000 7f1633fff640 1 -- 172.21.15.132:0/3420070998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16341ed720 con 0x7f1614003970 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.578+0000 7f1633fff640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f16341ecf20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f162400c240 tx=0x7f1624001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.578+0000 7f1630ff9640 1 -- 172.21.15.132:0/3420070998 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624039070 con 0x7f1614003970 2023-11-18T20:40:21.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.578+0000 7f1630ff9640 1 -- 172.21.15.132:0/3420070998 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624000fe0 con 0x7f1614003970 2023-11-18T20:40:21.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.578+0000 7f1630ff9640 1 -- 172.21.15.132:0/3420070998 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162403c040 con 0x7f1614003970 2023-11-18T20:40:21.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.578+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16341eda00 con 0x7f1614003970 2023-11-18T20:40:21.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.578+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16341edfc0 con 0x7f1614003970 2023-11-18T20:40:21.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.579+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1634066d40 con 0x7f1614003970 2023-11-18T20:40:21.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.580+0000 7f1630ff9640 1 -- 172.21.15.132:0/3420070998 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1624032070 con 0x7f1614003970 2023-11-18T20:40:21.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.581+0000 7f1630ff9640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f161806ae70 0x7f161806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:21.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.581+0000 7f1630ff9640 1 -- 172.21.15.132:0/3420070998 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16240aa830 con 0x7f1614003970 2023-11-18T20:40:21.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.582+0000 7f16337fe640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f161806ae70 0x7f161806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:21.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.583+0000 7f16337fe640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f161806ae70 0x7f161806d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1634154050 tx=0x7f161c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:21.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.586+0000 7f1630ff9640 1 -- 172.21.15.132:0/3420070998 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16240759f0 con 0x7f1614003970 2023-11-18T20:40:21.775 INFO:tasks.ceph.mds.c.smithi132.stderr:2023-11-18T20:40:21.774+0000 7fd8f0dfa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:40:21.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.814+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f163404e920 con 0x7f1614003970 2023-11-18T20:40:21.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.815+0000 7f1630ff9640 1 -- 172.21.15.132:0/3420070998 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f1624079010 con 0x7f1614003970 2023-11-18T20:40:21.817 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:21.817 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:15.246098+0000","modified":"2023-11-18T20:40:18.344815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/3392191515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3392191515},{"type":"v1","addr":"172.21.15.132:6835","nonce":3392191515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-18T20:40:21.817 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 30 2023-11-18T20:40:21.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f161806ae70 msgr2=0x7f161806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f161806ae70 0x7f161806d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1634154050 tx=0x7f161c00b040 comp rx=0 tx=0).stop 2023-11-18T20:40:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 msgr2=0x7f16341ecf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f16341ecf20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f162400c240 tx=0x7f1624001a00 comp rx=0 tx=0).stop 2023-11-18T20:40:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 shutdown_connections 2023-11-18T20:40:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f161806ae70 0x7f161806d330 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16340a83d0 0x7f16340a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1634150840 0x7f16341500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 --2- 172.21.15.132:0/3420070998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1614003970 0x7f16341ecf20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.818+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 >> 172.21.15.132:0/3420070998 conn(0x7f16340c7e30 msgr2=0x7f16340c1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.819+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 shutdown_connections 2023-11-18T20:40:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:21.819+0000 7f163a644640 1 -- 172.21.15.132:0/3420070998 wait complete. 2023-11-18T20:40:22.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T20:40:15.246098+0000', 'modified': '2023-11-18T20:40:18.344815+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5781}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5781': {'gid': 5781, 'name': 'c', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6835/3392191515', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6834', 'nonce': 3392191515}, {'type': 'v1', 'addr': '172.21.15.132:6835', 'nonce': 3392191515}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-18T20:40:22.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T20:40:22.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-18T20:40:22.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.463+0000 7fd6e7fff640 1 Processor -- start 2023-11-18T20:40:22.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.463+0000 7fd6e7fff640 1 -- start start 2023-11-18T20:40:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.464+0000 7fd6e7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6e806cd20 0x7fd6e815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.464+0000 7fd6e7fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e80a8380 con 0x7fd6e814e7f0 2023-11-18T20:40:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e7fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e81510b0 con 0x7fd6e80c52e0 2023-11-18T20:40:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e7fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e806bf60 con 0x7fd6e806cd20 2023-11-18T20:40:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e6ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd6e814e7f0 0x7fd6e80c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54856/0 (socket says 172.21.15.132:54856) 2023-11-18T20:40:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e6ffd640 1 -- 172.21.15.132:0/208519853 learned_addr learned my addr 172.21.15.132:0/208519853 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/208519853 >> v2:172.21.15.132:3300/0 conn(0x7fd6e806cd20 0x7fd6e815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e5ffb640 1 -- 172.21.15.132:0/208519853 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093816389 0 0) 0x7fd6e80a8380 con 0x7fd6e814e7f0 2023-11-18T20:40:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e5ffb640 1 -- 172.21.15.132:0/208519853 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d4003520 con 0x7fd6e814e7f0 2023-11-18T20:40:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e77fe640 1 -- 172.21.15.132:0/208519853 >> v1:172.21.15.161:6789/0 conn(0x7fd6e80c52e0 legacy=0x7fd6e806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e77fe640 1 -- 172.21.15.132:0/208519853 >> v1:172.21.15.132:6789/0 conn(0x7fd6e814e7f0 legacy=0x7fd6e80c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.465+0000 7fd6e77fe640 1 -- 172.21.15.132:0/208519853 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e806c240 con 0x7fd6e806cd20 2023-11-18T20:40:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.466+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/208519853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e806cd20 0x7fd6e815ca40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00097a0 tx=0x7fd6e002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529e7a97fa8c9348 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.467+0000 7fd6e5ffb640 1 -- 172.21.15.132:0/208519853 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e002e070 con 0x7fd6e806cd20 2023-11-18T20:40:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.467+0000 7fd6e5ffb640 1 -- 172.21.15.132:0/208519853 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e00315a0 con 0x7fd6e806cd20 2023-11-18T20:40:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.467+0000 7fd6e5ffb640 1 -- 172.21.15.132:0/208519853 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0031930 con 0x7fd6e806cd20 2023-11-18T20:40:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.467+0000 7fd6e7fff640 1 -- 172.21.15.132:0/208519853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e806cd20 msgr2=0x7fd6e815ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.467+0000 7fd6e7fff640 1 --2- 172.21.15.132:0/208519853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e806cd20 0x7fd6e815ca40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00097a0 tx=0x7fd6e002b840 comp rx=0 tx=0).stop 2023-11-18T20:40:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.467+0000 7fd6e7fff640 1 -- 172.21.15.132:0/208519853 shutdown_connections 2023-11-18T20:40:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.467+0000 7fd6e7fff640 1 --2- 172.21.15.132:0/208519853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e806cd20 0x7fd6e815ca40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.467+0000 7fd6e7fff640 1 -- 172.21.15.132:0/208519853 >> 172.21.15.132:0/208519853 conn(0x7fd6e80a77f0 msgr2=0x7fd6e80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:22.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.468+0000 7fd6e7fff640 1 -- 172.21.15.132:0/208519853 shutdown_connections 2023-11-18T20:40:22.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.468+0000 7fd6e7fff640 1 -- 172.21.15.132:0/208519853 wait complete. 2023-11-18T20:40:22.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.469+0000 7fd6e7fff640 1 Processor -- start 2023-11-18T20:40:22.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.469+0000 7fd6e7fff640 1 -- start start 2023-11-18T20:40:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.470+0000 7fd6e7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6e806cd20 0x7fd6e81e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.470+0000 7fd6e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e80c52e0 0x7fd6e81477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.470+0000 7fd6e7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e814e7f0 0x7fd6e814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.470+0000 7fd6e7fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80aad60 con 0x7fd6e80c52e0 2023-11-18T20:40:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.470+0000 7fd6e7fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81e85a0 con 0x7fd6e814e7f0 2023-11-18T20:40:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.470+0000 7fd6e7fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81e8880 con 0x7fd6e806cd20 2023-11-18T20:40:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.470+0000 7fd6e67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e80c52e0 0x7fd6e81477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e80c52e0 0x7fd6e81477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39222/0 (socket says 172.21.15.132:39222) 2023-11-18T20:40:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e67fc640 1 -- 172.21.15.132:0/1905369425 learned_addr learned my addr 172.21.15.132:0/1905369425 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6e806cd20 0x7fd6e81e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e814e7f0 0x7fd6e814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e67fc640 1 -- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6e806cd20 msgr2=0x7fd6e81e7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6e806cd20 0x7fd6e81e7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e67fc640 1 -- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e814e7f0 msgr2=0x7fd6e814d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e814e7f0 0x7fd6e814d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e67fc640 1 -- 172.21.15.132:0/1905369425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0009400 con 0x7fd6e80c52e0 2023-11-18T20:40:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e80c52e0 0x7fd6e81477c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c7c0 tx=0x7fd6d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.471+0000 7fd6df7fe640 1 -- 172.21.15.132:0/1905369425 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000aa50 con 0x7fd6e80c52e0 2023-11-18T20:40:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.472+0000 7fd6df7fe640 1 -- 172.21.15.132:0/1905369425 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d000abb0 con 0x7fd6e80c52e0 2023-11-18T20:40:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.472+0000 7fd6df7fe640 1 -- 172.21.15.132:0/1905369425 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0012420 con 0x7fd6e80c52e0 2023-11-18T20:40:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.472+0000 7fd6e7fff640 1 -- 172.21.15.132:0/1905369425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e81e8b60 con 0x7fd6e80c52e0 2023-11-18T20:40:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.472+0000 7fd6e7fff640 1 -- 172.21.15.132:0/1905369425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e8148a90 con 0x7fd6e80c52e0 2023-11-18T20:40:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.474+0000 7fd6df7fe640 1 -- 172.21.15.132:0/1905369425 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6d0012580 con 0x7fd6e80c52e0 2023-11-18T20:40:22.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.475+0000 7fd6df7fe640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd6c806ae40 0x7fd6c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.475+0000 7fd6df7fe640 1 -- 172.21.15.132:0/1905369425 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6d0089590 con 0x7fd6e80c52e0 2023-11-18T20:40:22.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.475+0000 7fd6efbfd740 1 Processor -- start 2023-11-18T20:40:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.476+0000 7fd6efbfd740 1 -- start start 2023-11-18T20:40:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.476+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd6c806ae40 0x7fd6c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.476+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b93e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b78390 0x55ca92b96e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b94bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca92ab7880 con 0x55ca92b93a70 2023-11-18T20:40:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca92ac6ae0 con 0x55ca92b5a7c0 2023-11-18T20:40:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca92ac41d0 con 0x55ca92b78390 2023-11-18T20:40:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b93e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b93e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39228/0 (socket says 172.21.15.132:39228) 2023-11-18T20:40:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 -- 172.21.15.132:0/2328602713 learned_addr learned my addr 172.21.15.132:0/2328602713 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b94bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b78390 0x55ca92b96e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 -- 172.21.15.132:0/2328602713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b78390 msgr2=0x55ca92b96e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b78390 0x55ca92b96e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 -- 172.21.15.132:0/2328602713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 msgr2=0x55ca92b94bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b94bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 -- 172.21.15.132:0/2328602713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca92a87860 con 0x55ca92b93a70 2023-11-18T20:40:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.477+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd6c806ae40 0x7fd6c806d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80011e0 tx=0x7fd6d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.478+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b93e50 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8005ac0 tx=0x7fd6d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25abe86bdbd9049 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.478+0000 7fd6dcff9640 1 -- 172.21.15.132:0/2328602713 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8007750 con 0x55ca92b93a70 2023-11-18T20:40:22.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.478+0000 7fd6dcff9640 1 -- 172.21.15.132:0/2328602713 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d800d4a0 con 0x55ca92b93a70 2023-11-18T20:40:22.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.478+0000 7fd6dcff9640 1 -- 172.21.15.132:0/2328602713 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800d870 con 0x55ca92b93a70 2023-11-18T20:40:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 -- 172.21.15.132:0/2328602713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 msgr2=0x55ca92b93e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b93e50 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8005ac0 tx=0x7fd6d8018000 comp rx=0 tx=0).stop 2023-11-18T20:40:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 -- 172.21.15.132:0/2328602713 shutdown_connections 2023-11-18T20:40:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b94bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b78390 0x55ca92b96e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/2328602713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b93e50 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 -- 172.21.15.132:0/2328602713 >> 172.21.15.132:0/2328602713 conn(0x55ca92b1abb0 msgr2=0x55ca92b7a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 -- 172.21.15.132:0/2328602713 shutdown_connections 2023-11-18T20:40:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 -- 172.21.15.132:0/2328602713 wait complete. 2023-11-18T20:40:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.479+0000 7fd6efbfd740 1 -- start start 2023-11-18T20:40:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.480+0000 7fd6efbfd740 1 Processor -- start 2023-11-18T20:40:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 0x55ca92b960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b59000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b7bee0 0x55ca92b7c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca92abfac0 con 0x55ca92b93a70 2023-11-18T20:40:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca92a5c2f0 con 0x55ca92b7bee0 2023-11-18T20:40:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca92a79c70 con 0x55ca92b5a7c0 2023-11-18T20:40:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6efbfd740 10 client.0 _ll_register_callbacks cb 0x55ca92a7e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:40:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b59000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b59000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39242/0 (socket says 172.21.15.132:39242) 2023-11-18T20:40:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e67fc640 1 -- 172.21.15.132:0/4195705279 learned_addr learned my addr 172.21.15.132:0/4195705279 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 0x55ca92b960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e67fc640 1 -- 172.21.15.132:0/4195705279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 msgr2=0x55ca92b960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 0x55ca92b960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e67fc640 1 -- 172.21.15.132:0/4195705279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b7bee0 msgr2=0x55ca92b7c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b7bee0 0x55ca92b7c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.481+0000 7fd6e67fc640 1 -- 172.21.15.132:0/4195705279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d4003520 con 0x55ca92b93a70 2023-11-18T20:40:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b59000 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00600c0 tx=0x7fd6d005c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1f71b6f648dba8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-11-18T20:40:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/4195705279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0054a00 con 0x55ca92b93a70 2023-11-18T20:40:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/4195705279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6d0054b60 con 0x55ca92b93a70 2023-11-18T20:40:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6efbfd740 1 -- 172.21.15.132:0/4195705279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca92ab8aa0 con 0x55ca92b93a70 2023-11-18T20:40:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/4195705279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6d0060160 con 0x55ca92b93a70 2023-11-18T20:40:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6efbfd740 10 client.5931 fetch_fsmap learned FSMap version 30 2023-11-18T20:40:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6efbfd740 1 -- 172.21.15.132:0/4195705279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55ca92abe140 con 0x55ca92b93a70 2023-11-18T20:40:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/4195705279 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca92ab8aa0 con 0x55ca92b93a70 2023-11-18T20:40:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/4195705279 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd6d00890c0 con 0x55ca92b93a70 2023-11-18T20:40:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6efbfd740 10 client.5931 fetch_fsmap finished waiting for FSMap version 30 2023-11-18T20:40:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.482+0000 7fd6efbfd740 10 client.5931 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-18T20:40:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.483+0000 7fd6efbfd740 20 client.5931 populate_metadata read hostname 'smithi132' 2023-11-18T20:40:22.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.483+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] conn(0x55ca92b574d0 0x55ca92b578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.483+0000 7fd6efbfd740 4 client.5931 mds_command: new command op to 5781 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T20:40:22.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.483+0000 7fd6efbfd740 1 -- 172.21.15.132:0/4195705279 --> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca92ab87c0 con 0x55ca92b574d0 2023-11-18T20:40:22.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.483+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] conn(0x55ca92b574d0 0x55ca92b578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.483+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] conn(0x55ca92b574d0 0x55ca92b578b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4928c0a1005b632e server_cookie=d3f636bdc33276d5 in_seq=0 out_seq=0 2023-11-18T20:40:22.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.483+0000 7fd6c5ffb640 10 client.5931 ms_handle_connect on v2:172.21.15.132:6834/3392191515 2023-11-18T20:40:22.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.484+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/4195705279 <== mds.0 v2:172.21.15.132:6834/3392191515 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ca92ab87c0 con 0x55ca92b574d0 2023-11-18T20:40:22.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.484+0000 7fd6c5ffb640 10 client.5931 handle_command_reply: tid=0 2023-11-18T20:40:22.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.484+0000 7fd6efbfd740 1 client.5931 shutdown 2023-11-18T20:40:22.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.484+0000 7fd6efbfd740 1 -- 172.21.15.132:0/4195705279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 msgr2=0x55ca92b59000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.484+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b59000 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00600c0 tx=0x7fd6d005c440 comp rx=0 tx=0).stop 2023-11-18T20:40:22.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 1 -- 172.21.15.132:0/4195705279 shutdown_connections 2023-11-18T20:40:22.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b7bee0 0x55ca92b7c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b59000 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] conn(0x55ca92b574d0 0x55ca92b578b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/4195705279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 0x55ca92b960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 1 -- 172.21.15.132:0/4195705279 >> 172.21.15.132:0/4195705279 conn(0x55ca92b1abb0 msgr2=0x55ca92b99440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:22.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6c5ffb640 0 client.5931 ms_handle_reset on v2:172.21.15.132:6834/3392191515 2023-11-18T20:40:22.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 1 -- 172.21.15.132:0/4195705279 shutdown_connections 2023-11-18T20:40:22.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 1 -- 172.21.15.132:0/4195705279 wait complete. 2023-11-18T20:40:22.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.485+0000 7fd6efbfd740 20 client.5931 trim_cache size 0 max 16384 2023-11-18T20:40:22.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.502+0000 7fd6efbfd740 1 Processor -- start 2023-11-18T20:40:22.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.502+0000 7fd6efbfd740 1 -- start start 2023-11-18T20:40:22.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 0x55ca92bbc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b7bee0 0x55ca92b7abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b7d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca92822f20 con 0x55ca92b93a70 2023-11-18T20:40:22.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca92b595e0 con 0x55ca92b7bee0 2023-11-18T20:40:22.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca92b58050 con 0x55ca92b5a7c0 2023-11-18T20:40:22.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6e77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b7d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6e77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b7d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39252/0 (socket says 172.21.15.132:39252) 2023-11-18T20:40:22.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6e77fe640 1 -- 172.21.15.132:0/1423751883 learned_addr learned my addr 172.21.15.132:0/1423751883 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:22.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6e77fe640 1 -- 172.21.15.132:0/1423751883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 msgr2=0x55ca92bbc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/1423751883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 0x55ca92bbc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6e77fe640 1 -- 172.21.15.132:0/1423751883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b7bee0 msgr2=0x55ca92b7abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/1423751883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b7bee0 0x55ca92b7abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.503+0000 7fd6e77fe640 1 -- 172.21.15.132:0/1423751883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca92a5bb80 con 0x55ca92b93a70 2023-11-18T20:40:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.504+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/1423751883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b7d350 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009890 tx=0x7fd6e0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea03c61d93b50e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.504+0000 7fd6dd7fa640 1 -- 172.21.15.132:0/1423751883 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0031910 con 0x55ca92b93a70 2023-11-18T20:40:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.504+0000 7fd6dd7fa640 1 -- 172.21.15.132:0/1423751883 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e0031a70 con 0x55ca92b93a70 2023-11-18T20:40:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.504+0000 7fd6dd7fa640 1 -- 172.21.15.132:0/1423751883 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0031e20 con 0x55ca92b93a70 2023-11-18T20:40:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.504+0000 7fd6efbfd740 1 -- 172.21.15.132:0/1423751883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 msgr2=0x55ca92b7d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.504+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/1423751883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b7d350 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009890 tx=0x7fd6e0030000 comp rx=0 tx=0).stop 2023-11-18T20:40:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 -- 172.21.15.132:0/1423751883 shutdown_connections 2023-11-18T20:40:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/1423751883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92b7d350 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/1423751883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b7bee0 0x55ca92b7abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/1423751883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b5a7c0 0x55ca92bbc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 -- 172.21.15.132:0/1423751883 >> 172.21.15.132:0/1423751883 conn(0x55ca92b1abb0 msgr2=0x55ca92b95ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:22.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 -- 172.21.15.132:0/1423751883 shutdown_connections 2023-11-18T20:40:22.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 -- 172.21.15.132:0/1423751883 wait complete. 2023-11-18T20:40:22.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 -- start start 2023-11-18T20:40:22.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.505+0000 7fd6efbfd740 1 Processor -- start 2023-11-18T20:40:22.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.506+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b9bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.506+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b7bee0 0x55ca92b9dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.506+0000 7fd6efbfd740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92c01530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.506+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca92b9c1e0 con 0x55ca92b93a70 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.506+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca92b8b590 con 0x55ca92b5a7c0 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.506+0000 7fd6efbfd740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca92b7e660 con 0x55ca92b7bee0 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6efbfd740 10 client.0 _ll_register_callbacks cb 0x7fd6d0054630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92c01530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92c01530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39258/0 (socket says 172.21.15.132:39258) 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e77fe640 1 -- 172.21.15.132:0/3273613186 learned_addr learned my addr 172.21.15.132:0/3273613186 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b9bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b7bee0 0x55ca92b9dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e77fe640 1 -- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b7bee0 msgr2=0x55ca92b9dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b7bee0 0x55ca92b9dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e77fe640 1 -- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 msgr2=0x55ca92b9bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b9bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e77fe640 1 -- 172.21.15.132:0/3273613186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e806c240 con 0x55ca92b93a70 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b9bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.507+0000 7fd6e67fc640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b7bee0 0x55ca92b9dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6e77fe640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92c01530 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00097a0 tx=0x7fd6e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dcb4d0f8538e77 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/3273613186 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0004030 con 0x55ca92b93a70 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/3273613186 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6e0040070 con 0x55ca92b93a70 2023-11-18T20:40:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6efbfd740 1 -- 172.21.15.132:0/3273613186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca92b7e990 con 0x55ca92b93a70 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/3273613186 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6e0004190 con 0x55ca92b93a70 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6efbfd740 10 client.5937 fetch_fsmap learned FSMap version 30 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6efbfd740 1 -- 172.21.15.132:0/3273613186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55ca92a81170 con 0x55ca92b93a70 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/3273613186 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca92b7e990 con 0x55ca92b93a70 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/3273613186 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd6e00042f0 con 0x55ca92b93a70 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6efbfd740 10 client.5937 fetch_fsmap finished waiting for FSMap version 30 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6efbfd740 10 client.5937 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.508+0000 7fd6efbfd740 20 client.5937 populate_metadata read hostname 'smithi132' 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] conn(0x55ca92c01ac0 0x55ca92c07830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6efbfd740 4 client.5937 mds_command: new command op to 5781 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T20:40:22.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6efbfd740 1 -- 172.21.15.132:0/3273613186 --> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fd6d800d4a0 con 0x55ca92c01ac0 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] conn(0x55ca92c01ac0 0x55ca92c07830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6e6ffd640 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] conn(0x55ca92c01ac0 0x55ca92c07830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c559ae95f2fa74 server_cookie=be0d409537e3fbda in_seq=0 out_seq=0 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6c5ffb640 10 client.5937 ms_handle_connect on v2:172.21.15.132:6834/3392191515 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6c5ffb640 1 -- 172.21.15.132:0/3273613186 <== mds.0 v2:172.21.15.132:6834/3392191515 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7fd6d800d4a0 con 0x55ca92c01ac0 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6c5ffb640 10 client.5937 handle_command_reply: tid=0 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.509+0000 7fd6efbfd740 1 client.5937 shutdown 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 -- 172.21.15.132:0/3273613186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 msgr2=0x55ca92c01530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92c01530 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00097a0 tx=0x7fd6e0004730 comp rx=0 tx=0).stop 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 -- 172.21.15.132:0/3273613186 shutdown_connections 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ca92b93a70 0x55ca92c01530 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.132:6834/3392191515,v1:172.21.15.132:6835/3392191515] conn(0x55ca92c01ac0 0x55ca92c07830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ca92b7bee0 0x55ca92b9dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 --2- 172.21.15.132:0/3273613186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ca92b5a7c0 0x55ca92b9bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6c5ffb640 0 client.5937 ms_handle_reset on v2:172.21.15.132:6834/3392191515 2023-11-18T20:40:22.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 -- 172.21.15.132:0/3273613186 >> 172.21.15.132:0/3273613186 conn(0x55ca92b1abb0 msgr2=0x55ca92b9e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:22.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 -- 172.21.15.132:0/3273613186 shutdown_connections 2023-11-18T20:40:22.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 1 -- 172.21.15.132:0/3273613186 wait complete. 2023-11-18T20:40:22.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.510+0000 7fd6efbfd740 20 client.5937 trim_cache size 0 max 16384 2023-11-18T20:40:22.517 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:40:22.517 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "95273225-bfbe-4b9a-893d-dfaf6292d673", 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5781, 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 6.6830005190000001, 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 30, 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 55, 2023-11-18T20:40:22.518 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 55, 2023-11-18T20:40:22.519 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 12.216803130000001 2023-11-18T20:40:22.519 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:40:22.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 -- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd6c806ae40 msgr2=0x7fd6c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd6c806ae40 0x7fd6c806d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80011e0 tx=0x7fd6d8009040 comp rx=0 tx=0).stop 2023-11-18T20:40:22.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 -- 172.21.15.132:0/1905369425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e80c52e0 msgr2=0x7fd6e81477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e80c52e0 0x7fd6e81477c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c7c0 tx=0x7fd6d000cc80 comp rx=0 tx=0).stop 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 -- 172.21.15.132:0/1905369425 shutdown_connections 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd6c806ae40 0x7fd6c806d300 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6e814e7f0 0x7fd6e814d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e80c52e0 0x7fd6e81477c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 --2- 172.21.15.132:0/1905369425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6e806cd20 0x7fd6e81e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 -- 172.21.15.132:0/1905369425 >> 172.21.15.132:0/1905369425 conn(0x7fd6e80a77f0 msgr2=0x7fd6e814b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 -- 172.21.15.132:0/1905369425 shutdown_connections 2023-11-18T20:40:22.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.511+0000 7fd6e7fff640 1 -- 172.21.15.132:0/1905369425 wait complete. 2023-11-18T20:40:22.528 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:40:22.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.738+0000 7ff58ea34640 1 Processor -- start 2023-11-18T20:40:22.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.739+0000 7ff58ea34640 1 -- start start 2023-11-18T20:40:22.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.740+0000 7ff58ea34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff588152f20 0x7ff5880c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.740+0000 7ff58ea34640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5880c64a0 con 0x7ff58814fd30 2023-11-18T20:40:22.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.740+0000 7ff58ea34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5880c5c00 con 0x7ff58806d0a0 2023-11-18T20:40:22.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.740+0000 7ff58ea34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5880c5ee0 con 0x7ff588152f20 2023-11-18T20:40:22.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.740+0000 7ff587fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff58814fd30 0x7ff5880a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54868/0 (socket says 172.21.15.132:54868) 2023-11-18T20:40:22.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.740+0000 7ff587fff640 1 -- 172.21.15.132:0/1135340609 learned_addr learned my addr 172.21.15.132:0/1135340609 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff58cfd1640 1 --2- 172.21.15.132:0/1135340609 >> v2:172.21.15.161:3300/0 conn(0x7ff588152f20 0x7ff5880c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671620678 0 0) 0x7ff5880c64a0 con 0x7ff58814fd30 2023-11-18T20:40:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff574003520 con 0x7ff58814fd30 2023-11-18T20:40:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1625118185 0 0) 0x7ff574003520 con 0x7ff58814fd30 2023-11-18T20:40:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 >> v2:172.21.15.161:3300/0 conn(0x7ff588152f20 msgr2=0x7ff5880c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 --2- 172.21.15.132:0/1135340609 >> v2:172.21.15.161:3300/0 conn(0x7ff588152f20 0x7ff5880c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 >> v1:172.21.15.161:6789/0 conn(0x7ff58806d0a0 legacy=0x7ff5880c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5880c61c0 con 0x7ff58814fd30 2023-11-18T20:40:22.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7ff578001670 con 0x7ff58814fd30 2023-11-18T20:40:22.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 >> v1:172.21.15.132:6789/0 conn(0x7ff58814fd30 legacy=0x7ff5880a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff574003970 0x7ff574003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5740047c0 0x7ff574004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574005180 0x7ff57400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.741+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5880c5ee0 con 0x7ff574005180 2023-11-18T20:40:22.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57400c020 con 0x7ff5740047c0 2023-11-18T20:40:22.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57400c1e0 con 0x7ff574003970 2023-11-18T20:40:22.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff58cfd1640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574005180 0x7ff57400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff57ffff640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5740047c0 0x7ff574004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff587fff640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff574003970 0x7ff574003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff58cfd1640 1 -- 172.21.15.132:0/1135340609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff574003970 msgr2=0x7ff574003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff58cfd1640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff574003970 0x7ff574003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff58cfd1640 1 -- 172.21.15.132:0/1135340609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5740047c0 msgr2=0x7ff574004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:22.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff58cfd1640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5740047c0 0x7ff574004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.742+0000 7ff58cfd1640 1 -- 172.21.15.132:0/1135340609 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574003520 con 0x7ff574005180 2023-11-18T20:40:22.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.743+0000 7ff58cfd1640 1 -- 172.21.15.132:0/1135340609 reap_dead start 2023-11-18T20:40:22.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.743+0000 7ff58cfd1640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574005180 0x7ff57400b980 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff580009fc0 tx=0x7ff5740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dda23aea188d33 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.743+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58002cc60 con 0x7ff574005180 2023-11-18T20:40:22.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.743+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58000f040 con 0x7ff574005180 2023-11-18T20:40:22.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.743+0000 7ff5877fe640 1 -- 172.21.15.132:0/1135340609 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580003990 con 0x7ff574005180 2023-11-18T20:40:22.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.744+0000 7ff58ea34640 1 -- 172.21.15.132:0/1135340609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574005180 msgr2=0x7ff57400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.744+0000 7ff58ea34640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574005180 0x7ff57400b980 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff580009fc0 tx=0x7ff5740057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.744+0000 7ff58ea34640 1 -- 172.21.15.132:0/1135340609 shutdown_connections 2023-11-18T20:40:22.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.744+0000 7ff58ea34640 1 --2- 172.21.15.132:0/1135340609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574005180 0x7ff57400b980 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.744+0000 7ff58ea34640 1 -- 172.21.15.132:0/1135340609 >> 172.21.15.132:0/1135340609 conn(0x7ff58806a500 msgr2=0x7ff58806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:22.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.744+0000 7ff58ea34640 1 -- 172.21.15.132:0/1135340609 shutdown_connections 2023-11-18T20:40:22.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.744+0000 7ff58ea34640 1 -- 172.21.15.132:0/1135340609 wait complete. 2023-11-18T20:40:22.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.746+0000 7ff58ea34640 1 Processor -- start 2023-11-18T20:40:22.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.746+0000 7ff58ea34640 1 -- start start 2023-11-18T20:40:22.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff58ea34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff574005180 0x7ff5881eb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff58ea34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5881eb690 0x7ff58814aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff58ea34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58814afb0 0x7ff5881e9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff58ea34640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5880a82c0 con 0x7ff5881eb690 2023-11-18T20:40:22.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff58ea34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5881ebaf0 con 0x7ff574005180 2023-11-18T20:40:22.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff58ea34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5881e9490 con 0x7ff58814afb0 2023-11-18T20:40:22.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff57ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5881eb690 0x7ff58814aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff57ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5881eb690 0x7ff58814aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39276/0 (socket says 172.21.15.132:39276) 2023-11-18T20:40:22.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.747+0000 7ff57ffff640 1 -- 172.21.15.132:0/757829149 learned_addr learned my addr 172.21.15.132:0/757829149 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:22.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff58cfd1640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58814afb0 0x7ff5881e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff57ffff640 1 -- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58814afb0 msgr2=0x7ff5881e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff587fff640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff574005180 0x7ff5881eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff57ffff640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58814afb0 0x7ff5881e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff57ffff640 1 -- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff574005180 msgr2=0x7ff5881eb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff57ffff640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff574005180 0x7ff5881eb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff57ffff640 1 -- 172.21.15.132:0/757829149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5881e9160 con 0x7ff5881eb690 2023-11-18T20:40:22.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff58cfd1640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58814afb0 0x7ff5881e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:22.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff587fff640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff574005180 0x7ff5881eb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:22.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff57ffff640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5881eb690 0x7ff58814aa70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff57000d480 tx=0x7ff57000d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff5857fa640 1 -- 172.21.15.132:0/757829149 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570005480 con 0x7ff5881eb690 2023-11-18T20:40:22.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff5857fa640 1 -- 172.21.15.132:0/757829149 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff570003610 con 0x7ff5881eb690 2023-11-18T20:40:22.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff5857fa640 1 -- 172.21.15.132:0/757829149 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700039e0 con 0x7ff5881eb690 2023-11-18T20:40:22.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.748+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5881ebd00 con 0x7ff5881eb690 2023-11-18T20:40:22.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.749+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5881555d0 con 0x7ff5881eb690 2023-11-18T20:40:22.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.750+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff588068350 con 0x7ff5881eb690 2023-11-18T20:40:22.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.751+0000 7ff5857fa640 1 -- 172.21.15.132:0/757829149 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff570003b40 con 0x7ff5881eb690 2023-11-18T20:40:22.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.752+0000 7ff5857fa640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56806ae40 0x7ff56806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:22.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.752+0000 7ff5857fa640 1 -- 172.21.15.132:0/757829149 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff570089560 con 0x7ff5881eb690 2023-11-18T20:40:22.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.752+0000 7ff587fff640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56806ae40 0x7ff56806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:22.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.753+0000 7ff587fff640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56806ae40 0x7ff56806d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff5780018e0 tx=0x7ff578009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:22.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.756+0000 7ff5857fa640 1 -- 172.21.15.132:0/757829149 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff5700546c0 con 0x7ff5881eb690 2023-11-18T20:40:22.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.989+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5881e95d0 con 0x7ff5881eb690 2023-11-18T20:40:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.990+0000 7ff5857fa640 1 -- 172.21.15.132:0/757829149 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff570057ce0 con 0x7ff5881eb690 2023-11-18T20:40:22.991 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:40:22.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.992+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56806ae40 msgr2=0x7ff56806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.992+0000 7ff58ea34640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56806ae40 0x7ff56806d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff5780018e0 tx=0x7ff578009040 comp rx=0 tx=0).stop 2023-11-18T20:40:22.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.992+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5881eb690 msgr2=0x7ff58814aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:22.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.992+0000 7ff58ea34640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5881eb690 0x7ff58814aa70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff57000d480 tx=0x7ff57000d940 comp rx=0 tx=0).stop 2023-11-18T20:40:22.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.992+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 shutdown_connections 2023-11-18T20:40:22.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.992+0000 7ff58ea34640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56806ae40 0x7ff56806d300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.993+0000 7ff58ea34640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58814afb0 0x7ff5881e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.993+0000 7ff58ea34640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5881eb690 0x7ff58814aa70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.993+0000 7ff58ea34640 1 --2- 172.21.15.132:0/757829149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff574005180 0x7ff5881eb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:22.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.993+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 >> 172.21.15.132:0/757829149 conn(0x7ff58806a500 msgr2=0x7ff588150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:22.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.993+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 shutdown_connections 2023-11-18T20:40:22.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:22.993+0000 7ff58ea34640 1 -- 172.21.15.132:0/757829149 wait complete. 2023-11-18T20:40:23.013 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T20:40:23.013 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:40:23.013 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-18T20:40:23.013 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-18T20:40:23.014 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:40:23.014 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T20:40:23.014 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:40:23.014 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:40:23.014 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:40:23.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.015 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-18T20:40:23.064 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:40:23.064 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:40:23.065 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:40:23.065 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:23.065 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-18T20:40:23.065 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:23.065 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:23.065 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:23.066 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-18T20:40:23.066 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:23.066 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:23.066 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-18T20:40:23.066 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:23.066 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:23.066 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:40:23.067 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:23.067 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:40:23.067 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42288sec preferred_lft 42288sec 2023-11-18T20:40:23.067 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-18T20:40:23.067 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:23.067 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:40:23.068 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:23.068 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:40:23.068 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:23.068 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::84fc:84ff:fe41:e5e7/64 scope link 2023-11-18T20:40:23.068 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:23.068 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:40:23.068 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T20:40:23.069 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a88f:ebff:fe95:c612/64 scope link 2023-11-18T20:40:23.069 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:23.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.070 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:40:23.207 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-18T20:40:23.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.212 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-18T20:40:23.266 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-18T20:40:23.267 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:40:23.267 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:40:23.267 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:40:23.267 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:40:23.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.267 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:40:23.267 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:40:23.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:40:23.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:40:23.268 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:40:23.268 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:40:23.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.455 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:40:23.505 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T20:40:23.506 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:40:23.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-18T20:40:23.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:40:23.601 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T20:40:23.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:40:23.658 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:40:23.710 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:40:23.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:40:23.850 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:40:23.850 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:40:23.850 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:40:23.872 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:40:23.872 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:40:23.872 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:40:23.872 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:40:23.872 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:40:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:40:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:40:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:40:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:40:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:40:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:40:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:40:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:40:23.905 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-18T20:40:23.905 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:40:23.905 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:40:23.905 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:40:23.905 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:40:23.910 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:40:23.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:40:23.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:23.998 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:40:24.060 INFO:teuthology.orchestra.run.smithi132.stdout:client4859 2023-11-18T20:40:24.060 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:40:24.060 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:24.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:40:24.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.315+0000 7f30aa6a2640 1 Processor -- start 2023-11-18T20:40:24.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.315+0000 7f30aa6a2640 1 -- start start 2023-11-18T20:40:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.316+0000 7f30aa6a2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a406b970 0x7f30a40c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.316+0000 7f30aa6a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30a4151720 0x7f30a4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.316+0000 7f30aa6a2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a40710e0 con 0x7f30a414eae0 2023-11-18T20:40:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.316+0000 7f30aa6a2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40c2cf0 con 0x7f30a4151720 2023-11-18T20:40:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f30aa6a2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4072b90 con 0x7f30a406b970 2023-11-18T20:40:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f30a8c3f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30a4151720 0x7f30a4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f30a8c3f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30a4151720 0x7f30a4151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39290/0 (socket says 172.21.15.132:39290) 2023-11-18T20:40:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f30a8c3f640 1 -- 172.21.15.132:0/198273206 learned_addr learned my addr 172.21.15.132:0/198273206 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f309bfff640 1 --2- 172.21.15.132:0/198273206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a406b970 0x7f30a40c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f30a8c3f640 1 -- 172.21.15.132:0/198273206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a406b970 msgr2=0x7f30a40c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f30a8c3f640 1 --2- 172.21.15.132:0/198273206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a406b970 0x7f30a40c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f30a8c3f640 1 -- 172.21.15.132:0/198273206 >> v1:172.21.15.161:6789/0 conn(0x7f30a414eae0 legacy=0x7f30a406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:24.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.317+0000 7f30a8c3f640 1 -- 172.21.15.132:0/198273206 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a4070840 con 0x7f30a4151720 2023-11-18T20:40:24.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.319+0000 7f30a8c3f640 1 --2- 172.21.15.132:0/198273206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a4151720 0x7f30a4151b90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f309c009e50 tx=0x7f309c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740560f1ca2b9b35 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:24.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.319+0000 7f30a37fe640 1 -- 172.21.15.132:0/198273206 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c02c9e0 con 0x7f30a4151720 2023-11-18T20:40:24.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.319+0000 7f30a37fe640 1 -- 172.21.15.132:0/198273206 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c02cb40 con 0x7f30a4151720 2023-11-18T20:40:24.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.319+0000 7f30a37fe640 1 -- 172.21.15.132:0/198273206 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c0343f0 con 0x7f30a4151720 2023-11-18T20:40:24.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.320+0000 7f30aa6a2640 1 -- 172.21.15.132:0/198273206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a4151720 msgr2=0x7f30a4151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:24.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.320+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/198273206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a4151720 0x7f30a4151b90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f309c009e50 tx=0x7f309c02be40 comp rx=0 tx=0).stop 2023-11-18T20:40:24.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.320+0000 7f30aa6a2640 1 -- 172.21.15.132:0/198273206 shutdown_connections 2023-11-18T20:40:24.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.320+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/198273206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a4151720 0x7f30a4151b90 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.320+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/198273206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a406b970 0x7f30a40c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.320+0000 7f30aa6a2640 1 -- 172.21.15.132:0/198273206 >> 172.21.15.132:0/198273206 conn(0x7f30a40c3120 msgr2=0x7f30a40c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:24.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.320+0000 7f30aa6a2640 1 -- 172.21.15.132:0/198273206 shutdown_connections 2023-11-18T20:40:24.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.320+0000 7f30aa6a2640 1 -- 172.21.15.132:0/198273206 wait complete. 2023-11-18T20:40:24.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.322+0000 7f30aa6a2640 1 Processor -- start 2023-11-18T20:40:24.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.322+0000 7f30aa6a2640 1 -- start start 2023-11-18T20:40:24.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.323+0000 7f30aa6a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a406b970 0x7f30a4150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:24.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.323+0000 7f30aa6a2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a414eae0 0x7f30a41ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:24.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.323+0000 7f30aa6a2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a4151720 0x7f30a41dedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:24.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.323+0000 7f30aa6a2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40ab540 con 0x7f30a406b970 2023-11-18T20:40:24.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.323+0000 7f30aa6a2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a41e9af0 con 0x7f30a4151720 2023-11-18T20:40:24.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.323+0000 7f30aa6a2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a41ede90 con 0x7f30a414eae0 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.323+0000 7f30a3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a406b970 0x7f30a4150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a406b970 0x7f30a4150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39292/0 (socket says 172.21.15.132:39292) 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a3fff640 1 -- 172.21.15.132:0/1888503591 learned_addr learned my addr 172.21.15.132:0/1888503591 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a8c3f640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a4151720 0x7f30a41dedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f309bfff640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a414eae0 0x7f30a41ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a3fff640 1 -- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a414eae0 msgr2=0x7f30a41ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a3fff640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a414eae0 0x7f30a41ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a3fff640 1 -- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a4151720 msgr2=0x7f30a41dedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a3fff640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a4151720 0x7f30a41dedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a3fff640 1 -- 172.21.15.132:0/1888503591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c009b30 con 0x7f30a406b970 2023-11-18T20:40:24.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a3fff640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a406b970 0x7f30a4150fb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f309400b3f0 tx=0x7f309400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:24.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.324+0000 7f30a17fa640 1 -- 172.21.15.132:0/1888503591 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094011830 con 0x7f30a406b970 2023-11-18T20:40:24.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.325+0000 7f30a17fa640 1 -- 172.21.15.132:0/1888503591 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3094011990 con 0x7f30a406b970 2023-11-18T20:40:24.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.325+0000 7f30a17fa640 1 -- 172.21.15.132:0/1888503591 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094011d40 con 0x7f30a406b970 2023-11-18T20:40:24.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.325+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a40ab260 con 0x7f30a406b970 2023-11-18T20:40:24.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.325+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a4149b10 con 0x7f30a406b970 2023-11-18T20:40:24.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.326+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a4149d30 con 0x7f30a406b970 2023-11-18T20:40:24.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.327+0000 7f30a17fa640 1 -- 172.21.15.132:0/1888503591 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f309401a400 con 0x7f30a406b970 2023-11-18T20:40:24.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.328+0000 7f30a17fa640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f308406ae40 0x7f308406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:24.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.328+0000 7f30a17fa640 1 -- 172.21.15.132:0/1888503591 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30940893c0 con 0x7f30a406b970 2023-11-18T20:40:24.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.328+0000 7f309bfff640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f308406ae40 0x7f308406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:24.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.329+0000 7f309bfff640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f308406ae40 0x7f308406d300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f308c006fd0 tx=0x7f308c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:24.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.333+0000 7f30a17fa640 1 -- 172.21.15.132:0/1888503591 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3094054500 con 0x7f30a406b970 2023-11-18T20:40:24.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.558+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f30a4068350 con 0x7f30a406b970 2023-11-18T20:40:24.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.558+0000 7f30a17fa640 1 -- 172.21.15.132:0/1888503591 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3094057b20 con 0x7f30a406b970 2023-11-18T20:40:24.560 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:40:24.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f308406ae40 msgr2=0x7f308406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f308406ae40 0x7f308406d300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f308c006fd0 tx=0x7f308c008040 comp rx=0 tx=0).stop 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a406b970 msgr2=0x7f30a4150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a406b970 0x7f30a4150fb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f309400b3f0 tx=0x7f309400b8b0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 shutdown_connections 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f308406ae40 0x7f308406d300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a4151720 0x7f30a41dedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a414eae0 0x7f30a41ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 --2- 172.21.15.132:0/1888503591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a406b970 0x7f30a4150fb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 >> 172.21.15.132:0/1888503591 conn(0x7f30a40c3120 msgr2=0x7f30a4147440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:24.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.561+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 shutdown_connections 2023-11-18T20:40:24.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:24.562+0000 7f30aa6a2640 1 -- 172.21.15.132:0/1888503591 wait complete. 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:40:24.580 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:40:24.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:24.581 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-18T20:40:24.642 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:40:24.642 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:40:24.642 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:40:24.643 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:24.643 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-18T20:40:24.643 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:24.643 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:24.643 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:24.643 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-18T20:40:24.643 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-18T20:40:24.644 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:24.644 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:40:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:40:24.645 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42285sec preferred_lft 42285sec 2023-11-18T20:40:24.645 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-18T20:40:24.645 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:24.645 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:40:24.645 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:24.645 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:40:24.645 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:24.646 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::78f3:28ff:fe93:897/64 scope link 2023-11-18T20:40:24.646 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:24.646 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:40:24.646 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:40:24.646 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::442e:5aff:fe28:3e67/64 scope link 2023-11-18T20:40:24.646 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:24.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:24.647 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:40:24.740 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:40:24.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:24.745 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-18T20:40:24.801 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-18T20:40:24.801 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:40:24.801 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:40:24.801 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:40:24.801 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:40:24.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:24.802 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:40:24.802 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:40:24.802 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:40:24.802 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:40:24.802 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:40:24.802 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:40:24.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:24.975 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:40:25.021 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T20:40:25.022 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:40:25.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:25.023 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-18T20:40:25.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:40:25.158 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:25.208 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:40:25.208 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:40:25.208 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:25.249 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:40:25.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:25.249 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:40:25.416 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:40:25.417 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:40:25.417 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:40:25.433 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:40:25.434 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:40:25.434 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:40:25.434 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:40:25.434 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:40:25.461 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:40:25.462 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:40:25.462 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:40:25.462 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:40:25.462 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:40:25.462 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:40:25.462 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:40:25.462 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:40:25.464 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T20:40:25.464 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:40:25.465 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:40:25.465 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:40:25.465 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:40:25.468 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:40:25.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:25.468 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:25.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:25.543 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:40:25.593 INFO:teuthology.orchestra.run.smithi161.stdout:client5952 2023-11-18T20:40:25.594 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:40:25.594 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:25.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-18T20:40:25.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.860+0000 7f642fb01640 1 Processor -- start 2023-11-18T20:40:25.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.860+0000 7f642fb01640 1 -- start start 2023-11-18T20:40:25.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642fb01640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6428151fd0 0x7f642806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:25.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642fb01640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64280c3400 0x7f642806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:25.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642fb01640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f642806aa40 0x7f6428157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:25.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642fb01640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642806ee50 con 0x7f642806aa40 2023-11-18T20:40:25.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642fb01640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6428071fd0 con 0x7f64280c3400 2023-11-18T20:40:25.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642fb01640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6428072220 con 0x7f6428151fd0 2023-11-18T20:40:25.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642e09e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f642806aa40 0x7f6428157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:25.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642e09e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f642806aa40 0x7f6428157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39306/0 (socket says 172.21.15.132:39306) 2023-11-18T20:40:25.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.862+0000 7f642e09e640 1 -- 172.21.15.132:0/3438123758 learned_addr learned my addr 172.21.15.132:0/3438123758 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:25.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.863+0000 7f642d09c640 1 --2- 172.21.15.132:0/3438123758 >> v2:172.21.15.161:3300/0 conn(0x7f64280c3400 0x7f642806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:25.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.863+0000 7f642d89d640 1 --2- 172.21.15.132:0/3438123758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6428151fd0 0x7f642806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:25.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.863+0000 7f642e09e640 1 -- 172.21.15.132:0/3438123758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6428151fd0 msgr2=0x7f642806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:25.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.863+0000 7f642e09e640 1 --2- 172.21.15.132:0/3438123758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6428151fd0 0x7f642806e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:25.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.863+0000 7f642e09e640 1 -- 172.21.15.132:0/3438123758 >> v2:172.21.15.161:3300/0 conn(0x7f64280c3400 msgr2=0x7f642806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:25.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.863+0000 7f642e09e640 1 --2- 172.21.15.132:0/3438123758 >> v2:172.21.15.161:3300/0 conn(0x7f64280c3400 0x7f642806a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:25.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.863+0000 7f642e09e640 1 -- 172.21.15.132:0/3438123758 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642806e0d0 con 0x7f642806aa40 2023-11-18T20:40:25.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.863+0000 7f642d09c640 1 --2- 172.21.15.132:0/3438123758 >> v2:172.21.15.161:3300/0 conn(0x7f64280c3400 0x7f642806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.864+0000 7f642e09e640 1 --2- 172.21.15.132:0/3438123758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f642806aa40 0x7f6428157fe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f642806de80 tx=0x7f642002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1781a37ea223997a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642c89b640 1 -- 172.21.15.132:0/3438123758 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420031860 con 0x7f642806aa40 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642c89b640 1 -- 172.21.15.132:0/3438123758 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64200319c0 con 0x7f642806aa40 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642c89b640 1 -- 172.21.15.132:0/3438123758 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420031d50 con 0x7f642806aa40 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 -- 172.21.15.132:0/3438123758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f642806aa40 msgr2=0x7f6428157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 --2- 172.21.15.132:0/3438123758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f642806aa40 0x7f6428157fe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f642806de80 tx=0x7f642002b900 comp rx=0 tx=0).stop 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 -- 172.21.15.132:0/3438123758 shutdown_connections 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 --2- 172.21.15.132:0/3438123758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f642806aa40 0x7f6428157fe0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 --2- 172.21.15.132:0/3438123758 >> v2:172.21.15.161:3300/0 conn(0x7f64280c3400 0x7f642806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 --2- 172.21.15.132:0/3438123758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6428151fd0 0x7f642806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 -- 172.21.15.132:0/3438123758 >> 172.21.15.132:0/3438123758 conn(0x7f64280c6ee0 msgr2=0x7f64280c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 -- 172.21.15.132:0/3438123758 shutdown_connections 2023-11-18T20:40:25.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.865+0000 7f642fb01640 1 -- 172.21.15.132:0/3438123758 wait complete. 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.867+0000 7f642fb01640 1 Processor -- start 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.868+0000 7f642fb01640 1 -- start start 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642fb01640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f642806aa40 0x7f642814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642fb01640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64280c3400 0x7f64281e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642fb01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6428151fd0 0x7f64281e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642fb01640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6428153620 con 0x7f6428151fd0 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642fb01640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64281551b0 con 0x7f64280c3400 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642fb01640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642814e9c0 con 0x7f642806aa40 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642e09e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6428151fd0 0x7f64281e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642e09e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6428151fd0 0x7f64281e7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39310/0 (socket says 172.21.15.132:39310) 2023-11-18T20:40:25.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642e09e640 1 -- 172.21.15.132:0/1809737259 learned_addr learned my addr 172.21.15.132:0/1809737259 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642d09c640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64280c3400 0x7f64281e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.869+0000 7f642d89d640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f642806aa40 0x7f642814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f642e09e640 1 -- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f642806aa40 msgr2=0x7f642814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f642e09e640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f642806aa40 0x7f642814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f642e09e640 1 -- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64280c3400 msgr2=0x7f64281e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f642e09e640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64280c3400 0x7f64281e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f642e09e640 1 -- 172.21.15.132:0/1809737259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64200094d0 con 0x7f6428151fd0 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f642e09e640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6428151fd0 0x7f64281e7700 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f64200090b0 tx=0x7f64200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f641e7fc640 1 -- 172.21.15.132:0/1809737259 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642003ac60 con 0x7f6428151fd0 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f641e7fc640 1 -- 172.21.15.132:0/1809737259 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642003adc0 con 0x7f6428151fd0 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.870+0000 7f641e7fc640 1 -- 172.21.15.132:0/1809737259 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420044630 con 0x7f6428151fd0 2023-11-18T20:40:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.871+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6428155400 con 0x7f6428151fd0 2023-11-18T20:40:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.871+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64281556e0 con 0x7f6428151fd0 2023-11-18T20:40:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.872+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6428152ce0 con 0x7f6428151fd0 2023-11-18T20:40:25.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.873+0000 7f641e7fc640 1 -- 172.21.15.132:0/1809737259 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6420044790 con 0x7f6428151fd0 2023-11-18T20:40:25.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.874+0000 7f641e7fc640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f640c06ae40 0x7f640c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:25.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.874+0000 7f641e7fc640 1 -- 172.21.15.132:0/1809737259 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64200abb90 con 0x7f6428151fd0 2023-11-18T20:40:25.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.874+0000 7f642d89d640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f640c06ae40 0x7f640c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:25.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.875+0000 7f642d89d640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f640c06ae40 0x7f640c06d300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6424009940 tx=0x7f6424003cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:25.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:25.878+0000 7f641e7fc640 1 -- 172.21.15.132:0/1809737259 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6428152ce0 con 0x7f6428151fd0 2023-11-18T20:40:25.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:40:25.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:40:26.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.140+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f6428152ce0 con 0x7f6428151fd0 2023-11-18T20:40:26.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.141+0000 7f641e7fc640 1 -- 172.21.15.132:0/1809737259 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7f6428152ce0 con 0x7f6428151fd0 2023-11-18T20:40:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f640c06ae40 msgr2=0x7f640c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f640c06ae40 0x7f640c06d300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6424009940 tx=0x7f6424003cd0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6428151fd0 msgr2=0x7f64281e7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6428151fd0 0x7f64281e7700 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f64200090b0 tx=0x7f64200046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 shutdown_connections 2023-11-18T20:40:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f640c06ae40 0x7f640c06d300 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6428151fd0 0x7f64281e7700 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64280c3400 0x7f64281e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 --2- 172.21.15.132:0/1809737259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f642806aa40 0x7f642814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.143+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 >> 172.21.15.132:0/1809737259 conn(0x7f64280c6ee0 msgr2=0x7f64280c0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:26.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.144+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 shutdown_connections 2023-11-18T20:40:26.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.144+0000 7f642fb01640 1 -- 172.21.15.132:0/1809737259 wait complete. 2023-11-18T20:40:26.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:26.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.373+0000 7f654b31d640 1 Processor -- start 2023-11-18T20:40:26.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.373+0000 7f654b31d640 1 -- start start 2023-11-18T20:40:26.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.374+0000 7f654b31d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654406d0a0 0x7f6544152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.374+0000 7f654b31d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65440c3ea0 0x7f65440c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f654b31d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65440c64a0 con 0x7f654414fd30 2023-11-18T20:40:26.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f654b31d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65440c5c00 con 0x7f65440c3ea0 2023-11-18T20:40:26.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f654b31d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65440c5ee0 con 0x7f654406d0a0 2023-11-18T20:40:26.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65498ba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65440c3ea0 0x7f65440c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65498ba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65440c3ea0 0x7f65440c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39316/0 (socket says 172.21.15.132:39316) 2023-11-18T20:40:26.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65498ba640 1 -- 172.21.15.132:0/1287760148 learned_addr learned my addr 172.21.15.132:0/1287760148 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:26.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65490b9640 1 --1- 172.21.15.132:0/1287760148 >> v1:172.21.15.132:6789/0 conn(0x7f654414fd30 0x7f65440a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54872/0 (socket says 172.21.15.132:54872) 2023-11-18T20:40:26.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65488b8640 1 --2- 172.21.15.132:0/1287760148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654406d0a0 0x7f6544152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65498ba640 1 -- 172.21.15.132:0/1287760148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654406d0a0 msgr2=0x7f6544152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:26.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65498ba640 1 --2- 172.21.15.132:0/1287760148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654406d0a0 0x7f6544152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65498ba640 1 -- 172.21.15.132:0/1287760148 >> v1:172.21.15.132:6789/0 conn(0x7f654414fd30 legacy=0x7f65440a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65498ba640 1 -- 172.21.15.132:0/1287760148 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440c61c0 con 0x7f65440c3ea0 2023-11-18T20:40:26.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.375+0000 7f65488b8640 1 --2- 172.21.15.132:0/1287760148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654406d0a0 0x7f6544152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:26.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.376+0000 7f65498ba640 1 --2- 172.21.15.132:0/1287760148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f65440c4330 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f653c009e50 tx=0x7f653c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edba0cb4ec70be server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:26.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.377+0000 7f653bfff640 1 -- 172.21.15.132:0/1287760148 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c02cb00 con 0x7f65440c3ea0 2023-11-18T20:40:26.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.377+0000 7f653bfff640 1 -- 172.21.15.132:0/1287760148 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c02cc60 con 0x7f65440c3ea0 2023-11-18T20:40:26.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.377+0000 7f653bfff640 1 -- 172.21.15.132:0/1287760148 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c0343f0 con 0x7f65440c3ea0 2023-11-18T20:40:26.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.377+0000 7f654b31d640 1 -- 172.21.15.132:0/1287760148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 msgr2=0x7f65440c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.377+0000 7f654b31d640 1 --2- 172.21.15.132:0/1287760148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f65440c4330 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f653c009e50 tx=0x7f653c02bf60 comp rx=0 tx=0).stop 2023-11-18T20:40:26.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.377+0000 7f654b31d640 1 -- 172.21.15.132:0/1287760148 shutdown_connections 2023-11-18T20:40:26.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.377+0000 7f654b31d640 1 --2- 172.21.15.132:0/1287760148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f65440c4330 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.377+0000 7f654b31d640 1 --2- 172.21.15.132:0/1287760148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654406d0a0 0x7f6544152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.378+0000 7f654b31d640 1 -- 172.21.15.132:0/1287760148 >> 172.21.15.132:0/1287760148 conn(0x7f654406a500 msgr2=0x7f654406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:26.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.378+0000 7f654b31d640 1 -- 172.21.15.132:0/1287760148 shutdown_connections 2023-11-18T20:40:26.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.378+0000 7f654b31d640 1 -- 172.21.15.132:0/1287760148 wait complete. 2023-11-18T20:40:26.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.379+0000 7f654b31d640 1 Processor -- start 2023-11-18T20:40:26.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.379+0000 7f654b31d640 1 -- start start 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.380+0000 7f654b31d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f654406d0a0 0x7f65440bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.380+0000 7f654b31d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f6544155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.380+0000 7f654b31d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654414fd30 0x7f65441dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.380+0000 7f654b31d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65440bb120 con 0x7f65440c3ea0 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.380+0000 7f654b31d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65440bae80 con 0x7f654406d0a0 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.380+0000 7f654b31d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65440c0360 con 0x7f654414fd30 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f6544155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f6544155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39328/0 (socket says 172.21.15.132:39328) 2023-11-18T20:40:26.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 -- 172.21.15.132:0/3734507939 learned_addr learned my addr 172.21.15.132:0/3734507939 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:26.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 -- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654414fd30 msgr2=0x7f65441dbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654414fd30 0x7f65441dbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 -- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f654406d0a0 msgr2=0x7f65440bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65490b9640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f654406d0a0 0x7f65440bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f654406d0a0 0x7f65440bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 -- 172.21.15.132:0/3734507939 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c009b30 con 0x7f65440c3ea0 2023-11-18T20:40:26.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.381+0000 7f65488b8640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f6544155a30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f653400c7c0 tx=0x7f653400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:26.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.382+0000 7f6539ffb640 1 -- 172.21.15.132:0/3734507939 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534007820 con 0x7f65440c3ea0 2023-11-18T20:40:26.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.382+0000 7f6539ffb640 1 -- 172.21.15.132:0/3734507939 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534007980 con 0x7f65440c3ea0 2023-11-18T20:40:26.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.382+0000 7f6539ffb640 1 -- 172.21.15.132:0/3734507939 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534007d10 con 0x7f65440c3ea0 2023-11-18T20:40:26.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.382+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65441e8a50 con 0x7f65440c3ea0 2023-11-18T20:40:26.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.382+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65440bbf90 con 0x7f65440c3ea0 2023-11-18T20:40:26.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.383+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6544068350 con 0x7f65440c3ea0 2023-11-18T20:40:26.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.384+0000 7f6539ffb640 1 -- 172.21.15.132:0/3734507939 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65340113f0 con 0x7f65440c3ea0 2023-11-18T20:40:26.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.385+0000 7f6539ffb640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f652806ae70 0x7f652806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.385+0000 7f6539ffb640 1 -- 172.21.15.132:0/3734507939 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6534089620 con 0x7f65440c3ea0 2023-11-18T20:40:26.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.385+0000 7f65490b9640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f652806ae70 0x7f652806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.386+0000 7f65490b9640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f652806ae70 0x7f652806d330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6540007fd0 tx=0x7f6540009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:26.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.389+0000 7f6539ffb640 1 -- 172.21.15.132:0/3734507939 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65340546c0 con 0x7f65440c3ea0 2023-11-18T20:40:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.579+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65440c66d0 con 0x7f65440c3ea0 2023-11-18T20:40:26.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.582+0000 7f6539ffb640 1 -- 172.21.15.132:0/3734507939 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f6534057ce0 con 0x7f65440c3ea0 2023-11-18T20:40:26.583 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:26.583 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":55,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:16.316858+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:26.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f652806ae70 msgr2=0x7f652806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f652806ae70 0x7f652806d330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6540007fd0 tx=0x7f6540009040 comp rx=0 tx=0).stop 2023-11-18T20:40:26.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 msgr2=0x7f6544155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f6544155a30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f653400c7c0 tx=0x7f653400cc80 comp rx=0 tx=0).stop 2023-11-18T20:40:26.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 shutdown_connections 2023-11-18T20:40:26.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f652806ae70 0x7f652806d330 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f654414fd30 0x7f65441dbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440c3ea0 0x7f6544155a30 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 --2- 172.21.15.132:0/3734507939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f654406d0a0 0x7f65440bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 >> 172.21.15.132:0/3734507939 conn(0x7f654406a500 msgr2=0x7f6544152c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:26.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 shutdown_connections 2023-11-18T20:40:26.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.584+0000 7f654b31d640 1 -- 172.21.15.132:0/3734507939 wait complete. 2023-11-18T20:40:26.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:40:13.573413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:40:14.279671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:40:26.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:40:26.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.819+0000 7f0ae4133640 1 Processor -- start 2023-11-18T20:40:26.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.819+0000 7f0ae4133640 1 -- start start 2023-11-18T20:40:26.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.820+0000 7f0ae4133640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0adc0a9b40 0x7f0adc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.820+0000 7f0ae4133640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 0x7f0adc0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.820+0000 7f0ae4133640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0c06c0 con 0x7f0adc155490 2023-11-18T20:40:26.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.820+0000 7f0ae4133640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0a5820 con 0x7f0adc0a9b40 2023-11-18T20:40:26.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.820+0000 7f0ae4133640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c1020 con 0x7f0adc0c1500 2023-11-18T20:40:26.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.820+0000 7f0ae1ecf640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0adc155490 0x7f0adc0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54876/0 (socket says 172.21.15.132:54876) 2023-11-18T20:40:26.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.820+0000 7f0ae1ecf640 1 -- 172.21.15.132:0/387756751 learned_addr learned my addr 172.21.15.132:0/387756751 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:26.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.820+0000 7f0ae16ce640 1 --2- 172.21.15.132:0/387756751 >> v2:172.21.15.132:3300/0 conn(0x7f0adc0a9b40 0x7f0adc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.821+0000 7f0ae26d0640 1 --2- 172.21.15.132:0/387756751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 0x7f0adc0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.821+0000 7f0ae16ce640 1 -- 172.21.15.132:0/387756751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 msgr2=0x7f0adc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:26.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.821+0000 7f0ae16ce640 1 --2- 172.21.15.132:0/387756751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 0x7f0adc0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.821+0000 7f0ae16ce640 1 -- 172.21.15.132:0/387756751 >> v1:172.21.15.132:6789/0 conn(0x7f0adc155490 legacy=0x7f0adc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.821+0000 7f0ae16ce640 1 -- 172.21.15.132:0/387756751 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0c0910 con 0x7f0adc0a9b40 2023-11-18T20:40:26.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.821+0000 7f0ae0ecd640 1 -- 172.21.15.132:0/387756751 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892096480 0 0) 0x7f0adc0c06c0 con 0x7f0adc155490 2023-11-18T20:40:26.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.822+0000 7f0ae16ce640 1 --2- 172.21.15.132:0/387756751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc0a9b40 0x7f0adc0a51b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0097a0 tx=0x7f0acc02dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad1f45890bb3e6d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:26.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.822+0000 7f0ae0ecd640 1 -- 172.21.15.132:0/387756751 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc02f8a0 con 0x7f0adc0a9b40 2023-11-18T20:40:26.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.822+0000 7f0ae0ecd640 1 -- 172.21.15.132:0/387756751 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc02fa00 con 0x7f0adc0a9b40 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.822+0000 7f0ae0ecd640 1 -- 172.21.15.132:0/387756751 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc02fd90 con 0x7f0adc0a9b40 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.823+0000 7f0ae4133640 1 -- 172.21.15.132:0/387756751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc0a9b40 msgr2=0x7f0adc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.823+0000 7f0ae4133640 1 --2- 172.21.15.132:0/387756751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc0a9b40 0x7f0adc0a51b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0097a0 tx=0x7f0acc02dae0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.823+0000 7f0ae4133640 1 -- 172.21.15.132:0/387756751 shutdown_connections 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.823+0000 7f0ae4133640 1 --2- 172.21.15.132:0/387756751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 0x7f0adc0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.823+0000 7f0ae4133640 1 --2- 172.21.15.132:0/387756751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc0a9b40 0x7f0adc0a51b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.823+0000 7f0ae4133640 1 -- 172.21.15.132:0/387756751 >> 172.21.15.132:0/387756751 conn(0x7f0adc06a500 msgr2=0x7f0adc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.823+0000 7f0ae4133640 1 -- 172.21.15.132:0/387756751 shutdown_connections 2023-11-18T20:40:26.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.823+0000 7f0ae4133640 1 -- 172.21.15.132:0/387756751 wait complete. 2023-11-18T20:40:26.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.825+0000 7f0ae4133640 1 Processor -- start 2023-11-18T20:40:26.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.825+0000 7f0ae4133640 1 -- start start 2023-11-18T20:40:26.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae4133640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 0x7f0adc0bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae4133640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc155490 0x7f0adc1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae4133640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0adc0baeb0 0x7f0adc14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae4133640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c0200 con 0x7f0adc155490 2023-11-18T20:40:26.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae4133640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0bb420 con 0x7f0adc0baeb0 2023-11-18T20:40:26.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae4133640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1e8b80 con 0x7f0adc0c1500 2023-11-18T20:40:26.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae16ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc155490 0x7f0adc1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae16ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc155490 0x7f0adc1519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39346/0 (socket says 172.21.15.132:39346) 2023-11-18T20:40:26.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.826+0000 7f0ae16ce640 1 -- 172.21.15.132:0/2708929565 learned_addr learned my addr 172.21.15.132:0/2708929565 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:26.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae1ecf640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 0x7f0adc0bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae16ce640 1 -- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 msgr2=0x7f0adc0bfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae16ce640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 0x7f0adc0bfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae16ce640 1 -- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0adc0baeb0 msgr2=0x7f0adc14ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:26.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae16ce640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0adc0baeb0 0x7f0adc14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:26.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae16ce640 1 -- 172.21.15.132:0/2708929565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc009400 con 0x7f0adc155490 2023-11-18T20:40:26.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae16ce640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc155490 0x7f0adc1519f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0acc000c00 tx=0x7f0acc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:26.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ad27fc640 1 -- 172.21.15.132:0/2708929565 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc03d050 con 0x7f0adc155490 2023-11-18T20:40:26.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ad27fc640 1 -- 172.21.15.132:0/2708929565 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc03e040 con 0x7f0adc155490 2023-11-18T20:40:26.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ad27fc640 1 -- 172.21.15.132:0/2708929565 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc004030 con 0x7f0adc155490 2023-11-18T20:40:26.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc1e8e60 con 0x7f0adc155490 2023-11-18T20:40:26.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.827+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc1e9420 con 0x7f0adc155490 2023-11-18T20:40:26.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.829+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc068350 con 0x7f0adc155490 2023-11-18T20:40:26.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.829+0000 7f0ad27fc640 1 -- 172.21.15.132:0/2708929565 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0acc004190 con 0x7f0adc155490 2023-11-18T20:40:26.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.831+0000 7f0ad27fc640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ac006ae70 0x7f0ac006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:26.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.831+0000 7f0ad27fc640 1 -- 172.21.15.132:0/2708929565 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0acc0ae070 con 0x7f0adc155490 2023-11-18T20:40:26.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.831+0000 7f0ae1ecf640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ac006ae70 0x7f0ac006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:26.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.832+0000 7f0ae1ecf640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ac006ae70 0x7f0ac006d330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8000f60 tx=0x7f0ad8007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:26.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:26.835+0000 7f0ad27fc640 1 -- 172.21.15.132:0/2708929565 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0acc0e0e90 con 0x7f0adc155490 2023-11-18T20:40:27.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.023+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0adc0aa2f0 con 0x7f0adc155490 2023-11-18T20:40:27.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.024+0000 7f0ad27fc640 1 -- 172.21.15.132:0/2708929565 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0acc079110 con 0x7f0adc155490 2023-11-18T20:40:27.026 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:40:27.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ac006ae70 msgr2=0x7f0ac006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ac006ae70 0x7f0ac006d330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8000f60 tx=0x7f0ad8007c00 comp rx=0 tx=0).stop 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc155490 msgr2=0x7f0adc1519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc155490 0x7f0adc1519f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0acc000c00 tx=0x7f0acc0046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 shutdown_connections 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ac006ae70 0x7f0ac006d330 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0adc0baeb0 0x7f0adc14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0adc155490 0x7f0adc1519f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 --2- 172.21.15.132:0/2708929565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0adc0c1500 0x7f0adc0bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 >> 172.21.15.132:0/2708929565 conn(0x7f0adc06a500 msgr2=0x7f0adc152620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 shutdown_connections 2023-11-18T20:40:27.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.027+0000 7f0ae4133640 1 -- 172.21.15.132:0/2708929565 wait complete. 2023-11-18T20:40:27.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:40:27.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.254+0000 7f17f6044640 1 Processor -- start 2023-11-18T20:40:27.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.254+0000 7f17f6044640 1 -- start start 2023-11-18T20:40:27.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17f6044640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f17f006d0a0 0x7f17f0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17f6044640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00c64a0 con 0x7f17f014fd30 2023-11-18T20:40:27.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17f6044640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00c5c00 con 0x7f17f00c3ea0 2023-11-18T20:40:27.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17f6044640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00c5ee0 con 0x7f17f006d0a0 2023-11-18T20:40:27.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17ef7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f17f014fd30 0x7f17f00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54890/0 (socket says 172.21.15.132:54890) 2023-11-18T20:40:27.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17ef7fe640 1 -- 172.21.15.132:0/3621932230 learned_addr learned my addr 172.21.15.132:0/3621932230 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17e7fff640 1 --2- 172.21.15.132:0/3621932230 >> v2:172.21.15.161:3300/0 conn(0x7f17f006d0a0 0x7f17f0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499547948 0 0) 0x7f17f00c64a0 con 0x7f17f014fd30 2023-11-18T20:40:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.256+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17dc003520 con 0x7f17f014fd30 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1208645534 0 0) 0x7f17dc003520 con 0x7f17f014fd30 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 >> v2:172.21.15.161:3300/0 conn(0x7f17f006d0a0 msgr2=0x7f17f0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 --2- 172.21.15.132:0/3621932230 >> v2:172.21.15.161:3300/0 conn(0x7f17f006d0a0 0x7f17f0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 >> v1:172.21.15.161:6789/0 conn(0x7f17f00c3ea0 legacy=0x7f17f00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00c61c0 con 0x7f17f014fd30 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f17e0001670 con 0x7f17f014fd30 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 >> v1:172.21.15.132:6789/0 conn(0x7f17f014fd30 legacy=0x7f17f00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc003970 0x7f17dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17dc0047c0 0x7f17dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17dc005180 0x7f17dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00c5ee0 con 0x7f17dc005180 2023-11-18T20:40:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc00c020 con 0x7f17dc003970 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc00c1e0 con 0x7f17dc0047c0 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.257+0000 7f17effff640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17dc005180 0x7f17dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.258+0000 7f17ef7fe640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc003970 0x7f17dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.258+0000 7f17e7fff640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17dc0047c0 0x7f17dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.258+0000 7f17effff640 1 -- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17dc0047c0 msgr2=0x7f17dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.258+0000 7f17effff640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17dc0047c0 0x7f17dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.258+0000 7f17effff640 1 -- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc003970 msgr2=0x7f17dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.258+0000 7f17effff640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc003970 0x7f17dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.258+0000 7f17effff640 1 -- 172.21.15.132:0/3621932230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc003520 con 0x7f17dc005180 2023-11-18T20:40:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.258+0000 7f17ef7fe640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc003970 0x7f17dc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.259+0000 7f17effff640 1 -- 172.21.15.132:0/3621932230 reap_dead start 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.259+0000 7f17effff640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17dc005180 0x7f17dc00b980 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f17e8001e50 tx=0x7f17dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775cfd49167f54c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.259+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8003b70 con 0x7f17dc005180 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.259+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8003d10 con 0x7f17dc005180 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.259+0000 7f17eeffd640 1 -- 172.21.15.132:0/3621932230 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8005310 con 0x7f17dc005180 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.260+0000 7f17f6044640 1 -- 172.21.15.132:0/3621932230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17dc005180 msgr2=0x7f17dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.260+0000 7f17f6044640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17dc005180 0x7f17dc00b980 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f17e8001e50 tx=0x7f17dc0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.260+0000 7f17f6044640 1 -- 172.21.15.132:0/3621932230 shutdown_connections 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.260+0000 7f17f6044640 1 --2- 172.21.15.132:0/3621932230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17dc005180 0x7f17dc00b980 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.260+0000 7f17f6044640 1 -- 172.21.15.132:0/3621932230 >> 172.21.15.132:0/3621932230 conn(0x7f17f006a500 msgr2=0x7f17f006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:27.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.260+0000 7f17f6044640 1 -- 172.21.15.132:0/3621932230 shutdown_connections 2023-11-18T20:40:27.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.260+0000 7f17f6044640 1 -- 172.21.15.132:0/3621932230 wait complete. 2023-11-18T20:40:27.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.262+0000 7f17f6044640 1 Processor -- start 2023-11-18T20:40:27.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.262+0000 7f17f6044640 1 -- start start 2023-11-18T20:40:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17f6044640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc005180 0x7f17f00aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17f6044640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f01566e0 0x7f17f014a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17f6044640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17f014a8d0 0x7f17f01e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17f6044640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00a8590 con 0x7f17f01566e0 2023-11-18T20:40:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17f6044640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01547c0 con 0x7f17dc005180 2023-11-18T20:40:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17f6044640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0154050 con 0x7f17f014a8d0 2023-11-18T20:40:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f01566e0 0x7f17f014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f01566e0 0x7f17f014a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39366/0 (socket says 172.21.15.132:39366) 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17e7fff640 1 -- 172.21.15.132:0/3311047924 learned_addr learned my addr 172.21.15.132:0/3311047924 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17effff640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17f014a8d0 0x7f17f01e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.263+0000 7f17ef7fe640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc005180 0x7f17f00aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17e7fff640 1 -- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17f014a8d0 msgr2=0x7f17f01e5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17e7fff640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17f014a8d0 0x7f17f01e5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17e7fff640 1 -- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc005180 msgr2=0x7f17f00aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17e7fff640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc005180 0x7f17f00aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17e7fff640 1 -- 172.21.15.132:0/3311047924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0151ce0 con 0x7f17f01566e0 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17effff640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17f014a8d0 0x7f17f01e5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17ef7fe640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc005180 0x7f17f00aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17e7fff640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f01566e0 0x7f17f014a390 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f17d80115c0 tx=0x7f17d8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17ecff9640 1 -- 172.21.15.132:0/3311047924 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8004220 con 0x7f17f01566e0 2023-11-18T20:40:27.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17ecff9640 1 -- 172.21.15.132:0/3311047924 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8004380 con 0x7f17f01566e0 2023-11-18T20:40:27.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17ecff9640 1 -- 172.21.15.132:0/3311047924 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8015930 con 0x7f17f01566e0 2023-11-18T20:40:27.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f0151fc0 con 0x7f17f01566e0 2023-11-18T20:40:27.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.264+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f00aa830 con 0x7f17f01566e0 2023-11-18T20:40:27.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.265+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f01521b0 con 0x7f17f01566e0 2023-11-18T20:40:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.266+0000 7f17ecff9640 1 -- 172.21.15.132:0/3311047924 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17d8015a90 con 0x7f17f01566e0 2023-11-18T20:40:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.267+0000 7f17ecff9640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17d006ae70 0x7f17d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.267+0000 7f17ecff9640 1 -- 172.21.15.132:0/3311047924 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17d8089730 con 0x7f17f01566e0 2023-11-18T20:40:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.268+0000 7f17ef7fe640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17d006ae70 0x7f17d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.269+0000 7f17ef7fe640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17d006ae70 0x7f17d006d330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f17e0000f60 tx=0x7f17e00014c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.272+0000 7f17ecff9640 1 -- 172.21.15.132:0/3311047924 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17d80547d0 con 0x7f17f01566e0 2023-11-18T20:40:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.461+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17f0068350 con 0x7f17f01566e0 2023-11-18T20:40:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.462+0000 7f17ecff9640 1 -- 172.21.15.132:0/3311047924 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17d8057df0 con 0x7f17f01566e0 2023-11-18T20:40:27.464 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17d006ae70 msgr2=0x7f17d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17d006ae70 0x7f17d006d330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f17e0000f60 tx=0x7f17e00014c0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f01566e0 msgr2=0x7f17f014a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f01566e0 0x7f17f014a390 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f17d80115c0 tx=0x7f17d8011a80 comp rx=0 tx=0).stop 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 shutdown_connections 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f17d006ae70 0x7f17d006d330 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17f014a8d0 0x7f17f01e5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f01566e0 0x7f17f014a390 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 --2- 172.21.15.132:0/3311047924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17dc005180 0x7f17f00aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 >> 172.21.15.132:0/3311047924 conn(0x7f17f006a500 msgr2=0x7f17f0071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 shutdown_connections 2023-11-18T20:40:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.465+0000 7f17f6044640 1 -- 172.21.15.132:0/3311047924 wait complete. 2023-11-18T20:40:27.483 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:40:27.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.696+0000 7fddbc261640 1 Processor -- start 2023-11-18T20:40:27.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.696+0000 7fddbc261640 1 -- start start 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddbc261640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fddb40a9b40 0x7fddb40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddbc261640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddb40c1500 0x7fddb40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddbc261640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb40c06c0 con 0x7fddb4155490 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddbc261640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb40a5820 con 0x7fddb40c1500 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddbc261640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb40c1020 con 0x7fddb40a9b40 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddba7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddb40c1500 0x7fddb40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddb9ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fddb4155490 0x7fddb40a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54898/0 (socket says 172.21.15.132:54898) 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddba7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddb40c1500 0x7fddb40c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39368/0 (socket says 172.21.15.132:39368) 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.698+0000 7fddb9ffd640 1 -- 172.21.15.132:0/1952702181 learned_addr learned my addr 172.21.15.132:0/1952702181 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:27.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.699+0000 7fddb97fc640 1 --2- 172.21.15.132:0/1952702181 >> v2:172.21.15.161:3300/0 conn(0x7fddb40a9b40 0x7fddb40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.699+0000 7fddba7fe640 1 -- 172.21.15.132:0/1952702181 >> v2:172.21.15.161:3300/0 conn(0x7fddb40a9b40 msgr2=0x7fddb40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:27.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.699+0000 7fddba7fe640 1 --2- 172.21.15.132:0/1952702181 >> v2:172.21.15.161:3300/0 conn(0x7fddb40a9b40 0x7fddb40a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.699+0000 7fddba7fe640 1 -- 172.21.15.132:0/1952702181 >> v1:172.21.15.132:6789/0 conn(0x7fddb4155490 legacy=0x7fddb40a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.699+0000 7fddba7fe640 1 -- 172.21.15.132:0/1952702181 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40c0910 con 0x7fddb40c1500 2023-11-18T20:40:27.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.699+0000 7fddb8ffb640 1 -- 172.21.15.132:0/1952702181 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194859409 0 0) 0x7fddb40c06c0 con 0x7fddb4155490 2023-11-18T20:40:27.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.700+0000 7fddba7fe640 1 --2- 172.21.15.132:0/1952702181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb40c1500 0x7fddb40c24d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fddb40a5160 tx=0x7fddac02e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0848757b79397a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:27.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.700+0000 7fddb8ffb640 1 -- 172.21.15.132:0/1952702181 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac02ea70 con 0x7fddb40c1500 2023-11-18T20:40:27.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.700+0000 7fddb8ffb640 1 -- 172.21.15.132:0/1952702181 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac02ebd0 con 0x7fddb40c1500 2023-11-18T20:40:27.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.700+0000 7fddb8ffb640 1 -- 172.21.15.132:0/1952702181 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac009540 con 0x7fddb40c1500 2023-11-18T20:40:27.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.701+0000 7fddbc261640 1 -- 172.21.15.132:0/1952702181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb40c1500 msgr2=0x7fddb40c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.701+0000 7fddbc261640 1 --2- 172.21.15.132:0/1952702181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb40c1500 0x7fddb40c24d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fddb40a5160 tx=0x7fddac02e0d0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.701+0000 7fddbc261640 1 -- 172.21.15.132:0/1952702181 shutdown_connections 2023-11-18T20:40:27.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.701+0000 7fddbc261640 1 --2- 172.21.15.132:0/1952702181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb40c1500 0x7fddb40c24d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.701+0000 7fddbc261640 1 --2- 172.21.15.132:0/1952702181 >> v2:172.21.15.161:3300/0 conn(0x7fddb40a9b40 0x7fddb40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.701+0000 7fddbc261640 1 -- 172.21.15.132:0/1952702181 >> 172.21.15.132:0/1952702181 conn(0x7fddb406a500 msgr2=0x7fddb406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:27.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.701+0000 7fddbc261640 1 -- 172.21.15.132:0/1952702181 shutdown_connections 2023-11-18T20:40:27.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.701+0000 7fddbc261640 1 -- 172.21.15.132:0/1952702181 wait complete. 2023-11-18T20:40:27.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.703+0000 7fddbc261640 1 Processor -- start 2023-11-18T20:40:27.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.703+0000 7fddbc261640 1 -- start start 2023-11-18T20:40:27.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddbc261640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddb40c1500 0x7fddb40aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddbc261640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb4155490 0x7fddb41e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddbc261640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddb40aac00 0x7fddb41e1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddbc261640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4154cc0 con 0x7fddb4155490 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddbc261640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb41eda20 con 0x7fddb40c1500 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddbc261640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb41e18b0 con 0x7fddb40aac00 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb97fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb4155490 0x7fddb41e0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb97fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb4155490 0x7fddb41e0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39380/0 (socket says 172.21.15.132:39380) 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb97fc640 1 -- 172.21.15.132:0/2248360802 learned_addr learned my addr 172.21.15.132:0/2248360802 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb9ffd640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddb40c1500 0x7fddb40aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb97fc640 1 -- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddb40aac00 msgr2=0x7fddb41e1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb97fc640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddb40aac00 0x7fddb41e1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb97fc640 1 -- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddb40c1500 msgr2=0x7fddb40aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb97fc640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddb40c1500 0x7fddb40aa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.704+0000 7fddb97fc640 1 -- 172.21.15.132:0/2248360802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac00bc80 con 0x7fddb4155490 2023-11-18T20:40:27.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.705+0000 7fddb97fc640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb4155490 0x7fddb41e0e30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdda400d800 tx=0x7fdda400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:27.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.705+0000 7fddaa7fc640 1 -- 172.21.15.132:0/2248360802 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400b6c0 con 0x7fddb4155490 2023-11-18T20:40:27.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.705+0000 7fddaa7fc640 1 -- 172.21.15.132:0/2248360802 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400b820 con 0x7fddb4155490 2023-11-18T20:40:27.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.705+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb41504f0 con 0x7fddb4155490 2023-11-18T20:40:27.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.705+0000 7fddaa7fc640 1 -- 172.21.15.132:0/2248360802 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400bbb0 con 0x7fddb4155490 2023-11-18T20:40:27.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.705+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb41edcc0 con 0x7fddb4155490 2023-11-18T20:40:27.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.706+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb4068350 con 0x7fddb4155490 2023-11-18T20:40:27.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.707+0000 7fddaa7fc640 1 -- 172.21.15.132:0/2248360802 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdda400bd10 con 0x7fddb4155490 2023-11-18T20:40:27.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.708+0000 7fddaa7fc640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd9806ae70 0x7fdd9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:27.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.708+0000 7fddaa7fc640 1 -- 172.21.15.132:0/2248360802 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdda4089ae0 con 0x7fddb4155490 2023-11-18T20:40:27.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.709+0000 7fddb9ffd640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd9806ae70 0x7fdd9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:27.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.710+0000 7fddb9ffd640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd9806ae70 0x7fdd9806d330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fddb0000f60 tx=0x7fddb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:27.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.713+0000 7fddaa7fc640 1 -- 172.21.15.132:0/2248360802 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdda4054c20 con 0x7fddb4155490 2023-11-18T20:40:27.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.904+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fddb406b510 con 0x7fddb4155490 2023-11-18T20:40:27.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.905+0000 7fddaa7fc640 1 -- 172.21.15.132:0/2248360802 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdda4058240 con 0x7fddb4155490 2023-11-18T20:40:27.906 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.907+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd9806ae70 msgr2=0x7fdd9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.907+0000 7fddbc261640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd9806ae70 0x7fdd9806d330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fddb0000f60 tx=0x7fddb0009040 comp rx=0 tx=0).stop 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.907+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb4155490 msgr2=0x7fddb41e0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.907+0000 7fddbc261640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb4155490 0x7fddb41e0e30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdda400d800 tx=0x7fdda400dcc0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.907+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 shutdown_connections 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.907+0000 7fddbc261640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd9806ae70 0x7fdd9806d330 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.907+0000 7fddbc261640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddb40aac00 0x7fddb41e1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.908+0000 7fddbc261640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb4155490 0x7fddb41e0e30 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.908+0000 7fddbc261640 1 --2- 172.21.15.132:0/2248360802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddb40c1500 0x7fddb40aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.908+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 >> 172.21.15.132:0/2248360802 conn(0x7fddb406a500 msgr2=0x7fddb406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.908+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 shutdown_connections 2023-11-18T20:40:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:27.908+0000 7fddbc261640 1 -- 172.21.15.132:0/2248360802 wait complete. 2023-11-18T20:40:27.927 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T20:40:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.140+0000 7fa1d6dce640 1 Processor -- start 2023-11-18T20:40:28.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.140+0000 7fa1d6dce640 1 -- start start 2023-11-18T20:40:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.141+0000 7fa1d6dce640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa1d006d0a0 0x7fa1d0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.141+0000 7fa1d6dce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d00c64a0 con 0x7fa1d00c3ea0 2023-11-18T20:40:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.141+0000 7fa1d6dce640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d00c5c00 con 0x7fa1d014fd30 2023-11-18T20:40:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.141+0000 7fa1d6dce640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d00c5ee0 con 0x7fa1d006d0a0 2023-11-18T20:40:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1d536b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa1d00c3ea0 0x7fa1d00c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54902/0 (socket says 172.21.15.132:54902) 2023-11-18T20:40:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1d536b640 1 -- 172.21.15.132:0/2625510983 learned_addr learned my addr 172.21.15.132:0/2625510983 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cffff640 1 --2- 172.21.15.132:0/2625510983 >> v2:172.21.15.161:3300/0 conn(0x7fa1d006d0a0 0x7fa1d0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093413683 0 0) 0x7fa1d00c64a0 con 0x7fa1d00c3ea0 2023-11-18T20:40:28.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1bc003520 con 0x7fa1d00c3ea0 2023-11-18T20:40:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1791501081 0 0) 0x7fa1bc003520 con 0x7fa1d00c3ea0 2023-11-18T20:40:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 >> v2:172.21.15.161:3300/0 conn(0x7fa1d006d0a0 msgr2=0x7fa1d0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 --2- 172.21.15.132:0/2625510983 >> v2:172.21.15.161:3300/0 conn(0x7fa1d006d0a0 0x7fa1d0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 >> v1:172.21.15.161:6789/0 conn(0x7fa1d014fd30 legacy=0x7fa1d00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00c61c0 con 0x7fa1d00c3ea0 2023-11-18T20:40:28.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fa1c8001670 con 0x7fa1d00c3ea0 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.142+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 >> v1:172.21.15.132:6789/0 conn(0x7fa1d00c3ea0 legacy=0x7fa1d00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cf7fe640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1bc003970 0x7fa1bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cf7fe640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1bc0047c0 0x7fa1bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cf7fe640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1bc005180 0x7fa1bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c5ee0 con 0x7fa1bc0047c0 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc00c020 con 0x7fa1bc005180 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc00c1e0 con 0x7fa1bc003970 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cffff640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1bc0047c0 0x7fa1bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1d536b640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1bc005180 0x7fa1bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cffff640 1 -- 172.21.15.132:0/2625510983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1bc003970 msgr2=0x7fa1bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:28.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cffff640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1bc003970 0x7fa1bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cffff640 1 -- 172.21.15.132:0/2625510983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1bc005180 msgr2=0x7fa1bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:28.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cffff640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1bc005180 0x7fa1bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1cffff640 1 -- 172.21.15.132:0/2625510983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc003520 con 0x7fa1bc0047c0 2023-11-18T20:40:28.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1d536b640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1bc005180 0x7fa1bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:28.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.143+0000 7fa1d536b640 1 -- 172.21.15.132:0/2625510983 reap_dead start 2023-11-18T20:40:28.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.144+0000 7fa1cffff640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1bc0047c0 0x7fa1bc004c40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009a90 tx=0x7fa1bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd53584ee053bcf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b802c680 con 0x7fa1bc0047c0 2023-11-18T20:40:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b802c7e0 con 0x7fa1bc0047c0 2023-11-18T20:40:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1cf7fe640 1 -- 172.21.15.132:0/2625510983 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b802cb70 con 0x7fa1bc0047c0 2023-11-18T20:40:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1d6dce640 1 -- 172.21.15.132:0/2625510983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1bc0047c0 msgr2=0x7fa1bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1d6dce640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1bc0047c0 0x7fa1bc004c40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009a90 tx=0x7fa1bc0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1d6dce640 1 -- 172.21.15.132:0/2625510983 shutdown_connections 2023-11-18T20:40:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1d6dce640 1 --2- 172.21.15.132:0/2625510983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1bc0047c0 0x7fa1bc004c40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1d6dce640 1 -- 172.21.15.132:0/2625510983 >> 172.21.15.132:0/2625510983 conn(0x7fa1d006a500 msgr2=0x7fa1d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1d6dce640 1 -- 172.21.15.132:0/2625510983 shutdown_connections 2023-11-18T20:40:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.145+0000 7fa1d6dce640 1 -- 172.21.15.132:0/2625510983 wait complete. 2023-11-18T20:40:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.147+0000 7fa1d6dce640 1 Processor -- start 2023-11-18T20:40:28.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.147+0000 7fa1d6dce640 1 -- start start 2023-11-18T20:40:28.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d6dce640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1bc0047c0 0x7fa1d0155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d6dce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d01ddc50 0x7fa1d01562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d6dce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1d01e8300 0x7fa1d01e8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d6dce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d01dcb70 con 0x7fa1d01e8300 2023-11-18T20:40:28.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d6dce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d01dce50 con 0x7fa1d01ddc50 2023-11-18T20:40:28.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d6dce640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d01dd130 con 0x7fa1bc0047c0 2023-11-18T20:40:28.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d536b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1d01e8300 0x7fa1d01e8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d536b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1d01e8300 0x7fa1d01e8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39400/0 (socket says 172.21.15.132:39400) 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.148+0000 7fa1d536b640 1 -- 172.21.15.132:0/1412698272 learned_addr learned my addr 172.21.15.132:0/1412698272 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.149+0000 7fa1d4b6a640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1bc0047c0 0x7fa1d0155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.149+0000 7fa1cffff640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d01ddc50 0x7fa1d01562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.149+0000 7fa1d536b640 1 -- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1bc0047c0 msgr2=0x7fa1d0155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.149+0000 7fa1d536b640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1bc0047c0 0x7fa1d0155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.149+0000 7fa1d536b640 1 -- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d01ddc50 msgr2=0x7fa1d01562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.149+0000 7fa1d536b640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d01ddc50 0x7fa1d01562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.149+0000 7fa1d536b640 1 -- 172.21.15.132:0/1412698272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0155870 con 0x7fa1d01e8300 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.149+0000 7fa1d536b640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1d01e8300 0x7fa1d01e8790 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8000f60 tx=0x7fa1c800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.150+0000 7fa1cd7fa640 1 -- 172.21.15.132:0/1412698272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80074e0 con 0x7fa1d01e8300 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.150+0000 7fa1cd7fa640 1 -- 172.21.15.132:0/1412698272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c8007640 con 0x7fa1d01e8300 2023-11-18T20:40:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.150+0000 7fa1cd7fa640 1 -- 172.21.15.132:0/1412698272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8004a00 con 0x7fa1d01e8300 2023-11-18T20:40:28.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.150+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d01dbdb0 con 0x7fa1d01e8300 2023-11-18T20:40:28.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.150+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d01eb590 con 0x7fa1d01e8300 2023-11-18T20:40:28.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.151+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d01dccb0 con 0x7fa1d01e8300 2023-11-18T20:40:28.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.152+0000 7fa1cd7fa640 1 -- 172.21.15.132:0/1412698272 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1c8004b60 con 0x7fa1d01e8300 2023-11-18T20:40:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.153+0000 7fa1cd7fa640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa1b006ae40 0x7fa1b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.153+0000 7fa1cd7fa640 1 -- 172.21.15.132:0/1412698272 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1c80892b0 con 0x7fa1d01e8300 2023-11-18T20:40:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.154+0000 7fa1d4b6a640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa1b006ae40 0x7fa1b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.154+0000 7fa1d4b6a640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa1b006ae40 0x7fa1b006d300 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0007fd0 tx=0x7fa1c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:28.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.157+0000 7fa1cd7fa640 1 -- 172.21.15.132:0/1412698272 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1d01dccb0 con 0x7fa1d01e8300 2023-11-18T20:40:28.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.343+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa1d01dccb0 con 0x7fa1d01e8300 2023-11-18T20:40:28.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.346+0000 7fa1cd7fa640 1 -- 172.21.15.132:0/1412698272 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+207 (secure 0 0 0) 0x7fa1d01dccb0 con 0x7fa1d01e8300 2023-11-18T20:40:28.347 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:28.347 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 8, 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": "cephfs_metadata" 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 9, 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": "cephfs_data" 2023-11-18T20:40:28.348 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:40:28.349 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-11-18T20:40:28.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa1b006ae40 msgr2=0x7fa1b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa1b006ae40 0x7fa1b006d300 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0007fd0 tx=0x7fa1c0009040 comp rx=0 tx=0).stop 2023-11-18T20:40:28.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1d01e8300 msgr2=0x7fa1d01e8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1d01e8300 0x7fa1d01e8790 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8000f60 tx=0x7fa1c800d9d0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 shutdown_connections 2023-11-18T20:40:28.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa1b006ae40 0x7fa1b006d300 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1d01e8300 0x7fa1d01e8790 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d01ddc50 0x7fa1d01562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 --2- 172.21.15.132:0/1412698272 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1bc0047c0 0x7fa1d0155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 >> 172.21.15.132:0/1412698272 conn(0x7fa1d006a500 msgr2=0x7fa1d00a6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:28.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 shutdown_connections 2023-11-18T20:40:28.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.349+0000 7fa1d6dce640 1 -- 172.21.15.132:0/1412698272 wait complete. 2023-11-18T20:40:28.366 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-18T20:40:28.366 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-18T20:40:28.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.571+0000 7f39289ef640 1 Processor -- start 2023-11-18T20:40:28.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.571+0000 7f39289ef640 1 -- start start 2023-11-18T20:40:28.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.572+0000 7f39289ef640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f392414e800 0x7f39240a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.572+0000 7f39289ef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39240c5720 0x7f39240c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.572+0000 7f39289ef640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39240c06f0 con 0x7f39240a5260 2023-11-18T20:40:28.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.572+0000 7f39289ef640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3924151500 con 0x7f392414e800 2023-11-18T20:40:28.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.572+0000 7f39289ef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240c09d0 con 0x7f39240c5720 2023-11-18T20:40:28.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.573+0000 7f39237fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f392414e800 0x7f39240a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.573+0000 7f39237fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f392414e800 0x7f39240a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39412/0 (socket says 172.21.15.132:39412) 2023-11-18T20:40:28.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.573+0000 7f39237fe640 1 -- 172.21.15.132:0/2808820924 learned_addr learned my addr 172.21.15.132:0/2808820924 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:28.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.573+0000 7f3922ffd640 1 --2- 172.21.15.132:0/2808820924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39240c5720 0x7f39240c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.573+0000 7f39237fe640 1 -- 172.21.15.132:0/2808820924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39240c5720 msgr2=0x7f39240c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:28.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.573+0000 7f39237fe640 1 --2- 172.21.15.132:0/2808820924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39240c5720 0x7f39240c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.573+0000 7f39237fe640 1 -- 172.21.15.132:0/2808820924 >> v1:172.21.15.161:6789/0 conn(0x7f39240a5260 legacy=0x7f3924154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:28.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.573+0000 7f39237fe640 1 -- 172.21.15.132:0/2808820924 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240c0cb0 con 0x7f392414e800 2023-11-18T20:40:28.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.574+0000 7f39237fe640 1 --2- 172.21.15.132:0/2808820924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f392414e800 0x7f39240a4d20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3924066c90 tx=0x7f391402e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8825368265a8e06b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:28.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.574+0000 7f39227fc640 1 -- 172.21.15.132:0/2808820924 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391402e9b0 con 0x7f392414e800 2023-11-18T20:40:28.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39227fc640 1 -- 172.21.15.132:0/2808820924 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391402eb10 con 0x7f392414e800 2023-11-18T20:40:28.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39227fc640 1 -- 172.21.15.132:0/2808820924 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391402eea0 con 0x7f392414e800 2023-11-18T20:40:28.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39289ef640 1 -- 172.21.15.132:0/2808820924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f392414e800 msgr2=0x7f39240a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39289ef640 1 --2- 172.21.15.132:0/2808820924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f392414e800 0x7f39240a4d20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3924066c90 tx=0x7f391402e010 comp rx=0 tx=0).stop 2023-11-18T20:40:28.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39289ef640 1 -- 172.21.15.132:0/2808820924 shutdown_connections 2023-11-18T20:40:28.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39289ef640 1 --2- 172.21.15.132:0/2808820924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39240c5720 0x7f39240c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39289ef640 1 --2- 172.21.15.132:0/2808820924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f392414e800 0x7f39240a4d20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39289ef640 1 -- 172.21.15.132:0/2808820924 >> 172.21.15.132:0/2808820924 conn(0x7f39240c2650 msgr2=0x7f39240c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:28.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39289ef640 1 -- 172.21.15.132:0/2808820924 shutdown_connections 2023-11-18T20:40:28.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.575+0000 7f39289ef640 1 -- 172.21.15.132:0/2808820924 wait complete. 2023-11-18T20:40:28.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.577+0000 7f39289ef640 1 Processor -- start 2023-11-18T20:40:28.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.577+0000 7f39289ef640 1 -- start start 2023-11-18T20:40:28.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f39289ef640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39240a5260 0x7f39240bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f39289ef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39240c5720 0x7f39241471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f39289ef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f392414e800 0x7f3924147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f39289ef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39241ee180 con 0x7f39240c5720 2023-11-18T20:40:28.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f39289ef640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39240a8f50 con 0x7f39240a5260 2023-11-18T20:40:28.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f39289ef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240a8c00 con 0x7f392414e800 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f3922ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39240c5720 0x7f39241471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f3922ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39240c5720 0x7f39241471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47440/0 (socket says 172.21.15.132:47440) 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.578+0000 7f3922ffd640 1 -- 172.21.15.132:0/220182800 learned_addr learned my addr 172.21.15.132:0/220182800 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f39237fe640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39240a5260 0x7f39240bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f3923fff640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f392414e800 0x7f3924147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f3922ffd640 1 -- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f392414e800 msgr2=0x7f3924147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f3922ffd640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f392414e800 0x7f3924147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f3922ffd640 1 -- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39240a5260 msgr2=0x7f39240bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f3922ffd640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39240a5260 0x7f39240bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f3922ffd640 1 -- 172.21.15.132:0/220182800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391400bd40 con 0x7f39240c5720 2023-11-18T20:40:28.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f3922ffd640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39240c5720 0x7f39241471d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f390c00d7d0 tx=0x7f390c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:28.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.579+0000 7f391bfff640 1 -- 172.21.15.132:0/220182800 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c00b6c0 con 0x7f39240c5720 2023-11-18T20:40:28.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.580+0000 7f391bfff640 1 -- 172.21.15.132:0/220182800 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c00b840 con 0x7f39240c5720 2023-11-18T20:40:28.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.580+0000 7f391bfff640 1 -- 172.21.15.132:0/220182800 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c00bbf0 con 0x7f39240c5720 2023-11-18T20:40:28.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.580+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3924072680 con 0x7f39240c5720 2023-11-18T20:40:28.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.580+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39240bf730 con 0x7f39240c5720 2023-11-18T20:40:28.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.581+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392404e840 con 0x7f39240c5720 2023-11-18T20:40:28.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.582+0000 7f391bfff640 1 -- 172.21.15.132:0/220182800 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f390c00bd50 con 0x7f39240c5720 2023-11-18T20:40:28.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.582+0000 7f391bfff640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f390406ae40 0x7f390406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:28.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.583+0000 7f391bfff640 1 -- 172.21.15.132:0/220182800 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f390c089bb0 con 0x7f39240c5720 2023-11-18T20:40:28.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.583+0000 7f39237fe640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f390406ae40 0x7f390406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:28.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.584+0000 7f39237fe640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f390406ae40 0x7f390406d300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3914037000 tx=0x7f3914032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:28.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.587+0000 7f391bfff640 1 -- 172.21.15.132:0/220182800 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f390c054c50 con 0x7f39240c5720 2023-11-18T20:40:28.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:28.776+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f392406fda0 con 0x7f39240c5720 2023-11-18T20:40:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.352+0000 7f391bfff640 1 -- 172.21.15.132:0/220182800 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v56) v1 ==== 140+0+0 (secure 0 0 0) 0x7f390c058270 con 0x7f39240c5720 2023-11-18T20:40:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_metadata' created 2023-11-18T20:40:29.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.356+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f390406ae40 msgr2=0x7f390406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:29.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.356+0000 7f39289ef640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f390406ae40 0x7f390406d300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3914037000 tx=0x7f3914032000 comp rx=0 tx=0).stop 2023-11-18T20:40:29.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39240c5720 msgr2=0x7f39241471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:29.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39240c5720 0x7f39241471d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f390c00d7d0 tx=0x7f390c00dc90 comp rx=0 tx=0).stop 2023-11-18T20:40:29.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 shutdown_connections 2023-11-18T20:40:29.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f390406ae40 0x7f390406d300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f392414e800 0x7f3924147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39240c5720 0x7f39241471d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 --2- 172.21.15.132:0/220182800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39240a5260 0x7f39240bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 >> 172.21.15.132:0/220182800 conn(0x7f39240c2650 msgr2=0x7f392406d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:29.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 shutdown_connections 2023-11-18T20:40:29.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.357+0000 7f39289ef640 1 -- 172.21.15.132:0/220182800 wait complete. 2023-11-18T20:40:29.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T20:40:29.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.579+0000 7f728f10f640 1 Processor -- start 2023-11-18T20:40:29.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.579+0000 7f728f10f640 1 -- start start 2023-11-18T20:40:29.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.580+0000 7f728f10f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7288151cc0 0x7f7288155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:29.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.580+0000 7f728f10f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72880c7ec0 0x7f7288157d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:29.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f728f10f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72880c4940 0x7f72880c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:29.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f728f10f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72881556d0 con 0x7f72880c7ec0 2023-11-18T20:40:29.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f728f10f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7288154740 con 0x7f7288151cc0 2023-11-18T20:40:29.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f728f10f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728806c760 con 0x7f72880c4940 2023-11-18T20:40:29.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f7287fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72880c7ec0 0x7f7288157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:29.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f7287fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72880c7ec0 0x7f7288157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47454/0 (socket says 172.21.15.132:47454) 2023-11-18T20:40:29.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f7287fff640 1 -- 172.21.15.132:0/4053753379 learned_addr learned my addr 172.21.15.132:0/4053753379 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:29.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f7287fff640 1 -- 172.21.15.132:0/4053753379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72880c4940 msgr2=0x7f72880c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:29.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f728ceab640 1 --2- 172.21.15.132:0/4053753379 >> v2:172.21.15.161:3300/0 conn(0x7f7288151cc0 0x7f7288155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:29.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f7287fff640 1 --2- 172.21.15.132:0/4053753379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72880c4940 0x7f72880c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f7287fff640 1 -- 172.21.15.132:0/4053753379 >> v2:172.21.15.161:3300/0 conn(0x7f7288151cc0 msgr2=0x7f7288155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f7287fff640 1 --2- 172.21.15.132:0/4053753379 >> v2:172.21.15.161:3300/0 conn(0x7f7288151cc0 0x7f7288155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f7287fff640 1 -- 172.21.15.132:0/4053753379 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880c8470 con 0x7f72880c7ec0 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.581+0000 7f728ceab640 1 --2- 172.21.15.132:0/4053753379 >> v2:172.21.15.161:3300/0 conn(0x7f7288151cc0 0x7f7288155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.582+0000 7f7287fff640 1 --2- 172.21.15.132:0/4053753379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f7288157d30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f72880cb030 tx=0x7f727402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d2b49c29566202 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.583+0000 7f72877fe640 1 -- 172.21.15.132:0/4053753379 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274031870 con 0x7f72880c7ec0 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.583+0000 7f72877fe640 1 -- 172.21.15.132:0/4053753379 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72740319d0 con 0x7f72880c7ec0 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.583+0000 7f72877fe640 1 -- 172.21.15.132:0/4053753379 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274031d60 con 0x7f72880c7ec0 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.583+0000 7f728f10f640 1 -- 172.21.15.132:0/4053753379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 msgr2=0x7f7288157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.583+0000 7f728f10f640 1 --2- 172.21.15.132:0/4053753379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f7288157d30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f72880cb030 tx=0x7f727402b910 comp rx=0 tx=0).stop 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.583+0000 7f728f10f640 1 -- 172.21.15.132:0/4053753379 shutdown_connections 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.584+0000 7f728f10f640 1 --2- 172.21.15.132:0/4053753379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72880c4940 0x7f72880c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.584+0000 7f728f10f640 1 --2- 172.21.15.132:0/4053753379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f7288157d30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.584+0000 7f728f10f640 1 --2- 172.21.15.132:0/4053753379 >> v2:172.21.15.161:3300/0 conn(0x7f7288151cc0 0x7f7288155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.584+0000 7f728f10f640 1 -- 172.21.15.132:0/4053753379 >> 172.21.15.132:0/4053753379 conn(0x7f7288071e10 msgr2=0x7f7288072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:29.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.584+0000 7f728f10f640 1 -- 172.21.15.132:0/4053753379 shutdown_connections 2023-11-18T20:40:29.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.584+0000 7f728f10f640 1 -- 172.21.15.132:0/4053753379 wait complete. 2023-11-18T20:40:29.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.585+0000 7f728f10f640 1 Processor -- start 2023-11-18T20:40:29.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.585+0000 7f728f10f640 1 -- start start 2023-11-18T20:40:29.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.586+0000 7f728f10f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72880c4940 0x7f7288150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:29.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.586+0000 7f728f10f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f72881539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.586+0000 7f728f10f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7288151cc0 0x7f7288148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.586+0000 7f728f10f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7288157160 con 0x7f72880c7ec0 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.586+0000 7f728f10f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7288151000 con 0x7f72880c4940 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.586+0000 7f728f10f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c7390 con 0x7f7288151cc0 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f72881539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f72881539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47468/0 (socket says 172.21.15.132:47468) 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 -- 172.21.15.132:0/510160681 learned_addr learned my addr 172.21.15.132:0/510160681 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f728ceab640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72880c4940 0x7f7288150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 -- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7288151cc0 msgr2=0x7f7288148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7288151cc0 0x7f7288148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 -- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72880c4940 msgr2=0x7f7288150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:29.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72880c4940 0x7f7288150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:29.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 -- 172.21.15.132:0/510160681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740094d0 con 0x7f72880c7ec0 2023-11-18T20:40:29.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.587+0000 7f7287fff640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f72881539a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f727402b950 tx=0x7f72740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:29.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.588+0000 7f72857fa640 1 -- 172.21.15.132:0/510160681 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274031840 con 0x7f72880c7ec0 2023-11-18T20:40:29.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.588+0000 7f72857fa640 1 -- 172.21.15.132:0/510160681 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72740443f0 con 0x7f72880c7ec0 2023-11-18T20:40:29.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.588+0000 7f72857fa640 1 -- 172.21.15.132:0/510160681 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72740447a0 con 0x7f72880c7ec0 2023-11-18T20:40:29.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.588+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7288156a10 con 0x7f72880c7ec0 2023-11-18T20:40:29.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.588+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72881563c0 con 0x7f72880c7ec0 2023-11-18T20:40:29.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.589+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7288156ba0 con 0x7f72880c7ec0 2023-11-18T20:40:29.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.590+0000 7f72857fa640 1 -- 172.21.15.132:0/510160681 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7274044900 con 0x7f72880c7ec0 2023-11-18T20:40:29.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.591+0000 7f72857fa640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f726c06ae70 0x7f726c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:29.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.591+0000 7f72857fa640 1 -- 172.21.15.132:0/510160681 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f727402d040 con 0x7f72880c7ec0 2023-11-18T20:40:29.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.592+0000 7f728ceab640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f726c06ae70 0x7f726c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:29.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.593+0000 7f728ceab640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f726c06ae70 0x7f726c06d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f727c00b840 tx=0x7f727c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:29.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.596+0000 7f72857fa640 1 -- 172.21.15.132:0/510160681 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7274076fa0 con 0x7f72880c7ec0 2023-11-18T20:40:29.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:29.774+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7288067d50 con 0x7f72880c7ec0 2023-11-18T20:40:30.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.359+0000 7f72857fa640 1 -- 172.21.15.132:0/510160681 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v57) v1 ==== 172+0+0 (secure 0 0 0) 0x7f72740350d0 con 0x7f72880c7ec0 2023-11-18T20:40:30.360 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_data' created 2023-11-18T20:40:30.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.363+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f726c06ae70 msgr2=0x7f726c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:30.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.363+0000 7f728f10f640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f726c06ae70 0x7f726c06d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f727c00b840 tx=0x7f727c008040 comp rx=0 tx=0).stop 2023-11-18T20:40:30.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.363+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 msgr2=0x7f72881539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:30.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.363+0000 7f728f10f640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f72881539a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f727402b950 tx=0x7f72740046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.364+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 shutdown_connections 2023-11-18T20:40:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.364+0000 7f728f10f640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f726c06ae70 0x7f726c06d330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.364+0000 7f728f10f640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7288151cc0 0x7f7288148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.364+0000 7f728f10f640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72880c7ec0 0x7f72881539a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.364+0000 7f728f10f640 1 --2- 172.21.15.132:0/510160681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72880c4940 0x7f7288150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.364+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 >> 172.21.15.132:0/510160681 conn(0x7f7288071e10 msgr2=0x7f72880c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.364+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 shutdown_connections 2023-11-18T20:40:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.364+0000 7f728f10f640 1 -- 172.21.15.132:0/510160681 wait complete. 2023-11-18T20:40:30.404 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-18T20:40:30.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.588+0000 7fa481390640 1 Processor -- start 2023-11-18T20:40:30.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.589+0000 7fa481390640 1 -- start start 2023-11-18T20:40:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.590+0000 7fa481390640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa47c0a50e0 0x7fa47c156260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.590+0000 7fa481390640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c0c05c0 con 0x7fa47c0c0a50 2023-11-18T20:40:30.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.590+0000 7fa481390640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c06de60 con 0x7fa47c155e80 2023-11-18T20:40:30.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.590+0000 7fa481390640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47c0c11b0 con 0x7fa47c0a50e0 2023-11-18T20:40:30.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.590+0000 7fa47b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa47c0c0a50 0x7fa47c14f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41514/0 (socket says 172.21.15.132:41514) 2023-11-18T20:40:30.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa47b7fe640 1 -- 172.21.15.132:0/3949823885 learned_addr learned my addr 172.21.15.132:0/3949823885 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa47a7fc640 1 --2- 172.21.15.132:0/3949823885 >> v2:172.21.15.161:3300/0 conn(0x7fa47c0a50e0 0x7fa47c156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488499853 0 0) 0x7fa47c0c05c0 con 0x7fa47c0c0a50 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa468003520 con 0x7fa47c0c0a50 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 367165459 0 0) 0x7fa468003520 con 0x7fa47c0c0a50 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 >> v2:172.21.15.161:3300/0 conn(0x7fa47c0a50e0 msgr2=0x7fa47c156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 --2- 172.21.15.132:0/3949823885 >> v2:172.21.15.161:3300/0 conn(0x7fa47c0a50e0 0x7fa47c156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 >> v1:172.21.15.161:6789/0 conn(0x7fa47c155e80 legacy=0x7fa47c0c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c156b50 con 0x7fa47c0c0a50 2023-11-18T20:40:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fa474001670 con 0x7fa47c0c0a50 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 >> v1:172.21.15.132:6789/0 conn(0x7fa47c0c0a50 legacy=0x7fa47c14f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.591+0000 7fa479ffb640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4680039c0 0x7fa468003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa479ffb640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4680047c0 0x7fa468004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa479ffb640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680052a0 0x7fa46800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800c170 con 0x7fa4680047c0 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800c2e0 con 0x7fa4680052a0 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800c4a0 con 0x7fa4680039c0 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47a7fc640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4680047c0 0x7fa468004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47affd640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4680039c0 0x7fa468003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47b7fe640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680052a0 0x7fa46800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47a7fc640 1 -- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4680039c0 msgr2=0x7fa468003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47a7fc640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4680039c0 0x7fa468003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47a7fc640 1 -- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680052a0 msgr2=0x7fa46800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:30.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47a7fc640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680052a0 0x7fa46800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47b7fe640 1 -- 172.21.15.132:0/3949823885 reap_dead start 2023-11-18T20:40:30.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47a7fc640 1 -- 172.21.15.132:0/3949823885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468003520 con 0x7fa4680047c0 2023-11-18T20:40:30.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.592+0000 7fa47affd640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4680039c0 0x7fa468003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.594+0000 7fa47a7fc640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4680047c0 0x7fa468004c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa464009f90 tx=0x7fa4680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b61c28870ce72b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.594+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46402cbd0 con 0x7fa4680047c0 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.594+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46400f040 con 0x7fa4680047c0 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.594+0000 7fa479ffb640 1 -- 172.21.15.132:0/3949823885 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464034440 con 0x7fa4680047c0 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.595+0000 7fa481390640 1 -- 172.21.15.132:0/3949823885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4680047c0 msgr2=0x7fa468004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.595+0000 7fa481390640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4680047c0 0x7fa468004c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa464009f90 tx=0x7fa4680057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.595+0000 7fa481390640 1 -- 172.21.15.132:0/3949823885 shutdown_connections 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.595+0000 7fa481390640 1 --2- 172.21.15.132:0/3949823885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4680047c0 0x7fa468004c40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.595+0000 7fa481390640 1 -- 172.21.15.132:0/3949823885 >> 172.21.15.132:0/3949823885 conn(0x7fa47c0a7970 msgr2=0x7fa47c0a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.595+0000 7fa481390640 1 -- 172.21.15.132:0/3949823885 shutdown_connections 2023-11-18T20:40:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.595+0000 7fa481390640 1 -- 172.21.15.132:0/3949823885 wait complete. 2023-11-18T20:40:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.596+0000 7fa481390640 1 Processor -- start 2023-11-18T20:40:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.597+0000 7fa481390640 1 -- start start 2023-11-18T20:40:30.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.597+0000 7fa481390640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680047c0 0x7fa47c1eb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:30.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.597+0000 7fa481390640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa47c0bdcd0 0x7fa47c1ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:30.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa481390640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa47c1ee990 0x7fa47c0bf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:30.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa481390640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c1eb710 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa481390640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c1edce0 con 0x7fa4680047c0 2023-11-18T20:40:30.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa481390640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0a9030 con 0x7fa47c1ee990 2023-11-18T20:40:30.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa47c0bdcd0 0x7fa47c1ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa47c0bdcd0 0x7fa47c1ee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47492/0 (socket says 172.21.15.132:47492) 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47a7fc640 1 -- 172.21.15.132:0/4187218628 learned_addr learned my addr 172.21.15.132:0/4187218628 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47b7fe640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa47c1ee990 0x7fa47c0bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47affd640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680047c0 0x7fa47c1eb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47a7fc640 1 -- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa47c1ee990 msgr2=0x7fa47c0bf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47a7fc640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa47c1ee990 0x7fa47c0bf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47a7fc640 1 -- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680047c0 msgr2=0x7fa47c1eb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47a7fc640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680047c0 0x7fa47c1eb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47a7fc640 1 -- 172.21.15.132:0/4187218628 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c0a9310 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47b7fe640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa47c1ee990 0x7fa47c0bf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.598+0000 7fa47affd640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680047c0 0x7fa47c1eb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.599+0000 7fa47a7fc640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa47c0bdcd0 0x7fa47c1ee450 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa46402c570 tx=0x7fa464009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:30.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.599+0000 7fa4737fe640 1 -- 172.21.15.132:0/4187218628 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46403e400 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.599+0000 7fa4737fe640 1 -- 172.21.15.132:0/4187218628 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46403e580 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.599+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c0a95f0 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.599+0000 7fa4737fe640 1 -- 172.21.15.132:0/4187218628 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46403e930 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.599+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c0bca90 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.600+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c0c3bd0 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.601+0000 7fa4737fe640 1 -- 172.21.15.132:0/4187218628 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa46403ea90 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.602+0000 7fa4737fe640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa45c06ae70 0x7fa45c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:30.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.602+0000 7fa4737fe640 1 -- 172.21.15.132:0/4187218628 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fa4640ac060 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.603+0000 7fa47affd640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa45c06ae70 0x7fa45c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:30.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.604+0000 7fa47affd640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa45c06ae70 0x7fa45c06d330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa47c04fab0 tx=0x7fa46c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:30.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.607+0000 7fa4737fe640 1 -- 172.21.15.132:0/4187218628 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa47c0c3bd0 con 0x7fa47c0bdcd0 2023-11-18T20:40:30.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:30.826+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fa47c0c3bd0 con 0x7fa47c0bdcd0 2023-11-18T20:40:31.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.397+0000 7fa4737fe640 1 -- 172.21.15.132:0/4187218628 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v31) v1 ==== 177+0+0 (secure 0 0 0) 0x7fa47c0c3bd0 con 0x7fa47c0bdcd0 2023-11-18T20:40:31.402 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 10 and data pool 11 2023-11-18T20:40:31.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.407+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa45c06ae70 msgr2=0x7fa45c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:31.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.407+0000 7fa481390640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa45c06ae70 0x7fa45c06d330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa47c04fab0 tx=0x7fa46c009040 comp rx=0 tx=0).stop 2023-11-18T20:40:31.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.407+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa47c0bdcd0 msgr2=0x7fa47c1ee450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:31.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.407+0000 7fa481390640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa47c0bdcd0 0x7fa47c1ee450 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa46402c570 tx=0x7fa464009750 comp rx=0 tx=0).stop 2023-11-18T20:40:31.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.409+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 shutdown_connections 2023-11-18T20:40:31.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.409+0000 7fa481390640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa45c06ae70 0x7fa45c06d330 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.409+0000 7fa481390640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa47c1ee990 0x7fa47c0bf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.409+0000 7fa481390640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa47c0bdcd0 0x7fa47c1ee450 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.409+0000 7fa481390640 1 --2- 172.21.15.132:0/4187218628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4680047c0 0x7fa47c1eb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.409+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 >> 172.21.15.132:0/4187218628 conn(0x7fa47c0a7970 msgr2=0x7fa47c0a7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:31.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.410+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 shutdown_connections 2023-11-18T20:40:31.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.411+0000 7fa481390640 1 -- 172.21.15.132:0/4187218628 wait complete. 2023-11-18T20:40:31.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:31.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.616+0000 7f43f89a5640 1 Processor -- start 2023-11-18T20:40:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.616+0000 7f43f89a5640 1 -- start start 2023-11-18T20:40:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43f89a5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f43f414e7c0 0x7f43f40c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43f89a5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f41550c0 con 0x7f43f40c4c00 2023-11-18T20:40:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43f89a5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f4158a60 con 0x7f43f4154580 2023-11-18T20:40:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43f89a5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f40c5b10 con 0x7f43f414e7c0 2023-11-18T20:40:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43eaffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f43f40c4c00 0x7f43f40ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41526/0 (socket says 172.21.15.132:41526) 2023-11-18T20:40:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43eaffd640 1 -- 172.21.15.132:0/2041511727 learned_addr learned my addr 172.21.15.132:0/2041511727 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577108658 0 0) 0x7f43f41550c0 con 0x7f43f40c4c00 2023-11-18T20:40:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d4003520 con 0x7f43f40c4c00 2023-11-18T20:40:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.618+0000 7f43f37fe640 1 --2- 172.21.15.132:0/2041511727 >> v2:172.21.15.161:3300/0 conn(0x7f43f414e7c0 0x7f43f40c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3236822477 0 0) 0x7f43d4003520 con 0x7f43f40c4c00 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 >> v2:172.21.15.161:3300/0 conn(0x7f43f414e7c0 msgr2=0x7f43f40c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 --2- 172.21.15.132:0/2041511727 >> v2:172.21.15.161:3300/0 conn(0x7f43f414e7c0 0x7f43f40c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 >> v1:172.21.15.161:6789/0 conn(0x7f43f4154580 legacy=0x7f43f41549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4157ca0 con 0x7f43f40c4c00 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f43dc001670 con 0x7f43f40c4c00 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 >> v1:172.21.15.132:6789/0 conn(0x7f43f40c4c00 legacy=0x7f43f40ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43d40039c0 0x7f43d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d40047c0 0x7f43d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d4005380 0x7f43d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d400c210 con 0x7f43d40039c0 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d400c380 con 0x7f43d4005380 2023-11-18T20:40:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d400c540 con 0x7f43d40047c0 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f37fe640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43d40039c0 0x7f43d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f37fe640 1 -- 172.21.15.132:0/2041511727 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d40047c0 msgr2=0x7f43d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.619+0000 7f43f3fff640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d4005380 0x7f43d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.620+0000 7f43f37fe640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d40047c0 0x7f43d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.620+0000 7f43f37fe640 1 -- 172.21.15.132:0/2041511727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d4005380 msgr2=0x7f43d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.620+0000 7f43f37fe640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d4005380 0x7f43d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.620+0000 7f43f37fe640 1 -- 172.21.15.132:0/2041511727 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4003520 con 0x7f43d40039c0 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.620+0000 7f43f3fff640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d4005380 0x7f43d400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:31.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.620+0000 7f43f3fff640 1 -- 172.21.15.132:0/2041511727 reap_dead start 2023-11-18T20:40:31.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.621+0000 7f43f37fe640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43d40039c0 0x7f43d4003dc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f43e400ba30 tx=0x7f43d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade802f07e94aa98 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:31.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.621+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4032640 con 0x7f43d40039c0 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.621+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e40327a0 con 0x7f43d40039c0 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.621+0000 7f43f2ffd640 1 -- 172.21.15.132:0/2041511727 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4032b30 con 0x7f43d40039c0 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.622+0000 7f43f89a5640 1 -- 172.21.15.132:0/2041511727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43d40039c0 msgr2=0x7f43d4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.622+0000 7f43f89a5640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43d40039c0 0x7f43d4003dc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f43e400ba30 tx=0x7f43d40057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.622+0000 7f43f89a5640 1 -- 172.21.15.132:0/2041511727 shutdown_connections 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.622+0000 7f43f89a5640 1 --2- 172.21.15.132:0/2041511727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43d40039c0 0x7f43d4003dc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.622+0000 7f43f89a5640 1 -- 172.21.15.132:0/2041511727 >> 172.21.15.132:0/2041511727 conn(0x7f43f40abf00 msgr2=0x7f43f40c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.622+0000 7f43f89a5640 1 -- 172.21.15.132:0/2041511727 shutdown_connections 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.622+0000 7f43f89a5640 1 -- 172.21.15.132:0/2041511727 wait complete. 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.623+0000 7f43f89a5640 1 Processor -- start 2023-11-18T20:40:31.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.624+0000 7f43f89a5640 1 -- start start 2023-11-18T20:40:31.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.624+0000 7f43f89a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d40039c0 0x7f43f40aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.624+0000 7f43f89a5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f414c070 0x7f43f4153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.624+0000 7f43f89a5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43f40c05d0 0x7f43f40bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43f89a5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f41534d0 con 0x7f43f414c070 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43f89a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f41571a0 con 0x7f43d40039c0 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43f89a5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f41eabb0 con 0x7f43f40c05d0 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43eaffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f414c070 0x7f43f4153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43eaffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f414c070 0x7f43f4153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47498/0 (socket says 172.21.15.132:47498) 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43eaffd640 1 -- 172.21.15.132:0/4180781381 learned_addr learned my addr 172.21.15.132:0/4180781381 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43f37fe640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d40039c0 0x7f43f40aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43eaffd640 1 -- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43f40c05d0 msgr2=0x7f43f40bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:31.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43f3fff640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43f40c05d0 0x7f43f40bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43eaffd640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43f40c05d0 0x7f43f40bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43eaffd640 1 -- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d40039c0 msgr2=0x7f43f40aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43eaffd640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d40039c0 0x7f43f40aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43eaffd640 1 -- 172.21.15.132:0/4180781381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f41576d0 con 0x7f43f414c070 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.625+0000 7f43f37fe640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d40039c0 0x7f43f40aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.626+0000 7f43eaffd640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f414c070 0x7f43f4153d20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00c730 tx=0x7f43dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.626+0000 7f43f0ff9640 1 -- 172.21.15.132:0/4180781381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0072d0 con 0x7f43f414c070 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.626+0000 7f43f0ff9640 1 -- 172.21.15.132:0/4180781381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc007450 con 0x7f43f414c070 2023-11-18T20:40:31.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.626+0000 7f43f0ff9640 1 -- 172.21.15.132:0/4180781381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0047e0 con 0x7f43f414c070 2023-11-18T20:40:31.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.626+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f41eae50 con 0x7f43f414c070 2023-11-18T20:40:31.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.626+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f40aac50 con 0x7f43f414c070 2023-11-18T20:40:31.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.627+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f4152230 con 0x7f43f414c070 2023-11-18T20:40:31.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.628+0000 7f43f0ff9640 1 -- 172.21.15.132:0/4180781381 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43dc004b50 con 0x7f43f414c070 2023-11-18T20:40:31.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.629+0000 7f43f0ff9640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f43d806ae70 0x7f43d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:31.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.629+0000 7f43f0ff9640 1 -- 172.21.15.132:0/4180781381 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f43dc088fd0 con 0x7f43f414c070 2023-11-18T20:40:31.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.630+0000 7f43f37fe640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f43d806ae70 0x7f43d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:31.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.631+0000 7f43f37fe640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f43d806ae70 0x7f43d806d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f43e400ba00 tx=0x7f43e4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:31.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.634+0000 7f43f0ff9640 1 -- 172.21.15.132:0/4180781381 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43f4152230 con 0x7f43f414c070 2023-11-18T20:40:31.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.824+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43f4152230 con 0x7f43f414c070 2023-11-18T20:40:31.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.826+0000 7f43f0ff9640 1 -- 172.21.15.132:0/4180781381 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20269 (secure 0 0 0) 0x7f43f4152230 con 0x7f43f414c070 2023-11-18T20:40:31.827 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:31.827 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":58,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:30.828001+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f43d806ae70 msgr2=0x7f43d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f43d806ae70 0x7f43d806d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f43e400ba00 tx=0x7f43e4030000 comp rx=0 tx=0).stop 2023-11-18T20:40:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f414c070 msgr2=0x7f43f4153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f414c070 0x7f43f4153d20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00c730 tx=0x7f43dc00cbf0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 shutdown_connections 2023-11-18T20:40:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f43d806ae70 0x7f43d806d330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43f40c05d0 0x7f43f40bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f414c070 0x7f43f4153d20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 --2- 172.21.15.132:0/4180781381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d40039c0 0x7f43f40aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.828+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 >> 172.21.15.132:0/4180781381 conn(0x7f43f40abf00 msgr2=0x7f43f414ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.829+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 shutdown_connections 2023-11-18T20:40:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:31.829+0000 7f43f89a5640 1 -- 172.21.15.132:0/4180781381 wait complete. 2023-11-18T20:40:31.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:32.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.051+0000 7f9286716640 1 Processor -- start 2023-11-18T20:40:32.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.051+0000 7f9286716640 1 -- start start 2023-11-18T20:40:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.052+0000 7f9286716640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f928014fd30 0x7f9280152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.052+0000 7f9286716640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800c64a0 con 0x7f928006d0a0 2023-11-18T20:40:32.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.052+0000 7f9286716640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800c5c00 con 0x7f92800c3ea0 2023-11-18T20:40:32.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.052+0000 7f9286716640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92800c5ee0 con 0x7f928014fd30 2023-11-18T20:40:32.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.053+0000 7f9277fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f928006d0a0 0x7f92800a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41532/0 (socket says 172.21.15.132:41532) 2023-11-18T20:40:32.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.053+0000 7f9277fff640 1 -- 172.21.15.132:0/946412681 learned_addr learned my addr 172.21.15.132:0/946412681 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:32.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.053+0000 7f927ffff640 1 --2- 172.21.15.132:0/946412681 >> v2:172.21.15.132:3300/0 conn(0x7f928014fd30 0x7f9280152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.053+0000 7f927f7fe640 1 -- 172.21.15.132:0/946412681 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218194103 0 0) 0x7f92800c64a0 con 0x7f928006d0a0 2023-11-18T20:40:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.053+0000 7f927ffff640 1 -- 172.21.15.132:0/946412681 >> v1:172.21.15.161:6789/0 conn(0x7f92800c3ea0 legacy=0x7f92800c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.053+0000 7f927ffff640 1 -- 172.21.15.132:0/946412681 >> v1:172.21.15.132:6789/0 conn(0x7f928006d0a0 legacy=0x7f92800a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.053+0000 7f927ffff640 1 -- 172.21.15.132:0/946412681 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800c61c0 con 0x7f928014fd30 2023-11-18T20:40:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f927ffff640 1 --2- 172.21.15.132:0/946412681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928014fd30 0x7f9280152f20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f92700097a0 tx=0x7f927002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd941bd03742aa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:32.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f927f7fe640 1 -- 172.21.15.132:0/946412681 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270031830 con 0x7f928014fd30 2023-11-18T20:40:32.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f927f7fe640 1 -- 172.21.15.132:0/946412681 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270031990 con 0x7f928014fd30 2023-11-18T20:40:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f927f7fe640 1 -- 172.21.15.132:0/946412681 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270031d20 con 0x7f928014fd30 2023-11-18T20:40:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f9286716640 1 -- 172.21.15.132:0/946412681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928014fd30 msgr2=0x7f9280152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f9286716640 1 --2- 172.21.15.132:0/946412681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928014fd30 0x7f9280152f20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f92700097a0 tx=0x7f927002b8d0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f9286716640 1 -- 172.21.15.132:0/946412681 shutdown_connections 2023-11-18T20:40:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f9286716640 1 --2- 172.21.15.132:0/946412681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f928014fd30 0x7f9280152f20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.055+0000 7f9286716640 1 -- 172.21.15.132:0/946412681 >> 172.21.15.132:0/946412681 conn(0x7f928006a500 msgr2=0x7f928006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.056+0000 7f9286716640 1 -- 172.21.15.132:0/946412681 shutdown_connections 2023-11-18T20:40:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.056+0000 7f9286716640 1 -- 172.21.15.132:0/946412681 wait complete. 2023-11-18T20:40:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.057+0000 7f9286716640 1 Processor -- start 2023-11-18T20:40:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.057+0000 7f9286716640 1 -- start start 2023-11-18T20:40:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.058+0000 7f9286716640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f928006d0a0 0x7f92800aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.058+0000 7f9286716640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92800c3ea0 0x7f928014afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.058+0000 7f9286716640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928014fd30 0x7f928014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.058+0000 7f9286716640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92800a5090 con 0x7f92800c3ea0 2023-11-18T20:40:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.058+0000 7f9286716640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92801dbad0 con 0x7f928006d0a0 2023-11-18T20:40:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.058+0000 7f9286716640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92801522b0 con 0x7f928014fd30 2023-11-18T20:40:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.058+0000 7f9277fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92800c3ea0 0x7f928014afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9277fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92800c3ea0 0x7f928014afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47526/0 (socket says 172.21.15.132:47526) 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9277fff640 1 -- 172.21.15.132:0/3679304013 learned_addr learned my addr 172.21.15.132:0/3679304013 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f927ffff640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f928006d0a0 0x7f92800aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9284cb3640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928014fd30 0x7f928014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9277fff640 1 -- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928014fd30 msgr2=0x7f928014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9277fff640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928014fd30 0x7f928014b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9277fff640 1 -- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f928006d0a0 msgr2=0x7f92800aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9277fff640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f928006d0a0 0x7f92800aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9277fff640 1 -- 172.21.15.132:0/3679304013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270009400 con 0x7f92800c3ea0 2023-11-18T20:40:32.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.059+0000 7f9277fff640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92800c3ea0 0x7f928014afc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f926800c410 tx=0x7f926800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:32.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.060+0000 7f927d7fa640 1 -- 172.21.15.132:0/3679304013 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680074e0 con 0x7f92800c3ea0 2023-11-18T20:40:32.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.060+0000 7f927d7fa640 1 -- 172.21.15.132:0/3679304013 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268007660 con 0x7f92800c3ea0 2023-11-18T20:40:32.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.060+0000 7f927d7fa640 1 -- 172.21.15.132:0/3679304013 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268004a20 con 0x7f92800c3ea0 2023-11-18T20:40:32.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.060+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92801dbd20 con 0x7f92800c3ea0 2023-11-18T20:40:32.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.060+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928014ba40 con 0x7f92800c3ea0 2023-11-18T20:40:32.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.061+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92801ed900 con 0x7f92800c3ea0 2023-11-18T20:40:32.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.062+0000 7f927d7fa640 1 -- 172.21.15.132:0/3679304013 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9268004b80 con 0x7f92800c3ea0 2023-11-18T20:40:32.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.063+0000 7f927d7fa640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f926006ae90 0x7f926006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.063+0000 7f927d7fa640 1 -- 172.21.15.132:0/3679304013 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9268089720 con 0x7f92800c3ea0 2023-11-18T20:40:32.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.063+0000 7f927ffff640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f926006ae90 0x7f926006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.064+0000 7f927ffff640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f926006ae90 0x7f926006d350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9270036000 tx=0x7f927003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:32.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.067+0000 7f927d7fa640 1 -- 172.21.15.132:0/3679304013 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92801ed900 con 0x7f92800c3ea0 2023-11-18T20:40:32.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.258+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92801ed900 con 0x7f92800c3ea0 2023-11-18T20:40:32.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.262+0000 7f927d7fa640 1 -- 172.21.15.132:0/3679304013 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20269 (secure 0 0 0) 0x7f92801ed900 con 0x7f92800c3ea0 2023-11-18T20:40:32.265 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:32.265 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":58,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:30.828001+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f926006ae90 msgr2=0x7f926006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f926006ae90 0x7f926006d350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9270036000 tx=0x7f927003c040 comp rx=0 tx=0).stop 2023-11-18T20:40:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92800c3ea0 msgr2=0x7f928014afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92800c3ea0 0x7f928014afc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f926800c410 tx=0x7f926800c8d0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 shutdown_connections 2023-11-18T20:40:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f926006ae90 0x7f926006d350 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f928014fd30 0x7f928014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92800c3ea0 0x7f928014afc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 --2- 172.21.15.132:0/3679304013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f928006d0a0 0x7f92800aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 >> 172.21.15.132:0/3679304013 conn(0x7f928006a500 msgr2=0x7f92800c2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 shutdown_connections 2023-11-18T20:40:32.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.265+0000 7f9286716640 1 -- 172.21.15.132:0/3679304013 wait complete. 2023-11-18T20:40:32.288 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-18T20:40:32.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.499+0000 7f9f0cf05640 1 Processor -- start 2023-11-18T20:40:32.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.499+0000 7f9f0cf05640 1 -- start start 2023-11-18T20:40:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.501+0000 7f9f0cf05640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9f0814fd30 0x7f9f08152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.501+0000 7f9f0cf05640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f080c64a0 con 0x7f9f0806d0a0 2023-11-18T20:40:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.501+0000 7f9f0cf05640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f080c5c00 con 0x7f9f080c3ea0 2023-11-18T20:40:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.501+0000 7f9f0cf05640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f080c5ee0 con 0x7f9f0814fd30 2023-11-18T20:40:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.501+0000 7f9f0659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9f0814fd30 0x7f9f08152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.501+0000 7f9f05d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9f0806d0a0 0x7f9f080a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41546/0 (socket says 172.21.15.132:41546) 2023-11-18T20:40:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.501+0000 7f9f05d9b640 1 -- 172.21.15.132:0/89603437 learned_addr learned my addr 172.21.15.132:0/89603437 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:32.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.502+0000 7f9f0659c640 1 -- 172.21.15.132:0/89603437 >> v1:172.21.15.161:6789/0 conn(0x7f9f080c3ea0 legacy=0x7f9f080c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:32.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.502+0000 7f9f0659c640 1 -- 172.21.15.132:0/89603437 >> v1:172.21.15.132:6789/0 conn(0x7f9f0806d0a0 legacy=0x7f9f080a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.502+0000 7f9f0659c640 1 -- 172.21.15.132:0/89603437 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f080c61c0 con 0x7f9f0814fd30 2023-11-18T20:40:32.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.502+0000 7f9f0559a640 1 -- 172.21.15.132:0/89603437 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437349069 0 0) 0x7f9f080c64a0 con 0x7f9f0806d0a0 2023-11-18T20:40:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.503+0000 7f9f0659c640 1 --2- 172.21.15.132:0/89603437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0814fd30 0x7f9f08152f20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80097a0 tx=0x7f9ef802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5d3237d9a4f2f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.503+0000 7f9f0559a640 1 -- 172.21.15.132:0/89603437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8031830 con 0x7f9f0814fd30 2023-11-18T20:40:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.503+0000 7f9f0559a640 1 -- 172.21.15.132:0/89603437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef8031990 con 0x7f9f0814fd30 2023-11-18T20:40:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.503+0000 7f9f0559a640 1 -- 172.21.15.132:0/89603437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8031d20 con 0x7f9f0814fd30 2023-11-18T20:40:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.504+0000 7f9f0cf05640 1 -- 172.21.15.132:0/89603437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0814fd30 msgr2=0x7f9f08152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.504+0000 7f9f0cf05640 1 --2- 172.21.15.132:0/89603437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0814fd30 0x7f9f08152f20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80097a0 tx=0x7f9ef802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.504+0000 7f9f0cf05640 1 -- 172.21.15.132:0/89603437 shutdown_connections 2023-11-18T20:40:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.504+0000 7f9f0cf05640 1 --2- 172.21.15.132:0/89603437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0814fd30 0x7f9f08152f20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.504+0000 7f9f0cf05640 1 -- 172.21.15.132:0/89603437 >> 172.21.15.132:0/89603437 conn(0x7f9f0806a500 msgr2=0x7f9f0806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.504+0000 7f9f0cf05640 1 -- 172.21.15.132:0/89603437 shutdown_connections 2023-11-18T20:40:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.504+0000 7f9f0cf05640 1 -- 172.21.15.132:0/89603437 wait complete. 2023-11-18T20:40:32.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.505+0000 7f9f0cf05640 1 Processor -- start 2023-11-18T20:40:32.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.506+0000 7f9f0cf05640 1 -- start start 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.506+0000 7f9f0cf05640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f0806d0a0 0x7f9f081520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.506+0000 7f9f0cf05640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f080c3ea0 0x7f9f081dc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.506+0000 7f9f0cf05640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f0814fd30 0x7f9f08150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.506+0000 7f9f0cf05640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f08152750 con 0x7f9f080c3ea0 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.506+0000 7f9f0cf05640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081ea8d0 con 0x7f9f0814fd30 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.506+0000 7f9f0cf05640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081eabb0 con 0x7f9f0806d0a0 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f080c3ea0 0x7f9f081dc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f080c3ea0 0x7f9f081dc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47536/0 (socket says 172.21.15.132:47536) 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 -- 172.21.15.132:0/131636833 learned_addr learned my addr 172.21.15.132:0/131636833 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:32.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f0659c640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f0806d0a0 0x7f9f081520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f06d9d640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f0814fd30 0x7f9f08150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 -- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f0806d0a0 msgr2=0x7f9f081520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f0806d0a0 0x7f9f081520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 -- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f0814fd30 msgr2=0x7f9f08150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f0814fd30 0x7f9f08150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 -- 172.21.15.132:0/131636833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8009400 con 0x7f9f080c3ea0 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f0659c640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f0806d0a0 0x7f9f081520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.507+0000 7f9f05d9b640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f080c3ea0 0x7f9f081dc3a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c410 tx=0x7f9efc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.508+0000 7f9ef6ffd640 1 -- 172.21.15.132:0/131636833 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0074e0 con 0x7f9f080c3ea0 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.508+0000 7f9ef6ffd640 1 -- 172.21.15.132:0/131636833 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc007660 con 0x7f9f080c3ea0 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.508+0000 7f9ef6ffd640 1 -- 172.21.15.132:0/131636833 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc004a20 con 0x7f9f080c3ea0 2023-11-18T20:40:32.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.508+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f081eae90 con 0x7f9f080c3ea0 2023-11-18T20:40:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.508+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f081dc8e0 con 0x7f9f080c3ea0 2023-11-18T20:40:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.509+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f080c56b0 con 0x7f9f080c3ea0 2023-11-18T20:40:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.510+0000 7f9ef6ffd640 1 -- 172.21.15.132:0/131636833 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9efc004b80 con 0x7f9f080c3ea0 2023-11-18T20:40:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.511+0000 7f9ef6ffd640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ee806ae40 0x7f9ee806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.511+0000 7f9ef6ffd640 1 -- 172.21.15.132:0/131636833 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9efc089730 con 0x7f9f080c3ea0 2023-11-18T20:40:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.512+0000 7f9f0659c640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ee806ae40 0x7f9ee806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.513+0000 7f9f0659c640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ee806ae40 0x7f9ee806d300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8036000 tx=0x7f9ef8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:32.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.516+0000 7f9ef6ffd640 1 -- 172.21.15.132:0/131636833 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9efc057fa0 con 0x7f9f080c3ea0 2023-11-18T20:40:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:32.729+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9f080c49c0 con 0x7f9f080c3ea0 2023-11-18T20:40:33.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.416+0000 7f9ef6ffd640 1 -- 172.21.15.132:0/131636833 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 119+0+0 (secure 0 0 0) 0x7f9efc057b30 con 0x7f9f080c3ea0 2023-11-18T20:40:33.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ee806ae40 msgr2=0x7f9ee806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:33.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ee806ae40 0x7f9ee806d300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8036000 tx=0x7f9ef8008030 comp rx=0 tx=0).stop 2023-11-18T20:40:33.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f080c3ea0 msgr2=0x7f9f081dc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f080c3ea0 0x7f9f081dc3a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c410 tx=0x7f9efc00c8d0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 shutdown_connections 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ee806ae40 0x7f9ee806d300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f0814fd30 0x7f9f08150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f080c3ea0 0x7f9f081dc3a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 --2- 172.21.15.132:0/131636833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f0806d0a0 0x7f9f081520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 >> 172.21.15.132:0/131636833 conn(0x7f9f0806a500 msgr2=0x7f9f0806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 shutdown_connections 2023-11-18T20:40:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.421+0000 7f9f0cf05640 1 -- 172.21.15.132:0/131636833 wait complete. 2023-11-18T20:40:33.442 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T20:40:33.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-18T20:40:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.658+0000 7fcc0a094640 1 Processor -- start 2023-11-18T20:40:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.658+0000 7fcc0a094640 1 -- start start 2023-11-18T20:40:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.659+0000 7fcc0a094640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0414fd30 0x7fcc04152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.659+0000 7fcc0a094640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcc0406d0a0 0x7fcc040a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc0a094640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc040c64a0 con 0x7fcc040a5260 2023-11-18T20:40:33.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc0a094640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc040c5c00 con 0x7fcc0406d0a0 2023-11-18T20:40:33.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc0a094640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040c5ee0 con 0x7fcc0414fd30 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc03fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcc040a5260 0x7fcc040c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41548/0 (socket says 172.21.15.132:41548) 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc03fff640 1 -- 172.21.15.132:0/1970891543 learned_addr learned my addr 172.21.15.132:0/1970891543 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc02ffd640 1 --2- 172.21.15.132:0/1970891543 >> v2:172.21.15.161:3300/0 conn(0x7fcc0406d0a0 0x7fcc040a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc037fe640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0414fd30 0x7fcc04152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132654343 0 0) 0x7fcc040c64a0 con 0x7fcc040a5260 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.660+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf0003520 con 0x7fcc040a5260 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369015549 0 0) 0x7fcbf0003520 con 0x7fcc040a5260 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0414fd30 msgr2=0x7fcc04152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0414fd30 0x7fcc04152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 >> v2:172.21.15.161:3300/0 conn(0x7fcc0406d0a0 msgr2=0x7fcc040a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 --2- 172.21.15.132:0/1970891543 >> v2:172.21.15.161:3300/0 conn(0x7fcc0406d0a0 0x7fcc040a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc040c61c0 con 0x7fcc040a5260 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fcbfc0019f0 con 0x7fcc040a5260 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 >> v1:172.21.15.132:6789/0 conn(0x7fcc040a5260 legacy=0x7fcc040c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf0003970 0x7fcbf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcbf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0414fd30 0x7fcbf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040c5c00 con 0x7fcbf00047c0 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040c5ee0 con 0x7fcbf0003970 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf000ba80 con 0x7fcc0414fd30 2023-11-18T20:40:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc02ffd640 1 --2- 172.21.15.132:0/1970891543 >> v2:172.21.15.161:3300/0 conn(0x7fcc0406d0a0 0x7fcc040a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:40:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.661+0000 7fcc02ffd640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcbf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.662+0000 7fcc037fe640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf0003970 0x7fcbf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.662+0000 7fcc02ffd640 1 -- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0414fd30 msgr2=0x7fcbf0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.662+0000 7fcc02ffd640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0414fd30 0x7fcbf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.662+0000 7fcc02ffd640 1 -- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf0003970 msgr2=0x7fcbf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.662+0000 7fcc02ffd640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf0003970 0x7fcbf0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.662+0000 7fcc02ffd640 1 -- 172.21.15.132:0/1970891543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0003520 con 0x7fcbf00047c0 2023-11-18T20:40:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.663+0000 7fcc02ffd640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcbf0004c40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcbec006fd0 tx=0x7fcbf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def29bb017cfc7b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.663+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec030900 con 0x7fcbf00047c0 2023-11-18T20:40:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.663+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec030a60 con 0x7fcbf00047c0 2023-11-18T20:40:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.663+0000 7fcc027fc640 1 -- 172.21.15.132:0/1970891543 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec030dd0 con 0x7fcbf00047c0 2023-11-18T20:40:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.664+0000 7fcc0a094640 1 -- 172.21.15.132:0/1970891543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 msgr2=0x7fcbf0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.664+0000 7fcc0a094640 1 --2- 172.21.15.132:0/1970891543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcbf0004c40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcbec006fd0 tx=0x7fcbf00057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.664+0000 7fcc03fff640 1 -- 172.21.15.132:0/1970891543 reap_dead start 2023-11-18T20:40:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.664+0000 7fcc0a094640 1 -- 172.21.15.132:0/1970891543 shutdown_connections 2023-11-18T20:40:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.664+0000 7fcc0a094640 1 -- 172.21.15.132:0/1970891543 >> 172.21.15.132:0/1970891543 conn(0x7fcc0406a500 msgr2=0x7fcc0406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.664+0000 7fcc0a094640 1 -- 172.21.15.132:0/1970891543 shutdown_connections 2023-11-18T20:40:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.664+0000 7fcc0a094640 1 -- 172.21.15.132:0/1970891543 wait complete. 2023-11-18T20:40:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.666+0000 7fcc0a094640 1 Processor -- start 2023-11-18T20:40:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.666+0000 7fcc0a094640 1 -- start start 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc0a094640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcc0414e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc0a094640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc041524f0 0x7fcc040aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc0a094640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc041e9f50 0x7fcc040aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc0a094640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc041ea430 con 0x7fcbf00047c0 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc0a094640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc04151790 con 0x7fcc041e9f50 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc0a094640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc04151a70 con 0x7fcc041524f0 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcc0414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcc0414e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47544/0 (socket says 172.21.15.132:47544) 2023-11-18T20:40:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.667+0000 7fcc037fe640 1 -- 172.21.15.132:0/3970204505 learned_addr learned my addr 172.21.15.132:0/3970204505 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcc03fff640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc041e9f50 0x7fcc040aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcc037fe640 1 -- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc041524f0 msgr2=0x7fcc040aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcc037fe640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc041524f0 0x7fcc040aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcc037fe640 1 -- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc041e9f50 msgr2=0x7fcc040aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcc037fe640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc041e9f50 0x7fcc040aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcc037fe640 1 -- 172.21.15.132:0/3970204505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc04151d50 con 0x7fcbf00047c0 2023-11-18T20:40:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcc037fe640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcc0414e560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400f580 tx=0x7fcbf400fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcbfbfff640 1 -- 172.21.15.132:0/3970204505 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4014870 con 0x7fcbf00047c0 2023-11-18T20:40:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcbfbfff640 1 -- 172.21.15.132:0/3970204505 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf40149d0 con 0x7fcbf00047c0 2023-11-18T20:40:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0414eaa0 con 0x7fcbf00047c0 2023-11-18T20:40:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.668+0000 7fcbfbfff640 1 -- 172.21.15.132:0/3970204505 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4014d80 con 0x7fcbf00047c0 2023-11-18T20:40:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.669+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc04153a30 con 0x7fcbf00047c0 2023-11-18T20:40:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.670+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc041e61b0 con 0x7fcbf00047c0 2023-11-18T20:40:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.671+0000 7fcbfbfff640 1 -- 172.21.15.132:0/3970204505 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbf4015410 con 0x7fcbf00047c0 2023-11-18T20:40:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.671+0000 7fcbfbfff640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcbe406ae40 0x7fcbe406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.672+0000 7fcbfbfff640 1 -- 172.21.15.132:0/3970204505 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcbf408a350 con 0x7fcbf00047c0 2023-11-18T20:40:33.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.672+0000 7fcc02ffd640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcbe406ae40 0x7fcbe406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.673+0000 7fcc02ffd640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcbe406ae40 0x7fcbe406d300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcbec03a000 tx=0x7fcbec032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:33.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.676+0000 7fcbfbfff640 1 -- 172.21.15.132:0/3970204505 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbf4055010 con 0x7fcbf00047c0 2023-11-18T20:40:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:33.907+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcc04068350 con 0x7fcbf00047c0 2023-11-18T20:40:34.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.420+0000 7fcbfbfff640 1 -- 172.21.15.132:0/3970204505 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcbf4058630 con 0x7fcbf00047c0 2023-11-18T20:40:34.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.423+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcbe406ae40 msgr2=0x7fcbe406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:34.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.423+0000 7fcc0a094640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcbe406ae40 0x7fcbe406d300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcbec03a000 tx=0x7fcbec032000 comp rx=0 tx=0).stop 2023-11-18T20:40:34.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.423+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 msgr2=0x7fcc0414e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:34.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.423+0000 7fcc0a094640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcc0414e560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400f580 tx=0x7fcbf400fa40 comp rx=0 tx=0).stop 2023-11-18T20:40:34.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.424+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 shutdown_connections 2023-11-18T20:40:34.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.424+0000 7fcc0a094640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcbe406ae40 0x7fcbe406d300 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.424+0000 7fcc0a094640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc041e9f50 0x7fcc040aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.424+0000 7fcc0a094640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc041524f0 0x7fcc040aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.424+0000 7fcc0a094640 1 --2- 172.21.15.132:0/3970204505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbf00047c0 0x7fcc0414e560 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.424+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 >> 172.21.15.132:0/3970204505 conn(0x7fcc0406a500 msgr2=0x7fcc0406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:34.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.424+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 shutdown_connections 2023-11-18T20:40:34.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.424+0000 7fcc0a094640 1 -- 172.21.15.132:0/3970204505 wait complete. 2023-11-18T20:40:34.447 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-18T20:40:34.447 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.661+0000 7fa11bd2c640 1 Processor -- start 2023-11-18T20:40:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.661+0000 7fa11bd2c640 1 -- start start 2023-11-18T20:40:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa11bd2c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1140c3bc0 0x7fa1140a5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa11bd2c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa1140724f0 0x7fa1140c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa11bd2c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1140a5780 con 0x7fa1140c2750 2023-11-18T20:40:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa11bd2c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140aadc0 con 0x7fa1140724f0 2023-11-18T20:40:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa11bd2c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140c4170 con 0x7fa1140c3bc0 2023-11-18T20:40:34.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa11a2c9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa1140c2750 0x7fa114154500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41550/0 (socket says 172.21.15.132:41550) 2023-11-18T20:40:34.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa11a2c9640 1 -- 172.21.15.132:0/407863254 learned_addr learned my addr 172.21.15.132:0/407863254 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa119ac8640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1140c3bc0 0x7fa1140a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa1192c7640 1 --2- 172.21.15.132:0/407863254 >> v2:172.21.15.161:3300/0 conn(0x7fa1140724f0 0x7fa1140c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227682229 0 0) 0x7fa1140a5780 con 0x7fa1140c2750 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa100005730 con 0x7fa1140c2750 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1269580065 0 0) 0x7fa100005730 con 0x7fa1140c2750 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1140c3bc0 msgr2=0x7fa1140a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1140c3bc0 0x7fa1140a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 >> v2:172.21.15.161:3300/0 conn(0x7fa1140724f0 msgr2=0x7fa1140c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 --2- 172.21.15.132:0/407863254 >> v2:172.21.15.161:3300/0 conn(0x7fa1140724f0 0x7fa1140c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140c4450 con 0x7fa1140c2750 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fa10c0019f0 con 0x7fa1140c2750 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 >> v1:172.21.15.132:6789/0 conn(0x7fa1140c2750 legacy=0x7fa114154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa100005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1140c3bc0 0x7fa1000069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa100006f10 0x7fa100007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140aadc0 con 0x7fa100005b80 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140c4170 con 0x7fa100006f10 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.663+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10000db90 con 0x7fa1140c3bc0 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.664+0000 7fa119ac8640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa100005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.664+0000 7fa119ac8640 1 -- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1140c3bc0 msgr2=0x7fa1000069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.664+0000 7fa119ac8640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1140c3bc0 0x7fa1000069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.664+0000 7fa119ac8640 1 -- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa100006f10 msgr2=0x7fa100007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.664+0000 7fa119ac8640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa100006f10 0x7fa100007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.664+0000 7fa119ac8640 1 -- 172.21.15.132:0/407863254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100005730 con 0x7fa100005b80 2023-11-18T20:40:34.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.665+0000 7fa119ac8640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa100005fa0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa110009ac0 tx=0x7fa100007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7236f2a7220f56ac server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:34.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.665+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11002c710 con 0x7fa100005b80 2023-11-18T20:40:34.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.665+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11002c870 con 0x7fa100005b80 2023-11-18T20:40:34.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.665+0000 7fa118ac6640 1 -- 172.21.15.132:0/407863254 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11002cc00 con 0x7fa100005b80 2023-11-18T20:40:34.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.666+0000 7fa11bd2c640 1 -- 172.21.15.132:0/407863254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 msgr2=0x7fa100005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:34.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.666+0000 7fa11bd2c640 1 --2- 172.21.15.132:0/407863254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa100005fa0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa110009ac0 tx=0x7fa100007a00 comp rx=0 tx=0).stop 2023-11-18T20:40:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.666+0000 7fa11a2c9640 1 -- 172.21.15.132:0/407863254 reap_dead start 2023-11-18T20:40:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.666+0000 7fa11bd2c640 1 -- 172.21.15.132:0/407863254 shutdown_connections 2023-11-18T20:40:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.666+0000 7fa11bd2c640 1 -- 172.21.15.132:0/407863254 >> 172.21.15.132:0/407863254 conn(0x7fa11406a500 msgr2=0x7fa11406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.666+0000 7fa11bd2c640 1 -- 172.21.15.132:0/407863254 shutdown_connections 2023-11-18T20:40:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.666+0000 7fa11bd2c640 1 -- 172.21.15.132:0/407863254 wait complete. 2023-11-18T20:40:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.668+0000 7fa11bd2c640 1 Processor -- start 2023-11-18T20:40:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.668+0000 7fa11bd2c640 1 -- start start 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa11bd2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa1140a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa11bd2c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa114152cf0 0x7fa1141525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa11bd2c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1140bf260 0x7fa1140bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa11bd2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114152b30 con 0x7fa100005b80 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa11bd2c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140a4860 con 0x7fa1140bf260 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa11bd2c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140bad80 con 0x7fa114152cf0 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa119ac8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa1140a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa119ac8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa1140a41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47556/0 (socket says 172.21.15.132:47556) 2023-11-18T20:40:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa119ac8640 1 -- 172.21.15.132:0/4115765687 learned_addr learned my addr 172.21.15.132:0/4115765687 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa119ac8640 1 -- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa114152cf0 msgr2=0x7fa1141525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa119ac8640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa114152cf0 0x7fa1141525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa119ac8640 1 -- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1140bf260 msgr2=0x7fa1140bf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa119ac8640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1140bf260 0x7fa1140bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.669+0000 7fa119ac8640 1 -- 172.21.15.132:0/4115765687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140bb060 con 0x7fa100005b80 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.670+0000 7fa119ac8640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa1140a41f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa11002c2b0 tx=0x7fa110004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.670+0000 7fa10a7fc640 1 -- 172.21.15.132:0/4115765687 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110003810 con 0x7fa100005b80 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.670+0000 7fa10a7fc640 1 -- 172.21.15.132:0/4115765687 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11002de90 con 0x7fa100005b80 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.670+0000 7fa10a7fc640 1 -- 172.21.15.132:0/4115765687 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110003b90 con 0x7fa100005b80 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.670+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1140bb340 con 0x7fa100005b80 2023-11-18T20:40:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.670+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1140a9690 con 0x7fa100005b80 2023-11-18T20:40:34.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.671+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa114072a50 con 0x7fa100005b80 2023-11-18T20:40:34.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.672+0000 7fa10a7fc640 1 -- 172.21.15.132:0/4115765687 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa110003cf0 con 0x7fa100005b80 2023-11-18T20:40:34.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.673+0000 7fa10a7fc640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa0f806ae40 0x7fa0f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:34.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.673+0000 7fa10a7fc640 1 -- 172.21.15.132:0/4115765687 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa1100aba60 con 0x7fa100005b80 2023-11-18T20:40:34.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.674+0000 7fa1192c7640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa0f806ae40 0x7fa0f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:34.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.675+0000 7fa1192c7640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa0f806ae40 0x7fa0f806d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa1040093d0 tx=0x7fa104009300 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:34.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.680+0000 7fa10a7fc640 1 -- 172.21.15.132:0/4115765687 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa110076a10 con 0x7fa100005b80 2023-11-18T20:40:34.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.912+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa114068350 con 0x7fa100005b80 2023-11-18T20:40:34.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.913+0000 7fa10a7fc640 1 -- 172.21.15.132:0/4115765687 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6141 (secure 0 0 0) 0x7fa11007a030 con 0x7fa100005b80 2023-11-18T20:40:34.915 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:34.916 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:15.246098+0000","modified":"2023-11-18T20:40:18.344815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/3392191515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3392191515},{"type":"v1","addr":"172.21.15.132:6835","nonce":3392191515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:30.829157+0000","modified":"2023-11-18T20:40:33.909984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-18T20:40:34.916 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 35 2023-11-18T20:40:34.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa0f806ae40 msgr2=0x7fa0f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:34.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa0f806ae40 0x7fa0f806d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa1040093d0 tx=0x7fa104009300 comp rx=0 tx=0).stop 2023-11-18T20:40:34.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 msgr2=0x7fa1140a41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:34.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa1140a41f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa11002c2b0 tx=0x7fa110004730 comp rx=0 tx=0).stop 2023-11-18T20:40:34.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 shutdown_connections 2023-11-18T20:40:34.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa0f806ae40 0x7fa0f806d300 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1140bf260 0x7fa1140bf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa114152cf0 0x7fa1141525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 --2- 172.21.15.132:0/4115765687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa100005b80 0x7fa1140a41f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:34.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 >> 172.21.15.132:0/4115765687 conn(0x7fa11406a500 msgr2=0x7fa11406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:34.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 shutdown_connections 2023-11-18T20:40:34.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:34.916+0000 7fa11bd2c640 1 -- 172.21.15.132:0/4115765687 wait complete. 2023-11-18T20:40:34.938 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:35.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.147+0000 7ff57a1fb640 1 Processor -- start 2023-11-18T20:40:35.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.147+0000 7ff57a1fb640 1 -- start start 2023-11-18T20:40:35.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.149+0000 7ff57a1fb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff57406d0a0 0x7ff574152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.149+0000 7ff57a1fb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5740c64a0 con 0x7ff57414fd30 2023-11-18T20:40:35.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.149+0000 7ff57a1fb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5740c5c00 con 0x7ff5740c3ea0 2023-11-18T20:40:35.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.149+0000 7ff57a1fb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5740c5ee0 con 0x7ff57406d0a0 2023-11-18T20:40:35.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.149+0000 7ff5737fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff57414fd30 0x7ff5740a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41566/0 (socket says 172.21.15.132:41566) 2023-11-18T20:40:35.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.149+0000 7ff5737fe640 1 -- 172.21.15.132:0/597816538 learned_addr learned my addr 172.21.15.132:0/597816538 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:35.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.149+0000 7ff572ffd640 1 --2- 172.21.15.132:0/597816538 >> v2:172.21.15.161:3300/0 conn(0x7ff57406d0a0 0x7ff574152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.149+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976678248 0 0) 0x7ff5740c64a0 con 0x7ff57414fd30 2023-11-18T20:40:35.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff55c003520 con 0x7ff57414fd30 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535808734 0 0) 0x7ff55c003520 con 0x7ff57414fd30 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 >> v2:172.21.15.161:3300/0 conn(0x7ff57406d0a0 msgr2=0x7ff574152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 --2- 172.21.15.132:0/597816538 >> v2:172.21.15.161:3300/0 conn(0x7ff57406d0a0 0x7ff574152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 >> v1:172.21.15.161:6789/0 conn(0x7ff5740c3ea0 legacy=0x7ff5740c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5740c61c0 con 0x7ff57414fd30 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7ff564001670 con 0x7ff57414fd30 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 >> v1:172.21.15.132:6789/0 conn(0x7ff57414fd30 legacy=0x7ff5740a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff55c0039c0 0x7ff55c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff55c0047c0 0x7ff55c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff55c0051d0 0x7ff55c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740c5ee0 con 0x7ff55c0039c0 2023-11-18T20:40:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c00c120 con 0x7ff55c0047c0 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c00c2e0 con 0x7ff55c0051d0 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.150+0000 7ff5737fe640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff55c0039c0 0x7ff55c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.151+0000 7ff572ffd640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff55c0047c0 0x7ff55c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.151+0000 7ff5737fe640 1 -- 172.21.15.132:0/597816538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff55c0051d0 msgr2=0x7ff55c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.151+0000 7ff5737fe640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff55c0051d0 0x7ff55c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.151+0000 7ff5737fe640 1 -- 172.21.15.132:0/597816538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff55c0047c0 msgr2=0x7ff55c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.151+0000 7ff5737fe640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff55c0047c0 0x7ff55c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.151+0000 7ff5737fe640 1 -- 172.21.15.132:0/597816538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c003520 con 0x7ff55c0039c0 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.151+0000 7ff572ffd640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff55c0047c0 0x7ff55c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.151+0000 7ff573fff640 1 -- 172.21.15.132:0/597816538 reap_dead start 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.152+0000 7ff5737fe640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff55c0039c0 0x7ff55c003de0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c0e0 tx=0x7ff55c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fecd3b8cae81d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.152+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564005ad0 con 0x7ff55c0039c0 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.152+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564005c30 con 0x7ff55c0039c0 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.152+0000 7ff5727fc640 1 -- 172.21.15.132:0/597816538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56402ca50 con 0x7ff55c0039c0 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.153+0000 7ff57a1fb640 1 -- 172.21.15.132:0/597816538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff55c0039c0 msgr2=0x7ff55c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.153+0000 7ff57a1fb640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff55c0039c0 0x7ff55c003de0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c0e0 tx=0x7ff55c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.153+0000 7ff57a1fb640 1 -- 172.21.15.132:0/597816538 shutdown_connections 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.153+0000 7ff57a1fb640 1 --2- 172.21.15.132:0/597816538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff55c0039c0 0x7ff55c003de0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.153+0000 7ff57a1fb640 1 -- 172.21.15.132:0/597816538 >> 172.21.15.132:0/597816538 conn(0x7ff57406a500 msgr2=0x7ff57406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.153+0000 7ff57a1fb640 1 -- 172.21.15.132:0/597816538 shutdown_connections 2023-11-18T20:40:35.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.153+0000 7ff57a1fb640 1 -- 172.21.15.132:0/597816538 wait complete. 2023-11-18T20:40:35.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.155+0000 7ff57a1fb640 1 Processor -- start 2023-11-18T20:40:35.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.155+0000 7ff57a1fb640 1 -- start start 2023-11-18T20:40:35.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff57a1fb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff55c0039c0 0x7ff5741547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff57a1fb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5741de710 0x7ff5741538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff57a1fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574153e30 0x7ff5741eb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff57a1fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740c0320 con 0x7ff574153e30 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff57a1fb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5741ec150 con 0x7ff5741de710 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff57a1fb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740bb6e0 con 0x7ff55c0039c0 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff573fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574153e30 0x7ff5741eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff573fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574153e30 0x7ff5741eb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47564/0 (socket says 172.21.15.132:47564) 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff573fff640 1 -- 172.21.15.132:0/4073346665 learned_addr learned my addr 172.21.15.132:0/4073346665 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff572ffd640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5741de710 0x7ff5741538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff5737fe640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff55c0039c0 0x7ff5741547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff573fff640 1 -- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff55c0039c0 msgr2=0x7ff5741547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff573fff640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff55c0039c0 0x7ff5741547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff573fff640 1 -- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5741de710 msgr2=0x7ff5741538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff573fff640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5741de710 0x7ff5741538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.156+0000 7ff573fff640 1 -- 172.21.15.132:0/4073346665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5741ebe70 con 0x7ff574153e30 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.157+0000 7ff573fff640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574153e30 0x7ff5741eb480 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff5740c3860 tx=0x7ff56c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.157+0000 7ff55bfff640 1 -- 172.21.15.132:0/4073346665 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c005d40 con 0x7ff574153e30 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.157+0000 7ff55bfff640 1 -- 172.21.15.132:0/4073346665 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c00ced0 con 0x7ff574153e30 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.157+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5740bff40 con 0x7ff574153e30 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.157+0000 7ff55bfff640 1 -- 172.21.15.132:0/4073346665 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00a850 con 0x7ff574153e30 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.157+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5741eb9c0 con 0x7ff574153e30 2023-11-18T20:40:35.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.158+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5741ebc40 con 0x7ff574153e30 2023-11-18T20:40:35.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.159+0000 7ff55bfff640 1 -- 172.21.15.132:0/4073346665 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff56c00a9b0 con 0x7ff574153e30 2023-11-18T20:40:35.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.160+0000 7ff55bfff640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56006ae40 0x7ff56006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.160+0000 7ff55bfff640 1 -- 172.21.15.132:0/4073346665 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff56c088d10 con 0x7ff574153e30 2023-11-18T20:40:35.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.161+0000 7ff5737fe640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56006ae40 0x7ff56006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.162+0000 7ff5737fe640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56006ae40 0x7ff56006d300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff564034000 tx=0x7ff564009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:35.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.165+0000 7ff55bfff640 1 -- 172.21.15.132:0/4073346665 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff56c053af0 con 0x7ff574153e30 2023-11-18T20:40:35.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.354+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff574068350 con 0x7ff574153e30 2023-11-18T20:40:35.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.359+0000 7ff55bfff640 1 -- 172.21.15.132:0/4073346665 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+20256 (secure 0 0 0) 0x7ff56c017020 con 0x7ff574153e30 2023-11-18T20:40:35.361 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":59,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:32.397403+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:35.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56006ae40 msgr2=0x7ff56006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56006ae40 0x7ff56006d300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff564034000 tx=0x7ff564009030 comp rx=0 tx=0).stop 2023-11-18T20:40:35.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574153e30 msgr2=0x7ff5741eb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574153e30 0x7ff5741eb480 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff5740c3860 tx=0x7ff56c00cb90 comp rx=0 tx=0).stop 2023-11-18T20:40:35.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 shutdown_connections 2023-11-18T20:40:35.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff56006ae40 0x7ff56006d300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff574153e30 0x7ff5741eb480 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5741de710 0x7ff5741538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 --2- 172.21.15.132:0/4073346665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff55c0039c0 0x7ff5741547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 >> 172.21.15.132:0/4073346665 conn(0x7ff57406a500 msgr2=0x7ff574152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:35.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 shutdown_connections 2023-11-18T20:40:35.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.361+0000 7ff57a1fb640 1 -- 172.21.15.132:0/4073346665 wait complete. 2023-11-18T20:40:35.380 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T20:40:35.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:40:35.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.588+0000 7f028d4a2640 1 Processor -- start 2023-11-18T20:40:35.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.588+0000 7f028d4a2640 1 -- start start 2023-11-18T20:40:35.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.589+0000 7f028d4a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f028814fd30 0x7f0288152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.589+0000 7f028d4a2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f028806d0a0 0x7f02880a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.589+0000 7f028d4a2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880c64a0 con 0x7f02880a5260 2023-11-18T20:40:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.589+0000 7f028d4a2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880c5c00 con 0x7f028814fd30 2023-11-18T20:40:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.589+0000 7f028d4a2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880c5ee0 con 0x7f028806d0a0 2023-11-18T20:40:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f0286ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f028814fd30 0x7f0288152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f0286ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f028814fd30 0x7f0288152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47568/0 (socket says 172.21.15.132:47568) 2023-11-18T20:40:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f0286ffd640 1 -- 172.21.15.132:0/1525862044 learned_addr learned my addr 172.21.15.132:0/1525862044 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:35.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f02867fc640 1 --2- 172.21.15.132:0/1525862044 >> v2:172.21.15.161:3300/0 conn(0x7f028806d0a0 0x7f02880a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f0286ffd640 1 -- 172.21.15.132:0/1525862044 >> v2:172.21.15.161:3300/0 conn(0x7f028806d0a0 msgr2=0x7f02880a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:35.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f0286ffd640 1 --2- 172.21.15.132:0/1525862044 >> v2:172.21.15.161:3300/0 conn(0x7f028806d0a0 0x7f02880a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f0286ffd640 1 -- 172.21.15.132:0/1525862044 >> v1:172.21.15.161:6789/0 conn(0x7f02880a5260 legacy=0x7f02880c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:35.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f0286ffd640 1 -- 172.21.15.132:0/1525862044 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880c61c0 con 0x7f028814fd30 2023-11-18T20:40:35.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.590+0000 7f02867fc640 1 --2- 172.21.15.132:0/1525862044 >> v2:172.21.15.161:3300/0 conn(0x7f028806d0a0 0x7f02880a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:35.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.591+0000 7f0286ffd640 1 --2- 172.21.15.132:0/1525862044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f028814fd30 0x7f0288152f20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f028806b460 tx=0x7f027802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbf1ea425eed248 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f0285ffb640 1 -- 172.21.15.132:0/1525862044 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027802ca80 con 0x7f028814fd30 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f0285ffb640 1 -- 172.21.15.132:0/1525862044 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027802cbe0 con 0x7f028814fd30 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f0285ffb640 1 -- 172.21.15.132:0/1525862044 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780343f0 con 0x7f028814fd30 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f028d4a2640 1 -- 172.21.15.132:0/1525862044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f028814fd30 msgr2=0x7f0288152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f028d4a2640 1 --2- 172.21.15.132:0/1525862044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f028814fd30 0x7f0288152f20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f028806b460 tx=0x7f027802bee0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f028d4a2640 1 -- 172.21.15.132:0/1525862044 shutdown_connections 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f028d4a2640 1 --2- 172.21.15.132:0/1525862044 >> v2:172.21.15.161:3300/0 conn(0x7f028806d0a0 0x7f02880a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f028d4a2640 1 --2- 172.21.15.132:0/1525862044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f028814fd30 0x7f0288152f20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.592+0000 7f028d4a2640 1 -- 172.21.15.132:0/1525862044 >> 172.21.15.132:0/1525862044 conn(0x7f028806a500 msgr2=0x7f028806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.593+0000 7f028d4a2640 1 -- 172.21.15.132:0/1525862044 shutdown_connections 2023-11-18T20:40:35.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.593+0000 7f028d4a2640 1 -- 172.21.15.132:0/1525862044 wait complete. 2023-11-18T20:40:35.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.594+0000 7f028d4a2640 1 Processor -- start 2023-11-18T20:40:35.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.594+0000 7f028d4a2640 1 -- start start 2023-11-18T20:40:35.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.595+0000 7f028d4a2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f028806d0a0 0x7f028814ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.595+0000 7f028d4a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02880a5260 0x7f02880a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.595+0000 7f028d4a2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f028814fd30 0x7f02880a8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.595+0000 7f028d4a2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02881dc940 con 0x7f02880a5260 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.595+0000 7f028d4a2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880a9bc0 con 0x7f028814fd30 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.595+0000 7f028d4a2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880c2380 con 0x7f028806d0a0 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02880a5260 0x7f02880a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02880a5260 0x7f02880a9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47584/0 (socket says 172.21.15.132:47584) 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 -- 172.21.15.132:0/2298094028 learned_addr learned my addr 172.21.15.132:0/2298094028 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f0286ffd640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f028806d0a0 0x7f028814ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02877fe640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f028814fd30 0x7f02880a8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 -- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f028806d0a0 msgr2=0x7f028814ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f028806d0a0 0x7f028814ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 -- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f028814fd30 msgr2=0x7f02880a8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f028814fd30 0x7f02880a8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 -- 172.21.15.132:0/2298094028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278009b30 con 0x7f02880a5260 2023-11-18T20:40:35.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.596+0000 7f02867fc640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02880a5260 0x7f02880a9e40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c820 tx=0x7f027c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:35.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.597+0000 7f026f7fe640 1 -- 172.21.15.132:0/2298094028 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c007a30 con 0x7f02880a5260 2023-11-18T20:40:35.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.597+0000 7f026f7fe640 1 -- 172.21.15.132:0/2298094028 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c007b90 con 0x7f02880a5260 2023-11-18T20:40:35.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.597+0000 7f026f7fe640 1 -- 172.21.15.132:0/2298094028 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c0113f0 con 0x7f02880a5260 2023-11-18T20:40:35.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.597+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02881eddd0 con 0x7f02880a5260 2023-11-18T20:40:35.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.597+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02881ee300 con 0x7f02880a5260 2023-11-18T20:40:35.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.598+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02880aa380 con 0x7f02880a5260 2023-11-18T20:40:35.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.599+0000 7f026f7fe640 1 -- 172.21.15.132:0/2298094028 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f027c011550 con 0x7f02880a5260 2023-11-18T20:40:35.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.600+0000 7f026f7fe640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f027406ae40 0x7f027406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:35.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.600+0000 7f026f7fe640 1 -- 172.21.15.132:0/2298094028 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f027c089a10 con 0x7f02880a5260 2023-11-18T20:40:35.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.601+0000 7f0286ffd640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f027406ae40 0x7f027406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:35.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.602+0000 7f0286ffd640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f027406ae40 0x7f027406d300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0278035000 tx=0x7f0278030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:35.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.604+0000 7f026f7fe640 1 -- 172.21.15.132:0/2298094028 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f027c0547f0 con 0x7f02880a5260 2023-11-18T20:40:35.756 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-11-18T20:40:35.754+0000 7f658eeb8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:40:35.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.795+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0288072060 con 0x7f027406ae40 2023-11-18T20:40:35.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.837+0000 7f026f7fe640 1 -- 172.21.15.132:0/2298094028 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525564 (secure 0 0 0) 0x7f0288072060 con 0x7f027406ae40 2023-11-18T20:40:35.845 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:35.849 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f027406ae40 msgr2=0x7f027406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f027406ae40 0x7f027406d300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0278035000 tx=0x7f0278030000 comp rx=0 tx=0).stop 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02880a5260 msgr2=0x7f02880a9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02880a5260 0x7f02880a9e40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c820 tx=0x7f027c00cce0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 shutdown_connections 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f027406ae40 0x7f027406d300 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f028814fd30 0x7f02880a8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02880a5260 0x7f02880a9e40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 --2- 172.21.15.132:0/2298094028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f028806d0a0 0x7f028814ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 >> 172.21.15.132:0/2298094028 conn(0x7f028806a500 msgr2=0x7f02880c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:35.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 shutdown_connections 2023-11-18T20:40:35.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:35.847+0000 7f028d4a2640 1 -- 172.21.15.132:0/2298094028 wait complete. 2023-11-18T20:40:35.873 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-11-18T20:40:34.694473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":278,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235388,"kb_used_data":6696,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739332,"statfs":{"total":773094113280,"available":772853075968,"internally_reserved":0,"allocated":6856704,"data_stored":3625134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.337980"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425359+0000","last_change":"2023-11-18T20:40:31.422211+0000","last_active":"2023-11-18T20:40:31.425359+0000","last_peered":"2023-11-18T20:40:31.425359+0000","last_clean":"2023-11-18T20:40:31.425359+0000","last_became_active":"2023-11-18T20:40:31.421897+0000","last_became_peered":"2023-11-18T20:40:31.421897+0000","last_unstale":"2023-11-18T20:40:31.425359+0000","last_undegraded":"2023-11-18T20:40:31.425359+0000","last_fullsized":"2023-11-18T20:40:31.425359+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:47.217160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384685+0000","last_change":"2023-11-18T20:40:15.353470+0000","last_active":"2023-11-18T20:40:31.384685+0000","last_peered":"2023-11-18T20:40:31.384685+0000","last_clean":"2023-11-18T20:40:31.384685+0000","last_became_active":"2023-11-18T20:40:15.353123+0000","last_became_peered":"2023-11-18T20:40:15.353123+0000","last_unstale":"2023-11-18T20:40:31.384685+0000","last_undegraded":"2023-11-18T20:40:31.384685+0000","last_fullsized":"2023-11-18T20:40:31.384685+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:17:38.972740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.419531+0000","last_change":"2023-11-18T20:40:31.415623+0000","last_active":"2023-11-18T20:40:31.419531+0000","last_peered":"2023-11-18T20:40:31.419531+0000","last_clean":"2023-11-18T20:40:31.419531+0000","last_became_active":"2023-11-18T20:40:31.415317+0000","last_became_peered":"2023-11-18T20:40:31.415317+0000","last_unstale":"2023-11-18T20:40:31.419531+0000","last_undegraded":"2023-11-18T20:40:31.419531+0000","last_fullsized":"2023-11-18T20:40:31.419531+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:56.247717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394884+0000","last_change":"2023-11-18T20:40:15.364843+0000","last_active":"2023-11-18T20:40:30.394884+0000","last_peered":"2023-11-18T20:40:30.394884+0000","last_clean":"2023-11-18T20:40:30.394884+0000","last_became_active":"2023-11-18T20:40:15.364551+0000","last_became_peered":"2023-11-18T20:40:15.364551+0000","last_unstale":"2023-11-18T20:40:30.394884+0000","last_undegraded":"2023-11-18T20:40:30.394884+0000","last_fullsized":"2023-11-18T20:40:30.394884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:21.022118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436880+0000","last_change":"2023-11-18T20:40:31.428085+0000","last_active":"2023-11-18T20:40:31.436880+0000","last_peered":"2023-11-18T20:40:31.436880+0000","last_clean":"2023-11-18T20:40:31.436880+0000","last_became_active":"2023-11-18T20:40:31.427807+0000","last_became_peered":"2023-11-18T20:40:31.427807+0000","last_unstale":"2023-11-18T20:40:31.436880+0000","last_undegraded":"2023-11-18T20:40:31.436880+0000","last_fullsized":"2023-11-18T20:40:31.436880+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:39:59.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384838+0000","last_change":"2023-11-18T20:40:15.345424+0000","last_active":"2023-11-18T20:40:31.384838+0000","last_peered":"2023-11-18T20:40:31.384838+0000","last_clean":"2023-11-18T20:40:31.384838+0000","last_became_active":"2023-11-18T20:40:15.344537+0000","last_became_peered":"2023-11-18T20:40:15.344537+0000","last_unstale":"2023-11-18T20:40:31.384838+0000","last_undegraded":"2023-11-18T20:40:31.384838+0000","last_fullsized":"2023-11-18T20:40:31.384838+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:26.358299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.426050+0000","last_change":"2023-11-18T20:40:31.418641+0000","last_active":"2023-11-18T20:40:31.426050+0000","last_peered":"2023-11-18T20:40:31.426050+0000","last_clean":"2023-11-18T20:40:31.426050+0000","last_became_active":"2023-11-18T20:40:31.418359+0000","last_became_peered":"2023-11-18T20:40:31.418359+0000","last_unstale":"2023-11-18T20:40:31.426050+0000","last_undegraded":"2023-11-18T20:40:31.426050+0000","last_fullsized":"2023-11-18T20:40:31.426050+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:15:35.384237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388009+0000","last_change":"2023-11-18T20:40:15.356657+0000","last_active":"2023-11-18T20:40:30.388009+0000","last_peered":"2023-11-18T20:40:30.388009+0000","last_clean":"2023-11-18T20:40:30.388009+0000","last_became_active":"2023-11-18T20:40:15.356417+0000","last_became_peered":"2023-11-18T20:40:15.356417+0000","last_unstale":"2023-11-18T20:40:30.388009+0000","last_undegraded":"2023-11-18T20:40:30.388009+0000","last_fullsized":"2023-11-18T20:40:30.388009+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:07:05.628953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.427895+0000","last_change":"2023-11-18T20:40:31.420471+0000","last_active":"2023-11-18T20:40:31.427895+0000","last_peered":"2023-11-18T20:40:31.427895+0000","last_clean":"2023-11-18T20:40:31.427895+0000","last_became_active":"2023-11-18T20:40:31.420218+0000","last_became_peered":"2023-11-18T20:40:31.420218+0000","last_unstale":"2023-11-18T20:40:31.427895+0000","last_undegraded":"2023-11-18T20:40:31.427895+0000","last_fullsized":"2023-11-18T20:40:31.427895+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:40.795447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383757+0000","last_change":"2023-11-18T20:40:15.343983+0000","last_active":"2023-11-18T20:40:31.383757+0000","last_peered":"2023-11-18T20:40:31.383757+0000","last_clean":"2023-11-18T20:40:31.383757+0000","last_became_active":"2023-11-18T20:40:15.343720+0000","last_became_peered":"2023-11-18T20:40:15.343720+0000","last_unstale":"2023-11-18T20:40:31.383757+0000","last_undegraded":"2023-11-18T20:40:31.383757+0000","last_fullsized":"2023-11-18T20:40:31.383757+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:56:02.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436042+0000","last_change":"2023-11-18T20:40:31.423292+0000","last_active":"2023-11-18T20:40:31.436042+0000","last_peered":"2023-11-18T20:40:31.436042+0000","last_clean":"2023-11-18T20:40:31.436042+0000","last_became_active":"2023-11-18T20:40:31.418148+0000","last_became_peered":"2023-11-18T20:40:31.418148+0000","last_unstale":"2023-11-18T20:40:31.436042+0000","last_undegraded":"2023-11-18T20:40:31.436042+0000","last_fullsized":"2023-11-18T20:40:31.436042+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:57.947690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.382940+0000","last_change":"2023-11-18T20:40:15.350938+0000","last_active":"2023-11-18T20:40:31.382940+0000","last_peered":"2023-11-18T20:40:31.382940+0000","last_clean":"2023-11-18T20:40:31.382940+0000","last_became_active":"2023-11-18T20:40:15.350551+0000","last_became_peered":"2023-11-18T20:40:15.350551+0000","last_unstale":"2023-11-18T20:40:31.382940+0000","last_undegraded":"2023-11-18T20:40:31.382940+0000","last_fullsized":"2023-11-18T20:40:31.382940+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:32.423699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425152+0000","last_change":"2023-11-18T20:40:31.421612+0000","last_active":"2023-11-18T20:40:31.425152+0000","last_peered":"2023-11-18T20:40:31.425152+0000","last_clean":"2023-11-18T20:40:31.425152+0000","last_became_active":"2023-11-18T20:40:31.421180+0000","last_became_peered":"2023-11-18T20:40:31.421180+0000","last_unstale":"2023-11-18T20:40:31.425152+0000","last_undegraded":"2023-11-18T20:40:31.425152+0000","last_fullsized":"2023-11-18T20:40:31.425152+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:52:12.486041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382477+0000","last_change":"2023-11-18T20:40:15.349771+0000","last_active":"2023-11-18T20:40:30.382477+0000","last_peered":"2023-11-18T20:40:30.382477+0000","last_clean":"2023-11-18T20:40:30.382477+0000","last_became_active":"2023-11-18T20:40:15.349537+0000","last_became_peered":"2023-11-18T20:40:15.349537+0000","last_unstale":"2023-11-18T20:40:30.382477+0000","last_undegraded":"2023-11-18T20:40:30.382477+0000","last_fullsized":"2023-11-18T20:40:30.382477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:24:36.093151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415316+0000","last_change":"2023-11-18T20:40:31.412311+0000","last_active":"2023-11-18T20:40:32.415316+0000","last_peered":"2023-11-18T20:40:32.415316+0000","last_clean":"2023-11-18T20:40:32.415316+0000","last_became_active":"2023-11-18T20:40:31.411929+0000","last_became_peered":"2023-11-18T20:40:31.411929+0000","last_unstale":"2023-11-18T20:40:32.415316+0000","last_undegraded":"2023-11-18T20:40:32.415316+0000","last_fullsized":"2023-11-18T20:40:32.415316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:24.444189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392440+0000","last_change":"2023-11-18T20:40:15.348439+0000","last_active":"2023-11-18T20:40:30.392440+0000","last_peered":"2023-11-18T20:40:30.392440+0000","last_clean":"2023-11-18T20:40:30.392440+0000","last_became_active":"2023-11-18T20:40:15.348132+0000","last_became_peered":"2023-11-18T20:40:15.348132+0000","last_unstale":"2023-11-18T20:40:30.392440+0000","last_undegraded":"2023-11-18T20:40:30.392440+0000","last_fullsized":"2023-11-18T20:40:30.392440+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:15:18.987033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435981+0000","last_change":"2023-11-18T20:40:31.419314+0000","last_active":"2023-11-18T20:40:31.435981+0000","last_peered":"2023-11-18T20:40:31.435981+0000","last_clean":"2023-11-18T20:40:31.435981+0000","last_became_active":"2023-11-18T20:40:31.418530+0000","last_became_peered":"2023-11-18T20:40:31.418530+0000","last_unstale":"2023-11-18T20:40:31.435981+0000","last_undegraded":"2023-11-18T20:40:31.435981+0000","last_fullsized":"2023-11-18T20:40:31.435981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:49:08.160909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382920+0000","last_change":"2023-11-18T20:40:15.353406+0000","last_active":"2023-11-18T20:40:30.382920+0000","last_peered":"2023-11-18T20:40:30.382920+0000","last_clean":"2023-11-18T20:40:30.382920+0000","last_became_active":"2023-11-18T20:40:15.353034+0000","last_became_peered":"2023-11-18T20:40:15.353034+0000","last_unstale":"2023-11-18T20:40:30.382920+0000","last_undegraded":"2023-11-18T20:40:30.382920+0000","last_fullsized":"2023-11-18T20:40:30.382920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:20:37.917813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416050+0000","last_change":"2023-11-18T20:40:31.409265+0000","last_active":"2023-11-18T20:40:32.416050+0000","last_peered":"2023-11-18T20:40:32.416050+0000","last_clean":"2023-11-18T20:40:32.416050+0000","last_became_active":"2023-11-18T20:40:31.408953+0000","last_became_peered":"2023-11-18T20:40:31.408953+0000","last_unstale":"2023-11-18T20:40:32.416050+0000","last_undegraded":"2023-11-18T20:40:32.416050+0000","last_fullsized":"2023-11-18T20:40:32.416050+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:55:19.366101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384458+0000","last_change":"2023-11-18T20:40:15.342874+0000","last_active":"2023-11-18T20:40:31.384458+0000","last_peered":"2023-11-18T20:40:31.384458+0000","last_clean":"2023-11-18T20:40:31.384458+0000","last_became_active":"2023-11-18T20:40:15.342588+0000","last_became_peered":"2023-11-18T20:40:15.342588+0000","last_unstale":"2023-11-18T20:40:31.384458+0000","last_undegraded":"2023-11-18T20:40:31.384458+0000","last_fullsized":"2023-11-18T20:40:31.384458+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:25:23.165385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424943+0000","last_change":"2023-11-18T20:40:31.418792+0000","last_active":"2023-11-18T20:40:31.424943+0000","last_peered":"2023-11-18T20:40:31.424943+0000","last_clean":"2023-11-18T20:40:31.424943+0000","last_became_active":"2023-11-18T20:40:31.417959+0000","last_became_peered":"2023-11-18T20:40:31.417959+0000","last_unstale":"2023-11-18T20:40:31.424943+0000","last_undegraded":"2023-11-18T20:40:31.424943+0000","last_fullsized":"2023-11-18T20:40:31.424943+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:24:42.742871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.390289+0000","last_change":"2023-11-18T20:40:15.340398+0000","last_active":"2023-11-18T20:40:31.390289+0000","last_peered":"2023-11-18T20:40:31.390289+0000","last_clean":"2023-11-18T20:40:31.390289+0000","last_became_active":"2023-11-18T20:40:15.340055+0000","last_became_peered":"2023-11-18T20:40:15.340055+0000","last_unstale":"2023-11-18T20:40:31.390289+0000","last_undegraded":"2023-11-18T20:40:31.390289+0000","last_fullsized":"2023-11-18T20:40:31.390289+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:07:14.006606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.428975+0000","last_change":"2023-11-18T20:40:31.421505+0000","last_active":"2023-11-18T20:40:31.428975+0000","last_peered":"2023-11-18T20:40:31.428975+0000","last_clean":"2023-11-18T20:40:31.428975+0000","last_became_active":"2023-11-18T20:40:31.421167+0000","last_became_peered":"2023-11-18T20:40:31.421167+0000","last_unstale":"2023-11-18T20:40:31.428975+0000","last_undegraded":"2023-11-18T20:40:31.428975+0000","last_fullsized":"2023-11-18T20:40:31.428975+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:06:25.583469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.383028+0000","last_change":"2023-11-18T20:40:15.344623+0000","last_active":"2023-11-18T20:40:30.383028+0000","last_peered":"2023-11-18T20:40:30.383028+0000","last_clean":"2023-11-18T20:40:30.383028+0000","last_became_active":"2023-11-18T20:40:15.344216+0000","last_became_peered":"2023-11-18T20:40:15.344216+0000","last_unstale":"2023-11-18T20:40:30.383028+0000","last_undegraded":"2023-11-18T20:40:30.383028+0000","last_fullsized":"2023-11-18T20:40:30.383028+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:53.802513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.413911+0000","last_change":"2023-11-18T20:40:31.415434+0000","last_active":"2023-11-18T20:40:32.413911+0000","last_peered":"2023-11-18T20:40:32.413911+0000","last_clean":"2023-11-18T20:40:32.413911+0000","last_became_active":"2023-11-18T20:40:31.415092+0000","last_became_peered":"2023-11-18T20:40:31.415092+0000","last_unstale":"2023-11-18T20:40:32.413911+0000","last_undegraded":"2023-11-18T20:40:32.413911+0000","last_fullsized":"2023-11-18T20:40:32.413911+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:16.063377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378655+0000","last_change":"2023-11-18T20:40:15.352260+0000","last_active":"2023-11-18T20:40:30.378655+0000","last_peered":"2023-11-18T20:40:30.378655+0000","last_clean":"2023-11-18T20:40:30.378655+0000","last_became_active":"2023-11-18T20:40:15.351965+0000","last_became_peered":"2023-11-18T20:40:15.351965+0000","last_unstale":"2023-11-18T20:40:30.378655+0000","last_undegraded":"2023-11-18T20:40:30.378655+0000","last_fullsized":"2023-11-18T20:40:30.378655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:11.392335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.429898+0000","last_change":"2023-11-18T20:40:31.410941+0000","last_active":"2023-11-18T20:40:31.429898+0000","last_peered":"2023-11-18T20:40:31.429898+0000","last_clean":"2023-11-18T20:40:31.429898+0000","last_became_active":"2023-11-18T20:40:31.410658+0000","last_became_peered":"2023-11-18T20:40:31.410658+0000","last_unstale":"2023-11-18T20:40:31.429898+0000","last_undegraded":"2023-11-18T20:40:31.429898+0000","last_fullsized":"2023-11-18T20:40:31.429898+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:37:46.059128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.385708+0000","last_change":"2023-11-18T20:40:15.348662+0000","last_active":"2023-11-18T20:40:31.385708+0000","last_peered":"2023-11-18T20:40:31.385708+0000","last_clean":"2023-11-18T20:40:31.385708+0000","last_became_active":"2023-11-18T20:40:15.348091+0000","last_became_peered":"2023-11-18T20:40:15.348091+0000","last_unstale":"2023-11-18T20:40:31.385708+0000","last_undegraded":"2023-11-18T20:40:31.385708+0000","last_fullsized":"2023-11-18T20:40:31.385708+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:21:51.102783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425210+0000","last_change":"2023-11-18T20:40:31.422290+0000","last_active":"2023-11-18T20:40:31.425210+0000","last_peered":"2023-11-18T20:40:31.425210+0000","last_clean":"2023-11-18T20:40:31.425210+0000","last_became_active":"2023-11-18T20:40:31.421973+0000","last_became_peered":"2023-11-18T20:40:31.421973+0000","last_unstale":"2023-11-18T20:40:31.425210+0000","last_undegraded":"2023-11-18T20:40:31.425210+0000","last_fullsized":"2023-11-18T20:40:31.425210+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:00.254306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382573+0000","last_change":"2023-11-18T20:40:15.356747+0000","last_active":"2023-11-18T20:40:30.382573+0000","last_peered":"2023-11-18T20:40:30.382573+0000","last_clean":"2023-11-18T20:40:30.382573+0000","last_became_active":"2023-11-18T20:40:15.356448+0000","last_became_peered":"2023-11-18T20:40:15.356448+0000","last_unstale":"2023-11-18T20:40:30.382573+0000","last_undegraded":"2023-11-18T20:40:30.382573+0000","last_fullsized":"2023-11-18T20:40:30.382573+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:44.689679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415839+0000","last_change":"2023-11-18T20:40:31.409443+0000","last_active":"2023-11-18T20:40:32.415839+0000","last_peered":"2023-11-18T20:40:32.415839+0000","last_clean":"2023-11-18T20:40:32.415839+0000","last_became_active":"2023-11-18T20:40:31.409147+0000","last_became_peered":"2023-11-18T20:40:31.409147+0000","last_unstale":"2023-11-18T20:40:32.415839+0000","last_undegraded":"2023-11-18T20:40:32.415839+0000","last_fullsized":"2023-11-18T20:40:32.415839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:32.927454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383017+0000","last_change":"2023-11-18T20:40:15.349839+0000","last_active":"2023-11-18T20:40:31.383017+0000","last_peered":"2023-11-18T20:40:31.383017+0000","last_clean":"2023-11-18T20:40:31.383017+0000","last_became_active":"2023-11-18T20:40:15.349526+0000","last_became_peered":"2023-11-18T20:40:15.349526+0000","last_unstale":"2023-11-18T20:40:31.383017+0000","last_undegraded":"2023-11-18T20:40:31.383017+0000","last_fullsized":"2023-11-18T20:40:31.383017+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:54:40.657646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436117+0000","last_change":"2023-11-18T20:40:31.423351+0000","last_active":"2023-11-18T20:40:31.436117+0000","last_peered":"2023-11-18T20:40:31.436117+0000","last_clean":"2023-11-18T20:40:31.436117+0000","last_became_active":"2023-11-18T20:40:31.422902+0000","last_became_peered":"2023-11-18T20:40:31.422902+0000","last_unstale":"2023-11-18T20:40:31.436117+0000","last_undegraded":"2023-11-18T20:40:31.436117+0000","last_fullsized":"2023-11-18T20:40:31.436117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:40:49.827138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384702+0000","last_change":"2023-11-18T20:40:15.356534+0000","last_active":"2023-11-18T20:40:31.384702+0000","last_peered":"2023-11-18T20:40:31.384702+0000","last_clean":"2023-11-18T20:40:31.384702+0000","last_became_active":"2023-11-18T20:40:15.356211+0000","last_became_peered":"2023-11-18T20:40:15.356211+0000","last_unstale":"2023-11-18T20:40:31.384702+0000","last_undegraded":"2023-11-18T20:40:31.384702+0000","last_fullsized":"2023-11-18T20:40:31.384702+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:49.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.423750+0000","last_change":"2023-11-18T20:40:31.419255+0000","last_active":"2023-11-18T20:40:31.423750+0000","last_peered":"2023-11-18T20:40:31.423750+0000","last_clean":"2023-11-18T20:40:31.423750+0000","last_became_active":"2023-11-18T20:40:31.418012+0000","last_became_peered":"2023-11-18T20:40:31.418012+0000","last_unstale":"2023-11-18T20:40:31.423750+0000","last_undegraded":"2023-11-18T20:40:31.423750+0000","last_fullsized":"2023-11-18T20:40:31.423750+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:13.087448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383964+0000","last_change":"2023-11-18T20:40:15.357082+0000","last_active":"2023-11-18T20:40:31.383964+0000","last_peered":"2023-11-18T20:40:31.383964+0000","last_clean":"2023-11-18T20:40:31.383964+0000","last_became_active":"2023-11-18T20:40:15.356757+0000","last_became_peered":"2023-11-18T20:40:15.356757+0000","last_unstale":"2023-11-18T20:40:31.383964+0000","last_undegraded":"2023-11-18T20:40:31.383964+0000","last_fullsized":"2023-11-18T20:40:31.383964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:56:31.141946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424985+0000","last_change":"2023-11-18T20:40:31.421292+0000","last_active":"2023-11-18T20:40:31.424985+0000","last_peered":"2023-11-18T20:40:31.424985+0000","last_clean":"2023-11-18T20:40:31.424985+0000","last_became_active":"2023-11-18T20:40:31.420987+0000","last_became_peered":"2023-11-18T20:40:31.420987+0000","last_unstale":"2023-11-18T20:40:31.424985+0000","last_undegraded":"2023-11-18T20:40:31.424985+0000","last_fullsized":"2023-11-18T20:40:31.424985+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:03:12.220746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395245+0000","last_change":"2023-11-18T20:40:15.363178+0000","last_active":"2023-11-18T20:40:30.395245+0000","last_peered":"2023-11-18T20:40:30.395245+0000","last_clean":"2023-11-18T20:40:30.395245+0000","last_became_active":"2023-11-18T20:40:15.362454+0000","last_became_peered":"2023-11-18T20:40:15.362454+0000","last_unstale":"2023-11-18T20:40:30.395245+0000","last_undegraded":"2023-11-18T20:40:30.395245+0000","last_fullsized":"2023-11-18T20:40:30.395245+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:53.802513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425708+0000","last_change":"2023-11-18T20:40:31.423445+0000","last_active":"2023-11-18T20:40:31.425708+0000","last_peered":"2023-11-18T20:40:31.425708+0000","last_clean":"2023-11-18T20:40:31.425708+0000","last_became_active":"2023-11-18T20:40:31.422277+0000","last_became_peered":"2023-11-18T20:40:31.422277+0000","last_unstale":"2023-11-18T20:40:31.425708+0000","last_undegraded":"2023-11-18T20:40:31.425708+0000","last_fullsized":"2023-11-18T20:40:31.425708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:04.472128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.389317+0000","last_change":"2023-11-18T20:40:15.348980+0000","last_active":"2023-11-18T20:40:31.389317+0000","last_peered":"2023-11-18T20:40:31.389317+0000","last_clean":"2023-11-18T20:40:31.389317+0000","last_became_active":"2023-11-18T20:40:15.348714+0000","last_became_peered":"2023-11-18T20:40:15.348714+0000","last_unstale":"2023-11-18T20:40:31.389317+0000","last_undegraded":"2023-11-18T20:40:31.389317+0000","last_fullsized":"2023-11-18T20:40:31.389317+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:06:10.018842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.427928+0000","last_change":"2023-11-18T20:40:31.422697+0000","last_active":"2023-11-18T20:40:31.427928+0000","last_peered":"2023-11-18T20:40:31.427928+0000","last_clean":"2023-11-18T20:40:31.427928+0000","last_became_active":"2023-11-18T20:40:31.422403+0000","last_became_peered":"2023-11-18T20:40:31.422403+0000","last_unstale":"2023-11-18T20:40:31.427928+0000","last_undegraded":"2023-11-18T20:40:31.427928+0000","last_fullsized":"2023-11-18T20:40:31.427928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:28.256207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378745+0000","last_change":"2023-11-18T20:40:15.349389+0000","last_active":"2023-11-18T20:40:30.378745+0000","last_peered":"2023-11-18T20:40:30.378745+0000","last_clean":"2023-11-18T20:40:30.378745+0000","last_became_active":"2023-11-18T20:40:15.348893+0000","last_became_peered":"2023-11-18T20:40:15.348893+0000","last_unstale":"2023-11-18T20:40:30.378745+0000","last_undegraded":"2023-11-18T20:40:30.378745+0000","last_fullsized":"2023-11-18T20:40:30.378745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:40.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435591+0000","last_change":"2023-11-18T20:40:31.414891+0000","last_active":"2023-11-18T20:40:31.435591+0000","last_peered":"2023-11-18T20:40:31.435591+0000","last_clean":"2023-11-18T20:40:31.435591+0000","last_became_active":"2023-11-18T20:40:31.414631+0000","last_became_peered":"2023-11-18T20:40:31.414631+0000","last_unstale":"2023-11-18T20:40:31.435591+0000","last_undegraded":"2023-11-18T20:40:31.435591+0000","last_fullsized":"2023-11-18T20:40:31.435591+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:36:34.926444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.388223+0000","last_change":"2023-11-18T20:40:15.357261+0000","last_active":"2023-11-18T20:40:31.388223+0000","last_peered":"2023-11-18T20:40:31.388223+0000","last_clean":"2023-11-18T20:40:31.388223+0000","last_became_active":"2023-11-18T20:40:15.356930+0000","last_became_peered":"2023-11-18T20:40:15.356930+0000","last_unstale":"2023-11-18T20:40:31.388223+0000","last_undegraded":"2023-11-18T20:40:31.388223+0000","last_fullsized":"2023-11-18T20:40:31.388223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:21:51.102783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424697+0000","last_change":"2023-11-18T20:40:31.416870+0000","last_active":"2023-11-18T20:40:31.424697+0000","last_peered":"2023-11-18T20:40:31.424697+0000","last_clean":"2023-11-18T20:40:31.424697+0000","last_became_active":"2023-11-18T20:40:31.416619+0000","last_became_peered":"2023-11-18T20:40:31.416619+0000","last_unstale":"2023-11-18T20:40:31.424697+0000","last_undegraded":"2023-11-18T20:40:31.424697+0000","last_fullsized":"2023-11-18T20:40:31.424697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:54.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382982+0000","last_change":"2023-11-18T20:40:15.357312+0000","last_active":"2023-11-18T20:40:30.382982+0000","last_peered":"2023-11-18T20:40:30.382982+0000","last_clean":"2023-11-18T20:40:30.382982+0000","last_became_active":"2023-11-18T20:40:15.355941+0000","last_became_peered":"2023-11-18T20:40:15.355941+0000","last_unstale":"2023-11-18T20:40:30.382982+0000","last_undegraded":"2023-11-18T20:40:30.382982+0000","last_fullsized":"2023-11-18T20:40:30.382982+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:58:33.591767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415159+0000","last_change":"2023-11-18T20:40:31.418311+0000","last_active":"2023-11-18T20:40:32.415159+0000","last_peered":"2023-11-18T20:40:32.415159+0000","last_clean":"2023-11-18T20:40:32.415159+0000","last_became_active":"2023-11-18T20:40:31.418052+0000","last_became_peered":"2023-11-18T20:40:31.418052+0000","last_unstale":"2023-11-18T20:40:32.415159+0000","last_undegraded":"2023-11-18T20:40:32.415159+0000","last_fullsized":"2023-11-18T20:40:32.415159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:28.157821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.381306+0000","last_change":"2023-11-18T20:40:15.352149+0000","last_active":"2023-11-18T20:40:30.381306+0000","last_peered":"2023-11-18T20:40:30.381306+0000","last_clean":"2023-11-18T20:40:30.381306+0000","last_became_active":"2023-11-18T20:40:15.351873+0000","last_became_peered":"2023-11-18T20:40:15.351873+0000","last_unstale":"2023-11-18T20:40:30.381306+0000","last_undegraded":"2023-11-18T20:40:30.381306+0000","last_fullsized":"2023-11-18T20:40:30.381306+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:18.839789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424617+0000","last_change":"2023-11-18T20:40:31.420077+0000","last_active":"2023-11-18T20:40:31.424617+0000","last_peered":"2023-11-18T20:40:31.424617+0000","last_clean":"2023-11-18T20:40:31.424617+0000","last_became_active":"2023-11-18T20:40:31.419278+0000","last_became_peered":"2023-11-18T20:40:31.419278+0000","last_unstale":"2023-11-18T20:40:31.424617+0000","last_undegraded":"2023-11-18T20:40:31.424617+0000","last_fullsized":"2023-11-18T20:40:31.424617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:05.782020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395513+0000","last_change":"2023-11-18T20:40:15.363235+0000","last_active":"2023-11-18T20:40:30.395513+0000","last_peered":"2023-11-18T20:40:30.395513+0000","last_clean":"2023-11-18T20:40:30.395513+0000","last_became_active":"2023-11-18T20:40:15.361152+0000","last_became_peered":"2023-11-18T20:40:15.361152+0000","last_unstale":"2023-11-18T20:40:30.395513+0000","last_undegraded":"2023-11-18T20:40:30.395513+0000","last_fullsized":"2023-11-18T20:40:30.395513+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:35:23.067715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.420943+0000","last_change":"2023-11-18T20:40:31.411807+0000","last_active":"2023-11-18T20:40:31.420943+0000","last_peered":"2023-11-18T20:40:31.420943+0000","last_clean":"2023-11-18T20:40:31.420943+0000","last_became_active":"2023-11-18T20:40:31.411469+0000","last_became_peered":"2023-11-18T20:40:31.411469+0000","last_unstale":"2023-11-18T20:40:31.420943+0000","last_undegraded":"2023-11-18T20:40:31.420943+0000","last_fullsized":"2023-11-18T20:40:31.420943+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:39.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.379575+0000","last_change":"2023-11-18T20:40:15.341577+0000","last_active":"2023-11-18T20:40:30.379575+0000","last_peered":"2023-11-18T20:40:30.379575+0000","last_clean":"2023-11-18T20:40:30.379575+0000","last_became_active":"2023-11-18T20:40:15.341217+0000","last_became_peered":"2023-11-18T20:40:15.341217+0000","last_unstale":"2023-11-18T20:40:30.379575+0000","last_undegraded":"2023-11-18T20:40:30.379575+0000","last_fullsized":"2023-11-18T20:40:30.379575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:12.691580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.430544+0000","last_change":"2023-11-18T20:40:31.424993+0000","last_active":"2023-11-18T20:40:31.430544+0000","last_peered":"2023-11-18T20:40:31.430544+0000","last_clean":"2023-11-18T20:40:31.430544+0000","last_became_active":"2023-11-18T20:40:31.423491+0000","last_became_peered":"2023-11-18T20:40:31.423491+0000","last_unstale":"2023-11-18T20:40:31.430544+0000","last_undegraded":"2023-11-18T20:40:31.430544+0000","last_fullsized":"2023-11-18T20:40:31.430544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.240547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395456+0000","last_change":"2023-11-18T20:40:15.364215+0000","last_active":"2023-11-18T20:40:30.395456+0000","last_peered":"2023-11-18T20:40:30.395456+0000","last_clean":"2023-11-18T20:40:30.395456+0000","last_became_active":"2023-11-18T20:40:15.363880+0000","last_became_peered":"2023-11-18T20:40:15.363880+0000","last_unstale":"2023-11-18T20:40:30.395456+0000","last_undegraded":"2023-11-18T20:40:30.395456+0000","last_fullsized":"2023-11-18T20:40:30.395456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:12.766245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435941+0000","last_change":"2023-11-18T20:40:31.422749+0000","last_active":"2023-11-18T20:40:31.435941+0000","last_peered":"2023-11-18T20:40:31.435941+0000","last_clean":"2023-11-18T20:40:31.435941+0000","last_became_active":"2023-11-18T20:40:31.422441+0000","last_became_peered":"2023-11-18T20:40:31.422441+0000","last_unstale":"2023-11-18T20:40:31.435941+0000","last_undegraded":"2023-11-18T20:40:31.435941+0000","last_fullsized":"2023-11-18T20:40:31.435941+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:45:18.524774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394290+0000","last_change":"2023-11-18T20:40:15.353818+0000","last_active":"2023-11-18T20:40:30.394290+0000","last_peered":"2023-11-18T20:40:30.394290+0000","last_clean":"2023-11-18T20:40:30.394290+0000","last_became_active":"2023-11-18T20:40:15.352248+0000","last_became_peered":"2023-11-18T20:40:15.352248+0000","last_unstale":"2023-11-18T20:40:30.394290+0000","last_undegraded":"2023-11-18T20:40:30.394290+0000","last_fullsized":"2023-11-18T20:40:30.394290+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:26:51.505142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.420631+0000","last_change":"2023-11-18T20:40:31.410292+0000","last_active":"2023-11-18T20:40:31.420631+0000","last_peered":"2023-11-18T20:40:31.420631+0000","last_clean":"2023-11-18T20:40:31.420631+0000","last_became_active":"2023-11-18T20:40:31.407554+0000","last_became_peered":"2023-11-18T20:40:31.407554+0000","last_unstale":"2023-11-18T20:40:31.420631+0000","last_undegraded":"2023-11-18T20:40:31.420631+0000","last_fullsized":"2023-11-18T20:40:31.420631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:11.422322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393452+0000","last_change":"2023-11-18T20:40:15.354009+0000","last_active":"2023-11-18T20:40:30.393452+0000","last_peered":"2023-11-18T20:40:30.393452+0000","last_clean":"2023-11-18T20:40:30.393452+0000","last_became_active":"2023-11-18T20:40:15.352886+0000","last_became_peered":"2023-11-18T20:40:15.352886+0000","last_unstale":"2023-11-18T20:40:30.393452+0000","last_undegraded":"2023-11-18T20:40:30.393452+0000","last_fullsized":"2023-11-18T20:40:30.393452+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:23.691704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425439+0000","last_change":"2023-11-18T20:40:31.416414+0000","last_active":"2023-11-18T20:40:31.425439+0000","last_peered":"2023-11-18T20:40:31.425439+0000","last_clean":"2023-11-18T20:40:31.425439+0000","last_became_active":"2023-11-18T20:40:31.415941+0000","last_became_peered":"2023-11-18T20:40:31.415941+0000","last_unstale":"2023-11-18T20:40:31.425439+0000","last_undegraded":"2023-11-18T20:40:31.425439+0000","last_fullsized":"2023-11-18T20:40:31.425439+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:03.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.383254+0000","last_change":"2023-11-18T20:40:15.342034+0000","last_active":"2023-11-18T20:40:30.383254+0000","last_peered":"2023-11-18T20:40:30.383254+0000","last_clean":"2023-11-18T20:40:30.383254+0000","last_became_active":"2023-11-18T20:40:15.341779+0000","last_became_peered":"2023-11-18T20:40:15.341779+0000","last_unstale":"2023-11-18T20:40:30.383254+0000","last_undegraded":"2023-11-18T20:40:30.383254+0000","last_fullsized":"2023-11-18T20:40:30.383254+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:13.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.417069+0000","last_change":"2023-11-18T20:40:31.411639+0000","last_active":"2023-11-18T20:40:31.417069+0000","last_peered":"2023-11-18T20:40:31.417069+0000","last_clean":"2023-11-18T20:40:31.417069+0000","last_became_active":"2023-11-18T20:40:31.411331+0000","last_became_peered":"2023-11-18T20:40:31.411331+0000","last_unstale":"2023-11-18T20:40:31.417069+0000","last_undegraded":"2023-11-18T20:40:31.417069+0000","last_fullsized":"2023-11-18T20:40:31.417069+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:26.956962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394230+0000","last_change":"2023-11-18T20:40:15.356706+0000","last_active":"2023-11-18T20:40:30.394230+0000","last_peered":"2023-11-18T20:40:30.394230+0000","last_clean":"2023-11-18T20:40:30.394230+0000","last_became_active":"2023-11-18T20:40:15.356386+0000","last_became_peered":"2023-11-18T20:40:15.356386+0000","last_unstale":"2023-11-18T20:40:30.394230+0000","last_undegraded":"2023-11-18T20:40:30.394230+0000","last_fullsized":"2023-11-18T20:40:30.394230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:46:38.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436049+0000","last_change":"2023-11-18T20:40:31.417471+0000","last_active":"2023-11-18T20:40:31.436049+0000","last_peered":"2023-11-18T20:40:31.436049+0000","last_clean":"2023-11-18T20:40:31.436049+0000","last_became_active":"2023-11-18T20:40:31.417121+0000","last_became_peered":"2023-11-18T20:40:31.417121+0000","last_unstale":"2023-11-18T20:40:31.436049+0000","last_undegraded":"2023-11-18T20:40:31.436049+0000","last_fullsized":"2023-11-18T20:40:31.436049+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:00.284659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.386081+0000","last_change":"2023-11-18T20:40:15.352408+0000","last_active":"2023-11-18T20:40:31.386081+0000","last_peered":"2023-11-18T20:40:31.386081+0000","last_clean":"2023-11-18T20:40:31.386081+0000","last_became_active":"2023-11-18T20:40:15.351996+0000","last_became_peered":"2023-11-18T20:40:15.351996+0000","last_unstale":"2023-11-18T20:40:31.386081+0000","last_undegraded":"2023-11-18T20:40:31.386081+0000","last_fullsized":"2023-11-18T20:40:31.386081+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:05.854524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415953+0000","last_change":"2023-11-18T20:40:31.412271+0000","last_active":"2023-11-18T20:40:32.415953+0000","last_peered":"2023-11-18T20:40:32.415953+0000","last_clean":"2023-11-18T20:40:32.415953+0000","last_became_active":"2023-11-18T20:40:31.411944+0000","last_became_peered":"2023-11-18T20:40:31.411944+0000","last_unstale":"2023-11-18T20:40:32.415953+0000","last_undegraded":"2023-11-18T20:40:32.415953+0000","last_fullsized":"2023-11-18T20:40:32.415953+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:04.472128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.438404+0000","last_change":"2023-11-18T20:40:30.395822+0000","last_active":"2023-11-18T20:40:31.438404+0000","last_peered":"2023-11-18T20:40:31.438404+0000","last_clean":"2023-11-18T20:40:31.438404+0000","last_became_active":"2023-11-18T20:40:30.395333+0000","last_became_peered":"2023-11-18T20:40:30.395333+0000","last_unstale":"2023-11-18T20:40:31.438404+0000","last_undegraded":"2023-11-18T20:40:31.438404+0000","last_fullsized":"2023-11-18T20:40:31.438404+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:00:31.495644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384656+0000","last_change":"2023-11-18T20:40:15.347869+0000","last_active":"2023-11-18T20:40:31.384656+0000","last_peered":"2023-11-18T20:40:31.384656+0000","last_clean":"2023-11-18T20:40:31.384656+0000","last_became_active":"2023-11-18T20:40:15.346533+0000","last_became_peered":"2023-11-18T20:40:15.346533+0000","last_unstale":"2023-11-18T20:40:31.384656+0000","last_undegraded":"2023-11-18T20:40:31.384656+0000","last_fullsized":"2023-11-18T20:40:31.384656+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:48.046712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.392185+0000","last_change":"2023-11-18T20:40:14.825864+0000","last_active":"2023-11-18T20:40:31.392185+0000","last_peered":"2023-11-18T20:40:31.392185+0000","last_clean":"2023-11-18T20:40:31.392185+0000","last_became_active":"2023-11-18T20:40:14.824070+0000","last_became_peered":"2023-11-18T20:40:14.824070+0000","last_unstale":"2023-11-18T20:40:31.392185+0000","last_undegraded":"2023-11-18T20:40:31.392185+0000","last_fullsized":"2023-11-18T20:40:31.392185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:43.675287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.417624+0000","last_change":"2023-11-18T20:40:31.409612+0000","last_active":"2023-11-18T20:40:31.417624+0000","last_peered":"2023-11-18T20:40:31.417624+0000","last_clean":"2023-11-18T20:40:31.417624+0000","last_became_active":"2023-11-18T20:40:31.409364+0000","last_became_peered":"2023-11-18T20:40:31.409364+0000","last_unstale":"2023-11-18T20:40:31.417624+0000","last_undegraded":"2023-11-18T20:40:31.417624+0000","last_fullsized":"2023-11-18T20:40:31.417624+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:21.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"58'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415985+0000","last_change":"2023-11-18T20:40:30.383818+0000","last_active":"2023-11-18T20:40:32.415985+0000","last_peered":"2023-11-18T20:40:32.415985+0000","last_clean":"2023-11-18T20:40:32.415985+0000","last_became_active":"2023-11-18T20:40:30.383510+0000","last_became_peered":"2023-11-18T20:40:30.383510+0000","last_unstale":"2023-11-18T20:40:32.415985+0000","last_undegraded":"2023-11-18T20:40:32.415985+0000","last_fullsized":"2023-11-18T20:40:32.415985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:31.917046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384921+0000","last_change":"2023-11-18T20:40:15.351630+0000","last_active":"2023-11-18T20:40:31.384921+0000","last_peered":"2023-11-18T20:40:31.384921+0000","last_clean":"2023-11-18T20:40:31.384921+0000","last_became_active":"2023-11-18T20:40:15.351258+0000","last_became_peered":"2023-11-18T20:40:15.351258+0000","last_unstale":"2023-11-18T20:40:31.384921+0000","last_undegraded":"2023-11-18T20:40:31.384921+0000","last_fullsized":"2023-11-18T20:40:31.384921+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:14.293907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394903+0000","last_change":"2023-11-18T20:40:14.833864+0000","last_active":"2023-11-18T20:40:30.394903+0000","last_peered":"2023-11-18T20:40:30.394903+0000","last_clean":"2023-11-18T20:40:30.394903+0000","last_became_active":"2023-11-18T20:40:14.833570+0000","last_became_peered":"2023-11-18T20:40:14.833570+0000","last_unstale":"2023-11-18T20:40:30.394903+0000","last_undegraded":"2023-11-18T20:40:30.394903+0000","last_fullsized":"2023-11-18T20:40:30.394903+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:15.089130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435908+0000","last_change":"2023-11-18T20:40:31.416463+0000","last_active":"2023-11-18T20:40:31.435908+0000","last_peered":"2023-11-18T20:40:31.435908+0000","last_clean":"2023-11-18T20:40:31.435908+0000","last_became_active":"2023-11-18T20:40:31.416203+0000","last_became_peered":"2023-11-18T20:40:31.416203+0000","last_unstale":"2023-11-18T20:40:31.435908+0000","last_undegraded":"2023-11-18T20:40:31.435908+0000","last_fullsized":"2023-11-18T20:40:31.435908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:05:41.474591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"58'4","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415983+0000","last_change":"2023-11-18T20:40:30.391798+0000","last_active":"2023-11-18T20:40:32.415983+0000","last_peered":"2023-11-18T20:40:32.415983+0000","last_clean":"2023-11-18T20:40:32.415983+0000","last_became_active":"2023-11-18T20:40:30.389422+0000","last_became_peered":"2023-11-18T20:40:30.389422+0000","last_unstale":"2023-11-18T20:40:32.415983+0000","last_undegraded":"2023-11-18T20:40:32.415983+0000","last_fullsized":"2023-11-18T20:40:32.415983+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:15.052969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394381+0000","last_change":"2023-11-18T20:40:15.361548+0000","last_active":"2023-11-18T20:40:30.394381+0000","last_peered":"2023-11-18T20:40:30.394381+0000","last_clean":"2023-11-18T20:40:30.394381+0000","last_became_active":"2023-11-18T20:40:15.361199+0000","last_became_peered":"2023-11-18T20:40:15.361199+0000","last_unstale":"2023-11-18T20:40:30.394381+0000","last_undegraded":"2023-11-18T20:40:30.394381+0000","last_fullsized":"2023-11-18T20:40:30.394381+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:29.561471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384174+0000","last_change":"2023-11-18T20:40:14.833036+0000","last_active":"2023-11-18T20:40:31.384174+0000","last_peered":"2023-11-18T20:40:31.384174+0000","last_clean":"2023-11-18T20:40:31.384174+0000","last_became_active":"2023-11-18T20:40:14.831403+0000","last_became_peered":"2023-11-18T20:40:14.831403+0000","last_unstale":"2023-11-18T20:40:31.384174+0000","last_undegraded":"2023-11-18T20:40:31.384174+0000","last_fullsized":"2023-11-18T20:40:31.384174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:51:45.803351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.418958+0000","last_change":"2023-11-18T20:40:31.416599+0000","last_active":"2023-11-18T20:40:31.418958+0000","last_peered":"2023-11-18T20:40:31.418958+0000","last_clean":"2023-11-18T20:40:31.418958+0000","last_became_active":"2023-11-18T20:40:31.415532+0000","last_became_peered":"2023-11-18T20:40:31.415532+0000","last_unstale":"2023-11-18T20:40:31.418958+0000","last_undegraded":"2023-11-18T20:40:31.418958+0000","last_fullsized":"2023-11-18T20:40:31.418958+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:40.795447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.431823+0000","last_change":"2023-11-18T20:40:30.398249+0000","last_active":"2023-11-18T20:40:31.431823+0000","last_peered":"2023-11-18T20:40:31.431823+0000","last_clean":"2023-11-18T20:40:31.431823+0000","last_became_active":"2023-11-18T20:40:30.397956+0000","last_became_peered":"2023-11-18T20:40:30.397956+0000","last_unstale":"2023-11-18T20:40:31.431823+0000","last_undegraded":"2023-11-18T20:40:31.431823+0000","last_fullsized":"2023-11-18T20:40:31.431823+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:37.535432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384035+0000","last_change":"2023-11-18T20:40:15.359834+0000","last_active":"2023-11-18T20:40:31.384035+0000","last_peered":"2023-11-18T20:40:31.384035+0000","last_clean":"2023-11-18T20:40:31.384035+0000","last_became_active":"2023-11-18T20:40:15.355953+0000","last_became_peered":"2023-11-18T20:40:15.355953+0000","last_unstale":"2023-11-18T20:40:31.384035+0000","last_undegraded":"2023-11-18T20:40:31.384035+0000","last_fullsized":"2023-11-18T20:40:31.384035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:37.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388097+0000","last_change":"2023-11-18T20:40:14.827337+0000","last_active":"2023-11-18T20:40:30.388097+0000","last_peered":"2023-11-18T20:40:30.388097+0000","last_clean":"2023-11-18T20:40:30.388097+0000","last_became_active":"2023-11-18T20:40:14.826653+0000","last_became_peered":"2023-11-18T20:40:14.826653+0000","last_unstale":"2023-11-18T20:40:30.388097+0000","last_undegraded":"2023-11-18T20:40:30.388097+0000","last_fullsized":"2023-11-18T20:40:30.388097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:25:30.247203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414841+0000","last_change":"2023-11-18T20:40:31.408280+0000","last_active":"2023-11-18T20:40:32.414841+0000","last_peered":"2023-11-18T20:40:32.414841+0000","last_clean":"2023-11-18T20:40:32.414841+0000","last_became_active":"2023-11-18T20:40:31.407933+0000","last_became_peered":"2023-11-18T20:40:31.407933+0000","last_unstale":"2023-11-18T20:40:32.414841+0000","last_undegraded":"2023-11-18T20:40:32.414841+0000","last_fullsized":"2023-11-18T20:40:32.414841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:15:39.417019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415006+0000","last_change":"2023-11-18T20:40:30.388103+0000","last_active":"2023-11-18T20:40:32.415006+0000","last_peered":"2023-11-18T20:40:32.415006+0000","last_clean":"2023-11-18T20:40:32.415006+0000","last_became_active":"2023-11-18T20:40:30.387246+0000","last_became_peered":"2023-11-18T20:40:30.387246+0000","last_unstale":"2023-11-18T20:40:32.415006+0000","last_undegraded":"2023-11-18T20:40:32.415006+0000","last_fullsized":"2023-11-18T20:40:32.415006+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:18:11.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393482+0000","last_change":"2023-11-18T20:40:15.357662+0000","last_active":"2023-11-18T20:40:30.393482+0000","last_peered":"2023-11-18T20:40:30.393482+0000","last_clean":"2023-11-18T20:40:30.393482+0000","last_became_active":"2023-11-18T20:40:15.357033+0000","last_became_peered":"2023-11-18T20:40:15.357033+0000","last_unstale":"2023-11-18T20:40:30.393482+0000","last_undegraded":"2023-11-18T20:40:30.393482+0000","last_fullsized":"2023-11-18T20:40:30.393482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:27.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383249+0000","last_change":"2023-11-18T20:40:14.822926+0000","last_active":"2023-11-18T20:40:31.383249+0000","last_peered":"2023-11-18T20:40:31.383249+0000","last_clean":"2023-11-18T20:40:31.383249+0000","last_became_active":"2023-11-18T20:40:14.822593+0000","last_became_peered":"2023-11-18T20:40:14.822593+0000","last_unstale":"2023-11-18T20:40:31.383249+0000","last_undegraded":"2023-11-18T20:40:31.383249+0000","last_fullsized":"2023-11-18T20:40:31.383249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:07:12.992214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414155+0000","last_change":"2023-11-18T20:40:31.411284+0000","last_active":"2023-11-18T20:40:32.414155+0000","last_peered":"2023-11-18T20:40:32.414155+0000","last_clean":"2023-11-18T20:40:32.414155+0000","last_became_active":"2023-11-18T20:40:31.410926+0000","last_became_peered":"2023-11-18T20:40:31.410926+0000","last_unstale":"2023-11-18T20:40:32.414155+0000","last_undegraded":"2023-11-18T20:40:32.414155+0000","last_fullsized":"2023-11-18T20:40:32.414155+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:38:21.463017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.413211+0000","last_change":"2023-11-18T20:40:30.398059+0000","last_active":"2023-11-18T20:40:32.413211+0000","last_peered":"2023-11-18T20:40:32.413211+0000","last_clean":"2023-11-18T20:40:32.413211+0000","last_became_active":"2023-11-18T20:40:30.397741+0000","last_became_peered":"2023-11-18T20:40:30.397741+0000","last_unstale":"2023-11-18T20:40:32.413211+0000","last_undegraded":"2023-11-18T20:40:32.413211+0000","last_fullsized":"2023-11-18T20:40:32.413211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:38.890287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.388996+0000","last_change":"2023-11-18T20:40:15.354490+0000","last_active":"2023-11-18T20:40:31.388996+0000","last_peered":"2023-11-18T20:40:31.388996+0000","last_clean":"2023-11-18T20:40:31.388996+0000","last_became_active":"2023-11-18T20:40:15.354207+0000","last_became_peered":"2023-11-18T20:40:15.354207+0000","last_unstale":"2023-11-18T20:40:31.388996+0000","last_undegraded":"2023-11-18T20:40:31.388996+0000","last_fullsized":"2023-11-18T20:40:31.388996+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:30:22.075302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383429+0000","last_change":"2023-11-18T20:40:14.824769+0000","last_active":"2023-11-18T20:40:31.383429+0000","last_peered":"2023-11-18T20:40:31.383429+0000","last_clean":"2023-11-18T20:40:31.383429+0000","last_became_active":"2023-11-18T20:40:14.824476+0000","last_became_peered":"2023-11-18T20:40:14.824476+0000","last_unstale":"2023-11-18T20:40:31.383429+0000","last_undegraded":"2023-11-18T20:40:31.383429+0000","last_fullsized":"2023-11-18T20:40:31.383429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:09:23.933844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436486+0000","last_change":"2023-11-18T20:40:31.425000+0000","last_active":"2023-11-18T20:40:31.436486+0000","last_peered":"2023-11-18T20:40:31.436486+0000","last_clean":"2023-11-18T20:40:31.436486+0000","last_became_active":"2023-11-18T20:40:31.423234+0000","last_became_peered":"2023-11-18T20:40:31.423234+0000","last_unstale":"2023-11-18T20:40:31.436486+0000","last_undegraded":"2023-11-18T20:40:31.436486+0000","last_fullsized":"2023-11-18T20:40:31.436486+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:46.851699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"58'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.418057+0000","last_change":"2023-11-18T20:40:30.389560+0000","last_active":"2023-11-18T20:40:32.418057+0000","last_peered":"2023-11-18T20:40:32.418057+0000","last_clean":"2023-11-18T20:40:32.418057+0000","last_became_active":"2023-11-18T20:40:30.387253+0000","last_became_peered":"2023-11-18T20:40:30.387253+0000","last_unstale":"2023-11-18T20:40:32.418057+0000","last_undegraded":"2023-11-18T20:40:32.418057+0000","last_fullsized":"2023-11-18T20:40:32.418057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:02.048891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.382436+0000","last_change":"2023-11-18T20:40:15.343792+0000","last_active":"2023-11-18T20:40:31.382436+0000","last_peered":"2023-11-18T20:40:31.382436+0000","last_clean":"2023-11-18T20:40:31.382436+0000","last_became_active":"2023-11-18T20:40:15.343641+0000","last_became_peered":"2023-11-18T20:40:15.343641+0000","last_unstale":"2023-11-18T20:40:31.382436+0000","last_undegraded":"2023-11-18T20:40:31.382436+0000","last_fullsized":"2023-11-18T20:40:31.382436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:30:22.075302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382376+0000","last_change":"2023-11-18T20:40:14.824464+0000","last_active":"2023-11-18T20:40:30.382376+0000","last_peered":"2023-11-18T20:40:30.382376+0000","last_clean":"2023-11-18T20:40:30.382376+0000","last_became_active":"2023-11-18T20:40:14.824093+0000","last_became_peered":"2023-11-18T20:40:14.824093+0000","last_unstale":"2023-11-18T20:40:30.382376+0000","last_undegraded":"2023-11-18T20:40:30.382376+0000","last_fullsized":"2023-11-18T20:40:30.382376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:29.994861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415283+0000","last_change":"2023-11-18T20:40:31.411481+0000","last_active":"2023-11-18T20:40:32.415283+0000","last_peered":"2023-11-18T20:40:32.415283+0000","last_clean":"2023-11-18T20:40:32.415283+0000","last_became_active":"2023-11-18T20:40:31.411180+0000","last_became_peered":"2023-11-18T20:40:31.411180+0000","last_unstale":"2023-11-18T20:40:32.415283+0000","last_undegraded":"2023-11-18T20:40:32.415283+0000","last_fullsized":"2023-11-18T20:40:32.415283+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:22:18.584232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.438563+0000","last_change":"2023-11-18T20:40:30.387472+0000","last_active":"2023-11-18T20:40:31.438563+0000","last_peered":"2023-11-18T20:40:31.438563+0000","last_clean":"2023-11-18T20:40:31.438563+0000","last_became_active":"2023-11-18T20:40:30.387149+0000","last_became_peered":"2023-11-18T20:40:30.387149+0000","last_unstale":"2023-11-18T20:40:31.438563+0000","last_undegraded":"2023-11-18T20:40:31.438563+0000","last_fullsized":"2023-11-18T20:40:31.438563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:10:23.244504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.382511+0000","last_change":"2023-11-18T20:40:15.355962+0000","last_active":"2023-11-18T20:40:31.382511+0000","last_peered":"2023-11-18T20:40:31.382511+0000","last_clean":"2023-11-18T20:40:31.382511+0000","last_became_active":"2023-11-18T20:40:15.355647+0000","last_became_peered":"2023-11-18T20:40:15.355647+0000","last_unstale":"2023-11-18T20:40:31.382511+0000","last_undegraded":"2023-11-18T20:40:31.382511+0000","last_fullsized":"2023-11-18T20:40:31.382511+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:44.617490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378436+0000","last_change":"2023-11-18T20:40:14.826728+0000","last_active":"2023-11-18T20:40:30.378436+0000","last_peered":"2023-11-18T20:40:30.378436+0000","last_clean":"2023-11-18T20:40:30.378436+0000","last_became_active":"2023-11-18T20:40:14.826453+0000","last_became_peered":"2023-11-18T20:40:14.826453+0000","last_unstale":"2023-11-18T20:40:30.378436+0000","last_undegraded":"2023-11-18T20:40:30.378436+0000","last_fullsized":"2023-11-18T20:40:30.378436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:39:23.515944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435830+0000","last_change":"2023-11-18T20:40:31.419955+0000","last_active":"2023-11-18T20:40:31.435830+0000","last_peered":"2023-11-18T20:40:31.435830+0000","last_clean":"2023-11-18T20:40:31.435830+0000","last_became_active":"2023-11-18T20:40:31.419446+0000","last_became_peered":"2023-11-18T20:40:31.419446+0000","last_unstale":"2023-11-18T20:40:31.435830+0000","last_undegraded":"2023-11-18T20:40:31.435830+0000","last_fullsized":"2023-11-18T20:40:31.435830+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:39.661260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"58'3","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.417575+0000","last_change":"2023-11-18T20:40:30.397877+0000","last_active":"2023-11-18T20:40:32.417575+0000","last_peered":"2023-11-18T20:40:32.417575+0000","last_clean":"2023-11-18T20:40:32.417575+0000","last_became_active":"2023-11-18T20:40:30.397591+0000","last_became_peered":"2023-11-18T20:40:30.397591+0000","last_unstale":"2023-11-18T20:40:32.417575+0000","last_undegraded":"2023-11-18T20:40:32.417575+0000","last_fullsized":"2023-11-18T20:40:32.417575+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:18.449109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.379662+0000","last_change":"2023-11-18T20:40:15.340229+0000","last_active":"2023-11-18T20:40:30.379662+0000","last_peered":"2023-11-18T20:40:30.379662+0000","last_clean":"2023-11-18T20:40:30.379662+0000","last_became_active":"2023-11-18T20:40:15.339486+0000","last_became_peered":"2023-11-18T20:40:15.339486+0000","last_unstale":"2023-11-18T20:40:30.379662+0000","last_undegraded":"2023-11-18T20:40:30.379662+0000","last_fullsized":"2023-11-18T20:40:30.379662+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:31.652533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.383087+0000","last_change":"2023-11-18T20:40:14.827685+0000","last_active":"2023-11-18T20:40:30.383087+0000","last_peered":"2023-11-18T20:40:30.383087+0000","last_clean":"2023-11-18T20:40:30.383087+0000","last_became_active":"2023-11-18T20:40:14.827366+0000","last_became_peered":"2023-11-18T20:40:14.827366+0000","last_unstale":"2023-11-18T20:40:30.383087+0000","last_undegraded":"2023-11-18T20:40:30.383087+0000","last_fullsized":"2023-11-18T20:40:30.383087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:55.130516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424643+0000","last_change":"2023-11-18T20:40:31.420329+0000","last_active":"2023-11-18T20:40:31.424643+0000","last_peered":"2023-11-18T20:40:31.424643+0000","last_clean":"2023-11-18T20:40:31.424643+0000","last_became_active":"2023-11-18T20:40:31.419695+0000","last_became_peered":"2023-11-18T20:40:31.419695+0000","last_unstale":"2023-11-18T20:40:31.424643+0000","last_undegraded":"2023-11-18T20:40:31.424643+0000","last_fullsized":"2023-11-18T20:40:31.424643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:50:20.825579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"58'6","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416996+0000","last_change":"2023-11-18T20:40:30.398785+0000","last_active":"2023-11-18T20:40:32.416996+0000","last_peered":"2023-11-18T20:40:32.416996+0000","last_clean":"2023-11-18T20:40:32.416996+0000","last_became_active":"2023-11-18T20:40:30.398263+0000","last_became_peered":"2023-11-18T20:40:30.398263+0000","last_unstale":"2023-11-18T20:40:32.416996+0000","last_undegraded":"2023-11-18T20:40:32.416996+0000","last_fullsized":"2023-11-18T20:40:32.416996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:39:08.307898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383995+0000","last_change":"2023-11-18T20:40:15.355620+0000","last_active":"2023-11-18T20:40:31.383995+0000","last_peered":"2023-11-18T20:40:31.383995+0000","last_clean":"2023-11-18T20:40:31.383995+0000","last_became_active":"2023-11-18T20:40:15.355354+0000","last_became_peered":"2023-11-18T20:40:15.355354+0000","last_unstale":"2023-11-18T20:40:31.383995+0000","last_undegraded":"2023-11-18T20:40:31.383995+0000","last_fullsized":"2023-11-18T20:40:31.383995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:03.431735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394095+0000","last_change":"2023-11-18T20:40:14.833810+0000","last_active":"2023-11-18T20:40:30.394095+0000","last_peered":"2023-11-18T20:40:30.394095+0000","last_clean":"2023-11-18T20:40:30.394095+0000","last_became_active":"2023-11-18T20:40:14.832447+0000","last_became_peered":"2023-11-18T20:40:14.832447+0000","last_unstale":"2023-11-18T20:40:30.394095+0000","last_undegraded":"2023-11-18T20:40:30.394095+0000","last_fullsized":"2023-11-18T20:40:30.394095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:02.417342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.428994+0000","last_change":"2023-11-18T20:40:31.422327+0000","last_active":"2023-11-18T20:40:31.428994+0000","last_peered":"2023-11-18T20:40:31.428994+0000","last_clean":"2023-11-18T20:40:31.428994+0000","last_became_active":"2023-11-18T20:40:31.422016+0000","last_became_peered":"2023-11-18T20:40:31.422016+0000","last_unstale":"2023-11-18T20:40:31.428994+0000","last_undegraded":"2023-11-18T20:40:31.428994+0000","last_fullsized":"2023-11-18T20:40:31.428994+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:56.247717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424844+0000","last_change":"2023-11-18T20:40:30.399101+0000","last_active":"2023-11-18T20:40:31.424844+0000","last_peered":"2023-11-18T20:40:31.424844+0000","last_clean":"2023-11-18T20:40:31.424844+0000","last_became_active":"2023-11-18T20:40:30.398791+0000","last_became_peered":"2023-11-18T20:40:30.398791+0000","last_unstale":"2023-11-18T20:40:31.424844+0000","last_undegraded":"2023-11-18T20:40:31.424844+0000","last_fullsized":"2023-11-18T20:40:31.424844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:28.455197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394469+0000","last_change":"2023-11-18T20:40:15.359505+0000","last_active":"2023-11-18T20:40:30.394469+0000","last_peered":"2023-11-18T20:40:30.394469+0000","last_clean":"2023-11-18T20:40:30.394469+0000","last_became_active":"2023-11-18T20:40:15.358966+0000","last_became_peered":"2023-11-18T20:40:15.358966+0000","last_unstale":"2023-11-18T20:40:30.394469+0000","last_undegraded":"2023-11-18T20:40:30.394469+0000","last_fullsized":"2023-11-18T20:40:30.394469+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:25:51.738059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388323+0000","last_change":"2023-11-18T20:40:14.827802+0000","last_active":"2023-11-18T20:40:30.388323+0000","last_peered":"2023-11-18T20:40:30.388323+0000","last_clean":"2023-11-18T20:40:30.388323+0000","last_became_active":"2023-11-18T20:40:14.827062+0000","last_became_peered":"2023-11-18T20:40:14.827062+0000","last_unstale":"2023-11-18T20:40:30.388323+0000","last_undegraded":"2023-11-18T20:40:30.388323+0000","last_fullsized":"2023-11-18T20:40:30.388323+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:47:46.239729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.427973+0000","last_change":"2023-11-18T20:40:31.420233+0000","last_active":"2023-11-18T20:40:31.427973+0000","last_peered":"2023-11-18T20:40:31.427973+0000","last_clean":"2023-11-18T20:40:31.427973+0000","last_became_active":"2023-11-18T20:40:31.418961+0000","last_became_peered":"2023-11-18T20:40:31.418961+0000","last_unstale":"2023-11-18T20:40:31.427973+0000","last_undegraded":"2023-11-18T20:40:31.427973+0000","last_fullsized":"2023-11-18T20:40:31.427973+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:42.830879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.402325+0000","last_change":"2023-11-18T20:40:30.389403+0000","last_active":"2023-11-18T20:40:31.402325+0000","last_peered":"2023-11-18T20:40:31.402325+0000","last_clean":"2023-11-18T20:40:31.402325+0000","last_became_active":"2023-11-18T20:40:30.389101+0000","last_became_peered":"2023-11-18T20:40:30.389101+0000","last_unstale":"2023-11-18T20:40:31.402325+0000","last_undegraded":"2023-11-18T20:40:31.402325+0000","last_fullsized":"2023-11-18T20:40:31.402325+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:44.115690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388187+0000","last_change":"2023-11-18T20:40:15.350874+0000","last_active":"2023-11-18T20:40:30.388187+0000","last_peered":"2023-11-18T20:40:30.388187+0000","last_clean":"2023-11-18T20:40:30.388187+0000","last_became_active":"2023-11-18T20:40:15.350271+0000","last_became_peered":"2023-11-18T20:40:15.350271+0000","last_unstale":"2023-11-18T20:40:30.388187+0000","last_undegraded":"2023-11-18T20:40:30.388187+0000","last_fullsized":"2023-11-18T20:40:30.388187+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:51:14.162201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"55'9","reported_seq":24,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378910+0000","last_change":"2023-11-18T20:40:14.831009+0000","last_active":"2023-11-18T20:40:30.378910+0000","last_peered":"2023-11-18T20:40:30.378910+0000","last_clean":"2023-11-18T20:40:30.378910+0000","last_became_active":"2023-11-18T20:40:14.830639+0000","last_became_peered":"2023-11-18T20:40:14.830639+0000","last_unstale":"2023-11-18T20:40:30.378910+0000","last_undegraded":"2023-11-18T20:40:30.378910+0000","last_fullsized":"2023-11-18T20:40:30.378910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:20.007726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.415759+0000","last_change":"2023-11-18T20:40:31.412443+0000","last_active":"2023-11-18T20:40:31.415759+0000","last_peered":"2023-11-18T20:40:31.415759+0000","last_clean":"2023-11-18T20:40:31.415759+0000","last_became_active":"2023-11-18T20:40:31.412166+0000","last_became_peered":"2023-11-18T20:40:31.412166+0000","last_unstale":"2023-11-18T20:40:31.415759+0000","last_undegraded":"2023-11-18T20:40:31.415759+0000","last_fullsized":"2023-11-18T20:40:31.415759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:22:18.584232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.399328+0000","last_change":"2023-11-18T20:40:30.392806+0000","last_active":"2023-11-18T20:40:31.399328+0000","last_peered":"2023-11-18T20:40:31.399328+0000","last_clean":"2023-11-18T20:40:31.399328+0000","last_became_active":"2023-11-18T20:40:30.392506+0000","last_became_peered":"2023-11-18T20:40:30.392506+0000","last_unstale":"2023-11-18T20:40:31.399328+0000","last_undegraded":"2023-11-18T20:40:31.399328+0000","last_fullsized":"2023-11-18T20:40:31.399328+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:30:36.629521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382663+0000","last_change":"2023-11-18T20:40:15.354465+0000","last_active":"2023-11-18T20:40:30.382663+0000","last_peered":"2023-11-18T20:40:30.382663+0000","last_clean":"2023-11-18T20:40:30.382663+0000","last_became_active":"2023-11-18T20:40:15.354191+0000","last_became_peered":"2023-11-18T20:40:15.354191+0000","last_unstale":"2023-11-18T20:40:30.382663+0000","last_undegraded":"2023-11-18T20:40:30.382663+0000","last_fullsized":"2023-11-18T20:40:30.382663+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:18:39.504225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393647+0000","last_change":"2023-11-18T20:40:14.832793+0000","last_active":"2023-11-18T20:40:30.393647+0000","last_peered":"2023-11-18T20:40:30.393647+0000","last_clean":"2023-11-18T20:40:30.393647+0000","last_became_active":"2023-11-18T20:40:14.831869+0000","last_became_peered":"2023-11-18T20:40:14.831869+0000","last_unstale":"2023-11-18T20:40:30.393647+0000","last_undegraded":"2023-11-18T20:40:30.393647+0000","last_fullsized":"2023-11-18T20:40:30.393647+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:54.843303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.417179+0000","last_change":"2023-11-18T20:40:31.413101+0000","last_active":"2023-11-18T20:40:31.417179+0000","last_peered":"2023-11-18T20:40:31.417179+0000","last_clean":"2023-11-18T20:40:31.417179+0000","last_became_active":"2023-11-18T20:40:31.412809+0000","last_became_peered":"2023-11-18T20:40:31.412809+0000","last_unstale":"2023-11-18T20:40:31.417179+0000","last_undegraded":"2023-11-18T20:40:31.417179+0000","last_fullsized":"2023-11-18T20:40:31.417179+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:34.596489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"58'8","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.439413+0000","last_change":"2023-11-18T20:40:30.385446+0000","last_active":"2023-11-18T20:40:31.439413+0000","last_peered":"2023-11-18T20:40:31.439413+0000","last_clean":"2023-11-18T20:40:31.439413+0000","last_became_active":"2023-11-18T20:40:30.385174+0000","last_became_peered":"2023-11-18T20:40:30.385174+0000","last_unstale":"2023-11-18T20:40:31.439413+0000","last_undegraded":"2023-11-18T20:40:31.439413+0000","last_fullsized":"2023-11-18T20:40:31.439413+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:07:28.560825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383214+0000","last_change":"2023-11-18T20:40:15.343712+0000","last_active":"2023-11-18T20:40:31.383214+0000","last_peered":"2023-11-18T20:40:31.383214+0000","last_clean":"2023-11-18T20:40:31.383214+0000","last_became_active":"2023-11-18T20:40:15.343433+0000","last_became_peered":"2023-11-18T20:40:15.343433+0000","last_unstale":"2023-11-18T20:40:31.383214+0000","last_undegraded":"2023-11-18T20:40:31.383214+0000","last_fullsized":"2023-11-18T20:40:31.383214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:10:08.690285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.383351+0000","last_change":"2023-11-18T20:40:14.821052+0000","last_active":"2023-11-18T20:40:30.383351+0000","last_peered":"2023-11-18T20:40:30.383351+0000","last_clean":"2023-11-18T20:40:30.383351+0000","last_became_active":"2023-11-18T20:40:14.820746+0000","last_became_peered":"2023-11-18T20:40:14.820746+0000","last_unstale":"2023-11-18T20:40:30.383351+0000","last_undegraded":"2023-11-18T20:40:30.383351+0000","last_fullsized":"2023-11-18T20:40:30.383351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:48.332445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414994+0000","last_change":"2023-11-18T20:40:31.396427+0000","last_active":"2023-11-18T20:40:32.414994+0000","last_peered":"2023-11-18T20:40:32.414994+0000","last_clean":"2023-11-18T20:40:32.414994+0000","last_became_active":"2023-11-18T20:40:31.395525+0000","last_became_peered":"2023-11-18T20:40:31.395525+0000","last_unstale":"2023-11-18T20:40:32.414994+0000","last_undegraded":"2023-11-18T20:40:32.414994+0000","last_fullsized":"2023-11-18T20:40:32.414994+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:17.157383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"58'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415685+0000","last_change":"2023-11-18T20:40:30.393560+0000","last_active":"2023-11-18T20:40:32.415685+0000","last_peered":"2023-11-18T20:40:32.415685+0000","last_clean":"2023-11-18T20:40:32.415685+0000","last_became_active":"2023-11-18T20:40:30.393256+0000","last_became_peered":"2023-11-18T20:40:30.393256+0000","last_unstale":"2023-11-18T20:40:32.415685+0000","last_undegraded":"2023-11-18T20:40:32.415685+0000","last_fullsized":"2023-11-18T20:40:32.415685+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:59:50.932334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.381417+0000","last_change":"2023-11-18T20:40:15.345010+0000","last_active":"2023-11-18T20:40:30.381417+0000","last_peered":"2023-11-18T20:40:30.381417+0000","last_clean":"2023-11-18T20:40:30.381417+0000","last_became_active":"2023-11-18T20:40:15.344217+0000","last_became_peered":"2023-11-18T20:40:15.344217+0000","last_unstale":"2023-11-18T20:40:30.381417+0000","last_undegraded":"2023-11-18T20:40:30.381417+0000","last_fullsized":"2023-11-18T20:40:30.381417+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:46:38.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382669+0000","last_change":"2023-11-18T20:40:14.819105+0000","last_active":"2023-11-18T20:40:30.382669+0000","last_peered":"2023-11-18T20:40:30.382669+0000","last_clean":"2023-11-18T20:40:30.382669+0000","last_became_active":"2023-11-18T20:40:14.818836+0000","last_became_peered":"2023-11-18T20:40:14.818836+0000","last_unstale":"2023-11-18T20:40:30.382669+0000","last_undegraded":"2023-11-18T20:40:30.382669+0000","last_fullsized":"2023-11-18T20:40:30.382669+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:45.745180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.416141+0000","last_change":"2023-11-18T20:40:31.411253+0000","last_active":"2023-11-18T20:40:31.416141+0000","last_peered":"2023-11-18T20:40:31.416141+0000","last_clean":"2023-11-18T20:40:31.416141+0000","last_became_active":"2023-11-18T20:40:31.410897+0000","last_became_peered":"2023-11-18T20:40:31.410897+0000","last_unstale":"2023-11-18T20:40:31.416141+0000","last_undegraded":"2023-11-18T20:40:31.416141+0000","last_fullsized":"2023-11-18T20:40:31.416141+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:26.956962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.402695+0000","last_change":"2023-11-18T20:40:30.396563+0000","last_active":"2023-11-18T20:40:31.402695+0000","last_peered":"2023-11-18T20:40:31.402695+0000","last_clean":"2023-11-18T20:40:31.402695+0000","last_became_active":"2023-11-18T20:40:30.395763+0000","last_became_peered":"2023-11-18T20:40:30.395763+0000","last_unstale":"2023-11-18T20:40:31.402695+0000","last_undegraded":"2023-11-18T20:40:31.402695+0000","last_fullsized":"2023-11-18T20:40:31.402695+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:05.657002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382582+0000","last_change":"2023-11-18T20:40:15.357869+0000","last_active":"2023-11-18T20:40:30.382582+0000","last_peered":"2023-11-18T20:40:30.382582+0000","last_clean":"2023-11-18T20:40:30.382582+0000","last_became_active":"2023-11-18T20:40:15.355608+0000","last_became_peered":"2023-11-18T20:40:15.355608+0000","last_unstale":"2023-11-18T20:40:30.382582+0000","last_undegraded":"2023-11-18T20:40:30.382582+0000","last_fullsized":"2023-11-18T20:40:30.382582+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.686758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382812+0000","last_change":"2023-11-18T20:40:14.816928+0000","last_active":"2023-11-18T20:40:30.382812+0000","last_peered":"2023-11-18T20:40:30.382812+0000","last_clean":"2023-11-18T20:40:30.382812+0000","last_became_active":"2023-11-18T20:40:14.816652+0000","last_became_peered":"2023-11-18T20:40:14.816652+0000","last_unstale":"2023-11-18T20:40:30.382812+0000","last_undegraded":"2023-11-18T20:40:30.382812+0000","last_fullsized":"2023-11-18T20:40:30.382812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:55.852659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.423321+0000","last_change":"2023-11-18T20:40:31.417979+0000","last_active":"2023-11-18T20:40:31.423321+0000","last_peered":"2023-11-18T20:40:31.423321+0000","last_clean":"2023-11-18T20:40:31.423321+0000","last_became_active":"2023-11-18T20:40:31.417110+0000","last_became_peered":"2023-11-18T20:40:31.417110+0000","last_unstale":"2023-11-18T20:40:31.423321+0000","last_undegraded":"2023-11-18T20:40:31.423321+0000","last_fullsized":"2023-11-18T20:40:31.423321+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.240547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.439254+0000","last_change":"2023-11-18T20:40:30.392190+0000","last_active":"2023-11-18T20:40:31.439254+0000","last_peered":"2023-11-18T20:40:31.439254+0000","last_clean":"2023-11-18T20:40:31.439254+0000","last_became_active":"2023-11-18T20:40:30.391903+0000","last_became_peered":"2023-11-18T20:40:30.391903+0000","last_unstale":"2023-11-18T20:40:31.439254+0000","last_undegraded":"2023-11-18T20:40:31.439254+0000","last_fullsized":"2023-11-18T20:40:31.439254+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:23:54.558014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384099+0000","last_change":"2023-11-18T20:40:15.355385+0000","last_active":"2023-11-18T20:40:31.384099+0000","last_peered":"2023-11-18T20:40:31.384099+0000","last_clean":"2023-11-18T20:40:31.384099+0000","last_became_active":"2023-11-18T20:40:15.355098+0000","last_became_peered":"2023-11-18T20:40:15.355098+0000","last_unstale":"2023-11-18T20:40:31.384099+0000","last_undegraded":"2023-11-18T20:40:31.384099+0000","last_fullsized":"2023-11-18T20:40:31.384099+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:51:14.523181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.396063+0000","last_change":"2023-11-18T20:40:14.834099+0000","last_active":"2023-11-18T20:40:30.396063+0000","last_peered":"2023-11-18T20:40:30.396063+0000","last_clean":"2023-11-18T20:40:30.396063+0000","last_became_active":"2023-11-18T20:40:14.833825+0000","last_became_peered":"2023-11-18T20:40:14.833825+0000","last_unstale":"2023-11-18T20:40:30.396063+0000","last_undegraded":"2023-11-18T20:40:30.396063+0000","last_fullsized":"2023-11-18T20:40:30.396063+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:29.994861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.437338+0000","last_change":"2023-11-18T20:40:31.436613+0000","last_active":"2023-11-18T20:40:31.437338+0000","last_peered":"2023-11-18T20:40:31.437338+0000","last_clean":"2023-11-18T20:40:31.437338+0000","last_became_active":"2023-11-18T20:40:31.436222+0000","last_became_peered":"2023-11-18T20:40:31.436222+0000","last_unstale":"2023-11-18T20:40:31.437338+0000","last_undegraded":"2023-11-18T20:40:31.437338+0000","last_fullsized":"2023-11-18T20:40:31.437338+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:28.256207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416186+0000","last_change":"2023-11-18T20:40:30.377213+0000","last_active":"2023-11-18T20:40:32.416186+0000","last_peered":"2023-11-18T20:40:32.416186+0000","last_clean":"2023-11-18T20:40:32.416186+0000","last_became_active":"2023-11-18T20:40:30.376906+0000","last_became_peered":"2023-11-18T20:40:30.376906+0000","last_unstale":"2023-11-18T20:40:32.416186+0000","last_undegraded":"2023-11-18T20:40:32.416186+0000","last_fullsized":"2023-11-18T20:40:32.416186+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:38:20.452609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384214+0000","last_change":"2023-11-18T20:40:15.357460+0000","last_active":"2023-11-18T20:40:31.384214+0000","last_peered":"2023-11-18T20:40:31.384214+0000","last_clean":"2023-11-18T20:40:31.384214+0000","last_became_active":"2023-11-18T20:40:15.355817+0000","last_became_peered":"2023-11-18T20:40:15.355817+0000","last_unstale":"2023-11-18T20:40:31.384214+0000","last_undegraded":"2023-11-18T20:40:31.384214+0000","last_fullsized":"2023-11-18T20:40:31.384214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:55.857695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394184+0000","last_change":"2023-11-18T20:40:14.832158+0000","last_active":"2023-11-18T20:40:30.394184+0000","last_peered":"2023-11-18T20:40:30.394184+0000","last_clean":"2023-11-18T20:40:30.394184+0000","last_became_active":"2023-11-18T20:40:14.831853+0000","last_became_peered":"2023-11-18T20:40:14.831853+0000","last_unstale":"2023-11-18T20:40:30.394184+0000","last_undegraded":"2023-11-18T20:40:30.394184+0000","last_fullsized":"2023-11-18T20:40:30.394184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:51:13.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.426031+0000","last_change":"2023-11-18T20:40:31.417701+0000","last_active":"2023-11-18T20:40:31.426031+0000","last_peered":"2023-11-18T20:40:31.426031+0000","last_clean":"2023-11-18T20:40:31.426031+0000","last_became_active":"2023-11-18T20:40:31.417314+0000","last_became_peered":"2023-11-18T20:40:31.417314+0000","last_unstale":"2023-11-18T20:40:31.426031+0000","last_undegraded":"2023-11-18T20:40:31.426031+0000","last_fullsized":"2023-11-18T20:40:31.426031+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:39.256330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.439152+0000","last_change":"2023-11-18T20:40:30.394894+0000","last_active":"2023-11-18T20:40:31.439152+0000","last_peered":"2023-11-18T20:40:31.439152+0000","last_clean":"2023-11-18T20:40:31.439152+0000","last_became_active":"2023-11-18T20:40:30.394376+0000","last_became_peered":"2023-11-18T20:40:30.394376+0000","last_unstale":"2023-11-18T20:40:31.439152+0000","last_undegraded":"2023-11-18T20:40:31.439152+0000","last_fullsized":"2023-11-18T20:40:31.439152+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:50.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394676+0000","last_change":"2023-11-18T20:40:15.358307+0000","last_active":"2023-11-18T20:40:30.394676+0000","last_peered":"2023-11-18T20:40:30.394676+0000","last_clean":"2023-11-18T20:40:30.394676+0000","last_became_active":"2023-11-18T20:40:15.357876+0000","last_became_peered":"2023-11-18T20:40:15.357876+0000","last_unstale":"2023-11-18T20:40:30.394676+0000","last_undegraded":"2023-11-18T20:40:30.394676+0000","last_fullsized":"2023-11-18T20:40:30.394676+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:20:37.917813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.385117+0000","last_change":"2023-11-18T20:40:14.831548+0000","last_active":"2023-11-18T20:40:31.385117+0000","last_peered":"2023-11-18T20:40:31.385117+0000","last_clean":"2023-11-18T20:40:31.385117+0000","last_became_active":"2023-11-18T20:40:14.831302+0000","last_became_peered":"2023-11-18T20:40:14.831302+0000","last_unstale":"2023-11-18T20:40:31.385117+0000","last_undegraded":"2023-11-18T20:40:31.385117+0000","last_fullsized":"2023-11-18T20:40:31.385117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:24.216427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.420958+0000","last_change":"2023-11-18T20:40:31.411900+0000","last_active":"2023-11-18T20:40:31.420958+0000","last_peered":"2023-11-18T20:40:31.420958+0000","last_clean":"2023-11-18T20:40:31.420958+0000","last_became_active":"2023-11-18T20:40:31.411602+0000","last_became_peered":"2023-11-18T20:40:31.411602+0000","last_unstale":"2023-11-18T20:40:31.420958+0000","last_undegraded":"2023-11-18T20:40:31.420958+0000","last_fullsized":"2023-11-18T20:40:31.420958+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:43:33.022688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436705+0000","last_change":"2023-11-18T20:40:30.385639+0000","last_active":"2023-11-18T20:40:31.436705+0000","last_peered":"2023-11-18T20:40:31.436705+0000","last_clean":"2023-11-18T20:40:31.436705+0000","last_became_active":"2023-11-18T20:40:30.385377+0000","last_became_peered":"2023-11-18T20:40:30.385377+0000","last_unstale":"2023-11-18T20:40:31.436705+0000","last_undegraded":"2023-11-18T20:40:31.436705+0000","last_fullsized":"2023-11-18T20:40:31.436705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:18.449109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388273+0000","last_change":"2023-11-18T20:40:15.357107+0000","last_active":"2023-11-18T20:40:30.388273+0000","last_peered":"2023-11-18T20:40:30.388273+0000","last_clean":"2023-11-18T20:40:30.388273+0000","last_became_active":"2023-11-18T20:40:15.356852+0000","last_became_peered":"2023-11-18T20:40:15.356852+0000","last_unstale":"2023-11-18T20:40:30.388273+0000","last_undegraded":"2023-11-18T20:40:30.388273+0000","last_fullsized":"2023-11-18T20:40:30.388273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:07.057091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394590+0000","last_change":"2023-11-18T20:40:14.830198+0000","last_active":"2023-11-18T20:40:30.394590+0000","last_peered":"2023-11-18T20:40:30.394590+0000","last_clean":"2023-11-18T20:40:30.394590+0000","last_became_active":"2023-11-18T20:40:14.829922+0000","last_became_peered":"2023-11-18T20:40:14.829922+0000","last_unstale":"2023-11-18T20:40:30.394590+0000","last_undegraded":"2023-11-18T20:40:30.394590+0000","last_fullsized":"2023-11-18T20:40:30.394590+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:37.429611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414929+0000","last_change":"2023-11-18T20:40:31.393091+0000","last_active":"2023-11-18T20:40:32.414929+0000","last_peered":"2023-11-18T20:40:32.414929+0000","last_clean":"2023-11-18T20:40:32.414929+0000","last_became_active":"2023-11-18T20:40:31.392505+0000","last_became_peered":"2023-11-18T20:40:31.392505+0000","last_unstale":"2023-11-18T20:40:32.414929+0000","last_undegraded":"2023-11-18T20:40:32.414929+0000","last_fullsized":"2023-11-18T20:40:32.414929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:18.803857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.401827+0000","last_change":"2023-11-18T20:40:30.390110+0000","last_active":"2023-11-18T20:40:31.401827+0000","last_peered":"2023-11-18T20:40:31.401827+0000","last_clean":"2023-11-18T20:40:31.401827+0000","last_became_active":"2023-11-18T20:40:30.389821+0000","last_became_peered":"2023-11-18T20:40:30.389821+0000","last_unstale":"2023-11-18T20:40:31.401827+0000","last_undegraded":"2023-11-18T20:40:31.401827+0000","last_fullsized":"2023-11-18T20:40:31.401827+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:27:06.059361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382764+0000","last_change":"2023-11-18T20:40:15.352716+0000","last_active":"2023-11-18T20:40:30.382764+0000","last_peered":"2023-11-18T20:40:30.382764+0000","last_clean":"2023-11-18T20:40:30.382764+0000","last_became_active":"2023-11-18T20:40:15.352413+0000","last_became_peered":"2023-11-18T20:40:15.352413+0000","last_unstale":"2023-11-18T20:40:30.382764+0000","last_undegraded":"2023-11-18T20:40:30.382764+0000","last_fullsized":"2023-11-18T20:40:30.382764+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:15:33.663727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.389078+0000","last_change":"2023-11-18T20:40:14.820194+0000","last_active":"2023-11-18T20:40:31.389078+0000","last_peered":"2023-11-18T20:40:31.389078+0000","last_clean":"2023-11-18T20:40:31.389078+0000","last_became_active":"2023-11-18T20:40:14.819684+0000","last_became_peered":"2023-11-18T20:40:14.819684+0000","last_unstale":"2023-11-18T20:40:31.389078+0000","last_undegraded":"2023-11-18T20:40:31.389078+0000","last_fullsized":"2023-11-18T20:40:31.389078+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:30.638140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414228+0000","last_change":"2023-11-18T20:40:31.405203+0000","last_active":"2023-11-18T20:40:32.414228+0000","last_peered":"2023-11-18T20:40:32.414228+0000","last_clean":"2023-11-18T20:40:32.414228+0000","last_became_active":"2023-11-18T20:40:31.404741+0000","last_became_peered":"2023-11-18T20:40:31.404741+0000","last_unstale":"2023-11-18T20:40:32.414228+0000","last_undegraded":"2023-11-18T20:40:32.414228+0000","last_fullsized":"2023-11-18T20:40:32.414228+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:14:26.091354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.409451+0000","last_change":"2023-11-18T20:40:30.390317+0000","last_active":"2023-11-18T20:40:31.409451+0000","last_peered":"2023-11-18T20:40:31.409451+0000","last_clean":"2023-11-18T20:40:31.409451+0000","last_became_active":"2023-11-18T20:40:30.390049+0000","last_became_peered":"2023-11-18T20:40:30.390049+0000","last_unstale":"2023-11-18T20:40:31.409451+0000","last_undegraded":"2023-11-18T20:40:31.409451+0000","last_fullsized":"2023-11-18T20:40:31.409451+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:16.341435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393552+0000","last_change":"2023-11-18T20:40:15.352432+0000","last_active":"2023-11-18T20:40:30.393552+0000","last_peered":"2023-11-18T20:40:30.393552+0000","last_clean":"2023-11-18T20:40:30.393552+0000","last_became_active":"2023-11-18T20:40:15.352146+0000","last_became_peered":"2023-11-18T20:40:15.352146+0000","last_unstale":"2023-11-18T20:40:30.393552+0000","last_undegraded":"2023-11-18T20:40:30.393552+0000","last_fullsized":"2023-11-18T20:40:30.393552+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:47.494672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393595+0000","last_change":"2023-11-18T20:40:14.828458+0000","last_active":"2023-11-18T20:40:30.393595+0000","last_peered":"2023-11-18T20:40:30.393595+0000","last_clean":"2023-11-18T20:40:30.393595+0000","last_became_active":"2023-11-18T20:40:14.828170+0000","last_became_peered":"2023-11-18T20:40:14.828170+0000","last_unstale":"2023-11-18T20:40:30.393595+0000","last_undegraded":"2023-11-18T20:40:30.393595+0000","last_fullsized":"2023-11-18T20:40:30.393595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:56:30.127554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416254+0000","last_change":"2023-11-18T20:40:31.410062+0000","last_active":"2023-11-18T20:40:32.416254+0000","last_peered":"2023-11-18T20:40:32.416254+0000","last_clean":"2023-11-18T20:40:32.416254+0000","last_became_active":"2023-11-18T20:40:31.405883+0000","last_became_peered":"2023-11-18T20:40:31.405883+0000","last_unstale":"2023-11-18T20:40:32.416254+0000","last_undegraded":"2023-11-18T20:40:32.416254+0000","last_fullsized":"2023-11-18T20:40:32.416254+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:11:23.971990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414957+0000","last_change":"2023-11-18T20:40:30.384416+0000","last_active":"2023-11-18T20:40:32.414957+0000","last_peered":"2023-11-18T20:40:32.414957+0000","last_clean":"2023-11-18T20:40:32.414957+0000","last_became_active":"2023-11-18T20:40:30.383677+0000","last_became_peered":"2023-11-18T20:40:30.383677+0000","last_unstale":"2023-11-18T20:40:32.414957+0000","last_undegraded":"2023-11-18T20:40:32.414957+0000","last_fullsized":"2023-11-18T20:40:32.414957+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:55:18.355693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392462+0000","last_change":"2023-11-18T20:40:15.349261+0000","last_active":"2023-11-18T20:40:30.392462+0000","last_peered":"2023-11-18T20:40:30.392462+0000","last_clean":"2023-11-18T20:40:30.392462+0000","last_became_active":"2023-11-18T20:40:15.346287+0000","last_became_peered":"2023-11-18T20:40:15.346287+0000","last_unstale":"2023-11-18T20:40:30.392462+0000","last_undegraded":"2023-11-18T20:40:30.392462+0000","last_fullsized":"2023-11-18T20:40:30.392462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:43:17.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.381559+0000","last_change":"2023-11-18T20:40:14.828962+0000","last_active":"2023-11-18T20:40:30.381559+0000","last_peered":"2023-11-18T20:40:30.381559+0000","last_clean":"2023-11-18T20:40:30.381559+0000","last_became_active":"2023-11-18T20:40:14.828681+0000","last_became_peered":"2023-11-18T20:40:14.828681+0000","last_unstale":"2023-11-18T20:40:30.381559+0000","last_undegraded":"2023-11-18T20:40:30.381559+0000","last_fullsized":"2023-11-18T20:40:30.381559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:21:19.606979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.420900+0000","last_change":"2023-11-18T20:40:31.411458+0000","last_active":"2023-11-18T20:40:31.420900+0000","last_peered":"2023-11-18T20:40:31.420900+0000","last_clean":"2023-11-18T20:40:31.420900+0000","last_became_active":"2023-11-18T20:40:31.411147+0000","last_became_peered":"2023-11-18T20:40:31.411147+0000","last_unstale":"2023-11-18T20:40:31.420900+0000","last_undegraded":"2023-11-18T20:40:31.420900+0000","last_fullsized":"2023-11-18T20:40:31.420900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:15:34.551660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.417742+0000","last_change":"2023-11-18T20:40:30.394216+0000","last_active":"2023-11-18T20:40:32.417742+0000","last_peered":"2023-11-18T20:40:32.417742+0000","last_clean":"2023-11-18T20:40:32.417742+0000","last_became_active":"2023-11-18T20:40:30.393934+0000","last_became_peered":"2023-11-18T20:40:30.393934+0000","last_unstale":"2023-11-18T20:40:32.417742+0000","last_undegraded":"2023-11-18T20:40:32.417742+0000","last_fullsized":"2023-11-18T20:40:32.417742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:23:54.558014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384318+0000","last_change":"2023-11-18T20:40:15.354747+0000","last_active":"2023-11-18T20:40:31.384318+0000","last_peered":"2023-11-18T20:40:31.384318+0000","last_clean":"2023-11-18T20:40:31.384318+0000","last_became_active":"2023-11-18T20:40:15.354502+0000","last_became_peered":"2023-11-18T20:40:15.354502+0000","last_unstale":"2023-11-18T20:40:31.384318+0000","last_undegraded":"2023-11-18T20:40:31.384318+0000","last_fullsized":"2023-11-18T20:40:31.384318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:38.444004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395817+0000","last_change":"2023-11-18T20:40:14.834889+0000","last_active":"2023-11-18T20:40:30.395817+0000","last_peered":"2023-11-18T20:40:30.395817+0000","last_clean":"2023-11-18T20:40:30.395817+0000","last_became_active":"2023-11-18T20:40:14.834576+0000","last_became_peered":"2023-11-18T20:40:14.834576+0000","last_unstale":"2023-11-18T20:40:30.395817+0000","last_undegraded":"2023-11-18T20:40:30.395817+0000","last_fullsized":"2023-11-18T20:40:30.395817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.426440+0000","last_change":"2023-11-18T20:40:31.414801+0000","last_active":"2023-11-18T20:40:31.426440+0000","last_peered":"2023-11-18T20:40:31.426440+0000","last_clean":"2023-11-18T20:40:31.426440+0000","last_became_active":"2023-11-18T20:40:31.414563+0000","last_became_peered":"2023-11-18T20:40:31.414563+0000","last_unstale":"2023-11-18T20:40:31.426440+0000","last_undegraded":"2023-11-18T20:40:31.426440+0000","last_fullsized":"2023-11-18T20:40:31.426440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:00.254306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415713+0000","last_change":"2023-11-18T20:40:30.389479+0000","last_active":"2023-11-18T20:40:32.415713+0000","last_peered":"2023-11-18T20:40:32.415713+0000","last_clean":"2023-11-18T20:40:32.415713+0000","last_became_active":"2023-11-18T20:40:30.389201+0000","last_became_peered":"2023-11-18T20:40:30.389201+0000","last_unstale":"2023-11-18T20:40:32.415713+0000","last_undegraded":"2023-11-18T20:40:32.415713+0000","last_fullsized":"2023-11-18T20:40:32.415713+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:44.115690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384421+0000","last_change":"2023-11-18T20:40:15.348518+0000","last_active":"2023-11-18T20:40:31.384421+0000","last_peered":"2023-11-18T20:40:31.384421+0000","last_clean":"2023-11-18T20:40:31.384421+0000","last_became_active":"2023-11-18T20:40:15.348248+0000","last_became_peered":"2023-11-18T20:40:15.348248+0000","last_unstale":"2023-11-18T20:40:31.384421+0000","last_undegraded":"2023-11-18T20:40:31.384421+0000","last_fullsized":"2023-11-18T20:40:31.384421+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:07.483048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"55'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384739+0000","last_change":"2023-11-18T20:40:14.827087+0000","last_active":"2023-11-18T20:40:31.384739+0000","last_peered":"2023-11-18T20:40:31.384739+0000","last_clean":"2023-11-18T20:40:31.384739+0000","last_became_active":"2023-11-18T20:40:14.826756+0000","last_became_peered":"2023-11-18T20:40:14.826756+0000","last_unstale":"2023-11-18T20:40:31.384739+0000","last_undegraded":"2023-11-18T20:40:31.384739+0000","last_fullsized":"2023-11-18T20:40:31.384739+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:44:23.259634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.416084+0000","last_change":"2023-11-18T20:40:31.413669+0000","last_active":"2023-11-18T20:40:31.416084+0000","last_peered":"2023-11-18T20:40:31.416084+0000","last_clean":"2023-11-18T20:40:31.416084+0000","last_became_active":"2023-11-18T20:40:31.413040+0000","last_became_peered":"2023-11-18T20:40:31.413040+0000","last_unstale":"2023-11-18T20:40:31.416084+0000","last_undegraded":"2023-11-18T20:40:31.416084+0000","last_fullsized":"2023-11-18T20:40:31.416084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:24.444189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.439109+0000","last_change":"2023-11-18T20:40:30.390651+0000","last_active":"2023-11-18T20:40:31.439109+0000","last_peered":"2023-11-18T20:40:31.439109+0000","last_clean":"2023-11-18T20:40:31.439109+0000","last_became_active":"2023-11-18T20:40:30.390293+0000","last_became_peered":"2023-11-18T20:40:30.390293+0000","last_unstale":"2023-11-18T20:40:31.439109+0000","last_undegraded":"2023-11-18T20:40:31.439109+0000","last_fullsized":"2023-11-18T20:40:31.439109+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:17.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395321+0000","last_change":"2023-11-18T20:40:15.363781+0000","last_active":"2023-11-18T20:40:30.395321+0000","last_peered":"2023-11-18T20:40:30.395321+0000","last_clean":"2023-11-18T20:40:30.395321+0000","last_became_active":"2023-11-18T20:40:15.363178+0000","last_became_peered":"2023-11-18T20:40:15.363178+0000","last_unstale":"2023-11-18T20:40:30.395321+0000","last_undegraded":"2023-11-18T20:40:30.395321+0000","last_fullsized":"2023-11-18T20:40:30.395321+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:10.272018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382794+0000","last_change":"2023-11-18T20:40:14.830237+0000","last_active":"2023-11-18T20:40:30.382794+0000","last_peered":"2023-11-18T20:40:30.382794+0000","last_clean":"2023-11-18T20:40:30.382794+0000","last_became_active":"2023-11-18T20:40:14.829895+0000","last_became_peered":"2023-11-18T20:40:14.829895+0000","last_unstale":"2023-11-18T20:40:30.382794+0000","last_undegraded":"2023-11-18T20:40:30.382794+0000","last_fullsized":"2023-11-18T20:40:30.382794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.416087+0000","last_change":"2023-11-18T20:40:31.407783+0000","last_active":"2023-11-18T20:40:31.416087+0000","last_peered":"2023-11-18T20:40:31.416087+0000","last_clean":"2023-11-18T20:40:31.416087+0000","last_became_active":"2023-11-18T20:40:31.406619+0000","last_became_peered":"2023-11-18T20:40:31.406619+0000","last_unstale":"2023-11-18T20:40:31.416087+0000","last_undegraded":"2023-11-18T20:40:31.416087+0000","last_fullsized":"2023-11-18T20:40:31.416087+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:47.217160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.422142+0000","last_change":"2023-11-18T20:40:30.389209+0000","last_active":"2023-11-18T20:40:31.422142+0000","last_peered":"2023-11-18T20:40:31.422142+0000","last_clean":"2023-11-18T20:40:31.422142+0000","last_became_active":"2023-11-18T20:40:30.385645+0000","last_became_peered":"2023-11-18T20:40:30.385645+0000","last_unstale":"2023-11-18T20:40:31.422142+0000","last_undegraded":"2023-11-18T20:40:31.422142+0000","last_fullsized":"2023-11-18T20:40:31.422142+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:49.010844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393910+0000","last_change":"2023-11-18T20:40:15.346282+0000","last_active":"2023-11-18T20:40:30.393910+0000","last_peered":"2023-11-18T20:40:30.393910+0000","last_clean":"2023-11-18T20:40:30.393910+0000","last_became_active":"2023-11-18T20:40:15.345731+0000","last_became_peered":"2023-11-18T20:40:15.345731+0000","last_unstale":"2023-11-18T20:40:30.393910+0000","last_undegraded":"2023-11-18T20:40:30.393910+0000","last_fullsized":"2023-11-18T20:40:30.393910+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:03.894891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384619+0000","last_change":"2023-11-18T20:40:14.823740+0000","last_active":"2023-11-18T20:40:31.384619+0000","last_peered":"2023-11-18T20:40:31.384619+0000","last_clean":"2023-11-18T20:40:31.384619+0000","last_became_active":"2023-11-18T20:40:14.823071+0000","last_became_peered":"2023-11-18T20:40:14.823071+0000","last_unstale":"2023-11-18T20:40:31.384619+0000","last_undegraded":"2023-11-18T20:40:31.384619+0000","last_fullsized":"2023-11-18T20:40:31.384619+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:30.638140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416884+0000","last_change":"2023-11-18T20:40:31.410915+0000","last_active":"2023-11-18T20:40:32.416884+0000","last_peered":"2023-11-18T20:40:32.416884+0000","last_clean":"2023-11-18T20:40:32.416884+0000","last_became_active":"2023-11-18T20:40:31.410596+0000","last_became_peered":"2023-11-18T20:40:31.410596+0000","last_unstale":"2023-11-18T20:40:32.416884+0000","last_undegraded":"2023-11-18T20:40:32.416884+0000","last_fullsized":"2023-11-18T20:40:32.416884+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:06.286330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.402390+0000","last_change":"2023-11-18T20:40:30.388330+0000","last_active":"2023-11-18T20:40:31.402390+0000","last_peered":"2023-11-18T20:40:31.402390+0000","last_clean":"2023-11-18T20:40:31.402390+0000","last_became_active":"2023-11-18T20:40:30.387901+0000","last_became_peered":"2023-11-18T20:40:30.387901+0000","last_unstale":"2023-11-18T20:40:31.402390+0000","last_undegraded":"2023-11-18T20:40:31.402390+0000","last_fullsized":"2023-11-18T20:40:31.402390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:26:06.292277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383170+0000","last_change":"2023-11-18T20:40:15.345339+0000","last_active":"2023-11-18T20:40:31.383170+0000","last_peered":"2023-11-18T20:40:31.383170+0000","last_clean":"2023-11-18T20:40:31.383170+0000","last_became_active":"2023-11-18T20:40:15.345007+0000","last_became_peered":"2023-11-18T20:40:15.345007+0000","last_unstale":"2023-11-18T20:40:31.383170+0000","last_undegraded":"2023-11-18T20:40:31.383170+0000","last_fullsized":"2023-11-18T20:40:31.383170+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:30:28.760969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394503+0000","last_change":"2023-11-18T20:40:14.833918+0000","last_active":"2023-11-18T20:40:30.394503+0000","last_peered":"2023-11-18T20:40:30.394503+0000","last_clean":"2023-11-18T20:40:30.394503+0000","last_became_active":"2023-11-18T20:40:14.833631+0000","last_became_peered":"2023-11-18T20:40:14.833631+0000","last_unstale":"2023-11-18T20:40:30.394503+0000","last_undegraded":"2023-11-18T20:40:30.394503+0000","last_fullsized":"2023-11-18T20:40:30.394503+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:42:45.782573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425406+0000","last_change":"2023-11-18T20:40:31.417031+0000","last_active":"2023-11-18T20:40:31.425406+0000","last_peered":"2023-11-18T20:40:31.425406+0000","last_clean":"2023-11-18T20:40:31.425406+0000","last_became_active":"2023-11-18T20:40:31.410261+0000","last_became_peered":"2023-11-18T20:40:31.410261+0000","last_unstale":"2023-11-18T20:40:31.425406+0000","last_undegraded":"2023-11-18T20:40:31.425406+0000","last_fullsized":"2023-11-18T20:40:31.425406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:41.922925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414891+0000","last_change":"2023-11-18T20:40:30.391206+0000","last_active":"2023-11-18T20:40:32.414891+0000","last_peered":"2023-11-18T20:40:32.414891+0000","last_clean":"2023-11-18T20:40:32.414891+0000","last_became_active":"2023-11-18T20:40:30.390793+0000","last_became_peered":"2023-11-18T20:40:30.390793+0000","last_unstale":"2023-11-18T20:40:32.414891+0000","last_undegraded":"2023-11-18T20:40:32.414891+0000","last_fullsized":"2023-11-18T20:40:32.414891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:26:06.292277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378836+0000","last_change":"2023-11-18T20:40:15.352662+0000","last_active":"2023-11-18T20:40:30.378836+0000","last_peered":"2023-11-18T20:40:30.378836+0000","last_clean":"2023-11-18T20:40:30.378836+0000","last_became_active":"2023-11-18T20:40:15.352389+0000","last_became_peered":"2023-11-18T20:40:15.352389+0000","last_unstale":"2023-11-18T20:40:30.378836+0000","last_undegraded":"2023-11-18T20:40:30.378836+0000","last_fullsized":"2023-11-18T20:40:30.378836+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:03.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.386115+0000","last_change":"2023-11-18T20:40:14.826072+0000","last_active":"2023-11-18T20:40:31.386115+0000","last_peered":"2023-11-18T20:40:31.386115+0000","last_clean":"2023-11-18T20:40:31.386115+0000","last_became_active":"2023-11-18T20:40:14.825599+0000","last_became_peered":"2023-11-18T20:40:14.825599+0000","last_unstale":"2023-11-18T20:40:31.386115+0000","last_undegraded":"2023-11-18T20:40:31.386115+0000","last_fullsized":"2023-11-18T20:40:31.386115+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:04.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425071+0000","last_change":"2023-11-18T20:40:31.421287+0000","last_active":"2023-11-18T20:40:31.425071+0000","last_peered":"2023-11-18T20:40:31.425071+0000","last_clean":"2023-11-18T20:40:31.425071+0000","last_became_active":"2023-11-18T20:40:31.420945+0000","last_became_peered":"2023-11-18T20:40:31.420945+0000","last_unstale":"2023-11-18T20:40:31.425071+0000","last_undegraded":"2023-11-18T20:40:31.425071+0000","last_fullsized":"2023-11-18T20:40:31.425071+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:01.894798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.417154+0000","last_change":"2023-11-18T20:40:30.387684+0000","last_active":"2023-11-18T20:40:32.417154+0000","last_peered":"2023-11-18T20:40:32.417154+0000","last_clean":"2023-11-18T20:40:32.417154+0000","last_became_active":"2023-11-18T20:40:30.386825+0000","last_became_peered":"2023-11-18T20:40:30.386825+0000","last_unstale":"2023-11-18T20:40:32.417154+0000","last_undegraded":"2023-11-18T20:40:32.417154+0000","last_fullsized":"2023-11-18T20:40:32.417154+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:27:06.059361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392541+0000","last_change":"2023-11-18T20:40:15.352617+0000","last_active":"2023-11-18T20:40:30.392541+0000","last_peered":"2023-11-18T20:40:30.392541+0000","last_clean":"2023-11-18T20:40:30.392541+0000","last_became_active":"2023-11-18T20:40:15.350699+0000","last_became_peered":"2023-11-18T20:40:15.350699+0000","last_unstale":"2023-11-18T20:40:30.392541+0000","last_undegraded":"2023-11-18T20:40:30.392541+0000","last_fullsized":"2023-11-18T20:40:30.392541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:24.336068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.382714+0000","last_change":"2023-11-18T20:40:14.814908+0000","last_active":"2023-11-18T20:40:31.382714+0000","last_peered":"2023-11-18T20:40:31.382714+0000","last_clean":"2023-11-18T20:40:31.382714+0000","last_became_active":"2023-11-18T20:40:14.814486+0000","last_became_peered":"2023-11-18T20:40:14.814486+0000","last_unstale":"2023-11-18T20:40:31.382714+0000","last_undegraded":"2023-11-18T20:40:31.382714+0000","last_fullsized":"2023-11-18T20:40:31.382714+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:10.795775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436247+0000","last_change":"2023-11-18T20:40:31.426009+0000","last_active":"2023-11-18T20:40:31.436247+0000","last_peered":"2023-11-18T20:40:31.436247+0000","last_clean":"2023-11-18T20:40:31.436247+0000","last_became_active":"2023-11-18T20:40:31.424341+0000","last_became_peered":"2023-11-18T20:40:31.424341+0000","last_unstale":"2023-11-18T20:40:31.436247+0000","last_undegraded":"2023-11-18T20:40:31.436247+0000","last_fullsized":"2023-11-18T20:40:31.436247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:35:50.495871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.414166+0000","last_change":"2023-11-18T20:40:30.388648+0000","last_active":"2023-11-18T20:40:31.414166+0000","last_peered":"2023-11-18T20:40:31.414166+0000","last_clean":"2023-11-18T20:40:31.414166+0000","last_became_active":"2023-11-18T20:40:30.388375+0000","last_became_peered":"2023-11-18T20:40:30.388375+0000","last_unstale":"2023-11-18T20:40:31.414166+0000","last_undegraded":"2023-11-18T20:40:31.414166+0000","last_fullsized":"2023-11-18T20:40:31.414166+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:20:05.082948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394362+0000","last_change":"2023-11-18T20:40:15.363267+0000","last_active":"2023-11-18T20:40:30.394362+0000","last_peered":"2023-11-18T20:40:30.394362+0000","last_clean":"2023-11-18T20:40:30.394362+0000","last_became_active":"2023-11-18T20:40:15.362302+0000","last_became_peered":"2023-11-18T20:40:15.362302+0000","last_unstale":"2023-11-18T20:40:30.394362+0000","last_undegraded":"2023-11-18T20:40:30.394362+0000","last_fullsized":"2023-11-18T20:40:30.394362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:15:33.663727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392626+0000","last_change":"2023-11-18T20:40:14.830736+0000","last_active":"2023-11-18T20:40:30.392626+0000","last_peered":"2023-11-18T20:40:30.392626+0000","last_clean":"2023-11-18T20:40:30.392626+0000","last_became_active":"2023-11-18T20:40:14.830431+0000","last_became_peered":"2023-11-18T20:40:14.830431+0000","last_unstale":"2023-11-18T20:40:30.392626+0000","last_undegraded":"2023-11-18T20:40:30.392626+0000","last_fullsized":"2023-11-18T20:40:30.392626+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:10:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.437026+0000","last_change":"2023-11-18T20:40:31.435914+0000","last_active":"2023-11-18T20:40:31.437026+0000","last_peered":"2023-11-18T20:40:31.437026+0000","last_clean":"2023-11-18T20:40:31.437026+0000","last_became_active":"2023-11-18T20:40:31.435528+0000","last_became_peered":"2023-11-18T20:40:31.435528+0000","last_unstale":"2023-11-18T20:40:31.437026+0000","last_undegraded":"2023-11-18T20:40:31.437026+0000","last_fullsized":"2023-11-18T20:40:31.437026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:35.876254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.437946+0000","last_change":"2023-11-18T20:40:30.395620+0000","last_active":"2023-11-18T20:40:31.437946+0000","last_peered":"2023-11-18T20:40:31.437946+0000","last_clean":"2023-11-18T20:40:31.437946+0000","last_became_active":"2023-11-18T20:40:30.395314+0000","last_became_peered":"2023-11-18T20:40:30.395314+0000","last_unstale":"2023-11-18T20:40:31.437946+0000","last_undegraded":"2023-11-18T20:40:31.437946+0000","last_fullsized":"2023-11-18T20:40:31.437946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:17.985953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392732+0000","last_change":"2023-11-18T20:40:15.355538+0000","last_active":"2023-11-18T20:40:30.392732+0000","last_peered":"2023-11-18T20:40:30.392732+0000","last_clean":"2023-11-18T20:40:30.392732+0000","last_became_active":"2023-11-18T20:40:15.355212+0000","last_became_peered":"2023-11-18T20:40:15.355212+0000","last_unstale":"2023-11-18T20:40:30.392732+0000","last_undegraded":"2023-11-18T20:40:30.392732+0000","last_fullsized":"2023-11-18T20:40:30.392732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:15:19.819611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382666+0000","last_change":"2023-11-18T20:40:14.834678+0000","last_active":"2023-11-18T20:40:30.382666+0000","last_peered":"2023-11-18T20:40:30.382666+0000","last_clean":"2023-11-18T20:40:30.382666+0000","last_became_active":"2023-11-18T20:40:14.834152+0000","last_became_peered":"2023-11-18T20:40:14.834152+0000","last_unstale":"2023-11-18T20:40:30.382666+0000","last_undegraded":"2023-11-18T20:40:30.382666+0000","last_fullsized":"2023-11-18T20:40:30.382666+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:24:26.163852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.381559+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:40:30.381559+0000","last_peered":"2023-11-18T20:40:30.381559+0000","last_clean":"2023-11-18T20:40:30.381559+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:40:30.381559+0000","last_undegraded":"2023-11-18T20:40:30.381559+0000","last_fullsized":"2023-11-18T20:40:30.381559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":305675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.046,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0900000000000001,"15min":1.0940000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.276}]},{"osd":1,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.2110000000000001,"15min":1.214},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.599,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6180000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.097}]},{"osd":2,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1180000000000001,"15min":1.1240000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.613,"15min":1.613},"last":1.341},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0950000000000002,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.375}]},{"osd":3,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2490000000000001,"15min":1.244},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.661,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.198},{"interface":"front","average":{"1min":1.397,"5min":1.4470000000000001,"15min":1.4550000000000001},"min":{"1min":0.95999999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8939999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.4810000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.577,"15min":1.5880000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":2.0750000000000002,"5min":2.601,"15min":2.601},"last":1.595},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.542,"15min":1.554},"min":{"1min":1.135,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.883,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.97699999999999998}]},{"osd":5,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.6160000000000001,"15min":1.6259999999999999},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.218,"5min":3.02,"15min":3.02},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.728,"15min":1.7410000000000001},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":2.1640000000000001,"5min":3.488,"15min":3.488},"last":1.4139999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":1.7749999999999999,"15min":1.782},"min":{"1min":1.202,"5min":1.202,"15min":1.202},"max":{"1min":2.2290000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.7290000000000001,"15min":1.7470000000000001},"min":{"1min":1.1499999999999999,"5min":1.075,"15min":1.075},"max":{"1min":2.302,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.456}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":712704,"data_stored":305639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.60899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.206},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":0.98099999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.995,"15min":0.998},"min":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.78600000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6399999999999999,"5min":1.653,"15min":1.653},"last":1.006}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.163,"15min":1.1739999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4750000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2310000000000001,"15min":1.234},"min":{"1min":0.82099999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.744,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.347}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3220000000000001,"15min":1.341},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7130000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.448},{"interface":"front","average":{"1min":1.139,"5min":1.1830000000000001,"15min":1.1910000000000001},"min":{"1min":0.82899999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.4470000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.488}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3600000000000001,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.3},{"interface":"front","average":{"1min":1.351,"5min":1.3700000000000001,"15min":1.373},"min":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7909999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.53}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3140000000000001,"15min":1.3109999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.847,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.581},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.534,"15min":1.5289999999999999},"min":{"1min":1.127,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.4039999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.5509999999999999,"15min":1.5569999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9379999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.611},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.6359999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1294336,"data_stored":894463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.84199999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5640000000000001,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.054},{"interface":"front","average":{"1min":1.226,"5min":1.1299999999999999,"15min":1.1140000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5509999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.81200000000000006,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3080000000000001,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.5580000000000001,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.141}]},{"osd":2,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.375,"15min":1.3999999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6259999999999999,"5min":2.004,"15min":2.004},"last":1.254},{"interface":"front","average":{"1min":1.25,"5min":1.214,"15min":1.208},"min":{"1min":0.78900000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.627,"5min":2.214,"15min":2.214},"last":1.1040000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.4850000000000001,"15min":1.5069999999999999},"min":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.958,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4590000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.827,"5min":2.024,"15min":2.024},"last":1.421}]},{"osd":4,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3959999999999999,"15min":1.4079999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0470000000000002,"5min":2.359,"15min":2.359},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.496,"5min":1.5069999999999999,"15min":1.5089999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.645,"15min":1.667},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1720000000000002,"5min":2.181,"15min":2.181},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5980000000000001,"15min":1.615},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.109,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.321}]},{"osd":7,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6619999999999999,"15min":1.671},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.746,"15min":1.7609999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.609}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":305281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.371},{"interface":"front","average":{"1min":1.004,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4850000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1080000000000001,"15min":1.0900000000000001},"min":{"1min":0.73599999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.208,"15min":1.2350000000000001},"min":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4810000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6040000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.377,"15min":1.407},"min":{"1min":0.81699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.601,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":0.73799999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.212,"15min":1.224},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.4370000000000001,"5min":1.823,"15min":1.823},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.472,"15min":1.502},"min":{"1min":0.84699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.78,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4490000000000001,"15min":1.4610000000000001},"min":{"1min":1.0680000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.843,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4410000000000001,"15min":1.4630000000000001},"min":{"1min":1.073,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5549999999999999,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5489999999999999,"15min":1.5609999999999999},"min":{"1min":1.0489999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.893,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.605,"15min":1.617},"min":{"1min":1.2210000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.952,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.4790000000000001,"15min":1.478},"min":{"1min":1.244,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.843,"5min":1.929,"15min":1.929},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.635,"5min":1.6459999999999999,"15min":1.6479999999999999},"min":{"1min":1.234,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.59999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":304187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.432,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.073}]},{"osd":1,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93400000000000005,"15min":0.93300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.755},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.84999999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.274}]},{"osd":2,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.05,"15min":1.0600000000000001},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.9450000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.90800000000000003}]},{"osd":4,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1599999999999999,"15min":1.1559999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.228},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1599999999999999,"15min":1.1559999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.4259999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2410000000000001,"15min":1.2390000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8979999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.331},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.8520000000000001,"5min":1.901,"15min":1.901},"last":1.53}]},{"osd":6,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2649999999999999,"15min":1.262},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.379}]},{"osd":7,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.349},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.611},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.327,"15min":1.319},"min":{"1min":0.88500000000000001,"5min":0.754,"15min":0.754},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.355}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":716800,"data_stored":307820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.256,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":1.0389999999999999},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.367,"5min":2.081,"15min":2.081},"last":1.127}]},{"osd":1,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":0.85999999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2769999999999999,"5min":1.919,"15min":1.919},"last":1.367},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.84399999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.84199999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.085,"15min":1.1060000000000001},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4419999999999999,"5min":2.024,"15min":2.024},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.04,"15min":1.046},"min":{"1min":0.52500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5620000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0229999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.3140000000000001,"15min":1.3320000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.1659999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.177},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6839999999999999,"5min":2.254,"15min":2.254},"last":1.494}]},{"osd":5,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3109999999999999,"15min":1.323},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9419999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.425,"15min":1.4490000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5569999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.337}]},{"osd":6,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4359999999999999,"15min":1.462},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.0030000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.244},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3069999999999999,"15min":1.327},"min":{"1min":0.82299999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2189999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.056}]},{"osd":7,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.4450000000000001,"15min":1.4670000000000001},"min":{"1min":0.85999999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8600000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0950000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.2809999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1290240,"data_stored":894921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.88700000000000001,"15min":0.90800000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.371,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.194,"5min":1.524,"15min":1.524},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2290000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.433},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0349999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4730000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5589999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.115,"15min":1.129},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.595,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.206,"15min":1.22},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4199999999999999,"5min":1.927,"15min":1.927},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.258,"5min":1.4099999999999999,"15min":1.4350000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.619,"5min":3.343,"15min":3.343},"last":0.81399999999999995}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.4390000000000001,"15min":1.484},"min":{"1min":0.876,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.5429999999999999,"5min":3.206,"15min":3.206},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.387,"15min":1.401},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6519999999999999,"5min":2.165,"15min":2.165},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.681,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.331,"5min":1.5580000000000001,"15min":1.5960000000000001},"min":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.754,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.89000000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.575,"15min":1.617},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.843,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.379,"5min":1.4430000000000001,"15min":1.4530000000000001},"min":{"1min":0.81399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.306,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.0569999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":307148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2390000000000001,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.97399999999999998,"15min":1.0109999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.5529999999999999,"15min":1.663},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.331,"5min":14.169,"15min":14.169},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93000000000000005,"15min":0.94299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.96199999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":1.506,"15min":1.6080000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2989999999999999,"5min":11.629,"15min":11.629},"last":1.246},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.351,"15min":1.413},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6459999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.214}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.4119999999999999,"15min":1.4410000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4119999999999999,"15min":1.423},"min":{"1min":0.90400000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.5589999999999999,"15min":1.625},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.659,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.04},{"interface":"front","average":{"1min":1.27,"5min":1.6180000000000001,"15min":1.6759999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.736,"5min":6.202,"15min":6.202},"last":1.0629999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4710000000000001,"15min":1.472},"min":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":5.085,"5min":5.085,"15min":5.085},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.6739999999999999,"15min":1.744},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7210000000000001,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.1060000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.5820000000000001,"15min":1.6439999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.601,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.151},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.7310000000000001,"15min":1.798},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.6899999999999999,"5min":6.149,"15min":6.149},"last":1.2989999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:40:35.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:40:36.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.134+0000 7fcec759e640 1 Processor -- start 2023-11-18T20:40:36.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.134+0000 7fcec759e640 1 -- start start 2023-11-18T20:40:36.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.136+0000 7fcec759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcec80ca450 0x7fcec80ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.136+0000 7fcec759e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec8158a60 con 0x7fcec8154580 2023-11-18T20:40:36.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.136+0000 7fcec759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec80c4dd0 con 0x7fcec814e7c0 2023-11-18T20:40:36.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.136+0000 7fcec759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c5b10 con 0x7fcec80ca450 2023-11-18T20:40:36.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.136+0000 7fcec6d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcec8154580 0x7fcec8154a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41568/0 (socket says 172.21.15.132:41568) 2023-11-18T20:40:36.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.136+0000 7fcec6d9d640 1 -- 172.21.15.132:0/1723325683 learned_addr learned my addr 172.21.15.132:0/1723325683 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:36.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec5d9b640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcec80ca450 0x7fcec80ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223727752 0 0) 0x7fcec8158a60 con 0x7fcec8154580 2023-11-18T20:40:36.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb0003520 con 0x7fcec8154580 2023-11-18T20:40:36.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287974504 0 0) 0x7fceb0003520 con 0x7fcec8154580 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcec80ca450 msgr2=0x7fcec80ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcec80ca450 0x7fcec80ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 >> v1:172.21.15.161:6789/0 conn(0x7fcec814e7c0 legacy=0x7fcec80c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8157ca0 con 0x7fcec8154580 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fcec00019f0 con 0x7fcec8154580 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 >> v1:172.21.15.132:6789/0 conn(0x7fcec8154580 legacy=0x7fcec8154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb00039a0 0x7fceb0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb00047c0 0x7fceb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcec80ca450 0x7fceb0005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb000bb10 con 0x7fceb00039a0 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb000bc80 con 0x7fceb00047c0 2023-11-18T20:40:36.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb000be40 con 0x7fcec80ca450 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.137+0000 7fcec659c640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb00039a0 0x7fceb0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.138+0000 7fcec6d9d640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcec80ca450 0x7fceb0005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.138+0000 7fcec5d9b640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb00047c0 0x7fceb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.138+0000 7fcec659c640 1 -- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcec80ca450 msgr2=0x7fceb0005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.138+0000 7fcec659c640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcec80ca450 0x7fceb0005250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.138+0000 7fcec659c640 1 -- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb00047c0 msgr2=0x7fceb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.138+0000 7fcec659c640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb00047c0 0x7fceb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.138+0000 7fcec659c640 1 -- 172.21.15.132:0/1723325683 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0003520 con 0x7fceb00039a0 2023-11-18T20:40:36.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.138+0000 7fcec5d9b640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fceb00047c0 0x7fceb0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.139+0000 7fcec659c640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb00039a0 0x7fceb0003dc0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fceb8001750 tx=0x7fceb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1719e01ceb62a51 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.139+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80052d0 con 0x7fceb00039a0 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.139+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb802e050 con 0x7fceb00039a0 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.139+0000 7fcec559a640 1 -- 172.21.15.132:0/1723325683 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80035f0 con 0x7fceb00039a0 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.140+0000 7fcec759e640 1 -- 172.21.15.132:0/1723325683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb00039a0 msgr2=0x7fceb0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.140+0000 7fcec759e640 1 --2- 172.21.15.132:0/1723325683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fceb00039a0 0x7fceb0003dc0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fceb8001750 tx=0x7fceb00057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.140+0000 7fcec6d9d640 1 -- 172.21.15.132:0/1723325683 reap_dead start 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.140+0000 7fcec759e640 1 -- 172.21.15.132:0/1723325683 shutdown_connections 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.140+0000 7fcec759e640 1 -- 172.21.15.132:0/1723325683 >> 172.21.15.132:0/1723325683 conn(0x7fcec80abf00 msgr2=0x7fcec80c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.140+0000 7fcec759e640 1 -- 172.21.15.132:0/1723325683 shutdown_connections 2023-11-18T20:40:36.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.140+0000 7fcec759e640 1 -- 172.21.15.132:0/1723325683 wait complete. 2023-11-18T20:40:36.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.142+0000 7fcec759e640 1 Processor -- start 2023-11-18T20:40:36.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.142+0000 7fcec759e640 1 -- start start 2023-11-18T20:40:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.142+0000 7fcec759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb00039a0 0x7fcec81ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcec8153940 0x7fcec814b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec814b760 0x7fcec8144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec759e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec814cf50 con 0x7fcec814b760 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec8152ea0 con 0x7fcec8153940 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec81ee190 con 0x7fceb00039a0 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec814b760 0x7fcec8144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec814b760 0x7fcec8144120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47608/0 (socket says 172.21.15.132:47608) 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec6d9d640 1 -- 172.21.15.132:0/2420904508 learned_addr learned my addr 172.21.15.132:0/2420904508 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec659c640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb00039a0 0x7fcec81ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec6d9d640 1 -- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb00039a0 msgr2=0x7fcec81ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec6d9d640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb00039a0 0x7fcec81ed870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec6d9d640 1 -- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcec8153940 msgr2=0x7fcec814b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec6d9d640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcec8153940 0x7fcec814b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.143+0000 7fcec6d9d640 1 -- 172.21.15.132:0/2420904508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8153140 con 0x7fcec814b760 2023-11-18T20:40:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.144+0000 7fcec6d9d640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec814b760 0x7fcec8144120 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcec808b6c0 tx=0x7fcec000b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.144+0000 7fceb6ffd640 1 -- 172.21.15.132:0/2420904508 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000b8d0 con 0x7fcec814b760 2023-11-18T20:40:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.144+0000 7fceb6ffd640 1 -- 172.21.15.132:0/2420904508 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec000ba30 con 0x7fcec814b760 2023-11-18T20:40:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.144+0000 7fceb6ffd640 1 -- 172.21.15.132:0/2420904508 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000bde0 con 0x7fcec814b760 2023-11-18T20:40:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.144+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec8153420 con 0x7fcec814b760 2023-11-18T20:40:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.144+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec8151de0 con 0x7fcec814b760 2023-11-18T20:40:36.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.145+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec8153610 con 0x7fcec814b760 2023-11-18T20:40:36.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.146+0000 7fceb6ffd640 1 -- 172.21.15.132:0/2420904508 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcec0007070 con 0x7fcec814b760 2023-11-18T20:40:36.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.147+0000 7fceb6ffd640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcea806ae40 0x7fcea806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.148+0000 7fceb6ffd640 1 -- 172.21.15.132:0/2420904508 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcec0089cb0 con 0x7fcec814b760 2023-11-18T20:40:36.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.148+0000 7fcec659c640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcea806ae40 0x7fcea806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.149+0000 7fcec659c640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcea806ae40 0x7fcea806d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fceb8033000 tx=0x7fceb8009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.152+0000 7fceb6ffd640 1 -- 172.21.15.132:0/2420904508 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcec0054960 con 0x7fcec814b760 2023-11-18T20:40:36.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.342+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcec8158540 con 0x7fcea806ae40 2023-11-18T20:40:36.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.383+0000 7fceb6ffd640 1 -- 172.21.15.132:0/2420904508 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525564 (secure 0 0 0) 0x7fceb8005350 con 0x7fcea806ae40 2023-11-18T20:40:36.391 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:36.395 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:40:36.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcea806ae40 msgr2=0x7fcea806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcea806ae40 0x7fcea806d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fceb8033000 tx=0x7fceb8009030 comp rx=0 tx=0).stop 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec814b760 msgr2=0x7fcec8144120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec814b760 0x7fcec8144120 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcec808b6c0 tx=0x7fcec000b0d0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 shutdown_connections 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcea806ae40 0x7fcea806d300 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec814b760 0x7fcec8144120 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcec8153940 0x7fcec814b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 --2- 172.21.15.132:0/2420904508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fceb00039a0 0x7fcec81ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.390+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 >> 172.21.15.132:0/2420904508 conn(0x7fcec80abf00 msgr2=0x7fcec8148140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.391+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 shutdown_connections 2023-11-18T20:40:36.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.391+0000 7fcec759e640 1 -- 172.21.15.132:0/2420904508 wait complete. 2023-11-18T20:40:36.411 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-11-18T20:40:34.694473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":278,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235388,"kb_used_data":6696,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739332,"statfs":{"total":773094113280,"available":772853075968,"internally_reserved":0,"allocated":6856704,"data_stored":3625134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.337980"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425359+0000","last_change":"2023-11-18T20:40:31.422211+0000","last_active":"2023-11-18T20:40:31.425359+0000","last_peered":"2023-11-18T20:40:31.425359+0000","last_clean":"2023-11-18T20:40:31.425359+0000","last_became_active":"2023-11-18T20:40:31.421897+0000","last_became_peered":"2023-11-18T20:40:31.421897+0000","last_unstale":"2023-11-18T20:40:31.425359+0000","last_undegraded":"2023-11-18T20:40:31.425359+0000","last_fullsized":"2023-11-18T20:40:31.425359+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:47.217160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384685+0000","last_change":"2023-11-18T20:40:15.353470+0000","last_active":"2023-11-18T20:40:31.384685+0000","last_peered":"2023-11-18T20:40:31.384685+0000","last_clean":"2023-11-18T20:40:31.384685+0000","last_became_active":"2023-11-18T20:40:15.353123+0000","last_became_peered":"2023-11-18T20:40:15.353123+0000","last_unstale":"2023-11-18T20:40:31.384685+0000","last_undegraded":"2023-11-18T20:40:31.384685+0000","last_fullsized":"2023-11-18T20:40:31.384685+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:17:38.972740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.419531+0000","last_change":"2023-11-18T20:40:31.415623+0000","last_active":"2023-11-18T20:40:31.419531+0000","last_peered":"2023-11-18T20:40:31.419531+0000","last_clean":"2023-11-18T20:40:31.419531+0000","last_became_active":"2023-11-18T20:40:31.415317+0000","last_became_peered":"2023-11-18T20:40:31.415317+0000","last_unstale":"2023-11-18T20:40:31.419531+0000","last_undegraded":"2023-11-18T20:40:31.419531+0000","last_fullsized":"2023-11-18T20:40:31.419531+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:56.247717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394884+0000","last_change":"2023-11-18T20:40:15.364843+0000","last_active":"2023-11-18T20:40:30.394884+0000","last_peered":"2023-11-18T20:40:30.394884+0000","last_clean":"2023-11-18T20:40:30.394884+0000","last_became_active":"2023-11-18T20:40:15.364551+0000","last_became_peered":"2023-11-18T20:40:15.364551+0000","last_unstale":"2023-11-18T20:40:30.394884+0000","last_undegraded":"2023-11-18T20:40:30.394884+0000","last_fullsized":"2023-11-18T20:40:30.394884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:21.022118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436880+0000","last_change":"2023-11-18T20:40:31.428085+0000","last_active":"2023-11-18T20:40:31.436880+0000","last_peered":"2023-11-18T20:40:31.436880+0000","last_clean":"2023-11-18T20:40:31.436880+0000","last_became_active":"2023-11-18T20:40:31.427807+0000","last_became_peered":"2023-11-18T20:40:31.427807+0000","last_unstale":"2023-11-18T20:40:31.436880+0000","last_undegraded":"2023-11-18T20:40:31.436880+0000","last_fullsized":"2023-11-18T20:40:31.436880+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:39:59.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384838+0000","last_change":"2023-11-18T20:40:15.345424+0000","last_active":"2023-11-18T20:40:31.384838+0000","last_peered":"2023-11-18T20:40:31.384838+0000","last_clean":"2023-11-18T20:40:31.384838+0000","last_became_active":"2023-11-18T20:40:15.344537+0000","last_became_peered":"2023-11-18T20:40:15.344537+0000","last_unstale":"2023-11-18T20:40:31.384838+0000","last_undegraded":"2023-11-18T20:40:31.384838+0000","last_fullsized":"2023-11-18T20:40:31.384838+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:26.358299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.426050+0000","last_change":"2023-11-18T20:40:31.418641+0000","last_active":"2023-11-18T20:40:31.426050+0000","last_peered":"2023-11-18T20:40:31.426050+0000","last_clean":"2023-11-18T20:40:31.426050+0000","last_became_active":"2023-11-18T20:40:31.418359+0000","last_became_peered":"2023-11-18T20:40:31.418359+0000","last_unstale":"2023-11-18T20:40:31.426050+0000","last_undegraded":"2023-11-18T20:40:31.426050+0000","last_fullsized":"2023-11-18T20:40:31.426050+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:15:35.384237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388009+0000","last_change":"2023-11-18T20:40:15.356657+0000","last_active":"2023-11-18T20:40:30.388009+0000","last_peered":"2023-11-18T20:40:30.388009+0000","last_clean":"2023-11-18T20:40:30.388009+0000","last_became_active":"2023-11-18T20:40:15.356417+0000","last_became_peered":"2023-11-18T20:40:15.356417+0000","last_unstale":"2023-11-18T20:40:30.388009+0000","last_undegraded":"2023-11-18T20:40:30.388009+0000","last_fullsized":"2023-11-18T20:40:30.388009+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:07:05.628953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.427895+0000","last_change":"2023-11-18T20:40:31.420471+0000","last_active":"2023-11-18T20:40:31.427895+0000","last_peered":"2023-11-18T20:40:31.427895+0000","last_clean":"2023-11-18T20:40:31.427895+0000","last_became_active":"2023-11-18T20:40:31.420218+0000","last_became_peered":"2023-11-18T20:40:31.420218+0000","last_unstale":"2023-11-18T20:40:31.427895+0000","last_undegraded":"2023-11-18T20:40:31.427895+0000","last_fullsized":"2023-11-18T20:40:31.427895+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:40.795447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383757+0000","last_change":"2023-11-18T20:40:15.343983+0000","last_active":"2023-11-18T20:40:31.383757+0000","last_peered":"2023-11-18T20:40:31.383757+0000","last_clean":"2023-11-18T20:40:31.383757+0000","last_became_active":"2023-11-18T20:40:15.343720+0000","last_became_peered":"2023-11-18T20:40:15.343720+0000","last_unstale":"2023-11-18T20:40:31.383757+0000","last_undegraded":"2023-11-18T20:40:31.383757+0000","last_fullsized":"2023-11-18T20:40:31.383757+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:56:02.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436042+0000","last_change":"2023-11-18T20:40:31.423292+0000","last_active":"2023-11-18T20:40:31.436042+0000","last_peered":"2023-11-18T20:40:31.436042+0000","last_clean":"2023-11-18T20:40:31.436042+0000","last_became_active":"2023-11-18T20:40:31.418148+0000","last_became_peered":"2023-11-18T20:40:31.418148+0000","last_unstale":"2023-11-18T20:40:31.436042+0000","last_undegraded":"2023-11-18T20:40:31.436042+0000","last_fullsized":"2023-11-18T20:40:31.436042+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:57.947690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.382940+0000","last_change":"2023-11-18T20:40:15.350938+0000","last_active":"2023-11-18T20:40:31.382940+0000","last_peered":"2023-11-18T20:40:31.382940+0000","last_clean":"2023-11-18T20:40:31.382940+0000","last_became_active":"2023-11-18T20:40:15.350551+0000","last_became_peered":"2023-11-18T20:40:15.350551+0000","last_unstale":"2023-11-18T20:40:31.382940+0000","last_undegraded":"2023-11-18T20:40:31.382940+0000","last_fullsized":"2023-11-18T20:40:31.382940+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:32.423699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425152+0000","last_change":"2023-11-18T20:40:31.421612+0000","last_active":"2023-11-18T20:40:31.425152+0000","last_peered":"2023-11-18T20:40:31.425152+0000","last_clean":"2023-11-18T20:40:31.425152+0000","last_became_active":"2023-11-18T20:40:31.421180+0000","last_became_peered":"2023-11-18T20:40:31.421180+0000","last_unstale":"2023-11-18T20:40:31.425152+0000","last_undegraded":"2023-11-18T20:40:31.425152+0000","last_fullsized":"2023-11-18T20:40:31.425152+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:52:12.486041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382477+0000","last_change":"2023-11-18T20:40:15.349771+0000","last_active":"2023-11-18T20:40:30.382477+0000","last_peered":"2023-11-18T20:40:30.382477+0000","last_clean":"2023-11-18T20:40:30.382477+0000","last_became_active":"2023-11-18T20:40:15.349537+0000","last_became_peered":"2023-11-18T20:40:15.349537+0000","last_unstale":"2023-11-18T20:40:30.382477+0000","last_undegraded":"2023-11-18T20:40:30.382477+0000","last_fullsized":"2023-11-18T20:40:30.382477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:24:36.093151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415316+0000","last_change":"2023-11-18T20:40:31.412311+0000","last_active":"2023-11-18T20:40:32.415316+0000","last_peered":"2023-11-18T20:40:32.415316+0000","last_clean":"2023-11-18T20:40:32.415316+0000","last_became_active":"2023-11-18T20:40:31.411929+0000","last_became_peered":"2023-11-18T20:40:31.411929+0000","last_unstale":"2023-11-18T20:40:32.415316+0000","last_undegraded":"2023-11-18T20:40:32.415316+0000","last_fullsized":"2023-11-18T20:40:32.415316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:24.444189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392440+0000","last_change":"2023-11-18T20:40:15.348439+0000","last_active":"2023-11-18T20:40:30.392440+0000","last_peered":"2023-11-18T20:40:30.392440+0000","last_clean":"2023-11-18T20:40:30.392440+0000","last_became_active":"2023-11-18T20:40:15.348132+0000","last_became_peered":"2023-11-18T20:40:15.348132+0000","last_unstale":"2023-11-18T20:40:30.392440+0000","last_undegraded":"2023-11-18T20:40:30.392440+0000","last_fullsized":"2023-11-18T20:40:30.392440+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:15:18.987033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435981+0000","last_change":"2023-11-18T20:40:31.419314+0000","last_active":"2023-11-18T20:40:31.435981+0000","last_peered":"2023-11-18T20:40:31.435981+0000","last_clean":"2023-11-18T20:40:31.435981+0000","last_became_active":"2023-11-18T20:40:31.418530+0000","last_became_peered":"2023-11-18T20:40:31.418530+0000","last_unstale":"2023-11-18T20:40:31.435981+0000","last_undegraded":"2023-11-18T20:40:31.435981+0000","last_fullsized":"2023-11-18T20:40:31.435981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:49:08.160909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382920+0000","last_change":"2023-11-18T20:40:15.353406+0000","last_active":"2023-11-18T20:40:30.382920+0000","last_peered":"2023-11-18T20:40:30.382920+0000","last_clean":"2023-11-18T20:40:30.382920+0000","last_became_active":"2023-11-18T20:40:15.353034+0000","last_became_peered":"2023-11-18T20:40:15.353034+0000","last_unstale":"2023-11-18T20:40:30.382920+0000","last_undegraded":"2023-11-18T20:40:30.382920+0000","last_fullsized":"2023-11-18T20:40:30.382920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:20:37.917813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416050+0000","last_change":"2023-11-18T20:40:31.409265+0000","last_active":"2023-11-18T20:40:32.416050+0000","last_peered":"2023-11-18T20:40:32.416050+0000","last_clean":"2023-11-18T20:40:32.416050+0000","last_became_active":"2023-11-18T20:40:31.408953+0000","last_became_peered":"2023-11-18T20:40:31.408953+0000","last_unstale":"2023-11-18T20:40:32.416050+0000","last_undegraded":"2023-11-18T20:40:32.416050+0000","last_fullsized":"2023-11-18T20:40:32.416050+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:55:19.366101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384458+0000","last_change":"2023-11-18T20:40:15.342874+0000","last_active":"2023-11-18T20:40:31.384458+0000","last_peered":"2023-11-18T20:40:31.384458+0000","last_clean":"2023-11-18T20:40:31.384458+0000","last_became_active":"2023-11-18T20:40:15.342588+0000","last_became_peered":"2023-11-18T20:40:15.342588+0000","last_unstale":"2023-11-18T20:40:31.384458+0000","last_undegraded":"2023-11-18T20:40:31.384458+0000","last_fullsized":"2023-11-18T20:40:31.384458+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:25:23.165385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424943+0000","last_change":"2023-11-18T20:40:31.418792+0000","last_active":"2023-11-18T20:40:31.424943+0000","last_peered":"2023-11-18T20:40:31.424943+0000","last_clean":"2023-11-18T20:40:31.424943+0000","last_became_active":"2023-11-18T20:40:31.417959+0000","last_became_peered":"2023-11-18T20:40:31.417959+0000","last_unstale":"2023-11-18T20:40:31.424943+0000","last_undegraded":"2023-11-18T20:40:31.424943+0000","last_fullsized":"2023-11-18T20:40:31.424943+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:24:42.742871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.390289+0000","last_change":"2023-11-18T20:40:15.340398+0000","last_active":"2023-11-18T20:40:31.390289+0000","last_peered":"2023-11-18T20:40:31.390289+0000","last_clean":"2023-11-18T20:40:31.390289+0000","last_became_active":"2023-11-18T20:40:15.340055+0000","last_became_peered":"2023-11-18T20:40:15.340055+0000","last_unstale":"2023-11-18T20:40:31.390289+0000","last_undegraded":"2023-11-18T20:40:31.390289+0000","last_fullsized":"2023-11-18T20:40:31.390289+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:07:14.006606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.428975+0000","last_change":"2023-11-18T20:40:31.421505+0000","last_active":"2023-11-18T20:40:31.428975+0000","last_peered":"2023-11-18T20:40:31.428975+0000","last_clean":"2023-11-18T20:40:31.428975+0000","last_became_active":"2023-11-18T20:40:31.421167+0000","last_became_peered":"2023-11-18T20:40:31.421167+0000","last_unstale":"2023-11-18T20:40:31.428975+0000","last_undegraded":"2023-11-18T20:40:31.428975+0000","last_fullsized":"2023-11-18T20:40:31.428975+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:06:25.583469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.383028+0000","last_change":"2023-11-18T20:40:15.344623+0000","last_active":"2023-11-18T20:40:30.383028+0000","last_peered":"2023-11-18T20:40:30.383028+0000","last_clean":"2023-11-18T20:40:30.383028+0000","last_became_active":"2023-11-18T20:40:15.344216+0000","last_became_peered":"2023-11-18T20:40:15.344216+0000","last_unstale":"2023-11-18T20:40:30.383028+0000","last_undegraded":"2023-11-18T20:40:30.383028+0000","last_fullsized":"2023-11-18T20:40:30.383028+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:53.802513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.413911+0000","last_change":"2023-11-18T20:40:31.415434+0000","last_active":"2023-11-18T20:40:32.413911+0000","last_peered":"2023-11-18T20:40:32.413911+0000","last_clean":"2023-11-18T20:40:32.413911+0000","last_became_active":"2023-11-18T20:40:31.415092+0000","last_became_peered":"2023-11-18T20:40:31.415092+0000","last_unstale":"2023-11-18T20:40:32.413911+0000","last_undegraded":"2023-11-18T20:40:32.413911+0000","last_fullsized":"2023-11-18T20:40:32.413911+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:16.063377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378655+0000","last_change":"2023-11-18T20:40:15.352260+0000","last_active":"2023-11-18T20:40:30.378655+0000","last_peered":"2023-11-18T20:40:30.378655+0000","last_clean":"2023-11-18T20:40:30.378655+0000","last_became_active":"2023-11-18T20:40:15.351965+0000","last_became_peered":"2023-11-18T20:40:15.351965+0000","last_unstale":"2023-11-18T20:40:30.378655+0000","last_undegraded":"2023-11-18T20:40:30.378655+0000","last_fullsized":"2023-11-18T20:40:30.378655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:11.392335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.429898+0000","last_change":"2023-11-18T20:40:31.410941+0000","last_active":"2023-11-18T20:40:31.429898+0000","last_peered":"2023-11-18T20:40:31.429898+0000","last_clean":"2023-11-18T20:40:31.429898+0000","last_became_active":"2023-11-18T20:40:31.410658+0000","last_became_peered":"2023-11-18T20:40:31.410658+0000","last_unstale":"2023-11-18T20:40:31.429898+0000","last_undegraded":"2023-11-18T20:40:31.429898+0000","last_fullsized":"2023-11-18T20:40:31.429898+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:37:46.059128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.385708+0000","last_change":"2023-11-18T20:40:15.348662+0000","last_active":"2023-11-18T20:40:31.385708+0000","last_peered":"2023-11-18T20:40:31.385708+0000","last_clean":"2023-11-18T20:40:31.385708+0000","last_became_active":"2023-11-18T20:40:15.348091+0000","last_became_peered":"2023-11-18T20:40:15.348091+0000","last_unstale":"2023-11-18T20:40:31.385708+0000","last_undegraded":"2023-11-18T20:40:31.385708+0000","last_fullsized":"2023-11-18T20:40:31.385708+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:21:51.102783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425210+0000","last_change":"2023-11-18T20:40:31.422290+0000","last_active":"2023-11-18T20:40:31.425210+0000","last_peered":"2023-11-18T20:40:31.425210+0000","last_clean":"2023-11-18T20:40:31.425210+0000","last_became_active":"2023-11-18T20:40:31.421973+0000","last_became_peered":"2023-11-18T20:40:31.421973+0000","last_unstale":"2023-11-18T20:40:31.425210+0000","last_undegraded":"2023-11-18T20:40:31.425210+0000","last_fullsized":"2023-11-18T20:40:31.425210+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:00.254306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382573+0000","last_change":"2023-11-18T20:40:15.356747+0000","last_active":"2023-11-18T20:40:30.382573+0000","last_peered":"2023-11-18T20:40:30.382573+0000","last_clean":"2023-11-18T20:40:30.382573+0000","last_became_active":"2023-11-18T20:40:15.356448+0000","last_became_peered":"2023-11-18T20:40:15.356448+0000","last_unstale":"2023-11-18T20:40:30.382573+0000","last_undegraded":"2023-11-18T20:40:30.382573+0000","last_fullsized":"2023-11-18T20:40:30.382573+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:44.689679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415839+0000","last_change":"2023-11-18T20:40:31.409443+0000","last_active":"2023-11-18T20:40:32.415839+0000","last_peered":"2023-11-18T20:40:32.415839+0000","last_clean":"2023-11-18T20:40:32.415839+0000","last_became_active":"2023-11-18T20:40:31.409147+0000","last_became_peered":"2023-11-18T20:40:31.409147+0000","last_unstale":"2023-11-18T20:40:32.415839+0000","last_undegraded":"2023-11-18T20:40:32.415839+0000","last_fullsized":"2023-11-18T20:40:32.415839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:32.927454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383017+0000","last_change":"2023-11-18T20:40:15.349839+0000","last_active":"2023-11-18T20:40:31.383017+0000","last_peered":"2023-11-18T20:40:31.383017+0000","last_clean":"2023-11-18T20:40:31.383017+0000","last_became_active":"2023-11-18T20:40:15.349526+0000","last_became_peered":"2023-11-18T20:40:15.349526+0000","last_unstale":"2023-11-18T20:40:31.383017+0000","last_undegraded":"2023-11-18T20:40:31.383017+0000","last_fullsized":"2023-11-18T20:40:31.383017+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:54:40.657646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436117+0000","last_change":"2023-11-18T20:40:31.423351+0000","last_active":"2023-11-18T20:40:31.436117+0000","last_peered":"2023-11-18T20:40:31.436117+0000","last_clean":"2023-11-18T20:40:31.436117+0000","last_became_active":"2023-11-18T20:40:31.422902+0000","last_became_peered":"2023-11-18T20:40:31.422902+0000","last_unstale":"2023-11-18T20:40:31.436117+0000","last_undegraded":"2023-11-18T20:40:31.436117+0000","last_fullsized":"2023-11-18T20:40:31.436117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:40:49.827138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384702+0000","last_change":"2023-11-18T20:40:15.356534+0000","last_active":"2023-11-18T20:40:31.384702+0000","last_peered":"2023-11-18T20:40:31.384702+0000","last_clean":"2023-11-18T20:40:31.384702+0000","last_became_active":"2023-11-18T20:40:15.356211+0000","last_became_peered":"2023-11-18T20:40:15.356211+0000","last_unstale":"2023-11-18T20:40:31.384702+0000","last_undegraded":"2023-11-18T20:40:31.384702+0000","last_fullsized":"2023-11-18T20:40:31.384702+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:49.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.423750+0000","last_change":"2023-11-18T20:40:31.419255+0000","last_active":"2023-11-18T20:40:31.423750+0000","last_peered":"2023-11-18T20:40:31.423750+0000","last_clean":"2023-11-18T20:40:31.423750+0000","last_became_active":"2023-11-18T20:40:31.418012+0000","last_became_peered":"2023-11-18T20:40:31.418012+0000","last_unstale":"2023-11-18T20:40:31.423750+0000","last_undegraded":"2023-11-18T20:40:31.423750+0000","last_fullsized":"2023-11-18T20:40:31.423750+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:13.087448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383964+0000","last_change":"2023-11-18T20:40:15.357082+0000","last_active":"2023-11-18T20:40:31.383964+0000","last_peered":"2023-11-18T20:40:31.383964+0000","last_clean":"2023-11-18T20:40:31.383964+0000","last_became_active":"2023-11-18T20:40:15.356757+0000","last_became_peered":"2023-11-18T20:40:15.356757+0000","last_unstale":"2023-11-18T20:40:31.383964+0000","last_undegraded":"2023-11-18T20:40:31.383964+0000","last_fullsized":"2023-11-18T20:40:31.383964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:56:31.141946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424985+0000","last_change":"2023-11-18T20:40:31.421292+0000","last_active":"2023-11-18T20:40:31.424985+0000","last_peered":"2023-11-18T20:40:31.424985+0000","last_clean":"2023-11-18T20:40:31.424985+0000","last_became_active":"2023-11-18T20:40:31.420987+0000","last_became_peered":"2023-11-18T20:40:31.420987+0000","last_unstale":"2023-11-18T20:40:31.424985+0000","last_undegraded":"2023-11-18T20:40:31.424985+0000","last_fullsized":"2023-11-18T20:40:31.424985+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:03:12.220746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395245+0000","last_change":"2023-11-18T20:40:15.363178+0000","last_active":"2023-11-18T20:40:30.395245+0000","last_peered":"2023-11-18T20:40:30.395245+0000","last_clean":"2023-11-18T20:40:30.395245+0000","last_became_active":"2023-11-18T20:40:15.362454+0000","last_became_peered":"2023-11-18T20:40:15.362454+0000","last_unstale":"2023-11-18T20:40:30.395245+0000","last_undegraded":"2023-11-18T20:40:30.395245+0000","last_fullsized":"2023-11-18T20:40:30.395245+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:25:53.802513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425708+0000","last_change":"2023-11-18T20:40:31.423445+0000","last_active":"2023-11-18T20:40:31.425708+0000","last_peered":"2023-11-18T20:40:31.425708+0000","last_clean":"2023-11-18T20:40:31.425708+0000","last_became_active":"2023-11-18T20:40:31.422277+0000","last_became_peered":"2023-11-18T20:40:31.422277+0000","last_unstale":"2023-11-18T20:40:31.425708+0000","last_undegraded":"2023-11-18T20:40:31.425708+0000","last_fullsized":"2023-11-18T20:40:31.425708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:04.472128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.389317+0000","last_change":"2023-11-18T20:40:15.348980+0000","last_active":"2023-11-18T20:40:31.389317+0000","last_peered":"2023-11-18T20:40:31.389317+0000","last_clean":"2023-11-18T20:40:31.389317+0000","last_became_active":"2023-11-18T20:40:15.348714+0000","last_became_peered":"2023-11-18T20:40:15.348714+0000","last_unstale":"2023-11-18T20:40:31.389317+0000","last_undegraded":"2023-11-18T20:40:31.389317+0000","last_fullsized":"2023-11-18T20:40:31.389317+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:06:10.018842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.427928+0000","last_change":"2023-11-18T20:40:31.422697+0000","last_active":"2023-11-18T20:40:31.427928+0000","last_peered":"2023-11-18T20:40:31.427928+0000","last_clean":"2023-11-18T20:40:31.427928+0000","last_became_active":"2023-11-18T20:40:31.422403+0000","last_became_peered":"2023-11-18T20:40:31.422403+0000","last_unstale":"2023-11-18T20:40:31.427928+0000","last_undegraded":"2023-11-18T20:40:31.427928+0000","last_fullsized":"2023-11-18T20:40:31.427928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:28.256207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378745+0000","last_change":"2023-11-18T20:40:15.349389+0000","last_active":"2023-11-18T20:40:30.378745+0000","last_peered":"2023-11-18T20:40:30.378745+0000","last_clean":"2023-11-18T20:40:30.378745+0000","last_became_active":"2023-11-18T20:40:15.348893+0000","last_became_peered":"2023-11-18T20:40:15.348893+0000","last_unstale":"2023-11-18T20:40:30.378745+0000","last_undegraded":"2023-11-18T20:40:30.378745+0000","last_fullsized":"2023-11-18T20:40:30.378745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:40.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435591+0000","last_change":"2023-11-18T20:40:31.414891+0000","last_active":"2023-11-18T20:40:31.435591+0000","last_peered":"2023-11-18T20:40:31.435591+0000","last_clean":"2023-11-18T20:40:31.435591+0000","last_became_active":"2023-11-18T20:40:31.414631+0000","last_became_peered":"2023-11-18T20:40:31.414631+0000","last_unstale":"2023-11-18T20:40:31.435591+0000","last_undegraded":"2023-11-18T20:40:31.435591+0000","last_fullsized":"2023-11-18T20:40:31.435591+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:36:34.926444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.388223+0000","last_change":"2023-11-18T20:40:15.357261+0000","last_active":"2023-11-18T20:40:31.388223+0000","last_peered":"2023-11-18T20:40:31.388223+0000","last_clean":"2023-11-18T20:40:31.388223+0000","last_became_active":"2023-11-18T20:40:15.356930+0000","last_became_peered":"2023-11-18T20:40:15.356930+0000","last_unstale":"2023-11-18T20:40:31.388223+0000","last_undegraded":"2023-11-18T20:40:31.388223+0000","last_fullsized":"2023-11-18T20:40:31.388223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:21:51.102783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424697+0000","last_change":"2023-11-18T20:40:31.416870+0000","last_active":"2023-11-18T20:40:31.424697+0000","last_peered":"2023-11-18T20:40:31.424697+0000","last_clean":"2023-11-18T20:40:31.424697+0000","last_became_active":"2023-11-18T20:40:31.416619+0000","last_became_peered":"2023-11-18T20:40:31.416619+0000","last_unstale":"2023-11-18T20:40:31.424697+0000","last_undegraded":"2023-11-18T20:40:31.424697+0000","last_fullsized":"2023-11-18T20:40:31.424697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:54.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382982+0000","last_change":"2023-11-18T20:40:15.357312+0000","last_active":"2023-11-18T20:40:30.382982+0000","last_peered":"2023-11-18T20:40:30.382982+0000","last_clean":"2023-11-18T20:40:30.382982+0000","last_became_active":"2023-11-18T20:40:15.355941+0000","last_became_peered":"2023-11-18T20:40:15.355941+0000","last_unstale":"2023-11-18T20:40:30.382982+0000","last_undegraded":"2023-11-18T20:40:30.382982+0000","last_fullsized":"2023-11-18T20:40:30.382982+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:58:33.591767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415159+0000","last_change":"2023-11-18T20:40:31.418311+0000","last_active":"2023-11-18T20:40:32.415159+0000","last_peered":"2023-11-18T20:40:32.415159+0000","last_clean":"2023-11-18T20:40:32.415159+0000","last_became_active":"2023-11-18T20:40:31.418052+0000","last_became_peered":"2023-11-18T20:40:31.418052+0000","last_unstale":"2023-11-18T20:40:32.415159+0000","last_undegraded":"2023-11-18T20:40:32.415159+0000","last_fullsized":"2023-11-18T20:40:32.415159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:28.157821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.381306+0000","last_change":"2023-11-18T20:40:15.352149+0000","last_active":"2023-11-18T20:40:30.381306+0000","last_peered":"2023-11-18T20:40:30.381306+0000","last_clean":"2023-11-18T20:40:30.381306+0000","last_became_active":"2023-11-18T20:40:15.351873+0000","last_became_peered":"2023-11-18T20:40:15.351873+0000","last_unstale":"2023-11-18T20:40:30.381306+0000","last_undegraded":"2023-11-18T20:40:30.381306+0000","last_fullsized":"2023-11-18T20:40:30.381306+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:18.839789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424617+0000","last_change":"2023-11-18T20:40:31.420077+0000","last_active":"2023-11-18T20:40:31.424617+0000","last_peered":"2023-11-18T20:40:31.424617+0000","last_clean":"2023-11-18T20:40:31.424617+0000","last_became_active":"2023-11-18T20:40:31.419278+0000","last_became_peered":"2023-11-18T20:40:31.419278+0000","last_unstale":"2023-11-18T20:40:31.424617+0000","last_undegraded":"2023-11-18T20:40:31.424617+0000","last_fullsized":"2023-11-18T20:40:31.424617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:05.782020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395513+0000","last_change":"2023-11-18T20:40:15.363235+0000","last_active":"2023-11-18T20:40:30.395513+0000","last_peered":"2023-11-18T20:40:30.395513+0000","last_clean":"2023-11-18T20:40:30.395513+0000","last_became_active":"2023-11-18T20:40:15.361152+0000","last_became_peered":"2023-11-18T20:40:15.361152+0000","last_unstale":"2023-11-18T20:40:30.395513+0000","last_undegraded":"2023-11-18T20:40:30.395513+0000","last_fullsized":"2023-11-18T20:40:30.395513+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:35:23.067715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.420943+0000","last_change":"2023-11-18T20:40:31.411807+0000","last_active":"2023-11-18T20:40:31.420943+0000","last_peered":"2023-11-18T20:40:31.420943+0000","last_clean":"2023-11-18T20:40:31.420943+0000","last_became_active":"2023-11-18T20:40:31.411469+0000","last_became_peered":"2023-11-18T20:40:31.411469+0000","last_unstale":"2023-11-18T20:40:31.420943+0000","last_undegraded":"2023-11-18T20:40:31.420943+0000","last_fullsized":"2023-11-18T20:40:31.420943+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:39.900695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.379575+0000","last_change":"2023-11-18T20:40:15.341577+0000","last_active":"2023-11-18T20:40:30.379575+0000","last_peered":"2023-11-18T20:40:30.379575+0000","last_clean":"2023-11-18T20:40:30.379575+0000","last_became_active":"2023-11-18T20:40:15.341217+0000","last_became_peered":"2023-11-18T20:40:15.341217+0000","last_unstale":"2023-11-18T20:40:30.379575+0000","last_undegraded":"2023-11-18T20:40:30.379575+0000","last_fullsized":"2023-11-18T20:40:30.379575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:12.691580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.430544+0000","last_change":"2023-11-18T20:40:31.424993+0000","last_active":"2023-11-18T20:40:31.430544+0000","last_peered":"2023-11-18T20:40:31.430544+0000","last_clean":"2023-11-18T20:40:31.430544+0000","last_became_active":"2023-11-18T20:40:31.423491+0000","last_became_peered":"2023-11-18T20:40:31.423491+0000","last_unstale":"2023-11-18T20:40:31.430544+0000","last_undegraded":"2023-11-18T20:40:31.430544+0000","last_fullsized":"2023-11-18T20:40:31.430544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.240547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395456+0000","last_change":"2023-11-18T20:40:15.364215+0000","last_active":"2023-11-18T20:40:30.395456+0000","last_peered":"2023-11-18T20:40:30.395456+0000","last_clean":"2023-11-18T20:40:30.395456+0000","last_became_active":"2023-11-18T20:40:15.363880+0000","last_became_peered":"2023-11-18T20:40:15.363880+0000","last_unstale":"2023-11-18T20:40:30.395456+0000","last_undegraded":"2023-11-18T20:40:30.395456+0000","last_fullsized":"2023-11-18T20:40:30.395456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:12.766245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435941+0000","last_change":"2023-11-18T20:40:31.422749+0000","last_active":"2023-11-18T20:40:31.435941+0000","last_peered":"2023-11-18T20:40:31.435941+0000","last_clean":"2023-11-18T20:40:31.435941+0000","last_became_active":"2023-11-18T20:40:31.422441+0000","last_became_peered":"2023-11-18T20:40:31.422441+0000","last_unstale":"2023-11-18T20:40:31.435941+0000","last_undegraded":"2023-11-18T20:40:31.435941+0000","last_fullsized":"2023-11-18T20:40:31.435941+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:45:18.524774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394290+0000","last_change":"2023-11-18T20:40:15.353818+0000","last_active":"2023-11-18T20:40:30.394290+0000","last_peered":"2023-11-18T20:40:30.394290+0000","last_clean":"2023-11-18T20:40:30.394290+0000","last_became_active":"2023-11-18T20:40:15.352248+0000","last_became_peered":"2023-11-18T20:40:15.352248+0000","last_unstale":"2023-11-18T20:40:30.394290+0000","last_undegraded":"2023-11-18T20:40:30.394290+0000","last_fullsized":"2023-11-18T20:40:30.394290+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:26:51.505142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.420631+0000","last_change":"2023-11-18T20:40:31.410292+0000","last_active":"2023-11-18T20:40:31.420631+0000","last_peered":"2023-11-18T20:40:31.420631+0000","last_clean":"2023-11-18T20:40:31.420631+0000","last_became_active":"2023-11-18T20:40:31.407554+0000","last_became_peered":"2023-11-18T20:40:31.407554+0000","last_unstale":"2023-11-18T20:40:31.420631+0000","last_undegraded":"2023-11-18T20:40:31.420631+0000","last_fullsized":"2023-11-18T20:40:31.420631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:11.422322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393452+0000","last_change":"2023-11-18T20:40:15.354009+0000","last_active":"2023-11-18T20:40:30.393452+0000","last_peered":"2023-11-18T20:40:30.393452+0000","last_clean":"2023-11-18T20:40:30.393452+0000","last_became_active":"2023-11-18T20:40:15.352886+0000","last_became_peered":"2023-11-18T20:40:15.352886+0000","last_unstale":"2023-11-18T20:40:30.393452+0000","last_undegraded":"2023-11-18T20:40:30.393452+0000","last_fullsized":"2023-11-18T20:40:30.393452+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:23.691704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425439+0000","last_change":"2023-11-18T20:40:31.416414+0000","last_active":"2023-11-18T20:40:31.425439+0000","last_peered":"2023-11-18T20:40:31.425439+0000","last_clean":"2023-11-18T20:40:31.425439+0000","last_became_active":"2023-11-18T20:40:31.415941+0000","last_became_peered":"2023-11-18T20:40:31.415941+0000","last_unstale":"2023-11-18T20:40:31.425439+0000","last_undegraded":"2023-11-18T20:40:31.425439+0000","last_fullsized":"2023-11-18T20:40:31.425439+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:03.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.383254+0000","last_change":"2023-11-18T20:40:15.342034+0000","last_active":"2023-11-18T20:40:30.383254+0000","last_peered":"2023-11-18T20:40:30.383254+0000","last_clean":"2023-11-18T20:40:30.383254+0000","last_became_active":"2023-11-18T20:40:15.341779+0000","last_became_peered":"2023-11-18T20:40:15.341779+0000","last_unstale":"2023-11-18T20:40:30.383254+0000","last_undegraded":"2023-11-18T20:40:30.383254+0000","last_fullsized":"2023-11-18T20:40:30.383254+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:13.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.417069+0000","last_change":"2023-11-18T20:40:31.411639+0000","last_active":"2023-11-18T20:40:31.417069+0000","last_peered":"2023-11-18T20:40:31.417069+0000","last_clean":"2023-11-18T20:40:31.417069+0000","last_became_active":"2023-11-18T20:40:31.411331+0000","last_became_peered":"2023-11-18T20:40:31.411331+0000","last_unstale":"2023-11-18T20:40:31.417069+0000","last_undegraded":"2023-11-18T20:40:31.417069+0000","last_fullsized":"2023-11-18T20:40:31.417069+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:26.956962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394230+0000","last_change":"2023-11-18T20:40:15.356706+0000","last_active":"2023-11-18T20:40:30.394230+0000","last_peered":"2023-11-18T20:40:30.394230+0000","last_clean":"2023-11-18T20:40:30.394230+0000","last_became_active":"2023-11-18T20:40:15.356386+0000","last_became_peered":"2023-11-18T20:40:15.356386+0000","last_unstale":"2023-11-18T20:40:30.394230+0000","last_undegraded":"2023-11-18T20:40:30.394230+0000","last_fullsized":"2023-11-18T20:40:30.394230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:46:38.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436049+0000","last_change":"2023-11-18T20:40:31.417471+0000","last_active":"2023-11-18T20:40:31.436049+0000","last_peered":"2023-11-18T20:40:31.436049+0000","last_clean":"2023-11-18T20:40:31.436049+0000","last_became_active":"2023-11-18T20:40:31.417121+0000","last_became_peered":"2023-11-18T20:40:31.417121+0000","last_unstale":"2023-11-18T20:40:31.436049+0000","last_undegraded":"2023-11-18T20:40:31.436049+0000","last_fullsized":"2023-11-18T20:40:31.436049+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:00.284659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.386081+0000","last_change":"2023-11-18T20:40:15.352408+0000","last_active":"2023-11-18T20:40:31.386081+0000","last_peered":"2023-11-18T20:40:31.386081+0000","last_clean":"2023-11-18T20:40:31.386081+0000","last_became_active":"2023-11-18T20:40:15.351996+0000","last_became_peered":"2023-11-18T20:40:15.351996+0000","last_unstale":"2023-11-18T20:40:31.386081+0000","last_undegraded":"2023-11-18T20:40:31.386081+0000","last_fullsized":"2023-11-18T20:40:31.386081+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:05.854524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415953+0000","last_change":"2023-11-18T20:40:31.412271+0000","last_active":"2023-11-18T20:40:32.415953+0000","last_peered":"2023-11-18T20:40:32.415953+0000","last_clean":"2023-11-18T20:40:32.415953+0000","last_became_active":"2023-11-18T20:40:31.411944+0000","last_became_peered":"2023-11-18T20:40:31.411944+0000","last_unstale":"2023-11-18T20:40:32.415953+0000","last_undegraded":"2023-11-18T20:40:32.415953+0000","last_fullsized":"2023-11-18T20:40:32.415953+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:04.472128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.438404+0000","last_change":"2023-11-18T20:40:30.395822+0000","last_active":"2023-11-18T20:40:31.438404+0000","last_peered":"2023-11-18T20:40:31.438404+0000","last_clean":"2023-11-18T20:40:31.438404+0000","last_became_active":"2023-11-18T20:40:30.395333+0000","last_became_peered":"2023-11-18T20:40:30.395333+0000","last_unstale":"2023-11-18T20:40:31.438404+0000","last_undegraded":"2023-11-18T20:40:31.438404+0000","last_fullsized":"2023-11-18T20:40:31.438404+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:00:31.495644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384656+0000","last_change":"2023-11-18T20:40:15.347869+0000","last_active":"2023-11-18T20:40:31.384656+0000","last_peered":"2023-11-18T20:40:31.384656+0000","last_clean":"2023-11-18T20:40:31.384656+0000","last_became_active":"2023-11-18T20:40:15.346533+0000","last_became_peered":"2023-11-18T20:40:15.346533+0000","last_unstale":"2023-11-18T20:40:31.384656+0000","last_undegraded":"2023-11-18T20:40:31.384656+0000","last_fullsized":"2023-11-18T20:40:31.384656+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:24:48.046712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.392185+0000","last_change":"2023-11-18T20:40:14.825864+0000","last_active":"2023-11-18T20:40:31.392185+0000","last_peered":"2023-11-18T20:40:31.392185+0000","last_clean":"2023-11-18T20:40:31.392185+0000","last_became_active":"2023-11-18T20:40:14.824070+0000","last_became_peered":"2023-11-18T20:40:14.824070+0000","last_unstale":"2023-11-18T20:40:31.392185+0000","last_undegraded":"2023-11-18T20:40:31.392185+0000","last_fullsized":"2023-11-18T20:40:31.392185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:43.675287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.417624+0000","last_change":"2023-11-18T20:40:31.409612+0000","last_active":"2023-11-18T20:40:31.417624+0000","last_peered":"2023-11-18T20:40:31.417624+0000","last_clean":"2023-11-18T20:40:31.417624+0000","last_became_active":"2023-11-18T20:40:31.409364+0000","last_became_peered":"2023-11-18T20:40:31.409364+0000","last_unstale":"2023-11-18T20:40:31.417624+0000","last_undegraded":"2023-11-18T20:40:31.417624+0000","last_fullsized":"2023-11-18T20:40:31.417624+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:21.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"58'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415985+0000","last_change":"2023-11-18T20:40:30.383818+0000","last_active":"2023-11-18T20:40:32.415985+0000","last_peered":"2023-11-18T20:40:32.415985+0000","last_clean":"2023-11-18T20:40:32.415985+0000","last_became_active":"2023-11-18T20:40:30.383510+0000","last_became_peered":"2023-11-18T20:40:30.383510+0000","last_unstale":"2023-11-18T20:40:32.415985+0000","last_undegraded":"2023-11-18T20:40:32.415985+0000","last_fullsized":"2023-11-18T20:40:32.415985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:31.917046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384921+0000","last_change":"2023-11-18T20:40:15.351630+0000","last_active":"2023-11-18T20:40:31.384921+0000","last_peered":"2023-11-18T20:40:31.384921+0000","last_clean":"2023-11-18T20:40:31.384921+0000","last_became_active":"2023-11-18T20:40:15.351258+0000","last_became_peered":"2023-11-18T20:40:15.351258+0000","last_unstale":"2023-11-18T20:40:31.384921+0000","last_undegraded":"2023-11-18T20:40:31.384921+0000","last_fullsized":"2023-11-18T20:40:31.384921+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:14.293907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394903+0000","last_change":"2023-11-18T20:40:14.833864+0000","last_active":"2023-11-18T20:40:30.394903+0000","last_peered":"2023-11-18T20:40:30.394903+0000","last_clean":"2023-11-18T20:40:30.394903+0000","last_became_active":"2023-11-18T20:40:14.833570+0000","last_became_peered":"2023-11-18T20:40:14.833570+0000","last_unstale":"2023-11-18T20:40:30.394903+0000","last_undegraded":"2023-11-18T20:40:30.394903+0000","last_fullsized":"2023-11-18T20:40:30.394903+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:15.089130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435908+0000","last_change":"2023-11-18T20:40:31.416463+0000","last_active":"2023-11-18T20:40:31.435908+0000","last_peered":"2023-11-18T20:40:31.435908+0000","last_clean":"2023-11-18T20:40:31.435908+0000","last_became_active":"2023-11-18T20:40:31.416203+0000","last_became_peered":"2023-11-18T20:40:31.416203+0000","last_unstale":"2023-11-18T20:40:31.435908+0000","last_undegraded":"2023-11-18T20:40:31.435908+0000","last_fullsized":"2023-11-18T20:40:31.435908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:05:41.474591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"58'4","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415983+0000","last_change":"2023-11-18T20:40:30.391798+0000","last_active":"2023-11-18T20:40:32.415983+0000","last_peered":"2023-11-18T20:40:32.415983+0000","last_clean":"2023-11-18T20:40:32.415983+0000","last_became_active":"2023-11-18T20:40:30.389422+0000","last_became_peered":"2023-11-18T20:40:30.389422+0000","last_unstale":"2023-11-18T20:40:32.415983+0000","last_undegraded":"2023-11-18T20:40:32.415983+0000","last_fullsized":"2023-11-18T20:40:32.415983+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:08:15.052969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394381+0000","last_change":"2023-11-18T20:40:15.361548+0000","last_active":"2023-11-18T20:40:30.394381+0000","last_peered":"2023-11-18T20:40:30.394381+0000","last_clean":"2023-11-18T20:40:30.394381+0000","last_became_active":"2023-11-18T20:40:15.361199+0000","last_became_peered":"2023-11-18T20:40:15.361199+0000","last_unstale":"2023-11-18T20:40:30.394381+0000","last_undegraded":"2023-11-18T20:40:30.394381+0000","last_fullsized":"2023-11-18T20:40:30.394381+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:29.561471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384174+0000","last_change":"2023-11-18T20:40:14.833036+0000","last_active":"2023-11-18T20:40:31.384174+0000","last_peered":"2023-11-18T20:40:31.384174+0000","last_clean":"2023-11-18T20:40:31.384174+0000","last_became_active":"2023-11-18T20:40:14.831403+0000","last_became_peered":"2023-11-18T20:40:14.831403+0000","last_unstale":"2023-11-18T20:40:31.384174+0000","last_undegraded":"2023-11-18T20:40:31.384174+0000","last_fullsized":"2023-11-18T20:40:31.384174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:51:45.803351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.418958+0000","last_change":"2023-11-18T20:40:31.416599+0000","last_active":"2023-11-18T20:40:31.418958+0000","last_peered":"2023-11-18T20:40:31.418958+0000","last_clean":"2023-11-18T20:40:31.418958+0000","last_became_active":"2023-11-18T20:40:31.415532+0000","last_became_peered":"2023-11-18T20:40:31.415532+0000","last_unstale":"2023-11-18T20:40:31.418958+0000","last_undegraded":"2023-11-18T20:40:31.418958+0000","last_fullsized":"2023-11-18T20:40:31.418958+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:40.795447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.431823+0000","last_change":"2023-11-18T20:40:30.398249+0000","last_active":"2023-11-18T20:40:31.431823+0000","last_peered":"2023-11-18T20:40:31.431823+0000","last_clean":"2023-11-18T20:40:31.431823+0000","last_became_active":"2023-11-18T20:40:30.397956+0000","last_became_peered":"2023-11-18T20:40:30.397956+0000","last_unstale":"2023-11-18T20:40:31.431823+0000","last_undegraded":"2023-11-18T20:40:31.431823+0000","last_fullsized":"2023-11-18T20:40:31.431823+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:37.535432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384035+0000","last_change":"2023-11-18T20:40:15.359834+0000","last_active":"2023-11-18T20:40:31.384035+0000","last_peered":"2023-11-18T20:40:31.384035+0000","last_clean":"2023-11-18T20:40:31.384035+0000","last_became_active":"2023-11-18T20:40:15.355953+0000","last_became_peered":"2023-11-18T20:40:15.355953+0000","last_unstale":"2023-11-18T20:40:31.384035+0000","last_undegraded":"2023-11-18T20:40:31.384035+0000","last_fullsized":"2023-11-18T20:40:31.384035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:37.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388097+0000","last_change":"2023-11-18T20:40:14.827337+0000","last_active":"2023-11-18T20:40:30.388097+0000","last_peered":"2023-11-18T20:40:30.388097+0000","last_clean":"2023-11-18T20:40:30.388097+0000","last_became_active":"2023-11-18T20:40:14.826653+0000","last_became_peered":"2023-11-18T20:40:14.826653+0000","last_unstale":"2023-11-18T20:40:30.388097+0000","last_undegraded":"2023-11-18T20:40:30.388097+0000","last_fullsized":"2023-11-18T20:40:30.388097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:25:30.247203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414841+0000","last_change":"2023-11-18T20:40:31.408280+0000","last_active":"2023-11-18T20:40:32.414841+0000","last_peered":"2023-11-18T20:40:32.414841+0000","last_clean":"2023-11-18T20:40:32.414841+0000","last_became_active":"2023-11-18T20:40:31.407933+0000","last_became_peered":"2023-11-18T20:40:31.407933+0000","last_unstale":"2023-11-18T20:40:32.414841+0000","last_undegraded":"2023-11-18T20:40:32.414841+0000","last_fullsized":"2023-11-18T20:40:32.414841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:15:39.417019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415006+0000","last_change":"2023-11-18T20:40:30.388103+0000","last_active":"2023-11-18T20:40:32.415006+0000","last_peered":"2023-11-18T20:40:32.415006+0000","last_clean":"2023-11-18T20:40:32.415006+0000","last_became_active":"2023-11-18T20:40:30.387246+0000","last_became_peered":"2023-11-18T20:40:30.387246+0000","last_unstale":"2023-11-18T20:40:32.415006+0000","last_undegraded":"2023-11-18T20:40:32.415006+0000","last_fullsized":"2023-11-18T20:40:32.415006+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:18:11.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393482+0000","last_change":"2023-11-18T20:40:15.357662+0000","last_active":"2023-11-18T20:40:30.393482+0000","last_peered":"2023-11-18T20:40:30.393482+0000","last_clean":"2023-11-18T20:40:30.393482+0000","last_became_active":"2023-11-18T20:40:15.357033+0000","last_became_peered":"2023-11-18T20:40:15.357033+0000","last_unstale":"2023-11-18T20:40:30.393482+0000","last_undegraded":"2023-11-18T20:40:30.393482+0000","last_fullsized":"2023-11-18T20:40:30.393482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:27.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383249+0000","last_change":"2023-11-18T20:40:14.822926+0000","last_active":"2023-11-18T20:40:31.383249+0000","last_peered":"2023-11-18T20:40:31.383249+0000","last_clean":"2023-11-18T20:40:31.383249+0000","last_became_active":"2023-11-18T20:40:14.822593+0000","last_became_peered":"2023-11-18T20:40:14.822593+0000","last_unstale":"2023-11-18T20:40:31.383249+0000","last_undegraded":"2023-11-18T20:40:31.383249+0000","last_fullsized":"2023-11-18T20:40:31.383249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:07:12.992214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414155+0000","last_change":"2023-11-18T20:40:31.411284+0000","last_active":"2023-11-18T20:40:32.414155+0000","last_peered":"2023-11-18T20:40:32.414155+0000","last_clean":"2023-11-18T20:40:32.414155+0000","last_became_active":"2023-11-18T20:40:31.410926+0000","last_became_peered":"2023-11-18T20:40:31.410926+0000","last_unstale":"2023-11-18T20:40:32.414155+0000","last_undegraded":"2023-11-18T20:40:32.414155+0000","last_fullsized":"2023-11-18T20:40:32.414155+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:38:21.463017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.413211+0000","last_change":"2023-11-18T20:40:30.398059+0000","last_active":"2023-11-18T20:40:32.413211+0000","last_peered":"2023-11-18T20:40:32.413211+0000","last_clean":"2023-11-18T20:40:32.413211+0000","last_became_active":"2023-11-18T20:40:30.397741+0000","last_became_peered":"2023-11-18T20:40:30.397741+0000","last_unstale":"2023-11-18T20:40:32.413211+0000","last_undegraded":"2023-11-18T20:40:32.413211+0000","last_fullsized":"2023-11-18T20:40:32.413211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:38.890287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.388996+0000","last_change":"2023-11-18T20:40:15.354490+0000","last_active":"2023-11-18T20:40:31.388996+0000","last_peered":"2023-11-18T20:40:31.388996+0000","last_clean":"2023-11-18T20:40:31.388996+0000","last_became_active":"2023-11-18T20:40:15.354207+0000","last_became_peered":"2023-11-18T20:40:15.354207+0000","last_unstale":"2023-11-18T20:40:31.388996+0000","last_undegraded":"2023-11-18T20:40:31.388996+0000","last_fullsized":"2023-11-18T20:40:31.388996+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:30:22.075302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383429+0000","last_change":"2023-11-18T20:40:14.824769+0000","last_active":"2023-11-18T20:40:31.383429+0000","last_peered":"2023-11-18T20:40:31.383429+0000","last_clean":"2023-11-18T20:40:31.383429+0000","last_became_active":"2023-11-18T20:40:14.824476+0000","last_became_peered":"2023-11-18T20:40:14.824476+0000","last_unstale":"2023-11-18T20:40:31.383429+0000","last_undegraded":"2023-11-18T20:40:31.383429+0000","last_fullsized":"2023-11-18T20:40:31.383429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:09:23.933844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436486+0000","last_change":"2023-11-18T20:40:31.425000+0000","last_active":"2023-11-18T20:40:31.436486+0000","last_peered":"2023-11-18T20:40:31.436486+0000","last_clean":"2023-11-18T20:40:31.436486+0000","last_became_active":"2023-11-18T20:40:31.423234+0000","last_became_peered":"2023-11-18T20:40:31.423234+0000","last_unstale":"2023-11-18T20:40:31.436486+0000","last_undegraded":"2023-11-18T20:40:31.436486+0000","last_fullsized":"2023-11-18T20:40:31.436486+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:46.851699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"58'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.418057+0000","last_change":"2023-11-18T20:40:30.389560+0000","last_active":"2023-11-18T20:40:32.418057+0000","last_peered":"2023-11-18T20:40:32.418057+0000","last_clean":"2023-11-18T20:40:32.418057+0000","last_became_active":"2023-11-18T20:40:30.387253+0000","last_became_peered":"2023-11-18T20:40:30.387253+0000","last_unstale":"2023-11-18T20:40:32.418057+0000","last_undegraded":"2023-11-18T20:40:32.418057+0000","last_fullsized":"2023-11-18T20:40:32.418057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:02.048891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.382436+0000","last_change":"2023-11-18T20:40:15.343792+0000","last_active":"2023-11-18T20:40:31.382436+0000","last_peered":"2023-11-18T20:40:31.382436+0000","last_clean":"2023-11-18T20:40:31.382436+0000","last_became_active":"2023-11-18T20:40:15.343641+0000","last_became_peered":"2023-11-18T20:40:15.343641+0000","last_unstale":"2023-11-18T20:40:31.382436+0000","last_undegraded":"2023-11-18T20:40:31.382436+0000","last_fullsized":"2023-11-18T20:40:31.382436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:30:22.075302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382376+0000","last_change":"2023-11-18T20:40:14.824464+0000","last_active":"2023-11-18T20:40:30.382376+0000","last_peered":"2023-11-18T20:40:30.382376+0000","last_clean":"2023-11-18T20:40:30.382376+0000","last_became_active":"2023-11-18T20:40:14.824093+0000","last_became_peered":"2023-11-18T20:40:14.824093+0000","last_unstale":"2023-11-18T20:40:30.382376+0000","last_undegraded":"2023-11-18T20:40:30.382376+0000","last_fullsized":"2023-11-18T20:40:30.382376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:29.994861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415283+0000","last_change":"2023-11-18T20:40:31.411481+0000","last_active":"2023-11-18T20:40:32.415283+0000","last_peered":"2023-11-18T20:40:32.415283+0000","last_clean":"2023-11-18T20:40:32.415283+0000","last_became_active":"2023-11-18T20:40:31.411180+0000","last_became_peered":"2023-11-18T20:40:31.411180+0000","last_unstale":"2023-11-18T20:40:32.415283+0000","last_undegraded":"2023-11-18T20:40:32.415283+0000","last_fullsized":"2023-11-18T20:40:32.415283+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:22:18.584232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.438563+0000","last_change":"2023-11-18T20:40:30.387472+0000","last_active":"2023-11-18T20:40:31.438563+0000","last_peered":"2023-11-18T20:40:31.438563+0000","last_clean":"2023-11-18T20:40:31.438563+0000","last_became_active":"2023-11-18T20:40:30.387149+0000","last_became_peered":"2023-11-18T20:40:30.387149+0000","last_unstale":"2023-11-18T20:40:31.438563+0000","last_undegraded":"2023-11-18T20:40:31.438563+0000","last_fullsized":"2023-11-18T20:40:31.438563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:10:23.244504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.382511+0000","last_change":"2023-11-18T20:40:15.355962+0000","last_active":"2023-11-18T20:40:31.382511+0000","last_peered":"2023-11-18T20:40:31.382511+0000","last_clean":"2023-11-18T20:40:31.382511+0000","last_became_active":"2023-11-18T20:40:15.355647+0000","last_became_peered":"2023-11-18T20:40:15.355647+0000","last_unstale":"2023-11-18T20:40:31.382511+0000","last_undegraded":"2023-11-18T20:40:31.382511+0000","last_fullsized":"2023-11-18T20:40:31.382511+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:44.617490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378436+0000","last_change":"2023-11-18T20:40:14.826728+0000","last_active":"2023-11-18T20:40:30.378436+0000","last_peered":"2023-11-18T20:40:30.378436+0000","last_clean":"2023-11-18T20:40:30.378436+0000","last_became_active":"2023-11-18T20:40:14.826453+0000","last_became_peered":"2023-11-18T20:40:14.826453+0000","last_unstale":"2023-11-18T20:40:30.378436+0000","last_undegraded":"2023-11-18T20:40:30.378436+0000","last_fullsized":"2023-11-18T20:40:30.378436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:39:23.515944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.435830+0000","last_change":"2023-11-18T20:40:31.419955+0000","last_active":"2023-11-18T20:40:31.435830+0000","last_peered":"2023-11-18T20:40:31.435830+0000","last_clean":"2023-11-18T20:40:31.435830+0000","last_became_active":"2023-11-18T20:40:31.419446+0000","last_became_peered":"2023-11-18T20:40:31.419446+0000","last_unstale":"2023-11-18T20:40:31.435830+0000","last_undegraded":"2023-11-18T20:40:31.435830+0000","last_fullsized":"2023-11-18T20:40:31.435830+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:14:39.661260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"58'3","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.417575+0000","last_change":"2023-11-18T20:40:30.397877+0000","last_active":"2023-11-18T20:40:32.417575+0000","last_peered":"2023-11-18T20:40:32.417575+0000","last_clean":"2023-11-18T20:40:32.417575+0000","last_became_active":"2023-11-18T20:40:30.397591+0000","last_became_peered":"2023-11-18T20:40:30.397591+0000","last_unstale":"2023-11-18T20:40:32.417575+0000","last_undegraded":"2023-11-18T20:40:32.417575+0000","last_fullsized":"2023-11-18T20:40:32.417575+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:18.449109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.379662+0000","last_change":"2023-11-18T20:40:15.340229+0000","last_active":"2023-11-18T20:40:30.379662+0000","last_peered":"2023-11-18T20:40:30.379662+0000","last_clean":"2023-11-18T20:40:30.379662+0000","last_became_active":"2023-11-18T20:40:15.339486+0000","last_became_peered":"2023-11-18T20:40:15.339486+0000","last_unstale":"2023-11-18T20:40:30.379662+0000","last_undegraded":"2023-11-18T20:40:30.379662+0000","last_fullsized":"2023-11-18T20:40:30.379662+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:31.652533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.383087+0000","last_change":"2023-11-18T20:40:14.827685+0000","last_active":"2023-11-18T20:40:30.383087+0000","last_peered":"2023-11-18T20:40:30.383087+0000","last_clean":"2023-11-18T20:40:30.383087+0000","last_became_active":"2023-11-18T20:40:14.827366+0000","last_became_peered":"2023-11-18T20:40:14.827366+0000","last_unstale":"2023-11-18T20:40:30.383087+0000","last_undegraded":"2023-11-18T20:40:30.383087+0000","last_fullsized":"2023-11-18T20:40:30.383087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:55.130516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424643+0000","last_change":"2023-11-18T20:40:31.420329+0000","last_active":"2023-11-18T20:40:31.424643+0000","last_peered":"2023-11-18T20:40:31.424643+0000","last_clean":"2023-11-18T20:40:31.424643+0000","last_became_active":"2023-11-18T20:40:31.419695+0000","last_became_peered":"2023-11-18T20:40:31.419695+0000","last_unstale":"2023-11-18T20:40:31.424643+0000","last_undegraded":"2023-11-18T20:40:31.424643+0000","last_fullsized":"2023-11-18T20:40:31.424643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:50:20.825579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"58'6","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416996+0000","last_change":"2023-11-18T20:40:30.398785+0000","last_active":"2023-11-18T20:40:32.416996+0000","last_peered":"2023-11-18T20:40:32.416996+0000","last_clean":"2023-11-18T20:40:32.416996+0000","last_became_active":"2023-11-18T20:40:30.398263+0000","last_became_peered":"2023-11-18T20:40:30.398263+0000","last_unstale":"2023-11-18T20:40:32.416996+0000","last_undegraded":"2023-11-18T20:40:32.416996+0000","last_fullsized":"2023-11-18T20:40:32.416996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:39:08.307898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383995+0000","last_change":"2023-11-18T20:40:15.355620+0000","last_active":"2023-11-18T20:40:31.383995+0000","last_peered":"2023-11-18T20:40:31.383995+0000","last_clean":"2023-11-18T20:40:31.383995+0000","last_became_active":"2023-11-18T20:40:15.355354+0000","last_became_peered":"2023-11-18T20:40:15.355354+0000","last_unstale":"2023-11-18T20:40:31.383995+0000","last_undegraded":"2023-11-18T20:40:31.383995+0000","last_fullsized":"2023-11-18T20:40:31.383995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:03.431735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394095+0000","last_change":"2023-11-18T20:40:14.833810+0000","last_active":"2023-11-18T20:40:30.394095+0000","last_peered":"2023-11-18T20:40:30.394095+0000","last_clean":"2023-11-18T20:40:30.394095+0000","last_became_active":"2023-11-18T20:40:14.832447+0000","last_became_peered":"2023-11-18T20:40:14.832447+0000","last_unstale":"2023-11-18T20:40:30.394095+0000","last_undegraded":"2023-11-18T20:40:30.394095+0000","last_fullsized":"2023-11-18T20:40:30.394095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:02.417342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.428994+0000","last_change":"2023-11-18T20:40:31.422327+0000","last_active":"2023-11-18T20:40:31.428994+0000","last_peered":"2023-11-18T20:40:31.428994+0000","last_clean":"2023-11-18T20:40:31.428994+0000","last_became_active":"2023-11-18T20:40:31.422016+0000","last_became_peered":"2023-11-18T20:40:31.422016+0000","last_unstale":"2023-11-18T20:40:31.428994+0000","last_undegraded":"2023-11-18T20:40:31.428994+0000","last_fullsized":"2023-11-18T20:40:31.428994+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:56.247717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.424844+0000","last_change":"2023-11-18T20:40:30.399101+0000","last_active":"2023-11-18T20:40:31.424844+0000","last_peered":"2023-11-18T20:40:31.424844+0000","last_clean":"2023-11-18T20:40:31.424844+0000","last_became_active":"2023-11-18T20:40:30.398791+0000","last_became_peered":"2023-11-18T20:40:30.398791+0000","last_unstale":"2023-11-18T20:40:31.424844+0000","last_undegraded":"2023-11-18T20:40:31.424844+0000","last_fullsized":"2023-11-18T20:40:31.424844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:28.455197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394469+0000","last_change":"2023-11-18T20:40:15.359505+0000","last_active":"2023-11-18T20:40:30.394469+0000","last_peered":"2023-11-18T20:40:30.394469+0000","last_clean":"2023-11-18T20:40:30.394469+0000","last_became_active":"2023-11-18T20:40:15.358966+0000","last_became_peered":"2023-11-18T20:40:15.358966+0000","last_unstale":"2023-11-18T20:40:30.394469+0000","last_undegraded":"2023-11-18T20:40:30.394469+0000","last_fullsized":"2023-11-18T20:40:30.394469+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:25:51.738059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388323+0000","last_change":"2023-11-18T20:40:14.827802+0000","last_active":"2023-11-18T20:40:30.388323+0000","last_peered":"2023-11-18T20:40:30.388323+0000","last_clean":"2023-11-18T20:40:30.388323+0000","last_became_active":"2023-11-18T20:40:14.827062+0000","last_became_peered":"2023-11-18T20:40:14.827062+0000","last_unstale":"2023-11-18T20:40:30.388323+0000","last_undegraded":"2023-11-18T20:40:30.388323+0000","last_fullsized":"2023-11-18T20:40:30.388323+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:47:46.239729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.427973+0000","last_change":"2023-11-18T20:40:31.420233+0000","last_active":"2023-11-18T20:40:31.427973+0000","last_peered":"2023-11-18T20:40:31.427973+0000","last_clean":"2023-11-18T20:40:31.427973+0000","last_became_active":"2023-11-18T20:40:31.418961+0000","last_became_peered":"2023-11-18T20:40:31.418961+0000","last_unstale":"2023-11-18T20:40:31.427973+0000","last_undegraded":"2023-11-18T20:40:31.427973+0000","last_fullsized":"2023-11-18T20:40:31.427973+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:42.830879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.402325+0000","last_change":"2023-11-18T20:40:30.389403+0000","last_active":"2023-11-18T20:40:31.402325+0000","last_peered":"2023-11-18T20:40:31.402325+0000","last_clean":"2023-11-18T20:40:31.402325+0000","last_became_active":"2023-11-18T20:40:30.389101+0000","last_became_peered":"2023-11-18T20:40:30.389101+0000","last_unstale":"2023-11-18T20:40:31.402325+0000","last_undegraded":"2023-11-18T20:40:31.402325+0000","last_fullsized":"2023-11-18T20:40:31.402325+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:44.115690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388187+0000","last_change":"2023-11-18T20:40:15.350874+0000","last_active":"2023-11-18T20:40:30.388187+0000","last_peered":"2023-11-18T20:40:30.388187+0000","last_clean":"2023-11-18T20:40:30.388187+0000","last_became_active":"2023-11-18T20:40:15.350271+0000","last_became_peered":"2023-11-18T20:40:15.350271+0000","last_unstale":"2023-11-18T20:40:30.388187+0000","last_undegraded":"2023-11-18T20:40:30.388187+0000","last_fullsized":"2023-11-18T20:40:30.388187+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:51:14.162201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"55'9","reported_seq":24,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378910+0000","last_change":"2023-11-18T20:40:14.831009+0000","last_active":"2023-11-18T20:40:30.378910+0000","last_peered":"2023-11-18T20:40:30.378910+0000","last_clean":"2023-11-18T20:40:30.378910+0000","last_became_active":"2023-11-18T20:40:14.830639+0000","last_became_peered":"2023-11-18T20:40:14.830639+0000","last_unstale":"2023-11-18T20:40:30.378910+0000","last_undegraded":"2023-11-18T20:40:30.378910+0000","last_fullsized":"2023-11-18T20:40:30.378910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:20.007726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.415759+0000","last_change":"2023-11-18T20:40:31.412443+0000","last_active":"2023-11-18T20:40:31.415759+0000","last_peered":"2023-11-18T20:40:31.415759+0000","last_clean":"2023-11-18T20:40:31.415759+0000","last_became_active":"2023-11-18T20:40:31.412166+0000","last_became_peered":"2023-11-18T20:40:31.412166+0000","last_unstale":"2023-11-18T20:40:31.415759+0000","last_undegraded":"2023-11-18T20:40:31.415759+0000","last_fullsized":"2023-11-18T20:40:31.415759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:22:18.584232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.399328+0000","last_change":"2023-11-18T20:40:30.392806+0000","last_active":"2023-11-18T20:40:31.399328+0000","last_peered":"2023-11-18T20:40:31.399328+0000","last_clean":"2023-11-18T20:40:31.399328+0000","last_became_active":"2023-11-18T20:40:30.392506+0000","last_became_peered":"2023-11-18T20:40:30.392506+0000","last_unstale":"2023-11-18T20:40:31.399328+0000","last_undegraded":"2023-11-18T20:40:31.399328+0000","last_fullsized":"2023-11-18T20:40:31.399328+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:30:36.629521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382663+0000","last_change":"2023-11-18T20:40:15.354465+0000","last_active":"2023-11-18T20:40:30.382663+0000","last_peered":"2023-11-18T20:40:30.382663+0000","last_clean":"2023-11-18T20:40:30.382663+0000","last_became_active":"2023-11-18T20:40:15.354191+0000","last_became_peered":"2023-11-18T20:40:15.354191+0000","last_unstale":"2023-11-18T20:40:30.382663+0000","last_undegraded":"2023-11-18T20:40:30.382663+0000","last_fullsized":"2023-11-18T20:40:30.382663+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:18:39.504225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393647+0000","last_change":"2023-11-18T20:40:14.832793+0000","last_active":"2023-11-18T20:40:30.393647+0000","last_peered":"2023-11-18T20:40:30.393647+0000","last_clean":"2023-11-18T20:40:30.393647+0000","last_became_active":"2023-11-18T20:40:14.831869+0000","last_became_peered":"2023-11-18T20:40:14.831869+0000","last_unstale":"2023-11-18T20:40:30.393647+0000","last_undegraded":"2023-11-18T20:40:30.393647+0000","last_fullsized":"2023-11-18T20:40:30.393647+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:54.843303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.417179+0000","last_change":"2023-11-18T20:40:31.413101+0000","last_active":"2023-11-18T20:40:31.417179+0000","last_peered":"2023-11-18T20:40:31.417179+0000","last_clean":"2023-11-18T20:40:31.417179+0000","last_became_active":"2023-11-18T20:40:31.412809+0000","last_became_peered":"2023-11-18T20:40:31.412809+0000","last_unstale":"2023-11-18T20:40:31.417179+0000","last_undegraded":"2023-11-18T20:40:31.417179+0000","last_fullsized":"2023-11-18T20:40:31.417179+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:34.596489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"58'8","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.439413+0000","last_change":"2023-11-18T20:40:30.385446+0000","last_active":"2023-11-18T20:40:31.439413+0000","last_peered":"2023-11-18T20:40:31.439413+0000","last_clean":"2023-11-18T20:40:31.439413+0000","last_became_active":"2023-11-18T20:40:30.385174+0000","last_became_peered":"2023-11-18T20:40:30.385174+0000","last_unstale":"2023-11-18T20:40:31.439413+0000","last_undegraded":"2023-11-18T20:40:31.439413+0000","last_fullsized":"2023-11-18T20:40:31.439413+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:07:28.560825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383214+0000","last_change":"2023-11-18T20:40:15.343712+0000","last_active":"2023-11-18T20:40:31.383214+0000","last_peered":"2023-11-18T20:40:31.383214+0000","last_clean":"2023-11-18T20:40:31.383214+0000","last_became_active":"2023-11-18T20:40:15.343433+0000","last_became_peered":"2023-11-18T20:40:15.343433+0000","last_unstale":"2023-11-18T20:40:31.383214+0000","last_undegraded":"2023-11-18T20:40:31.383214+0000","last_fullsized":"2023-11-18T20:40:31.383214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:10:08.690285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.383351+0000","last_change":"2023-11-18T20:40:14.821052+0000","last_active":"2023-11-18T20:40:30.383351+0000","last_peered":"2023-11-18T20:40:30.383351+0000","last_clean":"2023-11-18T20:40:30.383351+0000","last_became_active":"2023-11-18T20:40:14.820746+0000","last_became_peered":"2023-11-18T20:40:14.820746+0000","last_unstale":"2023-11-18T20:40:30.383351+0000","last_undegraded":"2023-11-18T20:40:30.383351+0000","last_fullsized":"2023-11-18T20:40:30.383351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:48.332445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414994+0000","last_change":"2023-11-18T20:40:31.396427+0000","last_active":"2023-11-18T20:40:32.414994+0000","last_peered":"2023-11-18T20:40:32.414994+0000","last_clean":"2023-11-18T20:40:32.414994+0000","last_became_active":"2023-11-18T20:40:31.395525+0000","last_became_peered":"2023-11-18T20:40:31.395525+0000","last_unstale":"2023-11-18T20:40:32.414994+0000","last_undegraded":"2023-11-18T20:40:32.414994+0000","last_fullsized":"2023-11-18T20:40:32.414994+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:01:17.157383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"58'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415685+0000","last_change":"2023-11-18T20:40:30.393560+0000","last_active":"2023-11-18T20:40:32.415685+0000","last_peered":"2023-11-18T20:40:32.415685+0000","last_clean":"2023-11-18T20:40:32.415685+0000","last_became_active":"2023-11-18T20:40:30.393256+0000","last_became_peered":"2023-11-18T20:40:30.393256+0000","last_unstale":"2023-11-18T20:40:32.415685+0000","last_undegraded":"2023-11-18T20:40:32.415685+0000","last_fullsized":"2023-11-18T20:40:32.415685+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:59:50.932334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.381417+0000","last_change":"2023-11-18T20:40:15.345010+0000","last_active":"2023-11-18T20:40:30.381417+0000","last_peered":"2023-11-18T20:40:30.381417+0000","last_clean":"2023-11-18T20:40:30.381417+0000","last_became_active":"2023-11-18T20:40:15.344217+0000","last_became_peered":"2023-11-18T20:40:15.344217+0000","last_unstale":"2023-11-18T20:40:30.381417+0000","last_undegraded":"2023-11-18T20:40:30.381417+0000","last_fullsized":"2023-11-18T20:40:30.381417+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:46:38.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382669+0000","last_change":"2023-11-18T20:40:14.819105+0000","last_active":"2023-11-18T20:40:30.382669+0000","last_peered":"2023-11-18T20:40:30.382669+0000","last_clean":"2023-11-18T20:40:30.382669+0000","last_became_active":"2023-11-18T20:40:14.818836+0000","last_became_peered":"2023-11-18T20:40:14.818836+0000","last_unstale":"2023-11-18T20:40:30.382669+0000","last_undegraded":"2023-11-18T20:40:30.382669+0000","last_fullsized":"2023-11-18T20:40:30.382669+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:45.745180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.416141+0000","last_change":"2023-11-18T20:40:31.411253+0000","last_active":"2023-11-18T20:40:31.416141+0000","last_peered":"2023-11-18T20:40:31.416141+0000","last_clean":"2023-11-18T20:40:31.416141+0000","last_became_active":"2023-11-18T20:40:31.410897+0000","last_became_peered":"2023-11-18T20:40:31.410897+0000","last_unstale":"2023-11-18T20:40:31.416141+0000","last_undegraded":"2023-11-18T20:40:31.416141+0000","last_fullsized":"2023-11-18T20:40:31.416141+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:37:26.956962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.402695+0000","last_change":"2023-11-18T20:40:30.396563+0000","last_active":"2023-11-18T20:40:31.402695+0000","last_peered":"2023-11-18T20:40:31.402695+0000","last_clean":"2023-11-18T20:40:31.402695+0000","last_became_active":"2023-11-18T20:40:30.395763+0000","last_became_peered":"2023-11-18T20:40:30.395763+0000","last_unstale":"2023-11-18T20:40:31.402695+0000","last_undegraded":"2023-11-18T20:40:31.402695+0000","last_fullsized":"2023-11-18T20:40:31.402695+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:05.657002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382582+0000","last_change":"2023-11-18T20:40:15.357869+0000","last_active":"2023-11-18T20:40:30.382582+0000","last_peered":"2023-11-18T20:40:30.382582+0000","last_clean":"2023-11-18T20:40:30.382582+0000","last_became_active":"2023-11-18T20:40:15.355608+0000","last_became_peered":"2023-11-18T20:40:15.355608+0000","last_unstale":"2023-11-18T20:40:30.382582+0000","last_undegraded":"2023-11-18T20:40:30.382582+0000","last_fullsized":"2023-11-18T20:40:30.382582+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:16:43.686758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382812+0000","last_change":"2023-11-18T20:40:14.816928+0000","last_active":"2023-11-18T20:40:30.382812+0000","last_peered":"2023-11-18T20:40:30.382812+0000","last_clean":"2023-11-18T20:40:30.382812+0000","last_became_active":"2023-11-18T20:40:14.816652+0000","last_became_peered":"2023-11-18T20:40:14.816652+0000","last_unstale":"2023-11-18T20:40:30.382812+0000","last_undegraded":"2023-11-18T20:40:30.382812+0000","last_fullsized":"2023-11-18T20:40:30.382812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:55.852659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.423321+0000","last_change":"2023-11-18T20:40:31.417979+0000","last_active":"2023-11-18T20:40:31.423321+0000","last_peered":"2023-11-18T20:40:31.423321+0000","last_clean":"2023-11-18T20:40:31.423321+0000","last_became_active":"2023-11-18T20:40:31.417110+0000","last_became_peered":"2023-11-18T20:40:31.417110+0000","last_unstale":"2023-11-18T20:40:31.423321+0000","last_undegraded":"2023-11-18T20:40:31.423321+0000","last_fullsized":"2023-11-18T20:40:31.423321+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:19.240547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.439254+0000","last_change":"2023-11-18T20:40:30.392190+0000","last_active":"2023-11-18T20:40:31.439254+0000","last_peered":"2023-11-18T20:40:31.439254+0000","last_clean":"2023-11-18T20:40:31.439254+0000","last_became_active":"2023-11-18T20:40:30.391903+0000","last_became_peered":"2023-11-18T20:40:30.391903+0000","last_unstale":"2023-11-18T20:40:31.439254+0000","last_undegraded":"2023-11-18T20:40:31.439254+0000","last_fullsized":"2023-11-18T20:40:31.439254+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:23:54.558014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384099+0000","last_change":"2023-11-18T20:40:15.355385+0000","last_active":"2023-11-18T20:40:31.384099+0000","last_peered":"2023-11-18T20:40:31.384099+0000","last_clean":"2023-11-18T20:40:31.384099+0000","last_became_active":"2023-11-18T20:40:15.355098+0000","last_became_peered":"2023-11-18T20:40:15.355098+0000","last_unstale":"2023-11-18T20:40:31.384099+0000","last_undegraded":"2023-11-18T20:40:31.384099+0000","last_fullsized":"2023-11-18T20:40:31.384099+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:51:14.523181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.396063+0000","last_change":"2023-11-18T20:40:14.834099+0000","last_active":"2023-11-18T20:40:30.396063+0000","last_peered":"2023-11-18T20:40:30.396063+0000","last_clean":"2023-11-18T20:40:30.396063+0000","last_became_active":"2023-11-18T20:40:14.833825+0000","last_became_peered":"2023-11-18T20:40:14.833825+0000","last_unstale":"2023-11-18T20:40:30.396063+0000","last_undegraded":"2023-11-18T20:40:30.396063+0000","last_fullsized":"2023-11-18T20:40:30.396063+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:29.994861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.437338+0000","last_change":"2023-11-18T20:40:31.436613+0000","last_active":"2023-11-18T20:40:31.437338+0000","last_peered":"2023-11-18T20:40:31.437338+0000","last_clean":"2023-11-18T20:40:31.437338+0000","last_became_active":"2023-11-18T20:40:31.436222+0000","last_became_peered":"2023-11-18T20:40:31.436222+0000","last_unstale":"2023-11-18T20:40:31.437338+0000","last_undegraded":"2023-11-18T20:40:31.437338+0000","last_fullsized":"2023-11-18T20:40:31.437338+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:28.256207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416186+0000","last_change":"2023-11-18T20:40:30.377213+0000","last_active":"2023-11-18T20:40:32.416186+0000","last_peered":"2023-11-18T20:40:32.416186+0000","last_clean":"2023-11-18T20:40:32.416186+0000","last_became_active":"2023-11-18T20:40:30.376906+0000","last_became_peered":"2023-11-18T20:40:30.376906+0000","last_unstale":"2023-11-18T20:40:32.416186+0000","last_undegraded":"2023-11-18T20:40:32.416186+0000","last_fullsized":"2023-11-18T20:40:32.416186+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:38:20.452609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384214+0000","last_change":"2023-11-18T20:40:15.357460+0000","last_active":"2023-11-18T20:40:31.384214+0000","last_peered":"2023-11-18T20:40:31.384214+0000","last_clean":"2023-11-18T20:40:31.384214+0000","last_became_active":"2023-11-18T20:40:15.355817+0000","last_became_peered":"2023-11-18T20:40:15.355817+0000","last_unstale":"2023-11-18T20:40:31.384214+0000","last_undegraded":"2023-11-18T20:40:31.384214+0000","last_fullsized":"2023-11-18T20:40:31.384214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:34:55.857695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394184+0000","last_change":"2023-11-18T20:40:14.832158+0000","last_active":"2023-11-18T20:40:30.394184+0000","last_peered":"2023-11-18T20:40:30.394184+0000","last_clean":"2023-11-18T20:40:30.394184+0000","last_became_active":"2023-11-18T20:40:14.831853+0000","last_became_peered":"2023-11-18T20:40:14.831853+0000","last_unstale":"2023-11-18T20:40:30.394184+0000","last_undegraded":"2023-11-18T20:40:30.394184+0000","last_fullsized":"2023-11-18T20:40:30.394184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:51:13.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.426031+0000","last_change":"2023-11-18T20:40:31.417701+0000","last_active":"2023-11-18T20:40:31.426031+0000","last_peered":"2023-11-18T20:40:31.426031+0000","last_clean":"2023-11-18T20:40:31.426031+0000","last_became_active":"2023-11-18T20:40:31.417314+0000","last_became_peered":"2023-11-18T20:40:31.417314+0000","last_unstale":"2023-11-18T20:40:31.426031+0000","last_undegraded":"2023-11-18T20:40:31.426031+0000","last_fullsized":"2023-11-18T20:40:31.426031+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:39.256330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.439152+0000","last_change":"2023-11-18T20:40:30.394894+0000","last_active":"2023-11-18T20:40:31.439152+0000","last_peered":"2023-11-18T20:40:31.439152+0000","last_clean":"2023-11-18T20:40:31.439152+0000","last_became_active":"2023-11-18T20:40:30.394376+0000","last_became_peered":"2023-11-18T20:40:30.394376+0000","last_unstale":"2023-11-18T20:40:31.439152+0000","last_undegraded":"2023-11-18T20:40:31.439152+0000","last_fullsized":"2023-11-18T20:40:31.439152+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:50.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394676+0000","last_change":"2023-11-18T20:40:15.358307+0000","last_active":"2023-11-18T20:40:30.394676+0000","last_peered":"2023-11-18T20:40:30.394676+0000","last_clean":"2023-11-18T20:40:30.394676+0000","last_became_active":"2023-11-18T20:40:15.357876+0000","last_became_peered":"2023-11-18T20:40:15.357876+0000","last_unstale":"2023-11-18T20:40:30.394676+0000","last_undegraded":"2023-11-18T20:40:30.394676+0000","last_fullsized":"2023-11-18T20:40:30.394676+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:20:37.917813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.385117+0000","last_change":"2023-11-18T20:40:14.831548+0000","last_active":"2023-11-18T20:40:31.385117+0000","last_peered":"2023-11-18T20:40:31.385117+0000","last_clean":"2023-11-18T20:40:31.385117+0000","last_became_active":"2023-11-18T20:40:14.831302+0000","last_became_peered":"2023-11-18T20:40:14.831302+0000","last_unstale":"2023-11-18T20:40:31.385117+0000","last_undegraded":"2023-11-18T20:40:31.385117+0000","last_fullsized":"2023-11-18T20:40:31.385117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:24.216427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.420958+0000","last_change":"2023-11-18T20:40:31.411900+0000","last_active":"2023-11-18T20:40:31.420958+0000","last_peered":"2023-11-18T20:40:31.420958+0000","last_clean":"2023-11-18T20:40:31.420958+0000","last_became_active":"2023-11-18T20:40:31.411602+0000","last_became_peered":"2023-11-18T20:40:31.411602+0000","last_unstale":"2023-11-18T20:40:31.420958+0000","last_undegraded":"2023-11-18T20:40:31.420958+0000","last_fullsized":"2023-11-18T20:40:31.420958+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:43:33.022688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436705+0000","last_change":"2023-11-18T20:40:30.385639+0000","last_active":"2023-11-18T20:40:31.436705+0000","last_peered":"2023-11-18T20:40:31.436705+0000","last_clean":"2023-11-18T20:40:31.436705+0000","last_became_active":"2023-11-18T20:40:30.385377+0000","last_became_peered":"2023-11-18T20:40:30.385377+0000","last_unstale":"2023-11-18T20:40:31.436705+0000","last_undegraded":"2023-11-18T20:40:31.436705+0000","last_fullsized":"2023-11-18T20:40:31.436705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:18.449109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.388273+0000","last_change":"2023-11-18T20:40:15.357107+0000","last_active":"2023-11-18T20:40:30.388273+0000","last_peered":"2023-11-18T20:40:30.388273+0000","last_clean":"2023-11-18T20:40:30.388273+0000","last_became_active":"2023-11-18T20:40:15.356852+0000","last_became_peered":"2023-11-18T20:40:15.356852+0000","last_unstale":"2023-11-18T20:40:30.388273+0000","last_undegraded":"2023-11-18T20:40:30.388273+0000","last_fullsized":"2023-11-18T20:40:30.388273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:07.057091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394590+0000","last_change":"2023-11-18T20:40:14.830198+0000","last_active":"2023-11-18T20:40:30.394590+0000","last_peered":"2023-11-18T20:40:30.394590+0000","last_clean":"2023-11-18T20:40:30.394590+0000","last_became_active":"2023-11-18T20:40:14.829922+0000","last_became_peered":"2023-11-18T20:40:14.829922+0000","last_unstale":"2023-11-18T20:40:30.394590+0000","last_undegraded":"2023-11-18T20:40:30.394590+0000","last_fullsized":"2023-11-18T20:40:30.394590+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:37.429611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414929+0000","last_change":"2023-11-18T20:40:31.393091+0000","last_active":"2023-11-18T20:40:32.414929+0000","last_peered":"2023-11-18T20:40:32.414929+0000","last_clean":"2023-11-18T20:40:32.414929+0000","last_became_active":"2023-11-18T20:40:31.392505+0000","last_became_peered":"2023-11-18T20:40:31.392505+0000","last_unstale":"2023-11-18T20:40:32.414929+0000","last_undegraded":"2023-11-18T20:40:32.414929+0000","last_fullsized":"2023-11-18T20:40:32.414929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:43:18.803857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.401827+0000","last_change":"2023-11-18T20:40:30.390110+0000","last_active":"2023-11-18T20:40:31.401827+0000","last_peered":"2023-11-18T20:40:31.401827+0000","last_clean":"2023-11-18T20:40:31.401827+0000","last_became_active":"2023-11-18T20:40:30.389821+0000","last_became_peered":"2023-11-18T20:40:30.389821+0000","last_unstale":"2023-11-18T20:40:31.401827+0000","last_undegraded":"2023-11-18T20:40:31.401827+0000","last_fullsized":"2023-11-18T20:40:31.401827+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:27:06.059361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382764+0000","last_change":"2023-11-18T20:40:15.352716+0000","last_active":"2023-11-18T20:40:30.382764+0000","last_peered":"2023-11-18T20:40:30.382764+0000","last_clean":"2023-11-18T20:40:30.382764+0000","last_became_active":"2023-11-18T20:40:15.352413+0000","last_became_peered":"2023-11-18T20:40:15.352413+0000","last_unstale":"2023-11-18T20:40:30.382764+0000","last_undegraded":"2023-11-18T20:40:30.382764+0000","last_fullsized":"2023-11-18T20:40:30.382764+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:15:33.663727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.389078+0000","last_change":"2023-11-18T20:40:14.820194+0000","last_active":"2023-11-18T20:40:31.389078+0000","last_peered":"2023-11-18T20:40:31.389078+0000","last_clean":"2023-11-18T20:40:31.389078+0000","last_became_active":"2023-11-18T20:40:14.819684+0000","last_became_peered":"2023-11-18T20:40:14.819684+0000","last_unstale":"2023-11-18T20:40:31.389078+0000","last_undegraded":"2023-11-18T20:40:31.389078+0000","last_fullsized":"2023-11-18T20:40:31.389078+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:30.638140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414228+0000","last_change":"2023-11-18T20:40:31.405203+0000","last_active":"2023-11-18T20:40:32.414228+0000","last_peered":"2023-11-18T20:40:32.414228+0000","last_clean":"2023-11-18T20:40:32.414228+0000","last_became_active":"2023-11-18T20:40:31.404741+0000","last_became_peered":"2023-11-18T20:40:31.404741+0000","last_unstale":"2023-11-18T20:40:32.414228+0000","last_undegraded":"2023-11-18T20:40:32.414228+0000","last_fullsized":"2023-11-18T20:40:32.414228+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:14:26.091354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.409451+0000","last_change":"2023-11-18T20:40:30.390317+0000","last_active":"2023-11-18T20:40:31.409451+0000","last_peered":"2023-11-18T20:40:31.409451+0000","last_clean":"2023-11-18T20:40:31.409451+0000","last_became_active":"2023-11-18T20:40:30.390049+0000","last_became_peered":"2023-11-18T20:40:30.390049+0000","last_unstale":"2023-11-18T20:40:31.409451+0000","last_undegraded":"2023-11-18T20:40:31.409451+0000","last_fullsized":"2023-11-18T20:40:31.409451+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:16.341435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393552+0000","last_change":"2023-11-18T20:40:15.352432+0000","last_active":"2023-11-18T20:40:30.393552+0000","last_peered":"2023-11-18T20:40:30.393552+0000","last_clean":"2023-11-18T20:40:30.393552+0000","last_became_active":"2023-11-18T20:40:15.352146+0000","last_became_peered":"2023-11-18T20:40:15.352146+0000","last_unstale":"2023-11-18T20:40:30.393552+0000","last_undegraded":"2023-11-18T20:40:30.393552+0000","last_fullsized":"2023-11-18T20:40:30.393552+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:47.494672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393595+0000","last_change":"2023-11-18T20:40:14.828458+0000","last_active":"2023-11-18T20:40:30.393595+0000","last_peered":"2023-11-18T20:40:30.393595+0000","last_clean":"2023-11-18T20:40:30.393595+0000","last_became_active":"2023-11-18T20:40:14.828170+0000","last_became_peered":"2023-11-18T20:40:14.828170+0000","last_unstale":"2023-11-18T20:40:30.393595+0000","last_undegraded":"2023-11-18T20:40:30.393595+0000","last_fullsized":"2023-11-18T20:40:30.393595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:56:30.127554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416254+0000","last_change":"2023-11-18T20:40:31.410062+0000","last_active":"2023-11-18T20:40:32.416254+0000","last_peered":"2023-11-18T20:40:32.416254+0000","last_clean":"2023-11-18T20:40:32.416254+0000","last_became_active":"2023-11-18T20:40:31.405883+0000","last_became_peered":"2023-11-18T20:40:31.405883+0000","last_unstale":"2023-11-18T20:40:32.416254+0000","last_undegraded":"2023-11-18T20:40:32.416254+0000","last_fullsized":"2023-11-18T20:40:32.416254+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:11:23.971990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414957+0000","last_change":"2023-11-18T20:40:30.384416+0000","last_active":"2023-11-18T20:40:32.414957+0000","last_peered":"2023-11-18T20:40:32.414957+0000","last_clean":"2023-11-18T20:40:32.414957+0000","last_became_active":"2023-11-18T20:40:30.383677+0000","last_became_peered":"2023-11-18T20:40:30.383677+0000","last_unstale":"2023-11-18T20:40:32.414957+0000","last_undegraded":"2023-11-18T20:40:32.414957+0000","last_fullsized":"2023-11-18T20:40:32.414957+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:55:18.355693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392462+0000","last_change":"2023-11-18T20:40:15.349261+0000","last_active":"2023-11-18T20:40:30.392462+0000","last_peered":"2023-11-18T20:40:30.392462+0000","last_clean":"2023-11-18T20:40:30.392462+0000","last_became_active":"2023-11-18T20:40:15.346287+0000","last_became_peered":"2023-11-18T20:40:15.346287+0000","last_unstale":"2023-11-18T20:40:30.392462+0000","last_undegraded":"2023-11-18T20:40:30.392462+0000","last_fullsized":"2023-11-18T20:40:30.392462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:43:17.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.381559+0000","last_change":"2023-11-18T20:40:14.828962+0000","last_active":"2023-11-18T20:40:30.381559+0000","last_peered":"2023-11-18T20:40:30.381559+0000","last_clean":"2023-11-18T20:40:30.381559+0000","last_became_active":"2023-11-18T20:40:14.828681+0000","last_became_peered":"2023-11-18T20:40:14.828681+0000","last_unstale":"2023-11-18T20:40:30.381559+0000","last_undegraded":"2023-11-18T20:40:30.381559+0000","last_fullsized":"2023-11-18T20:40:30.381559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:21:19.606979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.420900+0000","last_change":"2023-11-18T20:40:31.411458+0000","last_active":"2023-11-18T20:40:31.420900+0000","last_peered":"2023-11-18T20:40:31.420900+0000","last_clean":"2023-11-18T20:40:31.420900+0000","last_became_active":"2023-11-18T20:40:31.411147+0000","last_became_peered":"2023-11-18T20:40:31.411147+0000","last_unstale":"2023-11-18T20:40:31.420900+0000","last_undegraded":"2023-11-18T20:40:31.420900+0000","last_fullsized":"2023-11-18T20:40:31.420900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:15:34.551660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.417742+0000","last_change":"2023-11-18T20:40:30.394216+0000","last_active":"2023-11-18T20:40:32.417742+0000","last_peered":"2023-11-18T20:40:32.417742+0000","last_clean":"2023-11-18T20:40:32.417742+0000","last_became_active":"2023-11-18T20:40:30.393934+0000","last_became_peered":"2023-11-18T20:40:30.393934+0000","last_unstale":"2023-11-18T20:40:32.417742+0000","last_undegraded":"2023-11-18T20:40:32.417742+0000","last_fullsized":"2023-11-18T20:40:32.417742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:23:54.558014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384318+0000","last_change":"2023-11-18T20:40:15.354747+0000","last_active":"2023-11-18T20:40:31.384318+0000","last_peered":"2023-11-18T20:40:31.384318+0000","last_clean":"2023-11-18T20:40:31.384318+0000","last_became_active":"2023-11-18T20:40:15.354502+0000","last_became_peered":"2023-11-18T20:40:15.354502+0000","last_unstale":"2023-11-18T20:40:31.384318+0000","last_undegraded":"2023-11-18T20:40:31.384318+0000","last_fullsized":"2023-11-18T20:40:31.384318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:38.444004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395817+0000","last_change":"2023-11-18T20:40:14.834889+0000","last_active":"2023-11-18T20:40:30.395817+0000","last_peered":"2023-11-18T20:40:30.395817+0000","last_clean":"2023-11-18T20:40:30.395817+0000","last_became_active":"2023-11-18T20:40:14.834576+0000","last_became_peered":"2023-11-18T20:40:14.834576+0000","last_unstale":"2023-11-18T20:40:30.395817+0000","last_undegraded":"2023-11-18T20:40:30.395817+0000","last_fullsized":"2023-11-18T20:40:30.395817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.426440+0000","last_change":"2023-11-18T20:40:31.414801+0000","last_active":"2023-11-18T20:40:31.426440+0000","last_peered":"2023-11-18T20:40:31.426440+0000","last_clean":"2023-11-18T20:40:31.426440+0000","last_became_active":"2023-11-18T20:40:31.414563+0000","last_became_peered":"2023-11-18T20:40:31.414563+0000","last_unstale":"2023-11-18T20:40:31.426440+0000","last_undegraded":"2023-11-18T20:40:31.426440+0000","last_fullsized":"2023-11-18T20:40:31.426440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:44:00.254306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.415713+0000","last_change":"2023-11-18T20:40:30.389479+0000","last_active":"2023-11-18T20:40:32.415713+0000","last_peered":"2023-11-18T20:40:32.415713+0000","last_clean":"2023-11-18T20:40:32.415713+0000","last_became_active":"2023-11-18T20:40:30.389201+0000","last_became_peered":"2023-11-18T20:40:30.389201+0000","last_unstale":"2023-11-18T20:40:32.415713+0000","last_undegraded":"2023-11-18T20:40:32.415713+0000","last_fullsized":"2023-11-18T20:40:32.415713+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:44.115690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384421+0000","last_change":"2023-11-18T20:40:15.348518+0000","last_active":"2023-11-18T20:40:31.384421+0000","last_peered":"2023-11-18T20:40:31.384421+0000","last_clean":"2023-11-18T20:40:31.384421+0000","last_became_active":"2023-11-18T20:40:15.348248+0000","last_became_peered":"2023-11-18T20:40:15.348248+0000","last_unstale":"2023-11-18T20:40:31.384421+0000","last_undegraded":"2023-11-18T20:40:31.384421+0000","last_fullsized":"2023-11-18T20:40:31.384421+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:07.483048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"55'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384739+0000","last_change":"2023-11-18T20:40:14.827087+0000","last_active":"2023-11-18T20:40:31.384739+0000","last_peered":"2023-11-18T20:40:31.384739+0000","last_clean":"2023-11-18T20:40:31.384739+0000","last_became_active":"2023-11-18T20:40:14.826756+0000","last_became_peered":"2023-11-18T20:40:14.826756+0000","last_unstale":"2023-11-18T20:40:31.384739+0000","last_undegraded":"2023-11-18T20:40:31.384739+0000","last_fullsized":"2023-11-18T20:40:31.384739+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:44:23.259634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.416084+0000","last_change":"2023-11-18T20:40:31.413669+0000","last_active":"2023-11-18T20:40:31.416084+0000","last_peered":"2023-11-18T20:40:31.416084+0000","last_clean":"2023-11-18T20:40:31.416084+0000","last_became_active":"2023-11-18T20:40:31.413040+0000","last_became_peered":"2023-11-18T20:40:31.413040+0000","last_unstale":"2023-11-18T20:40:31.416084+0000","last_undegraded":"2023-11-18T20:40:31.416084+0000","last_fullsized":"2023-11-18T20:40:31.416084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:24.444189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.439109+0000","last_change":"2023-11-18T20:40:30.390651+0000","last_active":"2023-11-18T20:40:31.439109+0000","last_peered":"2023-11-18T20:40:31.439109+0000","last_clean":"2023-11-18T20:40:31.439109+0000","last_became_active":"2023-11-18T20:40:30.390293+0000","last_became_peered":"2023-11-18T20:40:30.390293+0000","last_unstale":"2023-11-18T20:40:31.439109+0000","last_undegraded":"2023-11-18T20:40:31.439109+0000","last_fullsized":"2023-11-18T20:40:31.439109+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:17.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.395321+0000","last_change":"2023-11-18T20:40:15.363781+0000","last_active":"2023-11-18T20:40:30.395321+0000","last_peered":"2023-11-18T20:40:30.395321+0000","last_clean":"2023-11-18T20:40:30.395321+0000","last_became_active":"2023-11-18T20:40:15.363178+0000","last_became_peered":"2023-11-18T20:40:15.363178+0000","last_unstale":"2023-11-18T20:40:30.395321+0000","last_undegraded":"2023-11-18T20:40:30.395321+0000","last_fullsized":"2023-11-18T20:40:30.395321+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:10.272018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382794+0000","last_change":"2023-11-18T20:40:14.830237+0000","last_active":"2023-11-18T20:40:30.382794+0000","last_peered":"2023-11-18T20:40:30.382794+0000","last_clean":"2023-11-18T20:40:30.382794+0000","last_became_active":"2023-11-18T20:40:14.829895+0000","last_became_peered":"2023-11-18T20:40:14.829895+0000","last_unstale":"2023-11-18T20:40:30.382794+0000","last_undegraded":"2023-11-18T20:40:30.382794+0000","last_fullsized":"2023-11-18T20:40:30.382794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.416087+0000","last_change":"2023-11-18T20:40:31.407783+0000","last_active":"2023-11-18T20:40:31.416087+0000","last_peered":"2023-11-18T20:40:31.416087+0000","last_clean":"2023-11-18T20:40:31.416087+0000","last_became_active":"2023-11-18T20:40:31.406619+0000","last_became_peered":"2023-11-18T20:40:31.406619+0000","last_unstale":"2023-11-18T20:40:31.416087+0000","last_undegraded":"2023-11-18T20:40:31.416087+0000","last_fullsized":"2023-11-18T20:40:31.416087+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:47.217160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.422142+0000","last_change":"2023-11-18T20:40:30.389209+0000","last_active":"2023-11-18T20:40:31.422142+0000","last_peered":"2023-11-18T20:40:31.422142+0000","last_clean":"2023-11-18T20:40:31.422142+0000","last_became_active":"2023-11-18T20:40:30.385645+0000","last_became_peered":"2023-11-18T20:40:30.385645+0000","last_unstale":"2023-11-18T20:40:31.422142+0000","last_undegraded":"2023-11-18T20:40:31.422142+0000","last_fullsized":"2023-11-18T20:40:31.422142+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:49.010844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.393910+0000","last_change":"2023-11-18T20:40:15.346282+0000","last_active":"2023-11-18T20:40:30.393910+0000","last_peered":"2023-11-18T20:40:30.393910+0000","last_clean":"2023-11-18T20:40:30.393910+0000","last_became_active":"2023-11-18T20:40:15.345731+0000","last_became_peered":"2023-11-18T20:40:15.345731+0000","last_unstale":"2023-11-18T20:40:30.393910+0000","last_undegraded":"2023-11-18T20:40:30.393910+0000","last_fullsized":"2023-11-18T20:40:30.393910+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:03.894891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.384619+0000","last_change":"2023-11-18T20:40:14.823740+0000","last_active":"2023-11-18T20:40:31.384619+0000","last_peered":"2023-11-18T20:40:31.384619+0000","last_clean":"2023-11-18T20:40:31.384619+0000","last_became_active":"2023-11-18T20:40:14.823071+0000","last_became_peered":"2023-11-18T20:40:14.823071+0000","last_unstale":"2023-11-18T20:40:31.384619+0000","last_undegraded":"2023-11-18T20:40:31.384619+0000","last_fullsized":"2023-11-18T20:40:31.384619+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:30.638140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.416884+0000","last_change":"2023-11-18T20:40:31.410915+0000","last_active":"2023-11-18T20:40:32.416884+0000","last_peered":"2023-11-18T20:40:32.416884+0000","last_clean":"2023-11-18T20:40:32.416884+0000","last_became_active":"2023-11-18T20:40:31.410596+0000","last_became_peered":"2023-11-18T20:40:31.410596+0000","last_unstale":"2023-11-18T20:40:32.416884+0000","last_undegraded":"2023-11-18T20:40:32.416884+0000","last_fullsized":"2023-11-18T20:40:32.416884+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:06.286330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.402390+0000","last_change":"2023-11-18T20:40:30.388330+0000","last_active":"2023-11-18T20:40:31.402390+0000","last_peered":"2023-11-18T20:40:31.402390+0000","last_clean":"2023-11-18T20:40:31.402390+0000","last_became_active":"2023-11-18T20:40:30.387901+0000","last_became_peered":"2023-11-18T20:40:30.387901+0000","last_unstale":"2023-11-18T20:40:31.402390+0000","last_undegraded":"2023-11-18T20:40:31.402390+0000","last_fullsized":"2023-11-18T20:40:31.402390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:26:06.292277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.383170+0000","last_change":"2023-11-18T20:40:15.345339+0000","last_active":"2023-11-18T20:40:31.383170+0000","last_peered":"2023-11-18T20:40:31.383170+0000","last_clean":"2023-11-18T20:40:31.383170+0000","last_became_active":"2023-11-18T20:40:15.345007+0000","last_became_peered":"2023-11-18T20:40:15.345007+0000","last_unstale":"2023-11-18T20:40:31.383170+0000","last_undegraded":"2023-11-18T20:40:31.383170+0000","last_fullsized":"2023-11-18T20:40:31.383170+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:30:28.760969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394503+0000","last_change":"2023-11-18T20:40:14.833918+0000","last_active":"2023-11-18T20:40:30.394503+0000","last_peered":"2023-11-18T20:40:30.394503+0000","last_clean":"2023-11-18T20:40:30.394503+0000","last_became_active":"2023-11-18T20:40:14.833631+0000","last_became_peered":"2023-11-18T20:40:14.833631+0000","last_unstale":"2023-11-18T20:40:30.394503+0000","last_undegraded":"2023-11-18T20:40:30.394503+0000","last_fullsized":"2023-11-18T20:40:30.394503+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:42:45.782573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425406+0000","last_change":"2023-11-18T20:40:31.417031+0000","last_active":"2023-11-18T20:40:31.425406+0000","last_peered":"2023-11-18T20:40:31.425406+0000","last_clean":"2023-11-18T20:40:31.425406+0000","last_became_active":"2023-11-18T20:40:31.410261+0000","last_became_peered":"2023-11-18T20:40:31.410261+0000","last_unstale":"2023-11-18T20:40:31.425406+0000","last_undegraded":"2023-11-18T20:40:31.425406+0000","last_fullsized":"2023-11-18T20:40:31.425406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:41.922925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.414891+0000","last_change":"2023-11-18T20:40:30.391206+0000","last_active":"2023-11-18T20:40:32.414891+0000","last_peered":"2023-11-18T20:40:32.414891+0000","last_clean":"2023-11-18T20:40:32.414891+0000","last_became_active":"2023-11-18T20:40:30.390793+0000","last_became_peered":"2023-11-18T20:40:30.390793+0000","last_unstale":"2023-11-18T20:40:32.414891+0000","last_undegraded":"2023-11-18T20:40:32.414891+0000","last_fullsized":"2023-11-18T20:40:32.414891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:26:06.292277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.378836+0000","last_change":"2023-11-18T20:40:15.352662+0000","last_active":"2023-11-18T20:40:30.378836+0000","last_peered":"2023-11-18T20:40:30.378836+0000","last_clean":"2023-11-18T20:40:30.378836+0000","last_became_active":"2023-11-18T20:40:15.352389+0000","last_became_peered":"2023-11-18T20:40:15.352389+0000","last_unstale":"2023-11-18T20:40:30.378836+0000","last_undegraded":"2023-11-18T20:40:30.378836+0000","last_fullsized":"2023-11-18T20:40:30.378836+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:03.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.386115+0000","last_change":"2023-11-18T20:40:14.826072+0000","last_active":"2023-11-18T20:40:31.386115+0000","last_peered":"2023-11-18T20:40:31.386115+0000","last_clean":"2023-11-18T20:40:31.386115+0000","last_became_active":"2023-11-18T20:40:14.825599+0000","last_became_peered":"2023-11-18T20:40:14.825599+0000","last_unstale":"2023-11-18T20:40:31.386115+0000","last_undegraded":"2023-11-18T20:40:31.386115+0000","last_fullsized":"2023-11-18T20:40:31.386115+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:27:04.840132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.425071+0000","last_change":"2023-11-18T20:40:31.421287+0000","last_active":"2023-11-18T20:40:31.425071+0000","last_peered":"2023-11-18T20:40:31.425071+0000","last_clean":"2023-11-18T20:40:31.425071+0000","last_became_active":"2023-11-18T20:40:31.420945+0000","last_became_peered":"2023-11-18T20:40:31.420945+0000","last_unstale":"2023-11-18T20:40:31.425071+0000","last_undegraded":"2023-11-18T20:40:31.425071+0000","last_fullsized":"2023-11-18T20:40:31.425071+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:01.894798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-18T20:40:32.417154+0000","last_change":"2023-11-18T20:40:30.387684+0000","last_active":"2023-11-18T20:40:32.417154+0000","last_peered":"2023-11-18T20:40:32.417154+0000","last_clean":"2023-11-18T20:40:32.417154+0000","last_became_active":"2023-11-18T20:40:30.386825+0000","last_became_peered":"2023-11-18T20:40:30.386825+0000","last_unstale":"2023-11-18T20:40:32.417154+0000","last_undegraded":"2023-11-18T20:40:32.417154+0000","last_fullsized":"2023-11-18T20:40:32.417154+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:27:06.059361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392541+0000","last_change":"2023-11-18T20:40:15.352617+0000","last_active":"2023-11-18T20:40:30.392541+0000","last_peered":"2023-11-18T20:40:30.392541+0000","last_clean":"2023-11-18T20:40:30.392541+0000","last_became_active":"2023-11-18T20:40:15.350699+0000","last_became_peered":"2023-11-18T20:40:15.350699+0000","last_unstale":"2023-11-18T20:40:30.392541+0000","last_undegraded":"2023-11-18T20:40:30.392541+0000","last_fullsized":"2023-11-18T20:40:30.392541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:24.336068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.382714+0000","last_change":"2023-11-18T20:40:14.814908+0000","last_active":"2023-11-18T20:40:31.382714+0000","last_peered":"2023-11-18T20:40:31.382714+0000","last_clean":"2023-11-18T20:40:31.382714+0000","last_became_active":"2023-11-18T20:40:14.814486+0000","last_became_peered":"2023-11-18T20:40:14.814486+0000","last_unstale":"2023-11-18T20:40:31.382714+0000","last_undegraded":"2023-11-18T20:40:31.382714+0000","last_fullsized":"2023-11-18T20:40:31.382714+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:30:10.795775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.436247+0000","last_change":"2023-11-18T20:40:31.426009+0000","last_active":"2023-11-18T20:40:31.436247+0000","last_peered":"2023-11-18T20:40:31.436247+0000","last_clean":"2023-11-18T20:40:31.436247+0000","last_became_active":"2023-11-18T20:40:31.424341+0000","last_became_peered":"2023-11-18T20:40:31.424341+0000","last_unstale":"2023-11-18T20:40:31.436247+0000","last_undegraded":"2023-11-18T20:40:31.436247+0000","last_fullsized":"2023-11-18T20:40:31.436247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:35:50.495871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.414166+0000","last_change":"2023-11-18T20:40:30.388648+0000","last_active":"2023-11-18T20:40:31.414166+0000","last_peered":"2023-11-18T20:40:31.414166+0000","last_clean":"2023-11-18T20:40:31.414166+0000","last_became_active":"2023-11-18T20:40:30.388375+0000","last_became_peered":"2023-11-18T20:40:30.388375+0000","last_unstale":"2023-11-18T20:40:31.414166+0000","last_undegraded":"2023-11-18T20:40:31.414166+0000","last_fullsized":"2023-11-18T20:40:31.414166+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:20:05.082948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.394362+0000","last_change":"2023-11-18T20:40:15.363267+0000","last_active":"2023-11-18T20:40:30.394362+0000","last_peered":"2023-11-18T20:40:30.394362+0000","last_clean":"2023-11-18T20:40:30.394362+0000","last_became_active":"2023-11-18T20:40:15.362302+0000","last_became_peered":"2023-11-18T20:40:15.362302+0000","last_unstale":"2023-11-18T20:40:30.394362+0000","last_undegraded":"2023-11-18T20:40:30.394362+0000","last_fullsized":"2023-11-18T20:40:30.394362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:15:33.663727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392626+0000","last_change":"2023-11-18T20:40:14.830736+0000","last_active":"2023-11-18T20:40:30.392626+0000","last_peered":"2023-11-18T20:40:30.392626+0000","last_clean":"2023-11-18T20:40:30.392626+0000","last_became_active":"2023-11-18T20:40:14.830431+0000","last_became_peered":"2023-11-18T20:40:14.830431+0000","last_unstale":"2023-11-18T20:40:30.392626+0000","last_undegraded":"2023-11-18T20:40:30.392626+0000","last_fullsized":"2023-11-18T20:40:30.392626+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:10:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.437026+0000","last_change":"2023-11-18T20:40:31.435914+0000","last_active":"2023-11-18T20:40:31.437026+0000","last_peered":"2023-11-18T20:40:31.437026+0000","last_clean":"2023-11-18T20:40:31.437026+0000","last_became_active":"2023-11-18T20:40:31.435528+0000","last_became_peered":"2023-11-18T20:40:31.435528+0000","last_unstale":"2023-11-18T20:40:31.437026+0000","last_undegraded":"2023-11-18T20:40:31.437026+0000","last_fullsized":"2023-11-18T20:40:31.437026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:30.353102+0000","last_clean_scrub_stamp":"2023-11-18T20:40:30.353102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:20:35.876254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-18T20:40:31.437946+0000","last_change":"2023-11-18T20:40:30.395620+0000","last_active":"2023-11-18T20:40:31.437946+0000","last_peered":"2023-11-18T20:40:31.437946+0000","last_clean":"2023-11-18T20:40:31.437946+0000","last_became_active":"2023-11-18T20:40:30.395314+0000","last_became_peered":"2023-11-18T20:40:30.395314+0000","last_unstale":"2023-11-18T20:40:31.437946+0000","last_undegraded":"2023-11-18T20:40:31.437946+0000","last_fullsized":"2023-11-18T20:40:31.437946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:29.342695+0000","last_clean_scrub_stamp":"2023-11-18T20:40:29.342695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:05:17.985953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.392732+0000","last_change":"2023-11-18T20:40:15.355538+0000","last_active":"2023-11-18T20:40:30.392732+0000","last_peered":"2023-11-18T20:40:30.392732+0000","last_clean":"2023-11-18T20:40:30.392732+0000","last_became_active":"2023-11-18T20:40:15.355212+0000","last_became_peered":"2023-11-18T20:40:15.355212+0000","last_unstale":"2023-11-18T20:40:30.392732+0000","last_undegraded":"2023-11-18T20:40:30.392732+0000","last_fullsized":"2023-11-18T20:40:30.392732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:14.788476+0000","last_clean_scrub_stamp":"2023-11-18T20:40:14.788476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:15:19.819611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.382666+0000","last_change":"2023-11-18T20:40:14.834678+0000","last_active":"2023-11-18T20:40:30.382666+0000","last_peered":"2023-11-18T20:40:30.382666+0000","last_clean":"2023-11-18T20:40:30.382666+0000","last_became_active":"2023-11-18T20:40:14.834152+0000","last_became_peered":"2023-11-18T20:40:14.834152+0000","last_unstale":"2023-11-18T20:40:30.382666+0000","last_undegraded":"2023-11-18T20:40:30.382666+0000","last_fullsized":"2023-11-18T20:40:30.382666+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:40:13.774083+0000","last_clean_scrub_stamp":"2023-11-18T20:40:13.774083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:24:26.163852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-18T20:40:30.381559+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:40:30.381559+0000","last_peered":"2023-11-18T20:40:30.381559+0000","last_clean":"2023-11-18T20:40:30.381559+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:40:30.381559+0000","last_undegraded":"2023-11-18T20:40:30.381559+0000","last_fullsized":"2023-11-18T20:40:30.381559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":305675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.046,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0900000000000001,"15min":1.0940000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.276}]},{"osd":1,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.2110000000000001,"15min":1.214},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.599,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6180000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.097}]},{"osd":2,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1180000000000001,"15min":1.1240000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.613,"15min":1.613},"last":1.341},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.302,"15min":1.3009999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0950000000000002,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.375}]},{"osd":3,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2490000000000001,"15min":1.244},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.661,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.198},{"interface":"front","average":{"1min":1.397,"5min":1.4470000000000001,"15min":1.4550000000000001},"min":{"1min":0.95999999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8939999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.4810000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.577,"15min":1.5880000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":2.0750000000000002,"5min":2.601,"15min":2.601},"last":1.595},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.542,"15min":1.554},"min":{"1min":1.135,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.883,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.97699999999999998}]},{"osd":5,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.6160000000000001,"15min":1.6259999999999999},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.218,"5min":3.02,"15min":3.02},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.728,"15min":1.7410000000000001},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":2.1640000000000001,"5min":3.488,"15min":3.488},"last":1.4139999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":1.7749999999999999,"15min":1.782},"min":{"1min":1.202,"5min":1.202,"15min":1.202},"max":{"1min":2.2290000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.7290000000000001,"15min":1.7470000000000001},"min":{"1min":1.1499999999999999,"5min":1.075,"15min":1.075},"max":{"1min":2.302,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.456}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":712704,"data_stored":305639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.60899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.206},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":0.98099999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.995,"15min":0.998},"min":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.78600000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6399999999999999,"5min":1.653,"15min":1.653},"last":1.006}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.163,"15min":1.1739999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4750000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2310000000000001,"15min":1.234},"min":{"1min":0.82099999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.744,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.347}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3220000000000001,"15min":1.341},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7130000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.448},{"interface":"front","average":{"1min":1.139,"5min":1.1830000000000001,"15min":1.1910000000000001},"min":{"1min":0.82899999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.4470000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.488}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3600000000000001,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.3},{"interface":"front","average":{"1min":1.351,"5min":1.3700000000000001,"15min":1.373},"min":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7909999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.53}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3140000000000001,"15min":1.3109999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.847,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.581},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.534,"15min":1.5289999999999999},"min":{"1min":1.127,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.4039999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.5509999999999999,"15min":1.5569999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9379999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.611},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.6359999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1294336,"data_stored":894463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.84199999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5640000000000001,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.054},{"interface":"front","average":{"1min":1.226,"5min":1.1299999999999999,"15min":1.1140000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5509999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1240000000000001,"15min":1.131},"min":{"1min":0.81200000000000006,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3080000000000001,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.5580000000000001,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.141}]},{"osd":2,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.375,"15min":1.3999999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6259999999999999,"5min":2.004,"15min":2.004},"last":1.254},{"interface":"front","average":{"1min":1.25,"5min":1.214,"15min":1.208},"min":{"1min":0.78900000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.627,"5min":2.214,"15min":2.214},"last":1.1040000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.4850000000000001,"15min":1.5069999999999999},"min":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.958,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4590000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.827,"5min":2.024,"15min":2.024},"last":1.421}]},{"osd":4,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3959999999999999,"15min":1.4079999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0470000000000002,"5min":2.359,"15min":2.359},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.496,"5min":1.5069999999999999,"15min":1.5089999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.645,"15min":1.667},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1720000000000002,"5min":2.181,"15min":2.181},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5980000000000001,"15min":1.615},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.109,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.321}]},{"osd":7,"last update":"Sat Nov 18 20:39:57 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6619999999999999,"15min":1.671},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.746,"15min":1.7609999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.609}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":305281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.371},{"interface":"front","average":{"1min":1.004,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4850000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.1080000000000001,"15min":1.0900000000000001},"min":{"1min":0.73599999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.208,"15min":1.2350000000000001},"min":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4810000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6040000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.377,"15min":1.407},"min":{"1min":0.81699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.601,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":0.73799999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.212,"15min":1.224},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.4370000000000001,"5min":1.823,"15min":1.823},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.472,"15min":1.502},"min":{"1min":0.84699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.78,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4490000000000001,"15min":1.4610000000000001},"min":{"1min":1.0680000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.843,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4410000000000001,"15min":1.4630000000000001},"min":{"1min":1.073,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.5549999999999999,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.5489999999999999,"15min":1.5609999999999999},"min":{"1min":1.0489999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.893,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.605,"15min":1.617},"min":{"1min":1.2210000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.952,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Sat Nov 18 20:39:56 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.4790000000000001,"15min":1.478},"min":{"1min":1.244,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.843,"5min":1.929,"15min":1.929},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.635,"5min":1.6459999999999999,"15min":1.6479999999999999},"min":{"1min":1.234,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.59999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":304187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.432,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.073}]},{"osd":1,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93400000000000005,"15min":0.93300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.755},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.84999999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.274}]},{"osd":2,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.05,"15min":1.0600000000000001},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.9450000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.90800000000000003}]},{"osd":4,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1599999999999999,"15min":1.1559999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.228},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1599999999999999,"15min":1.1559999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.4259999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2410000000000001,"15min":1.2390000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8979999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.331},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.8520000000000001,"5min":1.901,"15min":1.901},"last":1.53}]},{"osd":6,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2649999999999999,"15min":1.262},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.379}]},{"osd":7,"last update":"Sat Nov 18 20:39:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.349},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.611},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.327,"15min":1.319},"min":{"1min":0.88500000000000001,"5min":0.754,"15min":0.754},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.355}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":716800,"data_stored":307820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.256,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":1.0389999999999999},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.367,"5min":2.081,"15min":2.081},"last":1.127}]},{"osd":1,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":0.85999999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2769999999999999,"5min":1.919,"15min":1.919},"last":1.367},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.84399999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.84199999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.085,"15min":1.1060000000000001},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4419999999999999,"5min":2.024,"15min":2.024},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.04,"15min":1.046},"min":{"1min":0.52500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5620000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0229999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.3140000000000001,"15min":1.3320000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.1659999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.177},{"interface":"front","average":{"1min":1.171,"5min":1.2150000000000001,"15min":1.222},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6839999999999999,"5min":2.254,"15min":2.254},"last":1.494}]},{"osd":5,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3109999999999999,"15min":1.323},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9419999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.425,"15min":1.4490000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5569999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.337}]},{"osd":6,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4359999999999999,"15min":1.462},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.0030000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.244},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3069999999999999,"15min":1.327},"min":{"1min":0.82299999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2189999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.056}]},{"osd":7,"last update":"Sat Nov 18 20:39:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.4450000000000001,"15min":1.4670000000000001},"min":{"1min":0.85999999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8600000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0950000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.2809999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1290240,"data_stored":894921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.88700000000000001,"15min":0.90800000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.371,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.194,"5min":1.524,"15min":1.524},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2290000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.433},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0349999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4730000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5589999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.115,"15min":1.129},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.595,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.206,"15min":1.22},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4199999999999999,"5min":1.927,"15min":1.927},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.258,"5min":1.4099999999999999,"15min":1.4350000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.619,"5min":3.343,"15min":3.343},"last":0.81399999999999995}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.4390000000000001,"15min":1.484},"min":{"1min":0.876,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.5429999999999999,"5min":3.206,"15min":3.206},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.387,"15min":1.401},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6519999999999999,"5min":2.165,"15min":2.165},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.681,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.331,"5min":1.5580000000000001,"15min":1.5960000000000001},"min":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.754,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.89000000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.575,"15min":1.617},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.843,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.379,"5min":1.4430000000000001,"15min":1.4530000000000001},"min":{"1min":0.81399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.306,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.0569999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":307148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2390000000000001,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.97399999999999998,"15min":1.0109999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.5529999999999999,"15min":1.663},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.331,"5min":14.169,"15min":14.169},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93000000000000005,"15min":0.94299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.96199999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":1.506,"15min":1.6080000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2989999999999999,"5min":11.629,"15min":11.629},"last":1.246},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.351,"15min":1.413},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6459999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.214}]},{"osd":4,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.4119999999999999,"15min":1.4410000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4119999999999999,"15min":1.423},"min":{"1min":0.90400000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.5589999999999999,"15min":1.625},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.659,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.04},{"interface":"front","average":{"1min":1.27,"5min":1.6180000000000001,"15min":1.6759999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.736,"5min":6.202,"15min":6.202},"last":1.0629999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4710000000000001,"15min":1.472},"min":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":5.085,"5min":5.085,"15min":5.085},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.6739999999999999,"15min":1.744},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7210000000000001,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.1060000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:39:55 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.5820000000000001,"15min":1.6439999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.601,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.151},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.7310000000000001,"15min":1.798},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.6899999999999999,"5min":6.149,"15min":6.149},"last":1.2989999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:40:36.425 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T20:40:36.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-18T20:40:36.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.681+0000 7f68153ee640 1 Processor -- start 2023-11-18T20:40:36.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.681+0000 7f68153ee640 1 -- start start 2023-11-18T20:40:36.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f68153ee640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 0x7f6810151a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f68153ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6810155230 0x7f6810151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f68153ee640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6810155730 con 0x7f681006b1d0 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f68153ee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681006c9f0 con 0x7f6810155230 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f68153ee640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68101524e0 con 0x7f68100c8530 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f680f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6810155230 0x7f6810151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f680f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6810155230 0x7f6810151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47620/0 (socket says 172.21.15.132:47620) 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f680f7fe640 1 -- 172.21.15.132:0/18816314 learned_addr learned my addr 172.21.15.132:0/18816314 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f680e7fc640 1 --2- 172.21.15.132:0/18816314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 0x7f6810151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f680f7fe640 1 -- 172.21.15.132:0/18816314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 msgr2=0x7f6810151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f680f7fe640 1 --2- 172.21.15.132:0/18816314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 0x7f6810151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.683+0000 7f680f7fe640 1 -- 172.21.15.132:0/18816314 >> v1:172.21.15.161:6789/0 conn(0x7f681006b1d0 legacy=0x7f68100c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:36.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.684+0000 7f680f7fe640 1 -- 172.21.15.132:0/18816314 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100c5650 con 0x7f6810155230 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.685+0000 7f680f7fe640 1 --2- 172.21.15.132:0/18816314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6810155230 0x7f6810151fa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f68080098a0 tx=0x7f680802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e7b6cffb87a24c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.685+0000 7f680dffb640 1 -- 172.21.15.132:0/18816314 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808033620 con 0x7f6810155230 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.685+0000 7f680dffb640 1 -- 172.21.15.132:0/18816314 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808033780 con 0x7f6810155230 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.685+0000 7f680dffb640 1 -- 172.21.15.132:0/18816314 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808033b10 con 0x7f6810155230 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.685+0000 7f68153ee640 1 -- 172.21.15.132:0/18816314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6810155230 msgr2=0x7f6810151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.685+0000 7f68153ee640 1 --2- 172.21.15.132:0/18816314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6810155230 0x7f6810151fa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f68080098a0 tx=0x7f680802b7d0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.686+0000 7f68153ee640 1 -- 172.21.15.132:0/18816314 shutdown_connections 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.686+0000 7f68153ee640 1 --2- 172.21.15.132:0/18816314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6810155230 0x7f6810151fa0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.686+0000 7f68153ee640 1 --2- 172.21.15.132:0/18816314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 0x7f6810151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.686+0000 7f68153ee640 1 -- 172.21.15.132:0/18816314 >> 172.21.15.132:0/18816314 conn(0x7f68100ca100 msgr2=0x7f68100ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:36.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.686+0000 7f68153ee640 1 -- 172.21.15.132:0/18816314 shutdown_connections 2023-11-18T20:40:36.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.686+0000 7f68153ee640 1 -- 172.21.15.132:0/18816314 wait complete. 2023-11-18T20:40:36.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.687+0000 7f68153ee640 1 Processor -- start 2023-11-18T20:40:36.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.688+0000 7f68153ee640 1 -- start start 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.688+0000 7f68153ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f681006b1d0 0x7f68101ed290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.688+0000 7f68153ee640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 0x7f681014bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f68153ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6810155230 0x7f68101ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f68153ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681014a730 con 0x7f681006b1d0 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f68153ee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68100ad950 con 0x7f6810155230 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f68153ee640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68100adc30 con 0x7f68100c8530 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f681006b1d0 0x7f68101ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f681006b1d0 0x7f68101ed290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47624/0 (socket says 172.21.15.132:47624) 2023-11-18T20:40:36.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 -- 172.21.15.132:0/2533222664 learned_addr learned my addr 172.21.15.132:0/2533222664 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:36.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 -- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 msgr2=0x7f681014bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 0x7f681014bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 -- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6810155230 msgr2=0x7f68101ea5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6810155230 0x7f68101ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 -- 172.21.15.132:0/2533222664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68080094d0 con 0x7f681006b1d0 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.689+0000 7f680effd640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f681006b1d0 0x7f68101ed290 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f680000ba50 tx=0x7f680000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.690+0000 7f68077fe640 1 -- 172.21.15.132:0/2533222664 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000cb90 con 0x7f681006b1d0 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.690+0000 7f68077fe640 1 -- 172.21.15.132:0/2533222664 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680000ccf0 con 0x7f681006b1d0 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.690+0000 7f68077fe640 1 -- 172.21.15.132:0/2533222664 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800014680 con 0x7f681006b1d0 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.690+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68100adf10 con 0x7f681006b1d0 2023-11-18T20:40:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.690+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68101ea0b0 con 0x7f681006b1d0 2023-11-18T20:40:36.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.691+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681004e840 con 0x7f681006b1d0 2023-11-18T20:40:36.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.692+0000 7f68077fe640 1 -- 172.21.15.132:0/2533222664 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f680001e440 con 0x7f681006b1d0 2023-11-18T20:40:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.693+0000 7f68077fe640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f67f006ae40 0x7f67f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:36.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.693+0000 7f68077fe640 1 -- 172.21.15.132:0/2533222664 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6800089870 con 0x7f681006b1d0 2023-11-18T20:40:36.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.694+0000 7f680e7fc640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f67f006ae40 0x7f67f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:36.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.695+0000 7f680e7fc640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f67f006ae40 0x7f67f006d300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67f8006fd0 tx=0x7f67f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:36.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.698+0000 7f68077fe640 1 -- 172.21.15.132:0/2533222664 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6800054650 con 0x7f681006b1d0 2023-11-18T20:40:36.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.954+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f6810068350 con 0x7f681006b1d0 2023-11-18T20:40:36.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.959+0000 7f68077fe640 1 -- 172.21.15.132:0/2533222664 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7f68000190e0 con 0x7f681006b1d0 2023-11-18T20:40:36.960 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-11-18T20:40:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBsIFllrycwCxAAI7OVXj40YLGlQ4/hWY+mTA== 2023-11-18T20:40:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow" 2023-11-18T20:40:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2023-11-18T20:40:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-18T20:40:36.961 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.1 2023-11-18T20:40:36.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f67f006ae40 msgr2=0x7f67f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f67f006ae40 0x7f67f006d300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67f8006fd0 tx=0x7f67f8008040 comp rx=0 tx=0).stop 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f681006b1d0 msgr2=0x7f68101ed290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f681006b1d0 0x7f68101ed290 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f680000ba50 tx=0x7f680000bf10 comp rx=0 tx=0).stop 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 shutdown_connections 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f67f006ae40 0x7f67f006d300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6810155230 0x7f68101ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68100c8530 0x7f681014bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 --2- 172.21.15.132:0/2533222664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f681006b1d0 0x7f68101ed290 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.961+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 >> 172.21.15.132:0/2533222664 conn(0x7f68100ca100 msgr2=0x7f68100ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.962+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 shutdown_connections 2023-11-18T20:40:36.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:36.962+0000 7f68153ee640 1 -- 172.21.15.132:0/2533222664 wait complete. 2023-11-18T20:40:36.981 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:40:36.982 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:37.042 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:40:37.043 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:37.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:37.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.310+0000 7fc7cb21f640 1 Processor -- start 2023-11-18T20:40:37.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.310+0000 7fc7cb21f640 1 -- start start 2023-11-18T20:40:37.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.311+0000 7fc7cb21f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7c406d0a0 0x7fc7c4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.311+0000 7fc7cb21f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c40c64a0 con 0x7fc7c40c3ea0 2023-11-18T20:40:37.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.311+0000 7fc7cb21f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c40c5c00 con 0x7fc7c414fd30 2023-11-18T20:40:37.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.311+0000 7fc7cb21f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40c5ee0 con 0x7fc7c406d0a0 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.312+0000 7fc7c97bc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc7c40c3ea0 0x7fc7c40c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41570/0 (socket says 172.21.15.132:41570) 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.312+0000 7fc7c97bc640 1 -- 172.21.15.132:0/675966498 learned_addr learned my addr 172.21.15.132:0/675966498 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.312+0000 7fc7c3fff640 1 --2- 172.21.15.132:0/675966498 >> v2:172.21.15.161:3300/0 conn(0x7fc7c406d0a0 0x7fc7c4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.312+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71743250 0 0) 0x7fc7c40c64a0 con 0x7fc7c40c3ea0 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.312+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4003520 con 0x7fc7c40c3ea0 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 706029362 0 0) 0x7fc7b4003520 con 0x7fc7c40c3ea0 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 >> v2:172.21.15.161:3300/0 conn(0x7fc7c406d0a0 msgr2=0x7fc7c4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 --2- 172.21.15.132:0/675966498 >> v2:172.21.15.161:3300/0 conn(0x7fc7c406d0a0 0x7fc7c4152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 >> v1:172.21.15.161:6789/0 conn(0x7fc7c414fd30 legacy=0x7fc7c40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40c61c0 con 0x7fc7c40c3ea0 2023-11-18T20:40:37.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fc7bc0019f0 con 0x7fc7c40c3ea0 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 >> v1:172.21.15.132:6789/0 conn(0x7fc7c40c3ea0 legacy=0x7fc7c40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b4003970 0x7fc7b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40047c0 0x7fc7b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b4005180 0x7fc7b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40c5ee0 con 0x7fc7b4005180 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b400c020 con 0x7fc7b40047c0 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b400c1e0 con 0x7fc7b4003970 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.313+0000 7fc7c97bc640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b4005180 0x7fc7b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.314+0000 7fc7c3fff640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40047c0 0x7fc7b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.314+0000 7fc7c8fbb640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b4003970 0x7fc7b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.314+0000 7fc7c97bc640 1 -- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b4003970 msgr2=0x7fc7b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.314+0000 7fc7c97bc640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b4003970 0x7fc7b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.314+0000 7fc7c97bc640 1 -- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40047c0 msgr2=0x7fc7b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:37.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.314+0000 7fc7c97bc640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40047c0 0x7fc7b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.314+0000 7fc7c97bc640 1 -- 172.21.15.132:0/675966498 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4003520 con 0x7fc7b4005180 2023-11-18T20:40:37.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.314+0000 7fc7c8fbb640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7b4003970 0x7fc7b4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.315+0000 7fc7c97bc640 1 -- 172.21.15.132:0/675966498 reap_dead start 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.315+0000 7fc7c97bc640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b4005180 0x7fc7b400b980 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00a830 tx=0x7fc7b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ff74872c7c8e63 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.315+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0072d0 con 0x7fc7b4005180 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.315+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc02f070 con 0x7fc7b4005180 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.315+0000 7fc7c37fe640 1 -- 172.21.15.132:0/675966498 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc007690 con 0x7fc7b4005180 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.316+0000 7fc7cb21f640 1 -- 172.21.15.132:0/675966498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b4005180 msgr2=0x7fc7b400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.316+0000 7fc7cb21f640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b4005180 0x7fc7b400b980 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00a830 tx=0x7fc7b40057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.316+0000 7fc7cb21f640 1 -- 172.21.15.132:0/675966498 shutdown_connections 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.316+0000 7fc7cb21f640 1 --2- 172.21.15.132:0/675966498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7b4005180 0x7fc7b400b980 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.316+0000 7fc7cb21f640 1 -- 172.21.15.132:0/675966498 >> 172.21.15.132:0/675966498 conn(0x7fc7c406a500 msgr2=0x7fc7c406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:37.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.316+0000 7fc7cb21f640 1 -- 172.21.15.132:0/675966498 shutdown_connections 2023-11-18T20:40:37.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.316+0000 7fc7cb21f640 1 -- 172.21.15.132:0/675966498 wait complete. 2023-11-18T20:40:37.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.317+0000 7fc7cb21f640 1 Processor -- start 2023-11-18T20:40:37.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.318+0000 7fc7cb21f640 1 -- start start 2023-11-18T20:40:37.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7cb21f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4005180 0x7fc7c41e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7cb21f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c40a7db0 0x7fc7c41ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7cb21f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c41df340 0x7fc7c4153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7cb21f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c414cdb0 con 0x7fc7c41df340 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7cb21f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4154b60 con 0x7fc7b4005180 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7cb21f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4155370 con 0x7fc7c40a7db0 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c41df340 0x7fc7c4153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c41df340 0x7fc7c4153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47646/0 (socket says 172.21.15.132:47646) 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 -- 172.21.15.132:0/2630884436 learned_addr learned my addr 172.21.15.132:0/2630884436 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 -- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c40a7db0 msgr2=0x7fc7c41ebdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c40a7db0 0x7fc7c41ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 -- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4005180 msgr2=0x7fc7c41e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4005180 0x7fc7c41e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 -- 172.21.15.132:0/2630884436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c41e8450 con 0x7fc7c41df340 2023-11-18T20:40:37.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.319+0000 7fc7c97bc640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c41df340 0x7fc7c4153860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc02cc40 tx=0x7fc7bc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:37.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.320+0000 7fc7c17fa640 1 -- 172.21.15.132:0/2630884436 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc004d60 con 0x7fc7c41df340 2023-11-18T20:40:37.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.320+0000 7fc7c17fa640 1 -- 172.21.15.132:0/2630884436 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc001250 con 0x7fc7c41df340 2023-11-18T20:40:37.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.320+0000 7fc7c17fa640 1 -- 172.21.15.132:0/2630884436 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0072f0 con 0x7fc7c41df340 2023-11-18T20:40:37.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.320+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c4154db0 con 0x7fc7c41df340 2023-11-18T20:40:37.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.320+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c41eb5b0 con 0x7fc7c41df340 2023-11-18T20:40:37.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.321+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c4068350 con 0x7fc7c41df340 2023-11-18T20:40:37.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.322+0000 7fc7c17fa640 1 -- 172.21.15.132:0/2630884436 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7bc031030 con 0x7fc7c41df340 2023-11-18T20:40:37.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.323+0000 7fc7c17fa640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc7a806ae40 0x7fc7a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.323+0000 7fc7c17fa640 1 -- 172.21.15.132:0/2630884436 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc7bc0ab520 con 0x7fc7c41df340 2023-11-18T20:40:37.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.324+0000 7fc7c8fbb640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc7a806ae40 0x7fc7a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.325+0000 7fc7c8fbb640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc7a806ae40 0x7fc7a806d300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8000f60 tx=0x7fc7b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:37.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.327+0000 7fc7c17fa640 1 -- 172.21.15.132:0/2630884436 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7bc076260 con 0x7fc7c41df340 2023-11-18T20:40:37.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.520+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7c4068350 con 0x7fc7c41df340 2023-11-18T20:40:37.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.522+0000 7fc7c17fa640 1 -- 172.21.15.132:0/2630884436 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+20256 (secure 0 0 0) 0x7fc7bc079880 con 0x7fc7c41df340 2023-11-18T20:40:37.523 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:37.523 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":59,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:32.397403+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc7a806ae40 msgr2=0x7fc7a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc7a806ae40 0x7fc7a806d300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8000f60 tx=0x7fc7b8009040 comp rx=0 tx=0).stop 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c41df340 msgr2=0x7fc7c4153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c41df340 0x7fc7c4153860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc02cc40 tx=0x7fc7bc001d80 comp rx=0 tx=0).stop 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 shutdown_connections 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc7a806ae40 0x7fc7a806d300 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c41df340 0x7fc7c4153860 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c40a7db0 0x7fc7c41ebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 --2- 172.21.15.132:0/2630884436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b4005180 0x7fc7c41e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 >> 172.21.15.132:0/2630884436 conn(0x7fc7c406a500 msgr2=0x7fc7c40c30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:37.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 shutdown_connections 2023-11-18T20:40:37.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.524+0000 7fc7cb21f640 1 -- 172.21.15.132:0/2630884436 wait complete. 2023-11-18T20:40:37.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:40:13.573413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:40:14.279671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:40:28.826395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:40:29.825753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:40:37.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:40:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.757+0000 7f3684fe2640 1 Processor -- start 2023-11-18T20:40:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.758+0000 7f3684fe2640 1 -- start start 2023-11-18T20:40:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.759+0000 7f3684fe2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368006d0a0 0x7f3680152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.759+0000 7f3684fe2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36800c3ea0 0x7f36800c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.759+0000 7f3684fe2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800c64a0 con 0x7f368014fd30 2023-11-18T20:40:37.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.759+0000 7f3684fe2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800c5c00 con 0x7f36800c3ea0 2023-11-18T20:40:37.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.759+0000 7f3684fe2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800c5ee0 con 0x7f368006d0a0 2023-11-18T20:40:37.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.759+0000 7f367e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f368014fd30 0x7f36800a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41572/0 (socket says 172.21.15.132:41572) 2023-11-18T20:40:37.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.759+0000 7f367e59c640 1 -- 172.21.15.132:0/2080120360 learned_addr learned my addr 172.21.15.132:0/2080120360 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:37.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.759+0000 7f367ed9d640 1 --2- 172.21.15.132:0/2080120360 >> v2:172.21.15.132:3300/0 conn(0x7f36800c3ea0 0x7f36800c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.760+0000 7f367dd9b640 1 -- 172.21.15.132:0/2080120360 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627807230 0 0) 0x7f36800c64a0 con 0x7f368014fd30 2023-11-18T20:40:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.760+0000 7f3677fff640 1 --2- 172.21.15.132:0/2080120360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368006d0a0 0x7f3680152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.760+0000 7f367dd9b640 1 -- 172.21.15.132:0/2080120360 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f366c003520 con 0x7f368014fd30 2023-11-18T20:40:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.760+0000 7f367ed9d640 1 -- 172.21.15.132:0/2080120360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368006d0a0 msgr2=0x7f3680152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.760+0000 7f367ed9d640 1 --2- 172.21.15.132:0/2080120360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368006d0a0 0x7f3680152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.760+0000 7f367ed9d640 1 -- 172.21.15.132:0/2080120360 >> v1:172.21.15.132:6789/0 conn(0x7f368014fd30 legacy=0x7f36800a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.760+0000 7f367ed9d640 1 -- 172.21.15.132:0/2080120360 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800c61c0 con 0x7f36800c3ea0 2023-11-18T20:40:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.760+0000 7f3677fff640 1 --2- 172.21.15.132:0/2080120360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368006d0a0 0x7f3680152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.761+0000 7f367ed9d640 1 --2- 172.21.15.132:0/2080120360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36800c3ea0 0x7f36800c4330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3678009d90 tx=0x7f367802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5772ccd306008e4a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.761+0000 7f367dd9b640 1 -- 172.21.15.132:0/2080120360 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367802cc50 con 0x7f36800c3ea0 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.761+0000 7f367dd9b640 1 -- 172.21.15.132:0/2080120360 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367802cdb0 con 0x7f36800c3ea0 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.761+0000 7f367dd9b640 1 -- 172.21.15.132:0/2080120360 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678034660 con 0x7f36800c3ea0 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.762+0000 7f3684fe2640 1 -- 172.21.15.132:0/2080120360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36800c3ea0 msgr2=0x7f36800c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.762+0000 7f3684fe2640 1 --2- 172.21.15.132:0/2080120360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36800c3ea0 0x7f36800c4330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3678009d90 tx=0x7f367802bea0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.762+0000 7f3684fe2640 1 -- 172.21.15.132:0/2080120360 shutdown_connections 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.762+0000 7f3684fe2640 1 --2- 172.21.15.132:0/2080120360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36800c3ea0 0x7f36800c4330 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.762+0000 7f3684fe2640 1 --2- 172.21.15.132:0/2080120360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368006d0a0 0x7f3680152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.762+0000 7f3684fe2640 1 -- 172.21.15.132:0/2080120360 >> 172.21.15.132:0/2080120360 conn(0x7f368006a500 msgr2=0x7f368006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.762+0000 7f3684fe2640 1 -- 172.21.15.132:0/2080120360 shutdown_connections 2023-11-18T20:40:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.762+0000 7f3684fe2640 1 -- 172.21.15.132:0/2080120360 wait complete. 2023-11-18T20:40:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.764+0000 7f3684fe2640 1 Processor -- start 2023-11-18T20:40:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.764+0000 7f3684fe2640 1 -- start start 2023-11-18T20:40:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f3684fe2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f368006d0a0 0x7f36801dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f3684fe2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36800c3ea0 0x7f36800719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f3684fe2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368014fd30 0x7f36801ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f3684fe2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801ee5a0 con 0x7f368006d0a0 2023-11-18T20:40:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f3684fe2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801ee110 con 0x7f36800c3ea0 2023-11-18T20:40:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f3684fe2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36801dc160 con 0x7f368014fd30 2023-11-18T20:40:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f367e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f368006d0a0 0x7f36801dbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f367e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f368006d0a0 0x7f36801dbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47662/0 (socket says 172.21.15.132:47662) 2023-11-18T20:40:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.765+0000 7f367e59c640 1 -- 172.21.15.132:0/1323864483 learned_addr learned my addr 172.21.15.132:0/1323864483 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:37.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f3677fff640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36800c3ea0 0x7f36800719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f367e59c640 1 -- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368014fd30 msgr2=0x7f36801ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f367e59c640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368014fd30 0x7f36801ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f367e59c640 1 -- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36800c3ea0 msgr2=0x7f36800719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f367e59c640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36800c3ea0 0x7f36800719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f367e59c640 1 -- 172.21.15.132:0/1323864483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678009a70 con 0x7f368006d0a0 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f367e59c640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f368006d0a0 0x7f36801dbad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f367000c500 tx=0x7f367000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f3676ffd640 1 -- 172.21.15.132:0/1323864483 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670005ce0 con 0x7f368006d0a0 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f3676ffd640 1 -- 172.21.15.132:0/1323864483 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670005e40 con 0x7f368006d0a0 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36801525b0 con 0x7f368006d0a0 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f3676ffd640 1 -- 172.21.15.132:0/1323864483 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670007330 con 0x7f368006d0a0 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.766+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36801edac0 con 0x7f368006d0a0 2023-11-18T20:40:37.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.767+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3680068350 con 0x7f368006d0a0 2023-11-18T20:40:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.769+0000 7f3676ffd640 1 -- 172.21.15.132:0/1323864483 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3670007490 con 0x7f368006d0a0 2023-11-18T20:40:37.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.770+0000 7f3676ffd640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f366006ae70 0x7f366006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:37.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.770+0000 7f3676ffd640 1 -- 172.21.15.132:0/1323864483 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3670088fb0 con 0x7f368006d0a0 2023-11-18T20:40:37.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.770+0000 7f3677fff640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f366006ae70 0x7f366006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:37.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.772+0000 7f3677fff640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f366006ae70 0x7f366006d330 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f36801dd3b0 tx=0x7f3668008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:37.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.777+0000 7f3676ffd640 1 -- 172.21.15.132:0/1323864483 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3670053db0 con 0x7f368006d0a0 2023-11-18T20:40:37.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.966+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36800c66d0 con 0x7f368006d0a0 2023-11-18T20:40:37.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.967+0000 7f3676ffd640 1 -- 172.21.15.132:0/1323864483 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3670017020 con 0x7f368006d0a0 2023-11-18T20:40:37.968 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:40:37.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f366006ae70 msgr2=0x7f366006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f366006ae70 0x7f366006d330 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f36801dd3b0 tx=0x7f3668008040 comp rx=0 tx=0).stop 2023-11-18T20:40:37.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f368006d0a0 msgr2=0x7f36801dbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f368006d0a0 0x7f36801dbad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f367000c500 tx=0x7f367000c9c0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 shutdown_connections 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f366006ae70 0x7f366006d330 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f368014fd30 0x7f36801ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36800c3ea0 0x7f36800719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 --2- 172.21.15.132:0/1323864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f368006d0a0 0x7f36801dbad0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 >> 172.21.15.132:0/1323864483 conn(0x7f368006a500 msgr2=0x7f368006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 shutdown_connections 2023-11-18T20:40:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:37.970+0000 7f3684fe2640 1 -- 172.21.15.132:0/1323864483 wait complete. 2023-11-18T20:40:37.989 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:40:38.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.203+0000 7f184f221640 1 Processor -- start 2023-11-18T20:40:38.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.203+0000 7f184f221640 1 -- start start 2023-11-18T20:40:38.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.204+0000 7f184f221640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f184806d0a0 0x7f1848152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.204+0000 7f184f221640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f18480c3ea0 0x7f18480c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.204+0000 7f184f221640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480c64a0 con 0x7f184814fd30 2023-11-18T20:40:38.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.204+0000 7f184f221640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18480c5c00 con 0x7f18480c3ea0 2023-11-18T20:40:38.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.204+0000 7f184f221640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c5ee0 con 0x7f184806d0a0 2023-11-18T20:40:38.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.205+0000 7f184d7be640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f18480c3ea0 0x7f18480c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.205+0000 7f1847fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f184806d0a0 0x7f1848152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.205+0000 7f184d7be640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f18480c3ea0 0x7f18480c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:45864/0 (socket says 172.21.15.132:45864) 2023-11-18T20:40:38.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.205+0000 7f184d7be640 1 -- 172.21.15.132:0/2175818170 learned_addr learned my addr 172.21.15.132:0/2175818170 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:38.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.206+0000 7f1847fff640 1 -- 172.21.15.132:0/2175818170 >> v2:172.21.15.161:3300/0 conn(0x7f18480c3ea0 msgr2=0x7f18480c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:38.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.206+0000 7f1847fff640 1 --2- 172.21.15.132:0/2175818170 >> v2:172.21.15.161:3300/0 conn(0x7f18480c3ea0 0x7f18480c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.206+0000 7f1847fff640 1 -- 172.21.15.132:0/2175818170 >> v1:172.21.15.161:6789/0 conn(0x7f184814fd30 legacy=0x7f18480a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.206+0000 7f1847fff640 1 -- 172.21.15.132:0/2175818170 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480c61c0 con 0x7f184806d0a0 2023-11-18T20:40:38.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.207+0000 7f1847fff640 1 --2- 172.21.15.132:0/2175818170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f184806d0a0 0x7f1848152f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f183c0097a0 tx=0x7f183c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64bd976ba34b7727 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:38.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f18477fe640 1 -- 172.21.15.132:0/2175818170 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c02d040 con 0x7f184806d0a0 2023-11-18T20:40:38.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f18477fe640 1 -- 172.21.15.132:0/2175818170 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c031810 con 0x7f184806d0a0 2023-11-18T20:40:38.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f18477fe640 1 -- 172.21.15.132:0/2175818170 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c031ba0 con 0x7f184806d0a0 2023-11-18T20:40:38.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f184f221640 1 -- 172.21.15.132:0/2175818170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f184806d0a0 msgr2=0x7f1848152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f184f221640 1 --2- 172.21.15.132:0/2175818170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f184806d0a0 0x7f1848152f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f183c0097a0 tx=0x7f183c02b8b0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f184f221640 1 -- 172.21.15.132:0/2175818170 shutdown_connections 2023-11-18T20:40:38.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f184f221640 1 --2- 172.21.15.132:0/2175818170 >> v2:172.21.15.161:3300/0 conn(0x7f18480c3ea0 0x7f18480c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f184f221640 1 --2- 172.21.15.132:0/2175818170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f184806d0a0 0x7f1848152f20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f184f221640 1 -- 172.21.15.132:0/2175818170 >> 172.21.15.132:0/2175818170 conn(0x7f184806a500 msgr2=0x7f184806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:38.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.208+0000 7f184f221640 1 -- 172.21.15.132:0/2175818170 shutdown_connections 2023-11-18T20:40:38.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.209+0000 7f184f221640 1 -- 172.21.15.132:0/2175818170 wait complete. 2023-11-18T20:40:38.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.210+0000 7f184f221640 1 Processor -- start 2023-11-18T20:40:38.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.210+0000 7f184f221640 1 -- start start 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.211+0000 7f184f221640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f184806d0a0 0x7f18481ee400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.211+0000 7f184f221640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18480c3ea0 0x7f18481dbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.211+0000 7f184f221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f184814fd30 0x7f184814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.211+0000 7f184f221640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480a5090 con 0x7f184814fd30 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.211+0000 7f184f221640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18481e00d0 con 0x7f184806d0a0 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.211+0000 7f184f221640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18481e02e0 con 0x7f18480c3ea0 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f184814fd30 0x7f184814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f184814fd30 0x7f184814b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47676/0 (socket says 172.21.15.132:47676) 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 -- 172.21.15.132:0/244473008 learned_addr learned my addr 172.21.15.132:0/244473008 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184cfbd640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f184806d0a0 0x7f18481ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 -- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18480c3ea0 msgr2=0x7f18481dbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18480c3ea0 0x7f18481dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 -- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f184806d0a0 msgr2=0x7f18481ee400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f184806d0a0 0x7f18481ee400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 -- 172.21.15.132:0/244473008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c009400 con 0x7f184814fd30 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.212+0000 7f184d7be640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f184814fd30 0x7f184814b260 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f184000e870 tx=0x7f184000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.213+0000 7f18457fa640 1 -- 172.21.15.132:0/244473008 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840009660 con 0x7f184814fd30 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.213+0000 7f18457fa640 1 -- 172.21.15.132:0/244473008 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000c940 con 0x7f184814fd30 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.213+0000 7f18457fa640 1 -- 172.21.15.132:0/244473008 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000ccf0 con 0x7f184814fd30 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.213+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18481e05c0 con 0x7f184814fd30 2023-11-18T20:40:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.213+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18481dd970 con 0x7f184814fd30 2023-11-18T20:40:38.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.214+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18481ddbd0 con 0x7f184814fd30 2023-11-18T20:40:38.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.215+0000 7f18457fa640 1 -- 172.21.15.132:0/244473008 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1840013470 con 0x7f184814fd30 2023-11-18T20:40:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.216+0000 7f18457fa640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f183406ae40 0x7f183406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.216+0000 7f18457fa640 1 -- 172.21.15.132:0/244473008 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1840089d00 con 0x7f184814fd30 2023-11-18T20:40:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.217+0000 7f184cfbd640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f183406ae40 0x7f183406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.218+0000 7f184cfbd640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f183406ae40 0x7f183406d300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1838001d40 tx=0x7f1838009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.220+0000 7f18457fa640 1 -- 172.21.15.132:0/244473008 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18481ddbd0 con 0x7f184814fd30 2023-11-18T20:40:38.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.405+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18481ddbd0 con 0x7f184814fd30 2023-11-18T20:40:38.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.406+0000 7f18457fa640 1 -- 172.21.15.132:0/244473008 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1840021020 con 0x7f184814fd30 2023-11-18T20:40:38.407 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:38.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f183406ae40 msgr2=0x7f183406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f183406ae40 0x7f183406d300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1838001d40 tx=0x7f1838009040 comp rx=0 tx=0).stop 2023-11-18T20:40:38.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f184814fd30 msgr2=0x7f184814b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f184814fd30 0x7f184814b260 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f184000e870 tx=0x7f184000ed30 comp rx=0 tx=0).stop 2023-11-18T20:40:38.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 shutdown_connections 2023-11-18T20:40:38.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f183406ae40 0x7f183406d300 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f184814fd30 0x7f184814b260 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18480c3ea0 0x7f18481dbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 --2- 172.21.15.132:0/244473008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f184806d0a0 0x7f18481ee400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 >> 172.21.15.132:0/244473008 conn(0x7f184806a500 msgr2=0x7f184806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:38.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 shutdown_connections 2023-11-18T20:40:38.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.409+0000 7f184f221640 1 -- 172.21.15.132:0/244473008 wait complete. 2023-11-18T20:40:38.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:40:38.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.633+0000 7fe152ade640 1 Processor -- start 2023-11-18T20:40:38.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.633+0000 7fe152ade640 1 -- start start 2023-11-18T20:40:38.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe152ade640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe152ade640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe14c0c3ea0 0x7fe14c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe152ade640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c0c64a0 con 0x7fe14c06d0a0 2023-11-18T20:40:38.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe152ade640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0c5c00 con 0x7fe14c0c3ea0 2023-11-18T20:40:38.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe152ade640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0c5ee0 con 0x7fe14c14fd30 2023-11-18T20:40:38.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe15107b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe14c0c3ea0 0x7fe14c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe15087a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe15087a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:54364/0 (socket says 172.21.15.132:54364) 2023-11-18T20:40:38.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.635+0000 7fe15087a640 1 -- 172.21.15.132:0/813611007 learned_addr learned my addr 172.21.15.132:0/813611007 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:38.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.636+0000 7fe15087a640 1 -- 172.21.15.132:0/813611007 >> v2:172.21.15.161:3300/0 conn(0x7fe14c0c3ea0 msgr2=0x7fe14c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:38.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.636+0000 7fe15087a640 1 --2- 172.21.15.132:0/813611007 >> v2:172.21.15.161:3300/0 conn(0x7fe14c0c3ea0 0x7fe14c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.636+0000 7fe15087a640 1 -- 172.21.15.132:0/813611007 >> v1:172.21.15.161:6789/0 conn(0x7fe14c06d0a0 legacy=0x7fe14c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.636+0000 7fe15087a640 1 -- 172.21.15.132:0/813611007 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0c61c0 con 0x7fe14c14fd30 2023-11-18T20:40:38.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.636+0000 7fe15107b640 1 --2- 172.21.15.132:0/813611007 >> v2:172.21.15.161:3300/0 conn(0x7fe14c0c3ea0 0x7fe14c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:40:38.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.637+0000 7fe15087a640 1 --2- 172.21.15.132:0/813611007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c152f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe140009870 tx=0x7fe14002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e222b763a1e4a75b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:38.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.638+0000 7fe14b7fe640 1 -- 172.21.15.132:0/813611007 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140030840 con 0x7fe14c14fd30 2023-11-18T20:40:38.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.638+0000 7fe14b7fe640 1 -- 172.21.15.132:0/813611007 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1400309a0 con 0x7fe14c14fd30 2023-11-18T20:40:38.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.638+0000 7fe14b7fe640 1 -- 172.21.15.132:0/813611007 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140030d30 con 0x7fe14c14fd30 2023-11-18T20:40:38.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.639+0000 7fe152ade640 1 -- 172.21.15.132:0/813611007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 msgr2=0x7fe14c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.639+0000 7fe152ade640 1 --2- 172.21.15.132:0/813611007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c152f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe140009870 tx=0x7fe14002b980 comp rx=0 tx=0).stop 2023-11-18T20:40:38.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.639+0000 7fe152ade640 1 -- 172.21.15.132:0/813611007 shutdown_connections 2023-11-18T20:40:38.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.639+0000 7fe152ade640 1 --2- 172.21.15.132:0/813611007 >> v2:172.21.15.161:3300/0 conn(0x7fe14c0c3ea0 0x7fe14c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.639+0000 7fe152ade640 1 --2- 172.21.15.132:0/813611007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c152f20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.639+0000 7fe152ade640 1 -- 172.21.15.132:0/813611007 >> 172.21.15.132:0/813611007 conn(0x7fe14c06a500 msgr2=0x7fe14c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:38.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.639+0000 7fe152ade640 1 -- 172.21.15.132:0/813611007 shutdown_connections 2023-11-18T20:40:38.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.639+0000 7fe152ade640 1 -- 172.21.15.132:0/813611007 wait complete. 2023-11-18T20:40:38.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.641+0000 7fe152ade640 1 Processor -- start 2023-11-18T20:40:38.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.642+0000 7fe152ade640 1 -- start start 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe152ade640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe14c06d0a0 0x7fe14c0bace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe152ade640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe14c0c3ea0 0x7fe14c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe152ade640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c1dd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe152ade640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c1dccb0 con 0x7fe14c06d0a0 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe152ade640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c1dc4e0 con 0x7fe14c0c3ea0 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe152ade640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c156090 con 0x7fe14c14fd30 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe15087a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe14c06d0a0 0x7fe14c0bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe15087a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe14c06d0a0 0x7fe14c0bace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56058/0 (socket says 172.21.15.132:56058) 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.643+0000 7fe15087a640 1 -- 172.21.15.132:0/3332955840 learned_addr learned my addr 172.21.15.132:0/3332955840 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe15107b640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c1dd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe15087a640 1 -- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 msgr2=0x7fe14c1dd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe14bfff640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe14c0c3ea0 0x7fe14c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe15087a640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c1dd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe15087a640 1 -- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe14c0c3ea0 msgr2=0x7fe14c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe15087a640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe14c0c3ea0 0x7fe14c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe15087a640 1 -- 172.21.15.132:0/3332955840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144009a70 con 0x7fe14c06d0a0 2023-11-18T20:40:38.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe15107b640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c1dd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:38.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe14bfff640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe14c0c3ea0 0x7fe14c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:38.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe15087a640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe14c06d0a0 0x7fe14c0bace0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe14002b9c0 tx=0x7fe140004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:38.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe1497fa640 1 -- 172.21.15.132:0/3332955840 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14003e040 con 0x7fe14c06d0a0 2023-11-18T20:40:38.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe1497fa640 1 -- 172.21.15.132:0/3332955840 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe140039cb0 con 0x7fe14c06d0a0 2023-11-18T20:40:38.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe1497fa640 1 -- 172.21.15.132:0/3332955840 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140044630 con 0x7fe14c06d0a0 2023-11-18T20:40:38.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1400094d0 con 0x7fe14c06d0a0 2023-11-18T20:40:38.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.644+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c1dc6f0 con 0x7fe14c06d0a0 2023-11-18T20:40:38.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.645+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c068350 con 0x7fe14c06d0a0 2023-11-18T20:40:38.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.646+0000 7fe1497fa640 1 -- 172.21.15.132:0/3332955840 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe140043390 con 0x7fe14c06d0a0 2023-11-18T20:40:38.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.647+0000 7fe1497fa640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe13806ae70 0x7fe13806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:38.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.647+0000 7fe1497fa640 1 -- 172.21.15.132:0/3332955840 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe1400abd50 con 0x7fe14c06d0a0 2023-11-18T20:40:38.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.648+0000 7fe14bfff640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe13806ae70 0x7fe13806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:38.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.649+0000 7fe14bfff640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe13806ae70 0x7fe13806d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe14c14f820 tx=0x7fe13c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:38.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.652+0000 7fe1497fa640 1 -- 172.21.15.132:0/3332955840 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe140076a00 con 0x7fe14c06d0a0 2023-11-18T20:40:38.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.844+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe14c06d540 con 0x7fe14c06d0a0 2023-11-18T20:40:38.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.845+0000 7fe1497fa640 1 -- 172.21.15.132:0/3332955840 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1400340a0 con 0x7fe14c06d0a0 2023-11-18T20:40:38.847 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:38.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe13806ae70 msgr2=0x7fe13806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe13806ae70 0x7fe13806d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe14c14f820 tx=0x7fe13c009040 comp rx=0 tx=0).stop 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe14c06d0a0 msgr2=0x7fe14c0bace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe14c06d0a0 0x7fe14c0bace0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe14002b9c0 tx=0x7fe140004730 comp rx=0 tx=0).stop 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 shutdown_connections 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe13806ae70 0x7fe13806d330 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe14c14fd30 0x7fe14c1dd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe14c0c3ea0 0x7fe14c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 --2- 172.21.15.132:0/3332955840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe14c06d0a0 0x7fe14c0bace0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 >> 172.21.15.132:0/3332955840 conn(0x7fe14c06a500 msgr2=0x7fe14c0c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:38.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 shutdown_connections 2023-11-18T20:40:38.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:38.848+0000 7fe152ade640 1 -- 172.21.15.132:0/3332955840 wait complete. 2023-11-18T20:40:38.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:40:39.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.080+0000 7fe9215d5640 1 Processor -- start 2023-11-18T20:40:39.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.080+0000 7fe9215d5640 1 -- start start 2023-11-18T20:40:39.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.082+0000 7fe9215d5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe91c152f20 0x7fe91c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.082+0000 7fe9215d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91c0c64a0 con 0x7fe91c06d0a0 2023-11-18T20:40:39.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.082+0000 7fe9215d5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91c0c5c00 con 0x7fe91c14fd30 2023-11-18T20:40:39.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.082+0000 7fe9215d5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c0c5ee0 con 0x7fe91c152f20 2023-11-18T20:40:39.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.082+0000 7fe91a7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe91c06d0a0 0x7fe91c0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43634/0 (socket says 172.21.15.132:43634) 2023-11-18T20:40:39.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.082+0000 7fe91a7fc640 1 -- 172.21.15.132:0/247667007 learned_addr learned my addr 172.21.15.132:0/247667007 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:39.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.082+0000 7fe91b7fe640 1 --2- 172.21.15.132:0/247667007 >> v2:172.21.15.161:3300/0 conn(0x7fe91c152f20 0x7fe91c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.082+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096172970 0 0) 0x7fe91c0c64a0 con 0x7fe91c06d0a0 2023-11-18T20:40:39.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe904003520 con 0x7fe91c06d0a0 2023-11-18T20:40:39.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2864845379 0 0) 0x7fe904003520 con 0x7fe91c06d0a0 2023-11-18T20:40:39.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 >> v2:172.21.15.161:3300/0 conn(0x7fe91c152f20 msgr2=0x7fe91c0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 --2- 172.21.15.132:0/247667007 >> v2:172.21.15.161:3300/0 conn(0x7fe91c152f20 0x7fe91c0c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 >> v1:172.21.15.161:6789/0 conn(0x7fe91c14fd30 legacy=0x7fe91c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c0c61c0 con 0x7fe91c06d0a0 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fe910001670 con 0x7fe91c06d0a0 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 >> v1:172.21.15.132:6789/0 conn(0x7fe91c06d0a0 legacy=0x7fe91c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe904003970 0x7fe904003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9040047c0 0x7fe904004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe90400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c0c5ee0 con 0x7fe904005180 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90400c020 con 0x7fe904003970 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90400c1e0 con 0x7fe9040047c0 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.083+0000 7fe91b7fe640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe90400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.084+0000 7fe91b7fe640 1 -- 172.21.15.132:0/247667007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9040047c0 msgr2=0x7fe904004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.084+0000 7fe91b7fe640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9040047c0 0x7fe904004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.084+0000 7fe91affd640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe904003970 0x7fe904003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.084+0000 7fe91b7fe640 1 -- 172.21.15.132:0/247667007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe904003970 msgr2=0x7fe904003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.084+0000 7fe91b7fe640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe904003970 0x7fe904003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.084+0000 7fe91b7fe640 1 -- 172.21.15.132:0/247667007 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe904003520 con 0x7fe904005180 2023-11-18T20:40:39.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.084+0000 7fe91affd640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe904003970 0x7fe904003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:39.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.085+0000 7fe91b7fe640 1 -- 172.21.15.132:0/247667007 reap_dead start 2023-11-18T20:40:39.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.085+0000 7fe91b7fe640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe90400b980 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe914009fc0 tx=0x7fe9040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eb6c7f1a95b32a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.085+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91402cc60 con 0x7fe904005180 2023-11-18T20:40:39.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.085+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91400f040 con 0x7fe904005180 2023-11-18T20:40:39.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.085+0000 7fe919ffb640 1 -- 172.21.15.132:0/247667007 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914003990 con 0x7fe904005180 2023-11-18T20:40:39.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.086+0000 7fe9215d5640 1 -- 172.21.15.132:0/247667007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 msgr2=0x7fe90400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.086+0000 7fe9215d5640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe90400b980 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe914009fc0 tx=0x7fe9040057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.086+0000 7fe9215d5640 1 -- 172.21.15.132:0/247667007 shutdown_connections 2023-11-18T20:40:39.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.086+0000 7fe9215d5640 1 --2- 172.21.15.132:0/247667007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe90400b980 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.086+0000 7fe9215d5640 1 -- 172.21.15.132:0/247667007 >> 172.21.15.132:0/247667007 conn(0x7fe91c06a500 msgr2=0x7fe91c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:39.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.086+0000 7fe9215d5640 1 -- 172.21.15.132:0/247667007 shutdown_connections 2023-11-18T20:40:39.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.086+0000 7fe9215d5640 1 -- 172.21.15.132:0/247667007 wait complete. 2023-11-18T20:40:39.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.088+0000 7fe9215d5640 1 Processor -- start 2023-11-18T20:40:39.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.088+0000 7fe9215d5640 1 -- start start 2023-11-18T20:40:39.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe9215d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe91c1ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe9215d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe91c154270 0x7fe91c0aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe9215d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe91c1547c0 0x7fe91c154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe9215d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c0a8700 con 0x7fe904005180 2023-11-18T20:40:39.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe9215d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c156810 con 0x7fe91c154270 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe9215d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c0a75e0 con 0x7fe91c1547c0 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe91affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe91c1ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe91affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe91c1ea010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56070/0 (socket says 172.21.15.132:56070) 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.089+0000 7fe91affd640 1 -- 172.21.15.132:0/91998297 learned_addr learned my addr 172.21.15.132:0/91998297 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe91affd640 1 -- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe91c1547c0 msgr2=0x7fe91c154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe91a7fc640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe91c154270 0x7fe91c0aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe91affd640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe91c1547c0 0x7fe91c154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe91affd640 1 -- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe91c154270 msgr2=0x7fe91c0aa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe91affd640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe91c154270 0x7fe91c0aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe91affd640 1 -- 172.21.15.132:0/91998297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c0a78c0 con 0x7fe904005180 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe91affd640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe91c1ea010 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe90c000f60 tx=0x7fe90c00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe9037fe640 1 -- 172.21.15.132:0/91998297 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c005480 con 0x7fe904005180 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe9037fe640 1 -- 172.21.15.132:0/91998297 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c003610 con 0x7fe904005180 2023-11-18T20:40:39.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91c0a8390 con 0x7fe904005180 2023-11-18T20:40:39.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe9037fe640 1 -- 172.21.15.132:0/91998297 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0039c0 con 0x7fe904005180 2023-11-18T20:40:39.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.090+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c0aa590 con 0x7fe904005180 2023-11-18T20:40:39.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.091+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c0c3c30 con 0x7fe904005180 2023-11-18T20:40:39.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.092+0000 7fe9037fe640 1 -- 172.21.15.132:0/91998297 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe90c003b20 con 0x7fe904005180 2023-11-18T20:40:39.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.093+0000 7fe9037fe640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe90806ae40 0x7fe90806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.093+0000 7fe9037fe640 1 -- 172.21.15.132:0/91998297 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe90c089830 con 0x7fe904005180 2023-11-18T20:40:39.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.094+0000 7fe91a7fc640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe90806ae40 0x7fe90806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.095+0000 7fe91a7fc640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe90806ae40 0x7fe90806d300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe910000ff0 tx=0x7fe910009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.098+0000 7fe9037fe640 1 -- 172.21.15.132:0/91998297 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe90c054620 con 0x7fe904005180 2023-11-18T20:40:39.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.287+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe91c068350 con 0x7fe904005180 2023-11-18T20:40:39.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.288+0000 7fe9037fe640 1 -- 172.21.15.132:0/91998297 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v59) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe90c001230 con 0x7fe904005180 2023-11-18T20:40:39.289 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.290+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe90806ae40 msgr2=0x7fe90806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.290+0000 7fe9215d5640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe90806ae40 0x7fe90806d300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe910000ff0 tx=0x7fe910009040 comp rx=0 tx=0).stop 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.290+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 msgr2=0x7fe91c1ea010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.290+0000 7fe9215d5640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe91c1ea010 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe90c000f60 tx=0x7fe90c00d9f0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.291+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 shutdown_connections 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.291+0000 7fe9215d5640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe90806ae40 0x7fe90806d300 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.291+0000 7fe9215d5640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe91c1547c0 0x7fe91c154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.291+0000 7fe9215d5640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe91c154270 0x7fe91c0aa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.291+0000 7fe9215d5640 1 --2- 172.21.15.132:0/91998297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe904005180 0x7fe91c1ea010 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.291+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 >> 172.21.15.132:0/91998297 conn(0x7fe91c06a500 msgr2=0x7fe91c0bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:39.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.291+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 shutdown_connections 2023-11-18T20:40:39.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.291+0000 7fe9215d5640 1 -- 172.21.15.132:0/91998297 wait complete. 2023-11-18T20:40:39.311 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:40:39.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.519+0000 7f9e0fbd5640 1 Processor -- start 2023-11-18T20:40:39.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.520+0000 7f9e0fbd5640 1 -- start start 2023-11-18T20:40:39.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0fbd5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e0814e810 0x7f9e081550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0fbd5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e080c7e90 0x7f9e080c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0fbd5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e080bd8d0 con 0x7f9e080c4e50 2023-11-18T20:40:39.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0fbd5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e080c6e60 con 0x7f9e080c7e90 2023-11-18T20:40:39.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0fbd5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e08155600 con 0x7f9e0814e810 2023-11-18T20:40:39.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0d170640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e080c7e90 0x7f9e080c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0d170640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e080c7e90 0x7f9e080c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56078/0 (socket says 172.21.15.132:56078) 2023-11-18T20:40:39.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0d170640 1 -- 172.21.15.132:0/3100806895 learned_addr learned my addr 172.21.15.132:0/3100806895 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:39.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0d170640 1 -- 172.21.15.132:0/3100806895 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e0814e810 msgr2=0x7f9e081550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.521+0000 7f9e0d170640 1 --2- 172.21.15.132:0/3100806895 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e0814e810 0x7f9e081550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.522+0000 7f9e0d170640 1 -- 172.21.15.132:0/3100806895 >> v1:172.21.15.161:6789/0 conn(0x7f9e080c4e50 legacy=0x7f9e0806b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.522+0000 7f9e0d170640 1 -- 172.21.15.132:0/3100806895 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080c70d0 con 0x7f9e080c7e90 2023-11-18T20:40:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.523+0000 7f9e0d170640 1 --2- 172.21.15.132:0/3100806895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c7e90 0x7f9e080c4910 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009870 tx=0x7f9df802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8449f9ee19044e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.523+0000 7f9e0c96f640 1 -- 172.21.15.132:0/3100806895 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80317c0 con 0x7f9e080c7e90 2023-11-18T20:40:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.523+0000 7f9e0c96f640 1 -- 172.21.15.132:0/3100806895 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df8031920 con 0x7f9e080c7e90 2023-11-18T20:40:39.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.523+0000 7f9e0c96f640 1 -- 172.21.15.132:0/3100806895 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8031cb0 con 0x7f9e080c7e90 2023-11-18T20:40:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.524+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3100806895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c7e90 msgr2=0x7f9e080c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.524+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3100806895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c7e90 0x7f9e080c4910 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009870 tx=0x7f9df802b860 comp rx=0 tx=0).stop 2023-11-18T20:40:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.524+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3100806895 shutdown_connections 2023-11-18T20:40:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.524+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3100806895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c7e90 0x7f9e080c4910 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.524+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3100806895 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e0814e810 0x7f9e081550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.524+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3100806895 >> 172.21.15.132:0/3100806895 conn(0x7f9e080ca170 msgr2=0x7f9e080ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:39.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.524+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3100806895 shutdown_connections 2023-11-18T20:40:39.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.524+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3100806895 wait complete. 2023-11-18T20:40:39.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.526+0000 7f9e0fbd5640 1 Processor -- start 2023-11-18T20:40:39.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.526+0000 7f9e0fbd5640 1 -- start start 2023-11-18T20:40:39.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0fbd5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c4e50 0x7f9e081eac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0fbd5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e080c7e90 0x7f9e080c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0fbd5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e0814e810 0x7f9e080be9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0fbd5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080be510 con 0x7f9e080c4e50 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0fbd5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080bdbe0 con 0x7f9e0814e810 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0fbd5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080bdec0 con 0x7f9e080c7e90 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0d971640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c4e50 0x7f9e081eac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0d971640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c4e50 0x7f9e081eac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56080/0 (socket says 172.21.15.132:56080) 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0d971640 1 -- 172.21.15.132:0/3638351848 learned_addr learned my addr 172.21.15.132:0/3638351848 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0d971640 1 -- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e080c7e90 msgr2=0x7f9e080c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0d971640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e080c7e90 0x7f9e080c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0d971640 1 -- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e0814e810 msgr2=0x7f9e080be9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0d971640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e0814e810 0x7f9e080be9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.527+0000 7f9e0d971640 1 -- 172.21.15.132:0/3638351848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80094d0 con 0x7f9e080c4e50 2023-11-18T20:40:39.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.528+0000 7f9e0d971640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c4e50 0x7f9e081eac40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400b410 tx=0x7f9e0400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.528+0000 7f9dfe7fc640 1 -- 172.21.15.132:0/3638351848 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04011830 con 0x7f9e080c4e50 2023-11-18T20:40:39.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.528+0000 7f9dfe7fc640 1 -- 172.21.15.132:0/3638351848 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e040119b0 con 0x7f9e080c4e50 2023-11-18T20:40:39.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.528+0000 7f9dfe7fc640 1 -- 172.21.15.132:0/3638351848 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04011d60 con 0x7f9e080c4e50 2023-11-18T20:40:39.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.528+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e080be1a0 con 0x7f9e080c4e50 2023-11-18T20:40:39.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.528+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e081eb660 con 0x7f9e080c4e50 2023-11-18T20:40:39.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.529+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e08068350 con 0x7f9e080c4e50 2023-11-18T20:40:39.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.530+0000 7f9dfe7fc640 1 -- 172.21.15.132:0/3638351848 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e0401a400 con 0x7f9e080c4e50 2023-11-18T20:40:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.531+0000 7f9dfe7fc640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dec06ae70 0x7f9dec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.532+0000 7f9dfe7fc640 1 -- 172.21.15.132:0/3638351848 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e04089a60 con 0x7f9e080c4e50 2023-11-18T20:40:39.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.532+0000 7f9e0d170640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dec06ae70 0x7f9dec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.533+0000 7f9e0d170640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dec06ae70 0x7f9dec06d330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9df8036000 tx=0x7f9df8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.536+0000 7f9dfe7fc640 1 -- 172.21.15.132:0/3638351848 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e04054820 con 0x7f9e080c4e50 2023-11-18T20:40:39.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.724+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9e08152100 con 0x7f9e080c4e50 2023-11-18T20:40:39.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.725+0000 7f9dfe7fc640 1 -- 172.21.15.132:0/3638351848 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v59) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9e04015020 con 0x7f9e080c4e50 2023-11-18T20:40:39.726 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:39.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.727+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dec06ae70 msgr2=0x7f9dec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.727+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dec06ae70 0x7f9dec06d330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9df8036000 tx=0x7f9df8030000 comp rx=0 tx=0).stop 2023-11-18T20:40:39.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c4e50 msgr2=0x7f9e081eac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c4e50 0x7f9e081eac40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400b410 tx=0x7f9e0400b8d0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 shutdown_connections 2023-11-18T20:40:39.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9dec06ae70 0x7f9dec06d330 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e0814e810 0x7f9e080be9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e080c7e90 0x7f9e080c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 --2- 172.21.15.132:0/3638351848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e080c4e50 0x7f9e081eac40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 >> 172.21.15.132:0/3638351848 conn(0x7f9e080ca170 msgr2=0x7f9e080aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:39.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 shutdown_connections 2023-11-18T20:40:39.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.728+0000 7f9e0fbd5640 1 -- 172.21.15.132:0/3638351848 wait complete. 2023-11-18T20:40:39.746 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:40:39.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.960+0000 7f2cefca2640 1 Processor -- start 2023-11-18T20:40:39.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.960+0000 7f2cefca2640 1 -- start start 2023-11-18T20:40:39.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.962+0000 7f2cefca2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 0x7f2ce814f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.962+0000 7f2cefca2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ce814fe80 0x7f2ce8070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.962+0000 7f2cefca2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce81534e0 con 0x7f2ce806a770 2023-11-18T20:40:39.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.962+0000 7f2cefca2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce80aab70 con 0x7f2ce814fe80 2023-11-18T20:40:39.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.962+0000 7f2cefca2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8152f80 con 0x7f2ce8072050 2023-11-18T20:40:39.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.962+0000 7f2ceda3e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2ce806a770 0x7f2ce806ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43640/0 (socket says 172.21.15.132:43640) 2023-11-18T20:40:39.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.962+0000 7f2ceda3e640 1 -- 172.21.15.132:0/4111609187 learned_addr learned my addr 172.21.15.132:0/4111609187 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2cee23f640 1 --2- 172.21.15.132:0/4111609187 >> v2:172.21.15.161:3300/0 conn(0x7f2ce814fe80 0x7f2ce8070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ced23d640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 0x7f2ce814f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037395239 0 0) 0x7f2ce81534e0 con 0x7f2ce806a770 2023-11-18T20:40:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd8003520 con 0x7f2ce806a770 2023-11-18T20:40:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2335399508 0 0) 0x7f2cd8003520 con 0x7f2ce806a770 2023-11-18T20:40:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 msgr2=0x7f2ce814f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 0x7f2ce814f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 >> v2:172.21.15.161:3300/0 conn(0x7f2ce814fe80 msgr2=0x7f2ce8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 --2- 172.21.15.132:0/4111609187 >> v2:172.21.15.161:3300/0 conn(0x7f2ce814fe80 0x7f2ce8070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce80ac470 con 0x7f2ce806a770 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f2cdc0019f0 con 0x7f2ce806a770 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 >> v1:172.21.15.132:6789/0 conn(0x7f2ce806a770 legacy=0x7f2ce806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cd8003970 0x7f2cd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 0x7f2cd80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2cd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80aab70 con 0x7f2cd8004d00 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8152f80 con 0x7f2cd8003970 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd800bab0 con 0x7f2ce8072050 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.963+0000 7f2cee23f640 1 --2- 172.21.15.132:0/4111609187 >> v2:172.21.15.161:3300/0 conn(0x7f2ce814fe80 0x7f2ce8070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2cee23f640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2cd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2ced23d640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 0x7f2cd80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2ceda3e640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cd8003970 0x7f2cd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2cee23f640 1 -- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 msgr2=0x7f2cd80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2cee23f640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 0x7f2cd80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2cee23f640 1 -- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cd8003970 msgr2=0x7f2cd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:39.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2cee23f640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cd8003970 0x7f2cd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2cee23f640 1 -- 172.21.15.132:0/4111609187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd8003520 con 0x7f2cd8004d00 2023-11-18T20:40:39.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2ced23d640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce8072050 0x7f2cd80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:39.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.964+0000 7f2ceda3e640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cd8003970 0x7f2cd8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:39.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.965+0000 7f2cee23f640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2cd8005180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00098a0 tx=0x7f2cd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530f1ad5bd1a9fa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.966+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0037600 con 0x7f2cd8004d00 2023-11-18T20:40:39.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.966+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0037760 con 0x7f2cd8004d00 2023-11-18T20:40:39.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.966+0000 7f2ceca3c640 1 -- 172.21.15.132:0/4111609187 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0037ad0 con 0x7f2cd8004d00 2023-11-18T20:40:39.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.966+0000 7f2cefca2640 1 -- 172.21.15.132:0/4111609187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 msgr2=0x7f2cd8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.966+0000 7f2cefca2640 1 --2- 172.21.15.132:0/4111609187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2cd8005180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00098a0 tx=0x7f2cd80057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.966+0000 7f2cee23f640 1 -- 172.21.15.132:0/4111609187 reap_dead start 2023-11-18T20:40:39.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.966+0000 7f2cefca2640 1 -- 172.21.15.132:0/4111609187 shutdown_connections 2023-11-18T20:40:39.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.966+0000 7f2cefca2640 1 -- 172.21.15.132:0/4111609187 >> 172.21.15.132:0/4111609187 conn(0x7f2ce80c6ee0 msgr2=0x7f2ce80c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:39.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.967+0000 7f2cefca2640 1 -- 172.21.15.132:0/4111609187 shutdown_connections 2023-11-18T20:40:39.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.967+0000 7f2cefca2640 1 -- 172.21.15.132:0/4111609187 wait complete. 2023-11-18T20:40:39.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.969+0000 7f2cefca2640 1 Processor -- start 2023-11-18T20:40:39.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.969+0000 7f2cefca2640 1 -- start start 2023-11-18T20:40:39.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2cefca2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2ce8143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2cefca2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ce8142f90 0x7f2ce814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2cefca2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce814f110 0x7f2ce81ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2cefca2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8143650 con 0x7f2cd8004d00 2023-11-18T20:40:39.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2cefca2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80c1fd0 con 0x7f2ce8142f90 2023-11-18T20:40:39.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2cefca2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce81e9ff0 con 0x7f2ce814f110 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2ceda3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2ce8143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2ceda3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2ce8143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56096/0 (socket says 172.21.15.132:56096) 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.970+0000 7f2ceda3e640 1 -- 172.21.15.132:0/3136984703 learned_addr learned my addr 172.21.15.132:0/3136984703 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ced23d640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ce8142f90 0x7f2ce814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ceda3e640 1 -- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce814f110 msgr2=0x7f2ce81ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ceda3e640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce814f110 0x7f2ce81ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ceda3e640 1 -- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ce8142f90 msgr2=0x7f2ce814ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ceda3e640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ce8142f90 0x7f2ce814ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ceda3e640 1 -- 172.21.15.132:0/3136984703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8143410 con 0x7f2cd8004d00 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ced23d640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ce8142f90 0x7f2ce814ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:39.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ceda3e640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2ce8143b10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc001c20 tx=0x7f2cdc00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ce67fc640 1 -- 172.21.15.132:0/3136984703 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc004d60 con 0x7f2cd8004d00 2023-11-18T20:40:39.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ce67fc640 1 -- 172.21.15.132:0/3136984703 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc00be60 con 0x7f2cd8004d00 2023-11-18T20:40:39.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2ce67fc640 1 -- 172.21.15.132:0/3136984703 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc007310 con 0x7f2cd8004d00 2023-11-18T20:40:39.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.971+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce8143830 con 0x7f2cd8004d00 2023-11-18T20:40:39.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.972+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce80c2500 con 0x7f2cd8004d00 2023-11-18T20:40:39.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.973+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce814f920 con 0x7f2cd8004d00 2023-11-18T20:40:39.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.974+0000 7f2ce67fc640 1 -- 172.21.15.132:0/3136984703 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2cdc007470 con 0x7f2cd8004d00 2023-11-18T20:40:39.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.975+0000 7f2ce67fc640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ccc06ae70 0x7f2ccc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:39.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.975+0000 7f2ce67fc640 1 -- 172.21.15.132:0/3136984703 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2cdc089780 con 0x7f2cd8004d00 2023-11-18T20:40:39.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.975+0000 7f2ced23d640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ccc06ae70 0x7f2ccc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:39.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.976+0000 7f2ced23d640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ccc06ae70 0x7f2ccc06d330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80aa0b0 tx=0x7f2cd4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:39.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:39.979+0000 7f2ce67fc640 1 -- 172.21.15.132:0/3136984703 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ce814f920 con 0x7f2cd8004d00 2023-11-18T20:40:40.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.182+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2ce814f920 con 0x7f2cd8004d00 2023-11-18T20:40:40.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.183+0000 7f2ce67fc640 1 -- 172.21.15.132:0/3136984703 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2ce814f920 con 0x7f2cd8004d00 2023-11-18T20:40:40.184 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ccc06ae70 msgr2=0x7f2ccc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ccc06ae70 0x7f2ccc06d330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80aa0b0 tx=0x7f2cd4008040 comp rx=0 tx=0).stop 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 msgr2=0x7f2ce8143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2ce8143b10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc001c20 tx=0x7f2cdc00b4a0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 shutdown_connections 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2ccc06ae70 0x7f2ccc06d330 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ce814f110 0x7f2ce81ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ce8142f90 0x7f2ce814ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 --2- 172.21.15.132:0/3136984703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd8004d00 0x7f2ce8143b10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.185+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 >> 172.21.15.132:0/3136984703 conn(0x7f2ce80c6ee0 msgr2=0x7f2ce81505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:40.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.186+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 shutdown_connections 2023-11-18T20:40:40.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.186+0000 7f2cefca2640 1 -- 172.21.15.132:0/3136984703 wait complete. 2023-11-18T20:40:40.205 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-18T20:40:40.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:40.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:40.326 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:40:40.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:40.326 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T20:40:40.382 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:40:40.382 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:40.435 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-18T20:40:40.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:40:40.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.655+0000 7fcd69d47640 1 Processor -- start 2023-11-18T20:40:40.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.655+0000 7fcd69d47640 1 -- start start 2023-11-18T20:40:40.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.656+0000 7fcd69d47640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd640c27b0 0x7fcd64151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:40.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.656+0000 7fcd69d47640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd640710e0 con 0x7fcd6414eae0 2023-11-18T20:40:40.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.656+0000 7fcd69d47640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd64070840 con 0x7fcd6406b970 2023-11-18T20:40:40.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.656+0000 7fcd69d47640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd64072b90 con 0x7fcd640c27b0 2023-11-18T20:40:40.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.657+0000 7fcd637fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcd6414eae0 0x7fcd6406e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43648/0 (socket says 172.21.15.132:43648) 2023-11-18T20:40:40.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.657+0000 7fcd637fe640 1 -- 172.21.15.132:0/3412868526 learned_addr learned my addr 172.21.15.132:0/3412868526 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:40.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.657+0000 7fcd63fff640 1 --2- 172.21.15.132:0/3412868526 >> v2:172.21.15.161:3300/0 conn(0x7fcd640c27b0 0x7fcd64151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:40.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.657+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203309569 0 0) 0x7fcd640710e0 con 0x7fcd6414eae0 2023-11-18T20:40:40.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.657+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd4c003520 con 0x7fcd6414eae0 2023-11-18T20:40:40.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.657+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4046554748 0 0) 0x7fcd4c003520 con 0x7fcd6414eae0 2023-11-18T20:40:40.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 >> v2:172.21.15.161:3300/0 conn(0x7fcd640c27b0 msgr2=0x7fcd64151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:40.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 --2- 172.21.15.132:0/3412868526 >> v2:172.21.15.161:3300/0 conn(0x7fcd640c27b0 0x7fcd64151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 >> v1:172.21.15.161:6789/0 conn(0x7fcd6406b970 legacy=0x7fcd64151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd64070b20 con 0x7fcd6414eae0 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fcd540019f0 con 0x7fcd6414eae0 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 >> v1:172.21.15.132:6789/0 conn(0x7fcd6414eae0 legacy=0x7fcd6406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c003970 0x7fcd4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd4c0047c0 0x7fcd4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0052a0 0x7fcd4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64072b90 con 0x7fcd4c0047c0 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c00c170 con 0x7fcd4c003970 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c00e540 con 0x7fcd4c0052a0 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd62ffd640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd4c0047c0 0x7fcd4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd637fe640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c003970 0x7fcd4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd62ffd640 1 -- 172.21.15.132:0/3412868526 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0052a0 msgr2=0x7fcd4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd62ffd640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0052a0 0x7fcd4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd62ffd640 1 -- 172.21.15.132:0/3412868526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c003970 msgr2=0x7fcd4c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:40.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd62ffd640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c003970 0x7fcd4c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd62ffd640 1 -- 172.21.15.132:0/3412868526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c003520 con 0x7fcd4c0047c0 2023-11-18T20:40:40.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.658+0000 7fcd63fff640 1 -- 172.21.15.132:0/3412868526 reap_dead start 2023-11-18T20:40:40.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd62ffd640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd4c0047c0 0x7fcd4c004c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcd58001720 tx=0x7fcd4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a5d54de6174091 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:40.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580052d0 con 0x7fcd4c0047c0 2023-11-18T20:40:40.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5802e050 con 0x7fcd4c0047c0 2023-11-18T20:40:40.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd627fc640 1 -- 172.21.15.132:0/3412868526 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58003830 con 0x7fcd4c0047c0 2023-11-18T20:40:40.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd69d47640 1 -- 172.21.15.132:0/3412868526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd4c0047c0 msgr2=0x7fcd4c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd69d47640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd4c0047c0 0x7fcd4c004c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcd58001720 tx=0x7fcd4c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd69d47640 1 -- 172.21.15.132:0/3412868526 shutdown_connections 2023-11-18T20:40:40.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd69d47640 1 --2- 172.21.15.132:0/3412868526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd4c0047c0 0x7fcd4c004c40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.660+0000 7fcd69d47640 1 -- 172.21.15.132:0/3412868526 >> 172.21.15.132:0/3412868526 conn(0x7fcd640c3120 msgr2=0x7fcd640c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:40.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.661+0000 7fcd69d47640 1 -- 172.21.15.132:0/3412868526 shutdown_connections 2023-11-18T20:40:40.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.661+0000 7fcd69d47640 1 -- 172.21.15.132:0/3412868526 wait complete. 2023-11-18T20:40:40.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.662+0000 7fcd69d47640 1 Processor -- start 2023-11-18T20:40:40.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.662+0000 7fcd69d47640 1 -- start start 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.663+0000 7fcd69d47640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0047c0 0x7fcd640c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.663+0000 7fcd69d47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641511a0 0x7fcd6414c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.663+0000 7fcd69d47640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd64150680 0x7fcd6414c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.663+0000 7fcd69d47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6414b540 con 0x7fcd641511a0 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.663+0000 7fcd69d47640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641501f0 con 0x7fcd64150680 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.663+0000 7fcd69d47640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64150d90 con 0x7fcd4c0047c0 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641511a0 0x7fcd6414c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641511a0 0x7fcd6414c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56116/0 (socket says 172.21.15.132:56116) 2023-11-18T20:40:40.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 -- 172.21.15.132:0/2379053221 learned_addr learned my addr 172.21.15.132:0/2379053221 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 -- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0047c0 msgr2=0x7fcd640c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0047c0 0x7fcd640c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 -- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd64150680 msgr2=0x7fcd6414c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd64150680 0x7fcd6414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 -- 172.21.15.132:0/2379053221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6414b790 con 0x7fcd641511a0 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.664+0000 7fcd62ffd640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641511a0 0x7fcd6414c1f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcd58005040 tx=0x7fcd58001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.665+0000 7fcd4bfff640 1 -- 172.21.15.132:0/2379053221 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580076c0 con 0x7fcd641511a0 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.665+0000 7fcd4bfff640 1 -- 172.21.15.132:0/2379053221 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58007a30 con 0x7fcd641511a0 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.665+0000 7fcd4bfff640 1 -- 172.21.15.132:0/2379053221 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58006be0 con 0x7fcd641511a0 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.665+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6414f8c0 con 0x7fcd641511a0 2023-11-18T20:40:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.665+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6414fe80 con 0x7fcd641511a0 2023-11-18T20:40:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.666+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd64068350 con 0x7fcd641511a0 2023-11-18T20:40:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.667+0000 7fcd4bfff640 1 -- 172.21.15.132:0/2379053221 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd58006d40 con 0x7fcd641511a0 2023-11-18T20:40:40.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.668+0000 7fcd4bfff640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd5006ae40 0x7fcd5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:40.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.668+0000 7fcd4bfff640 1 -- 172.21.15.132:0/2379053221 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcd580ab4e0 con 0x7fcd641511a0 2023-11-18T20:40:40.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.669+0000 7fcd637fe640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd5006ae40 0x7fcd5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:40.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.670+0000 7fcd637fe640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd5006ae40 0x7fcd5006d300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcd54001b20 tx=0x7fcd54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:40.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.672+0000 7fcd4bfff640 1 -- 172.21.15.132:0/2379053221 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd58076220 con 0x7fcd641511a0 2023-11-18T20:40:40.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.900+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd64150330 con 0x7fcd641511a0 2023-11-18T20:40:40.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.901+0000 7fcd4bfff640 1 -- 172.21.15.132:0/2379053221 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+149 (secure 0 0 0) 0x7fcd580410b0 con 0x7fcd641511a0 2023-11-18T20:40:40.902 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:40:40.902 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-18T20:40:40.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd5006ae40 msgr2=0x7fcd5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd5006ae40 0x7fcd5006d300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcd54001b20 tx=0x7fcd54009040 comp rx=0 tx=0).stop 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641511a0 msgr2=0x7fcd6414c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641511a0 0x7fcd6414c1f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcd58005040 tx=0x7fcd58001120 comp rx=0 tx=0).stop 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 shutdown_connections 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd5006ae40 0x7fcd5006d300 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd64150680 0x7fcd6414c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641511a0 0x7fcd6414c1f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 --2- 172.21.15.132:0/2379053221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0047c0 0x7fcd640c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 >> 172.21.15.132:0/2379053221 conn(0x7fcd640c3120 msgr2=0x7fcd640712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.903+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 shutdown_connections 2023-11-18T20:40:40.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:40.904+0000 7fcd69d47640 1 -- 172.21.15.132:0/2379053221 wait complete. 2023-11-18T20:40:40.922 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-18T20:40:40.922 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:40:40.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-18T20:40:40.922 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T20:40:40.922 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:40.923 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-18T20:40:40.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:40:40.923 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:40:40.923 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:40:40.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:40.923 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-18T20:40:40.984 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:40:40.984 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:40:40.984 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:40.985 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42268sec preferred_lft 42268sec 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::78f3:28ff:fe93:897/64 scope link 2023-11-18T20:40:40.986 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:40.987 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:40:40.987 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:40:40.987 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::442e:5aff:fe28:3e67/64 scope link 2023-11-18T20:40:40.987 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:40.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:40.988 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:40:41.079 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:40:41.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:41.083 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-18T20:40:41.137 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-18T20:40:41.137 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:40:41.138 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:40:41.138 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:40:41.138 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:40:41.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:41.138 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:40:41.138 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:40:41.138 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:40:41.138 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:40:41.138 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:40:41.139 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:40:41.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:41.313 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:40:41.364 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T20:40:41.364 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:40:41.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:41.364 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-18T20:40:41.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:40:41.458 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:41.509 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:40:41.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:40:41.510 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:41.560 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:40:41.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:41.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:40:41.693 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:40:41.693 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:40:41.693 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:40:41.715 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:40:41.715 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:40:41.715 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:40:41.715 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:40:41.715 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:40:41.741 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:40:41.741 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:40:41.741 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:40:41.741 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:40:41.741 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:40:41.741 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:40:41.741 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:40:41.742 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:40:41.744 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T20:40:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:40:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:40:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:40:41.744 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:40:41.748 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:40:41.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:41.749 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:41.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:41.843 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:40:41.922 INFO:teuthology.orchestra.run.smithi161.stdout:client4910 2023-11-18T20:40:41.922 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:40:41.922 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:41.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-11-18T20:40:42.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.210+0000 7f5eb4789640 1 Processor -- start 2023-11-18T20:40:42.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.211+0000 7f5eb4789640 1 -- start start 2023-11-18T20:40:42.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.212+0000 7f5eb4789640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5eac0c45d0 0x7f5eac155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.212+0000 7f5eb4789640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5eac0c3340 0x7f5eac156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.212+0000 7f5eb4789640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac0bfdc0 con 0x7f5eac0c5ec0 2023-11-18T20:40:42.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.212+0000 7f5eb4789640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac06e390 con 0x7f5eac0c3340 2023-11-18T20:40:42.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.212+0000 7f5eb4789640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac06ddd0 con 0x7f5eac0c45d0 2023-11-18T20:40:42.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.213+0000 7f5eb2d26640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5eac0c3340 0x7f5eac156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.213+0000 7f5eb2d26640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5eac0c3340 0x7f5eac156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56126/0 (socket says 172.21.15.132:56126) 2023-11-18T20:40:42.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.213+0000 7f5eb2d26640 1 -- 172.21.15.132:0/1595601236 learned_addr learned my addr 172.21.15.132:0/1595601236 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:42.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.213+0000 7f5eb1d24640 1 --2- 172.21.15.132:0/1595601236 >> v2:172.21.15.161:3300/0 conn(0x7f5eac0c45d0 0x7f5eac155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.213+0000 7f5eb2d26640 1 -- 172.21.15.132:0/1595601236 >> v2:172.21.15.161:3300/0 conn(0x7f5eac0c45d0 msgr2=0x7f5eac155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:42.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.213+0000 7f5eb2d26640 1 --2- 172.21.15.132:0/1595601236 >> v2:172.21.15.161:3300/0 conn(0x7f5eac0c45d0 0x7f5eac155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.213+0000 7f5eb2d26640 1 -- 172.21.15.132:0/1595601236 >> v1:172.21.15.161:6789/0 conn(0x7f5eac0c5ec0 legacy=0x7f5eac0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:42.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.213+0000 7f5eb2d26640 1 -- 172.21.15.132:0/1595601236 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac06e0b0 con 0x7f5eac0c3340 2023-11-18T20:40:42.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.214+0000 7f5eb2d26640 1 --2- 172.21.15.132:0/1595601236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac156370 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009870 tx=0x7f5ea402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7c9aa8d529dfc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:42.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb1523640 1 -- 172.21.15.132:0/1595601236 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4031750 con 0x7f5eac0c3340 2023-11-18T20:40:42.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb1523640 1 -- 172.21.15.132:0/1595601236 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea40318b0 con 0x7f5eac0c3340 2023-11-18T20:40:42.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb1523640 1 -- 172.21.15.132:0/1595601236 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4031c40 con 0x7f5eac0c3340 2023-11-18T20:40:42.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb4789640 1 -- 172.21.15.132:0/1595601236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 msgr2=0x7f5eac156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1595601236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac156370 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009870 tx=0x7f5ea402b7f0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb4789640 1 -- 172.21.15.132:0/1595601236 shutdown_connections 2023-11-18T20:40:42.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1595601236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac156370 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1595601236 >> v2:172.21.15.161:3300/0 conn(0x7f5eac0c45d0 0x7f5eac155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb4789640 1 -- 172.21.15.132:0/1595601236 >> 172.21.15.132:0/1595601236 conn(0x7f5eac06a500 msgr2=0x7f5eac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:42.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb4789640 1 -- 172.21.15.132:0/1595601236 shutdown_connections 2023-11-18T20:40:42.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.215+0000 7f5eb4789640 1 -- 172.21.15.132:0/1595601236 wait complete. 2023-11-18T20:40:42.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.217+0000 7f5eb4789640 1 Processor -- start 2023-11-18T20:40:42.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.217+0000 7f5eb4789640 1 -- start start 2023-11-18T20:40:42.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb4789640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac0a7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb4789640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5eac0c45d0 0x7f5eac14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb4789640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5eac0c5ec0 0x7f5eac14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb4789640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac156b60 con 0x7f5eac0c3340 2023-11-18T20:40:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb4789640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac155f40 con 0x7f5eac0c45d0 2023-11-18T20:40:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb4789640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac14eb10 con 0x7f5eac0c5ec0 2023-11-18T20:40:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb2525640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac0a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb2525640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac0a7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56138/0 (socket says 172.21.15.132:56138) 2023-11-18T20:40:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.218+0000 7f5eb2525640 1 -- 172.21.15.132:0/1406007027 learned_addr learned my addr 172.21.15.132:0/1406007027 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb1d24640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5eac0c45d0 0x7f5eac14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb2525640 1 -- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5eac0c5ec0 msgr2=0x7f5eac14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb2d26640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5eac0c5ec0 0x7f5eac14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb2525640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5eac0c5ec0 0x7f5eac14e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb2525640 1 -- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5eac0c45d0 msgr2=0x7f5eac14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb2525640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5eac0c45d0 0x7f5eac14e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb2525640 1 -- 172.21.15.132:0/1406007027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40094d0 con 0x7f5eac0c3340 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb1d24640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5eac0c45d0 0x7f5eac14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb2525640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac0a7670 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00ba80 tx=0x7f5e9c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eaaffd640 1 -- 172.21.15.132:0/1406007027 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00cc00 con 0x7f5eac0c3340 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eaaffd640 1 -- 172.21.15.132:0/1406007027 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c00cd60 con 0x7f5eac0c3340 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.219+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac155630 con 0x7f5eac0c3340 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.220+0000 7f5eaaffd640 1 -- 172.21.15.132:0/1406007027 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c003bb0 con 0x7f5eac0c3340 2023-11-18T20:40:42.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.220+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac155940 con 0x7f5eac0c3340 2023-11-18T20:40:42.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.221+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac068350 con 0x7f5eac0c3340 2023-11-18T20:40:42.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.222+0000 7f5eaaffd640 1 -- 172.21.15.132:0/1406007027 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e9c014440 con 0x7f5eac0c3340 2023-11-18T20:40:42.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.223+0000 7f5eaaffd640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e9806ae40 0x7f5e9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.223+0000 7f5eaaffd640 1 -- 172.21.15.132:0/1406007027 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5e9c0897a0 con 0x7f5eac0c3340 2023-11-18T20:40:42.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.223+0000 7f5eb1d24640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e9806ae40 0x7f5e9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.224+0000 7f5eb1d24640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e9806ae40 0x7f5e9806d300 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5eac1eabc0 tx=0x7f5ea0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:42.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.227+0000 7f5eaaffd640 1 -- 172.21.15.132:0/1406007027 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e9c0544e0 con 0x7f5eac0c3340 2023-11-18T20:40:42.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.489+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f5eac0c5340 con 0x7f5eac0c3340 2023-11-18T20:40:42.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.493+0000 7f5eaaffd640 1 -- 172.21.15.132:0/1406007027 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v17) v1 ==== 291+0+0 (secure 0 0 0) 0x7f5e9c057b00 con 0x7f5eac0c3340 2023-11-18T20:40:42.494 INFO:teuthology.orchestra.run.smithi132.stderr:added key for client.testuser 2023-11-18T20:40:42.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e9806ae40 msgr2=0x7f5e9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e9806ae40 0x7f5e9806d300 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5eac1eabc0 tx=0x7f5ea0008040 comp rx=0 tx=0).stop 2023-11-18T20:40:42.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 msgr2=0x7f5eac0a7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac0a7670 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00ba80 tx=0x7f5e9c00bf40 comp rx=0 tx=0).stop 2023-11-18T20:40:42.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 shutdown_connections 2023-11-18T20:40:42.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e9806ae40 0x7f5e9806d300 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5eac0c5ec0 0x7f5eac14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5eac0c45d0 0x7f5eac14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 --2- 172.21.15.132:0/1406007027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac0c3340 0x7f5eac0a7670 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 >> 172.21.15.132:0/1406007027 conn(0x7f5eac06a500 msgr2=0x7f5eac071530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:42.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 shutdown_connections 2023-11-18T20:40:42.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.496+0000 7f5eb4789640 1 -- 172.21.15.132:0/1406007027 wait complete. 2023-11-18T20:40:42.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-11-18T20:40:42.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.733+0000 7f0ee0d4e640 1 Processor -- start 2023-11-18T20:40:42.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.733+0000 7f0ee0d4e640 1 -- start start 2023-11-18T20:40:42.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.734+0000 7f0ee0d4e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.734+0000 7f0ee0d4e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0edc0c3ea0 0x7f0edc0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.734+0000 7f0ee0d4e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc0c64a0 con 0x7f0edc14fd30 2023-11-18T20:40:42.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.734+0000 7f0ee0d4e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0edc0c5c00 con 0x7f0edc0c3ea0 2023-11-18T20:40:42.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.734+0000 7f0ee0d4e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0c5ee0 con 0x7f0edc06d0a0 2023-11-18T20:40:42.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.735+0000 7f0ed3fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.735+0000 7f0edad9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0edc0c3ea0 0x7f0edc0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.735+0000 7f0ed3fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:54498/0 (socket says 172.21.15.132:54498) 2023-11-18T20:40:42.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.735+0000 7f0ed3fff640 1 -- 172.21.15.132:0/560564013 learned_addr learned my addr 172.21.15.132:0/560564013 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:42.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.736+0000 7f0ed3fff640 1 -- 172.21.15.132:0/560564013 >> v2:172.21.15.161:3300/0 conn(0x7f0edc0c3ea0 msgr2=0x7f0edc0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:42.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.736+0000 7f0ed3fff640 1 --2- 172.21.15.132:0/560564013 >> v2:172.21.15.161:3300/0 conn(0x7f0edc0c3ea0 0x7f0edc0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.736+0000 7f0ed3fff640 1 -- 172.21.15.132:0/560564013 >> v1:172.21.15.161:6789/0 conn(0x7f0edc14fd30 legacy=0x7f0edc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.736+0000 7f0ed3fff640 1 -- 172.21.15.132:0/560564013 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc0c61c0 con 0x7f0edc06d0a0 2023-11-18T20:40:42.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.737+0000 7f0ed3fff640 1 --2- 172.21.15.132:0/560564013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc152f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009870 tx=0x7f0ec402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=946ed7afa06e1b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:42.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.737+0000 7f0ed9d9b640 1 -- 172.21.15.132:0/560564013 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4030840 con 0x7f0edc06d0a0 2023-11-18T20:40:42.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.737+0000 7f0ed9d9b640 1 -- 172.21.15.132:0/560564013 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec40309a0 con 0x7f0edc06d0a0 2023-11-18T20:40:42.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.737+0000 7f0ed9d9b640 1 -- 172.21.15.132:0/560564013 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4030d30 con 0x7f0edc06d0a0 2023-11-18T20:40:42.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.738+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/560564013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 msgr2=0x7f0edc152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.738+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/560564013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc152f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009870 tx=0x7f0ec402b980 comp rx=0 tx=0).stop 2023-11-18T20:40:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.738+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/560564013 shutdown_connections 2023-11-18T20:40:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.738+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/560564013 >> v2:172.21.15.161:3300/0 conn(0x7f0edc0c3ea0 0x7f0edc0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.738+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/560564013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc152f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.738+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/560564013 >> 172.21.15.132:0/560564013 conn(0x7f0edc06a500 msgr2=0x7f0edc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.738+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/560564013 shutdown_connections 2023-11-18T20:40:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.739+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/560564013 wait complete. 2023-11-18T20:40:42.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.740+0000 7f0ee0d4e640 1 Processor -- start 2023-11-18T20:40:42.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.741+0000 7f0ee0d4e640 1 -- start start 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0ee0d4e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0ee0d4e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0edc0c3ea0 0x7f0edc1eab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0ee0d4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0edc14fd30 0x7f0edc1eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0ee0d4e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc1ea6b0 con 0x7f0edc14fd30 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0ee0d4e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0aae00 con 0x7f0edc0c3ea0 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0ee0d4e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0aa5a0 con 0x7f0edc06d0a0 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0edad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0edc14fd30 0x7f0edc1eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0edad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0edc14fd30 0x7f0edc1eb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56142/0 (socket says 172.21.15.132:56142) 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0edad9d640 1 -- 172.21.15.132:0/209922060 learned_addr learned my addr 172.21.15.132:0/209922060 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0ed3fff640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0edc0c3ea0 0x7f0edc1eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.742+0000 7f0eda59c640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0edad9d640 1 -- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 msgr2=0x7f0edc0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0edad9d640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc0bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0edad9d640 1 -- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0edc0c3ea0 msgr2=0x7f0edc1eab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0edad9d640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0edc0c3ea0 0x7f0edc1eab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0edad9d640 1 -- 172.21.15.132:0/209922060 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40094d0 con 0x7f0edc14fd30 2023-11-18T20:40:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0edad9d640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0edc14fd30 0x7f0edc1eb080 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009dd0 tx=0x7f0ed400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0ed2ffd640 1 -- 172.21.15.132:0/209922060 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4014480 con 0x7f0edc14fd30 2023-11-18T20:40:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0ed2ffd640 1 -- 172.21.15.132:0/209922060 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed400f040 con 0x7f0edc14fd30 2023-11-18T20:40:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0ed2ffd640 1 -- 172.21.15.132:0/209922060 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4014840 con 0x7f0edc14fd30 2023-11-18T20:40:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.743+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc0aa840 con 0x7f0edc14fd30 2023-11-18T20:40:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.744+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc0bf8a0 con 0x7f0edc14fd30 2023-11-18T20:40:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.745+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0edc1ea860 con 0x7f0edc14fd30 2023-11-18T20:40:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.746+0000 7f0ed2ffd640 1 -- 172.21.15.132:0/209922060 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ed40149a0 con 0x7f0edc14fd30 2023-11-18T20:40:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.746+0000 7f0ed2ffd640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ebc06ae70 0x7f0ebc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.747+0000 7f0ed2ffd640 1 -- 172.21.15.132:0/209922060 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ed408a450 con 0x7f0edc14fd30 2023-11-18T20:40:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.747+0000 7f0eda59c640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ebc06ae70 0x7f0ebc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.748+0000 7f0eda59c640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ebc06ae70 0x7f0ebc06d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc007fd0 tx=0x7f0ecc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:42.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:42.751+0000 7f0ed2ffd640 1 -- 172.21.15.132:0/209922060 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0edc1ea860 con 0x7f0edc14fd30 2023-11-18T20:40:43.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.007+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f0edc1ea860 con 0x7f0edc14fd30 2023-11-18T20:40:43.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.007+0000 7f0ed2ffd640 1 -- 172.21.15.132:0/209922060 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+245 (secure 0 0 0) 0x7f0edc1ea860 con 0x7f0edc14fd30 2023-11-18T20:40:43.009 INFO:teuthology.orchestra.run.smithi132.stdout:[client.testuser] 2023-11-18T20:40:43.009 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBKIVll24xCHRAACieDcOUVt/oS9yqNZXzmMw== 2023-11-18T20:40:43.009 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow rw fsname=cephfs" 2023-11-18T20:40:43.009 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-11-18T20:40:43.009 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-18T20:40:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ebc06ae70 msgr2=0x7f0ebc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ebc06ae70 0x7f0ebc06d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc007fd0 tx=0x7f0ecc009040 comp rx=0 tx=0).stop 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0edc14fd30 msgr2=0x7f0edc1eb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0edc14fd30 0x7f0edc1eb080 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009dd0 tx=0x7f0ed400c490 comp rx=0 tx=0).stop 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 shutdown_connections 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0ebc06ae70 0x7f0ebc06d330 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0edc14fd30 0x7f0edc1eb080 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0edc0c3ea0 0x7f0edc1eab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 --2- 172.21.15.132:0/209922060 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0edc06d0a0 0x7f0edc0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.010+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 >> 172.21.15.132:0/209922060 conn(0x7f0edc06a500 msgr2=0x7f0edc152120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.011+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 shutdown_connections 2023-11-18T20:40:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.011+0000 7f0ee0d4e640 1 -- 172.21.15.132:0/209922060 wait complete. 2023-11-18T20:40:43.031 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-18T20:40:43.078 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.FYgSYcwvVx 2023-11-18T20:40:43.078 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:40:43.078 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/tmp/tmp.FYgSYcwvVx 2023-11-18T20:40:43.177 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:40:43.177 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:43.277 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:40:43.277 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:43.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:43.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.541+0000 7f2607c2b640 1 Processor -- start 2023-11-18T20:40:43.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.541+0000 7f2607c2b640 1 -- start start 2023-11-18T20:40:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.542+0000 7f2607c2b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 0x7f260006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.542+0000 7f2607c2b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2600073a00 0x7f26000c0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.543+0000 7f2607c2b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260006aa40 con 0x7f2600158030 2023-11-18T20:40:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.543+0000 7f2607c2b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26000c00d0 con 0x7f2600073a00 2023-11-18T20:40:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.543+0000 7f2607c2b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26000c1e00 con 0x7f2600157c50 2023-11-18T20:40:43.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.543+0000 7f26051c6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2600073a00 0x7f26000c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:43.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.543+0000 7f26051c6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2600073a00 0x7f26000c0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56152/0 (socket says 172.21.15.132:56152) 2023-11-18T20:40:43.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.543+0000 7f26051c6640 1 -- 172.21.15.132:0/3458947589 learned_addr learned my addr 172.21.15.132:0/3458947589 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:43.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.543+0000 7f26059c7640 1 --2- 172.21.15.132:0/3458947589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 0x7f260006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:43.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.544+0000 7f26051c6640 1 -- 172.21.15.132:0/3458947589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 msgr2=0x7f260006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:43.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.544+0000 7f26051c6640 1 --2- 172.21.15.132:0/3458947589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 0x7f260006a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.544+0000 7f26051c6640 1 -- 172.21.15.132:0/3458947589 >> v1:172.21.15.161:6789/0 conn(0x7f2600158030 legacy=0x7f2600154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:43.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.544+0000 7f26051c6640 1 -- 172.21.15.132:0/3458947589 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000bfa80 con 0x7f2600073a00 2023-11-18T20:40:43.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.545+0000 7f26051c6640 1 --2- 172.21.15.132:0/3458947589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600073a00 0x7f26000c0560 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009870 tx=0x7f25fc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35daff9ca259809 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:43.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.545+0000 7f26049c5640 1 -- 172.21.15.132:0/3458947589 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc030840 con 0x7f2600073a00 2023-11-18T20:40:43.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.545+0000 7f26049c5640 1 -- 172.21.15.132:0/3458947589 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc0309a0 con 0x7f2600073a00 2023-11-18T20:40:43.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.545+0000 7f26049c5640 1 -- 172.21.15.132:0/3458947589 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc030d30 con 0x7f2600073a00 2023-11-18T20:40:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.546+0000 7f2607c2b640 1 -- 172.21.15.132:0/3458947589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600073a00 msgr2=0x7f26000c0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.546+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3458947589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600073a00 0x7f26000c0560 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009870 tx=0x7f25fc02b980 comp rx=0 tx=0).stop 2023-11-18T20:40:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.546+0000 7f2607c2b640 1 -- 172.21.15.132:0/3458947589 shutdown_connections 2023-11-18T20:40:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.546+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3458947589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600073a00 0x7f26000c0560 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.546+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3458947589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 0x7f260006a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.546+0000 7f2607c2b640 1 -- 172.21.15.132:0/3458947589 >> 172.21.15.132:0/3458947589 conn(0x7f26000c30b0 msgr2=0x7f26000c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.546+0000 7f2607c2b640 1 -- 172.21.15.132:0/3458947589 shutdown_connections 2023-11-18T20:40:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.546+0000 7f2607c2b640 1 -- 172.21.15.132:0/3458947589 wait complete. 2023-11-18T20:40:43.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.548+0000 7f2607c2b640 1 Processor -- start 2023-11-18T20:40:43.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.548+0000 7f2607c2b640 1 -- start start 2023-11-18T20:40:43.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f2607c2b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2600073a00 0x7f26001524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:43.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f2607c2b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 0x7f260013e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:43.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f2607c2b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600158030 0x7f260013d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:43.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f2607c2b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600153620 con 0x7f2600158030 2023-11-18T20:40:43.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f2607c2b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600154eb0 con 0x7f2600073a00 2023-11-18T20:40:43.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f2607c2b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2600153890 con 0x7f2600157c50 2023-11-18T20:40:43.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f26061c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600158030 0x7f260013d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:43.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f26061c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600158030 0x7f260013d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56168/0 (socket says 172.21.15.132:56168) 2023-11-18T20:40:43.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.549+0000 7f26061c8640 1 -- 172.21.15.132:0/3048690367 learned_addr learned my addr 172.21.15.132:0/3048690367 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:43.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f26059c7640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2600073a00 0x7f26001524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f26061c8640 1 -- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 msgr2=0x7f260013e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f26061c8640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 0x7f260013e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f26061c8640 1 -- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2600073a00 msgr2=0x7f26001524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f26061c8640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2600073a00 0x7f26001524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f26061c8640 1 -- 172.21.15.132:0/3048690367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc0094d0 con 0x7f2600158030 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f26061c8640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600158030 0x7f260013d090 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c6b0 tx=0x7f25f800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f25f27fc640 1 -- 172.21.15.132:0/3048690367 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8003b70 con 0x7f2600158030 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f25f27fc640 1 -- 172.21.15.132:0/3048690367 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8003cf0 con 0x7f2600158030 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f25f27fc640 1 -- 172.21.15.132:0/3048690367 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8003ea0 con 0x7f2600158030 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26001548f0 con 0x7f2600158030 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.550+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260013eb90 con 0x7f2600158030 2023-11-18T20:40:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.552+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2600066b40 con 0x7f2600158030 2023-11-18T20:40:43.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.553+0000 7f25f27fc640 1 -- 172.21.15.132:0/3048690367 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f25f8005310 con 0x7f2600158030 2023-11-18T20:40:43.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.553+0000 7f25f27fc640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f25e406ae40 0x7f25e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:43.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.553+0000 7f25f27fc640 1 -- 172.21.15.132:0/3048690367 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f25f8089700 con 0x7f2600158030 2023-11-18T20:40:43.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.554+0000 7f26059c7640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f25e406ae40 0x7f25e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:43.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.555+0000 7f26059c7640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f25e406ae40 0x7f25e406d300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f25f4006fd0 tx=0x7f25f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.558+0000 7f25f27fc640 1 -- 172.21.15.132:0/3048690367 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25f80544e0 con 0x7f2600158030 2023-11-18T20:40:43.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.749+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2600068350 con 0x7f2600158030 2023-11-18T20:40:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.753+0000 7f25f27fc640 1 -- 172.21.15.132:0/3048690367 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+20256 (secure 0 0 0) 0x7f25f8057b00 con 0x7f2600158030 2023-11-18T20:40:43.755 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:43.756 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":59,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:32.397403+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f25e406ae40 msgr2=0x7f25e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f25e406ae40 0x7f25e406d300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f25f4006fd0 tx=0x7f25f4008040 comp rx=0 tx=0).stop 2023-11-18T20:40:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600158030 msgr2=0x7f260013d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600158030 0x7f260013d090 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c6b0 tx=0x7f25f800cb70 comp rx=0 tx=0).stop 2023-11-18T20:40:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 shutdown_connections 2023-11-18T20:40:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f25e406ae40 0x7f25e406d300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600158030 0x7f260013d090 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2600157c50 0x7f260013e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 --2- 172.21.15.132:0/3048690367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2600073a00 0x7f26001524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:43.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 >> 172.21.15.132:0/3048690367 conn(0x7f26000c30b0 msgr2=0x7f260014e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:43.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 shutdown_connections 2023-11-18T20:40:43.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.756+0000 7f2607c2b640 1 -- 172.21.15.132:0/3048690367 wait complete. 2023-11-18T20:40:43.778 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:40:13.573413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:40:14.279671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:40:28.826395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:40:29.825753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:40:43.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:40:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.998+0000 7ff36b41f640 1 Processor -- start 2023-11-18T20:40:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.998+0000 7ff36b41f640 1 -- start start 2023-11-18T20:40:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.999+0000 7ff36b41f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff364155490 0x7ff3640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:43.999+0000 7ff36b41f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3640c1500 0x7ff3640a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff36b41f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff3640c4080 0x7ff3640a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff36b41f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3640a5820 con 0x7ff364155490 2023-11-18T20:40:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff36b41f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3640c06c0 con 0x7ff3640c4080 2023-11-18T20:40:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff36b41f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640c1020 con 0x7ff3640c1500 2023-11-18T20:40:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff3691bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff364155490 0x7ff3640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff3691bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff364155490 0x7ff3640a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56170/0 (socket says 172.21.15.132:56170) 2023-11-18T20:40:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff3691bb640 1 -- 172.21.15.132:0/768079961 learned_addr learned my addr 172.21.15.132:0/768079961 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff3699bc640 1 --2- 172.21.15.132:0/768079961 >> v2:172.21.15.161:3300/0 conn(0x7ff3640c4080 0x7ff3640a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.000+0000 7ff3689ba640 1 --2- 172.21.15.132:0/768079961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3640c1500 0x7ff3640a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.001+0000 7ff3691bb640 1 -- 172.21.15.132:0/768079961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3640c1500 msgr2=0x7ff3640a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.001+0000 7ff3691bb640 1 --2- 172.21.15.132:0/768079961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3640c1500 0x7ff3640a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.001+0000 7ff3691bb640 1 -- 172.21.15.132:0/768079961 >> v2:172.21.15.161:3300/0 conn(0x7ff3640c4080 msgr2=0x7ff3640a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.001+0000 7ff3691bb640 1 --2- 172.21.15.132:0/768079961 >> v2:172.21.15.161:3300/0 conn(0x7ff3640c4080 0x7ff3640a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.001+0000 7ff3691bb640 1 -- 172.21.15.132:0/768079961 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640c0910 con 0x7ff364155490 2023-11-18T20:40:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.002+0000 7ff3691bb640 1 --2- 172.21.15.132:0/768079961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364155490 0x7ff3640a51b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff3640c3e00 tx=0x7ff36002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e84e161b1bf61d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.002+0000 7ff35bfff640 1 -- 172.21.15.132:0/768079961 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36002ee00 con 0x7ff364155490 2023-11-18T20:40:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.002+0000 7ff35bfff640 1 -- 172.21.15.132:0/768079961 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff360036440 con 0x7ff364155490 2023-11-18T20:40:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.002+0000 7ff35bfff640 1 -- 172.21.15.132:0/768079961 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3600367d0 con 0x7ff364155490 2023-11-18T20:40:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 -- 172.21.15.132:0/768079961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364155490 msgr2=0x7ff3640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 --2- 172.21.15.132:0/768079961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364155490 0x7ff3640a51b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff3640c3e00 tx=0x7ff36002e050 comp rx=0 tx=0).stop 2023-11-18T20:40:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 -- 172.21.15.132:0/768079961 shutdown_connections 2023-11-18T20:40:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 --2- 172.21.15.132:0/768079961 >> v2:172.21.15.161:3300/0 conn(0x7ff3640c4080 0x7ff3640a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 --2- 172.21.15.132:0/768079961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3640c1500 0x7ff3640a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 --2- 172.21.15.132:0/768079961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364155490 0x7ff3640a51b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 -- 172.21.15.132:0/768079961 >> 172.21.15.132:0/768079961 conn(0x7ff36406a500 msgr2=0x7ff36406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 -- 172.21.15.132:0/768079961 shutdown_connections 2023-11-18T20:40:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.003+0000 7ff36b41f640 1 -- 172.21.15.132:0/768079961 wait complete. 2023-11-18T20:40:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.005+0000 7ff36b41f640 1 Processor -- start 2023-11-18T20:40:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.005+0000 7ff36b41f640 1 -- start start 2023-11-18T20:40:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff36b41f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3640c1500 0x7ff36414df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff36b41f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3640c4080 0x7ff364153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff36b41f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff364155490 0x7ff36414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff36b41f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3641edb80 con 0x7ff3640c1500 2023-11-18T20:40:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff36b41f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36414a2e0 con 0x7ff3640c4080 2023-11-18T20:40:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff36b41f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3641ed4c0 con 0x7ff364155490 2023-11-18T20:40:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3691bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3640c1500 0x7ff36414df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3691bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3640c1500 0x7ff36414df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56180/0 (socket says 172.21.15.132:56180) 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3691bb640 1 -- 172.21.15.132:0/1293871045 learned_addr learned my addr 172.21.15.132:0/1293871045 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3691bb640 1 -- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff364155490 msgr2=0x7ff36414b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3699bc640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff364155490 0x7ff36414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3691bb640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff364155490 0x7ff36414b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3689ba640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3640c4080 0x7ff364153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3691bb640 1 -- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3640c4080 msgr2=0x7ff364153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3691bb640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3640c4080 0x7ff364153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.006+0000 7ff3691bb640 1 -- 172.21.15.132:0/1293871045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36000b770 con 0x7ff3640c1500 2023-11-18T20:40:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.007+0000 7ff3691bb640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3640c1500 0x7ff36414df10 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff36002e090 tx=0x7ff360004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.007+0000 7ff359ffb640 1 -- 172.21.15.132:0/1293871045 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3600407f0 con 0x7ff3640c1500 2023-11-18T20:40:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.007+0000 7ff359ffb640 1 -- 172.21.15.132:0/1293871045 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff360040950 con 0x7ff3640c1500 2023-11-18T20:40:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.007+0000 7ff359ffb640 1 -- 172.21.15.132:0/1293871045 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360040d00 con 0x7ff3640c1500 2023-11-18T20:40:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.007+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3641ed7a0 con 0x7ff3640c1500 2023-11-18T20:40:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.007+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff364154460 con 0x7ff3640c1500 2023-11-18T20:40:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.009+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3641ed320 con 0x7ff3640c1500 2023-11-18T20:40:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.010+0000 7ff359ffb640 1 -- 172.21.15.132:0/1293871045 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff360041480 con 0x7ff3640c1500 2023-11-18T20:40:44.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.011+0000 7ff359ffb640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff34806ae40 0x7ff34806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.011+0000 7ff359ffb640 1 -- 172.21.15.132:0/1293871045 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff3600ac9c0 con 0x7ff3640c1500 2023-11-18T20:40:44.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.012+0000 7ff3689ba640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff34806ae40 0x7ff34806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.013+0000 7ff3689ba640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff34806ae40 0x7ff34806d300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff3641e17f0 tx=0x7ff354008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.016+0000 7ff359ffb640 1 -- 172.21.15.132:0/1293871045 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3641ed320 con 0x7ff3640c1500 2023-11-18T20:40:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.205+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3641ed320 con 0x7ff3640c1500 2023-11-18T20:40:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.206+0000 7ff359ffb640 1 -- 172.21.15.132:0/1293871045 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3641ed320 con 0x7ff3640c1500 2023-11-18T20:40:44.208 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:40:44.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff34806ae40 msgr2=0x7ff34806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff34806ae40 0x7ff34806d300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff3641e17f0 tx=0x7ff354008040 comp rx=0 tx=0).stop 2023-11-18T20:40:44.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3640c1500 msgr2=0x7ff36414df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3640c1500 0x7ff36414df10 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff36002e090 tx=0x7ff360004730 comp rx=0 tx=0).stop 2023-11-18T20:40:44.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 shutdown_connections 2023-11-18T20:40:44.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff34806ae40 0x7ff34806d300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff364155490 0x7ff36414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3640c4080 0x7ff364153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.209+0000 7ff36b41f640 1 --2- 172.21.15.132:0/1293871045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3640c1500 0x7ff36414df10 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.210+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 >> 172.21.15.132:0/1293871045 conn(0x7ff36406a500 msgr2=0x7ff36406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.210+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 shutdown_connections 2023-11-18T20:40:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.210+0000 7ff36b41f640 1 -- 172.21.15.132:0/1293871045 wait complete. 2023-11-18T20:40:44.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:40:44.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.442+0000 7f361fdf5640 1 Processor -- start 2023-11-18T20:40:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.442+0000 7f361fdf5640 1 -- start start 2023-11-18T20:40:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361fdf5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36180c3400 0x7f361806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361fdf5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3618157fe0 0x7f3618158430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361fdf5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3618071fd0 con 0x7f3618151fd0 2023-11-18T20:40:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361fdf5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361806ee50 con 0x7f3618157fe0 2023-11-18T20:40:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361fdf5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618072220 con 0x7f36180c3400 2023-11-18T20:40:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361e392640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3618157fe0 0x7f3618158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361e392640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3618157fe0 0x7f3618158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56190/0 (socket says 172.21.15.132:56190) 2023-11-18T20:40:44.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361e392640 1 -- 172.21.15.132:0/807633986 learned_addr learned my addr 172.21.15.132:0/807633986 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:44.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361e392640 1 -- 172.21.15.132:0/807633986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36180c3400 msgr2=0x7f361806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:44.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361d390640 1 --2- 172.21.15.132:0/807633986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36180c3400 0x7f361806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361e392640 1 --2- 172.21.15.132:0/807633986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36180c3400 0x7f361806e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361e392640 1 -- 172.21.15.132:0/807633986 >> v1:172.21.15.161:6789/0 conn(0x7f3618151fd0 legacy=0x7f361806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:44.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.444+0000 7f361e392640 1 -- 172.21.15.132:0/807633986 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361806e0d0 con 0x7f3618157fe0 2023-11-18T20:40:44.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.446+0000 7f361e392640 1 --2- 172.21.15.132:0/807633986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618157fe0 0x7f3618158430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3610009870 tx=0x7f361002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436877aaf1702286 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.446+0000 7f361cb8f640 1 -- 172.21.15.132:0/807633986 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36100317c0 con 0x7f3618157fe0 2023-11-18T20:40:44.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.446+0000 7f361cb8f640 1 -- 172.21.15.132:0/807633986 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3610031920 con 0x7f3618157fe0 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.446+0000 7f361cb8f640 1 -- 172.21.15.132:0/807633986 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610031cb0 con 0x7f3618157fe0 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.446+0000 7f361fdf5640 1 -- 172.21.15.132:0/807633986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618157fe0 msgr2=0x7f3618158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.446+0000 7f361fdf5640 1 --2- 172.21.15.132:0/807633986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618157fe0 0x7f3618158430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3610009870 tx=0x7f361002b860 comp rx=0 tx=0).stop 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.447+0000 7f361fdf5640 1 -- 172.21.15.132:0/807633986 shutdown_connections 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.447+0000 7f361fdf5640 1 --2- 172.21.15.132:0/807633986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618157fe0 0x7f3618158430 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.447+0000 7f361fdf5640 1 --2- 172.21.15.132:0/807633986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36180c3400 0x7f361806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.447+0000 7f361fdf5640 1 -- 172.21.15.132:0/807633986 >> 172.21.15.132:0/807633986 conn(0x7f36180c6ee0 msgr2=0x7f36180c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.447+0000 7f361fdf5640 1 -- 172.21.15.132:0/807633986 shutdown_connections 2023-11-18T20:40:44.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.447+0000 7f361fdf5640 1 -- 172.21.15.132:0/807633986 wait complete. 2023-11-18T20:40:44.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.448+0000 7f361fdf5640 1 Processor -- start 2023-11-18T20:40:44.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.448+0000 7f361fdf5640 1 -- start start 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.449+0000 7f361fdf5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36180c3400 0x7f36181e7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.449+0000 7f361fdf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618151fd0 0x7f36180c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.449+0000 7f361fdf5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3618157fe0 0x7f36180c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.449+0000 7f361fdf5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618146100 con 0x7f3618151fd0 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.449+0000 7f361fdf5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36181493c0 con 0x7f36180c3400 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.449+0000 7f361fdf5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618146f10 con 0x7f3618157fe0 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618151fd0 0x7f36180c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618151fd0 0x7f36180c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56206/0 (socket says 172.21.15.132:56206) 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 -- 172.21.15.132:0/1874987568 learned_addr learned my addr 172.21.15.132:0/1874987568 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361e392640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3618157fe0 0x7f36180c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 -- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3618157fe0 msgr2=0x7f36180c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3618157fe0 0x7f36180c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 -- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36180c3400 msgr2=0x7f36181e7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361db91640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36180c3400 0x7f36181e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36180c3400 0x7f36181e7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 -- 172.21.15.132:0/1874987568 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100094d0 con 0x7f3618151fd0 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.450+0000 7f361d390640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618151fd0 0x7f36180c5850 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f360800c7f0 tx=0x7f360800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.451+0000 7f360e7fc640 1 -- 172.21.15.132:0/1874987568 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608004220 con 0x7f3618151fd0 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.451+0000 7f360e7fc640 1 -- 172.21.15.132:0/1874987568 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36080043a0 con 0x7f3618151fd0 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.451+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36181ee1d0 con 0x7f3618151fd0 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.451+0000 7f360e7fc640 1 -- 172.21.15.132:0/1874987568 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608007860 con 0x7f3618151fd0 2023-11-18T20:40:44.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.451+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36181498f0 con 0x7f3618151fd0 2023-11-18T20:40:44.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.452+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36180c5570 con 0x7f3618151fd0 2023-11-18T20:40:44.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.453+0000 7f360e7fc640 1 -- 172.21.15.132:0/1874987568 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3608007bd0 con 0x7f3618151fd0 2023-11-18T20:40:44.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.454+0000 7f360e7fc640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35fc06ae40 0x7f35fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.454+0000 7f360e7fc640 1 -- 172.21.15.132:0/1874987568 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3608089870 con 0x7f3618151fd0 2023-11-18T20:40:44.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.455+0000 7f361db91640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35fc06ae40 0x7f35fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.456+0000 7f361db91640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35fc06ae40 0x7f35fc06d300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3614007fd0 tx=0x7f3614009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.459+0000 7f360e7fc640 1 -- 172.21.15.132:0/1874987568 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36180c5570 con 0x7f3618151fd0 2023-11-18T20:40:44.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.652+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36180c5570 con 0x7f3618151fd0 2023-11-18T20:40:44.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.653+0000 7f360e7fc640 1 -- 172.21.15.132:0/1874987568 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f360801e020 con 0x7f3618151fd0 2023-11-18T20:40:44.654 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35fc06ae40 msgr2=0x7f35fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35fc06ae40 0x7f35fc06d300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3614007fd0 tx=0x7f3614009040 comp rx=0 tx=0).stop 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618151fd0 msgr2=0x7f36180c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618151fd0 0x7f36180c5850 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f360800c7f0 tx=0x7f360800ccb0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 shutdown_connections 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f35fc06ae40 0x7f35fc06d300 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3618157fe0 0x7f36180c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3618151fd0 0x7f36180c5850 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 --2- 172.21.15.132:0/1874987568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36180c3400 0x7f36181e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 >> 172.21.15.132:0/1874987568 conn(0x7f36180c6ee0 msgr2=0x7f36181583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:44.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.655+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 shutdown_connections 2023-11-18T20:40:44.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.656+0000 7f361fdf5640 1 -- 172.21.15.132:0/1874987568 wait complete. 2023-11-18T20:40:44.675 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:40:44.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.883+0000 7fdc29f47640 1 Processor -- start 2023-11-18T20:40:44.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.883+0000 7fdc29f47640 1 -- start start 2023-11-18T20:40:44.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.884+0000 7fdc29f47640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2406d0a0 0x7fdc24152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.884+0000 7fdc29f47640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc240c3ea0 0x7fdc240c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.884+0000 7fdc29f47640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc240c64a0 con 0x7fdc2414fd30 2023-11-18T20:40:44.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.884+0000 7fdc29f47640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc240c5c00 con 0x7fdc240c3ea0 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.884+0000 7fdc29f47640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240c5ee0 con 0x7fdc2406d0a0 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc23fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc240c3ea0 0x7fdc240c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc23fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc240c3ea0 0x7fdc240c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56220/0 (socket says 172.21.15.132:56220) 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc23fff640 1 -- 172.21.15.132:0/1009490925 learned_addr learned my addr 172.21.15.132:0/1009490925 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc22ffd640 1 --2- 172.21.15.132:0/1009490925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2406d0a0 0x7fdc24152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc23fff640 1 -- 172.21.15.132:0/1009490925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2406d0a0 msgr2=0x7fdc24152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc23fff640 1 --2- 172.21.15.132:0/1009490925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2406d0a0 0x7fdc24152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc23fff640 1 -- 172.21.15.132:0/1009490925 >> v1:172.21.15.161:6789/0 conn(0x7fdc2414fd30 legacy=0x7fdc240a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc23fff640 1 -- 172.21.15.132:0/1009490925 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240c61c0 con 0x7fdc240c3ea0 2023-11-18T20:40:44.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.885+0000 7fdc22ffd640 1 --2- 172.21.15.132:0/1009490925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2406d0a0 0x7fdc24152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:44.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.886+0000 7fdc23fff640 1 --2- 172.21.15.132:0/1009490925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc240c4330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009e50 tx=0x7fdc1c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedac54bfe36b31c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.886+0000 7fdc227fc640 1 -- 172.21.15.132:0/1009490925 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c02ca70 con 0x7fdc240c3ea0 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc227fc640 1 -- 172.21.15.132:0/1009490925 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c02cbd0 con 0x7fdc240c3ea0 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc227fc640 1 -- 172.21.15.132:0/1009490925 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0343f0 con 0x7fdc240c3ea0 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc29f47640 1 -- 172.21.15.132:0/1009490925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 msgr2=0x7fdc240c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc29f47640 1 --2- 172.21.15.132:0/1009490925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc240c4330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009e50 tx=0x7fdc1c02bed0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc29f47640 1 -- 172.21.15.132:0/1009490925 shutdown_connections 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc29f47640 1 --2- 172.21.15.132:0/1009490925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc240c4330 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc29f47640 1 --2- 172.21.15.132:0/1009490925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2406d0a0 0x7fdc24152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc29f47640 1 -- 172.21.15.132:0/1009490925 >> 172.21.15.132:0/1009490925 conn(0x7fdc2406a500 msgr2=0x7fdc2406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc29f47640 1 -- 172.21.15.132:0/1009490925 shutdown_connections 2023-11-18T20:40:44.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.887+0000 7fdc29f47640 1 -- 172.21.15.132:0/1009490925 wait complete. 2023-11-18T20:40:44.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.889+0000 7fdc29f47640 1 Processor -- start 2023-11-18T20:40:44.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.889+0000 7fdc29f47640 1 -- start start 2023-11-18T20:40:44.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc29f47640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc2406d0a0 0x7fdc24155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc29f47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc2414ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc29f47640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2414fd30 0x7fdc2414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc29f47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc241dd310 con 0x7fdc240c3ea0 2023-11-18T20:40:44.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc29f47640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240bb080 con 0x7fdc2406d0a0 2023-11-18T20:40:44.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc29f47640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2414f7a0 con 0x7fdc2414fd30 2023-11-18T20:40:44.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc22ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc2414ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc22ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc2414ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56234/0 (socket says 172.21.15.132:56234) 2023-11-18T20:40:44.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.890+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2847409942 learned_addr learned my addr 172.21.15.132:0/2847409942 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:44.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2414fd30 msgr2=0x7fdc2414f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc22ffd640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2414fd30 0x7fdc2414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc2406d0a0 msgr2=0x7fdc24155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:44.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc237fe640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc2406d0a0 0x7fdc24155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc22ffd640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc2406d0a0 0x7fdc24155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:44.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2847409942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c009b30 con 0x7fdc240c3ea0 2023-11-18T20:40:44.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc22ffd640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc2414ed20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800c7f0 tx=0x7fdc1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc0bfff640 1 -- 172.21.15.132:0/2847409942 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18007820 con 0x7fdc240c3ea0 2023-11-18T20:40:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc0bfff640 1 -- 172.21.15.132:0/2847409942 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18007980 con 0x7fdc240c3ea0 2023-11-18T20:40:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc0bfff640 1 -- 172.21.15.132:0/2847409942 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18007d10 con 0x7fdc240c3ea0 2023-11-18T20:40:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240bfe90 con 0x7fdc240c3ea0 2023-11-18T20:40:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.891+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc241ec4f0 con 0x7fdc240c3ea0 2023-11-18T20:40:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.893+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc24155700 con 0x7fdc240c3ea0 2023-11-18T20:40:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.893+0000 7fdc0bfff640 1 -- 172.21.15.132:0/2847409942 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc180113f0 con 0x7fdc240c3ea0 2023-11-18T20:40:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.894+0000 7fdc0bfff640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdc1006ae40 0x7fdc1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.894+0000 7fdc0bfff640 1 -- 172.21.15.132:0/2847409942 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdc18089a30 con 0x7fdc240c3ea0 2023-11-18T20:40:44.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.895+0000 7fdc237fe640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdc1006ae40 0x7fdc1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:44.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.896+0000 7fdc237fe640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdc1006ae40 0x7fdc1006d300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdc24153350 tx=0x7fdc14009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:44.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:44.899+0000 7fdc0bfff640 1 -- 172.21.15.132:0/2847409942 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc24155700 con 0x7fdc240c3ea0 2023-11-18T20:40:45.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.087+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc240bfe90 con 0x7fdc240c3ea0 2023-11-18T20:40:45.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.088+0000 7fdc0bfff640 1 -- 172.21.15.132:0/2847409942 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc240bfe90 con 0x7fdc240c3ea0 2023-11-18T20:40:45.090 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdc1006ae40 msgr2=0x7fdc1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdc1006ae40 0x7fdc1006d300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdc24153350 tx=0x7fdc14009040 comp rx=0 tx=0).stop 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 msgr2=0x7fdc2414ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc2414ed20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800c7f0 tx=0x7fdc1800ccb0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 shutdown_connections 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdc1006ae40 0x7fdc1006d300 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc2414fd30 0x7fdc2414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc240c3ea0 0x7fdc2414ed20 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 --2- 172.21.15.132:0/2847409942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc2406d0a0 0x7fdc24155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 >> 172.21.15.132:0/2847409942 conn(0x7fdc2406a500 msgr2=0x7fdc240a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 shutdown_connections 2023-11-18T20:40:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.091+0000 7fdc29f47640 1 -- 172.21.15.132:0/2847409942 wait complete. 2023-11-18T20:40:45.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:40:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.327+0000 7fbafcf8a640 1 Processor -- start 2023-11-18T20:40:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.327+0000 7fbafcf8a640 1 -- start start 2023-11-18T20:40:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.328+0000 7fbafcf8a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbaf80a9b40 0x7fbaf80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.328+0000 7fbafcf8a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80c06c0 con 0x7fbaf8155490 2023-11-18T20:40:45.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.328+0000 7fbafcf8a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80c1020 con 0x7fbaf80c1500 2023-11-18T20:40:45.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.328+0000 7fbafcf8a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf80a5820 con 0x7fbaf80a9b40 2023-11-18T20:40:45.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbaf8155490 0x7fbaf80a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43658/0 (socket says 172.21.15.132:43658) 2023-11-18T20:40:45.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf659c640 1 -- 172.21.15.132:0/3062309205 learned_addr learned my addr 172.21.15.132:0/3062309205 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaedd9b640 1 --2- 172.21.15.132:0/3062309205 >> v2:172.21.15.161:3300/0 conn(0x7fbaf80a9b40 0x7fbaf80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502753488 0 0) 0x7fbaf80c06c0 con 0x7fbaf8155490 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae4003520 con 0x7fbaf8155490 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1845388214 0 0) 0x7fbae4003520 con 0x7fbaf8155490 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 >> v2:172.21.15.161:3300/0 conn(0x7fbaf80a9b40 msgr2=0x7fbaf80a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 --2- 172.21.15.132:0/3062309205 >> v2:172.21.15.161:3300/0 conn(0x7fbaf80a9b40 0x7fbaf80a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 >> v1:172.21.15.161:6789/0 conn(0x7fbaf80c1500 legacy=0x7fbaf80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80c0910 con 0x7fbaf8155490 2023-11-18T20:40:45.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fbae8001670 con 0x7fbaf8155490 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 >> v1:172.21.15.132:6789/0 conn(0x7fbaf8155490 legacy=0x7fbaf80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.329+0000 7fbaf5d9b640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbae40039c0 0x7fbae4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf5d9b640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbae40047c0 0x7fbae4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf5d9b640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbae400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae400c050 con 0x7fbae4005180 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae400c1c0 con 0x7fbae40039c0 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae400c380 con 0x7fbae40047c0 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf6d9d640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbae400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf6d9d640 1 -- 172.21.15.132:0/3062309205 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbae40047c0 msgr2=0x7fbae4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf659c640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbae40039c0 0x7fbae4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf6d9d640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbae40047c0 0x7fbae4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf6d9d640 1 -- 172.21.15.132:0/3062309205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbae40039c0 msgr2=0x7fbae4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf6d9d640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbae40039c0 0x7fbae4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf6d9d640 1 -- 172.21.15.132:0/3062309205 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4003520 con 0x7fbae4005180 2023-11-18T20:40:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.330+0000 7fbaf659c640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbae40039c0 0x7fbae4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.331+0000 7fbaf6d9d640 1 -- 172.21.15.132:0/3062309205 reap_dead start 2023-11-18T20:40:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.331+0000 7fbaf6d9d640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbae400b980 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0001e50 tx=0x7fbae40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a70e1c488530b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0003b70 con 0x7fbae4005180 2023-11-18T20:40:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0003d10 con 0x7fbae4005180 2023-11-18T20:40:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbaf5d9b640 1 -- 172.21.15.132:0/3062309205 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0005310 con 0x7fbae4005180 2023-11-18T20:40:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbafcf8a640 1 -- 172.21.15.132:0/3062309205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 msgr2=0x7fbae400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbafcf8a640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbae400b980 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0001e50 tx=0x7fbae40057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbafcf8a640 1 -- 172.21.15.132:0/3062309205 shutdown_connections 2023-11-18T20:40:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbafcf8a640 1 --2- 172.21.15.132:0/3062309205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbae400b980 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbafcf8a640 1 -- 172.21.15.132:0/3062309205 >> 172.21.15.132:0/3062309205 conn(0x7fbaf806a500 msgr2=0x7fbaf806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:45.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbafcf8a640 1 -- 172.21.15.132:0/3062309205 shutdown_connections 2023-11-18T20:40:45.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.332+0000 7fbafcf8a640 1 -- 172.21.15.132:0/3062309205 wait complete. 2023-11-18T20:40:45.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.334+0000 7fbafcf8a640 1 Processor -- start 2023-11-18T20:40:45.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.334+0000 7fbafcf8a640 1 -- start start 2023-11-18T20:40:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.335+0000 7fbafcf8a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbaf81ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.335+0000 7fbafcf8a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbaf81ea2d0 0x7fbaf81540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.335+0000 7fbafcf8a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf809b390 0x7fbaf81512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.335+0000 7fbafcf8a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf81ecee0 con 0x7fbae4005180 2023-11-18T20:40:45.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.335+0000 7fbafcf8a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf809a400 con 0x7fbaf809b390 2023-11-18T20:40:45.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.335+0000 7fbafcf8a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf809a6c0 con 0x7fbaf81ea2d0 2023-11-18T20:40:45.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.335+0000 7fbaf659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbaf81ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbaf81ed950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56260/0 (socket says 172.21.15.132:56260) 2023-11-18T20:40:45.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf659c640 1 -- 172.21.15.132:0/2133805064 learned_addr learned my addr 172.21.15.132:0/2133805064 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:45.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf6d9d640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf809b390 0x7fbaf81512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaedd9b640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbaf81ea2d0 0x7fbaf81540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf659c640 1 -- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbaf81ea2d0 msgr2=0x7fbaf81540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf659c640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbaf81ea2d0 0x7fbaf81540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf659c640 1 -- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf809b390 msgr2=0x7fbaf81512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf659c640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf809b390 0x7fbaf81512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf659c640 1 -- 172.21.15.132:0/2133805064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf81ed150 con 0x7fbae4005180 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaedd9b640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbaf81ea2d0 0x7fbaf81540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf6d9d640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf809b390 0x7fbaf81512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaf659c640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbaf81ed950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbae800d7a0 tx=0x7fbae800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.336+0000 7fbaef7fe640 1 -- 172.21.15.132:0/2133805064 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80072d0 con 0x7fbae4005180 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.337+0000 7fbaef7fe640 1 -- 172.21.15.132:0/2133805064 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae8007430 con 0x7fbae4005180 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.337+0000 7fbaef7fe640 1 -- 172.21.15.132:0/2133805064 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80047e0 con 0x7fbae4005180 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.337+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf81ed430 con 0x7fbae4005180 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.337+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf81ea750 con 0x7fbae4005180 2023-11-18T20:40:45.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.338+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf8068350 con 0x7fbae4005180 2023-11-18T20:40:45.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.339+0000 7fbaef7fe640 1 -- 172.21.15.132:0/2133805064 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbae8004940 con 0x7fbae4005180 2023-11-18T20:40:45.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.340+0000 7fbaef7fe640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbad806ae70 0x7fbad806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.340+0000 7fbaef7fe640 1 -- 172.21.15.132:0/2133805064 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbae8089160 con 0x7fbae4005180 2023-11-18T20:40:45.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.341+0000 7fbaedd9b640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbad806ae70 0x7fbad806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.342+0000 7fbaedd9b640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbad806ae70 0x7fbad806d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009a20 tx=0x7fbae0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:45.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.345+0000 7fbaef7fe640 1 -- 172.21.15.132:0/2133805064 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbae80579e0 con 0x7fbae4005180 2023-11-18T20:40:45.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.541+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbaf80bf430 con 0x7fbae4005180 2023-11-18T20:40:45.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.541+0000 7fbaef7fe640 1 -- 172.21.15.132:0/2133805064 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v59) v1 ==== 105+0+11 (secure 0 0 0) 0x7fbae8057570 con 0x7fbae4005180 2023-11-18T20:40:45.543 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:45.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbad806ae70 msgr2=0x7fbad806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbad806ae70 0x7fbad806d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009a20 tx=0x7fbae0008040 comp rx=0 tx=0).stop 2023-11-18T20:40:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 msgr2=0x7fbaf81ed950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbaf81ed950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbae800d7a0 tx=0x7fbae800dc60 comp rx=0 tx=0).stop 2023-11-18T20:40:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 shutdown_connections 2023-11-18T20:40:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbad806ae70 0x7fbad806d330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf809b390 0x7fbaf81512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbaf81ea2d0 0x7fbaf81540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 --2- 172.21.15.132:0/2133805064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbae4005180 0x7fbaf81ed950 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 >> 172.21.15.132:0/2133805064 conn(0x7fbaf806a500 msgr2=0x7fbaf80c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:45.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 shutdown_connections 2023-11-18T20:40:45.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.544+0000 7fbafcf8a640 1 -- 172.21.15.132:0/2133805064 wait complete. 2023-11-18T20:40:45.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:40:45.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.777+0000 7f9a4fee0640 1 Processor -- start 2023-11-18T20:40:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.777+0000 7f9a4fee0640 1 -- start start 2023-11-18T20:40:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4fee0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a480c7fc0 0x7f9a480c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4fee0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a48155790 0x7f9a480c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4fee0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a480c1da0 con 0x7f9a480c7700 2023-11-18T20:40:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4fee0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a480c3ee0 con 0x7f9a480c7fc0 2023-11-18T20:40:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4fee0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a480c7b90 con 0x7f9a48155790 2023-11-18T20:40:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4dc7c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a480c7fc0 0x7f9a480c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4dc7c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a480c7fc0 0x7f9a480c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:44752/0 (socket says 172.21.15.132:44752) 2023-11-18T20:40:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4dc7c640 1 -- 172.21.15.132:0/3944151080 learned_addr learned my addr 172.21.15.132:0/3944151080 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.779+0000 7f9a4e47d640 1 --2- 172.21.15.132:0/3944151080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a48155790 0x7f9a480c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.780+0000 7f9a4dc7c640 1 -- 172.21.15.132:0/3944151080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a48155790 msgr2=0x7f9a480c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.780+0000 7f9a4dc7c640 1 --2- 172.21.15.132:0/3944151080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a48155790 0x7f9a480c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.780+0000 7f9a4dc7c640 1 -- 172.21.15.132:0/3944151080 >> v1:172.21.15.161:6789/0 conn(0x7f9a480c7700 legacy=0x7f9a48155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.780+0000 7f9a4dc7c640 1 -- 172.21.15.132:0/3944151080 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a480c2080 con 0x7f9a480c7fc0 2023-11-18T20:40:45.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.781+0000 7f9a4dc7c640 1 --2- 172.21.15.132:0/3944151080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a480c7fc0 0x7f9a480c30b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a380098a0 tx=0x7f9a3802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c0fb65f46df0b8c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:45.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.782+0000 7f9a4cc7a640 1 -- 172.21.15.132:0/3944151080 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38031640 con 0x7f9a480c7fc0 2023-11-18T20:40:45.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.782+0000 7f9a4cc7a640 1 -- 172.21.15.132:0/3944151080 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380317a0 con 0x7f9a480c7fc0 2023-11-18T20:40:45.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.782+0000 7f9a4cc7a640 1 -- 172.21.15.132:0/3944151080 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38031b30 con 0x7f9a480c7fc0 2023-11-18T20:40:45.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.783+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3944151080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a480c7fc0 msgr2=0x7f9a480c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.783+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3944151080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a480c7fc0 0x7f9a480c30b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a380098a0 tx=0x7f9a3802b8f0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.783+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3944151080 shutdown_connections 2023-11-18T20:40:45.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.783+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3944151080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a48155790 0x7f9a480c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.783+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3944151080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a480c7fc0 0x7f9a480c30b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.783+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3944151080 >> 172.21.15.132:0/3944151080 conn(0x7f9a480a9b70 msgr2=0x7f9a480a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:45.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.783+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3944151080 shutdown_connections 2023-11-18T20:40:45.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.783+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3944151080 wait complete. 2023-11-18T20:40:45.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.784+0000 7f9a4fee0640 1 Processor -- start 2023-11-18T20:40:45.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.785+0000 7f9a4fee0640 1 -- start start 2023-11-18T20:40:45.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.785+0000 7f9a4fee0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a480c7fc0 0x7f9a481ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.785+0000 7f9a4fee0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a48155790 0x7f9a480ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.785+0000 7f9a4fee0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4814ffd0 0x7f9a4814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4fee0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4814f300 con 0x7f9a48155790 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4fee0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4806e800 con 0x7f9a4814ffd0 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4fee0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a481edd70 con 0x7f9a480c7fc0 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4d47b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a48155790 0x7f9a480ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4d47b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a48155790 0x7f9a480ac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56276/0 (socket says 172.21.15.132:56276) 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4d47b640 1 -- 172.21.15.132:0/3220373177 learned_addr learned my addr 172.21.15.132:0/3220373177 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4dc7c640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a480c7fc0 0x7f9a481ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4d47b640 1 -- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a480c7fc0 msgr2=0x7f9a481ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4e47d640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4814ffd0 0x7f9a4814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4d47b640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a480c7fc0 0x7f9a481ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4d47b640 1 -- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4814ffd0 msgr2=0x7f9a4814c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4d47b640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4814ffd0 0x7f9a4814c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.786+0000 7f9a4d47b640 1 -- 172.21.15.132:0/3220373177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380094d0 con 0x7f9a48155790 2023-11-18T20:40:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.787+0000 7f9a4d47b640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a48155790 0x7f9a480ac3c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400c430 tx=0x7f9a4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.787+0000 7f9a3e7fc640 1 -- 172.21.15.132:0/3220373177 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a440052d0 con 0x7f9a48155790 2023-11-18T20:40:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.787+0000 7f9a3e7fc640 1 -- 172.21.15.132:0/3220373177 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a44005430 con 0x7f9a48155790 2023-11-18T20:40:45.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.787+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a481ee050 con 0x7f9a48155790 2023-11-18T20:40:45.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.787+0000 7f9a3e7fc640 1 -- 172.21.15.132:0/3220373177 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44003850 con 0x7f9a48155790 2023-11-18T20:40:45.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.787+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4814d6c0 con 0x7f9a48155790 2023-11-18T20:40:45.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.788+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a480c36d0 con 0x7f9a48155790 2023-11-18T20:40:45.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.789+0000 7f9a3e7fc640 1 -- 172.21.15.132:0/3220373177 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a440039b0 con 0x7f9a48155790 2023-11-18T20:40:45.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.790+0000 7f9a3e7fc640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9a3406ae70 0x7f9a3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:45.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.790+0000 7f9a3e7fc640 1 -- 172.21.15.132:0/3220373177 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9a44088f20 con 0x7f9a48155790 2023-11-18T20:40:45.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.791+0000 7f9a4dc7c640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9a3406ae70 0x7f9a3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:45.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.792+0000 7f9a4dc7c640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9a3406ae70 0x7f9a3406d330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a38036000 tx=0x7f9a3803c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:45.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.795+0000 7f9a3e7fc640 1 -- 172.21.15.132:0/3220373177 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a44053c80 con 0x7f9a48155790 2023-11-18T20:40:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.985+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9a48068350 con 0x7f9a48155790 2023-11-18T20:40:45.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.986+0000 7f9a3e7fc640 1 -- 172.21.15.132:0/3220373177 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v59) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9a440572a0 con 0x7f9a48155790 2023-11-18T20:40:45.988 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9a3406ae70 msgr2=0x7f9a3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9a3406ae70 0x7f9a3406d330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a38036000 tx=0x7f9a3803c040 comp rx=0 tx=0).stop 2023-11-18T20:40:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a48155790 msgr2=0x7f9a480ac3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a48155790 0x7f9a480ac3c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400c430 tx=0x7f9a4400c8f0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 shutdown_connections 2023-11-18T20:40:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9a3406ae70 0x7f9a3406d330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4814ffd0 0x7f9a4814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a48155790 0x7f9a480ac3c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 --2- 172.21.15.132:0/3220373177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a480c7fc0 0x7f9a481ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.988+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 >> 172.21.15.132:0/3220373177 conn(0x7f9a480a9b70 msgr2=0x7f9a480c2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.989+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 shutdown_connections 2023-11-18T20:40:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:45.989+0000 7f9a4fee0640 1 -- 172.21.15.132:0/3220373177 wait complete. 2023-11-18T20:40:46.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:40:46.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.220+0000 7f632ba1f640 1 Processor -- start 2023-11-18T20:40:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.221+0000 7f632ba1f640 1 -- start start 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.222+0000 7f632ba1f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c6680 0x7f63240c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.222+0000 7f632ba1f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63240a6bc0 0x7f63240c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.222+0000 7f632ba1f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63240c7950 0x7f63240c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.222+0000 7f632ba1f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63240c2e80 con 0x7f63240a6bc0 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.222+0000 7f632ba1f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63240c4220 con 0x7f63240c7950 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.222+0000 7f632ba1f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63240c2ba0 con 0x7f63240c6680 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.222+0000 7f6328fba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63240a6bc0 0x7f63240c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6328fba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63240a6bc0 0x7f63240c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56280/0 (socket says 172.21.15.132:56280) 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6328fba640 1 -- 172.21.15.132:0/3144959914 learned_addr learned my addr 172.21.15.132:0/3144959914 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f63297bb640 1 --2- 172.21.15.132:0/3144959914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c6680 0x7f63240c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6329fbc640 1 --2- 172.21.15.132:0/3144959914 >> v2:172.21.15.161:3300/0 conn(0x7f63240c7950 0x7f63240c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6328fba640 1 -- 172.21.15.132:0/3144959914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c6680 msgr2=0x7f63240c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6328fba640 1 --2- 172.21.15.132:0/3144959914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c6680 0x7f63240c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6328fba640 1 -- 172.21.15.132:0/3144959914 >> v2:172.21.15.161:3300/0 conn(0x7f63240c7950 msgr2=0x7f63240c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6328fba640 1 --2- 172.21.15.132:0/3144959914 >> v2:172.21.15.161:3300/0 conn(0x7f63240c7950 0x7f63240c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6328fba640 1 -- 172.21.15.132:0/3144959914 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63240c32e0 con 0x7f63240a6bc0 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.223+0000 7f6329fbc640 1 --2- 172.21.15.132:0/3144959914 >> v2:172.21.15.161:3300/0 conn(0x7f63240c7950 0x7f63240c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.224+0000 7f6328fba640 1 --2- 172.21.15.132:0/3144959914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240c15d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f632406b410 tx=0x7f631402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6ace125456dce0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f631bfff640 1 -- 172.21.15.132:0/3144959914 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314031740 con 0x7f63240a6bc0 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f631bfff640 1 -- 172.21.15.132:0/3144959914 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63140318a0 con 0x7f63240a6bc0 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f631bfff640 1 -- 172.21.15.132:0/3144959914 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314031c30 con 0x7f63240a6bc0 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 -- 172.21.15.132:0/3144959914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 msgr2=0x7f63240c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 --2- 172.21.15.132:0/3144959914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240c15d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f632406b410 tx=0x7f631402b7e0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 -- 172.21.15.132:0/3144959914 shutdown_connections 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 --2- 172.21.15.132:0/3144959914 >> v2:172.21.15.161:3300/0 conn(0x7f63240c7950 0x7f63240c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 --2- 172.21.15.132:0/3144959914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240c15d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 --2- 172.21.15.132:0/3144959914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c6680 0x7f63240c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 -- 172.21.15.132:0/3144959914 >> 172.21.15.132:0/3144959914 conn(0x7f63240c7e30 msgr2=0x7f63240c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 -- 172.21.15.132:0/3144959914 shutdown_connections 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.225+0000 7f632ba1f640 1 -- 172.21.15.132:0/3144959914 wait complete. 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.227+0000 7f632ba1f640 1 Processor -- start 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.227+0000 7f632ba1f640 1 -- start start 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f632ba1f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f632ba1f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63240c6680 0x7f6324152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f632ba1f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c7950 0x7f63241edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f632ba1f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63240adbc0 con 0x7f63240a6bc0 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f632ba1f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63241ed7a0 con 0x7f63240c6680 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f632ba1f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63240a8290 con 0x7f63240c7950 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f63297bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f63297bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56284/0 (socket says 172.21.15.132:56284) 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.228+0000 7f63297bb640 1 -- 172.21.15.132:0/1711062254 learned_addr learned my addr 172.21.15.132:0/1711062254 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f6328fba640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63240c6680 0x7f6324152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f63297bb640 1 -- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c7950 msgr2=0x7f63241edc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f63297bb640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c7950 0x7f63241edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f63297bb640 1 -- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63240c6680 msgr2=0x7f6324152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f63297bb640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63240c6680 0x7f6324152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f63297bb640 1 -- 172.21.15.132:0/1711062254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140094d0 con 0x7f63240a6bc0 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f6328fba640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63240c6680 0x7f6324152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f63297bb640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240a7d50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f632000d830 tx=0x7f632000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f6319ffb640 1 -- 172.21.15.132:0/1711062254 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632000be10 con 0x7f63240a6bc0 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f6319ffb640 1 -- 172.21.15.132:0/1711062254 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63200098b0 con 0x7f63240a6bc0 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63240ad600 con 0x7f63240a6bc0 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.229+0000 7f6319ffb640 1 -- 172.21.15.132:0/1711062254 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320009a40 con 0x7f63240a6bc0 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.230+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63241ed430 con 0x7f63240a6bc0 2023-11-18T20:40:46.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.231+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6324068350 con 0x7f63240a6bc0 2023-11-18T20:40:46.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.232+0000 7f6319ffb640 1 -- 172.21.15.132:0/1711062254 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6320009ba0 con 0x7f63240a6bc0 2023-11-18T20:40:46.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.232+0000 7f6319ffb640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f630806ae40 0x7f630806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.233+0000 7f6319ffb640 1 -- 172.21.15.132:0/1711062254 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6320089c60 con 0x7f63240a6bc0 2023-11-18T20:40:46.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.233+0000 7f6328fba640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f630806ae40 0x7f630806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.234+0000 7f6328fba640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f630806ae40 0x7f630806d300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6314035000 tx=0x7f6314008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:46.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.237+0000 7f6319ffb640 1 -- 172.21.15.132:0/1711062254 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6320054a40 con 0x7f63240a6bc0 2023-11-18T20:40:46.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.443+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f63240c5f10 con 0x7f63240a6bc0 2023-11-18T20:40:46.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.444+0000 7f6319ffb640 1 -- 172.21.15.132:0/1711062254 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f632000b3a0 con 0x7f63240a6bc0 2023-11-18T20:40:46.445 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:40:46.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.446+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f630806ae40 msgr2=0x7f630806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.446+0000 7f632ba1f640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f630806ae40 0x7f630806d300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6314035000 tx=0x7f6314008030 comp rx=0 tx=0).stop 2023-11-18T20:40:46.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.446+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 msgr2=0x7f63240a7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.446+0000 7f632ba1f640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240a7d50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f632000d830 tx=0x7f632000dcf0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.447+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 shutdown_connections 2023-11-18T20:40:46.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.447+0000 7f632ba1f640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f630806ae40 0x7f630806d300 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.447+0000 7f632ba1f640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63240c7950 0x7f63241edc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.447+0000 7f632ba1f640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63240c6680 0x7f6324152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.447+0000 7f632ba1f640 1 --2- 172.21.15.132:0/1711062254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63240a6bc0 0x7f63240a7d50 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.447+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 >> 172.21.15.132:0/1711062254 conn(0x7f63240c7e30 msgr2=0x7f6324150260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:46.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.447+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 shutdown_connections 2023-11-18T20:40:46.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.447+0000 7f632ba1f640 1 -- 172.21.15.132:0/1711062254 wait complete. 2023-11-18T20:40:46.467 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-18T20:40:46.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:46.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-18T20:40:46.569 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:40:46.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:46.569 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-18T20:40:46.614 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:40:46.614 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:46.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:40:46.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:40:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.917+0000 7f358bfff640 1 Processor -- start 2023-11-18T20:40:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.917+0000 7f358bfff640 1 -- start start 2023-11-18T20:40:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c14c2e0 0x7f358c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f358c072310 0x7f358c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358bfff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c071e80 con 0x7f358c0c0440 2023-11-18T20:40:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358bfff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c071470 con 0x7f358c072310 2023-11-18T20:40:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358bfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c14c6c0 con 0x7f358c14c2e0 2023-11-18T20:40:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358a7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f358c0c0440 0x7f358c152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43668/0 (socket says 172.21.15.132:43668) 2023-11-18T20:40:46.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358a7fc640 1 -- 172.21.15.132:0/3377672495 learned_addr learned my addr 172.21.15.132:0/3377672495 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:46.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358b7fe640 1 --2- 172.21.15.132:0/3377672495 >> v2:172.21.15.161:3300/0 conn(0x7f358c072310 0x7f358c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.919+0000 7f358affd640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c14c2e0 0x7f358c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782571145 0 0) 0x7f358c071e80 con 0x7f358c0c0440 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3574003520 con 0x7f358c0c0440 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1349191075 0 0) 0x7f3574003520 con 0x7f358c0c0440 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c14c2e0 msgr2=0x7f358c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c14c2e0 0x7f358c0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 >> v2:172.21.15.161:3300/0 conn(0x7f358c072310 msgr2=0x7f358c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 --2- 172.21.15.132:0/3377672495 >> v2:172.21.15.161:3300/0 conn(0x7f358c072310 0x7f358c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c06fdc0 con 0x7f358c0c0440 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f3580001670 con 0x7f358c0c0440 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 >> v1:172.21.15.132:6789/0 conn(0x7f358c0c0440 legacy=0x7f358c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f3574003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35740047c0 0x7f3574004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c14c2e0 0x7f3574005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c14c6c0 con 0x7f3574003970 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357400fd90 con 0x7f35740047c0 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.920+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357400ff50 con 0x7f358c14c2e0 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.921+0000 7f358affd640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f3574003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.921+0000 7f358a7fc640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35740047c0 0x7f3574004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.921+0000 7f358b7fe640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c14c2e0 0x7f3574005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.921+0000 7f358affd640 1 -- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c14c2e0 msgr2=0x7f3574005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.921+0000 7f358affd640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c14c2e0 0x7f3574005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.921+0000 7f358affd640 1 -- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35740047c0 msgr2=0x7f3574004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.921+0000 7f358affd640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35740047c0 0x7f3574004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.921+0000 7f358affd640 1 -- 172.21.15.132:0/3377672495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574003520 con 0x7f3574003970 2023-11-18T20:40:46.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.922+0000 7f358affd640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f3574003d90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f357c009ac0 tx=0x7f35740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866335c39d32ea67 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.923+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c02c6b0 con 0x7f3574003970 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.923+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c02c810 con 0x7f3574003970 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.923+0000 7f3589ffb640 1 -- 172.21.15.132:0/3377672495 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c02cba0 con 0x7f3574003970 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.923+0000 7f358bfff640 1 -- 172.21.15.132:0/3377672495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 msgr2=0x7f3574003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.923+0000 7f358bfff640 1 --2- 172.21.15.132:0/3377672495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f3574003d90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f357c009ac0 tx=0x7f35740057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.923+0000 7f358b7fe640 1 -- 172.21.15.132:0/3377672495 reap_dead start 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.923+0000 7f358bfff640 1 -- 172.21.15.132:0/3377672495 shutdown_connections 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.923+0000 7f358bfff640 1 -- 172.21.15.132:0/3377672495 >> 172.21.15.132:0/3377672495 conn(0x7f358c0a77f0 msgr2=0x7f358c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.924+0000 7f358bfff640 1 -- 172.21.15.132:0/3377672495 shutdown_connections 2023-11-18T20:40:46.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.924+0000 7f358bfff640 1 -- 172.21.15.132:0/3377672495 wait complete. 2023-11-18T20:40:46.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.925+0000 7f358bfff640 1 Processor -- start 2023-11-18T20:40:46.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.925+0000 7f358bfff640 1 -- start start 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.926+0000 7f358bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f358c151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.926+0000 7f358bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c150000 0x7f358c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.926+0000 7f358bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f358c1526c0 0x7f358c06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.926+0000 7f358bfff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1512a0 con 0x7f3574003970 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.926+0000 7f358bfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1e53c0 con 0x7f358c1526c0 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.926+0000 7f358bfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c155f50 con 0x7f358c150000 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f358c151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f358c151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56292/0 (socket says 172.21.15.132:56292) 2023-11-18T20:40:46.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 -- 172.21.15.132:0/2834989431 learned_addr learned my addr 172.21.15.132:0/2834989431 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:46.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358a7fc640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c150000 0x7f358c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358b7fe640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f358c1526c0 0x7f358c06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 -- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c150000 msgr2=0x7f358c150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c150000 0x7f358c150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 -- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f358c1526c0 msgr2=0x7f358c06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f358c1526c0 0x7f358c06cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 -- 172.21.15.132:0/2834989431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c156230 con 0x7f3574003970 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358a7fc640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c150000 0x7f358c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.927+0000 7f358affd640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f358c151430 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f357c037040 tx=0x7f357c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.928+0000 7f3573fff640 1 -- 172.21.15.132:0/2834989431 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c003810 con 0x7f3574003970 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.928+0000 7f3573fff640 1 -- 172.21.15.132:0/2834989431 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c003970 con 0x7f3574003970 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.928+0000 7f3573fff640 1 -- 172.21.15.132:0/2834989431 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c003d00 con 0x7f3574003970 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.928+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c1e55d0 con 0x7f3574003970 2023-11-18T20:40:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.928+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c155be0 con 0x7f3574003970 2023-11-18T20:40:46.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.929+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c1e5790 con 0x7f3574003970 2023-11-18T20:40:46.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.930+0000 7f3573fff640 1 -- 172.21.15.132:0/2834989431 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f357c047450 con 0x7f3574003970 2023-11-18T20:40:46.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.931+0000 7f3573fff640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f357806ae40 0x7f357806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.931+0000 7f3573fff640 1 -- 172.21.15.132:0/2834989431 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f357c0abc00 con 0x7f3574003970 2023-11-18T20:40:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.931+0000 7f358a7fc640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f357806ae40 0x7f357806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:46.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.932+0000 7f358a7fc640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f357806ae40 0x7f357806d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3580001eb0 tx=0x7f3580000fe0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:46.935+0000 7f3573fff640 1 -- 172.21.15.132:0/2834989431 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f357c0b2080 con 0x7f3574003970 2023-11-18T20:40:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.163+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f358c156090 con 0x7f3574003970 2023-11-18T20:40:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.164+0000 7f3573fff640 1 -- 172.21.15.132:0/2834989431 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+149 (secure 0 0 0) 0x7f358c156090 con 0x7f3574003970 2023-11-18T20:40:47.165 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:40:47.165 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-18T20:40:47.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f357806ae40 msgr2=0x7f357806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:47.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f357806ae40 0x7f357806d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3580001eb0 tx=0x7f3580000fe0 comp rx=0 tx=0).stop 2023-11-18T20:40:47.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 msgr2=0x7f358c151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f358c151430 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f357c037040 tx=0x7f357c004730 comp rx=0 tx=0).stop 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 shutdown_connections 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f357806ae40 0x7f357806d300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f358c1526c0 0x7f358c06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f358c150000 0x7f358c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 --2- 172.21.15.132:0/2834989431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574003970 0x7f358c151430 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.166+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 >> 172.21.15.132:0/2834989431 conn(0x7f358c0a77f0 msgr2=0x7f358c145ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.167+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 shutdown_connections 2023-11-18T20:40:47.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:47.167+0000 7f358bfff640 1 -- 172.21.15.132:0/2834989431 wait complete. 2023-11-18T20:40:47.186 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-18T20:40:47.187 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:40:47.187 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-18T20:40:47.187 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-18T20:40:47.187 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:40:47.187 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-18T20:40:47.187 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:40:47.187 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.FYgSYcwvVx 2023-11-18T20:40:47.187 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-18T20:40:47.242 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.gWloTf8Gfb 2023-11-18T20:40:47.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /tmp/tmp.FYgSYcwvVx /tmp/tmp.gWloTf8Gfb 2023-11-18T20:40:47.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.gWloTf8Gfb 2023-11-18T20:40:47.489 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.gWloTf8Gfb is 245B 2023-11-18T20:40:47.551 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.gWloTf8Gfb 2023-11-18T20:40:47.596 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBKIVll24xCHRAACieDcOUVt/oS9yqNZXzmMw== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-18T20:40:47.596 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:40:47.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:47.596 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-18T20:40:47.692 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:40:47.692 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:40:47.692 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:40:47.692 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:47.692 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:40:47.693 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42263sec preferred_lft 42263sec 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::84fc:84ff:fe41:e5e7/64 scope link 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a88f:ebff:fe95:c612/64 scope link 2023-11-18T20:40:47.694 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:40:47.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:47.695 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:40:47.780 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-18T20:40:47.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:47.784 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-18T20:40:47.840 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-18T20:40:47.840 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:40:47.840 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:40:47.841 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:40:47.841 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:40:47.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:47.841 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:40:47.841 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:40:47.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:40:47.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:40:47.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:40:47.841 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:40:48.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:48.019 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:40:48.070 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T20:40:48.071 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:40:48.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:48.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-18T20:40:48.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:40:48.165 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T20:40:48.218 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:40:48.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:40:48.219 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:40:48.270 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:40:48.270 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/tmp/tmp.FYgSYcwvVx of=/dev/stdout 2023-11-18T20:40:48.323 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:40:48.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:48.324 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBKIVll24xCHRAACieDcOUVt/oS9yqNZXzmMw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:40:48.466 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQBKIVll24xCHRAACieDcOUVt/oS9yqNZXzmMw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:40:48.466 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:40:48.466 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:40:48.467 INFO:teuthology.orchestra.run.smithi132.stdout:keyring.get_secret failed 2023-11-18T20:40:48.490 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQBKIVll24xCHRAACieDcOUVt/oS9yqNZXzmMw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:40:48.490 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:40:48.490 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:40:48.490 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:40:48.491 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:40:48.491 INFO:teuthology.orchestra.run.smithi132.stdout:keyring.get_secret failed 2023-11-18T20:40:48.524 INFO:teuthology.orchestra.run.smithi132.stderr:mount error 13 = Permission denied 2023-11-18T20:40:48.525 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQBKIVll24xCHRAACieDcOUVt/oS9yqNZXzmMw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:40:48.525 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:40:48.525 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:40:48.526 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:40:48.526 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:40:48.526 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:40:48.526 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:40:48.526 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:40:48.532 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-18T20:40:48.533 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-11-18T20:40:48.533 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-18T20:40:48.533 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:40:48.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:40:48.778 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-18T20:40:48.778 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:40:48.779 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:48.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:40:48.839 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:40:48.839 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:48.900 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:40:48.900 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:40:48.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:49.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.180+0000 7fcbaae02640 1 Processor -- start 2023-11-18T20:40:49.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.180+0000 7fcbaae02640 1 -- start start 2023-11-18T20:40:49.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcbaae02640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba406d0a0 0x7fcba4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcbaae02640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcba40c3ea0 0x7fcba40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcbaae02640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba40c64a0 con 0x7fcba414fd30 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcbaae02640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba40c5c00 con 0x7fcba40c3ea0 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcbaae02640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40c5ee0 con 0x7fcba406d0a0 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcba939f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcba40c3ea0 0x7fcba40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcba939f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcba40c3ea0 0x7fcba40c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42230/0 (socket says 172.21.15.132:42230) 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcba939f640 1 -- 172.21.15.132:0/96836396 learned_addr learned my addr 172.21.15.132:0/96836396 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.182+0000 7fcba3fff640 1 --2- 172.21.15.132:0/96836396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba406d0a0 0x7fcba4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.183+0000 7fcba939f640 1 -- 172.21.15.132:0/96836396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba406d0a0 msgr2=0x7fcba4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.183+0000 7fcba939f640 1 --2- 172.21.15.132:0/96836396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba406d0a0 0x7fcba4152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.183+0000 7fcba939f640 1 -- 172.21.15.132:0/96836396 >> v1:172.21.15.161:6789/0 conn(0x7fcba414fd30 legacy=0x7fcba40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:49.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.183+0000 7fcba939f640 1 -- 172.21.15.132:0/96836396 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba40c61c0 con 0x7fcba40c3ea0 2023-11-18T20:40:49.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.184+0000 7fcba939f640 1 --2- 172.21.15.132:0/96836396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba40c3ea0 0x7fcba40c4330 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009e50 tx=0x7fcb9c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9344790b9bbe426d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:49.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.184+0000 7fcba37fe640 1 -- 172.21.15.132:0/96836396 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c02ca70 con 0x7fcba40c3ea0 2023-11-18T20:40:49.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.184+0000 7fcba37fe640 1 -- 172.21.15.132:0/96836396 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c02cbd0 con 0x7fcba40c3ea0 2023-11-18T20:40:49.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.184+0000 7fcba37fe640 1 -- 172.21.15.132:0/96836396 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0343f0 con 0x7fcba40c3ea0 2023-11-18T20:40:49.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.185+0000 7fcbaae02640 1 -- 172.21.15.132:0/96836396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba40c3ea0 msgr2=0x7fcba40c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.185+0000 7fcbaae02640 1 --2- 172.21.15.132:0/96836396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba40c3ea0 0x7fcba40c4330 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009e50 tx=0x7fcb9c02bed0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.185+0000 7fcbaae02640 1 -- 172.21.15.132:0/96836396 shutdown_connections 2023-11-18T20:40:49.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.185+0000 7fcbaae02640 1 --2- 172.21.15.132:0/96836396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba40c3ea0 0x7fcba40c4330 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.185+0000 7fcbaae02640 1 --2- 172.21.15.132:0/96836396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba406d0a0 0x7fcba4152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.185+0000 7fcbaae02640 1 -- 172.21.15.132:0/96836396 >> 172.21.15.132:0/96836396 conn(0x7fcba406a500 msgr2=0x7fcba406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:49.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.185+0000 7fcbaae02640 1 -- 172.21.15.132:0/96836396 shutdown_connections 2023-11-18T20:40:49.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.185+0000 7fcbaae02640 1 -- 172.21.15.132:0/96836396 wait complete. 2023-11-18T20:40:49.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.187+0000 7fcbaae02640 1 Processor -- start 2023-11-18T20:40:49.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.187+0000 7fcbaae02640 1 -- start start 2023-11-18T20:40:49.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcbaae02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba406d0a0 0x7fcba41eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcbaae02640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcba40c3ea0 0x7fcba40a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcbaae02640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba414fd30 0x7fcba406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcbaae02640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40c0d30 con 0x7fcba406d0a0 2023-11-18T20:40:49.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcbaae02640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4071af0 con 0x7fcba40c3ea0 2023-11-18T20:40:49.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcbaae02640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4071810 con 0x7fcba414fd30 2023-11-18T20:40:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcba8b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba406d0a0 0x7fcba41eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcba8b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba406d0a0 0x7fcba41eabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42240/0 (socket says 172.21.15.132:42240) 2023-11-18T20:40:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.188+0000 7fcba8b9e640 1 -- 172.21.15.132:0/1430554598 learned_addr learned my addr 172.21.15.132:0/1430554598 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:49.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba3fff640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcba40c3ea0 0x7fcba40a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba939f640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba414fd30 0x7fcba406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba8b9e640 1 -- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba414fd30 msgr2=0x7fcba406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba8b9e640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba414fd30 0x7fcba406fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba8b9e640 1 -- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcba40c3ea0 msgr2=0x7fcba40a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba8b9e640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcba40c3ea0 0x7fcba40a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba8b9e640 1 -- 172.21.15.132:0/1430554598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c009b30 con 0x7fcba406d0a0 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba3fff640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcba40c3ea0 0x7fcba40a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba8b9e640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba406d0a0 0x7fcba41eabc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800c430 tx=0x7fcb9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba17fa640 1 -- 172.21.15.132:0/1430554598 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98011790 con 0x7fcba406d0a0 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba17fa640 1 -- 172.21.15.132:0/1430554598 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb980118f0 con 0x7fcba406d0a0 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcba17fa640 1 -- 172.21.15.132:0/1430554598 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98011ce0 con 0x7fcba406d0a0 2023-11-18T20:40:49.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba41ea0e0 con 0x7fcba406d0a0 2023-11-18T20:40:49.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.189+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba41ea6a0 con 0x7fcba406d0a0 2023-11-18T20:40:49.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.190+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba4068350 con 0x7fcba406d0a0 2023-11-18T20:40:49.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.191+0000 7fcba17fa640 1 -- 172.21.15.132:0/1430554598 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb9801c460 con 0x7fcba406d0a0 2023-11-18T20:40:49.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.192+0000 7fcba17fa640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb8806ae40 0x7fcb8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.192+0000 7fcba17fa640 1 -- 172.21.15.132:0/1430554598 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fcb980899a0 con 0x7fcba406d0a0 2023-11-18T20:40:49.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.193+0000 7fcba3fff640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb8806ae40 0x7fcb8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.194+0000 7fcba3fff640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb8806ae40 0x7fcb8806d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcba40c35e0 tx=0x7fcb90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:49.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.197+0000 7fcba17fa640 1 -- 172.21.15.132:0/1430554598 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb98054670 con 0x7fcba406d0a0 2023-11-18T20:40:49.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.390+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcba40c66d0 con 0x7fcba406d0a0 2023-11-18T20:40:49.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.394+0000 7fcba17fa640 1 -- 172.21.15.132:0/1430554598 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20447 (secure 0 0 0) 0x7fcb98057c90 con 0x7fcba406d0a0 2023-11-18T20:40:49.395 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:49.396 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":61,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:47.525645+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":4}]},{"pgid":"9.3b","mappings":[{"from":6,"to":1}]},{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.29","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:49.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.396+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb8806ae40 msgr2=0x7fcb8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.396+0000 7fcbaae02640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb8806ae40 0x7fcb8806d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcba40c35e0 tx=0x7fcb90008040 comp rx=0 tx=0).stop 2023-11-18T20:40:49.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.396+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba406d0a0 msgr2=0x7fcba41eabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.396+0000 7fcbaae02640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba406d0a0 0x7fcba41eabc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800c430 tx=0x7fcb9800c8f0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.397+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 shutdown_connections 2023-11-18T20:40:49.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.397+0000 7fcbaae02640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcb8806ae40 0x7fcb8806d300 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.397+0000 7fcbaae02640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcba414fd30 0x7fcba406fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.397+0000 7fcbaae02640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcba40c3ea0 0x7fcba40a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.397+0000 7fcbaae02640 1 --2- 172.21.15.132:0/1430554598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcba406d0a0 0x7fcba41eabc0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.397+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 >> 172.21.15.132:0/1430554598 conn(0x7fcba406a500 msgr2=0x7fcba40a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:49.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.397+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 shutdown_connections 2023-11-18T20:40:49.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.397+0000 7fcbaae02640 1 -- 172.21.15.132:0/1430554598 wait complete. 2023-11-18T20:40:49.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:40:13.573413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:40:14.279671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:40:28.826395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:40:29.825753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:40:49.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:40:49.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.632+0000 7f1a7ffff640 1 Processor -- start 2023-11-18T20:40:49.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.633+0000 7f1a7ffff640 1 -- start start 2023-11-18T20:40:49.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.634+0000 7f1a7ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a80155f60 0x7f1a800c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.634+0000 7f1a7ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a8006e000 0x7f1a8015be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.634+0000 7f1a7ffff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a80159800 con 0x7f1a800c1100 2023-11-18T20:40:49.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.634+0000 7f1a7ffff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8006c440 con 0x7f1a80155f60 2023-11-18T20:40:49.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.634+0000 7f1a7ffff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a80156340 con 0x7f1a8006e000 2023-11-18T20:40:49.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a7effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a80155f60 0x7f1a800c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a7effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a80155f60 0x7f1a800c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42244/0 (socket says 172.21.15.132:42244) 2023-11-18T20:40:49.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a7effd640 1 -- 172.21.15.132:0/354866131 learned_addr learned my addr 172.21.15.132:0/354866131 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a77fff640 1 --2- 172.21.15.132:0/354866131 >> v2:172.21.15.161:3300/0 conn(0x7f1a8006e000 0x7f1a8015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a7effd640 1 -- 172.21.15.132:0/354866131 >> v2:172.21.15.161:3300/0 conn(0x7f1a8006e000 msgr2=0x7f1a8015be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a7effd640 1 --2- 172.21.15.132:0/354866131 >> v2:172.21.15.161:3300/0 conn(0x7f1a8006e000 0x7f1a8015be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a7effd640 1 -- 172.21.15.132:0/354866131 >> v1:172.21.15.161:6789/0 conn(0x7f1a800c1100 legacy=0x7f1a8015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a7effd640 1 -- 172.21.15.132:0/354866131 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80158a40 con 0x7f1a80155f60 2023-11-18T20:40:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.635+0000 7f1a77fff640 1 --2- 172.21.15.132:0/354866131 >> v2:172.21.15.161:3300/0 conn(0x7f1a8006e000 0x7f1a8015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.636+0000 7f1a7effd640 1 --2- 172.21.15.132:0/354866131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a80155f60 0x7f1a800c18f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1a8006c820 tx=0x7f1a7002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbbdeb667489203 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7e7fc640 1 -- 172.21.15.132:0/354866131 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70031890 con 0x7f1a80155f60 2023-11-18T20:40:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7e7fc640 1 -- 172.21.15.132:0/354866131 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a700319f0 con 0x7f1a80155f60 2023-11-18T20:40:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7e7fc640 1 -- 172.21.15.132:0/354866131 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70031d80 con 0x7f1a80155f60 2023-11-18T20:40:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7ffff640 1 -- 172.21.15.132:0/354866131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a80155f60 msgr2=0x7f1a800c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/354866131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a80155f60 0x7f1a800c18f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1a8006c820 tx=0x7f1a7002b930 comp rx=0 tx=0).stop 2023-11-18T20:40:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7ffff640 1 -- 172.21.15.132:0/354866131 shutdown_connections 2023-11-18T20:40:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/354866131 >> v2:172.21.15.161:3300/0 conn(0x7f1a8006e000 0x7f1a8015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/354866131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a80155f60 0x7f1a800c18f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.637+0000 7f1a7ffff640 1 -- 172.21.15.132:0/354866131 >> 172.21.15.132:0/354866131 conn(0x7f1a800a77f0 msgr2=0x7f1a800a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.638+0000 7f1a7ffff640 1 -- 172.21.15.132:0/354866131 shutdown_connections 2023-11-18T20:40:49.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.638+0000 7f1a7ffff640 1 -- 172.21.15.132:0/354866131 wait complete. 2023-11-18T20:40:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.639+0000 7f1a7ffff640 1 Processor -- start 2023-11-18T20:40:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.640+0000 7f1a7ffff640 1 -- start start 2023-11-18T20:40:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.640+0000 7f1a7ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a8006e000 0x7f1a800713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.640+0000 7f1a7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a800c1100 0x7f1a801ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.640+0000 7f1a7ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a80155f60 0x7f1a801ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.640+0000 7f1a7ffff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800a38f0 con 0x7f1a800c1100 2023-11-18T20:40:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.640+0000 7f1a7ffff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800a5520 con 0x7f1a80155f60 2023-11-18T20:40:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.640+0000 7f1a7ffff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015cd30 con 0x7f1a8006e000 2023-11-18T20:40:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a77fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a800c1100 0x7f1a801ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a77fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a800c1100 0x7f1a801ee2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42258/0 (socket says 172.21.15.132:42258) 2023-11-18T20:40:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a77fff640 1 -- 172.21.15.132:0/4065980994 learned_addr learned my addr 172.21.15.132:0/4065980994 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a7effd640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a8006e000 0x7f1a800713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a77fff640 1 -- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a8006e000 msgr2=0x7f1a800713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a77fff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a8006e000 0x7f1a800713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a77fff640 1 -- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a80155f60 msgr2=0x7f1a801ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a77fff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a80155f60 0x7f1a801ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.641+0000 7f1a77fff640 1 -- 172.21.15.132:0/4065980994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700094d0 con 0x7f1a800c1100 2023-11-18T20:40:49.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.642+0000 7f1a77fff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a800c1100 0x7f1a801ee2d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c7f0 tx=0x7f1a6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:49.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.642+0000 7f1a777fe640 1 -- 172.21.15.132:0/4065980994 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68007a30 con 0x7f1a800c1100 2023-11-18T20:40:49.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.642+0000 7f1a777fe640 1 -- 172.21.15.132:0/4065980994 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68007b90 con 0x7f1a800c1100 2023-11-18T20:40:49.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.642+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8015ca50 con 0x7f1a800c1100 2023-11-18T20:40:49.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.642+0000 7f1a777fe640 1 -- 172.21.15.132:0/4065980994 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800ce40 con 0x7f1a800c1100 2023-11-18T20:40:49.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.642+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a801f1c50 con 0x7f1a800c1100 2023-11-18T20:40:49.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.643+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8004e840 con 0x7f1a800c1100 2023-11-18T20:40:49.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.644+0000 7f1a777fe640 1 -- 172.21.15.132:0/4065980994 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a680113f0 con 0x7f1a800c1100 2023-11-18T20:40:49.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.645+0000 7f1a777fe640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a6006ae40 0x7f1a6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.645+0000 7f1a777fe640 1 -- 172.21.15.132:0/4065980994 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f1a68089b40 con 0x7f1a800c1100 2023-11-18T20:40:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.646+0000 7f1a7effd640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a6006ae40 0x7f1a6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.647+0000 7f1a7effd640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a6006ae40 0x7f1a6006d300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a70036000 tx=0x7f1a7003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.649+0000 7f1a777fe640 1 -- 172.21.15.132:0/4065980994 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a68054810 con 0x7f1a800c1100 2023-11-18T20:40:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.838+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a800c53d0 con 0x7f1a800c1100 2023-11-18T20:40:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.839+0000 7f1a777fe640 1 -- 172.21.15.132:0/4065980994 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a6801f0a0 con 0x7f1a800c1100 2023-11-18T20:40:49.841 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:40:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a6006ae40 msgr2=0x7f1a6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a6006ae40 0x7f1a6006d300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a70036000 tx=0x7f1a7003c040 comp rx=0 tx=0).stop 2023-11-18T20:40:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a800c1100 msgr2=0x7f1a801ee2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a800c1100 0x7f1a801ee2d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c7f0 tx=0x7f1a6800cbf0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 shutdown_connections 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1a6006ae40 0x7f1a6006d300 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a80155f60 0x7f1a801ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a800c1100 0x7f1a801ee2d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 --2- 172.21.15.132:0/4065980994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a8006e000 0x7f1a800713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 >> 172.21.15.132:0/4065980994 conn(0x7f1a800a77f0 msgr2=0x7f1a800a6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 shutdown_connections 2023-11-18T20:40:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:49.842+0000 7f1a7ffff640 1 -- 172.21.15.132:0/4065980994 wait complete. 2023-11-18T20:40:49.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:40:50.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.073+0000 7ff354a33640 1 Processor -- start 2023-11-18T20:40:50.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.073+0000 7ff354a33640 1 -- start start 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.074+0000 7ff354a33640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff35014c2e0 0x7ff3500c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.074+0000 7ff354a33640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff3500c0440 0x7ff350152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.074+0000 7ff354a33640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff350072310 0x7ff3500a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.074+0000 7ff354a33640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff350071470 con 0x7ff350072310 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.074+0000 7ff354a33640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff350071e80 con 0x7ff3500c0440 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.074+0000 7ff354a33640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35014c6c0 con 0x7ff35014c2e0 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff350072310 0x7ff3500a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff350072310 0x7ff3500a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42270/0 (socket says 172.21.15.132:42270) 2023-11-18T20:40:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34f59e640 1 -- 172.21.15.132:0/2154197592 learned_addr learned my addr 172.21.15.132:0/2154197592 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:50.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff347fff640 1 --2- 172.21.15.132:0/2154197592 >> v2:172.21.15.161:3300/0 conn(0x7ff3500c0440 0x7ff350152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34ed9d640 1 --2- 172.21.15.132:0/2154197592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff35014c2e0 0x7ff3500c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34f59e640 1 -- 172.21.15.132:0/2154197592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff35014c2e0 msgr2=0x7ff3500c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34f59e640 1 --2- 172.21.15.132:0/2154197592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff35014c2e0 0x7ff3500c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34f59e640 1 -- 172.21.15.132:0/2154197592 >> v2:172.21.15.161:3300/0 conn(0x7ff3500c0440 msgr2=0x7ff350152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34f59e640 1 --2- 172.21.15.132:0/2154197592 >> v2:172.21.15.161:3300/0 conn(0x7ff3500c0440 0x7ff350152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff34f59e640 1 -- 172.21.15.132:0/2154197592 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350153180 con 0x7ff350072310 2023-11-18T20:40:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.075+0000 7ff347fff640 1 --2- 172.21.15.132:0/2154197592 >> v2:172.21.15.161:3300/0 conn(0x7ff3500c0440 0x7ff350152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.076+0000 7ff34f59e640 1 --2- 172.21.15.132:0/2154197592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff350072310 0x7ff3500a4d20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff35006b500 tx=0x7ff34802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd3791faa1d2805 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.077+0000 7ff34e59c640 1 -- 172.21.15.132:0/2154197592 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34802c950 con 0x7ff350072310 2023-11-18T20:40:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.077+0000 7ff34e59c640 1 -- 172.21.15.132:0/2154197592 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34802cab0 con 0x7ff350072310 2023-11-18T20:40:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.077+0000 7ff34e59c640 1 -- 172.21.15.132:0/2154197592 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34802ce40 con 0x7ff350072310 2023-11-18T20:40:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.077+0000 7ff354a33640 1 -- 172.21.15.132:0/2154197592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff350072310 msgr2=0x7ff3500a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.077+0000 7ff354a33640 1 --2- 172.21.15.132:0/2154197592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff350072310 0x7ff3500a4d20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff35006b500 tx=0x7ff34802bdb0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.078+0000 7ff354a33640 1 -- 172.21.15.132:0/2154197592 shutdown_connections 2023-11-18T20:40:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.078+0000 7ff354a33640 1 --2- 172.21.15.132:0/2154197592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff350072310 0x7ff3500a4d20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.078+0000 7ff354a33640 1 --2- 172.21.15.132:0/2154197592 >> v2:172.21.15.161:3300/0 conn(0x7ff3500c0440 0x7ff350152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.078+0000 7ff354a33640 1 --2- 172.21.15.132:0/2154197592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff35014c2e0 0x7ff3500c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.078+0000 7ff354a33640 1 -- 172.21.15.132:0/2154197592 >> 172.21.15.132:0/2154197592 conn(0x7ff3500a77f0 msgr2=0x7ff3500a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.078+0000 7ff354a33640 1 -- 172.21.15.132:0/2154197592 shutdown_connections 2023-11-18T20:40:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.078+0000 7ff354a33640 1 -- 172.21.15.132:0/2154197592 wait complete. 2023-11-18T20:40:50.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.079+0000 7ff354a33640 1 Processor -- start 2023-11-18T20:40:50.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.079+0000 7ff354a33640 1 -- start start 2023-11-18T20:40:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.080+0000 7ff354a33640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff350072310 0x7ff3501e4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.080+0000 7ff354a33640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3500c0440 0x7ff3501eae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.080+0000 7ff354a33640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff35014c2e0 0x7ff3501eb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.080+0000 7ff354a33640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350142900 con 0x7ff3500c0440 2023-11-18T20:40:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.080+0000 7ff354a33640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501ebcf0 con 0x7ff35014c2e0 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.080+0000 7ff354a33640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500a9570 con 0x7ff350072310 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff347fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3500c0440 0x7ff3501eae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff347fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3500c0440 0x7ff3501eae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42278/0 (socket says 172.21.15.132:42278) 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff347fff640 1 -- 172.21.15.132:0/2809142193 learned_addr learned my addr 172.21.15.132:0/2809142193 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff34ed9d640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff350072310 0x7ff3501e4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff34f59e640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff35014c2e0 0x7ff3501eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff347fff640 1 -- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff350072310 msgr2=0x7ff3501e4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff347fff640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff350072310 0x7ff3501e4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff347fff640 1 -- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff35014c2e0 msgr2=0x7ff3501eb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff347fff640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff35014c2e0 0x7ff3501eb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.081+0000 7ff347fff640 1 -- 172.21.15.132:0/2809142193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009b30 con 0x7ff3500c0440 2023-11-18T20:40:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.082+0000 7ff347fff640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3500c0440 0x7ff3501eae50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff33800c7f0 tx=0x7ff33800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.082+0000 7ff3477fe640 1 -- 172.21.15.132:0/2809142193 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338007a30 con 0x7ff3500c0440 2023-11-18T20:40:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.082+0000 7ff3477fe640 1 -- 172.21.15.132:0/2809142193 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338007b90 con 0x7ff3500c0440 2023-11-18T20:40:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.082+0000 7ff3477fe640 1 -- 172.21.15.132:0/2809142193 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800ce40 con 0x7ff3500c0440 2023-11-18T20:40:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.082+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3500a9850 con 0x7ff3500c0440 2023-11-18T20:40:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.082+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3500a9e10 con 0x7ff3500c0440 2023-11-18T20:40:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.083+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35004e840 con 0x7ff3500c0440 2023-11-18T20:40:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.084+0000 7ff3477fe640 1 -- 172.21.15.132:0/2809142193 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3380113f0 con 0x7ff3500c0440 2023-11-18T20:40:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.085+0000 7ff3477fe640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff33006ae40 0x7ff33006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.085+0000 7ff3477fe640 1 -- 172.21.15.132:0/2809142193 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7ff338089b40 con 0x7ff3500c0440 2023-11-18T20:40:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.085+0000 7ff34ed9d640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff33006ae40 0x7ff33006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.086+0000 7ff34ed9d640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff33006ae40 0x7ff33006d300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff340006fd0 tx=0x7ff340008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.089+0000 7ff3477fe640 1 -- 172.21.15.132:0/2809142193 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3380548b0 con 0x7ff3500c0440 2023-11-18T20:40:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.278+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3500c5380 con 0x7ff3500c0440 2023-11-18T20:40:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.279+0000 7ff3477fe640 1 -- 172.21.15.132:0/2809142193 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff338057ed0 con 0x7ff3500c0440 2023-11-18T20:40:50.280 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff33006ae40 msgr2=0x7ff33006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff33006ae40 0x7ff33006d300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff340006fd0 tx=0x7ff340008040 comp rx=0 tx=0).stop 2023-11-18T20:40:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3500c0440 msgr2=0x7ff3501eae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3500c0440 0x7ff3501eae50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff33800c7f0 tx=0x7ff33800cbf0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 shutdown_connections 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff33006ae40 0x7ff33006d300 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff35014c2e0 0x7ff3501eb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3500c0440 0x7ff3501eae50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 --2- 172.21.15.132:0/2809142193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff350072310 0x7ff3501e4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 >> 172.21.15.132:0/2809142193 conn(0x7ff3500a77f0 msgr2=0x7ff350150030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 shutdown_connections 2023-11-18T20:40:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.282+0000 7ff354a33640 1 -- 172.21.15.132:0/2809142193 wait complete. 2023-11-18T20:40:50.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:40:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.516+0000 7fd254ebb640 1 Processor -- start 2023-11-18T20:40:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.517+0000 7fd254ebb640 1 -- start start 2023-11-18T20:40:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.518+0000 7fd254ebb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006d0a0 0x7fd250152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.518+0000 7fd254ebb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500c64a0 con 0x7fd2500c3ea0 2023-11-18T20:40:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.518+0000 7fd254ebb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500c5c00 con 0x7fd25014fd30 2023-11-18T20:40:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.518+0000 7fd254ebb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500c5ee0 con 0x7fd25006d0a0 2023-11-18T20:40:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.518+0000 7fd24ed9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd2500c3ea0 0x7fd2500c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56770/0 (socket says 172.21.15.132:56770) 2023-11-18T20:40:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.518+0000 7fd24ed9d640 1 -- 172.21.15.132:0/3351135238 learned_addr learned my addr 172.21.15.132:0/3351135238 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843055388 0 0) 0x7fd2500c64a0 con 0x7fd2500c3ea0 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd247fff640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006d0a0 0x7fd250152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c003520 con 0x7fd2500c3ea0 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019969859 0 0) 0x7fd23c003520 con 0x7fd2500c3ea0 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006d0a0 msgr2=0x7fd250152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006d0a0 0x7fd250152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 >> v1:172.21.15.161:6789/0 conn(0x7fd25014fd30 legacy=0x7fd2500a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500c61c0 con 0x7fd2500c3ea0 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fd2480019f0 con 0x7fd2500c3ea0 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd247fff640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006d0a0 0x7fd250152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 >> v1:172.21.15.132:6789/0 conn(0x7fd2500c3ea0 legacy=0x7fd2500c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.519+0000 7fd24dd9b640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd23c0039a0 0x7fd23c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24dd9b640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006d0a0 0x7fd23c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24dd9b640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd23c004d00 0x7fd23c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500c5ee0 con 0x7fd23c0039a0 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c00ba90 con 0x7fd23c004d00 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c00bc50 con 0x7fd25006d0a0 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24e59c640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd23c0039a0 0x7fd23c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24e59c640 1 -- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006d0a0 msgr2=0x7fd23c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24e59c640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006d0a0 0x7fd23c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24e59c640 1 -- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd23c004d00 msgr2=0x7fd23c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24ed9d640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd23c004d00 0x7fd23c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24e59c640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd23c004d00 0x7fd23c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.520+0000 7fd24e59c640 1 -- 172.21.15.132:0/3351135238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c003520 con 0x7fd23c0039a0 2023-11-18T20:40:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.521+0000 7fd24e59c640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd23c0039a0 0x7fd23c003dc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd240001720 tx=0x7fd23c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314cde2095e38cc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400052d0 con 0x7fd23c0039a0 2023-11-18T20:40:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24002e050 con 0x7fd23c0039a0 2023-11-18T20:40:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd24dd9b640 1 -- 172.21.15.132:0/3351135238 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400035f0 con 0x7fd23c0039a0 2023-11-18T20:40:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd254ebb640 1 -- 172.21.15.132:0/3351135238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd23c0039a0 msgr2=0x7fd23c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd254ebb640 1 --2- 172.21.15.132:0/3351135238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd23c0039a0 0x7fd23c003dc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd240001720 tx=0x7fd23c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd24ed9d640 1 -- 172.21.15.132:0/3351135238 reap_dead start 2023-11-18T20:40:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd254ebb640 1 -- 172.21.15.132:0/3351135238 shutdown_connections 2023-11-18T20:40:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd254ebb640 1 -- 172.21.15.132:0/3351135238 >> 172.21.15.132:0/3351135238 conn(0x7fd25006a500 msgr2=0x7fd25006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd254ebb640 1 -- 172.21.15.132:0/3351135238 shutdown_connections 2023-11-18T20:40:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.522+0000 7fd254ebb640 1 -- 172.21.15.132:0/3351135238 wait complete. 2023-11-18T20:40:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.524+0000 7fd254ebb640 1 Processor -- start 2023-11-18T20:40:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.524+0000 7fd254ebb640 1 -- start start 2023-11-18T20:40:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd254ebb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd23c0039a0 0x7fd2500a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd254ebb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2501555d0 0x7fd250150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd254ebb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2501513b0 0x7fd2501eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd254ebb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501dc940 con 0x7fd2501513b0 2023-11-18T20:40:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd254ebb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25006ac00 con 0x7fd2501555d0 2023-11-18T20:40:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd254ebb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500a5260 con 0x7fd23c0039a0 2023-11-18T20:40:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd24ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2501513b0 0x7fd2501eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd24ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2501513b0 0x7fd2501eb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42294/0 (socket says 172.21.15.132:42294) 2023-11-18T20:40:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.525+0000 7fd24ed9d640 1 -- 172.21.15.132:0/3590734692 learned_addr learned my addr 172.21.15.132:0/3590734692 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd247fff640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2501555d0 0x7fd250150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd24e59c640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd23c0039a0 0x7fd2500a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd24ed9d640 1 -- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd23c0039a0 msgr2=0x7fd2500a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd24ed9d640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd23c0039a0 0x7fd2500a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd24ed9d640 1 -- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2501555d0 msgr2=0x7fd250150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd24ed9d640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2501555d0 0x7fd250150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd24ed9d640 1 -- 172.21.15.132:0/3590734692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd250156190 con 0x7fd2501513b0 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd24e59c640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd23c0039a0 0x7fd2500a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd24ed9d640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2501513b0 0x7fd2501eb4b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd2500c3860 tx=0x7fd24800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd246ffd640 1 -- 172.21.15.132:0/3590734692 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800bb80 con 0x7fd2501513b0 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd246ffd640 1 -- 172.21.15.132:0/3590734692 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24800bd00 con 0x7fd2501513b0 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd250156470 con 0x7fd2501513b0 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.526+0000 7fd246ffd640 1 -- 172.21.15.132:0/3590734692 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248007350 con 0x7fd2501513b0 2023-11-18T20:40:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.527+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2501dbf50 con 0x7fd2501513b0 2023-11-18T20:40:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.528+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2501dbad0 con 0x7fd2501513b0 2023-11-18T20:40:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.529+0000 7fd246ffd640 1 -- 172.21.15.132:0/3590734692 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2480074b0 con 0x7fd2501513b0 2023-11-18T20:40:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.530+0000 7fd246ffd640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd23006ae70 0x7fd23006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.530+0000 7fd246ffd640 1 -- 172.21.15.132:0/3590734692 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fd248089de0 con 0x7fd2501513b0 2023-11-18T20:40:50.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.530+0000 7fd24e59c640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd23006ae70 0x7fd23006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.531+0000 7fd24e59c640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd23006ae70 0x7fd23006d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd240033000 tx=0x7fd240009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.534+0000 7fd246ffd640 1 -- 172.21.15.132:0/3590734692 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2501dbad0 con 0x7fd2501513b0 2023-11-18T20:40:50.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.723+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2501dbad0 con 0x7fd2501513b0 2023-11-18T20:40:50.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.724+0000 7fd246ffd640 1 -- 172.21.15.132:0/3590734692 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2501dbad0 con 0x7fd2501513b0 2023-11-18T20:40:50.726 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:50.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd23006ae70 msgr2=0x7fd23006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd23006ae70 0x7fd23006d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd240033000 tx=0x7fd240009030 comp rx=0 tx=0).stop 2023-11-18T20:40:50.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2501513b0 msgr2=0x7fd2501eb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2501513b0 0x7fd2501eb4b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd2500c3860 tx=0x7fd24800b4a0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 shutdown_connections 2023-11-18T20:40:50.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd23006ae70 0x7fd23006d330 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2501513b0 0x7fd2501eb4b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2501555d0 0x7fd250150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 --2- 172.21.15.132:0/3590734692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd23c0039a0 0x7fd2500a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 >> 172.21.15.132:0/3590734692 conn(0x7fd25006a500 msgr2=0x7fd250071560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:50.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 shutdown_connections 2023-11-18T20:40:50.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.727+0000 7fd254ebb640 1 -- 172.21.15.132:0/3590734692 wait complete. 2023-11-18T20:40:50.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:40:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.963+0000 7f5c7b341640 1 Processor -- start 2023-11-18T20:40:50.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.963+0000 7f5c7b341640 1 -- start start 2023-11-18T20:40:50.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c7b341640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5c740c7ec0 0x7f5c74155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c7b341640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5c740c4940 0x7f5c740c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c7b341640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c741556d0 con 0x7f5c74151cc0 2023-11-18T20:40:50.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c7b341640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c74154740 con 0x7f5c740c7ec0 2023-11-18T20:40:50.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c7b341640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7406c760 con 0x7f5c740c4940 2023-11-18T20:40:50.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c788dc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5c740c7ec0 0x7f5c74155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c790dd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5c74151cc0 0x7f5c74157d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56780/0 (socket says 172.21.15.132:56780) 2023-11-18T20:40:50.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c790dd640 1 -- 172.21.15.132:0/3635013734 learned_addr learned my addr 172.21.15.132:0/3635013734 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:50.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.965+0000 7f5c798de640 1 --2- 172.21.15.132:0/3635013734 >> v2:172.21.15.161:3300/0 conn(0x7f5c740c4940 0x7f5c740c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.966+0000 7f5c788dc640 1 -- 172.21.15.132:0/3635013734 >> v2:172.21.15.161:3300/0 conn(0x7f5c740c4940 msgr2=0x7f5c740c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:50.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.966+0000 7f5c788dc640 1 --2- 172.21.15.132:0/3635013734 >> v2:172.21.15.161:3300/0 conn(0x7f5c740c4940 0x7f5c740c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.966+0000 7f5c788dc640 1 -- 172.21.15.132:0/3635013734 >> v1:172.21.15.132:6789/0 conn(0x7f5c74151cc0 legacy=0x7f5c74157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.966+0000 7f5c6bfff640 1 -- 172.21.15.132:0/3635013734 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666881987 0 0) 0x7f5c70001110 con 0x7f5c74151cc0 2023-11-18T20:40:50.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.966+0000 7f5c788dc640 1 -- 172.21.15.132:0/3635013734 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c740c8470 con 0x7f5c740c7ec0 2023-11-18T20:40:50.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.967+0000 7f5c788dc640 1 --2- 172.21.15.132:0/3635013734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74155190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5c740c67b0 tx=0x7f5c6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cc9af98a7647e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.967+0000 7f5c6bfff640 1 -- 172.21.15.132:0/3635013734 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64031830 con 0x7f5c740c7ec0 2023-11-18T20:40:50.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.967+0000 7f5c6bfff640 1 -- 172.21.15.132:0/3635013734 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c64031990 con 0x7f5c740c7ec0 2023-11-18T20:40:50.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.967+0000 7f5c6bfff640 1 -- 172.21.15.132:0/3635013734 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64031d20 con 0x7f5c740c7ec0 2023-11-18T20:40:50.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.968+0000 7f5c7b341640 1 -- 172.21.15.132:0/3635013734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 msgr2=0x7f5c74155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.968+0000 7f5c7b341640 1 --2- 172.21.15.132:0/3635013734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74155190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5c740c67b0 tx=0x7f5c6402b8d0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.968+0000 7f5c7b341640 1 -- 172.21.15.132:0/3635013734 shutdown_connections 2023-11-18T20:40:50.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.968+0000 7f5c7b341640 1 --2- 172.21.15.132:0/3635013734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74155190 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.968+0000 7f5c7b341640 1 --2- 172.21.15.132:0/3635013734 >> v2:172.21.15.161:3300/0 conn(0x7f5c740c4940 0x7f5c740c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.968+0000 7f5c7b341640 1 -- 172.21.15.132:0/3635013734 >> 172.21.15.132:0/3635013734 conn(0x7f5c74071e10 msgr2=0x7f5c74072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:50.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.968+0000 7f5c7b341640 1 -- 172.21.15.132:0/3635013734 shutdown_connections 2023-11-18T20:40:50.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.968+0000 7f5c7b341640 1 -- 172.21.15.132:0/3635013734 wait complete. 2023-11-18T20:40:50.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.969+0000 7f5c7b341640 1 Processor -- start 2023-11-18T20:40:50.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.970+0000 7f5c7b341640 1 -- start start 2023-11-18T20:40:50.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.970+0000 7f5c7b341640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c740c4940 0x7f5c740aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.970+0000 7f5c7b341640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.970+0000 7f5c7b341640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c74151cc0 0x7f5c740ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.970+0000 7f5c7b341640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74148e90 con 0x7f5c740c7ec0 2023-11-18T20:40:50.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.970+0000 7f5c7b341640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c741ee930 con 0x7f5c74151cc0 2023-11-18T20:40:50.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c7b341640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c741eda40 con 0x7f5c740c4940 2023-11-18T20:40:50.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42316/0 (socket says 172.21.15.132:42316) 2023-11-18T20:40:50.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 -- 172.21.15.132:0/2327799910 learned_addr learned my addr 172.21.15.132:0/2327799910 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:50.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 -- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c740c4940 msgr2=0x7f5c740aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c740c4940 0x7f5c740aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 -- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c74151cc0 msgr2=0x7f5c740ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:50.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c74151cc0 0x7f5c740ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:50.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 -- 172.21.15.132:0/2327799910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64009400 con 0x7f5c740c7ec0 2023-11-18T20:40:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.971+0000 7f5c788dc640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74150740 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5c6402bee0 tx=0x7f5c640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.972+0000 7f5c69ffb640 1 -- 172.21.15.132:0/2327799910 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640317d0 con 0x7f5c740c7ec0 2023-11-18T20:40:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.972+0000 7f5c69ffb640 1 -- 172.21.15.132:0/2327799910 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6403ba70 con 0x7f5c740c7ec0 2023-11-18T20:40:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.972+0000 7f5c69ffb640 1 -- 172.21.15.132:0/2327799910 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6403be20 con 0x7f5c740c7ec0 2023-11-18T20:40:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.972+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c741edd20 con 0x7f5c740c7ec0 2023-11-18T20:40:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.972+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c741ee2e0 con 0x7f5c740c7ec0 2023-11-18T20:40:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.973+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c74068350 con 0x7f5c740c7ec0 2023-11-18T20:40:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.974+0000 7f5c69ffb640 1 -- 172.21.15.132:0/2327799910 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c6404c3b0 con 0x7f5c740c7ec0 2023-11-18T20:40:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.975+0000 7f5c69ffb640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5c5806ae40 0x7f5c5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.975+0000 7f5c69ffb640 1 -- 172.21.15.132:0/2327799910 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f5c640ab940 con 0x7f5c740c7ec0 2023-11-18T20:40:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.975+0000 7f5c790dd640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5c5806ae40 0x7f5c5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.977+0000 7f5c790dd640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5c5806ae40 0x7f5c5806d300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5c70007fd0 tx=0x7f5c70007960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:50.980+0000 7f5c69ffb640 1 -- 172.21.15.132:0/2327799910 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c64076580 con 0x7f5c740c7ec0 2023-11-18T20:40:51.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.171+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c74155ef0 con 0x7f5c740c7ec0 2023-11-18T20:40:51.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.172+0000 7f5c69ffb640 1 -- 172.21.15.132:0/2327799910 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v61) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5c64035020 con 0x7f5c740c7ec0 2023-11-18T20:40:51.173 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:51.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5c5806ae40 msgr2=0x7f5c5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5c5806ae40 0x7f5c5806d300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5c70007fd0 tx=0x7f5c70007960 comp rx=0 tx=0).stop 2023-11-18T20:40:51.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 msgr2=0x7f5c74150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74150740 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5c6402bee0 tx=0x7f5c640046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 shutdown_connections 2023-11-18T20:40:51.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5c5806ae40 0x7f5c5806d300 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c74151cc0 0x7f5c740ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c7ec0 0x7f5c74150740 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 --2- 172.21.15.132:0/2327799910 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c740c4940 0x7f5c740aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 >> 172.21.15.132:0/2327799910 conn(0x7f5c74071e10 msgr2=0x7f5c7414d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:51.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 shutdown_connections 2023-11-18T20:40:51.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.175+0000 7f5c7b341640 1 -- 172.21.15.132:0/2327799910 wait complete. 2023-11-18T20:40:51.196 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:40:51.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.409+0000 7efe2a71d640 1 Processor -- start 2023-11-18T20:40:51.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.409+0000 7efe2a71d640 1 -- start start 2023-11-18T20:40:51.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.411+0000 7efe2a71d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efe241555c0 0x7efe240c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.411+0000 7efe2a71d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe240c3210 0x7efe240c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.411+0000 7efe2a71d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe240c2830 con 0x7efe240c4e00 2023-11-18T20:40:51.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.411+0000 7efe2a71d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240c3d80 con 0x7efe241555c0 2023-11-18T20:40:51.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.411+0000 7efe2a71d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe240c1260 con 0x7efe240c3210 2023-11-18T20:40:51.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.411+0000 7efe28cba640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7efe240c4e00 0x7efe240c16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56782/0 (socket says 172.21.15.132:56782) 2023-11-18T20:40:51.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.411+0000 7efe28cba640 1 -- 172.21.15.132:0/3167962834 learned_addr learned my addr 172.21.15.132:0/3167962834 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923935217 0 0) 0x7efe240c2830 con 0x7efe240c4e00 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe10003520 con 0x7efe240c4e00 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe237fe640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe240c3210 0x7efe240c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe23fff640 1 --2- 172.21.15.132:0/3167962834 >> v2:172.21.15.161:3300/0 conn(0x7efe241555c0 0x7efe240c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1788389095 0 0) 0x7efe10003520 con 0x7efe240c4e00 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe240c3210 msgr2=0x7efe240c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe240c3210 0x7efe240c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 >> v2:172.21.15.161:3300/0 conn(0x7efe241555c0 msgr2=0x7efe240c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 --2- 172.21.15.132:0/3167962834 >> v2:172.21.15.161:3300/0 conn(0x7efe241555c0 0x7efe240c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2406bbd0 con 0x7efe240c4e00 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7efe1c001670 con 0x7efe240c4e00 2023-11-18T20:40:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 >> v1:172.21.15.132:6789/0 conn(0x7efe240c4e00 legacy=0x7efe240c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe240c3210 0x7efe10003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10003ef0 0x7efe100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe10004d00 0x7efe10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240c1260 con 0x7efe10004d00 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1000b980 con 0x7efe10003ef0 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.412+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1000bb10 con 0x7efe240c3210 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.413+0000 7efe28cba640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe10004d00 0x7efe10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.413+0000 7efe23fff640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe240c3210 0x7efe10003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.413+0000 7efe237fe640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10003ef0 0x7efe100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.413+0000 7efe28cba640 1 -- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe240c3210 msgr2=0x7efe10003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.413+0000 7efe28cba640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe240c3210 0x7efe10003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.413+0000 7efe28cba640 1 -- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10003ef0 msgr2=0x7efe100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.413+0000 7efe28cba640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10003ef0 0x7efe100047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.413+0000 7efe28cba640 1 -- 172.21.15.132:0/3167962834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe10003520 con 0x7efe10004d00 2023-11-18T20:40:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.414+0000 7efe28cba640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe10004d00 0x7efe10005180 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00c270 tx=0x7efe100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d57aed8fa0697e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.414+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c02cae0 con 0x7efe10004d00 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.414+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c02cc40 con 0x7efe10004d00 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.415+0000 7efe22ffd640 1 -- 172.21.15.132:0/3167962834 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c005af0 con 0x7efe10004d00 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.415+0000 7efe2a71d640 1 -- 172.21.15.132:0/3167962834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe10004d00 msgr2=0x7efe10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.415+0000 7efe2a71d640 1 --2- 172.21.15.132:0/3167962834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe10004d00 0x7efe10005180 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00c270 tx=0x7efe100057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.415+0000 7efe28cba640 1 -- 172.21.15.132:0/3167962834 reap_dead start 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.415+0000 7efe2a71d640 1 -- 172.21.15.132:0/3167962834 shutdown_connections 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.415+0000 7efe2a71d640 1 -- 172.21.15.132:0/3167962834 >> 172.21.15.132:0/3167962834 conn(0x7efe240c7e30 msgr2=0x7efe240c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.415+0000 7efe2a71d640 1 -- 172.21.15.132:0/3167962834 shutdown_connections 2023-11-18T20:40:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.415+0000 7efe2a71d640 1 -- 172.21.15.132:0/3167962834 wait complete. 2023-11-18T20:40:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.417+0000 7efe2a71d640 1 Processor -- start 2023-11-18T20:40:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.417+0000 7efe2a71d640 1 -- start start 2023-11-18T20:40:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe2a71d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10004d00 0x7efe241e7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe2a71d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe24147fc0 0x7efe24153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe2a71d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe24147740 0x7efe24148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe2a71d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe241ee2a0 con 0x7efe24147740 2023-11-18T20:40:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe2a71d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24158e70 con 0x7efe10004d00 2023-11-18T20:40:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe2a71d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2414aa40 con 0x7efe24147fc0 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe28cba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe24147740 0x7efe24148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe28cba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe24147740 0x7efe24148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42334/0 (socket says 172.21.15.132:42334) 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.418+0000 7efe28cba640 1 -- 172.21.15.132:0/2357943509 learned_addr learned my addr 172.21.15.132:0/2357943509 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe237fe640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe24147fc0 0x7efe24153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe23fff640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10004d00 0x7efe241e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe28cba640 1 -- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe24147fc0 msgr2=0x7efe24153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe28cba640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe24147fc0 0x7efe24153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe28cba640 1 -- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10004d00 msgr2=0x7efe241e7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe28cba640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10004d00 0x7efe241e7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe28cba640 1 -- 172.21.15.132:0/2357943509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe241edfc0 con 0x7efe24147740 2023-11-18T20:40:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe23fff640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10004d00 0x7efe241e7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe28cba640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe24147740 0x7efe24148c40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00c270 tx=0x7efe1c001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe20ff9640 1 -- 172.21.15.132:0/2357943509 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c03c040 con 0x7efe24147740 2023-11-18T20:40:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe20ff9640 1 -- 172.21.15.132:0/2357943509 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c001630 con 0x7efe24147740 2023-11-18T20:40:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.419+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2414a6d0 con 0x7efe24147740 2023-11-18T20:40:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.420+0000 7efe20ff9640 1 -- 172.21.15.132:0/2357943509 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c007270 con 0x7efe24147740 2023-11-18T20:40:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.420+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe241edc90 con 0x7efe24147740 2023-11-18T20:40:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.421+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2414a530 con 0x7efe24147740 2023-11-18T20:40:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.422+0000 7efe20ff9640 1 -- 172.21.15.132:0/2357943509 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe1c032070 con 0x7efe24147740 2023-11-18T20:40:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.422+0000 7efe20ff9640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efe0406ae70 0x7efe0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.423+0000 7efe20ff9640 1 -- 172.21.15.132:0/2357943509 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7efe1c0aad40 con 0x7efe24147740 2023-11-18T20:40:51.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.423+0000 7efe23fff640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efe0406ae70 0x7efe0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.424+0000 7efe23fff640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efe0406ae70 0x7efe0406d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe14007440 tx=0x7efe1400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:51.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.427+0000 7efe20ff9640 1 -- 172.21.15.132:0/2357943509 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe2414a530 con 0x7efe24147740 2023-11-18T20:40:51.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.616+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7efe2414a530 con 0x7efe24147740 2023-11-18T20:40:51.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.617+0000 7efe20ff9640 1 -- 172.21.15.132:0/2357943509 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v61) v1 ==== 101+0+11 (secure 0 0 0) 0x7efe2414a530 con 0x7efe24147740 2023-11-18T20:40:51.618 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efe0406ae70 msgr2=0x7efe0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efe0406ae70 0x7efe0406d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe14007440 tx=0x7efe1400b040 comp rx=0 tx=0).stop 2023-11-18T20:40:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe24147740 msgr2=0x7efe24148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe24147740 0x7efe24148c40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00c270 tx=0x7efe1c001a70 comp rx=0 tx=0).stop 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 shutdown_connections 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7efe0406ae70 0x7efe0406d330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe24147740 0x7efe24148c40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe24147fc0 0x7efe24153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 --2- 172.21.15.132:0/2357943509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10004d00 0x7efe241e7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 >> 172.21.15.132:0/2357943509 conn(0x7efe240c7e30 msgr2=0x7efe2406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 shutdown_connections 2023-11-18T20:40:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.620+0000 7efe2a71d640 1 -- 172.21.15.132:0/2357943509 wait complete. 2023-11-18T20:40:51.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:40:51.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.848+0000 7fbcdbfff640 1 Processor -- start 2023-11-18T20:40:51.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.848+0000 7fbcdbfff640 1 -- start start 2023-11-18T20:40:51.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcdbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbcdc0c0440 0x7fbcdc0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcdbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbcdc072310 0x7fbcdc0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcdbfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcdc071e80 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcdbfff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcdc071470 con 0x7fbcdc0c0440 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcdbfff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcdc14c6c0 con 0x7fbcdc072310 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcda7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbcdc0c0440 0x7fbcdc0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcda7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbcdc0c0440 0x7fbcdc0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42340/0 (socket says 172.21.15.132:42340) 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcda7fc640 1 -- 172.21.15.132:0/3237583091 learned_addr learned my addr 172.21.15.132:0/3237583091 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcda7fc640 1 -- 172.21.15.132:0/3237583091 >> v2:172.21.15.161:3300/0 conn(0x7fbcdc072310 msgr2=0x7fbcdc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcda7fc640 1 --2- 172.21.15.132:0/3237583091 >> v2:172.21.15.161:3300/0 conn(0x7fbcdc072310 0x7fbcdc0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcda7fc640 1 -- 172.21.15.132:0/3237583091 >> v1:172.21.15.161:6789/0 conn(0x7fbcdc14c2e0 legacy=0x7fbcdc152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:51.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.850+0000 7fbcda7fc640 1 -- 172.21.15.132:0/3237583091 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc06fdc0 con 0x7fbcdc0c0440 2023-11-18T20:40:51.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.852+0000 7fbcda7fc640 1 --2- 172.21.15.132:0/3237583091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc0c0440 0x7fbcdc0c0c80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc156850 tx=0x7fbcd002b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dccec8ffa4a71d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:51.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.852+0000 7fbcd9ffb640 1 -- 172.21.15.132:0/3237583091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0031760 con 0x7fbcdc0c0440 2023-11-18T20:40:51.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.852+0000 7fbcd9ffb640 1 -- 172.21.15.132:0/3237583091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd00318c0 con 0x7fbcdc0c0440 2023-11-18T20:40:51.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.852+0000 7fbcd9ffb640 1 -- 172.21.15.132:0/3237583091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0031c50 con 0x7fbcdc0c0440 2023-11-18T20:40:51.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.852+0000 7fbcdbfff640 1 -- 172.21.15.132:0/3237583091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc0c0440 msgr2=0x7fbcdc0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.852+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/3237583091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc0c0440 0x7fbcdc0c0c80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc156850 tx=0x7fbcd002b800 comp rx=0 tx=0).stop 2023-11-18T20:40:51.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.853+0000 7fbcdbfff640 1 -- 172.21.15.132:0/3237583091 shutdown_connections 2023-11-18T20:40:51.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.853+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/3237583091 >> v2:172.21.15.161:3300/0 conn(0x7fbcdc072310 0x7fbcdc0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.853+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/3237583091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc0c0440 0x7fbcdc0c0c80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.853+0000 7fbcdbfff640 1 -- 172.21.15.132:0/3237583091 >> 172.21.15.132:0/3237583091 conn(0x7fbcdc0a77f0 msgr2=0x7fbcdc0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:51.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.853+0000 7fbcdbfff640 1 -- 172.21.15.132:0/3237583091 shutdown_connections 2023-11-18T20:40:51.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.853+0000 7fbcdbfff640 1 -- 172.21.15.132:0/3237583091 wait complete. 2023-11-18T20:40:51.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.854+0000 7fbcdbfff640 1 Processor -- start 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.854+0000 7fbcdbfff640 1 -- start start 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.855+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc072310 0x7fbcdc145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.855+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcdc0c0440 0x7fbcdc153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.855+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc14c2e0 0x7fbcdc1e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.855+0000 7fbcdbfff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc1ebd20 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.855+0000 7fbcdbfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc0bab80 con 0x7fbcdc072310 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.855+0000 7fbcdbfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc146310 con 0x7fbcdc0c0440 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc14c2e0 0x7fbcdc1e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc14c2e0 0x7fbcdc1e92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42344/0 (socket says 172.21.15.132:42344) 2023-11-18T20:40:51.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdb7fe640 1 -- 172.21.15.132:0/2880700322 learned_addr learned my addr 172.21.15.132:0/2880700322 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcda7fc640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcdc0c0440 0x7fbcdc153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdaffd640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc072310 0x7fbcdc145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdb7fe640 1 -- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcdc0c0440 msgr2=0x7fbcdc153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdb7fe640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcdc0c0440 0x7fbcdc153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdb7fe640 1 -- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc072310 msgr2=0x7fbcdc145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdb7fe640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc072310 0x7fbcdc145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.856+0000 7fbcdb7fe640 1 -- 172.21.15.132:0/2880700322 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd00094d0 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.857+0000 7fbcdb7fe640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc14c2e0 0x7fbcdc1e92b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400b970 tx=0x7fbcd400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.857+0000 7fbcc37fe640 1 -- 172.21.15.132:0/2880700322 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400cb40 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.857+0000 7fbcc37fe640 1 -- 172.21.15.132:0/2880700322 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd400ccc0 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.857+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc1dc0e0 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.857+0000 7fbcc37fe640 1 -- 172.21.15.132:0/2880700322 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4014680 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.857+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc1dc6a0 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.858+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc04e840 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.859+0000 7fbcc37fe640 1 -- 172.21.15.132:0/2880700322 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbcd401d3b0 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.860+0000 7fbcc37fe640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcc806ae40 0x7fbcc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:51.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.860+0000 7fbcc37fe640 1 -- 172.21.15.132:0/2880700322 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fbcd4089950 con 0x7fbcdc14c2e0 2023-11-18T20:40:51.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.861+0000 7fbcdaffd640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcc806ae40 0x7fbcc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:51.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.862+0000 7fbcdaffd640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcc806ae40 0x7fbcc806d300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbccc007fd0 tx=0x7fbccc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:51.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:51.865+0000 7fbcc37fe640 1 -- 172.21.15.132:0/2880700322 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbcd4054620 con 0x7fbcdc14c2e0 2023-11-18T20:40:52.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.068+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbcdc0c5380 con 0x7fbcdc14c2e0 2023-11-18T20:40:52.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.069+0000 7fbcc37fe640 1 -- 172.21.15.132:0/2880700322 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbcd4019080 con 0x7fbcdc14c2e0 2023-11-18T20:40:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:40:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcc806ae40 msgr2=0x7fbcc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcc806ae40 0x7fbcc806d300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbccc007fd0 tx=0x7fbccc009040 comp rx=0 tx=0).stop 2023-11-18T20:40:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc14c2e0 msgr2=0x7fbcdc1e92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc14c2e0 0x7fbcdc1e92b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400b970 tx=0x7fbcd400be30 comp rx=0 tx=0).stop 2023-11-18T20:40:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 shutdown_connections 2023-11-18T20:40:52.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbcc806ae40 0x7fbcc806d300 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcdc14c2e0 0x7fbcdc1e92b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcdc0c0440 0x7fbcdc153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 --2- 172.21.15.132:0/2880700322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc072310 0x7fbcdc145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 >> 172.21.15.132:0/2880700322 conn(0x7fbcdc0a77f0 msgr2=0x7fbcdc153950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:52.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 shutdown_connections 2023-11-18T20:40:52.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.072+0000 7fbcdbfff640 1 -- 172.21.15.132:0/2880700322 wait complete. 2023-11-18T20:40:52.093 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-18T20:40:52.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:52.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-18T20:40:52.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:40:52.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:40:52.211 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T20:40:52.269 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:52.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.491+0000 7f4e29f8a640 1 Processor -- start 2023-11-18T20:40:52.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.491+0000 7f4e29f8a640 1 -- start start 2023-11-18T20:40:52.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.493+0000 7f4e29f8a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e24155490 0x7f4e240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.494+0000 7f4e29f8a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e240c06c0 con 0x7f4e240c1500 2023-11-18T20:40:52.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.494+0000 7f4e29f8a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e240c1020 con 0x7f4e240a9b40 2023-11-18T20:40:52.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.494+0000 7f4e29f8a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e240a5820 con 0x7f4e24155490 2023-11-18T20:40:52.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.494+0000 7f4e1bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4e240c1500 0x7f4e240a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56786/0 (socket says 172.21.15.132:56786) 2023-11-18T20:40:52.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.494+0000 7f4e1bfff640 1 -- 172.21.15.132:0/874053810 learned_addr learned my addr 172.21.15.132:0/874053810 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.494+0000 7f4e237fe640 1 --2- 172.21.15.132:0/874053810 >> v2:172.21.15.161:3300/0 conn(0x7f4e24155490 0x7f4e240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.494+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642219039 0 0) 0x7f4e240c06c0 con 0x7f4e240c1500 2023-11-18T20:40:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e10003520 con 0x7f4e240c1500 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931712167 0 0) 0x7f4e10003520 con 0x7f4e240c1500 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 >> v2:172.21.15.161:3300/0 conn(0x7f4e24155490 msgr2=0x7f4e240a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 --2- 172.21.15.132:0/874053810 >> v2:172.21.15.161:3300/0 conn(0x7f4e24155490 0x7f4e240a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 >> v1:172.21.15.161:6789/0 conn(0x7f4e240a9b40 legacy=0x7f4e240c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e240c0910 con 0x7f4e240c1500 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f4e0c001670 con 0x7f4e240c1500 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 >> v1:172.21.15.132:6789/0 conn(0x7f4e240c1500 legacy=0x7f4e240a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e100039c0 0x7f4e10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e100047c0 0x7f4e10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e10005180 0x7f4e1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1000c050 con 0x7f4e100039c0 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1000c1c0 con 0x7f4e100047c0 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1000e590 con 0x7f4e10005180 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.495+0000 7f4e237fe640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e100039c0 0x7f4e10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.496+0000 7f4e1bfff640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e100047c0 0x7f4e10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.496+0000 7f4e237fe640 1 -- 172.21.15.132:0/874053810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e10005180 msgr2=0x7f4e1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.496+0000 7f4e237fe640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e10005180 0x7f4e1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.496+0000 7f4e237fe640 1 -- 172.21.15.132:0/874053810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e100047c0 msgr2=0x7f4e10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.496+0000 7f4e237fe640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e100047c0 0x7f4e10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.496+0000 7f4e237fe640 1 -- 172.21.15.132:0/874053810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10003520 con 0x7f4e100039c0 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.496+0000 7f4e1bfff640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e100047c0 0x7f4e10004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.496+0000 7f4e23fff640 1 -- 172.21.15.132:0/874053810 reap_dead start 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.497+0000 7f4e237fe640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e100039c0 0x7f4e10003de0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009ac0 tx=0x7f4e100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5be084d474c054 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.497+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1402c710 con 0x7f4e100039c0 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.497+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1402c870 con 0x7f4e100039c0 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.497+0000 7f4e22ffd640 1 -- 172.21.15.132:0/874053810 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1402cc00 con 0x7f4e100039c0 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.498+0000 7f4e29f8a640 1 -- 172.21.15.132:0/874053810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e100039c0 msgr2=0x7f4e10003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.498+0000 7f4e29f8a640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e100039c0 0x7f4e10003de0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009ac0 tx=0x7f4e100057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.498+0000 7f4e29f8a640 1 -- 172.21.15.132:0/874053810 shutdown_connections 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.498+0000 7f4e29f8a640 1 --2- 172.21.15.132:0/874053810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e100039c0 0x7f4e10003de0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.498+0000 7f4e29f8a640 1 -- 172.21.15.132:0/874053810 >> 172.21.15.132:0/874053810 conn(0x7f4e2406a500 msgr2=0x7f4e2406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.498+0000 7f4e29f8a640 1 -- 172.21.15.132:0/874053810 shutdown_connections 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.498+0000 7f4e29f8a640 1 -- 172.21.15.132:0/874053810 wait complete. 2023-11-18T20:40:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.500+0000 7f4e29f8a640 1 Processor -- start 2023-11-18T20:40:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.500+0000 7f4e29f8a640 1 -- start start 2023-11-18T20:40:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e29f8a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e100039c0 0x7f4e241ed260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e29f8a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e241ed7a0 0x7f4e24151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e29f8a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e24151790 0x7f4e241dd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e29f8a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e241df370 con 0x7f4e24151790 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e29f8a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e241de610 con 0x7f4e241ed7a0 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e29f8a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e241dcbc0 con 0x7f4e100039c0 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e23fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e24151790 0x7f4e241dd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e23fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e24151790 0x7f4e241dd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42364/0 (socket says 172.21.15.132:42364) 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e23fff640 1 -- 172.21.15.132:0/305741222 learned_addr learned my addr 172.21.15.132:0/305741222 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e23fff640 1 -- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e100039c0 msgr2=0x7f4e241ed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e23fff640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e100039c0 0x7f4e241ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e23fff640 1 -- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e241ed7a0 msgr2=0x7f4e24151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e23fff640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e241ed7a0 0x7f4e24151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.501+0000 7f4e23fff640 1 -- 172.21.15.132:0/305741222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e241daa40 con 0x7f4e24151790 2023-11-18T20:40:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.502+0000 7f4e23fff640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e24151790 0x7f4e241dd050 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4e2406b200 tx=0x7f4e1c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.502+0000 7f4e20ff9640 1 -- 172.21.15.132:0/305741222 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c003970 con 0x7f4e24151790 2023-11-18T20:40:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.502+0000 7f4e20ff9640 1 -- 172.21.15.132:0/305741222 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c003af0 con 0x7f4e24151790 2023-11-18T20:40:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.502+0000 7f4e20ff9640 1 -- 172.21.15.132:0/305741222 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c003ea0 con 0x7f4e24151790 2023-11-18T20:40:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.502+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e241edce0 con 0x7f4e24151790 2023-11-18T20:40:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.502+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e241dc850 con 0x7f4e24151790 2023-11-18T20:40:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.503+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e241dca10 con 0x7f4e24151790 2023-11-18T20:40:52.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.504+0000 7f4e20ff9640 1 -- 172.21.15.132:0/305741222 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e1c004000 con 0x7f4e24151790 2023-11-18T20:40:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.505+0000 7f4e20ff9640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e0406ae70 0x7f4e0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.505+0000 7f4e20ff9640 1 -- 172.21.15.132:0/305741222 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f4e1c088b40 con 0x7f4e24151790 2023-11-18T20:40:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.506+0000 7f4e237fe640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e0406ae70 0x7f4e0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.507+0000 7f4e237fe640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e0406ae70 0x7f4e0406d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e14036000 tx=0x7f4e1402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:52.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.510+0000 7f4e20ff9640 1 -- 172.21.15.132:0/305741222 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e1c0538b0 con 0x7f4e24151790 2023-11-18T20:40:52.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.739+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e24068350 con 0x7f4e24151790 2023-11-18T20:40:52.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.740+0000 7f4e20ff9640 1 -- 172.21.15.132:0/305741222 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6141 (secure 0 0 0) 0x7f4e1c056ed0 con 0x7f4e24151790 2023-11-18T20:40:52.742 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:52.742 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:15.246098+0000","modified":"2023-11-18T20:40:18.344815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/3392191515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3392191515},{"type":"v1","addr":"172.21.15.132:6835","nonce":3392191515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:30.829157+0000","modified":"2023-11-18T20:40:33.909984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-18T20:40:52.742 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 35 2023-11-18T20:40:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e0406ae70 msgr2=0x7f4e0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e0406ae70 0x7f4e0406d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e14036000 tx=0x7f4e1402e000 comp rx=0 tx=0).stop 2023-11-18T20:40:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e24151790 msgr2=0x7f4e241dd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e24151790 0x7f4e241dd050 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4e2406b200 tx=0x7f4e1c00c8b0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 shutdown_connections 2023-11-18T20:40:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4e0406ae70 0x7f4e0406d330 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e24151790 0x7f4e241dd050 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e241ed7a0 0x7f4e24151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 --2- 172.21.15.132:0/305741222 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e100039c0 0x7f4e241ed260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 >> 172.21.15.132:0/305741222 conn(0x7f4e2406a500 msgr2=0x7f4e2406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 shutdown_connections 2023-11-18T20:40:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.743+0000 7f4e29f8a640 1 -- 172.21.15.132:0/305741222 wait complete. 2023-11-18T20:40:52.763 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:52.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.971+0000 7f715f10f640 1 Processor -- start 2023-11-18T20:40:52.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.971+0000 7f715f10f640 1 -- start start 2023-11-18T20:40:52.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.972+0000 7f715f10f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f715814fd30 0x7f7158152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.972+0000 7f715f10f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f715806d0a0 0x7f71580a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f715f10f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71580c64a0 con 0x7f71580a5260 2023-11-18T20:40:52.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f715f10f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71580c5c00 con 0x7f715806d0a0 2023-11-18T20:40:52.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f715f10f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71580c5ee0 con 0x7f715814fd30 2023-11-18T20:40:52.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f7157fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f715806d0a0 0x7f71580a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f7157fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f715806d0a0 0x7f71580a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42372/0 (socket says 172.21.15.132:42372) 2023-11-18T20:40:52.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f7157fff640 1 -- 172.21.15.132:0/2728179742 learned_addr learned my addr 172.21.15.132:0/2728179742 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:52.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f715ceab640 1 --2- 172.21.15.132:0/2728179742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f715814fd30 0x7f7158152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f7157fff640 1 -- 172.21.15.132:0/2728179742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f715814fd30 msgr2=0x7f7158152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:52.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f7157fff640 1 --2- 172.21.15.132:0/2728179742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f715814fd30 0x7f7158152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f7157fff640 1 -- 172.21.15.132:0/2728179742 >> v1:172.21.15.161:6789/0 conn(0x7f71580a5260 legacy=0x7f71580c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:52.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.973+0000 7f7157fff640 1 -- 172.21.15.132:0/2728179742 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71580c61c0 con 0x7f715806d0a0 2023-11-18T20:40:52.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.975+0000 7f7157fff640 1 --2- 172.21.15.132:0/2728179742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f71580a4d20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7144009870 tx=0x7f714402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff163d069dac10d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:52.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.975+0000 7f71577fe640 1 -- 172.21.15.132:0/2728179742 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144031640 con 0x7f715806d0a0 2023-11-18T20:40:52.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.975+0000 7f71577fe640 1 -- 172.21.15.132:0/2728179742 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71440317a0 con 0x7f715806d0a0 2023-11-18T20:40:52.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.975+0000 7f71577fe640 1 -- 172.21.15.132:0/2728179742 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144031b30 con 0x7f715806d0a0 2023-11-18T20:40:52.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.976+0000 7f715f10f640 1 -- 172.21.15.132:0/2728179742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 msgr2=0x7f71580a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.976+0000 7f715f10f640 1 --2- 172.21.15.132:0/2728179742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f71580a4d20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7144009870 tx=0x7f714402b8f0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.976+0000 7f715f10f640 1 -- 172.21.15.132:0/2728179742 shutdown_connections 2023-11-18T20:40:52.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.976+0000 7f715f10f640 1 --2- 172.21.15.132:0/2728179742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f71580a4d20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.976+0000 7f715f10f640 1 --2- 172.21.15.132:0/2728179742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f715814fd30 0x7f7158152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.976+0000 7f715f10f640 1 -- 172.21.15.132:0/2728179742 >> 172.21.15.132:0/2728179742 conn(0x7f715806a500 msgr2=0x7f715806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:52.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.976+0000 7f715f10f640 1 -- 172.21.15.132:0/2728179742 shutdown_connections 2023-11-18T20:40:52.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.976+0000 7f715f10f640 1 -- 172.21.15.132:0/2728179742 wait complete. 2023-11-18T20:40:52.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.977+0000 7f715f10f640 1 Processor -- start 2023-11-18T20:40:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.978+0000 7f715f10f640 1 -- start start 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.978+0000 7f715f10f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f7158155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.978+0000 7f715f10f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71580a5260 0x7f71581561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.978+0000 7f715f10f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f715814fd30 0x7f715814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.978+0000 7f715f10f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71581dd830 con 0x7f715806d0a0 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.978+0000 7f715f10f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71581ec360 con 0x7f715814fd30 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.978+0000 7f715f10f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71581ec640 con 0x7f71580a5260 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f715ceab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f7158155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f715ceab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f7158155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42384/0 (socket says 172.21.15.132:42384) 2023-11-18T20:40:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f715ceab640 1 -- 172.21.15.132:0/3539512796 learned_addr learned my addr 172.21.15.132:0/3539512796 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f7157fff640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71580a5260 0x7f71581561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f715ceab640 1 -- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71580a5260 msgr2=0x7f71581561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f715ceab640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71580a5260 0x7f71581561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f715ceab640 1 -- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f715814fd30 msgr2=0x7f715814eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:52.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f715ceab640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f715814fd30 0x7f715814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:52.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.979+0000 7f715ceab640 1 -- 172.21.15.132:0/3539512796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440094d0 con 0x7f715806d0a0 2023-11-18T20:40:52.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.980+0000 7f715ceab640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f7158155ca0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f714c00d5f0 tx=0x7f714c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:52.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.980+0000 7f71557fa640 1 -- 172.21.15.132:0/3539512796 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0125f0 con 0x7f715806d0a0 2023-11-18T20:40:52.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.980+0000 7f71557fa640 1 -- 172.21.15.132:0/3539512796 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c012750 con 0x7f715806d0a0 2023-11-18T20:40:52.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.980+0000 7f71557fa640 1 -- 172.21.15.132:0/3539512796 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c012b00 con 0x7f715806d0a0 2023-11-18T20:40:52.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.980+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71581dd1e0 con 0x7f715806d0a0 2023-11-18T20:40:52.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.980+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715814f800 con 0x7f715806d0a0 2023-11-18T20:40:52.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.981+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7158068350 con 0x7f715806d0a0 2023-11-18T20:40:52.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.982+0000 7f71557fa640 1 -- 172.21.15.132:0/3539512796 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f714c012c60 con 0x7f715806d0a0 2023-11-18T20:40:52.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.983+0000 7f71557fa640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f713c06ae70 0x7f713c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:52.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.983+0000 7f71557fa640 1 -- 172.21.15.132:0/3539512796 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f714c089f20 con 0x7f715806d0a0 2023-11-18T20:40:52.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.983+0000 7f7157fff640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f713c06ae70 0x7f713c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.984+0000 7f7157fff640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f713c06ae70 0x7f713c06d330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7144036000 tx=0x7f714403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:52.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:52.987+0000 7f71557fa640 1 -- 172.21.15.132:0/3539512796 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f714c054bf0 con 0x7f715806d0a0 2023-11-18T20:40:53.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.165+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71580c03a0 con 0x7f715806d0a0 2023-11-18T20:40:53.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.169+0000 7f71557fa640 1 -- 172.21.15.132:0/3539512796 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20447 (secure 0 0 0) 0x7f714c058210 con 0x7f715806d0a0 2023-11-18T20:40:53.170 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:53.171 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":61,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:47.525645+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":4}]},{"pgid":"9.3b","mappings":[{"from":6,"to":1}]},{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.29","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:53.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f713c06ae70 msgr2=0x7f713c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f713c06ae70 0x7f713c06d330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7144036000 tx=0x7f714403c040 comp rx=0 tx=0).stop 2023-11-18T20:40:53.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 msgr2=0x7f7158155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f7158155ca0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f714c00d5f0 tx=0x7f714c00dab0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 shutdown_connections 2023-11-18T20:40:53.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f713c06ae70 0x7f713c06d330 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f715814fd30 0x7f715814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71580a5260 0x7f71581561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 --2- 172.21.15.132:0/3539512796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f715806d0a0 0x7f7158155ca0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 >> 172.21.15.132:0/3539512796 conn(0x7f715806a500 msgr2=0x7f715806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:53.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 shutdown_connections 2023-11-18T20:40:53.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.172+0000 7f715f10f640 1 -- 172.21.15.132:0/3539512796 wait complete. 2023-11-18T20:40:53.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:40:13.573413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:40:14.279671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:40:28.826395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:40:29.825753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:40:53.191 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:40:53.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.410+0000 7feee5367640 1 Processor -- start 2023-11-18T20:40:53.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.410+0000 7feee5367640 1 -- start start 2023-11-18T20:40:53.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feee5367640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feee014c2e0 0x7feee00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feee5367640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee00c0440 0x7feee0152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feee5367640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee0071e80 con 0x7feee0072310 2023-11-18T20:40:53.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feee5367640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee0071470 con 0x7feee014c2e0 2023-11-18T20:40:53.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feee5367640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee014c6c0 con 0x7feee00c0440 2023-11-18T20:40:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feee4b66640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feee0072310 0x7feee00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56790/0 (socket says 172.21.15.132:56790) 2023-11-18T20:40:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feee4b66640 1 -- 172.21.15.132:0/402824467 learned_addr learned my addr 172.21.15.132:0/402824467 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feedffff640 1 --2- 172.21.15.132:0/402824467 >> v2:172.21.15.132:3300/0 conn(0x7feee014c2e0 0x7feee00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.412+0000 7feed7fff640 1 --2- 172.21.15.132:0/402824467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee00c0440 0x7feee0152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.413+0000 7feedffff640 1 -- 172.21.15.132:0/402824467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee00c0440 msgr2=0x7feee0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.413+0000 7feedffff640 1 --2- 172.21.15.132:0/402824467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee00c0440 0x7feee0152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.413+0000 7feedffff640 1 -- 172.21.15.132:0/402824467 >> v1:172.21.15.132:6789/0 conn(0x7feee0072310 legacy=0x7feee00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.413+0000 7feedffff640 1 -- 172.21.15.132:0/402824467 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0153180 con 0x7feee014c2e0 2023-11-18T20:40:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.414+0000 7feedffff640 1 --2- 172.21.15.132:0/402824467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee014c2e0 0x7feee00c0c80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feed00097a0 tx=0x7feed002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c0b4a86626ca2c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:53.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.414+0000 7feedf7fe640 1 -- 172.21.15.132:0/402824467 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00316f0 con 0x7feee014c2e0 2023-11-18T20:40:53.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.414+0000 7feedf7fe640 1 -- 172.21.15.132:0/402824467 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0031850 con 0x7feee014c2e0 2023-11-18T20:40:53.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.414+0000 7feedf7fe640 1 -- 172.21.15.132:0/402824467 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0031be0 con 0x7feee014c2e0 2023-11-18T20:40:53.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.415+0000 7feee5367640 1 -- 172.21.15.132:0/402824467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee014c2e0 msgr2=0x7feee00c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.415+0000 7feee5367640 1 --2- 172.21.15.132:0/402824467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee014c2e0 0x7feee00c0c80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feed00097a0 tx=0x7feed002b790 comp rx=0 tx=0).stop 2023-11-18T20:40:53.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.415+0000 7feee5367640 1 -- 172.21.15.132:0/402824467 shutdown_connections 2023-11-18T20:40:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.415+0000 7feee5367640 1 --2- 172.21.15.132:0/402824467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee00c0440 0x7feee0152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.415+0000 7feee5367640 1 --2- 172.21.15.132:0/402824467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee014c2e0 0x7feee00c0c80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.415+0000 7feee5367640 1 -- 172.21.15.132:0/402824467 >> 172.21.15.132:0/402824467 conn(0x7feee00a77f0 msgr2=0x7feee00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.415+0000 7feee5367640 1 -- 172.21.15.132:0/402824467 shutdown_connections 2023-11-18T20:40:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.415+0000 7feee5367640 1 -- 172.21.15.132:0/402824467 wait complete. 2023-11-18T20:40:53.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.417+0000 7feee5367640 1 Processor -- start 2023-11-18T20:40:53.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.417+0000 7feee5367640 1 -- start start 2023-11-18T20:40:53.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feee5367640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee0072310 0x7feee0146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feee5367640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee00c0440 0x7feee014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feee5367640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee014c2e0 0x7feee0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feee5367640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee0146940 con 0x7feee00c0440 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feee5367640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee01ea690 con 0x7feee0072310 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feee5367640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee014ca40 con 0x7feee014c2e0 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feed7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee00c0440 0x7feee014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feed7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee00c0440 0x7feee014efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42402/0 (socket says 172.21.15.132:42402) 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feed7fff640 1 -- 172.21.15.132:0/816226437 learned_addr learned my addr 172.21.15.132:0/816226437 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feed7fff640 1 -- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee014c2e0 msgr2=0x7feee0151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feed7fff640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee014c2e0 0x7feee0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feed7fff640 1 -- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee0072310 msgr2=0x7feee0146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feed7fff640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee0072310 0x7feee0146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.418+0000 7feed7fff640 1 -- 172.21.15.132:0/816226437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0009400 con 0x7feee00c0440 2023-11-18T20:40:53.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.419+0000 7feed7fff640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee00c0440 0x7feee014efe0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7feec800d800 tx=0x7feec800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:53.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.419+0000 7feedd7fa640 1 -- 172.21.15.132:0/816226437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec800b6c0 con 0x7feee00c0440 2023-11-18T20:40:53.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.419+0000 7feedd7fa640 1 -- 172.21.15.132:0/816226437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec800b820 con 0x7feee00c0440 2023-11-18T20:40:53.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.419+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee0147630 con 0x7feee00c0440 2023-11-18T20:40:53.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.419+0000 7feedd7fa640 1 -- 172.21.15.132:0/816226437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec800bbb0 con 0x7feee00c0440 2023-11-18T20:40:53.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.419+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee0146c50 con 0x7feee00c0440 2023-11-18T20:40:53.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.421+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee004e840 con 0x7feee00c0440 2023-11-18T20:40:53.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.421+0000 7feedd7fa640 1 -- 172.21.15.132:0/816226437 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feec800bd10 con 0x7feee00c0440 2023-11-18T20:40:53.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.422+0000 7feedd7fa640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feec006ae40 0x7feec006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.422+0000 7feedd7fa640 1 -- 172.21.15.132:0/816226437 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7feec8089ef0 con 0x7feee00c0440 2023-11-18T20:40:53.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.423+0000 7feedffff640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feec006ae40 0x7feec006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.424+0000 7feedffff640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feec006ae40 0x7feec006d300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7feed0036000 tx=0x7feed0030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.426+0000 7feedd7fa640 1 -- 172.21.15.132:0/816226437 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feec8054c60 con 0x7feee00c0440 2023-11-18T20:40:53.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.616+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feee014cbb0 con 0x7feee00c0440 2023-11-18T20:40:53.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.616+0000 7feedd7fa640 1 -- 172.21.15.132:0/816226437 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7feee014cbb0 con 0x7feee00c0440 2023-11-18T20:40:53.617 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:40:53.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feec006ae40 msgr2=0x7feec006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feec006ae40 0x7feec006d300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7feed0036000 tx=0x7feed0030000 comp rx=0 tx=0).stop 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee00c0440 msgr2=0x7feee014efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee00c0440 0x7feee014efe0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7feec800d800 tx=0x7feec800dcc0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 shutdown_connections 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feec006ae40 0x7feec006d300 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee014c2e0 0x7feee0151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee00c0440 0x7feee014efe0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 --2- 172.21.15.132:0/816226437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee0072310 0x7feee0146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 >> 172.21.15.132:0/816226437 conn(0x7feee00a77f0 msgr2=0x7feee014a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 shutdown_connections 2023-11-18T20:40:53.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.619+0000 7feee5367640 1 -- 172.21.15.132:0/816226437 wait complete. 2023-11-18T20:40:53.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:40:53.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.852+0000 7f19ca452640 1 Processor -- start 2023-11-18T20:40:53.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.853+0000 7f19ca452640 1 -- start start 2023-11-18T20:40:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19ca452640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f19c414c2e0 0x7f19c40c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19ca452640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19c4072310 0x7f19c40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19ca452640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c4071e80 con 0x7f19c40c0440 2023-11-18T20:40:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19ca452640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c4071470 con 0x7f19c414c2e0 2023-11-18T20:40:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19ca452640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c414c6c0 con 0x7f19c4072310 2023-11-18T20:40:53.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19c9450640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f19c414c2e0 0x7f19c40c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19c8c4f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f19c40c0440 0x7f19c4152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56802/0 (socket says 172.21.15.132:56802) 2023-11-18T20:40:53.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19c8c4f640 1 -- 172.21.15.132:0/2948769492 learned_addr learned my addr 172.21.15.132:0/2948769492 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:53.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.854+0000 7f19c9c51640 1 --2- 172.21.15.132:0/2948769492 >> v2:172.21.15.161:3300/0 conn(0x7f19c4072310 0x7f19c40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.855+0000 7f19bbfff640 1 -- 172.21.15.132:0/2948769492 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572475076 0 0) 0x7f19c4071e80 con 0x7f19c40c0440 2023-11-18T20:40:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.855+0000 7f19bbfff640 1 -- 172.21.15.132:0/2948769492 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b0003520 con 0x7f19c40c0440 2023-11-18T20:40:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.855+0000 7f19c9450640 1 -- 172.21.15.132:0/2948769492 >> v2:172.21.15.161:3300/0 conn(0x7f19c4072310 msgr2=0x7f19c40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.855+0000 7f19c9450640 1 --2- 172.21.15.132:0/2948769492 >> v2:172.21.15.161:3300/0 conn(0x7f19c4072310 0x7f19c40a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.855+0000 7f19c9450640 1 -- 172.21.15.132:0/2948769492 >> v1:172.21.15.132:6789/0 conn(0x7f19c40c0440 legacy=0x7f19c4152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.855+0000 7f19c9450640 1 -- 172.21.15.132:0/2948769492 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c406fdc0 con 0x7f19c414c2e0 2023-11-18T20:40:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.855+0000 7f19c9c51640 1 --2- 172.21.15.132:0/2948769492 >> v2:172.21.15.161:3300/0 conn(0x7f19c4072310 0x7f19c40a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:53.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.856+0000 7f19c9450640 1 --2- 172.21.15.132:0/2948769492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c40c0c80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f19c406b720 tx=0x7f19c002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eb753e1111fc81 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.856+0000 7f19bbfff640 1 -- 172.21.15.132:0/2948769492 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0031710 con 0x7f19c414c2e0 2023-11-18T20:40:53.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.856+0000 7f19bbfff640 1 -- 172.21.15.132:0/2948769492 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c002f050 con 0x7f19c414c2e0 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.856+0000 7f19bbfff640 1 -- 172.21.15.132:0/2948769492 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0031a70 con 0x7f19c414c2e0 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.856+0000 7f19ca452640 1 -- 172.21.15.132:0/2948769492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 msgr2=0x7f19c40c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.856+0000 7f19ca452640 1 --2- 172.21.15.132:0/2948769492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c40c0c80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f19c406b720 tx=0x7f19c002b7b0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.857+0000 7f19ca452640 1 -- 172.21.15.132:0/2948769492 shutdown_connections 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.857+0000 7f19ca452640 1 --2- 172.21.15.132:0/2948769492 >> v2:172.21.15.161:3300/0 conn(0x7f19c4072310 0x7f19c40a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.857+0000 7f19ca452640 1 --2- 172.21.15.132:0/2948769492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c40c0c80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.857+0000 7f19ca452640 1 -- 172.21.15.132:0/2948769492 >> 172.21.15.132:0/2948769492 conn(0x7f19c40a77f0 msgr2=0x7f19c40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.857+0000 7f19ca452640 1 -- 172.21.15.132:0/2948769492 shutdown_connections 2023-11-18T20:40:53.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.857+0000 7f19ca452640 1 -- 172.21.15.132:0/2948769492 wait complete. 2023-11-18T20:40:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.858+0000 7f19ca452640 1 Processor -- start 2023-11-18T20:40:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.858+0000 7f19ca452640 1 -- start start 2023-11-18T20:40:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.859+0000 7f19ca452640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c4072310 0x7f19c41ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.859+0000 7f19ca452640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c40c0440 0x7f19c41ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.859+0000 7f19ca452640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c41eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.859+0000 7f19ca452640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c414cd90 con 0x7f19c414c2e0 2023-11-18T20:40:53.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.859+0000 7f19ca452640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c41ddba0 con 0x7f19c4072310 2023-11-18T20:40:53.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.859+0000 7f19ca452640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c41edbb0 con 0x7f19c40c0440 2023-11-18T20:40:53.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.859+0000 7f19c9c51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c41eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9c51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c41eb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42422/0 (socket says 172.21.15.132:42422) 2023-11-18T20:40:53.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9c51640 1 -- 172.21.15.132:0/3275967491 learned_addr learned my addr 172.21.15.132:0/3275967491 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:53.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9450640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c4072310 0x7f19c41ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c8c4f640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c40c0440 0x7f19c41ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9c51640 1 -- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c40c0440 msgr2=0x7f19c41ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9c51640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c40c0440 0x7f19c41ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9c51640 1 -- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c4072310 msgr2=0x7f19c41ed030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9c51640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c4072310 0x7f19c41ed030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9c51640 1 -- 172.21.15.132:0/3275967491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0009400 con 0x7f19c414c2e0 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c8c4f640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c40c0440 0x7f19c41ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19c9c51640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c41eb110 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00cef0 tx=0x7f19bc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.860+0000 7f19b9ffb640 1 -- 172.21.15.132:0/3275967491 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00d840 con 0x7f19c414c2e0 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.861+0000 7f19b9ffb640 1 -- 172.21.15.132:0/3275967491 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00d9c0 con 0x7f19c414c2e0 2023-11-18T20:40:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.861+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c41dde60 con 0x7f19c414c2e0 2023-11-18T20:40:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.861+0000 7f19b9ffb640 1 -- 172.21.15.132:0/3275967491 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00dd70 con 0x7f19c414c2e0 2023-11-18T20:40:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.861+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c414ac30 con 0x7f19c414c2e0 2023-11-18T20:40:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.862+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c41de380 con 0x7f19c414c2e0 2023-11-18T20:40:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.863+0000 7f19b9ffb640 1 -- 172.21.15.132:0/3275967491 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19bc01e3b0 con 0x7f19c414c2e0 2023-11-18T20:40:53.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.864+0000 7f19b9ffb640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19a806ae40 0x7f19a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:53.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.864+0000 7f19b9ffb640 1 -- 172.21.15.132:0/3275967491 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f19bc08a3f0 con 0x7f19c414c2e0 2023-11-18T20:40:53.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.864+0000 7f19c9450640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19a806ae40 0x7f19a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:53.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.865+0000 7f19c9450640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19a806ae40 0x7f19a806d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f19c0035000 tx=0x7f19c0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:53.868+0000 7f19b9ffb640 1 -- 172.21.15.132:0/3275967491 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19c41de380 con 0x7f19c414c2e0 2023-11-18T20:40:54.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.041+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19c41de380 con 0x7f19c414c2e0 2023-11-18T20:40:54.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.042+0000 7f19b9ffb640 1 -- 172.21.15.132:0/3275967491 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19c41de380 con 0x7f19c414c2e0 2023-11-18T20:40:54.044 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:54.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19a806ae40 msgr2=0x7f19a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19a806ae40 0x7f19a806d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f19c0035000 tx=0x7f19c0008030 comp rx=0 tx=0).stop 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 msgr2=0x7f19c41eb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c41eb110 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00cef0 tx=0x7f19bc00a710 comp rx=0 tx=0).stop 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 shutdown_connections 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19a806ae40 0x7f19a806d300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19c414c2e0 0x7f19c41eb110 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c40c0440 0x7f19c41ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 --2- 172.21.15.132:0/3275967491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c4072310 0x7f19c41ed030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 >> 172.21.15.132:0/3275967491 conn(0x7f19c40a77f0 msgr2=0x7f19c414a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 shutdown_connections 2023-11-18T20:40:54.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.045+0000 7f19ca452640 1 -- 172.21.15.132:0/3275967491 wait complete. 2023-11-18T20:40:54.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:40:54.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.269+0000 7f6b8357c640 1 Processor -- start 2023-11-18T20:40:54.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.270+0000 7f6b8357c640 1 -- start start 2023-11-18T20:40:54.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.271+0000 7f6b8357c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b7c0c7fc0 0x7f6b7c0c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.271+0000 7f6b8357c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c155790 0x7f6b7c0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.271+0000 7f6b8357c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c0c1da0 con 0x7f6b7c0c7700 2023-11-18T20:40:54.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.271+0000 7f6b8357c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c3ee0 con 0x7f6b7c0c7fc0 2023-11-18T20:40:54.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.271+0000 7f6b8357c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c7b90 con 0x7f6b7c155790 2023-11-18T20:40:54.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.271+0000 7f6b81318640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b7c0c7fc0 0x7f6b7c0c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.271+0000 7f6b80b17640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6b7c0c7700 0x7f6b7c155080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56818/0 (socket says 172.21.15.132:56818) 2023-11-18T20:40:54.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.271+0000 7f6b80b17640 1 -- 172.21.15.132:0/85588384 learned_addr learned my addr 172.21.15.132:0/85588384 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:54.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.272+0000 7f6b81b19640 1 --2- 172.21.15.132:0/85588384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c155790 0x7f6b7c0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.272+0000 7f6b81318640 1 -- 172.21.15.132:0/85588384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c155790 msgr2=0x7f6b7c0c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:54.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.272+0000 7f6b81318640 1 --2- 172.21.15.132:0/85588384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c155790 0x7f6b7c0c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.272+0000 7f6b81318640 1 -- 172.21.15.132:0/85588384 >> v1:172.21.15.132:6789/0 conn(0x7f6b7c0c7700 legacy=0x7f6b7c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.272+0000 7f6b81318640 1 -- 172.21.15.132:0/85588384 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c0c2080 con 0x7f6b7c0c7fc0 2023-11-18T20:40:54.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.273+0000 7f6b81318640 1 --2- 172.21.15.132:0/85588384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c0c7fc0 0x7f6b7c0c30b0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009dc0 tx=0x7f6b7802be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ce872a7edf1ce9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:54.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.273+0000 7f6b73fff640 1 -- 172.21.15.132:0/85588384 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7802cbb0 con 0x7f6b7c0c7fc0 2023-11-18T20:40:54.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.273+0000 7f6b73fff640 1 -- 172.21.15.132:0/85588384 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7802cd10 con 0x7f6b7c0c7fc0 2023-11-18T20:40:54.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.273+0000 7f6b73fff640 1 -- 172.21.15.132:0/85588384 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78034660 con 0x7f6b7c0c7fc0 2023-11-18T20:40:54.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.274+0000 7f6b8357c640 1 -- 172.21.15.132:0/85588384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c0c7fc0 msgr2=0x7f6b7c0c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.274+0000 7f6b8357c640 1 --2- 172.21.15.132:0/85588384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c0c7fc0 0x7f6b7c0c30b0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009dc0 tx=0x7f6b7802be00 comp rx=0 tx=0).stop 2023-11-18T20:40:54.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.274+0000 7f6b8357c640 1 -- 172.21.15.132:0/85588384 shutdown_connections 2023-11-18T20:40:54.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.274+0000 7f6b8357c640 1 --2- 172.21.15.132:0/85588384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c155790 0x7f6b7c0c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.274+0000 7f6b8357c640 1 --2- 172.21.15.132:0/85588384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c0c7fc0 0x7f6b7c0c30b0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.274+0000 7f6b8357c640 1 -- 172.21.15.132:0/85588384 >> 172.21.15.132:0/85588384 conn(0x7f6b7c0a9b70 msgr2=0x7f6b7c0a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:54.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.274+0000 7f6b8357c640 1 -- 172.21.15.132:0/85588384 shutdown_connections 2023-11-18T20:40:54.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.274+0000 7f6b8357c640 1 -- 172.21.15.132:0/85588384 wait complete. 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.275+0000 7f6b8357c640 1 Processor -- start 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.275+0000 7f6b8357c640 1 -- start start 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.276+0000 7f6b8357c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b7c0c7fc0 0x7f6b7c14efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.276+0000 7f6b8357c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c155790 0x7f6b7c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.276+0000 7f6b8357c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c14d760 0x7f6b7c143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.276+0000 7f6b8357c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c06f390 con 0x7f6b7c155790 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.276+0000 7f6b8357c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c06ed60 con 0x7f6b7c0c7fc0 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.276+0000 7f6b8357c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1437c0 con 0x7f6b7c14d760 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c155790 0x7f6b7c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c155790 0x7f6b7c142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42436/0 (socket says 172.21.15.132:42436) 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 -- 172.21.15.132:0/2007554246 learned_addr learned my addr 172.21.15.132:0/2007554246 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 -- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c14d760 msgr2=0x7f6b7c143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c14d760 0x7f6b7c143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 -- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b7c0c7fc0 msgr2=0x7f6b7c14efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b7c0c7fc0 0x7f6b7c14efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 -- 172.21.15.132:0/2007554246 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78009a70 con 0x7f6b7c155790 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b80b17640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c155790 0x7f6b7c142d40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c005880 tx=0x7f6b6c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b71ffb640 1 -- 172.21.15.132:0/2007554246 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c005ce0 con 0x7f6b7c155790 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b71ffb640 1 -- 172.21.15.132:0/2007554246 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c005e40 con 0x7f6b7c155790 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b71ffb640 1 -- 172.21.15.132:0/2007554246 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c007310 con 0x7f6b7c155790 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.277+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c1eae20 con 0x7f6b7c155790 2023-11-18T20:40:54.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.278+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c06efb0 con 0x7f6b7c155790 2023-11-18T20:40:54.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.279+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c068350 con 0x7f6b7c155790 2023-11-18T20:40:54.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.279+0000 7f6b71ffb640 1 -- 172.21.15.132:0/2007554246 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b6c007470 con 0x7f6b7c155790 2023-11-18T20:40:54.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.280+0000 7f6b71ffb640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6b6006ae40 0x7f6b6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.280+0000 7f6b71ffb640 1 -- 172.21.15.132:0/2007554246 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f6b6c088ff0 con 0x7f6b7c155790 2023-11-18T20:40:54.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.281+0000 7f6b81318640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6b6006ae40 0x7f6b6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.282+0000 7f6b81318640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6b6006ae40 0x7f6b6006d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b78036000 tx=0x7f6b7802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:54.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.284+0000 7f6b71ffb640 1 -- 172.21.15.132:0/2007554246 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b6c0bbe90 con 0x7f6b7c155790 2023-11-18T20:40:54.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.478+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b7c06f4d0 con 0x7f6b7c155790 2023-11-18T20:40:54.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.479+0000 7f6b71ffb640 1 -- 172.21.15.132:0/2007554246 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b7c06f4d0 con 0x7f6b7c155790 2023-11-18T20:40:54.480 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:54.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6b6006ae40 msgr2=0x7f6b6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6b6006ae40 0x7f6b6006d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b78036000 tx=0x7f6b7802e000 comp rx=0 tx=0).stop 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c155790 msgr2=0x7f6b7c142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c155790 0x7f6b7c142d40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c005880 tx=0x7f6b6c00c890 comp rx=0 tx=0).stop 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 shutdown_connections 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6b6006ae40 0x7f6b6006d300 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b7c14d760 0x7f6b7c143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7c155790 0x7f6b7c142d40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 --2- 172.21.15.132:0/2007554246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b7c0c7fc0 0x7f6b7c14efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 >> 172.21.15.132:0/2007554246 conn(0x7f6b7c0a9b70 msgr2=0x7f6b7c0a8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 shutdown_connections 2023-11-18T20:40:54.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.482+0000 7f6b8357c640 1 -- 172.21.15.132:0/2007554246 wait complete. 2023-11-18T20:40:54.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:40:54.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.709+0000 7f556a9f0640 1 Processor -- start 2023-11-18T20:40:54.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.709+0000 7f556a9f0640 1 -- start start 2023-11-18T20:40:54.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.710+0000 7f556a9f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f556414fd30 0x7f5564152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.710+0000 7f556a9f0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556406d0a0 0x7f55640a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.710+0000 7f556a9f0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55640c64a0 con 0x7f55640a5260 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.710+0000 7f556a9f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640c5c00 con 0x7f556414fd30 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.710+0000 7f556a9f0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55640c5ee0 con 0x7f556406d0a0 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.711+0000 7f5563fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f556414fd30 0x7f5564152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.711+0000 7f5563fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f556414fd30 0x7f5564152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42448/0 (socket says 172.21.15.132:42448) 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.711+0000 7f5563fff640 1 -- 172.21.15.132:0/3620345062 learned_addr learned my addr 172.21.15.132:0/3620345062 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.711+0000 7f55637fe640 1 --2- 172.21.15.132:0/3620345062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556406d0a0 0x7f55640a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.711+0000 7f5563fff640 1 -- 172.21.15.132:0/3620345062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556406d0a0 msgr2=0x7f55640a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.711+0000 7f5563fff640 1 --2- 172.21.15.132:0/3620345062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556406d0a0 0x7f55640a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.711+0000 7f5563fff640 1 -- 172.21.15.132:0/3620345062 >> v1:172.21.15.161:6789/0 conn(0x7f55640a5260 legacy=0x7f55640c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:54.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.711+0000 7f5563fff640 1 -- 172.21.15.132:0/3620345062 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640c61c0 con 0x7f556414fd30 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.712+0000 7f5563fff640 1 --2- 172.21.15.132:0/3620345062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f556414fd30 0x7f5564152f20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b955bbd371e850ef server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f5562ffd640 1 -- 172.21.15.132:0/3620345062 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554031640 con 0x7f556414fd30 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f5562ffd640 1 -- 172.21.15.132:0/3620345062 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55540317a0 con 0x7f556414fd30 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f5562ffd640 1 -- 172.21.15.132:0/3620345062 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554031b30 con 0x7f556414fd30 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f556a9f0640 1 -- 172.21.15.132:0/3620345062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f556414fd30 msgr2=0x7f5564152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f556a9f0640 1 --2- 172.21.15.132:0/3620345062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f556414fd30 0x7f5564152f20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402b8f0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f556a9f0640 1 -- 172.21.15.132:0/3620345062 shutdown_connections 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f556a9f0640 1 --2- 172.21.15.132:0/3620345062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556406d0a0 0x7f55640a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f556a9f0640 1 --2- 172.21.15.132:0/3620345062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f556414fd30 0x7f5564152f20 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f556a9f0640 1 -- 172.21.15.132:0/3620345062 >> 172.21.15.132:0/3620345062 conn(0x7f556406a500 msgr2=0x7f556406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f556a9f0640 1 -- 172.21.15.132:0/3620345062 shutdown_connections 2023-11-18T20:40:54.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.713+0000 7f556a9f0640 1 -- 172.21.15.132:0/3620345062 wait complete. 2023-11-18T20:40:54.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.715+0000 7f556a9f0640 1 Processor -- start 2023-11-18T20:40:54.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.715+0000 7f556a9f0640 1 -- start start 2023-11-18T20:40:54.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f556a9f0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556406d0a0 0x7f55640aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f556a9f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55640a5260 0x7f5564070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f556a9f0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556414fd30 0x7f5564149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f556a9f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564071410 con 0x7f55640a5260 2023-11-18T20:40:54.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f556a9f0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556414a170 con 0x7f556406d0a0 2023-11-18T20:40:54.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f556a9f0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55640aac40 con 0x7f556414fd30 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f55637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55640a5260 0x7f5564070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f55637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55640a5260 0x7f5564070220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42454/0 (socket says 172.21.15.132:42454) 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.716+0000 7f55637fe640 1 -- 172.21.15.132:0/15647130 learned_addr learned my addr 172.21.15.132:0/15647130 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f5563fff640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556406d0a0 0x7f55640aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f55637fe640 1 -- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556414fd30 msgr2=0x7f5564149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f5568f8d640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556414fd30 0x7f5564149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f55637fe640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556414fd30 0x7f5564149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f55637fe640 1 -- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556406d0a0 msgr2=0x7f55640aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f55637fe640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556406d0a0 0x7f55640aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f55637fe640 1 -- 172.21.15.132:0/15647130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540094d0 con 0x7f55640a5260 2023-11-18T20:40:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f55637fe640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55640a5260 0x7f5564070220 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f555800c820 tx=0x7f555800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:54.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.717+0000 7f5560ff9640 1 -- 172.21.15.132:0/15647130 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558004220 con 0x7f55640a5260 2023-11-18T20:40:54.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.718+0000 7f5560ff9640 1 -- 172.21.15.132:0/15647130 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558004380 con 0x7f55640a5260 2023-11-18T20:40:54.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.718+0000 7f5560ff9640 1 -- 172.21.15.132:0/15647130 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558007a50 con 0x7f55640a5260 2023-11-18T20:40:54.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.718+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556414beb0 con 0x7f55640a5260 2023-11-18T20:40:54.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.718+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5564070e90 con 0x7f55640a5260 2023-11-18T20:40:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.719+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556414a2e0 con 0x7f55640a5260 2023-11-18T20:40:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.720+0000 7f5560ff9640 1 -- 172.21.15.132:0/15647130 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5558007bb0 con 0x7f55640a5260 2023-11-18T20:40:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.721+0000 7f5560ff9640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f555006ae40 0x7f555006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:54.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.721+0000 7f5560ff9640 1 -- 172.21.15.132:0/15647130 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f5558089790 con 0x7f55640a5260 2023-11-18T20:40:54.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.721+0000 7f5563fff640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f555006ae40 0x7f555006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:54.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.722+0000 7f5563fff640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f555006ae40 0x7f555006d300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5554036000 tx=0x7f555403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:54.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.725+0000 7f5560ff9640 1 -- 172.21.15.132:0/15647130 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f556414a2e0 con 0x7f55640a5260 2023-11-18T20:40:54.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.922+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f556414a2e0 con 0x7f55640a5260 2023-11-18T20:40:54.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.922+0000 7f5560ff9640 1 -- 172.21.15.132:0/15647130 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v61) v1 ==== 105+0+11 (secure 0 0 0) 0x7f556414a2e0 con 0x7f55640a5260 2023-11-18T20:40:54.924 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:40:54.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f555006ae40 msgr2=0x7f555006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f555006ae40 0x7f555006d300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5554036000 tx=0x7f555403c040 comp rx=0 tx=0).stop 2023-11-18T20:40:54.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55640a5260 msgr2=0x7f5564070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:54.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55640a5260 0x7f5564070220 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f555800c820 tx=0x7f555800cce0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 shutdown_connections 2023-11-18T20:40:54.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f555006ae40 0x7f555006d300 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f556414fd30 0x7f5564149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55640a5260 0x7f5564070220 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 --2- 172.21.15.132:0/15647130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f556406d0a0 0x7f55640aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:54.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 >> 172.21.15.132:0/15647130 conn(0x7f556406a500 msgr2=0x7f55640c3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:54.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.925+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 shutdown_connections 2023-11-18T20:40:54.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:54.926+0000 7f556a9f0640 1 -- 172.21.15.132:0/15647130 wait complete. 2023-11-18T20:40:54.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:40:55.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.164+0000 7f9c8359e640 1 Processor -- start 2023-11-18T20:40:55.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.164+0000 7f9c8359e640 1 -- start start 2023-11-18T20:40:55.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.165+0000 7f9c8359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c840c52e0 0x7f9c8406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c8359e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840a8380 con 0x7f9c8414e7f0 2023-11-18T20:40:55.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c8359e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c841510b0 con 0x7f9c8406cd20 2023-11-18T20:40:55.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c8359e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8406bf60 con 0x7f9c840c52e0 2023-11-18T20:40:55.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c8259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9c8414e7f0 0x7f9c840c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56824/0 (socket says 172.21.15.132:56824) 2023-11-18T20:40:55.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c8259c640 1 -- 172.21.15.132:0/3179727308 learned_addr learned my addr 172.21.15.132:0/3179727308 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:55.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c79d9b640 1 --2- 172.21.15.132:0/3179727308 >> v2:172.21.15.132:3300/0 conn(0x7f9c840c52e0 0x7f9c8406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:55.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c81d9b640 1 -- 172.21.15.132:0/3179727308 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500943835 0 0) 0x7f9c840a8380 con 0x7f9c8414e7f0 2023-11-18T20:40:55.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c81d9b640 1 -- 172.21.15.132:0/3179727308 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c70003520 con 0x7f9c8414e7f0 2023-11-18T20:40:55.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c79d9b640 1 -- 172.21.15.132:0/3179727308 >> v1:172.21.15.161:6789/0 conn(0x7f9c8406cd20 legacy=0x7f9c8415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:55.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c79d9b640 1 -- 172.21.15.132:0/3179727308 >> v1:172.21.15.132:6789/0 conn(0x7f9c8414e7f0 legacy=0x7f9c840c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.166+0000 7f9c79d9b640 1 -- 172.21.15.132:0/3179727308 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8406c240 con 0x7f9c840c52e0 2023-11-18T20:40:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c79d9b640 1 --2- 172.21.15.132:0/3179727308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c840c52e0 0x7f9c8406d1e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0097a0 tx=0x7f9c6c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc80790d3b17b4f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c81d9b640 1 -- 172.21.15.132:0/3179727308 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c02e070 con 0x7f9c840c52e0 2023-11-18T20:40:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c81d9b640 1 -- 172.21.15.132:0/3179727308 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0315a0 con 0x7f9c840c52e0 2023-11-18T20:40:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c81d9b640 1 -- 172.21.15.132:0/3179727308 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c031930 con 0x7f9c840c52e0 2023-11-18T20:40:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c8359e640 1 -- 172.21.15.132:0/3179727308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c840c52e0 msgr2=0x7f9c8406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c8359e640 1 --2- 172.21.15.132:0/3179727308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c840c52e0 0x7f9c8406d1e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0097a0 tx=0x7f9c6c02b840 comp rx=0 tx=0).stop 2023-11-18T20:40:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c8359e640 1 -- 172.21.15.132:0/3179727308 shutdown_connections 2023-11-18T20:40:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c8359e640 1 --2- 172.21.15.132:0/3179727308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c840c52e0 0x7f9c8406d1e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.168+0000 7f9c8359e640 1 -- 172.21.15.132:0/3179727308 >> 172.21.15.132:0/3179727308 conn(0x7f9c840a77f0 msgr2=0x7f9c840a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.169+0000 7f9c8359e640 1 -- 172.21.15.132:0/3179727308 shutdown_connections 2023-11-18T20:40:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.169+0000 7f9c8359e640 1 -- 172.21.15.132:0/3179727308 wait complete. 2023-11-18T20:40:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.170+0000 7f9c8359e640 1 Processor -- start 2023-11-18T20:40:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.170+0000 7f9c8359e640 1 -- start start 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.171+0000 7f9c8359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8406cd20 0x7f9c84149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.171+0000 7f9c8359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c840c52e0 0x7f9c841e9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.171+0000 7f9c8359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c8414e7f0 0x7f9c841ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.171+0000 7f9c8359e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8414ccd0 con 0x7f9c8414e7f0 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.171+0000 7f9c8359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841494c0 con 0x7f9c8406cd20 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.171+0000 7f9c8359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84148d50 con 0x7f9c840c52e0 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c8414e7f0 0x7f9c841ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c8414e7f0 0x7f9c841ea1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42466/0 (socket says 172.21.15.132:42466) 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 -- 172.21.15.132:0/2070175309 learned_addr learned my addr 172.21.15.132:0/2070175309 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:55.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c8259c640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8406cd20 0x7f9c84149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:55.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 -- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c840c52e0 msgr2=0x7f9c841e9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c840c52e0 0x7f9c841e9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 -- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8406cd20 msgr2=0x7f9c84149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8406cd20 0x7f9c84149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 -- 172.21.15.132:0/2070175309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c009400 con 0x7f9c8414e7f0 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.172+0000 7f9c82d9d640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c8414e7f0 0x7f9c841ea1a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00c410 tx=0x7f9c7c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.173+0000 7f9c7b7fe640 1 -- 172.21.15.132:0/2070175309 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c011790 con 0x7f9c8414e7f0 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.173+0000 7f9c7b7fe640 1 -- 172.21.15.132:0/2070175309 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0118f0 con 0x7f9c8414e7f0 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.173+0000 7f9c7b7fe640 1 -- 172.21.15.132:0/2070175309 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c011ce0 con 0x7f9c8414e7f0 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.173+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8414c960 con 0x7f9c8414e7f0 2023-11-18T20:40:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.173+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c84149170 con 0x7f9c8414e7f0 2023-11-18T20:40:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.174+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8414ce40 con 0x7f9c8414e7f0 2023-11-18T20:40:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.175+0000 7f9c7b7fe640 1 -- 172.21.15.132:0/2070175309 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c7c01c460 con 0x7f9c8414e7f0 2023-11-18T20:40:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.176+0000 7f9c7b7fe640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c6406ae40 0x7f9c6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.176+0000 7f9c7b7fe640 1 -- 172.21.15.132:0/2070175309 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f9c7c089620 con 0x7f9c8414e7f0 2023-11-18T20:40:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.176+0000 7f9c8259c640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c6406ae40 0x7f9c6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:55.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.177+0000 7f9c8259c640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c6406ae40 0x7f9c6406d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c74001560 tx=0x7f9c74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:55.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.180+0000 7f9c7b7fe640 1 -- 172.21.15.132:0/2070175309 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c7c054390 con 0x7f9c8414e7f0 2023-11-18T20:40:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.374+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9c840c0ad0 con 0x7f9c8414e7f0 2023-11-18T20:40:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.374+0000 7f9c7b7fe640 1 -- 172.21.15.132:0/2070175309 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v61) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9c7c0579b0 con 0x7f9c8414e7f0 2023-11-18T20:40:55.376 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:40:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c6406ae40 msgr2=0x7f9c6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c6406ae40 0x7f9c6406d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c74001560 tx=0x7f9c74009040 comp rx=0 tx=0).stop 2023-11-18T20:40:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c8414e7f0 msgr2=0x7f9c841ea1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c8414e7f0 0x7f9c841ea1a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00c410 tx=0x7f9c7c00c8d0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 shutdown_connections 2023-11-18T20:40:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c6406ae40 0x7f9c6406d300 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c8414e7f0 0x7f9c841ea1a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c840c52e0 0x7f9c841e9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 --2- 172.21.15.132:0/2070175309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8406cd20 0x7f9c84149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 >> 172.21.15.132:0/2070175309 conn(0x7f9c840a77f0 msgr2=0x7f9c840c0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 shutdown_connections 2023-11-18T20:40:55.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.377+0000 7f9c8359e640 1 -- 172.21.15.132:0/2070175309 wait complete. 2023-11-18T20:40:55.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.608+0000 7fd9c83c5640 1 Processor -- start 2023-11-18T20:40:55.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.608+0000 7fd9c83c5640 1 -- start start 2023-11-18T20:40:55.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.609+0000 7fd9c83c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9c0155490 0x7fd9c00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.609+0000 7fd9c83c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9c00c1500 0x7fd9c00a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.609+0000 7fd9c83c5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9c00c4080 0x7fd9c00a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.609+0000 7fd9c83c5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c00a5820 con 0x7fd9c00c4080 2023-11-18T20:40:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.609+0000 7fd9c83c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c00c06c0 con 0x7fd9c0155490 2023-11-18T20:40:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.609+0000 7fd9c83c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00c1020 con 0x7fd9c00c1500 2023-11-18T20:40:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.610+0000 7fd9c6962640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9c00c4080 0x7fd9c00a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.610+0000 7fd9c6962640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9c00c4080 0x7fd9c00a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42482/0 (socket says 172.21.15.132:42482) 2023-11-18T20:40:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.610+0000 7fd9c6962640 1 -- 172.21.15.132:0/2910864735 learned_addr learned my addr 172.21.15.132:0/2910864735 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.610+0000 7fd9c6962640 1 -- 172.21.15.132:0/2910864735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9c00c1500 msgr2=0x7fd9c00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.610+0000 7fd9c6962640 1 --2- 172.21.15.132:0/2910864735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9c00c1500 0x7fd9c00a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.610+0000 7fd9c6962640 1 -- 172.21.15.132:0/2910864735 >> v2:172.21.15.161:3300/0 conn(0x7fd9c0155490 msgr2=0x7fd9c00a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.610+0000 7fd9c6962640 1 --2- 172.21.15.132:0/2910864735 >> v2:172.21.15.161:3300/0 conn(0x7fd9c0155490 0x7fd9c00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.610+0000 7fd9c6962640 1 -- 172.21.15.132:0/2910864735 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00c0910 con 0x7fd9c00c4080 2023-11-18T20:40:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.611+0000 7fd9c6962640 1 --2- 172.21.15.132:0/2910864735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c4080 0x7fd9c00a9970 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd9c006dff0 tx=0x7fd9bc02e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14ff7d80cf3df18 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c515f640 1 -- 172.21.15.132:0/2910864735 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc02ea00 con 0x7fd9c00c4080 2023-11-18T20:40:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c515f640 1 -- 172.21.15.132:0/2910864735 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc02eb60 con 0x7fd9c00c4080 2023-11-18T20:40:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c515f640 1 -- 172.21.15.132:0/2910864735 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc009600 con 0x7fd9c00c4080 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c83c5640 1 -- 172.21.15.132:0/2910864735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c4080 msgr2=0x7fd9c00a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/2910864735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c4080 0x7fd9c00a9970 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd9c006dff0 tx=0x7fd9bc02e060 comp rx=0 tx=0).stop 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c83c5640 1 -- 172.21.15.132:0/2910864735 shutdown_connections 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/2910864735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c4080 0x7fd9c00a9970 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/2910864735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9c00c1500 0x7fd9c00a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/2910864735 >> v2:172.21.15.161:3300/0 conn(0x7fd9c0155490 0x7fd9c00a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c83c5640 1 -- 172.21.15.132:0/2910864735 >> 172.21.15.132:0/2910864735 conn(0x7fd9c006a500 msgr2=0x7fd9c006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.612+0000 7fd9c83c5640 1 -- 172.21.15.132:0/2910864735 shutdown_connections 2023-11-18T20:40:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.613+0000 7fd9c83c5640 1 -- 172.21.15.132:0/2910864735 wait complete. 2023-11-18T20:40:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.614+0000 7fd9c83c5640 1 Processor -- start 2023-11-18T20:40:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.614+0000 7fd9c83c5640 1 -- start start 2023-11-18T20:40:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c83c5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c1500 0x7fd9c01495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c83c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9c00c4080 0x7fd9c0146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c83c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c0155490 0x7fd9c01e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c83c5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0147a30 con 0x7fd9c00c1500 2023-11-18T20:40:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c83c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0070120 con 0x7fd9c0155490 2023-11-18T20:40:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c83c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0149af0 con 0x7fd9c00c4080 2023-11-18T20:40:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c6161640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c1500 0x7fd9c01495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c6161640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c1500 0x7fd9c01495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42484/0 (socket says 172.21.15.132:42484) 2023-11-18T20:40:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.615+0000 7fd9c6161640 1 -- 172.21.15.132:0/858524874 learned_addr learned my addr 172.21.15.132:0/858524874 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9c6161640 1 -- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9c00c4080 msgr2=0x7fd9c0146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9c6161640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9c00c4080 0x7fd9c0146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9c6161640 1 -- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c0155490 msgr2=0x7fd9c01e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9c6161640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c0155490 0x7fd9c01e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9c6161640 1 -- 172.21.15.132:0/858524874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc00bd40 con 0x7fd9c00c1500 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9c6161640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c1500 0x7fd9c01495b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800b440 tx=0x7fd9b800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9b6ffd640 1 -- 172.21.15.132:0/858524874 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8011890 con 0x7fd9c00c1500 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9b6ffd640 1 -- 172.21.15.132:0/858524874 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80119f0 con 0x7fd9c00c1500 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9b6ffd640 1 -- 172.21.15.132:0/858524874 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8011da0 con 0x7fd9c00c1500 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.616+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c006fe40 con 0x7fd9c00c1500 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.617+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c01e9fd0 con 0x7fd9c00c1500 2023-11-18T20:40:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.618+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c0149f10 con 0x7fd9c00c1500 2023-11-18T20:40:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.618+0000 7fd9b6ffd640 1 -- 172.21.15.132:0/858524874 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9b801a400 con 0x7fd9c00c1500 2023-11-18T20:40:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.619+0000 7fd9b6ffd640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9a406ae70 0x7fd9a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.619+0000 7fd9b6ffd640 1 -- 172.21.15.132:0/858524874 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fd9b8089c20 con 0x7fd9c00c1500 2023-11-18T20:40:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.620+0000 7fd9c5960640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9a406ae70 0x7fd9a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.621+0000 7fd9c5960640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9a406ae70 0x7fd9a406d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00c12e0 tx=0x7fd9b0006c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:55.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.624+0000 7fd9b6ffd640 1 -- 172.21.15.132:0/858524874 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9c0149f10 con 0x7fd9c00c1500 2023-11-18T20:40:55.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.851+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9c0149f10 con 0x7fd9c00c1500 2023-11-18T20:40:55.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.852+0000 7fd9b6ffd640 1 -- 172.21.15.132:0/858524874 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6141 (secure 0 0 0) 0x7fd9c0149f10 con 0x7fd9c00c1500 2023-11-18T20:40:55.854 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:55.854 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:15.246098+0000","modified":"2023-11-18T20:40:18.344815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/3392191515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3392191515},{"type":"v1","addr":"172.21.15.132:6835","nonce":3392191515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:30.829157+0000","modified":"2023-11-18T20:40:33.909984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-18T20:40:55.854 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 35 2023-11-18T20:40:55.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9a406ae70 msgr2=0x7fd9a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9a406ae70 0x7fd9a406d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00c12e0 tx=0x7fd9b0006c90 comp rx=0 tx=0).stop 2023-11-18T20:40:55.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c1500 msgr2=0x7fd9c01495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c1500 0x7fd9c01495b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800b440 tx=0x7fd9b800b900 comp rx=0 tx=0).stop 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 shutdown_connections 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9a406ae70 0x7fd9a406d330 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c0155490 0x7fd9c01e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9c00c4080 0x7fd9c0146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 --2- 172.21.15.132:0/858524874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9c00c1500 0x7fd9c01495b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 >> 172.21.15.132:0/858524874 conn(0x7fd9c006a500 msgr2=0x7fd9c006d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 shutdown_connections 2023-11-18T20:40:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:55.855+0000 7fd9c83c5640 1 -- 172.21.15.132:0/858524874 wait complete. 2023-11-18T20:40:55.878 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:56.078 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:40:56.085 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:40:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.087+0000 7fd1f689f640 1 Processor -- start 2023-11-18T20:40:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.087+0000 7fd1f689f640 1 -- start start 2023-11-18T20:40:56.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.089+0000 7fd1f689f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd1f00ca8d0 0x7fd1f0154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.089+0000 7fd1f689f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f0158a60 con 0x7fd1f014e7c0 2023-11-18T20:40:56.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.089+0000 7fd1f689f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f00c4dd0 con 0x7fd1f00ca450 2023-11-18T20:40:56.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.089+0000 7fd1f689f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f00c5b10 con 0x7fd1f00ca8d0 2023-11-18T20:40:56.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.089+0000 7fd1f589d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd1f014e7c0 0x7fd1f00c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56834/0 (socket says 172.21.15.132:56834) 2023-11-18T20:40:56.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.089+0000 7fd1f589d640 1 -- 172.21.15.132:0/308568380 learned_addr learned my addr 172.21.15.132:0/308568380 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:56.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.089+0000 7fd1f609e640 1 --2- 172.21.15.132:0/308568380 >> v2:172.21.15.161:3300/0 conn(0x7fd1f00ca8d0 0x7fd1f0154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.089+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292429453 0 0) 0x7fd1f0158a60 con 0x7fd1f014e7c0 2023-11-18T20:40:56.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1dc003520 con 0x7fd1f014e7c0 2023-11-18T20:40:56.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 15636841 0 0) 0x7fd1dc003520 con 0x7fd1f014e7c0 2023-11-18T20:40:56.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 >> v2:172.21.15.161:3300/0 conn(0x7fd1f00ca8d0 msgr2=0x7fd1f0154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 --2- 172.21.15.132:0/308568380 >> v2:172.21.15.161:3300/0 conn(0x7fd1f00ca8d0 0x7fd1f0154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 >> v1:172.21.15.161:6789/0 conn(0x7fd1f00ca450 legacy=0x7fd1f0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0157ca0 con 0x7fd1f014e7c0 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fd1ec001670 con 0x7fd1f014e7c0 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 >> v1:172.21.15.132:6789/0 conn(0x7fd1f014e7c0 legacy=0x7fd1f00c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0039c0 0x7fd1dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1dc0047c0 0x7fd1dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1dc005380 0x7fd1dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc00c230 con 0x7fd1dc0047c0 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc00c3a0 con 0x7fd1dc005380 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc00c560 con 0x7fd1dc0039c0 2023-11-18T20:40:56.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.090+0000 7fd1f509c640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1dc0047c0 0x7fd1dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.091+0000 7fd1f589d640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0039c0 0x7fd1dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.091+0000 7fd1f609e640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1dc005380 0x7fd1dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.091+0000 7fd1f509c640 1 -- 172.21.15.132:0/308568380 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0039c0 msgr2=0x7fd1dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:56.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.091+0000 7fd1f509c640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0039c0 0x7fd1dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.091+0000 7fd1f509c640 1 -- 172.21.15.132:0/308568380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1dc005380 msgr2=0x7fd1dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:56.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.091+0000 7fd1f509c640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1dc005380 0x7fd1dc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.091+0000 7fd1f609e640 1 -- 172.21.15.132:0/308568380 reap_dead start 2023-11-18T20:40:56.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.091+0000 7fd1f509c640 1 -- 172.21.15.132:0/308568380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc003520 con 0x7fd1dc0047c0 2023-11-18T20:40:56.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.092+0000 7fd1f509c640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1dc0047c0 0x7fd1dc004c40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0001750 tx=0x7fd1dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e63fb1d529f6a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:56.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00052d0 con 0x7fd1dc0047c0 2023-11-18T20:40:56.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e002e050 con 0x7fd1dc0047c0 2023-11-18T20:40:56.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f489b640 1 -- 172.21.15.132:0/308568380 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0003830 con 0x7fd1dc0047c0 2023-11-18T20:40:56.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f689f640 1 -- 172.21.15.132:0/308568380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1dc0047c0 msgr2=0x7fd1dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f689f640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1dc0047c0 0x7fd1dc004c40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0001750 tx=0x7fd1dc0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f689f640 1 -- 172.21.15.132:0/308568380 shutdown_connections 2023-11-18T20:40:56.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f689f640 1 --2- 172.21.15.132:0/308568380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1dc0047c0 0x7fd1dc004c40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f689f640 1 -- 172.21.15.132:0/308568380 >> 172.21.15.132:0/308568380 conn(0x7fd1f00abf00 msgr2=0x7fd1f00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:56.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.093+0000 7fd1f689f640 1 -- 172.21.15.132:0/308568380 shutdown_connections 2023-11-18T20:40:56.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.094+0000 7fd1f689f640 1 -- 172.21.15.132:0/308568380 wait complete. 2023-11-18T20:40:56.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.095+0000 7fd1f689f640 1 Processor -- start 2023-11-18T20:40:56.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.095+0000 7fd1f689f640 1 -- start start 2023-11-18T20:40:56.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.096+0000 7fd1f689f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0047c0 0x7fd1f014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.096+0000 7fd1f689f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00a97b0 0x7fd1f00c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.096+0000 7fd1f689f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1f014f870 0x7fd1f014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.096+0000 7fd1f689f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0151c30 con 0x7fd1f00a97b0 2023-11-18T20:40:56.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.096+0000 7fd1f689f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01ea9c0 con 0x7fd1f014f870 2023-11-18T20:40:56.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.096+0000 7fd1f689f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00ab5d0 con 0x7fd1dc0047c0 2023-11-18T20:40:56.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00a97b0 0x7fd1f00c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00a97b0 0x7fd1f00c03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42494/0 (socket says 172.21.15.132:42494) 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 -- 172.21.15.132:0/3458790720 learned_addr learned my addr 172.21.15.132:0/3458790720 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f589d640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0047c0 0x7fd1f014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f609e640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1f014f870 0x7fd1f014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 -- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0047c0 msgr2=0x7fd1f014eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0047c0 0x7fd1f014eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 -- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1f014f870 msgr2=0x7fd1f014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1f014f870 0x7fd1f014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 -- 172.21.15.132:0/3458790720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0151690 con 0x7fd1f00a97b0 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f609e640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1f014f870 0x7fd1f014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.097+0000 7fd1f509c640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00a97b0 0x7fd1f00c03b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.098+0000 7fd1e67fc640 1 -- 172.21.15.132:0/3458790720 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00076c0 con 0x7fd1f00a97b0 2023-11-18T20:40:56.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.098+0000 7fd1e67fc640 1 -- 172.21.15.132:0/3458790720 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0007a30 con 0x7fd1f00a97b0 2023-11-18T20:40:56.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.098+0000 7fd1e67fc640 1 -- 172.21.15.132:0/3458790720 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0006be0 con 0x7fd1f00a97b0 2023-11-18T20:40:56.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.098+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f014f190 con 0x7fd1f00a97b0 2023-11-18T20:40:56.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.098+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f00c08f0 con 0x7fd1f00a97b0 2023-11-18T20:40:56.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.100+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f01ea790 con 0x7fd1f00a97b0 2023-11-18T20:40:56.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.101+0000 7fd1e67fc640 1 -- 172.21.15.132:0/3458790720 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1e0006d40 con 0x7fd1f00a97b0 2023-11-18T20:40:56.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.101+0000 7fd1e67fc640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd1d406ae70 0x7fd1d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.102+0000 7fd1e67fc640 1 -- 172.21.15.132:0/3458790720 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fd1e00ab580 con 0x7fd1f00a97b0 2023-11-18T20:40:56.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.102+0000 7fd1f589d640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd1d406ae70 0x7fd1d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.103+0000 7fd1f589d640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd1d406ae70 0x7fd1d406d330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec001eb0 tx=0x7fd1ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:56.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.106+0000 7fd1e67fc640 1 -- 172.21.15.132:0/3458790720 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1e0076250 con 0x7fd1f00a97b0 2023-11-18T20:40:56.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.299+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1f004e840 con 0x7fd1f00a97b0 2023-11-18T20:40:56.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.302+0000 7fd1e67fc640 1 -- 172.21.15.132:0/3458790720 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20447 (secure 0 0 0) 0x7fd1e0079870 con 0x7fd1f00a97b0 2023-11-18T20:40:56.304 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:56.304 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":61,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:47.525645+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":4}]},{"pgid":"9.3b","mappings":[{"from":6,"to":1}]},{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.29","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd1d406ae70 msgr2=0x7fd1d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd1d406ae70 0x7fd1d406d330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec001eb0 tx=0x7fd1ec009040 comp rx=0 tx=0).stop 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00a97b0 msgr2=0x7fd1f00c03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00a97b0 0x7fd1f00c03b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e0001120 comp rx=0 tx=0).stop 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 shutdown_connections 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd1d406ae70 0x7fd1d406d330 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1f014f870 0x7fd1f014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00a97b0 0x7fd1f00c03b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 --2- 172.21.15.132:0/3458790720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1dc0047c0 0x7fd1f014eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 >> 172.21.15.132:0/3458790720 conn(0x7fd1f00abf00 msgr2=0x7fd1f00662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:56.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 shutdown_connections 2023-11-18T20:40:56.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.305+0000 7fd1f689f640 1 -- 172.21.15.132:0/3458790720 wait complete. 2023-11-18T20:40:56.326 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-18T20:40:56.326 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:56.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.537+0000 7fb20c505640 1 Processor -- start 2023-11-18T20:40:56.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.537+0000 7fb20c505640 1 -- start start 2023-11-18T20:40:56.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.538+0000 7fb20c505640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 0x7fb204152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.538+0000 7fb20c505640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2040c3ea0 0x7fb2040c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20c505640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040c64a0 con 0x7fb20414fd30 2023-11-18T20:40:56.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20c505640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040c5c00 con 0x7fb2040c3ea0 2023-11-18T20:40:56.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20c505640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040c5ee0 con 0x7fb20406d0a0 2023-11-18T20:40:56.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20aaa2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2040c3ea0 0x7fb2040c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20aaa2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2040c3ea0 0x7fb2040c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42510/0 (socket says 172.21.15.132:42510) 2023-11-18T20:40:56.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20aaa2640 1 -- 172.21.15.132:0/18244408 learned_addr learned my addr 172.21.15.132:0/18244408 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:56.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20aaa2640 1 -- 172.21.15.132:0/18244408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 msgr2=0x7fb204152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:56.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20aaa2640 1 --2- 172.21.15.132:0/18244408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 0x7fb204152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20aaa2640 1 -- 172.21.15.132:0/18244408 >> v1:172.21.15.161:6789/0 conn(0x7fb20414fd30 legacy=0x7fb2040a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:56.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.539+0000 7fb20aaa2640 1 -- 172.21.15.132:0/18244408 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040c61c0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.540+0000 7fb20aaa2640 1 --2- 172.21.15.132:0/18244408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040c4330 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009e50 tx=0x7fb1fc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c853419a84e827 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20929f640 1 -- 172.21.15.132:0/18244408 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc02ca70 con 0x7fb2040c3ea0 2023-11-18T20:40:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20929f640 1 -- 172.21.15.132:0/18244408 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc02cbd0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20929f640 1 -- 172.21.15.132:0/18244408 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0343f0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20c505640 1 -- 172.21.15.132:0/18244408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 msgr2=0x7fb2040c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20c505640 1 --2- 172.21.15.132:0/18244408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040c4330 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009e50 tx=0x7fb1fc02bed0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20c505640 1 -- 172.21.15.132:0/18244408 shutdown_connections 2023-11-18T20:40:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20c505640 1 --2- 172.21.15.132:0/18244408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040c4330 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20c505640 1 --2- 172.21.15.132:0/18244408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 0x7fb204152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20c505640 1 -- 172.21.15.132:0/18244408 >> 172.21.15.132:0/18244408 conn(0x7fb20406a500 msgr2=0x7fb20406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20c505640 1 -- 172.21.15.132:0/18244408 shutdown_connections 2023-11-18T20:40:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.541+0000 7fb20c505640 1 -- 172.21.15.132:0/18244408 wait complete. 2023-11-18T20:40:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.543+0000 7fb20c505640 1 Processor -- start 2023-11-18T20:40:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.543+0000 7fb20c505640 1 -- start start 2023-11-18T20:40:56.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb20c505640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 0x7fb20414f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb20c505640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb20c505640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb20414fd30 0x7fb2041ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb20c505640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041dd570 con 0x7fb2040c3ea0 2023-11-18T20:40:56.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb20c505640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041de3d0 con 0x7fb20414fd30 2023-11-18T20:40:56.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb20c505640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041de900 con 0x7fb20406d0a0 2023-11-18T20:40:56.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb209aa0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb209aa0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040a6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42518/0 (socket says 172.21.15.132:42518) 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.544+0000 7fb209aa0640 1 -- 172.21.15.132:0/588167859 learned_addr learned my addr 172.21.15.132:0/588167859 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb20a2a1640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 0x7fb20414f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb209aa0640 1 -- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 msgr2=0x7fb20414f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb209aa0640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 0x7fb20414f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb20aaa2640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb20414fd30 0x7fb2041ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb209aa0640 1 -- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb20414fd30 msgr2=0x7fb2041ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb209aa0640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb20414fd30 0x7fb2041ea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb209aa0640 1 -- 172.21.15.132:0/588167859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc009b30 con 0x7fb2040c3ea0 2023-11-18T20:40:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb20aaa2640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb20414fd30 0x7fb2041ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb209aa0640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040a6c10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400b440 tx=0x7fb1f400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb1faffd640 1 -- 172.21.15.132:0/588167859 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4011890 con 0x7fb2040c3ea0 2023-11-18T20:40:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb1faffd640 1 -- 172.21.15.132:0/588167859 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f40119f0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb1faffd640 1 -- 172.21.15.132:0/588167859 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4011da0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.545+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2041ee300 con 0x7fb2040c3ea0 2023-11-18T20:40:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.546+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20414f870 con 0x7fb2040c3ea0 2023-11-18T20:40:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.547+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2041dd6b0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.548+0000 7fb1faffd640 1 -- 172.21.15.132:0/588167859 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1f401a400 con 0x7fb2040c3ea0 2023-11-18T20:40:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.548+0000 7fb1faffd640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb1e806ae70 0x7fb1e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.549+0000 7fb1faffd640 1 -- 172.21.15.132:0/588167859 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fb1f4089c20 con 0x7fb2040c3ea0 2023-11-18T20:40:56.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.549+0000 7fb20a2a1640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb1e806ae70 0x7fb1e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:56.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.550+0000 7fb20a2a1640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb1e806ae70 0x7fb1e806d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb2000015d0 tx=0x7fb200009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:56.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.553+0000 7fb1faffd640 1 -- 172.21.15.132:0/588167859 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2041dd6b0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.783+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2041dd6b0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.784+0000 7fb1faffd640 1 -- 172.21.15.132:0/588167859 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6141 (secure 0 0 0) 0x7fb2041dd6b0 con 0x7fb2040c3ea0 2023-11-18T20:40:56.785 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:56.786 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:15.246098+0000","modified":"2023-11-18T20:40:18.344815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/3392191515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3392191515},{"type":"v1","addr":"172.21.15.132:6835","nonce":3392191515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:30.829157+0000","modified":"2023-11-18T20:40:33.909984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-18T20:40:56.786 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 35 2023-11-18T20:40:56.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb1e806ae70 msgr2=0x7fb1e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb1e806ae70 0x7fb1e806d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb2000015d0 tx=0x7fb200009040 comp rx=0 tx=0).stop 2023-11-18T20:40:56.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 msgr2=0x7fb2040a6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:56.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040a6c10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400b440 tx=0x7fb1f400b900 comp rx=0 tx=0).stop 2023-11-18T20:40:56.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 shutdown_connections 2023-11-18T20:40:56.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb1e806ae70 0x7fb1e806d330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb20414fd30 0x7fb2041ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2040c3ea0 0x7fb2040a6c10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 --2- 172.21.15.132:0/588167859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb20406d0a0 0x7fb20414f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:56.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 >> 172.21.15.132:0/588167859 conn(0x7fb20406a500 msgr2=0x7fb2040c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:56.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 shutdown_connections 2023-11-18T20:40:56.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:56.787+0000 7fb20c505640 1 -- 172.21.15.132:0/588167859 wait complete. 2023-11-18T20:40:56.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:40:57.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.018+0000 7fd48a3b0640 1 Processor -- start 2023-11-18T20:40:57.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.018+0000 7fd48a3b0640 1 -- start start 2023-11-18T20:40:57.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.019+0000 7fd48a3b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd484155490 0x7fd4840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.019+0000 7fd48a3b0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4840a9b40 0x7fd4840c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.019+0000 7fd48a3b0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4840c06c0 con 0x7fd4840c1500 2023-11-18T20:40:57.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.019+0000 7fd48a3b0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4840a5820 con 0x7fd4840a9b40 2023-11-18T20:40:57.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.019+0000 7fd48a3b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4840c1020 con 0x7fd484155490 2023-11-18T20:40:57.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd47bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd4840c1500 0x7fd4840a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56840/0 (socket says 172.21.15.132:56840) 2023-11-18T20:40:57.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd47bfff640 1 -- 172.21.15.132:0/1508933739 learned_addr learned my addr 172.21.15.132:0/1508933739 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:57.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd48894d640 1 --2- 172.21.15.132:0/1508933739 >> v2:172.21.15.132:3300/0 conn(0x7fd4840a9b40 0x7fd4840c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd483fff640 1 --2- 172.21.15.132:0/1508933739 >> v2:172.21.15.161:3300/0 conn(0x7fd484155490 0x7fd4840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd4837fe640 1 -- 172.21.15.132:0/1508933739 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630190611 0 0) 0x7fd4840c06c0 con 0x7fd4840c1500 2023-11-18T20:40:57.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd4837fe640 1 -- 172.21.15.132:0/1508933739 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd470005730 con 0x7fd4840c1500 2023-11-18T20:40:57.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd48894d640 1 -- 172.21.15.132:0/1508933739 >> v2:172.21.15.161:3300/0 conn(0x7fd484155490 msgr2=0x7fd4840a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:57.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd48894d640 1 --2- 172.21.15.132:0/1508933739 >> v2:172.21.15.161:3300/0 conn(0x7fd484155490 0x7fd4840a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd48894d640 1 -- 172.21.15.132:0/1508933739 >> v1:172.21.15.132:6789/0 conn(0x7fd4840c1500 legacy=0x7fd4840a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd48894d640 1 -- 172.21.15.132:0/1508933739 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4840c0910 con 0x7fd4840a9b40 2023-11-18T20:40:57.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.020+0000 7fd483fff640 1 --2- 172.21.15.132:0/1508933739 >> v2:172.21.15.161:3300/0 conn(0x7fd484155490 0x7fd4840a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:40:57.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.021+0000 7fd48894d640 1 --2- 172.21.15.132:0/1508933739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840a9b40 0x7fd4840c24d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd48406dff0 tx=0x7fd47c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dab709d2e303aa6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd4837fe640 1 -- 172.21.15.132:0/1508933739 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c02cc80 con 0x7fd4840a9b40 2023-11-18T20:40:57.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd4837fe640 1 -- 172.21.15.132:0/1508933739 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c02cde0 con 0x7fd4840a9b40 2023-11-18T20:40:57.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd4837fe640 1 -- 172.21.15.132:0/1508933739 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c034660 con 0x7fd4840a9b40 2023-11-18T20:40:57.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd48a3b0640 1 -- 172.21.15.132:0/1508933739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840a9b40 msgr2=0x7fd4840c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/1508933739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840a9b40 0x7fd4840c24d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd48406dff0 tx=0x7fd47c02bed0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd48a3b0640 1 -- 172.21.15.132:0/1508933739 shutdown_connections 2023-11-18T20:40:57.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/1508933739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840a9b40 0x7fd4840c24d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/1508933739 >> v2:172.21.15.161:3300/0 conn(0x7fd484155490 0x7fd4840a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd48a3b0640 1 -- 172.21.15.132:0/1508933739 >> 172.21.15.132:0/1508933739 conn(0x7fd48406a500 msgr2=0x7fd48406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:57.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.022+0000 7fd48a3b0640 1 -- 172.21.15.132:0/1508933739 shutdown_connections 2023-11-18T20:40:57.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.023+0000 7fd48a3b0640 1 -- 172.21.15.132:0/1508933739 wait complete. 2023-11-18T20:40:57.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.024+0000 7fd48a3b0640 1 Processor -- start 2023-11-18T20:40:57.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.024+0000 7fd48a3b0640 1 -- start start 2023-11-18T20:40:57.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.025+0000 7fd48a3b0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4840c1500 0x7fd4841ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.025+0000 7fd48a3b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd484155490 0x7fd4841eae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.025+0000 7fd48a3b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840714a0 0x7fd4841eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.025+0000 7fd48a3b0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840707b0 con 0x7fd4840714a0 2023-11-18T20:40:57.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.025+0000 7fd48a3b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4841edb20 con 0x7fd484155490 2023-11-18T20:40:57.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.025+0000 7fd48a3b0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840709c0 con 0x7fd4840c1500 2023-11-18T20:40:57.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.025+0000 7fd48894d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840714a0 0x7fd4841eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.025+0000 7fd48894d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840714a0 0x7fd4841eb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42540/0 (socket says 172.21.15.132:42540) 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd48894d640 1 -- 172.21.15.132:0/3379144176 learned_addr learned my addr 172.21.15.132:0/3379144176 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd483fff640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4840c1500 0x7fd4841ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd47bfff640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd484155490 0x7fd4841eae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd48894d640 1 -- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4840c1500 msgr2=0x7fd4841ed200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd48894d640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4840c1500 0x7fd4841ed200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd48894d640 1 -- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd484155490 msgr2=0x7fd4841eae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd48894d640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd484155490 0x7fd4841eae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd48894d640 1 -- 172.21.15.132:0/3379144176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c009a70 con 0x7fd4840714a0 2023-11-18T20:40:57.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd48894d640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840714a0 0x7fd4841eb3d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009e80 tx=0x7fd47c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd4817fa640 1 -- 172.21.15.132:0/3379144176 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c040650 con 0x7fd4840714a0 2023-11-18T20:40:57.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd4817fa640 1 -- 172.21.15.132:0/3379144176 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c0407b0 con 0x7fd4840714a0 2023-11-18T20:40:57.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd4817fa640 1 -- 172.21.15.132:0/3379144176 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c040b60 con 0x7fd4840714a0 2023-11-18T20:40:57.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.026+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd484070ca0 con 0x7fd4840714a0 2023-11-18T20:40:57.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.027+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd484154a70 con 0x7fd4840714a0 2023-11-18T20:40:57.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.028+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd484071160 con 0x7fd4840714a0 2023-11-18T20:40:57.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.029+0000 7fd4817fa640 1 -- 172.21.15.132:0/3379144176 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd47c040cc0 con 0x7fd4840714a0 2023-11-18T20:40:57.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.029+0000 7fd4817fa640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd46406ae40 0x7fd46406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.030+0000 7fd4817fa640 1 -- 172.21.15.132:0/3379144176 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fd47c0ac6d0 con 0x7fd4840714a0 2023-11-18T20:40:57.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.030+0000 7fd483fff640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd46406ae40 0x7fd46406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.032+0000 7fd483fff640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd46406ae40 0x7fd46406d300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd484152280 tx=0x7fd474008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.034+0000 7fd4817fa640 1 -- 172.21.15.132:0/3379144176 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd47c0773a0 con 0x7fd4840714a0 2023-11-18T20:40:57.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.259+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd484068350 con 0x7fd4840714a0 2023-11-18T20:40:57.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.260+0000 7fd4817fa640 1 -- 172.21.15.132:0/3379144176 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6141 (secure 0 0 0) 0x7fd47c009450 con 0x7fd4840714a0 2023-11-18T20:40:57.262 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:57.262 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:15.246098+0000","modified":"2023-11-18T20:40:18.344815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/3392191515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3392191515},{"type":"v1","addr":"172.21.15.132:6835","nonce":3392191515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:30.829157+0000","modified":"2023-11-18T20:40:33.909984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-18T20:40:57.262 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 35 2023-11-18T20:40:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd46406ae40 msgr2=0x7fd46406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd46406ae40 0x7fd46406d300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd484152280 tx=0x7fd474008040 comp rx=0 tx=0).stop 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840714a0 msgr2=0x7fd4841eb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840714a0 0x7fd4841eb3d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009e80 tx=0x7fd47c004a40 comp rx=0 tx=0).stop 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 shutdown_connections 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd46406ae40 0x7fd46406d300 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4840714a0 0x7fd4841eb3d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd484155490 0x7fd4841eae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 --2- 172.21.15.132:0/3379144176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4840c1500 0x7fd4841ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 >> 172.21.15.132:0/3379144176 conn(0x7fd48406a500 msgr2=0x7fd4840aacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 shutdown_connections 2023-11-18T20:40:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.263+0000 7fd48a3b0640 1 -- 172.21.15.132:0/3379144176 wait complete. 2023-11-18T20:40:57.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:40:57.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.497+0000 7fb246890640 1 Processor -- start 2023-11-18T20:40:57.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.498+0000 7fb246890640 1 -- start start 2023-11-18T20:40:57.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.499+0000 7fb246890640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2400c45d0 0x7fb240155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.499+0000 7fb246890640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c3340 0x7fb240156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.499+0000 7fb246890640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2400bfdc0 con 0x7fb2400c5ec0 2023-11-18T20:40:57.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.499+0000 7fb246890640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24006e390 con 0x7fb2400c45d0 2023-11-18T20:40:57.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.499+0000 7fb246890640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24006ddd0 con 0x7fb2400c3340 2023-11-18T20:40:57.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.500+0000 7fb23f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2400c45d0 0x7fb240155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.500+0000 7fb244e2d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c3340 0x7fb240156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.500+0000 7fb23f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2400c45d0 0x7fb240155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:50896/0 (socket says 172.21.15.132:50896) 2023-11-18T20:40:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.500+0000 7fb23f7fe640 1 -- 172.21.15.132:0/3070531306 learned_addr learned my addr 172.21.15.132:0/3070531306 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.501+0000 7fb244e2d640 1 -- 172.21.15.132:0/3070531306 >> v2:172.21.15.161:3300/0 conn(0x7fb2400c45d0 msgr2=0x7fb240155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.501+0000 7fb244e2d640 1 --2- 172.21.15.132:0/3070531306 >> v2:172.21.15.161:3300/0 conn(0x7fb2400c45d0 0x7fb240155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.501+0000 7fb244e2d640 1 -- 172.21.15.132:0/3070531306 >> v1:172.21.15.161:6789/0 conn(0x7fb2400c5ec0 legacy=0x7fb2400c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.501+0000 7fb244e2d640 1 -- 172.21.15.132:0/3070531306 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24006e0b0 con 0x7fb2400c3340 2023-11-18T20:40:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.502+0000 7fb244e2d640 1 --2- 172.21.15.132:0/3070531306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c3340 0x7fb240156370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2380097d0 tx=0x7fb23802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422e2cdac24e1124 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.502+0000 7fb23effd640 1 -- 172.21.15.132:0/3070531306 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2380316f0 con 0x7fb2400c3340 2023-11-18T20:40:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb23effd640 1 -- 172.21.15.132:0/3070531306 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238031850 con 0x7fb2400c3340 2023-11-18T20:40:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb23effd640 1 -- 172.21.15.132:0/3070531306 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238031be0 con 0x7fb2400c3340 2023-11-18T20:40:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb246890640 1 -- 172.21.15.132:0/3070531306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c3340 msgr2=0x7fb240156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb246890640 1 --2- 172.21.15.132:0/3070531306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c3340 0x7fb240156370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2380097d0 tx=0x7fb23802b790 comp rx=0 tx=0).stop 2023-11-18T20:40:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb246890640 1 -- 172.21.15.132:0/3070531306 shutdown_connections 2023-11-18T20:40:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb246890640 1 --2- 172.21.15.132:0/3070531306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c3340 0x7fb240156370 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb246890640 1 --2- 172.21.15.132:0/3070531306 >> v2:172.21.15.161:3300/0 conn(0x7fb2400c45d0 0x7fb240155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb246890640 1 -- 172.21.15.132:0/3070531306 >> 172.21.15.132:0/3070531306 conn(0x7fb24006a500 msgr2=0x7fb24006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb246890640 1 -- 172.21.15.132:0/3070531306 shutdown_connections 2023-11-18T20:40:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.503+0000 7fb246890640 1 -- 172.21.15.132:0/3070531306 wait complete. 2023-11-18T20:40:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.505+0000 7fb246890640 1 Processor -- start 2023-11-18T20:40:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.505+0000 7fb246890640 1 -- start start 2023-11-18T20:40:57.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.506+0000 7fb246890640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2400c3340 0x7fb240155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.506+0000 7fb246890640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c45d0 0x7fb240158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.506+0000 7fb246890640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c5ec0 0x7fb240150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.506+0000 7fb246890640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240156ec0 con 0x7fb2400c5ec0 2023-11-18T20:40:57.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.506+0000 7fb246890640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400a8670 con 0x7fb2400c3340 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.506+0000 7fb246890640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb240158cb0 con 0x7fb2400c45d0 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.506+0000 7fb244e2d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c5ec0 0x7fb240150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.506+0000 7fb244e2d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c5ec0 0x7fb240150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42544/0 (socket says 172.21.15.132:42544) 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb244e2d640 1 -- 172.21.15.132:0/3630065584 learned_addr learned my addr 172.21.15.132:0/3630065584 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb23ffff640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2400c3340 0x7fb240155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb23f7fe640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c45d0 0x7fb240158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb244e2d640 1 -- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c45d0 msgr2=0x7fb240158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb244e2d640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c45d0 0x7fb240158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb244e2d640 1 -- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2400c3340 msgr2=0x7fb240155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb244e2d640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2400c3340 0x7fb240155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb244e2d640 1 -- 172.21.15.132:0/3630065584 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238009400 con 0x7fb2400c5ec0 2023-11-18T20:40:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.507+0000 7fb244e2d640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c5ec0 0x7fb240150480 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb2380098f0 tx=0x7fb2380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.508+0000 7fb23cff9640 1 -- 172.21.15.132:0/3630065584 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238034680 con 0x7fb2400c5ec0 2023-11-18T20:40:57.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.508+0000 7fb23cff9640 1 -- 172.21.15.132:0/3630065584 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238034800 con 0x7fb2400c5ec0 2023-11-18T20:40:57.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.508+0000 7fb23cff9640 1 -- 172.21.15.132:0/3630065584 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238034bb0 con 0x7fb2400c5ec0 2023-11-18T20:40:57.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.508+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2400a8bf0 con 0x7fb2400c5ec0 2023-11-18T20:40:57.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.508+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2400a82a0 con 0x7fb2400c5ec0 2023-11-18T20:40:57.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.509+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2400a8d80 con 0x7fb2400c5ec0 2023-11-18T20:40:57.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.510+0000 7fb23cff9640 1 -- 172.21.15.132:0/3630065584 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb23803b040 con 0x7fb2400c5ec0 2023-11-18T20:40:57.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.511+0000 7fb23cff9640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb22006ae40 0x7fb22006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.511+0000 7fb23cff9640 1 -- 172.21.15.132:0/3630065584 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fb2380aaf10 con 0x7fb2400c5ec0 2023-11-18T20:40:57.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.511+0000 7fb23ffff640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb22006ae40 0x7fb22006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.513+0000 7fb23ffff640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb22006ae40 0x7fb22006d300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb2300012e0 tx=0x7fb230009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.515+0000 7fb23cff9640 1 -- 172.21.15.132:0/3630065584 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb238075be0 con 0x7fb2400c5ec0 2023-11-18T20:40:57.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.707+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb240068350 con 0x7fb2400c5ec0 2023-11-18T20:40:57.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.710+0000 7fb23cff9640 1 -- 172.21.15.132:0/3630065584 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20447 (secure 0 0 0) 0x7fb238079200 con 0x7fb2400c5ec0 2023-11-18T20:40:57.712 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:40:57.712 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":61,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:40:47.525645+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:40:13.573413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-18T20:40:14.279671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":4}]},{"pgid":"9.3b","mappings":[{"from":6,"to":1}]},{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.29","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:40:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb22006ae40 msgr2=0x7fb22006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb22006ae40 0x7fb22006d300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb2300012e0 tx=0x7fb230009040 comp rx=0 tx=0).stop 2023-11-18T20:40:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c5ec0 msgr2=0x7fb240150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c5ec0 0x7fb240150480 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb2380098f0 tx=0x7fb2380046c0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 shutdown_connections 2023-11-18T20:40:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb22006ae40 0x7fb22006d300 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c5ec0 0x7fb240150480 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2400c45d0 0x7fb240158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 --2- 172.21.15.132:0/3630065584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2400c3340 0x7fb240155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.713+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 >> 172.21.15.132:0/3630065584 conn(0x7fb24006a500 msgr2=0x7fb2400c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:57.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.714+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 shutdown_connections 2023-11-18T20:40:57.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.714+0000 7fb246890640 1 -- 172.21.15.132:0/3630065584 wait complete. 2023-11-18T20:40:57.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-18T20:40:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.953+0000 7f1f35301640 1 Processor -- start 2023-11-18T20:40:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.953+0000 7f1f35301640 1 -- start start 2023-11-18T20:40:57.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.954+0000 7f1f35301640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f3006d0a0 0x7f1f30152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.954+0000 7f1f35301640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f300c3ea0 0x7f1f300c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.954+0000 7f1f35301640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f300c64a0 con 0x7f1f3014fd30 2023-11-18T20:40:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.954+0000 7f1f35301640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f300c5c00 con 0x7f1f3006d0a0 2023-11-18T20:40:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.954+0000 7f1f35301640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300c5ee0 con 0x7f1f300c3ea0 2023-11-18T20:40:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.955+0000 7f1f2effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1f3014fd30 0x7f1f300a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56852/0 (socket says 172.21.15.132:56852) 2023-11-18T20:40:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.955+0000 7f1f2effd640 1 -- 172.21.15.132:0/2143214342 learned_addr learned my addr 172.21.15.132:0/2143214342 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:57.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.955+0000 7f1f27fff640 1 --2- 172.21.15.132:0/2143214342 >> v2:172.21.15.161:3300/0 conn(0x7f1f3006d0a0 0x7f1f30152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.955+0000 7f1f2f7fe640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f300c3ea0 0x7f1f300c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.955+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595323694 0 0) 0x7f1f300c64a0 con 0x7f1f3014fd30 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.955+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f1c003520 con 0x7f1f3014fd30 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686119247 0 0) 0x7f1f1c003520 con 0x7f1f3014fd30 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f300c3ea0 msgr2=0x7f1f300c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f300c3ea0 0x7f1f300c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 >> v2:172.21.15.161:3300/0 conn(0x7f1f3006d0a0 msgr2=0x7f1f30152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 --2- 172.21.15.132:0/2143214342 >> v2:172.21.15.161:3300/0 conn(0x7f1f3006d0a0 0x7f1f30152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300c61c0 con 0x7f1f3014fd30 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f1f20001670 con 0x7f1f3014fd30 2023-11-18T20:40:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 >> v1:172.21.15.132:6789/0 conn(0x7f1f3014fd30 legacy=0x7f1f300a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f1c003970 0x7f1f1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c0047c0 0x7f1f1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f300c3ea0 0x7f1f1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300c5c00 con 0x7f1f1c003970 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300c5ee0 con 0x7f1f1c0047c0 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c00b980 con 0x7f1f300c3ea0 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2effd640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f1c003970 0x7f1f1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f27fff640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c0047c0 0x7f1f1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2effd640 1 -- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f300c3ea0 msgr2=0x7f1f1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2effd640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f300c3ea0 0x7f1f1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2effd640 1 -- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c0047c0 msgr2=0x7f1f1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2effd640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c0047c0 0x7f1f1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.956+0000 7f1f2effd640 1 -- 172.21.15.132:0/2143214342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c003520 con 0x7f1f1c003970 2023-11-18T20:40:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.957+0000 7f1f27fff640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c0047c0 0x7f1f1c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.958+0000 7f1f2effd640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f1c003970 0x7f1f1c003d90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c160 tx=0x7f1f1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdc809a238e0375 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.958+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20005ad0 con 0x7f1f1c003970 2023-11-18T20:40:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.958+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20005c30 con 0x7f1f1c003970 2023-11-18T20:40:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.958+0000 7f1f2e7fc640 1 -- 172.21.15.132:0/2143214342 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2002c830 con 0x7f1f1c003970 2023-11-18T20:40:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.958+0000 7f1f35301640 1 -- 172.21.15.132:0/2143214342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f1c003970 msgr2=0x7f1f1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.958+0000 7f1f35301640 1 --2- 172.21.15.132:0/2143214342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f1c003970 0x7f1f1c003d90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c160 tx=0x7f1f1c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.958+0000 7f1f2f7fe640 1 -- 172.21.15.132:0/2143214342 reap_dead start 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.959+0000 7f1f35301640 1 -- 172.21.15.132:0/2143214342 shutdown_connections 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.959+0000 7f1f35301640 1 -- 172.21.15.132:0/2143214342 >> 172.21.15.132:0/2143214342 conn(0x7f1f3006a500 msgr2=0x7f1f3006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.959+0000 7f1f35301640 1 -- 172.21.15.132:0/2143214342 shutdown_connections 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.959+0000 7f1f35301640 1 -- 172.21.15.132:0/2143214342 wait complete. 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.960+0000 7f1f35301640 1 Processor -- start 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.960+0000 7f1f35301640 1 -- start start 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.961+0000 7f1f35301640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c003970 0x7f1f301ddc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.961+0000 7f1f35301640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f3014ee30 0x7f1f301eb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.961+0000 7f1f35301640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f30070aa0 0x7f1f3014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.961+0000 7f1f35301640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f301dd420 con 0x7f1f30070aa0 2023-11-18T20:40:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.961+0000 7f1f35301640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f301dd950 con 0x7f1f1c003970 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.961+0000 7f1f35301640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f301de150 con 0x7f1f3014ee30 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f30070aa0 0x7f1f3014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f30070aa0 0x7f1f3014ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42562/0 (socket says 172.21.15.132:42562) 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2f7fe640 1 -- 172.21.15.132:0/4098935312 learned_addr learned my addr 172.21.15.132:0/4098935312 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f27fff640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f3014ee30 0x7f1f301eb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2effd640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c003970 0x7f1f301ddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2f7fe640 1 -- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f3014ee30 msgr2=0x7f1f301eb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2f7fe640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f3014ee30 0x7f1f301eb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2f7fe640 1 -- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c003970 msgr2=0x7f1f301ddc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2f7fe640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c003970 0x7f1f301ddc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.962+0000 7f1f2f7fe640 1 -- 172.21.15.132:0/4098935312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f301ebf30 con 0x7f1f30070aa0 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.963+0000 7f1f2f7fe640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f30070aa0 0x7f1f3014ddd0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1f300c3860 tx=0x7f1f2800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.963+0000 7f1f277fe640 1 -- 172.21.15.132:0/4098935312 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28010040 con 0x7f1f30070aa0 2023-11-18T20:40:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.963+0000 7f1f277fe640 1 -- 172.21.15.132:0/4098935312 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2800bae0 con 0x7f1f30070aa0 2023-11-18T20:40:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.963+0000 7f1f277fe640 1 -- 172.21.15.132:0/4098935312 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2800be70 con 0x7f1f30070aa0 2023-11-18T20:40:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.963+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f301dd670 con 0x7f1f30070aa0 2023-11-18T20:40:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.963+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f301eb4d0 con 0x7f1f30070aa0 2023-11-18T20:40:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.964+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f30068350 con 0x7f1f30070aa0 2023-11-18T20:40:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.965+0000 7f1f277fe640 1 -- 172.21.15.132:0/4098935312 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f2801d400 con 0x7f1f30070aa0 2023-11-18T20:40:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.966+0000 7f1f277fe640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f1006ae40 0x7f1f1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.966+0000 7f1f277fe640 1 -- 172.21.15.132:0/4098935312 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f1f2808a0e0 con 0x7f1f30070aa0 2023-11-18T20:40:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.967+0000 7f1f2effd640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f1006ae40 0x7f1f1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.968+0000 7f1f2effd640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f1006ae40 0x7f1f1006d300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f20001050 tx=0x7f1f20007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:57.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:57.970+0000 7f1f277fe640 1 -- 172.21.15.132:0/4098935312 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f28054db0 con 0x7f1f30070aa0 2023-11-18T20:40:58.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.197+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1f300c66d0 con 0x7f1f30070aa0 2023-11-18T20:40:58.199 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-11-18T20:40:58.198+0000 7feee5f07640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-18T20:40:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.201+0000 7f1f277fe640 1 -- 172.21.15.132:0/4098935312 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1f280583d0 con 0x7f1f30070aa0 2023-11-18T20:40:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T20:40:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f1006ae40 msgr2=0x7f1f1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f1006ae40 0x7f1f1006d300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f20001050 tx=0x7f1f20007000 comp rx=0 tx=0).stop 2023-11-18T20:40:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f30070aa0 msgr2=0x7f1f3014ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f30070aa0 0x7f1f3014ddd0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1f300c3860 tx=0x7f1f2800b480 comp rx=0 tx=0).stop 2023-11-18T20:40:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 shutdown_connections 2023-11-18T20:40:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f1006ae40 0x7f1f1006d300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f30070aa0 0x7f1f3014ddd0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f3014ee30 0x7f1f301eb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 --2- 172.21.15.132:0/4098935312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1c003970 0x7f1f301ddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 >> 172.21.15.132:0/4098935312 conn(0x7f1f3006a500 msgr2=0x7f1f300a5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.205+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 shutdown_connections 2023-11-18T20:40:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.206+0000 7f1f35301640 1 -- 172.21.15.132:0/4098935312 wait complete. 2023-11-18T20:40:58.218 INFO:tasks.ceph.mds.c.smithi132.stderr: -2895> 2023-11-18T20:40:21.774+0000 7fd8f0dfa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:40:58.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-18T20:40:58.286 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-11-18T20:40:58.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.414+0000 7f57bbdcc640 1 Processor -- start 2023-11-18T20:40:58.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.414+0000 7f57bbdcc640 1 -- start start 2023-11-18T20:40:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.416+0000 7f57bbdcc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b40c3bc0 0x7f57b4154500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.416+0000 7f57bbdcc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b40aadc0 con 0x7f57b40a5240 2023-11-18T20:40:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.416+0000 7f57bbdcc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b40c4170 con 0x7f57b40724f0 2023-11-18T20:40:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.416+0000 7f57bbdcc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b4151be0 con 0x7f57b40c3bc0 2023-11-18T20:40:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.416+0000 7f57b9b68640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f57b40a5240 0x7f57b40c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56872/0 (socket says 172.21.15.132:56872) 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.416+0000 7f57b9b68640 1 -- 172.21.15.132:0/2563827648 learned_addr learned my addr 172.21.15.132:0/2563827648 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.416+0000 7f57b9367640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b40c3bc0 0x7f57b4154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839787891 0 0) 0x7f57b40aadc0 con 0x7f57b40a5240 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a0003520 con 0x7f57b40a5240 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559381150 0 0) 0x7f57a0003520 con 0x7f57b40a5240 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b40c3bc0 msgr2=0x7f57b4154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b40c3bc0 0x7f57b4154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 >> v1:172.21.15.161:6789/0 conn(0x7f57b40724f0 legacy=0x7f57b4154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40c4450 con 0x7f57b40a5240 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f57b0001670 con 0x7f57b40a5240 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 >> v1:172.21.15.132:6789/0 conn(0x7f57b40a5240 legacy=0x7f57b40c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b40c3bc0 0x7f57a00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a0003f20 0x7f57a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57a0004d00 0x7f57a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a000bb10 con 0x7f57a0003f20 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a000bc50 con 0x7f57a0004d00 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.417+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a000be10 con 0x7f57b40c3bc0 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57b9367640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a0003f20 0x7f57a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57b9b68640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b40c3bc0 0x7f57a00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57ba369640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57a0004d00 0x7f57a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57b9367640 1 -- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b40c3bc0 msgr2=0x7f57a00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57b9367640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b40c3bc0 0x7f57a00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57b9367640 1 -- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57a0004d00 msgr2=0x7f57a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57b9367640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57a0004d00 0x7f57a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57b9367640 1 -- 172.21.15.132:0/2563827648 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0003520 con 0x7f57a0003f20 2023-11-18T20:40:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.418+0000 7f57ba369640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57a0004d00 0x7f57a0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:40:58.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.419+0000 7f57b9367640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a0003f20 0x7f57a00047c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f57a400aac0 tx=0x7f57a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0934e8cebf4716 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:58.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.419+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4034600 con 0x7f57a0003f20 2023-11-18T20:40:58.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.419+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4030050 con 0x7f57a0003f20 2023-11-18T20:40:58.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.419+0000 7f57b8b66640 1 -- 172.21.15.132:0/2563827648 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4034980 con 0x7f57a0003f20 2023-11-18T20:40:58.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.420+0000 7f57bbdcc640 1 -- 172.21.15.132:0/2563827648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a0003f20 msgr2=0x7f57a00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:58.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.420+0000 7f57bbdcc640 1 --2- 172.21.15.132:0/2563827648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a0003f20 0x7f57a00047c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f57a400aac0 tx=0x7f57a00057f0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.420+0000 7f57ba369640 1 -- 172.21.15.132:0/2563827648 reap_dead start 2023-11-18T20:40:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.420+0000 7f57bbdcc640 1 -- 172.21.15.132:0/2563827648 shutdown_connections 2023-11-18T20:40:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.420+0000 7f57bbdcc640 1 -- 172.21.15.132:0/2563827648 >> 172.21.15.132:0/2563827648 conn(0x7f57b406a500 msgr2=0x7f57b406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.420+0000 7f57bbdcc640 1 -- 172.21.15.132:0/2563827648 shutdown_connections 2023-11-18T20:40:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.420+0000 7f57bbdcc640 1 -- 172.21.15.132:0/2563827648 wait complete. 2023-11-18T20:40:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.422+0000 7f57bbdcc640 1 Processor -- start 2023-11-18T20:40:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.422+0000 7f57bbdcc640 1 -- start start 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57bbdcc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57a0003f20 0x7f57b41eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57bbdcc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b40a4300 0x7f57b41da630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57bbdcc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57b41dab70 0x7f57b4150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57bbdcc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41da150 con 0x7f57b41dab70 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57bbdcc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41edf50 con 0x7f57b40a4300 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57bbdcc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b4070f70 con 0x7f57a0003f20 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57ba369640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57b41dab70 0x7f57b4150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57ba369640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57b41dab70 0x7f57b4150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42606/0 (socket says 172.21.15.132:42606) 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.423+0000 7f57ba369640 1 -- 172.21.15.132:0/3191036799 learned_addr learned my addr 172.21.15.132:0/3191036799 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57b9b68640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57a0003f20 0x7f57b41eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57ba369640 1 -- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57a0003f20 msgr2=0x7f57b41eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57b9367640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b40a4300 0x7f57b41da630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57ba369640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57a0003f20 0x7f57b41eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57ba369640 1 -- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b40a4300 msgr2=0x7f57b41da630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57ba369640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b40a4300 0x7f57b41da630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57ba369640 1 -- 172.21.15.132:0/3191036799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4071230 con 0x7f57b41dab70 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57ba369640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57b41dab70 0x7f57b4150eb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f57b40c3360 tx=0x7f57ac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57aa7fc640 1 -- 172.21.15.132:0/3191036799 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac006d50 con 0x7f57b41dab70 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57aa7fc640 1 -- 172.21.15.132:0/3191036799 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac003970 con 0x7f57b41dab70 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57aa7fc640 1 -- 172.21.15.132:0/3191036799 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac003d60 con 0x7f57b41dab70 2023-11-18T20:40:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b4071510 con 0x7f57b41dab70 2023-11-18T20:40:58.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.424+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b40a4780 con 0x7f57b41dab70 2023-11-18T20:40:58.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.425+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b40a4910 con 0x7f57b41dab70 2023-11-18T20:40:58.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.426+0000 7f57aa7fc640 1 -- 172.21.15.132:0/3191036799 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57ac005070 con 0x7f57b41dab70 2023-11-18T20:40:58.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.427+0000 7f57aa7fc640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f579806ae70 0x7f579806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:58.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.427+0000 7f57aa7fc640 1 -- 172.21.15.132:0/3191036799 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6767+0+0 (secure 0 0 0) 0x7f57ac089930 con 0x7f57b41dab70 2023-11-18T20:40:58.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.428+0000 7f57b9b68640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f579806ae70 0x7f579806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:58.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.429+0000 7f57b9b68640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f579806ae70 0x7f579806d330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f57b0001050 tx=0x7f57b0001d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.432+0000 7f57aa7fc640 1 -- 172.21.15.132:0/3191036799 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f57ac0545b0 con 0x7f57b41dab70 2023-11-18T20:40:58.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:58.651+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f57b4068350 con 0x7f57b41dab70 2023-11-18T20:40:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.205+0000 7f57aa7fc640 1 -- 172.21.15.132:0/3191036799 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f57ac057bd0 con 0x7f57b41dab70 2023-11-18T20:40:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f579806ae70 msgr2=0x7f579806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f579806ae70 0x7f579806d330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f57b0001050 tx=0x7f57b0001d30 comp rx=0 tx=0).stop 2023-11-18T20:40:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57b41dab70 msgr2=0x7f57b4150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57b41dab70 0x7f57b4150eb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f57b40c3360 tx=0x7f57ac00dc00 comp rx=0 tx=0).stop 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 shutdown_connections 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f579806ae70 0x7f579806d330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57b41dab70 0x7f57b4150eb0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b40a4300 0x7f57b41da630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 --2- 172.21.15.132:0/3191036799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57a0003f20 0x7f57b41eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 >> 172.21.15.132:0/3191036799 conn(0x7f57b406a500 msgr2=0x7f57b40c2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 shutdown_connections 2023-11-18T20:40:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.209+0000 7f57bbdcc640 1 -- 172.21.15.132:0/3191036799 wait complete. 2023-11-18T20:40:59.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-18T20:40:59.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.428+0000 7ff8883ce640 1 Processor -- start 2023-11-18T20:40:59.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.429+0000 7ff8883ce640 1 -- start start 2023-11-18T20:40:59.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.430+0000 7ff8883ce640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8800aaa90 0x7ff8800aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:59.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.430+0000 7ff8883ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8800c49b0 0x7ff8800c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:59.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.430+0000 7ff8883ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8800a96b0 con 0x7ff8800c24c0 2023-11-18T20:40:59.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.430+0000 7ff8883ce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8800c1ed0 con 0x7ff8800c49b0 2023-11-18T20:40:59.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.430+0000 7ff8883ce640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8800c32c0 con 0x7ff8800aaa90 2023-11-18T20:40:59.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.430+0000 7ff885969640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff8800c24c0 0x7ff8800c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45698/0 (socket says 172.21.15.132:45698) 2023-11-18T20:40:59.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.430+0000 7ff885969640 1 -- 172.21.15.132:0/1514335935 learned_addr learned my addr 172.21.15.132:0/1514335935 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:40:59.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.430+0000 7ff88696b640 1 --2- 172.21.15.132:0/1514335935 >> v2:172.21.15.132:3300/0 conn(0x7ff8800c49b0 0x7ff8800c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:59.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.431+0000 7ff88616a640 1 --2- 172.21.15.132:0/1514335935 >> v2:172.21.15.161:3300/0 conn(0x7ff8800aaa90 0x7ff8800aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:59.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.431+0000 7ff885168640 1 -- 172.21.15.132:0/1514335935 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152101474 0 0) 0x7ff8800a96b0 con 0x7ff8800c24c0 2023-11-18T20:40:59.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.431+0000 7ff88696b640 1 -- 172.21.15.132:0/1514335935 >> v2:172.21.15.161:3300/0 conn(0x7ff8800aaa90 msgr2=0x7ff8800aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:40:59.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.431+0000 7ff88696b640 1 --2- 172.21.15.132:0/1514335935 >> v2:172.21.15.161:3300/0 conn(0x7ff8800aaa90 0x7ff8800aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.431+0000 7ff88696b640 1 -- 172.21.15.132:0/1514335935 >> v1:172.21.15.132:6789/0 conn(0x7ff8800c24c0 legacy=0x7ff8800c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:59.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.431+0000 7ff88696b640 1 -- 172.21.15.132:0/1514335935 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8800c4d90 con 0x7ff8800c49b0 2023-11-18T20:40:59.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.432+0000 7ff88696b640 1 --2- 172.21.15.132:0/1514335935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800c49b0 0x7ff8800c2950 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff880072ce0 tx=0x7ff87802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4170167b45e8ba46 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:59.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.432+0000 7ff885168640 1 -- 172.21.15.132:0/1514335935 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87802e070 con 0x7ff8800c49b0 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.432+0000 7ff885168640 1 -- 172.21.15.132:0/1514335935 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8780315a0 con 0x7ff8800c49b0 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.432+0000 7ff885168640 1 -- 172.21.15.132:0/1514335935 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878031930 con 0x7ff8800c49b0 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.433+0000 7ff8883ce640 1 -- 172.21.15.132:0/1514335935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800c49b0 msgr2=0x7ff8800c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.433+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1514335935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800c49b0 0x7ff8800c2950 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff880072ce0 tx=0x7ff87802b840 comp rx=0 tx=0).stop 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.433+0000 7ff8883ce640 1 -- 172.21.15.132:0/1514335935 shutdown_connections 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.433+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1514335935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800c49b0 0x7ff8800c2950 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.433+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1514335935 >> v2:172.21.15.161:3300/0 conn(0x7ff8800aaa90 0x7ff8800aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.433+0000 7ff8883ce640 1 -- 172.21.15.132:0/1514335935 >> 172.21.15.132:0/1514335935 conn(0x7ff8800c5d30 msgr2=0x7ff8800c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.433+0000 7ff8883ce640 1 -- 172.21.15.132:0/1514335935 shutdown_connections 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.433+0000 7ff8883ce640 1 -- 172.21.15.132:0/1514335935 wait complete. 2023-11-18T20:40:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.435+0000 7ff8883ce640 1 Processor -- start 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.435+0000 7ff8883ce640 1 -- start start 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff8883ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800aaa90 0x7ff88006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff8883ce640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8800c24c0 0x7ff8801d6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff8883ce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8800c49b0 0x7ff8801e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff8883ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8801ee090 con 0x7ff8800aaa90 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff8883ce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8801dfd60 con 0x7ff8800c49b0 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff8883ce640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88006c200 con 0x7ff8800c24c0 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff88616a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800aaa90 0x7ff88006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff88616a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800aaa90 0x7ff88006dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59506/0 (socket says 172.21.15.132:59506) 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff88616a640 1 -- 172.21.15.132:0/1692119704 learned_addr learned my addr 172.21.15.132:0/1692119704 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff88616a640 1 -- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8800c24c0 msgr2=0x7ff8801d6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff88616a640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8800c24c0 0x7ff8801d6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff88616a640 1 -- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8800c49b0 msgr2=0x7ff8801e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff88616a640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8800c49b0 0x7ff8801e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.436+0000 7ff88616a640 1 -- 172.21.15.132:0/1692119704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878009400 con 0x7ff8800aaa90 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.437+0000 7ff88616a640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800aaa90 0x7ff88006dda0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff870007ef0 tx=0x7ff87000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.437+0000 7ff87effd640 1 -- 172.21.15.132:0/1692119704 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870014620 con 0x7ff8800aaa90 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.437+0000 7ff87effd640 1 -- 172.21.15.132:0/1692119704 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff870014780 con 0x7ff8800aaa90 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.437+0000 7ff87effd640 1 -- 172.21.15.132:0/1692119704 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870014b30 con 0x7ff8800aaa90 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.437+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8801eddb0 con 0x7ff8800aaa90 2023-11-18T20:40:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.437+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8801db980 con 0x7ff8800aaa90 2023-11-18T20:40:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.438+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8801db500 con 0x7ff8800aaa90 2023-11-18T20:40:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.439+0000 7ff87effd640 1 -- 172.21.15.132:0/1692119704 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff870014c90 con 0x7ff8800aaa90 2023-11-18T20:40:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.440+0000 7ff87effd640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff86c06ae40 0x7ff86c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:40:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.440+0000 7ff87effd640 1 -- 172.21.15.132:0/1692119704 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6767+0+0 (secure 0 0 0) 0x7ff87008a440 con 0x7ff8800aaa90 2023-11-18T20:40:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.441+0000 7ff885969640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff86c06ae40 0x7ff86c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:40:59.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.442+0000 7ff885969640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff86c06ae40 0x7ff86c06d300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff874007fd0 tx=0x7ff874007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:40:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.445+0000 7ff87effd640 1 -- 172.21.15.132:0/1692119704 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8801db500 con 0x7ff8800aaa90 2023-11-18T20:40:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:40:59.636+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8801db500 con 0x7ff8800aaa90 2023-11-18T20:41:00.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.407+0000 7ff87effd640 1 -- 172.21.15.132:0/1692119704 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff8801db500 con 0x7ff8800aaa90 2023-11-18T20:41:00.409 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-11-18T20:41:00.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff86c06ae40 msgr2=0x7ff86c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:00.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff86c06ae40 0x7ff86c06d300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff874007fd0 tx=0x7ff874007920 comp rx=0 tx=0).stop 2023-11-18T20:41:00.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800aaa90 msgr2=0x7ff88006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:00.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800aaa90 0x7ff88006dda0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff870007ef0 tx=0x7ff87000e4b0 comp rx=0 tx=0).stop 2023-11-18T20:41:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 shutdown_connections 2023-11-18T20:41:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff86c06ae40 0x7ff86c06d300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8800c49b0 0x7ff8801e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8800c24c0 0x7ff8801d6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 --2- 172.21.15.132:0/1692119704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8800aaa90 0x7ff88006dda0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 >> 172.21.15.132:0/1692119704 conn(0x7ff8800c5d30 msgr2=0x7ff8800a87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 shutdown_connections 2023-11-18T20:41:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.411+0000 7ff8883ce640 1 -- 172.21.15.132:0/1692119704 wait complete. 2023-11-18T20:41:00.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-18T20:41:00.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.660+0000 7f816ed41640 1 Processor -- start 2023-11-18T20:41:00.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.661+0000 7f816ed41640 1 -- start start 2023-11-18T20:41:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816ed41640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8168071f70 0x7f81680c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816ed41640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81680c0980 con 0x7f816814fa80 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816ed41640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f816806c070 con 0x7f8168072530 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816ed41640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816806d160 con 0x7f8168071f70 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816cadd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f816814fa80 0x7f816806d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45714/0 (socket says 172.21.15.132:45714) 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816cadd640 1 -- 172.21.15.132:0/2661247312 learned_addr learned my addr 172.21.15.132:0/2661247312 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816d2de640 1 --2- 172.21.15.132:0/2661247312 >> v2:172.21.15.132:3300/0 conn(0x7f8168071f70 0x7f81680c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f81677fe640 1 -- 172.21.15.132:0/2661247312 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379278615 0 0) 0x7f81680c0980 con 0x7f816814fa80 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f81677fe640 1 -- 172.21.15.132:0/2661247312 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8158003520 con 0x7f816814fa80 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816d2de640 1 -- 172.21.15.132:0/2661247312 >> v1:172.21.15.161:6789/0 conn(0x7f8168072530 legacy=0x7f81680c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816d2de640 1 -- 172.21.15.132:0/2661247312 >> v1:172.21.15.132:6789/0 conn(0x7f816814fa80 legacy=0x7f816806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.662+0000 7f816d2de640 1 -- 172.21.15.132:0/2661247312 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680c20d0 con 0x7f8168071f70 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f816d2de640 1 --2- 172.21.15.132:0/2661247312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168071f70 0x7f81680c2610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8160009d90 tx=0x7f816002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37553c321c71b882 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f81677fe640 1 -- 172.21.15.132:0/2661247312 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816002cbd0 con 0x7f8168071f70 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f81677fe640 1 -- 172.21.15.132:0/2661247312 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816002cd30 con 0x7f8168071f70 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f81677fe640 1 -- 172.21.15.132:0/2661247312 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816002cea0 con 0x7f8168071f70 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f816ed41640 1 -- 172.21.15.132:0/2661247312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168071f70 msgr2=0x7f81680c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f816ed41640 1 --2- 172.21.15.132:0/2661247312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168071f70 0x7f81680c2610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8160009d90 tx=0x7f816002be20 comp rx=0 tx=0).stop 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f816ed41640 1 -- 172.21.15.132:0/2661247312 shutdown_connections 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f816ed41640 1 --2- 172.21.15.132:0/2661247312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168071f70 0x7f81680c2610 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.664+0000 7f816ed41640 1 -- 172.21.15.132:0/2661247312 >> 172.21.15.132:0/2661247312 conn(0x7f81680c5bc0 msgr2=0x7f81680c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.665+0000 7f816ed41640 1 -- 172.21.15.132:0/2661247312 shutdown_connections 2023-11-18T20:41:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.665+0000 7f816ed41640 1 -- 172.21.15.132:0/2661247312 wait complete. 2023-11-18T20:41:00.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.666+0000 7f816ed41640 1 Processor -- start 2023-11-18T20:41:00.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.666+0000 7f816ed41640 1 -- start start 2023-11-18T20:41:00.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.667+0000 7f816ed41640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8168071f70 0x7f8168152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:00.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.667+0000 7f816ed41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168072530 0x7f8168151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:00.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.667+0000 7f816ed41640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f816814fa80 0x7f8168071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:00.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.667+0000 7f816ed41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81681eaa30 con 0x7f8168072530 2023-11-18T20:41:00.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.667+0000 7f816ed41640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81681ea500 con 0x7f8168071f70 2023-11-18T20:41:00.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.667+0000 7f816ed41640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81681559f0 con 0x7f816814fa80 2023-11-18T20:41:00.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.667+0000 7f8167fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168072530 0x7f8168151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:00.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f8167fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168072530 0x7f8168151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59532/0 (socket says 172.21.15.132:59532) 2023-11-18T20:41:00.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f8167fff640 1 -- 172.21.15.132:0/146829684 learned_addr learned my addr 172.21.15.132:0/146829684 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:00.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f8167fff640 1 -- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f816814fa80 msgr2=0x7f8168071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:00.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f8167fff640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f816814fa80 0x7f8168071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:00.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f8167fff640 1 -- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8168071f70 msgr2=0x7f8168152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:00.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f8167fff640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8168071f70 0x7f8168152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f8167fff640 1 -- 172.21.15.132:0/146829684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160009a70 con 0x7f8168072530 2023-11-18T20:41:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f8167fff640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168072530 0x7f8168151490 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f815400c440 tx=0x7f815400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f81657fa640 1 -- 172.21.15.132:0/146829684 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540035f0 con 0x7f8168072530 2023-11-18T20:41:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f81657fa640 1 -- 172.21.15.132:0/146829684 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8154003770 con 0x7f8168072530 2023-11-18T20:41:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f81657fa640 1 -- 172.21.15.132:0/146829684 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8154003b20 con 0x7f8168072530 2023-11-18T20:41:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.668+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81681ea750 con 0x7f8168072530 2023-11-18T20:41:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.669+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81681519d0 con 0x7f8168072530 2023-11-18T20:41:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.670+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81681554e0 con 0x7f8168072530 2023-11-18T20:41:00.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.671+0000 7f81657fa640 1 -- 172.21.15.132:0/146829684 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8154003c80 con 0x7f8168072530 2023-11-18T20:41:00.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.671+0000 7f81657fa640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f814c06ae40 0x7f814c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:00.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.672+0000 7f81657fa640 1 -- 172.21.15.132:0/146829684 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6329+0+0 (secure 0 0 0) 0x7f8154088af0 con 0x7f8168072530 2023-11-18T20:41:00.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.672+0000 7f816cadd640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f814c06ae40 0x7f814c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:00.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.673+0000 7f816cadd640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f814c06ae40 0x7f814c06d300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f81681562d0 tx=0x7f815c007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.676+0000 7f81657fa640 1 -- 172.21.15.132:0/146829684 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81681554e0 con 0x7f8168072530 2023-11-18T20:41:00.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:00.868+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f81681554e0 con 0x7f8168072530 2023-11-18T20:41:01.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.429+0000 7f81657fa640 1 -- 172.21.15.132:0/146829684 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7f81681554e0 con 0x7f8168072530 2023-11-18T20:41:01.431 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-11-18T20:41:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.433+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f814c06ae40 msgr2=0x7f814c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.433+0000 7f816ed41640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f814c06ae40 0x7f814c06d300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f81681562d0 tx=0x7f815c007930 comp rx=0 tx=0).stop 2023-11-18T20:41:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.433+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168072530 msgr2=0x7f8168151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.433+0000 7f816ed41640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168072530 0x7f8168151490 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f815400c440 tx=0x7f815400c900 comp rx=0 tx=0).stop 2023-11-18T20:41:01.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.434+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 shutdown_connections 2023-11-18T20:41:01.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.434+0000 7f816ed41640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f814c06ae40 0x7f814c06d300 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.434+0000 7f816ed41640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f816814fa80 0x7f8168071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.434+0000 7f816ed41640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8168072530 0x7f8168151490 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.434+0000 7f816ed41640 1 --2- 172.21.15.132:0/146829684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8168071f70 0x7f8168152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.434+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 >> 172.21.15.132:0/146829684 conn(0x7f81680c5bc0 msgr2=0x7f81680c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.436+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 shutdown_connections 2023-11-18T20:41:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.436+0000 7f816ed41640 1 -- 172.21.15.132:0/146829684 wait complete. 2023-11-18T20:41:01.459 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:01.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.660+0000 7f1e5218e640 1 Processor -- start 2023-11-18T20:41:01.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.660+0000 7f1e5218e640 1 -- start start 2023-11-18T20:41:01.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.662+0000 7f1e5218e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c06cd20 0x7f1e4c15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:01.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.662+0000 7f1e5218e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4c0a8380 con 0x7f1e4c0c52e0 2023-11-18T20:41:01.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.662+0000 7f1e5218e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4c1510b0 con 0x7f1e4c14e7f0 2023-11-18T20:41:01.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.662+0000 7f1e5218e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c06bf60 con 0x7f1e4c06cd20 2023-11-18T20:41:01.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.662+0000 7f1e5098b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1e4c0c52e0 0x7f1e4c06d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45728/0 (socket says 172.21.15.132:45728) 2023-11-18T20:41:01.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.662+0000 7f1e5098b640 1 -- 172.21.15.132:0/926640781 learned_addr learned my addr 172.21.15.132:0/926640781 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:01.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.662+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171661306 0 0) 0x7f1e4c0a8380 con 0x7f1e4c0c52e0 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e38005730 con 0x7f1e4c0c52e0 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e5198d640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c06cd20 0x7f1e4c15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809669279 0 0) 0x7f1e38005730 con 0x7f1e4c0c52e0 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c06cd20 msgr2=0x7f1e4c15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c06cd20 0x7f1e4c15ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 >> v1:172.21.15.161:6789/0 conn(0x7f1e4c14e7f0 legacy=0x7f1e4c0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c06c240 con 0x7f1e4c0c52e0 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f1e3c001670 con 0x7f1e4c0c52e0 2023-11-18T20:41:01.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 >> v1:172.21.15.132:6789/0 conn(0x7f1e4c0c52e0 legacy=0x7f1e4c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e38005bb0 0x7f1e38005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e380069d0 0x7f1e38006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c06cd20 0x7f1e3800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c06bf60 con 0x7f1e38005bb0 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e380076c0 con 0x7f1e380069d0 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e38007880 con 0x7f1e4c06cd20 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.663+0000 7f1e5118c640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e38005bb0 0x7f1e38005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.664+0000 7f1e5098b640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e380069d0 0x7f1e38006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.664+0000 7f1e5198d640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c06cd20 0x7f1e3800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.664+0000 7f1e5118c640 1 -- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c06cd20 msgr2=0x7f1e3800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.664+0000 7f1e5118c640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c06cd20 0x7f1e3800db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.664+0000 7f1e5118c640 1 -- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e380069d0 msgr2=0x7f1e38006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:01.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.664+0000 7f1e5118c640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e380069d0 0x7f1e38006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.664+0000 7f1e5118c640 1 -- 172.21.15.132:0/926640781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38005730 con 0x7f1e38005bb0 2023-11-18T20:41:01.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.664+0000 7f1e5098b640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e380069d0 0x7f1e38006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:01.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.665+0000 7f1e5118c640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e38005bb0 0x7f1e38005fd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1e48001750 tx=0x7f1e38007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0c6d42f58191ed server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:01.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.665+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480052d0 con 0x7f1e38005bb0 2023-11-18T20:41:01.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.665+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4802e050 con 0x7f1e38005bb0 2023-11-18T20:41:01.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.665+0000 7f1e43fff640 1 -- 172.21.15.132:0/926640781 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480035f0 con 0x7f1e38005bb0 2023-11-18T20:41:01.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.666+0000 7f1e5218e640 1 -- 172.21.15.132:0/926640781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e38005bb0 msgr2=0x7f1e38005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.666+0000 7f1e5218e640 1 --2- 172.21.15.132:0/926640781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e38005bb0 0x7f1e38005fd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1e48001750 tx=0x7f1e38007a00 comp rx=0 tx=0).stop 2023-11-18T20:41:01.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.666+0000 7f1e5198d640 1 -- 172.21.15.132:0/926640781 reap_dead start 2023-11-18T20:41:01.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.666+0000 7f1e5218e640 1 -- 172.21.15.132:0/926640781 shutdown_connections 2023-11-18T20:41:01.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.666+0000 7f1e5218e640 1 -- 172.21.15.132:0/926640781 >> 172.21.15.132:0/926640781 conn(0x7f1e4c0a77f0 msgr2=0x7f1e4c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:01.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.666+0000 7f1e5218e640 1 -- 172.21.15.132:0/926640781 shutdown_connections 2023-11-18T20:41:01.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.666+0000 7f1e5218e640 1 -- 172.21.15.132:0/926640781 wait complete. 2023-11-18T20:41:01.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.668+0000 7f1e5218e640 1 Processor -- start 2023-11-18T20:41:01.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.668+0000 7f1e5218e640 1 -- start start 2023-11-18T20:41:01.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5218e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e4c140750 0x7f1e4c14a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:01.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5218e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e4c14aa60 0x7f1e4c140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:01.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5218e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c141070 0x7f1e4c1e9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:01.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5218e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c145f90 con 0x7f1e4c14aa60 2023-11-18T20:41:01.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5218e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c1ea0f0 con 0x7f1e4c140750 2023-11-18T20:41:01.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5218e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c148bc0 con 0x7f1e4c141070 2023-11-18T20:41:01.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5098b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e4c14aa60 0x7f1e4c140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5098b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e4c14aa60 0x7f1e4c140b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59556/0 (socket says 172.21.15.132:59556) 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5098b640 1 -- 172.21.15.132:0/1234596258 learned_addr learned my addr 172.21.15.132:0/1234596258 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.669+0000 7f1e5118c640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e4c140750 0x7f1e4c14a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5198d640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c141070 0x7f1e4c1e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5098b640 1 -- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c141070 msgr2=0x7f1e4c1e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5098b640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c141070 0x7f1e4c1e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5098b640 1 -- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e4c140750 msgr2=0x7f1e4c14a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5098b640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e4c140750 0x7f1e4c14a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5098b640 1 -- 172.21.15.132:0/1234596258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c148ea0 con 0x7f1e4c14aa60 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5198d640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c141070 0x7f1e4c1e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5098b640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e4c14aa60 0x7f1e4c140b30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00db10 tx=0x7f1e3c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:01.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e41ffb640 1 -- 172.21.15.132:0/1234596258 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c004cb0 con 0x7f1e4c14aa60 2023-11-18T20:41:01.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e41ffb640 1 -- 172.21.15.132:0/1234596258 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c004e10 con 0x7f1e4c14aa60 2023-11-18T20:41:01.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e41ffb640 1 -- 172.21.15.132:0/1234596258 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0072d0 con 0x7f1e4c14aa60 2023-11-18T20:41:01.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c145b60 con 0x7f1e4c14aa60 2023-11-18T20:41:01.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.670+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c1e9740 con 0x7f1e4c14aa60 2023-11-18T20:41:01.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.672+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c1460d0 con 0x7f1e4c14aa60 2023-11-18T20:41:01.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.672+0000 7f1e41ffb640 1 -- 172.21.15.132:0/1234596258 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e3c007430 con 0x7f1e4c14aa60 2023-11-18T20:41:01.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.674+0000 7f1e41ffb640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1e3006ae40 0x7f1e3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:01.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.674+0000 7f1e41ffb640 1 -- 172.21.15.132:0/1234596258 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f1e3c089090 con 0x7f1e4c14aa60 2023-11-18T20:41:01.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.674+0000 7f1e5118c640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1e3006ae40 0x7f1e3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:01.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.676+0000 7f1e5118c640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1e3006ae40 0x7f1e3006d300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e48033000 tx=0x7f1e48009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:01.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.678+0000 7f1e41ffb640 1 -- 172.21.15.132:0/1234596258 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e4c1460d0 con 0x7f1e4c14aa60 2023-11-18T20:41:01.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.860+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e4c1460d0 con 0x7f1e4c14aa60 2023-11-18T20:41:01.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.863+0000 7f1e41ffb640 1 -- 172.21.15.132:0/1234596258 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16776 (secure 0 0 0) 0x7f1e4c1460d0 con 0x7f1e4c14aa60 2023-11-18T20:41:01.865 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:01.865 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":64,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:01.420823+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.29","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/3392191515":"2023-11-19T20:40:58.199045+0000","172.21.15.132:6834/3392191515":"2023-11-19T20:40:58.199045+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:01.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1e3006ae40 msgr2=0x7f1e3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1e3006ae40 0x7f1e3006d300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e48033000 tx=0x7f1e48009030 comp rx=0 tx=0).stop 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e4c14aa60 msgr2=0x7f1e4c140b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e4c14aa60 0x7f1e4c140b30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00db10 tx=0x7f1e3c001d80 comp rx=0 tx=0).stop 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 shutdown_connections 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1e3006ae40 0x7f1e3006d300 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e4c141070 0x7f1e4c1e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e4c14aa60 0x7f1e4c140b30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 --2- 172.21.15.132:0/1234596258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e4c140750 0x7f1e4c14a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 >> 172.21.15.132:0/1234596258 conn(0x7f1e4c0a77f0 msgr2=0x7f1e4c0c2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 shutdown_connections 2023-11-18T20:41:01.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:01.866+0000 7f1e5218e640 1 -- 172.21.15.132:0/1234596258 wait complete. 2023-11-18T20:41:01.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:40:28.826395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:40:29.825753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:41:01.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:41:02.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.095+0000 7f4625f67640 1 Processor -- start 2023-11-18T20:41:02.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.095+0000 7f4625f67640 1 -- start start 2023-11-18T20:41:02.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4625f67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46200a6310 0x7f462006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4625f67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4620071320 0x7f462015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4625f67640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4620152c10 con 0x7f462006a500 2023-11-18T20:41:02.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4625f67640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46200c16d0 con 0x7f4620071320 2023-11-18T20:41:02.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4625f67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46201557c0 con 0x7f46200a6310 2023-11-18T20:41:02.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4624f65640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f462006a500 0x7f4620070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45736/0 (socket says 172.21.15.132:45736) 2023-11-18T20:41:02.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4624f65640 1 -- 172.21.15.132:0/1814070369 learned_addr learned my addr 172.21.15.132:0/1814070369 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:02.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4617fff640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46200a6310 0x7f462006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f4625766640 1 --2- 172.21.15.132:0/1814070369 >> v2:172.21.15.161:3300/0 conn(0x7f4620071320 0x7f462015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.097+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343747136 0 0) 0x7f4620152c10 con 0x7f462006a500 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4608003520 con 0x7f462006a500 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3600242086 0 0) 0x7f4608003520 con 0x7f462006a500 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46200a6310 msgr2=0x7f462006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46200a6310 0x7f462006a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 >> v2:172.21.15.161:3300/0 conn(0x7f4620071320 msgr2=0x7f462015cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 --2- 172.21.15.132:0/1814070369 >> v2:172.21.15.161:3300/0 conn(0x7f4620071320 0x7f462015cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620155a60 con 0x7f462006a500 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f461c0019f0 con 0x7f462006a500 2023-11-18T20:41:02.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 >> v1:172.21.15.132:6789/0 conn(0x7f462006a500 legacy=0x7f4620070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4608003970 0x7f4608003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46080047c0 0x7f4608004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46200a6310 0x7f4608005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46200c16d0 con 0x7f46080047c0 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46201557c0 con 0x7f4608003970 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460800ba00 con 0x7f46200a6310 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.098+0000 7f4617fff640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46080047c0 0x7f4608004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.099+0000 7f4625766640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46200a6310 0x7f4608005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.099+0000 7f4624f65640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4608003970 0x7f4608003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.099+0000 7f4617fff640 1 -- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46200a6310 msgr2=0x7f4608005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.099+0000 7f4617fff640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46200a6310 0x7f4608005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.099+0000 7f4617fff640 1 -- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4608003970 msgr2=0x7f4608003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.099+0000 7f4617fff640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4608003970 0x7f4608003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.099+0000 7f4617fff640 1 -- 172.21.15.132:0/1814070369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608003520 con 0x7f46080047c0 2023-11-18T20:41:02.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.099+0000 7f4624f65640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4608003970 0x7f4608003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:02.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.100+0000 7f4617fff640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46080047c0 0x7f4608004c40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4610009ac0 tx=0x7f46080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7646326b1c19157e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:02.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.100+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461002c6b0 con 0x7f46080047c0 2023-11-18T20:41:02.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.100+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461002c810 con 0x7f46080047c0 2023-11-18T20:41:02.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.100+0000 7f46177fe640 1 -- 172.21.15.132:0/1814070369 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461002cba0 con 0x7f46080047c0 2023-11-18T20:41:02.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.101+0000 7f4625f67640 1 -- 172.21.15.132:0/1814070369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46080047c0 msgr2=0x7f4608004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.101+0000 7f4625f67640 1 --2- 172.21.15.132:0/1814070369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46080047c0 0x7f4608004c40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4610009ac0 tx=0x7f46080057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.101+0000 7f4625766640 1 -- 172.21.15.132:0/1814070369 reap_dead start 2023-11-18T20:41:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.101+0000 7f4625f67640 1 -- 172.21.15.132:0/1814070369 shutdown_connections 2023-11-18T20:41:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.101+0000 7f4625f67640 1 -- 172.21.15.132:0/1814070369 >> 172.21.15.132:0/1814070369 conn(0x7f46200a8870 msgr2=0x7f46200a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.101+0000 7f4625f67640 1 -- 172.21.15.132:0/1814070369 shutdown_connections 2023-11-18T20:41:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.101+0000 7f4625f67640 1 -- 172.21.15.132:0/1814070369 wait complete. 2023-11-18T20:41:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.103+0000 7f4625f67640 1 Processor -- start 2023-11-18T20:41:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.103+0000 7f4625f67640 1 -- start start 2023-11-18T20:41:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4625f67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46080047c0 0x7f46200c0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4625f67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46200c4e30 0x7f46201544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4625f67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46201e9f50 0x7f46201ea400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4625f67640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46201ed440 con 0x7f46200c4e30 2023-11-18T20:41:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4625f67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46201ed720 con 0x7f46201e9f50 2023-11-18T20:41:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4625f67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46201eda00 con 0x7f46080047c0 2023-11-18T20:41:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4617fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46200c4e30 0x7f46201544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4617fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46200c4e30 0x7f46201544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59572/0 (socket says 172.21.15.132:59572) 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4617fff640 1 -- 172.21.15.132:0/159414811 learned_addr learned my addr 172.21.15.132:0/159414811 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4617fff640 1 -- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46080047c0 msgr2=0x7f46200c0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4617fff640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46080047c0 0x7f46200c0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4617fff640 1 -- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46201e9f50 msgr2=0x7f46201ea400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4625766640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46201e9f50 0x7f46201ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4617fff640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46201e9f50 0x7f46201ea400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.104+0000 7f4617fff640 1 -- 172.21.15.132:0/159414811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46201edce0 con 0x7f46200c4e30 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.105+0000 7f4617fff640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46200c4e30 0x7f46201544c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4610037040 tx=0x7f4610004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.105+0000 7f46157fa640 1 -- 172.21.15.132:0/159414811 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461002c6b0 con 0x7f46200c4e30 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.105+0000 7f46157fa640 1 -- 172.21.15.132:0/159414811 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610003820 con 0x7f46200c4e30 2023-11-18T20:41:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.105+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46201edfc0 con 0x7f46200c4e30 2023-11-18T20:41:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.105+0000 7f46157fa640 1 -- 172.21.15.132:0/159414811 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610003b90 con 0x7f46200c4e30 2023-11-18T20:41:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.105+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4620154a00 con 0x7f46200c4e30 2023-11-18T20:41:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.107+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46201e9d30 con 0x7f46200c4e30 2023-11-18T20:41:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.107+0000 7f46157fa640 1 -- 172.21.15.132:0/159414811 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4610003cf0 con 0x7f46200c4e30 2023-11-18T20:41:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.108+0000 7f46157fa640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f460c06ae70 0x7f460c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.108+0000 7f46157fa640 1 -- 172.21.15.132:0/159414811 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f46100ab660 con 0x7f46200c4e30 2023-11-18T20:41:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.109+0000 7f4624f65640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f460c06ae70 0x7f460c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.110+0000 7f4624f65640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f460c06ae70 0x7f460c06d330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f461c007c40 tx=0x7f461c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.112+0000 7f46157fa640 1 -- 172.21.15.132:0/159414811 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4610076700 con 0x7f46200c4e30 2023-11-18T20:41:02.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.303+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f462004e840 con 0x7f46200c4e30 2023-11-18T20:41:02.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.303+0000 7f46157fa640 1 -- 172.21.15.132:0/159414811 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4610079d20 con 0x7f46200c4e30 2023-11-18T20:41:02.305 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:41:02.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f460c06ae70 msgr2=0x7f460c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f460c06ae70 0x7f460c06d330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f461c007c40 tx=0x7f461c009040 comp rx=0 tx=0).stop 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46200c4e30 msgr2=0x7f46201544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46200c4e30 0x7f46201544c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4610037040 tx=0x7f4610004730 comp rx=0 tx=0).stop 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 shutdown_connections 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f460c06ae70 0x7f460c06d330 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46201e9f50 0x7f46201ea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46200c4e30 0x7f46201544c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 --2- 172.21.15.132:0/159414811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46080047c0 0x7f46200c0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 >> 172.21.15.132:0/159414811 conn(0x7f46200a8870 msgr2=0x7f462006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:02.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 shutdown_connections 2023-11-18T20:41:02.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.306+0000 7f4625f67640 1 -- 172.21.15.132:0/159414811 wait complete. 2023-11-18T20:41:02.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:41:02.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.542+0000 7f4799c21640 1 Processor -- start 2023-11-18T20:41:02.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.542+0000 7f4799c21640 1 -- start start 2023-11-18T20:41:02.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.543+0000 7f4799c21640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f479406d0a0 0x7f4794152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.543+0000 7f4799c21640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47940c64a0 con 0x7f479414fd30 2023-11-18T20:41:02.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.543+0000 7f4799c21640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47940c5c00 con 0x7f47940c3ea0 2023-11-18T20:41:02.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.543+0000 7f4799c21640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47940c5ee0 con 0x7f479406d0a0 2023-11-18T20:41:02.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47937fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f479414fd30 0x7f47940a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45742/0 (socket says 172.21.15.132:45742) 2023-11-18T20:41:02.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47937fe640 1 -- 172.21.15.132:0/1040185971 learned_addr learned my addr 172.21.15.132:0/1040185971 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60661063 0 0) 0x7f47940c64a0 con 0x7f479414fd30 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f477c003520 con 0x7f479414fd30 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f4792ffd640 1 --2- 172.21.15.132:0/1040185971 >> v2:172.21.15.161:3300/0 conn(0x7f479406d0a0 0x7f4794152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1145049641 0 0) 0x7f477c003520 con 0x7f479414fd30 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 >> v2:172.21.15.161:3300/0 conn(0x7f479406d0a0 msgr2=0x7f4794152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47927fc640 1 --2- 172.21.15.132:0/1040185971 >> v2:172.21.15.161:3300/0 conn(0x7f479406d0a0 0x7f4794152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 >> v1:172.21.15.161:6789/0 conn(0x7f47940c3ea0 legacy=0x7f47940c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940c61c0 con 0x7f479414fd30 2023-11-18T20:41:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.544+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f4784001670 con 0x7f479414fd30 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 >> v1:172.21.15.132:6789/0 conn(0x7f479414fd30 legacy=0x7f47940a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f47927fc640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f477c0039c0 0x7f477c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f47927fc640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f477c0047c0 0x7f477c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f47927fc640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f477c0052a0 0x7f477c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47940c5ee0 con 0x7f477c0047c0 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c00c1f0 con 0x7f477c0052a0 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c00c3b0 con 0x7f477c0039c0 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f4792ffd640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f477c0047c0 0x7f477c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f4792ffd640 1 -- 172.21.15.132:0/1040185971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f477c0039c0 msgr2=0x7f477c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f4792ffd640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f477c0039c0 0x7f477c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f4792ffd640 1 -- 172.21.15.132:0/1040185971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f477c0052a0 msgr2=0x7f477c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f4792ffd640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f477c0052a0 0x7f477c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f4792ffd640 1 -- 172.21.15.132:0/1040185971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c003520 con 0x7f477c0047c0 2023-11-18T20:41:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.545+0000 7f4793fff640 1 -- 172.21.15.132:0/1040185971 reap_dead start 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.546+0000 7f4792ffd640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f477c0047c0 0x7f477c004c40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f479406d4e0 tx=0x7f477c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba60e3f574ab51d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788031660 con 0x7f477c0047c0 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47880317c0 con 0x7f477c0047c0 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f47927fc640 1 -- 172.21.15.132:0/1040185971 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788031bb0 con 0x7f477c0047c0 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f4799c21640 1 -- 172.21.15.132:0/1040185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f477c0047c0 msgr2=0x7f477c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f4799c21640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f477c0047c0 0x7f477c004c40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f479406d4e0 tx=0x7f477c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f4799c21640 1 -- 172.21.15.132:0/1040185971 shutdown_connections 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f4799c21640 1 --2- 172.21.15.132:0/1040185971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f477c0047c0 0x7f477c004c40 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f4799c21640 1 -- 172.21.15.132:0/1040185971 >> 172.21.15.132:0/1040185971 conn(0x7f479406a500 msgr2=0x7f479406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.547+0000 7f4799c21640 1 -- 172.21.15.132:0/1040185971 shutdown_connections 2023-11-18T20:41:02.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.548+0000 7f4799c21640 1 -- 172.21.15.132:0/1040185971 wait complete. 2023-11-18T20:41:02.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.549+0000 7f4799c21640 1 Processor -- start 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.549+0000 7f4799c21640 1 -- start start 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4799c21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f477c0047c0 0x7f47941dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4799c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47940a7150 0x7f47941edf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4799c21640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47940bf360 0x7f47941e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4799c21640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479414f680 con 0x7f47940a7150 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4799c21640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4794072710 con 0x7f47940bf360 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4799c21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479414f3a0 con 0x7f477c0047c0 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4792ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47940a7150 0x7f47941edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4792ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47940a7150 0x7f47941edf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59584/0 (socket says 172.21.15.132:59584) 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.550+0000 7f4792ffd640 1 -- 172.21.15.132:0/486569457 learned_addr learned my addr 172.21.15.132:0/486569457 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f4792ffd640 1 -- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f477c0047c0 msgr2=0x7f47941dbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f4792ffd640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f477c0047c0 0x7f47941dbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f4792ffd640 1 -- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47940bf360 msgr2=0x7f47941e9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f4792ffd640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47940bf360 0x7f47941e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f4792ffd640 1 -- 172.21.15.132:0/486569457 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479414ef50 con 0x7f47940a7150 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f4792ffd640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47940a7150 0x7f47941edf90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f478802be50 tx=0x7f47880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f477bfff640 1 -- 172.21.15.132:0/486569457 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478803a830 con 0x7f47940a7150 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f477bfff640 1 -- 172.21.15.132:0/486569457 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478803a990 con 0x7f47940a7150 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f477bfff640 1 -- 172.21.15.132:0/486569457 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478803ad00 con 0x7f47940a7150 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.551+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47940bfd10 con 0x7f47940a7150 2023-11-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.552+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47941ea470 con 0x7f47940a7150 2023-11-18T20:41:02.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.553+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479414edb0 con 0x7f47940a7150 2023-11-18T20:41:02.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.554+0000 7f477bfff640 1 -- 172.21.15.132:0/486569457 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47880303c0 con 0x7f47940a7150 2023-11-18T20:41:02.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.555+0000 7f477bfff640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f478006ae40 0x7f478006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.555+0000 7f477bfff640 1 -- 172.21.15.132:0/486569457 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f478802d040 con 0x7f47940a7150 2023-11-18T20:41:02.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.555+0000 7f47937fe640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f478006ae40 0x7f478006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.556+0000 7f47937fe640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f478006ae40 0x7f478006d300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f47840017a0 tx=0x7f47840015b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:02.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.559+0000 7f477bfff640 1 -- 172.21.15.132:0/486569457 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f479414edb0 con 0x7f47940a7150 2023-11-18T20:41:02.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.749+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f479414edb0 con 0x7f47940a7150 2023-11-18T20:41:02.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.750+0000 7f477bfff640 1 -- 172.21.15.132:0/486569457 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v64) v1 ==== 105+0+11 (secure 0 0 0) 0x7f479414edb0 con 0x7f47940a7150 2023-11-18T20:41:02.752 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:41:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.753+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f478006ae40 msgr2=0x7f478006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.753+0000 7f4799c21640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f478006ae40 0x7f478006d300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f47840017a0 tx=0x7f47840015b0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.753+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47940a7150 msgr2=0x7f47941edf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.753+0000 7f4799c21640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47940a7150 0x7f47941edf90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f478802be50 tx=0x7f47880046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.754+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 shutdown_connections 2023-11-18T20:41:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.754+0000 7f4799c21640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f478006ae40 0x7f478006d300 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.754+0000 7f4799c21640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47940bf360 0x7f47941e9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.754+0000 7f4799c21640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47940a7150 0x7f47941edf90 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.754+0000 7f4799c21640 1 --2- 172.21.15.132:0/486569457 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f477c0047c0 0x7f47941dbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.754+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 >> 172.21.15.132:0/486569457 conn(0x7f479406a500 msgr2=0x7f4794152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:02.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.754+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 shutdown_connections 2023-11-18T20:41:02.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.754+0000 7f4799c21640 1 -- 172.21.15.132:0/486569457 wait complete. 2023-11-18T20:41:02.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:41:02.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.985+0000 7f408954e640 1 Processor -- start 2023-11-18T20:41:02.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.985+0000 7f408954e640 1 -- start start 2023-11-18T20:41:02.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.986+0000 7f408954e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40840c52e0 0x7f408406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.986+0000 7f408954e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 0x7f408415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.986+0000 7f408954e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40840a8380 con 0x7f408414e7f0 2023-11-18T20:41:02.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.986+0000 7f408954e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40841510b0 con 0x7f40840c52e0 2023-11-18T20:41:02.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.986+0000 7f408954e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408406bf60 con 0x7f408406cd20 2023-11-18T20:41:02.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f4083fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f408414e7f0 0x7f40840c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45754/0 (socket says 172.21.15.132:45754) 2023-11-18T20:41:02.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f4083fff640 1 -- 172.21.15.132:0/1677766563 learned_addr learned my addr 172.21.15.132:0/1677766563 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:02.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f407bfff640 1 --2- 172.21.15.132:0/1677766563 >> v2:172.21.15.132:3300/0 conn(0x7f40840c52e0 0x7f408406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f4088d4d640 1 --2- 172.21.15.132:0/1677766563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 0x7f408415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f40837fe640 1 -- 172.21.15.132:0/1677766563 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892351812 0 0) 0x7f40840a8380 con 0x7f408414e7f0 2023-11-18T20:41:02.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f40837fe640 1 -- 172.21.15.132:0/1677766563 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4070003520 con 0x7f408414e7f0 2023-11-18T20:41:02.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f407bfff640 1 -- 172.21.15.132:0/1677766563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 msgr2=0x7f408415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:02.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f407bfff640 1 --2- 172.21.15.132:0/1677766563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 0x7f408415ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f407bfff640 1 -- 172.21.15.132:0/1677766563 >> v1:172.21.15.132:6789/0 conn(0x7f408414e7f0 legacy=0x7f40840c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.987+0000 7f407bfff640 1 -- 172.21.15.132:0/1677766563 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408406c240 con 0x7f40840c52e0 2023-11-18T20:41:02.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.988+0000 7f407bfff640 1 --2- 172.21.15.132:0/1677766563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40840c52e0 0x7f408406d1e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f406c0097a0 tx=0x7f406c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8c5b28333cdea server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:02.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f40837fe640 1 -- 172.21.15.132:0/1677766563 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c031780 con 0x7f40840c52e0 2023-11-18T20:41:02.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f40837fe640 1 -- 172.21.15.132:0/1677766563 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c0318e0 con 0x7f40840c52e0 2023-11-18T20:41:02.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f40837fe640 1 -- 172.21.15.132:0/1677766563 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c031c70 con 0x7f40840c52e0 2023-11-18T20:41:02.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f408954e640 1 -- 172.21.15.132:0/1677766563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40840c52e0 msgr2=0x7f408406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f408954e640 1 --2- 172.21.15.132:0/1677766563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40840c52e0 0x7f408406d1e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f406c0097a0 tx=0x7f406c02b820 comp rx=0 tx=0).stop 2023-11-18T20:41:02.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f408954e640 1 -- 172.21.15.132:0/1677766563 shutdown_connections 2023-11-18T20:41:02.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f408954e640 1 --2- 172.21.15.132:0/1677766563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 0x7f408415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f408954e640 1 --2- 172.21.15.132:0/1677766563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40840c52e0 0x7f408406d1e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f408954e640 1 -- 172.21.15.132:0/1677766563 >> 172.21.15.132:0/1677766563 conn(0x7f40840a77f0 msgr2=0x7f40840a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:02.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f408954e640 1 -- 172.21.15.132:0/1677766563 shutdown_connections 2023-11-18T20:41:02.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.989+0000 7f408954e640 1 -- 172.21.15.132:0/1677766563 wait complete. 2023-11-18T20:41:02.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.991+0000 7f408954e640 1 Processor -- start 2023-11-18T20:41:02.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.991+0000 7f408954e640 1 -- start start 2023-11-18T20:41:02.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f408954e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 0x7f4084072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f408954e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40840c52e0 0x7f4084146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f408954e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f408414e7f0 0x7f4084147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:02.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f408954e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4084153930 con 0x7f408414e7f0 2023-11-18T20:41:02.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f408954e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4084147940 con 0x7f40840c52e0 2023-11-18T20:41:02.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f408954e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408414b160 con 0x7f408406cd20 2023-11-18T20:41:02.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f4088d4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f408414e7f0 0x7f4084147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f4088d4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f408414e7f0 0x7f4084147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59602/0 (socket says 172.21.15.132:59602) 2023-11-18T20:41:02.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.992+0000 7f4088d4d640 1 -- 172.21.15.132:0/715710878 learned_addr learned my addr 172.21.15.132:0/715710878 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:02.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f407bfff640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40840c52e0 0x7f4084146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f4083fff640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 0x7f4084072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:02.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f4088d4d640 1 -- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 msgr2=0x7f4084072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f4088d4d640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 0x7f4084072150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f4088d4d640 1 -- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40840c52e0 msgr2=0x7f4084146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:02.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f4088d4d640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40840c52e0 0x7f4084146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:02.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f4088d4d640 1 -- 172.21.15.132:0/715710878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c009400 con 0x7f408414e7f0 2023-11-18T20:41:02.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f407bfff640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40840c52e0 0x7f4084146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:02.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f4088d4d640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f408414e7f0 0x7f4084147400 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f407c007e30 tx=0x7f407c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:02.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f40817fa640 1 -- 172.21.15.132:0/715710878 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c014620 con 0x7f408414e7f0 2023-11-18T20:41:02.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f40817fa640 1 -- 172.21.15.132:0/715710878 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00ee90 con 0x7f408414e7f0 2023-11-18T20:41:02.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40841525b0 con 0x7f408414e7f0 2023-11-18T20:41:02.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.993+0000 7f40817fa640 1 -- 172.21.15.132:0/715710878 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c0149c0 con 0x7f408414e7f0 2023-11-18T20:41:02.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.994+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4084152b30 con 0x7f408414e7f0 2023-11-18T20:41:03.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.995+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408404e840 con 0x7f408414e7f0 2023-11-18T20:41:03.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.996+0000 7f40817fa640 1 -- 172.21.15.132:0/715710878 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f407c014b20 con 0x7f408414e7f0 2023-11-18T20:41:03.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.997+0000 7f40817fa640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f406406ae40 0x7f406406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.997+0000 7f40817fa640 1 -- 172.21.15.132:0/715710878 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f407c08a080 con 0x7f408414e7f0 2023-11-18T20:41:03.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.997+0000 7f4083fff640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f406406ae40 0x7f406406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:02.999+0000 7f4083fff640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f406406ae40 0x7f406406d300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f40740011e0 tx=0x7f4074009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:03.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.001+0000 7f40817fa640 1 -- 172.21.15.132:0/715710878 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f407c0bce90 con 0x7f408414e7f0 2023-11-18T20:41:03.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.190+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f40840c3c70 con 0x7f408414e7f0 2023-11-18T20:41:03.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.191+0000 7f40817fa640 1 -- 172.21.15.132:0/715710878 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v64) v1 ==== 101+0+11 (secure 0 0 0) 0x7f407c055080 con 0x7f408414e7f0 2023-11-18T20:41:03.192 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.193+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f406406ae40 msgr2=0x7f406406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.193+0000 7f408954e640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f406406ae40 0x7f406406d300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f40740011e0 tx=0x7f4074009040 comp rx=0 tx=0).stop 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.193+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f408414e7f0 msgr2=0x7f4084147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.193+0000 7f408954e640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f408414e7f0 0x7f4084147400 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f407c007e30 tx=0x7f407c00e4b0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.194+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 shutdown_connections 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.194+0000 7f408954e640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f406406ae40 0x7f406406d300 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.194+0000 7f408954e640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f408414e7f0 0x7f4084147400 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.194+0000 7f408954e640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40840c52e0 0x7f4084146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.194+0000 7f408954e640 1 --2- 172.21.15.132:0/715710878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f408406cd20 0x7f4084072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.194+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 >> 172.21.15.132:0/715710878 conn(0x7f40840a77f0 msgr2=0x7f40840c2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:03.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.194+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 shutdown_connections 2023-11-18T20:41:03.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.194+0000 7f408954e640 1 -- 172.21.15.132:0/715710878 wait complete. 2023-11-18T20:41:03.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:41:03.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.420+0000 7fd103fff640 1 Processor -- start 2023-11-18T20:41:03.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.420+0000 7fd103fff640 1 -- start start 2023-11-18T20:41:03.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.421+0000 7fd103fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 0x7fd1040c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.421+0000 7fd103fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1040a8380 con 0x7fd10406cd20 2023-11-18T20:41:03.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.421+0000 7fd103fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1041510b0 con 0x7fd1040c52e0 2023-11-18T20:41:03.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.421+0000 7fd103fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10406bf60 con 0x7fd10414e7f0 2023-11-18T20:41:03.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.422+0000 7fd1037fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd10406cd20 0x7fd10415ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45764/0 (socket says 172.21.15.132:45764) 2023-11-18T20:41:03.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.422+0000 7fd1037fe640 1 -- 172.21.15.132:0/3556698020 learned_addr learned my addr 172.21.15.132:0/3556698020 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:03.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.422+0000 7fd102ffd640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 0x7fd1040c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.422+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112526756 0 0) 0x7fd1040a8380 con 0x7fd10406cd20 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.422+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e8005730 con 0x7fd10406cd20 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1779588908 0 0) 0x7fd0e8005730 con 0x7fd10406cd20 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 msgr2=0x7fd1040c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 0x7fd1040c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 >> v1:172.21.15.161:6789/0 conn(0x7fd1040c52e0 legacy=0x7fd10406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10406c240 con 0x7fd10406cd20 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fd0fc0019f0 con 0x7fd10406cd20 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 >> v1:172.21.15.132:6789/0 conn(0x7fd10406cd20 legacy=0x7fd10415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0e8005bb0 0x7fd0e8005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80069d0 0x7fd0e8006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 0x7fd0e80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10406bf60 con 0x7fd0e80069d0 2023-11-18T20:41:03.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e800dcc0 con 0x7fd0e8005bb0 2023-11-18T20:41:03.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e800de80 con 0x7fd10414e7f0 2023-11-18T20:41:03.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.423+0000 7fd1027fc640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80069d0 0x7fd0e8006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.424+0000 7fd102ffd640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0e8005bb0 0x7fd0e8005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.424+0000 7fd1037fe640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 0x7fd0e80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.424+0000 7fd1027fc640 1 -- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 msgr2=0x7fd0e80073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.424+0000 7fd1027fc640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 0x7fd0e80073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.424+0000 7fd1027fc640 1 -- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0e8005bb0 msgr2=0x7fd0e8005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.424+0000 7fd1027fc640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0e8005bb0 0x7fd0e8005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.424+0000 7fd1027fc640 1 -- 172.21.15.132:0/3556698020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8005730 con 0x7fd0e80069d0 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.424+0000 7fd1037fe640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10414e7f0 0x7fd0e80073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.425+0000 7fd1027fc640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80069d0 0x7fd0e8006e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0001750 tx=0x7fd0e8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a25611eafbe132 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.425+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00052d0 con 0x7fd0e80069d0 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.425+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f002e050 con 0x7fd0e80069d0 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.425+0000 7fd101ffb640 1 -- 172.21.15.132:0/3556698020 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00035f0 con 0x7fd0e80069d0 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.426+0000 7fd103fff640 1 -- 172.21.15.132:0/3556698020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80069d0 msgr2=0x7fd0e8006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.426+0000 7fd103fff640 1 --2- 172.21.15.132:0/3556698020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80069d0 0x7fd0e8006e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0001750 tx=0x7fd0e8007a00 comp rx=0 tx=0).stop 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.426+0000 7fd1037fe640 1 -- 172.21.15.132:0/3556698020 reap_dead start 2023-11-18T20:41:03.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.426+0000 7fd103fff640 1 -- 172.21.15.132:0/3556698020 shutdown_connections 2023-11-18T20:41:03.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.426+0000 7fd103fff640 1 -- 172.21.15.132:0/3556698020 >> 172.21.15.132:0/3556698020 conn(0x7fd1040a77f0 msgr2=0x7fd1040a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:03.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.426+0000 7fd103fff640 1 -- 172.21.15.132:0/3556698020 shutdown_connections 2023-11-18T20:41:03.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.426+0000 7fd103fff640 1 -- 172.21.15.132:0/3556698020 wait complete. 2023-11-18T20:41:03.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.428+0000 7fd103fff640 1 Processor -- start 2023-11-18T20:41:03.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.428+0000 7fd103fff640 1 -- start start 2023-11-18T20:41:03.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd103fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd104140f10 0x7fd1041eabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd103fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1040abb20 0x7fd1040bee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd103fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1040bf3b0 0x7fd10414a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd103fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10414ef20 con 0x7fd1040abb20 2023-11-18T20:41:03.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd103fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041506c0 con 0x7fd104140f10 2023-11-18T20:41:03.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd103fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041509a0 con 0x7fd1040bf3b0 2023-11-18T20:41:03.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd1027fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1040abb20 0x7fd1040bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd1027fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1040abb20 0x7fd1040bee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59616/0 (socket says 172.21.15.132:59616) 2023-11-18T20:41:03.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.429+0000 7fd1027fc640 1 -- 172.21.15.132:0/3809769618 learned_addr learned my addr 172.21.15.132:0/3809769618 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:03.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd102ffd640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd104140f10 0x7fd1041eabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd1037fe640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1040bf3b0 0x7fd10414a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd1027fc640 1 -- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1040bf3b0 msgr2=0x7fd10414a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd1027fc640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1040bf3b0 0x7fd10414a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd1027fc640 1 -- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd104140f10 msgr2=0x7fd1041eabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd1027fc640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd104140f10 0x7fd1041eabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd1027fc640 1 -- 172.21.15.132:0/3809769618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104150c80 con 0x7fd1040abb20 2023-11-18T20:41:03.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd102ffd640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd104140f10 0x7fd1041eabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:03.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd1027fc640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1040abb20 0x7fd1040bee70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0005040 tx=0x7fd0f0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:03.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd0fb7fe640 1 -- 172.21.15.132:0/3809769618 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00076c0 con 0x7fd1040abb20 2023-11-18T20:41:03.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd0fb7fe640 1 -- 172.21.15.132:0/3809769618 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0007a30 con 0x7fd1040abb20 2023-11-18T20:41:03.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd0fb7fe640 1 -- 172.21.15.132:0/3809769618 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0006be0 con 0x7fd1040abb20 2023-11-18T20:41:03.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.430+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd104149db0 con 0x7fd1040abb20 2023-11-18T20:41:03.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.431+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1041412f0 con 0x7fd1040abb20 2023-11-18T20:41:03.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.432+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10404e840 con 0x7fd1040abb20 2023-11-18T20:41:03.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.433+0000 7fd0fb7fe640 1 -- 172.21.15.132:0/3809769618 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0f0006d40 con 0x7fd1040abb20 2023-11-18T20:41:03.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.433+0000 7fd0fb7fe640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0ec06ae70 0x7fd0ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.434+0000 7fd0fb7fe640 1 -- 172.21.15.132:0/3809769618 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fd0f00ab0e0 con 0x7fd1040abb20 2023-11-18T20:41:03.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.434+0000 7fd102ffd640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0ec06ae70 0x7fd0ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.435+0000 7fd102ffd640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0ec06ae70 0x7fd0ec06d330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009a00 tx=0x7fd0f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:03.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.438+0000 7fd0fb7fe640 1 -- 172.21.15.132:0/3809769618 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0f00760e0 con 0x7fd1040abb20 2023-11-18T20:41:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.662+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1040c3c70 con 0x7fd1040abb20 2023-11-18T20:41:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.663+0000 7fd0fb7fe640 1 -- 172.21.15.132:0/3809769618 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fd0f0079700 con 0x7fd1040abb20 2023-11-18T20:41:03.664 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:03.664 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/417491622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":417491622},{"type":"v1","addr":"172.21.15.132:6835","nonce":417491622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:30.829157+0000","modified":"2023-11-18T20:40:33.909984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-18T20:41:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 37 2023-11-18T20:41:03.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0ec06ae70 msgr2=0x7fd0ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0ec06ae70 0x7fd0ec06d330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009a00 tx=0x7fd0f4008040 comp rx=0 tx=0).stop 2023-11-18T20:41:03.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1040abb20 msgr2=0x7fd1040bee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1040abb20 0x7fd1040bee70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0005040 tx=0x7fd0f0001120 comp rx=0 tx=0).stop 2023-11-18T20:41:03.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 shutdown_connections 2023-11-18T20:41:03.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0ec06ae70 0x7fd0ec06d330 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1040bf3b0 0x7fd10414a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1040abb20 0x7fd1040bee70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 --2- 172.21.15.132:0/3809769618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd104140f10 0x7fd1041eabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.665+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 >> 172.21.15.132:0/3809769618 conn(0x7fd1040a77f0 msgr2=0x7fd10406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:03.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.666+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 shutdown_connections 2023-11-18T20:41:03.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.666+0000 7fd103fff640 1 -- 172.21.15.132:0/3809769618 wait complete. 2023-11-18T20:41:03.687 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:03.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.889+0000 7f2f31ba9640 1 Processor -- start 2023-11-18T20:41:03.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.889+0000 7f2f31ba9640 1 -- start start 2023-11-18T20:41:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f31ba9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f2c06d0a0 0x7f2f2c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f31ba9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c0c64a0 con 0x7f2f2c14fd30 2023-11-18T20:41:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f31ba9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c0c5c00 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f31ba9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c0c5ee0 con 0x7f2f2c06d0a0 2023-11-18T20:41:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f2affd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f2c06d0a0 0x7f2f2c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f2b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2f2c14fd30 0x7f2f2c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45778/0 (socket says 172.21.15.132:45778) 2023-11-18T20:41:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f2b7fe640 1 -- 172.21.15.132:0/4015487704 learned_addr learned my addr 172.21.15.132:0/4015487704 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f2affd640 1 -- 172.21.15.132:0/4015487704 >> v1:172.21.15.161:6789/0 conn(0x7f2f2c0c3ea0 legacy=0x7f2f2c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f2affd640 1 -- 172.21.15.132:0/4015487704 >> v1:172.21.15.132:6789/0 conn(0x7f2f2c14fd30 legacy=0x7f2f2c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f2affd640 1 -- 172.21.15.132:0/4015487704 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c0c61c0 con 0x7f2f2c06d0a0 2023-11-18T20:41:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.891+0000 7f2f2a7fc640 1 -- 172.21.15.132:0/4015487704 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934704836 0 0) 0x7f2f2c0c64a0 con 0x7f2f2c14fd30 2023-11-18T20:41:03.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.892+0000 7f2f2affd640 1 --2- 172.21.15.132:0/4015487704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c06d0a0 0x7f2f2c152f20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2f200097a0 tx=0x7f2f2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03999dd6a65947b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.893+0000 7f2f2a7fc640 1 -- 172.21.15.132:0/4015487704 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20031830 con 0x7f2f2c06d0a0 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.893+0000 7f2f2a7fc640 1 -- 172.21.15.132:0/4015487704 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f20031990 con 0x7f2f2c06d0a0 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.893+0000 7f2f2a7fc640 1 -- 172.21.15.132:0/4015487704 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20031d20 con 0x7f2f2c06d0a0 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.893+0000 7f2f31ba9640 1 -- 172.21.15.132:0/4015487704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c06d0a0 msgr2=0x7f2f2c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.893+0000 7f2f31ba9640 1 --2- 172.21.15.132:0/4015487704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c06d0a0 0x7f2f2c152f20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2f200097a0 tx=0x7f2f2002b8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.893+0000 7f2f31ba9640 1 -- 172.21.15.132:0/4015487704 shutdown_connections 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.893+0000 7f2f31ba9640 1 --2- 172.21.15.132:0/4015487704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c06d0a0 0x7f2f2c152f20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.893+0000 7f2f31ba9640 1 -- 172.21.15.132:0/4015487704 >> 172.21.15.132:0/4015487704 conn(0x7f2f2c06a500 msgr2=0x7f2f2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.894+0000 7f2f31ba9640 1 -- 172.21.15.132:0/4015487704 shutdown_connections 2023-11-18T20:41:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.894+0000 7f2f31ba9640 1 -- 172.21.15.132:0/4015487704 wait complete. 2023-11-18T20:41:03.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.895+0000 7f2f31ba9640 1 Processor -- start 2023-11-18T20:41:03.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.895+0000 7f2f31ba9640 1 -- start start 2023-11-18T20:41:03.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f31ba9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f2c06d0a0 0x7f2f2c151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f31ba9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0c3ea0 0x7f2f2c14c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f31ba9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c14fd30 0x7f2f2c14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f31ba9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1dce10 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f31ba9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1dc3e0 con 0x7f2f2c06d0a0 2023-11-18T20:41:03.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f31ba9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1dc680 con 0x7f2f2c14fd30 2023-11-18T20:41:03.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f2affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0c3ea0 0x7f2f2c14c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f2affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0c3ea0 0x7f2f2c14c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59632/0 (socket says 172.21.15.132:59632) 2023-11-18T20:41:03.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.896+0000 7f2f2affd640 1 -- 172.21.15.132:0/84730407 learned_addr learned my addr 172.21.15.132:0/84730407 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f2bfff640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c14fd30 0x7f2f2c14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f2affd640 1 -- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c14fd30 msgr2=0x7f2f2c14c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f2b7fe640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f2c06d0a0 0x7f2f2c151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f2affd640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c14fd30 0x7f2f2c14c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f2affd640 1 -- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f2c06d0a0 msgr2=0x7f2f2c151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f2affd640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f2c06d0a0 0x7f2f2c151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f2affd640 1 -- 172.21.15.132:0/84730407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20009400 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f2affd640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0c3ea0 0x7f2f2c14c3b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f13fff640 1 -- 172.21.15.132:0/84730407 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2003ab60 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f13fff640 1 -- 172.21.15.132:0/84730407 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2003ace0 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c1563f0 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f13fff640 1 -- 172.21.15.132:0/84730407 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20044630 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.897+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c1e8930 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.899+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c068350 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.899+0000 7f2f13fff640 1 -- 172.21.15.132:0/84730407 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f2004d450 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.900+0000 7f2f13fff640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f1806ae40 0x7f2f1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:03.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.900+0000 7f2f13fff640 1 -- 172.21.15.132:0/84730407 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f2f200ab910 con 0x7f2f2c0c3ea0 2023-11-18T20:41:03.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.901+0000 7f2f2b7fe640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f1806ae40 0x7f2f1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:03.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.902+0000 7f2f2b7fe640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f1806ae40 0x7f2f1806d300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c007fd0 tx=0x7f2f1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:03.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:03.904+0000 7f2f13fff640 1 -- 172.21.15.132:0/84730407 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f20076910 con 0x7f2f2c0c3ea0 2023-11-18T20:41:04.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.095+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f2c1dc7c0 con 0x7f2f2c0c3ea0 2023-11-18T20:41:04.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.097+0000 7f2f13fff640 1 -- 172.21.15.132:0/84730407 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16776 (secure 0 0 0) 0x7f2f20079f30 con 0x7f2f2c0c3ea0 2023-11-18T20:41:04.099 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:04.099 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":64,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:01.420823+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.29","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/3392191515":"2023-11-19T20:40:58.199045+0000","172.21.15.132:6834/3392191515":"2023-11-19T20:40:58.199045+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:04.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f1806ae40 msgr2=0x7f2f1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f1806ae40 0x7f2f1806d300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c007fd0 tx=0x7f2f1c009040 comp rx=0 tx=0).stop 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0c3ea0 msgr2=0x7f2f2c14c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0c3ea0 0x7f2f2c14c3b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f200046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 shutdown_connections 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f1806ae40 0x7f2f1806d300 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c14fd30 0x7f2f2c14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0c3ea0 0x7f2f2c14c3b0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 --2- 172.21.15.132:0/84730407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f2c06d0a0 0x7f2f2c151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 >> 172.21.15.132:0/84730407 conn(0x7f2f2c06a500 msgr2=0x7f2f2c0c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 shutdown_connections 2023-11-18T20:41:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.100+0000 7f2f31ba9640 1 -- 172.21.15.132:0/84730407 wait complete. 2023-11-18T20:41:04.121 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-18T20:41:04.121 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:41:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.320+0000 7f60a71f4640 1 Processor -- start 2023-11-18T20:41:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.320+0000 7f60a71f4640 1 -- start start 2023-11-18T20:41:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.321+0000 7f60a71f4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60a014e7f0 0x7f60a00c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.321+0000 7f60a71f4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60a006cd20 0x7f60a015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.321+0000 7f60a71f4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00a8380 con 0x7f60a00c52e0 2023-11-18T20:41:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.321+0000 7f60a71f4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a01510b0 con 0x7f60a014e7f0 2023-11-18T20:41:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.321+0000 7f60a71f4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a006bf60 con 0x7f60a006cd20 2023-11-18T20:41:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.321+0000 7f60a61f2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60a014e7f0 0x7f60a00c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.321+0000 7f60a59f1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f60a00c52e0 0x7f60a006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45788/0 (socket says 172.21.15.132:45788) 2023-11-18T20:41:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.321+0000 7f60a59f1640 1 -- 172.21.15.132:0/1430795943 learned_addr learned my addr 172.21.15.132:0/1430795943 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.322+0000 7f60a61f2640 1 -- 172.21.15.132:0/1430795943 >> v2:172.21.15.161:3300/0 conn(0x7f60a006cd20 msgr2=0x7f60a015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.322+0000 7f60a69f3640 1 --2- 172.21.15.132:0/1430795943 >> v2:172.21.15.161:3300/0 conn(0x7f60a006cd20 0x7f60a015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.322+0000 7f60a61f2640 1 --2- 172.21.15.132:0/1430795943 >> v2:172.21.15.161:3300/0 conn(0x7f60a006cd20 0x7f60a015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.322+0000 7f60a61f2640 1 -- 172.21.15.132:0/1430795943 >> v1:172.21.15.132:6789/0 conn(0x7f60a00c52e0 legacy=0x7f60a006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.322+0000 7f60a51f0640 1 -- 172.21.15.132:0/1430795943 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478033130 0 0) 0x7f60a00a8380 con 0x7f60a00c52e0 2023-11-18T20:41:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.322+0000 7f60a61f2640 1 -- 172.21.15.132:0/1430795943 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a006c240 con 0x7f60a014e7f0 2023-11-18T20:41:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.322+0000 7f60a69f3640 1 --2- 172.21.15.132:0/1430795943 >> v2:172.21.15.161:3300/0 conn(0x7f60a006cd20 0x7f60a015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.323+0000 7f60a61f2640 1 --2- 172.21.15.132:0/1430795943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a00c0440 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f60a00c1f50 tx=0x7f609c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2d342ca4c68ad4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.323+0000 7f60a51f0640 1 -- 172.21.15.132:0/1430795943 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c02e070 con 0x7f60a014e7f0 2023-11-18T20:41:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.323+0000 7f60a51f0640 1 -- 172.21.15.132:0/1430795943 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c0315a0 con 0x7f60a014e7f0 2023-11-18T20:41:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.323+0000 7f60a51f0640 1 -- 172.21.15.132:0/1430795943 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c031930 con 0x7f60a014e7f0 2023-11-18T20:41:04.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.324+0000 7f60a71f4640 1 -- 172.21.15.132:0/1430795943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 msgr2=0x7f60a00c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.324+0000 7f60a71f4640 1 --2- 172.21.15.132:0/1430795943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a00c0440 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f60a00c1f50 tx=0x7f609c02b840 comp rx=0 tx=0).stop 2023-11-18T20:41:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.324+0000 7f60a71f4640 1 -- 172.21.15.132:0/1430795943 shutdown_connections 2023-11-18T20:41:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.324+0000 7f60a71f4640 1 --2- 172.21.15.132:0/1430795943 >> v2:172.21.15.161:3300/0 conn(0x7f60a006cd20 0x7f60a015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.324+0000 7f60a71f4640 1 --2- 172.21.15.132:0/1430795943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a00c0440 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.324+0000 7f60a71f4640 1 -- 172.21.15.132:0/1430795943 >> 172.21.15.132:0/1430795943 conn(0x7f60a00a77f0 msgr2=0x7f60a00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.324+0000 7f60a71f4640 1 -- 172.21.15.132:0/1430795943 shutdown_connections 2023-11-18T20:41:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.324+0000 7f60a71f4640 1 -- 172.21.15.132:0/1430795943 wait complete. 2023-11-18T20:41:04.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.325+0000 7f60a71f4640 1 Processor -- start 2023-11-18T20:41:04.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.326+0000 7f60a71f4640 1 -- start start 2023-11-18T20:41:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.326+0000 7f60a71f4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60a006cd20 0x7f60a014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.326+0000 7f60a71f4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60a00c52e0 0x7f60a014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.326+0000 7f60a71f4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a01ea590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.326+0000 7f60a71f4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0141b20 con 0x7f60a014e7f0 2023-11-18T20:41:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.326+0000 7f60a71f4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a014e010 con 0x7f60a006cd20 2023-11-18T20:41:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.326+0000 7f60a71f4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0150810 con 0x7f60a00c52e0 2023-11-18T20:41:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a01ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a01ea590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59656/0 (socket says 172.21.15.132:59656) 2023-11-18T20:41:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 -- 172.21.15.132:0/4283479882 learned_addr learned my addr 172.21.15.132:0/4283479882 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a61f2640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60a006cd20 0x7f60a014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a59f1640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60a00c52e0 0x7f60a014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 -- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60a00c52e0 msgr2=0x7f60a014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60a00c52e0 0x7f60a014dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 -- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60a006cd20 msgr2=0x7f60a014ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60a006cd20 0x7f60a014ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 -- 172.21.15.132:0/4283479882 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c009400 con 0x7f60a014e7f0 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.327+0000 7f60a69f3640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a01ea590 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f609800cef0 tx=0x7f609800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.328+0000 7f6092ffd640 1 -- 172.21.15.132:0/4283479882 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800d840 con 0x7f60a014e7f0 2023-11-18T20:41:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.328+0000 7f6092ffd640 1 -- 172.21.15.132:0/4283479882 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609800d9c0 con 0x7f60a014e7f0 2023-11-18T20:41:04.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.328+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a0150af0 con 0x7f60a014e7f0 2023-11-18T20:41:04.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.328+0000 7f6092ffd640 1 -- 172.21.15.132:0/4283479882 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800dd70 con 0x7f60a014e7f0 2023-11-18T20:41:04.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.328+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a01e9d90 con 0x7f60a014e7f0 2023-11-18T20:41:04.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.330+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a004e840 con 0x7f60a014e7f0 2023-11-18T20:41:04.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.330+0000 7f6092ffd640 1 -- 172.21.15.132:0/4283479882 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f609801e3b0 con 0x7f60a014e7f0 2023-11-18T20:41:04.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.331+0000 7f6092ffd640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f608406ae40 0x7f608406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.331+0000 7f6092ffd640 1 -- 172.21.15.132:0/4283479882 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f609808a180 con 0x7f60a014e7f0 2023-11-18T20:41:04.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.332+0000 7f60a61f2640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f608406ae40 0x7f608406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.333+0000 7f60a61f2640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f608406ae40 0x7f608406d300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f609c036000 tx=0x7f609c03d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:04.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.336+0000 7f6092ffd640 1 -- 172.21.15.132:0/4283479882 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6098055180 con 0x7f60a014e7f0 2023-11-18T20:41:04.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.559+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a00c3c70 con 0x7f60a014e7f0 2023-11-18T20:41:04.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.560+0000 7f6092ffd640 1 -- 172.21.15.132:0/4283479882 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f60980587a0 con 0x7f60a014e7f0 2023-11-18T20:41:04.562 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/417491622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":417491622},{"type":"v1","addr":"172.21.15.132:6835","nonce":417491622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:30.829157+0000","modified":"2023-11-18T20:40:33.909984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-18T20:41:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 37 2023-11-18T20:41:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f608406ae40 msgr2=0x7f608406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f608406ae40 0x7f608406d300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f609c036000 tx=0x7f609c03d040 comp rx=0 tx=0).stop 2023-11-18T20:41:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 msgr2=0x7f60a01ea590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a01ea590 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f609800cef0 tx=0x7f609800a710 comp rx=0 tx=0).stop 2023-11-18T20:41:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 shutdown_connections 2023-11-18T20:41:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f608406ae40 0x7f608406d300 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a014e7f0 0x7f60a01ea590 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60a00c52e0 0x7f60a014dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 --2- 172.21.15.132:0/4283479882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60a006cd20 0x7f60a014ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 >> 172.21.15.132:0/4283479882 conn(0x7f60a00a77f0 msgr2=0x7f60a00a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 shutdown_connections 2023-11-18T20:41:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.563+0000 7f60a71f4640 1 -- 172.21.15.132:0/4283479882 wait complete. 2023-11-18T20:41:04.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:41:04.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.791+0000 7fe9054a9640 1 Processor -- start 2023-11-18T20:41:04.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.791+0000 7fe9054a9640 1 -- start start 2023-11-18T20:41:04.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.792+0000 7fe9054a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9000c45d0 0x7fe900155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.792+0000 7fe9054a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 0x7fe900156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.792+0000 7fe9054a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9000bfdc0 con 0x7fe9000c5ec0 2023-11-18T20:41:04.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.792+0000 7fe9054a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90006e390 con 0x7fe9000c45d0 2023-11-18T20:41:04.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.792+0000 7fe9054a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90006ddd0 con 0x7fe9000c3340 2023-11-18T20:41:04.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8feffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe9000c5ec0 0x7fe9000c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45802/0 (socket says 172.21.15.132:45802) 2023-11-18T20:41:04.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8feffd640 1 -- 172.21.15.132:0/1076519359 learned_addr learned my addr 172.21.15.132:0/1076519359 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:04.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8f67fc640 1 --2- 172.21.15.132:0/1076519359 >> v2:172.21.15.132:3300/0 conn(0x7fe9000c45d0 0x7fe900155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8fe7fc640 1 -- 172.21.15.132:0/1076519359 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706969758 0 0) 0x7fe9000bfdc0 con 0x7fe9000c5ec0 2023-11-18T20:41:04.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8fe7fc640 1 -- 172.21.15.132:0/1076519359 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8ec003520 con 0x7fe9000c5ec0 2023-11-18T20:41:04.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8ff7fe640 1 --2- 172.21.15.132:0/1076519359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 0x7fe900156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8f67fc640 1 -- 172.21.15.132:0/1076519359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 msgr2=0x7fe900156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:04.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8f67fc640 1 --2- 172.21.15.132:0/1076519359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 0x7fe900156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8f67fc640 1 -- 172.21.15.132:0/1076519359 >> v1:172.21.15.132:6789/0 conn(0x7fe9000c5ec0 legacy=0x7fe9000c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.793+0000 7fe8f67fc640 1 -- 172.21.15.132:0/1076519359 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90006e0b0 con 0x7fe9000c45d0 2023-11-18T20:41:04.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.794+0000 7fe8f67fc640 1 --2- 172.21.15.132:0/1076519359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c45d0 0x7fe900155e30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097d0 tx=0x7fe8e802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3f4979cce88025 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:04.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe8fe7fc640 1 -- 172.21.15.132:0/1076519359 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80316f0 con 0x7fe9000c45d0 2023-11-18T20:41:04.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe8fe7fc640 1 -- 172.21.15.132:0/1076519359 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8031850 con 0x7fe9000c45d0 2023-11-18T20:41:04.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe8fe7fc640 1 -- 172.21.15.132:0/1076519359 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8031be0 con 0x7fe9000c45d0 2023-11-18T20:41:04.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe9054a9640 1 -- 172.21.15.132:0/1076519359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c45d0 msgr2=0x7fe900155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe9054a9640 1 --2- 172.21.15.132:0/1076519359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c45d0 0x7fe900155e30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097d0 tx=0x7fe8e802b790 comp rx=0 tx=0).stop 2023-11-18T20:41:04.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe9054a9640 1 -- 172.21.15.132:0/1076519359 shutdown_connections 2023-11-18T20:41:04.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe9054a9640 1 --2- 172.21.15.132:0/1076519359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 0x7fe900156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe9054a9640 1 --2- 172.21.15.132:0/1076519359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c45d0 0x7fe900155e30 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe9054a9640 1 -- 172.21.15.132:0/1076519359 >> 172.21.15.132:0/1076519359 conn(0x7fe90006a500 msgr2=0x7fe90006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:04.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe9054a9640 1 -- 172.21.15.132:0/1076519359 shutdown_connections 2023-11-18T20:41:04.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.795+0000 7fe9054a9640 1 -- 172.21.15.132:0/1076519359 wait complete. 2023-11-18T20:41:04.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.797+0000 7fe9054a9640 1 Processor -- start 2023-11-18T20:41:04.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.797+0000 7fe9054a9640 1 -- start start 2023-11-18T20:41:04.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe9054a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 0x7fe900150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe9054a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9000c45d0 0x7fe90014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe9054a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c5ec0 0x7fe90014daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe9054a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90014e860 con 0x7fe9000c5ec0 2023-11-18T20:41:04.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe9054a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe900150ff0 con 0x7fe9000c45d0 2023-11-18T20:41:04.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe9054a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90014ba70 con 0x7fe9000c3340 2023-11-18T20:41:04.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe8ff7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c5ec0 0x7fe90014daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe8ff7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c5ec0 0x7fe90014daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59662/0 (socket says 172.21.15.132:59662) 2023-11-18T20:41:04.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.798+0000 7fe8ff7fe640 1 -- 172.21.15.132:0/608846962 learned_addr learned my addr 172.21.15.132:0/608846962 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:04.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8feffd640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 0x7fe900150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8f67fc640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9000c45d0 0x7fe90014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8ff7fe640 1 -- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 msgr2=0x7fe900150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8ff7fe640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 0x7fe900150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8ff7fe640 1 -- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9000c45d0 msgr2=0x7fe90014d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8ff7fe640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9000c45d0 0x7fe90014d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8ff7fe640 1 -- 172.21.15.132:0/608846962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8009400 con 0x7fe9000c5ec0 2023-11-18T20:41:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8ff7fe640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c5ec0 0x7fe90014daa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8007e70 tx=0x7fe8f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8f7fff640 1 -- 172.21.15.132:0/608846962 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8014620 con 0x7fe9000c5ec0 2023-11-18T20:41:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8f7fff640 1 -- 172.21.15.132:0/608846962 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f80147a0 con 0x7fe9000c5ec0 2023-11-18T20:41:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe8f7fff640 1 -- 172.21.15.132:0/608846962 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8014b50 con 0x7fe9000c5ec0 2023-11-18T20:41:04.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90014dfe0 con 0x7fe9000c5ec0 2023-11-18T20:41:04.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.799+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe900151240 con 0x7fe9000c5ec0 2023-11-18T20:41:04.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.800+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90014bbb0 con 0x7fe9000c5ec0 2023-11-18T20:41:04.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.801+0000 7fe8f7fff640 1 -- 172.21.15.132:0/608846962 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8f8014cb0 con 0x7fe9000c5ec0 2023-11-18T20:41:04.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.802+0000 7fe8f7fff640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe8e006ae40 0x7fe8e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:04.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.802+0000 7fe8f7fff640 1 -- 172.21.15.132:0/608846962 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fe8f8089ff0 con 0x7fe9000c5ec0 2023-11-18T20:41:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.803+0000 7fe8feffd640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe8e006ae40 0x7fe8e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.804+0000 7fe8feffd640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe8e006ae40 0x7fe8e006d300 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00011e0 tx=0x7fe8f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:04.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:04.806+0000 7fe8f7fff640 1 -- 172.21.15.132:0/608846962 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe90014bbb0 con 0x7fe9000c5ec0 2023-11-18T20:41:05.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.030+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe90014bbb0 con 0x7fe9000c5ec0 2023-11-18T20:41:05.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.031+0000 7fe8f7fff640 1 -- 172.21.15.132:0/608846962 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fe90014bbb0 con 0x7fe9000c5ec0 2023-11-18T20:41:05.032 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:05.032 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/417491622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":417491622},{"type":"v1","addr":"172.21.15.132:6835","nonce":417491622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:40:30.829157+0000","modified":"2023-11-18T20:40:33.909984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6833/3297068463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3297068463},{"type":"v1","addr":"172.21.15.132:6833","nonce":3297068463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-18T20:41:05.033 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 37 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.033+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe8e006ae40 msgr2=0x7fe8e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.033+0000 7fe9054a9640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe8e006ae40 0x7fe8e006d300 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00011e0 tx=0x7fe8f0009040 comp rx=0 tx=0).stop 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.033+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c5ec0 msgr2=0x7fe90014daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.033+0000 7fe9054a9640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c5ec0 0x7fe90014daa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8007e70 tx=0x7fe8f800e4b0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.034+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 shutdown_connections 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.034+0000 7fe9054a9640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe8e006ae40 0x7fe8e006d300 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.034+0000 7fe9054a9640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c5ec0 0x7fe90014daa0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.034+0000 7fe9054a9640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9000c45d0 0x7fe90014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.034+0000 7fe9054a9640 1 --2- 172.21.15.132:0/608846962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe9000c3340 0x7fe900150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.034+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 >> 172.21.15.132:0/608846962 conn(0x7fe90006a500 msgr2=0x7fe900072180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:05.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.034+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 shutdown_connections 2023-11-18T20:41:05.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.034+0000 7fe9054a9640 1 -- 172.21.15.132:0/608846962 wait complete. 2023-11-18T20:41:05.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.256+0000 7fd110a15640 1 Processor -- start 2023-11-18T20:41:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.257+0000 7fd110a15640 1 -- start start 2023-11-18T20:41:05.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.258+0000 7fd110a15640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c0c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.258+0000 7fd110a15640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd10c0c6c60 0x7fd10c0a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.258+0000 7fd110a15640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c0c8510 con 0x7fd10c155d40 2023-11-18T20:41:05.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.258+0000 7fd110a15640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c0c5cc0 con 0x7fd10c0c6c60 2023-11-18T20:41:05.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.258+0000 7fd110a15640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0c5ea0 con 0x7fd10c0c7a20 2023-11-18T20:41:05.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.259+0000 7fd10a59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c0c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.259+0000 7fd10a59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c0c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:35532/0 (socket says 172.21.15.132:35532) 2023-11-18T20:41:05.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.259+0000 7fd10a59c640 1 -- 172.21.15.132:0/3124069760 learned_addr learned my addr 172.21.15.132:0/3124069760 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:05.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.259+0000 7fd10ad9d640 1 --2- 172.21.15.132:0/3124069760 >> v2:172.21.15.161:3300/0 conn(0x7fd10c0c6c60 0x7fd10c0a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.260+0000 7fd10a59c640 1 -- 172.21.15.132:0/3124069760 >> v2:172.21.15.161:3300/0 conn(0x7fd10c0c6c60 msgr2=0x7fd10c0a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:05.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.260+0000 7fd10a59c640 1 --2- 172.21.15.132:0/3124069760 >> v2:172.21.15.161:3300/0 conn(0x7fd10c0c6c60 0x7fd10c0a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.260+0000 7fd10a59c640 1 -- 172.21.15.132:0/3124069760 >> v1:172.21.15.161:6789/0 conn(0x7fd10c155d40 legacy=0x7fd10c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.260+0000 7fd10a59c640 1 -- 172.21.15.132:0/3124069760 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c0c6180 con 0x7fd10c0c7a20 2023-11-18T20:41:05.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.261+0000 7fd10a59c640 1 --2- 172.21.15.132:0/3124069760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c0c1c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0098a0 tx=0x7fd0fc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e7c62a97672a903 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:05.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.262+0000 7fd10959a640 1 -- 172.21.15.132:0/3124069760 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc030840 con 0x7fd10c0c7a20 2023-11-18T20:41:05.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.262+0000 7fd10959a640 1 -- 172.21.15.132:0/3124069760 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc0309a0 con 0x7fd10c0c7a20 2023-11-18T20:41:05.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.262+0000 7fd10959a640 1 -- 172.21.15.132:0/3124069760 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc030d30 con 0x7fd10c0c7a20 2023-11-18T20:41:05.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.263+0000 7fd110a15640 1 -- 172.21.15.132:0/3124069760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 msgr2=0x7fd10c0c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.263+0000 7fd110a15640 1 --2- 172.21.15.132:0/3124069760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c0c1c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0098a0 tx=0x7fd0fc02b980 comp rx=0 tx=0).stop 2023-11-18T20:41:05.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.263+0000 7fd110a15640 1 -- 172.21.15.132:0/3124069760 shutdown_connections 2023-11-18T20:41:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.263+0000 7fd110a15640 1 --2- 172.21.15.132:0/3124069760 >> v2:172.21.15.161:3300/0 conn(0x7fd10c0c6c60 0x7fd10c0a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.263+0000 7fd110a15640 1 --2- 172.21.15.132:0/3124069760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c0c1c00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.263+0000 7fd110a15640 1 -- 172.21.15.132:0/3124069760 >> 172.21.15.132:0/3124069760 conn(0x7fd10c0a9b70 msgr2=0x7fd10c0a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.263+0000 7fd110a15640 1 -- 172.21.15.132:0/3124069760 shutdown_connections 2023-11-18T20:41:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.263+0000 7fd110a15640 1 -- 172.21.15.132:0/3124069760 wait complete. 2023-11-18T20:41:05.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.265+0000 7fd110a15640 1 Processor -- start 2023-11-18T20:41:05.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.265+0000 7fd110a15640 1 -- start start 2023-11-18T20:41:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.266+0000 7fd110a15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd10c0c6c60 0x7fd10c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.266+0000 7fd110a15640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c14b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd110a15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd10c155d40 0x7fd10c06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd110a15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c14b5e0 con 0x7fd10c0c6c60 2023-11-18T20:41:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd110a15640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c152050 con 0x7fd10c155d40 2023-11-18T20:41:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd110a15640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c14adc0 con 0x7fd10c0c7a20 2023-11-18T20:41:05.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd10c0c6c60 0x7fd10c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd10c0c6c60 0x7fd10c14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59666/0 (socket says 172.21.15.132:59666) 2023-11-18T20:41:05.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10a59c640 1 -- 172.21.15.132:0/4122732254 learned_addr learned my addr 172.21.15.132:0/4122732254 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10ad9d640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd10c155d40 0x7fd10c06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd109d9b640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c14b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10a59c640 1 -- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 msgr2=0x7fd10c14b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10a59c640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c14b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10a59c640 1 -- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd10c155d40 msgr2=0x7fd10c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10a59c640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd10c155d40 0x7fd10c06f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10a59c640 1 -- 172.21.15.132:0/4122732254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0094d0 con 0x7fd10c0c6c60 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd109d9b640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c14b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.267+0000 7fd10ad9d640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd10c155d40 0x7fd10c06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.268+0000 7fd10a59c640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd10c0c6c60 0x7fd10c14ee20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc000c00 tx=0x7fd0fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.268+0000 7fd102ffd640 1 -- 172.21.15.132:0/4122732254 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc039c90 con 0x7fd10c0c6c60 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.268+0000 7fd102ffd640 1 -- 172.21.15.132:0/4122732254 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc039df0 con 0x7fd10c0c6c60 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.268+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c14e860 con 0x7fd10c0c6c60 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.268+0000 7fd102ffd640 1 -- 172.21.15.132:0/4122732254 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc043640 con 0x7fd10c0c6c60 2023-11-18T20:41:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.268+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c06fe30 con 0x7fd10c0c6c60 2023-11-18T20:41:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.270+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0c3b00 con 0x7fd10c0c6c60 2023-11-18T20:41:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.270+0000 7fd102ffd640 1 -- 172.21.15.132:0/4122732254 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0fc0437a0 con 0x7fd10c0c6c60 2023-11-18T20:41:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.271+0000 7fd102ffd640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0f406ae40 0x7fd0f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.271+0000 7fd102ffd640 1 -- 172.21.15.132:0/4122732254 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fd0fc03e070 con 0x7fd10c0c6c60 2023-11-18T20:41:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.272+0000 7fd109d9b640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0f406ae40 0x7fd0f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.273+0000 7fd109d9b640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0f406ae40 0x7fd0f406d300 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd10c14d2d0 tx=0x7fd0f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.276+0000 7fd102ffd640 1 -- 172.21.15.132:0/4122732254 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0fc0776e0 con 0x7fd10c0c6c60 2023-11-18T20:41:05.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.467+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd10c068350 con 0x7fd10c0c6c60 2023-11-18T20:41:05.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.470+0000 7fd102ffd640 1 -- 172.21.15.132:0/4122732254 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16776 (secure 0 0 0) 0x7fd0fc07ad00 con 0x7fd10c0c6c60 2023-11-18T20:41:05.471 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:05.472 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":64,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:01.420823+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:40:28.826395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:40:29.825753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.29","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/3392191515":"2023-11-19T20:40:58.199045+0000","172.21.15.132:6834/3392191515":"2023-11-19T20:40:58.199045+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:05.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0f406ae40 msgr2=0x7fd0f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0f406ae40 0x7fd0f406d300 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd10c14d2d0 tx=0x7fd0f8009040 comp rx=0 tx=0).stop 2023-11-18T20:41:05.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd10c0c6c60 msgr2=0x7fd10c14ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd10c0c6c60 0x7fd10c14ee20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc000c00 tx=0x7fd0fc004730 comp rx=0 tx=0).stop 2023-11-18T20:41:05.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 shutdown_connections 2023-11-18T20:41:05.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd0f406ae40 0x7fd0f406d300 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd10c155d40 0x7fd10c06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd10c0c7a20 0x7fd10c14b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 --2- 172.21.15.132:0/4122732254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd10c0c6c60 0x7fd10c14ee20 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 >> 172.21.15.132:0/4122732254 conn(0x7fd10c0a9b70 msgr2=0x7fd10c156200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:05.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 shutdown_connections 2023-11-18T20:41:05.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.473+0000 7fd110a15640 1 -- 172.21.15.132:0/4122732254 wait complete. 2023-11-18T20:41:05.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-18T20:41:05.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.697+0000 7f3fc6701640 1 Processor -- start 2023-11-18T20:41:05.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.697+0000 7f3fc6701640 1 -- start start 2023-11-18T20:41:05.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.698+0000 7f3fc6701640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 0x7f3fc0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.698+0000 7f3fc6701640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fc00c3ea0 0x7f3fc00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.698+0000 7f3fc6701640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00c64a0 con 0x7f3fc014fd30 2023-11-18T20:41:05.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.698+0000 7f3fc6701640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00c5c00 con 0x7f3fc00c3ea0 2023-11-18T20:41:05.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.698+0000 7f3fc6701640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00c5ee0 con 0x7f3fc006d0a0 2023-11-18T20:41:05.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.699+0000 7f3fc4c9e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fc00c3ea0 0x7f3fc00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.699+0000 7f3fc4c9e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fc00c3ea0 0x7f3fc00c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59678/0 (socket says 172.21.15.132:59678) 2023-11-18T20:41:05.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.699+0000 7f3fc4c9e640 1 -- 172.21.15.132:0/4084310597 learned_addr learned my addr 172.21.15.132:0/4084310597 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:05.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.699+0000 7f3fc4c9e640 1 -- 172.21.15.132:0/4084310597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 msgr2=0x7f3fc0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:05.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.699+0000 7f3fc4c9e640 1 --2- 172.21.15.132:0/4084310597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 0x7f3fc0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.699+0000 7f3fc4c9e640 1 -- 172.21.15.132:0/4084310597 >> v1:172.21.15.161:6789/0 conn(0x7f3fc014fd30 legacy=0x7f3fc00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.699+0000 7f3fc4c9e640 1 -- 172.21.15.132:0/4084310597 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00c61c0 con 0x7f3fc00c3ea0 2023-11-18T20:41:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.700+0000 7f3fc4c9e640 1 --2- 172.21.15.132:0/4084310597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc00c3ea0 0x7f3fc00c4330 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009e50 tx=0x7f3fb802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8895912a04b42f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.701+0000 7f3fbeffd640 1 -- 172.21.15.132:0/4084310597 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb802ca80 con 0x7f3fc00c3ea0 2023-11-18T20:41:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.701+0000 7f3fbeffd640 1 -- 172.21.15.132:0/4084310597 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb802cbe0 con 0x7f3fc00c3ea0 2023-11-18T20:41:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.701+0000 7f3fbeffd640 1 -- 172.21.15.132:0/4084310597 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb80343f0 con 0x7f3fc00c3ea0 2023-11-18T20:41:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.701+0000 7f3fc6701640 1 -- 172.21.15.132:0/4084310597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc00c3ea0 msgr2=0x7f3fc00c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.701+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4084310597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc00c3ea0 0x7f3fc00c4330 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009e50 tx=0x7f3fb802bee0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.702+0000 7f3fc6701640 1 -- 172.21.15.132:0/4084310597 shutdown_connections 2023-11-18T20:41:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.702+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4084310597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc00c3ea0 0x7f3fc00c4330 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.702+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4084310597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 0x7f3fc0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.702+0000 7f3fc6701640 1 -- 172.21.15.132:0/4084310597 >> 172.21.15.132:0/4084310597 conn(0x7f3fc006a500 msgr2=0x7f3fc006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.702+0000 7f3fc6701640 1 -- 172.21.15.132:0/4084310597 shutdown_connections 2023-11-18T20:41:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.702+0000 7f3fc6701640 1 -- 172.21.15.132:0/4084310597 wait complete. 2023-11-18T20:41:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.703+0000 7f3fc6701640 1 Processor -- start 2023-11-18T20:41:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.703+0000 7f3fc6701640 1 -- start start 2023-11-18T20:41:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.704+0000 7f3fc6701640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 0x7f3fc014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.704+0000 7f3fc6701640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fc00c3ea0 0x7f3fc0148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.704+0000 7f3fc6701640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc014fd30 0x7f3fc0148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.704+0000 7f3fc6701640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0151310 con 0x7f3fc014fd30 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.704+0000 7f3fc6701640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00aa0b0 con 0x7f3fc00c3ea0 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.704+0000 7f3fc6701640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc01ee370 con 0x7f3fc006d0a0 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc014fd30 0x7f3fc0148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc014fd30 0x7f3fc0148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59694/0 (socket says 172.21.15.132:59694) 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 -- 172.21.15.132:0/4077289533 learned_addr learned my addr 172.21.15.132:0/4077289533 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fbffff640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 0x7f3fc014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 -- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 msgr2=0x7f3fc014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fbf7fe640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fc00c3ea0 0x7f3fc0148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 0x7f3fc014adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 -- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fc00c3ea0 msgr2=0x7f3fc0148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fc00c3ea0 0x7f3fc0148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 -- 172.21.15.132:0/4077289533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8009b30 con 0x7f3fc014fd30 2023-11-18T20:41:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.705+0000 7f3fc4c9e640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc014fd30 0x7f3fc0148f90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8036040 tx=0x7f3fb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.706+0000 7f3fbcff9640 1 -- 172.21.15.132:0/4077289533 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb803e450 con 0x7f3fc014fd30 2023-11-18T20:41:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.706+0000 7f3fbcff9640 1 -- 172.21.15.132:0/4077289533 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb803e5d0 con 0x7f3fc014fd30 2023-11-18T20:41:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.706+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc00aa350 con 0x7f3fc014fd30 2023-11-18T20:41:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.706+0000 7f3fbcff9640 1 -- 172.21.15.132:0/4077289533 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb803e980 con 0x7f3fc014fd30 2023-11-18T20:41:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.706+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc014bb90 con 0x7f3fc014fd30 2023-11-18T20:41:05.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.707+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc0068350 con 0x7f3fc014fd30 2023-11-18T20:41:05.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.708+0000 7f3fbcff9640 1 -- 172.21.15.132:0/4077289533 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3fb802cd50 con 0x7f3fc014fd30 2023-11-18T20:41:05.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.709+0000 7f3fbcff9640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fac06ae70 0x7f3fac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:05.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.709+0000 7f3fbcff9640 1 -- 172.21.15.132:0/4077289533 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f3fb80abff0 con 0x7f3fc014fd30 2023-11-18T20:41:05.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.709+0000 7f3fbffff640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fac06ae70 0x7f3fac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:05.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.711+0000 7f3fbffff640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fac06ae70 0x7f3fac06d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3fc014b940 tx=0x7f3fb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.713+0000 7f3fbcff9640 1 -- 172.21.15.132:0/4077289533 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fb80dee90 con 0x7f3fc014fd30 2023-11-18T20:41:05.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.946+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f3fc00c66d0 con 0x7f3fc014fd30 2023-11-18T20:41:05.949 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-11-18T20:41:05.948+0000 7feee5f07640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-18T20:41:05.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.951+0000 7f3fbcff9640 1 -- 172.21.15.132:0/4077289533 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3fb8077010 con 0x7f3fc014fd30 2023-11-18T20:41:05.953 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T20:41:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fac06ae70 msgr2=0x7f3fac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fac06ae70 0x7f3fac06d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3fc014b940 tx=0x7f3fb0009040 comp rx=0 tx=0).stop 2023-11-18T20:41:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc014fd30 msgr2=0x7f3fc0148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc014fd30 0x7f3fc0148f90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8036040 tx=0x7f3fb8004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 shutdown_connections 2023-11-18T20:41:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fac06ae70 0x7f3fac06d330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fc014fd30 0x7f3fc0148f90 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fc00c3ea0 0x7f3fc0148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 --2- 172.21.15.132:0/4077289533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fc006d0a0 0x7f3fc014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 >> 172.21.15.132:0/4077289533 conn(0x7f3fc006a500 msgr2=0x7f3fc006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 shutdown_connections 2023-11-18T20:41:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:05.955+0000 7f3fc6701640 1 -- 172.21.15.132:0/4077289533 wait complete. 2023-11-18T20:41:05.971 INFO:tasks.ceph.mds.a.smithi132.stderr: -2178> 2023-11-18T20:40:35.754+0000 7f658eeb8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:41:05.976 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-18T20:41:06.025 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-11-18T20:41:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.167+0000 7f0718890640 1 Processor -- start 2023-11-18T20:41:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.168+0000 7f0718890640 1 -- start start 2023-11-18T20:41:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.169+0000 7f0718890640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0714152f20 0x7f07140c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.169+0000 7f0718890640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07140c64a0 con 0x7f071406d0a0 2023-11-18T20:41:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.169+0000 7f0718890640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07140c5c00 con 0x7f071414fd30 2023-11-18T20:41:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.169+0000 7f0718890640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07140c5ee0 con 0x7f0714152f20 2023-11-18T20:41:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.169+0000 7f0712d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0714152f20 0x7f07140c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:06.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.169+0000 7f0711d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f071406d0a0 0x7f07140c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45808/0 (socket says 172.21.15.132:45808) 2023-11-18T20:41:06.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.169+0000 7f0711d9b640 1 -- 172.21.15.132:0/17983621 learned_addr learned my addr 172.21.15.132:0/17983621 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:06.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.170+0000 7f0712d9d640 1 -- 172.21.15.132:0/17983621 >> v1:172.21.15.161:6789/0 conn(0x7f071414fd30 legacy=0x7f07140a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:06.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.170+0000 7f0712d9d640 1 -- 172.21.15.132:0/17983621 >> v1:172.21.15.132:6789/0 conn(0x7f071406d0a0 legacy=0x7f07140c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:06.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.170+0000 7f0712d9d640 1 -- 172.21.15.132:0/17983621 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07140c61c0 con 0x7f0714152f20 2023-11-18T20:41:06.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.170+0000 7f071159a640 1 -- 172.21.15.132:0/17983621 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328343822 0 0) 0x7f07140c64a0 con 0x7f071406d0a0 2023-11-18T20:41:06.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.171+0000 7f0712d9d640 1 --2- 172.21.15.132:0/17983621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07140c45b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c200f0388f35b152 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:06.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.171+0000 7f071159a640 1 -- 172.21.15.132:0/17983621 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c02cc60 con 0x7f0714152f20 2023-11-18T20:41:06.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.171+0000 7f071159a640 1 -- 172.21.15.132:0/17983621 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c02cdc0 con 0x7f0714152f20 2023-11-18T20:41:06.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.171+0000 7f071159a640 1 -- 172.21.15.132:0/17983621 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c034660 con 0x7f0714152f20 2023-11-18T20:41:06.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.171+0000 7f0718890640 1 -- 172.21.15.132:0/17983621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 msgr2=0x7f07140c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:06.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.171+0000 7f0718890640 1 --2- 172.21.15.132:0/17983621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07140c45b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c02beb0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.172+0000 7f0718890640 1 -- 172.21.15.132:0/17983621 shutdown_connections 2023-11-18T20:41:06.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.172+0000 7f0718890640 1 --2- 172.21.15.132:0/17983621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07140c45b0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.172+0000 7f0718890640 1 -- 172.21.15.132:0/17983621 >> 172.21.15.132:0/17983621 conn(0x7f071406a500 msgr2=0x7f071406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:06.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.172+0000 7f0718890640 1 -- 172.21.15.132:0/17983621 shutdown_connections 2023-11-18T20:41:06.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.172+0000 7f0718890640 1 -- 172.21.15.132:0/17983621 wait complete. 2023-11-18T20:41:06.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.173+0000 7f0718890640 1 Processor -- start 2023-11-18T20:41:06.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.173+0000 7f0718890640 1 -- start start 2023-11-18T20:41:06.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.174+0000 7f0718890640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f071406d0a0 0x7f07140bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:06.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.174+0000 7f0718890640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f071414fd30 0x7f07141ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:06.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.174+0000 7f0718890640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07141de420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:06.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.174+0000 7f0718890640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07141dc9b0 con 0x7f0714152f20 2023-11-18T20:41:06.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.174+0000 7f0718890640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07141de960 con 0x7f071414fd30 2023-11-18T20:41:06.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.174+0000 7f0718890640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07141dc3f0 con 0x7f071406d0a0 2023-11-18T20:41:06.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07141de420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:06.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07141de420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59728/0 (socket says 172.21.15.132:59728) 2023-11-18T20:41:06.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 -- 172.21.15.132:0/2113839120 learned_addr learned my addr 172.21.15.132:0/2113839120 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:06.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 -- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f071406d0a0 msgr2=0x7f07140bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:06.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f071406d0a0 0x7f07140bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 -- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f071414fd30 msgr2=0x7f07141ddee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:06.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f071414fd30 0x7f07141ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 -- 172.21.15.132:0/2113839120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c009a70 con 0x7f0714152f20 2023-11-18T20:41:06.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0712d9d640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07141de420 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:06.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.175+0000 7f0702ffd640 1 -- 172.21.15.132:0/2113839120 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c03e610 con 0x7f0714152f20 2023-11-18T20:41:06.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.176+0000 7f0702ffd640 1 -- 172.21.15.132:0/2113839120 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c03e790 con 0x7f0714152f20 2023-11-18T20:41:06.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.176+0000 7f0702ffd640 1 -- 172.21.15.132:0/2113839120 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c03eb40 con 0x7f0714152f20 2023-11-18T20:41:06.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.176+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07141dc6d0 con 0x7f0714152f20 2023-11-18T20:41:06.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.176+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07140bf8a0 con 0x7f0714152f20 2023-11-18T20:41:06.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.177+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07140aa9d0 con 0x7f0714152f20 2023-11-18T20:41:06.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.178+0000 7f0702ffd640 1 -- 172.21.15.132:0/2113839120 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f070c03b050 con 0x7f0714152f20 2023-11-18T20:41:06.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.178+0000 7f0702ffd640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06f406ae40 0x7f06f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:06.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.179+0000 7f0702ffd640 1 -- 172.21.15.132:0/2113839120 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f070c0ac130 con 0x7f0714152f20 2023-11-18T20:41:06.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.179+0000 7f071259c640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06f406ae40 0x7f06f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:06.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.180+0000 7f071259c640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06f406ae40 0x7f06f406d300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0704003cc0 tx=0x7f07040079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:06.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.182+0000 7f0702ffd640 1 -- 172.21.15.132:0/2113839120 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f070c0770f0 con 0x7f0714152f20 2023-11-18T20:41:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.413+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0714068350 con 0x7f0714152f20 2023-11-18T20:41:06.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.955+0000 7f0702ffd640 1 -- 172.21.15.132:0/2113839120 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 105+0+0 (secure 0 0 0) 0x7f070c07a710 con 0x7f0714152f20 2023-11-18T20:41:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06f406ae40 msgr2=0x7f06f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06f406ae40 0x7f06f406d300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0704003cc0 tx=0x7f07040079b0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 msgr2=0x7f07141de420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07141de420 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 shutdown_connections 2023-11-18T20:41:06.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06f406ae40 0x7f06f406d300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0714152f20 0x7f07141de420 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f071414fd30 0x7f07141ddee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 --2- 172.21.15.132:0/2113839120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f071406d0a0 0x7f07140bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 >> 172.21.15.132:0/2113839120 conn(0x7f071406a500 msgr2=0x7f07140c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 shutdown_connections 2023-11-18T20:41:06.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:06.959+0000 7f0718890640 1 -- 172.21.15.132:0/2113839120 wait complete. 2023-11-18T20:41:06.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-18T20:41:07.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.189+0000 7f51f20b4640 1 Processor -- start 2023-11-18T20:41:07.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.189+0000 7f51f20b4640 1 -- start start 2023-11-18T20:41:07.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.191+0000 7f51f20b4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51ec151d80 0x7f51ec0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:07.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.191+0000 7f51f20b4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51ec0c1070 0x7f51ec06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:07.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.191+0000 7f51f20b4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec06d510 con 0x7f51ec0c34c0 2023-11-18T20:41:07.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.191+0000 7f51f20b4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec06e9c0 con 0x7f51ec0c1070 2023-11-18T20:41:07.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.191+0000 7f51f20b4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0c32a0 con 0x7f51ec151d80 2023-11-18T20:41:07.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.191+0000 7f51ebfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f51ec0c34c0 0x7f51ec1546d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45816/0 (socket says 172.21.15.132:45816) 2023-11-18T20:41:07.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.191+0000 7f51ebfff640 1 -- 172.21.15.132:0/2459802277 learned_addr learned my addr 172.21.15.132:0/2459802277 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:07.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.191+0000 7f51eaffd640 1 --2- 172.21.15.132:0/2459802277 >> v2:172.21.15.132:3300/0 conn(0x7f51ec0c1070 0x7f51ec06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:07.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.192+0000 7f51eb7fe640 1 --2- 172.21.15.132:0/2459802277 >> v2:172.21.15.161:3300/0 conn(0x7f51ec151d80 0x7f51ec0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:07.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.192+0000 7f51eaffd640 1 -- 172.21.15.132:0/2459802277 >> v2:172.21.15.161:3300/0 conn(0x7f51ec151d80 msgr2=0x7f51ec0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:07.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.192+0000 7f51eaffd640 1 --2- 172.21.15.132:0/2459802277 >> v2:172.21.15.161:3300/0 conn(0x7f51ec151d80 0x7f51ec0ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.192+0000 7f51eaffd640 1 -- 172.21.15.132:0/2459802277 >> v1:172.21.15.132:6789/0 conn(0x7f51ec0c34c0 legacy=0x7f51ec1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:07.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.192+0000 7f51eaffd640 1 -- 172.21.15.132:0/2459802277 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec152160 con 0x7f51ec0c1070 2023-11-18T20:41:07.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.192+0000 7f51ea7fc640 1 -- 172.21.15.132:0/2459802277 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354178955 0 0) 0x7f51ec06d510 con 0x7f51ec0c34c0 2023-11-18T20:41:07.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.193+0000 7f51eaffd640 1 --2- 172.21.15.132:0/2459802277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec06a500 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f51ec072400 tx=0x7f51d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea851c4de82d66a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:07.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.193+0000 7f51ea7fc640 1 -- 172.21.15.132:0/2459802277 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4031830 con 0x7f51ec0c1070 2023-11-18T20:41:07.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.193+0000 7f51ea7fc640 1 -- 172.21.15.132:0/2459802277 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4031990 con 0x7f51ec0c1070 2023-11-18T20:41:07.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.193+0000 7f51ea7fc640 1 -- 172.21.15.132:0/2459802277 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4031d20 con 0x7f51ec0c1070 2023-11-18T20:41:07.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.194+0000 7f51f20b4640 1 -- 172.21.15.132:0/2459802277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 msgr2=0x7f51ec06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:07.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.194+0000 7f51f20b4640 1 --2- 172.21.15.132:0/2459802277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec06a500 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f51ec072400 tx=0x7f51d402b8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.194+0000 7f51f20b4640 1 -- 172.21.15.132:0/2459802277 shutdown_connections 2023-11-18T20:41:07.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.194+0000 7f51f20b4640 1 --2- 172.21.15.132:0/2459802277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec06a500 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.194+0000 7f51f20b4640 1 --2- 172.21.15.132:0/2459802277 >> v2:172.21.15.161:3300/0 conn(0x7f51ec151d80 0x7f51ec0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.194+0000 7f51f20b4640 1 -- 172.21.15.132:0/2459802277 >> 172.21.15.132:0/2459802277 conn(0x7f51ec0c3970 msgr2=0x7f51ec0c3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:07.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.194+0000 7f51f20b4640 1 -- 172.21.15.132:0/2459802277 shutdown_connections 2023-11-18T20:41:07.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.194+0000 7f51f20b4640 1 -- 172.21.15.132:0/2459802277 wait complete. 2023-11-18T20:41:07.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.196+0000 7f51f20b4640 1 Processor -- start 2023-11-18T20:41:07.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.196+0000 7f51f20b4640 1 -- start start 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51f20b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51f20b4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51ec0c34c0 0x7f51ec1ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51f20b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51ec151d80 0x7f51ec14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51f20b4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1deac0 con 0x7f51ec0c1070 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51f20b4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1ee1b0 con 0x7f51ec151d80 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51f20b4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1de750 con 0x7f51ec0c34c0 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec14d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59738/0 (socket says 172.21.15.132:59738) 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51eb7fe640 1 -- 172.21.15.132:0/1106017305 learned_addr learned my addr 172.21.15.132:0/1106017305 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.197+0000 7f51ebfff640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51ec151d80 0x7f51ec14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51eb7fe640 1 -- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51ec0c34c0 msgr2=0x7f51ec1ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:07.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51eb7fe640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51ec0c34c0 0x7f51ec1ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51eb7fe640 1 -- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51ec151d80 msgr2=0x7f51ec14c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51eb7fe640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51ec151d80 0x7f51ec14c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51eb7fe640 1 -- 172.21.15.132:0/1106017305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4009400 con 0x7f51ec0c1070 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51eb7fe640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec14d960 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f51dc007e40 tx=0x7f51dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51e3fff640 1 -- 172.21.15.132:0/1106017305 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc014620 con 0x7f51ec0c1070 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51e3fff640 1 -- 172.21.15.132:0/1106017305 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc00ee90 con 0x7f51ec0c1070 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51e3fff640 1 -- 172.21.15.132:0/1106017305 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0149c0 con 0x7f51ec0c1070 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec155470 con 0x7f51ec0c1070 2023-11-18T20:41:07.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.198+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec14d610 con 0x7f51ec0c1070 2023-11-18T20:41:07.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.199+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec1de910 con 0x7f51ec0c1070 2023-11-18T20:41:07.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.200+0000 7f51e3fff640 1 -- 172.21.15.132:0/1106017305 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51dc014b20 con 0x7f51ec0c1070 2023-11-18T20:41:07.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.201+0000 7f51e3fff640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f51cc06ae70 0x7f51cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:07.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.201+0000 7f51e3fff640 1 -- 172.21.15.132:0/1106017305 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f51dc08a120 con 0x7f51ec0c1070 2023-11-18T20:41:07.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.202+0000 7f51eaffd640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f51cc06ae70 0x7f51cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:07.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.203+0000 7f51eaffd640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f51cc06ae70 0x7f51cc06d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f51d4036000 tx=0x7f51d4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:07.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.206+0000 7f51e3fff640 1 -- 172.21.15.132:0/1106017305 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51dc055040 con 0x7f51ec0c1070 2023-11-18T20:41:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.393+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51ec068350 con 0x7f51ec0c1070 2023-11-18T20:41:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.959+0000 7f51e3fff640 1 -- 172.21.15.132:0/1106017305 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v66) v1 ==== 184+0+0 (secure 0 0 0) 0x7f51dc058660 con 0x7f51ec0c1070 2023-11-18T20:41:07.961 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_metadata' removed 2023-11-18T20:41:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.964+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f51cc06ae70 msgr2=0x7f51cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.964+0000 7f51f20b4640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f51cc06ae70 0x7f51cc06d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f51d4036000 tx=0x7f51d4030000 comp rx=0 tx=0).stop 2023-11-18T20:41:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.964+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 msgr2=0x7f51ec14d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.964+0000 7f51f20b4640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec14d960 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f51dc007e40 tx=0x7f51dc00e4b0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.965+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 shutdown_connections 2023-11-18T20:41:07.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.965+0000 7f51f20b4640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f51cc06ae70 0x7f51cc06d330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.965+0000 7f51f20b4640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51ec151d80 0x7f51ec14c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.965+0000 7f51f20b4640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51ec0c34c0 0x7f51ec1ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.965+0000 7f51f20b4640 1 --2- 172.21.15.132:0/1106017305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51ec0c1070 0x7f51ec14d960 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:07.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.965+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 >> 172.21.15.132:0/1106017305 conn(0x7f51ec0c3970 msgr2=0x7f51ec1578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:07.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.965+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 shutdown_connections 2023-11-18T20:41:07.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:07.965+0000 7f51f20b4640 1 -- 172.21.15.132:0/1106017305 wait complete. 2023-11-18T20:41:07.992 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-18T20:41:08.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.189+0000 7f8ca1ea2640 1 Processor -- start 2023-11-18T20:41:08.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.190+0000 7f8ca1ea2640 1 -- start start 2023-11-18T20:41:08.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.191+0000 7f8ca1ea2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c9c072530 0x7f8c9c0c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:08.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.191+0000 7f8ca1ea2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c9c071f70 0x7f8c9c0c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:08.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.191+0000 7f8ca1ea2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c0c0980 con 0x7f8c9c14fa80 2023-11-18T20:41:08.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.191+0000 7f8ca1ea2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c06d160 con 0x7f8c9c071f70 2023-11-18T20:41:08.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.191+0000 7f8ca1ea2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c06c070 con 0x7f8c9c072530 2023-11-18T20:41:08.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.192+0000 7f8c9b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8c9c14fa80 0x7f8c9c06d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45830/0 (socket says 172.21.15.132:45830) 2023-11-18T20:41:08.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.192+0000 7f8c9bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c9c071f70 0x7f8c9c0c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:08.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.192+0000 7f8c9b7fe640 1 -- 172.21.15.132:0/2111521206 learned_addr learned my addr 172.21.15.132:0/2111521206 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:08.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.192+0000 7f8c9affd640 1 --2- 172.21.15.132:0/2111521206 >> v2:172.21.15.161:3300/0 conn(0x7f8c9c072530 0x7f8c9c0c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:08.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.192+0000 7f8c9bfff640 1 -- 172.21.15.132:0/2111521206 >> v2:172.21.15.161:3300/0 conn(0x7f8c9c072530 msgr2=0x7f8c9c0c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:08.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.192+0000 7f8c9bfff640 1 --2- 172.21.15.132:0/2111521206 >> v2:172.21.15.161:3300/0 conn(0x7f8c9c072530 0x7f8c9c0c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.192+0000 7f8c9bfff640 1 -- 172.21.15.132:0/2111521206 >> v1:172.21.15.132:6789/0 conn(0x7f8c9c14fa80 legacy=0x7f8c9c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:08.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.192+0000 7f8c9bfff640 1 -- 172.21.15.132:0/2111521206 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0c20d0 con 0x7f8c9c071f70 2023-11-18T20:41:08.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.193+0000 7f8c9bfff640 1 --2- 172.21.15.132:0/2111521206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c071f70 0x7f8c9c0c2610 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c156b20 tx=0x7f8c9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f89b5e5d5f4f7d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:08.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8c9a7fc640 1 -- 172.21.15.132:0/2111521206 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94031830 con 0x7f8c9c071f70 2023-11-18T20:41:08.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8c9a7fc640 1 -- 172.21.15.132:0/2111521206 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94031990 con 0x7f8c9c071f70 2023-11-18T20:41:08.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8c9a7fc640 1 -- 172.21.15.132:0/2111521206 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94031d20 con 0x7f8c9c071f70 2023-11-18T20:41:08.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/2111521206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c071f70 msgr2=0x7f8c9c0c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:08.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/2111521206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c071f70 0x7f8c9c0c2610 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c156b20 tx=0x7f8c9402b8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/2111521206 shutdown_connections 2023-11-18T20:41:08.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/2111521206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c071f70 0x7f8c9c0c2610 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/2111521206 >> v2:172.21.15.161:3300/0 conn(0x7f8c9c072530 0x7f8c9c0c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.194+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/2111521206 >> 172.21.15.132:0/2111521206 conn(0x7f8c9c0c5bc0 msgr2=0x7f8c9c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:08.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.195+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/2111521206 shutdown_connections 2023-11-18T20:41:08.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.195+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/2111521206 wait complete. 2023-11-18T20:41:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.197+0000 7f8ca1ea2640 1 Processor -- start 2023-11-18T20:41:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.197+0000 7f8ca1ea2640 1 -- start start 2023-11-18T20:41:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8ca1ea2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9c071f70 0x7f8c9c14b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8ca1ea2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c072530 0x7f8c9c13c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8ca1ea2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c9c14fa80 0x7f8c9c13cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8ca1ea2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c1eb140 con 0x7f8c9c072530 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8ca1ea2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c13d310 con 0x7f8c9c071f70 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8ca1ea2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c1ea200 con 0x7f8c9c14fa80 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8c9affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c072530 0x7f8c9c13c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8c9affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c072530 0x7f8c9c13c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59746/0 (socket says 172.21.15.132:59746) 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8c9affd640 1 -- 172.21.15.132:0/1438952520 learned_addr learned my addr 172.21.15.132:0/1438952520 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.198+0000 7f8c9b7fe640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9c071f70 0x7f8c9c14b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c9affd640 1 -- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c9c14fa80 msgr2=0x7f8c9c13cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c9bfff640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c9c14fa80 0x7f8c9c13cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c9affd640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c9c14fa80 0x7f8c9c13cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c9affd640 1 -- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9c071f70 msgr2=0x7f8c9c14b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c9affd640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9c071f70 0x7f8c9c14b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c9affd640 1 -- 172.21.15.132:0/1438952520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94009400 con 0x7f8c9c072530 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c9bfff640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c9c14fa80 0x7f8c9c13cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c9affd640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c072530 0x7f8c9c13c890 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400d830 tx=0x7f8c8400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c93fff640 1 -- 172.21.15.132:0/1438952520 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400b6c0 con 0x7f8c9c072530 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c93fff640 1 -- 172.21.15.132:0/1438952520 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8400b820 con 0x7f8c9c072530 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8c93fff640 1 -- 172.21.15.132:0/1438952520 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400bbb0 con 0x7f8c9c072530 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.199+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c1ea4c0 con 0x7f8c9c072530 2023-11-18T20:41:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.200+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c1eaa80 con 0x7f8c9c072530 2023-11-18T20:41:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.201+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c067950 con 0x7f8c9c072530 2023-11-18T20:41:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.202+0000 7f8c93fff640 1 -- 172.21.15.132:0/1438952520 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c8401e460 con 0x7f8c9c072530 2023-11-18T20:41:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.202+0000 7f8c93fff640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8c7c06ae40 0x7f8c7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.203+0000 7f8c93fff640 1 -- 172.21.15.132:0/1438952520 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5474+0+0 (secure 0 0 0) 0x7f8c84089c20 con 0x7f8c9c072530 2023-11-18T20:41:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.203+0000 7f8c9b7fe640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8c7c06ae40 0x7f8c7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.204+0000 7f8c9b7fe640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8c7c06ae40 0x7f8c7c06d300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c005c00 tx=0x7f8c8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:08.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.207+0000 7f8c93fff640 1 -- 172.21.15.132:0/1438952520 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c84054e40 con 0x7f8c9c072530 2023-11-18T20:41:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.396+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8c9c068350 con 0x7f8c9c072530 2023-11-18T20:41:08.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.962+0000 7f8c93fff640 1 -- 172.21.15.132:0/1438952520 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v67) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8c84058460 con 0x7f8c9c072530 2023-11-18T20:41:08.964 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_data' removed 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8c7c06ae40 msgr2=0x7f8c7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8c7c06ae40 0x7f8c7c06d300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c005c00 tx=0x7f8c8c009040 comp rx=0 tx=0).stop 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c072530 msgr2=0x7f8c9c13c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c072530 0x7f8c9c13c890 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400d830 tx=0x7f8c8400dcf0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 shutdown_connections 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f8c7c06ae40 0x7f8c7c06d300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c9c14fa80 0x7f8c9c13cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c9c072530 0x7f8c9c13c890 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 --2- 172.21.15.132:0/1438952520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9c071f70 0x7f8c9c14b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:08.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.966+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 >> 172.21.15.132:0/1438952520 conn(0x7f8c9c0c5bc0 msgr2=0x7f8c9c0c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:08.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.967+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 shutdown_connections 2023-11-18T20:41:08.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:08.967+0000 7f8ca1ea2640 1 -- 172.21.15.132:0/1438952520 wait complete. 2023-11-18T20:41:08.994 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-18T20:41:09.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.195+0000 7f522bc90640 1 Processor -- start 2023-11-18T20:41:09.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.195+0000 7f522bc90640 1 -- start start 2023-11-18T20:41:09.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.196+0000 7f522bc90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5224155490 0x7f52240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.196+0000 7f522bc90640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52240c1500 0x7f52240a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.196+0000 7f522bc90640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52240c06c0 con 0x7f52240c4080 2023-11-18T20:41:09.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.196+0000 7f522bc90640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52240a5820 con 0x7f52240c1500 2023-11-18T20:41:09.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.196+0000 7f522bc90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52240c1020 con 0x7f5224155490 2023-11-18T20:41:09.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.197+0000 7f522a22d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f52240c4080 0x7f52240c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45192/0 (socket says 172.21.15.132:45192) 2023-11-18T20:41:09.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.197+0000 7f522a22d640 1 -- 172.21.15.132:0/1622829184 learned_addr learned my addr 172.21.15.132:0/1622829184 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.197+0000 7f522922b640 1 --2- 172.21.15.132:0/1622829184 >> v2:172.21.15.161:3300/0 conn(0x7f52240c1500 0x7f52240a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.197+0000 7f5229a2c640 1 --2- 172.21.15.132:0/1622829184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5224155490 0x7f52240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.197+0000 7f5228a2a640 1 -- 172.21.15.132:0/1622829184 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534899253 0 0) 0x7f52240c06c0 con 0x7f52240c4080 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.197+0000 7f5228a2a640 1 -- 172.21.15.132:0/1622829184 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5210005730 con 0x7f52240c4080 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.198+0000 7f5228a2a640 1 -- 172.21.15.132:0/1622829184 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301382954 0 0) 0x7f5210005730 con 0x7f52240c4080 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.198+0000 7f522922b640 1 -- 172.21.15.132:0/1622829184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5224155490 msgr2=0x7f52240a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.198+0000 7f522922b640 1 --2- 172.21.15.132:0/1622829184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5224155490 0x7f52240a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.198+0000 7f522922b640 1 -- 172.21.15.132:0/1622829184 >> v1:172.21.15.132:6789/0 conn(0x7f52240c4080 legacy=0x7f52240c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.198+0000 7f522922b640 1 -- 172.21.15.132:0/1622829184 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52240c0910 con 0x7f52240c1500 2023-11-18T20:41:09.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.199+0000 7f522922b640 1 --2- 172.21.15.132:0/1622829184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52240c1500 0x7f52240a9430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52140097a0 tx=0x7f521402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c302ce174e48b02b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:09.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.199+0000 7f5228a2a640 1 -- 172.21.15.132:0/1622829184 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0019f0 con 0x7f52240c1500 2023-11-18T20:41:09.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.199+0000 7f5228a2a640 1 -- 172.21.15.132:0/1622829184 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521402e050 con 0x7f52240c1500 2023-11-18T20:41:09.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.199+0000 7f5228a2a640 1 -- 172.21.15.132:0/1622829184 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214030710 con 0x7f52240c1500 2023-11-18T20:41:09.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.200+0000 7f522bc90640 1 -- 172.21.15.132:0/1622829184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52240c1500 msgr2=0x7f52240a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.200+0000 7f522bc90640 1 --2- 172.21.15.132:0/1622829184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52240c1500 0x7f52240a9430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52140097a0 tx=0x7f521402b710 comp rx=0 tx=0).stop 2023-11-18T20:41:09.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.200+0000 7f522bc90640 1 -- 172.21.15.132:0/1622829184 shutdown_connections 2023-11-18T20:41:09.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.200+0000 7f522bc90640 1 --2- 172.21.15.132:0/1622829184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52240c1500 0x7f52240a9430 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.200+0000 7f522bc90640 1 --2- 172.21.15.132:0/1622829184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5224155490 0x7f52240a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.200+0000 7f522bc90640 1 -- 172.21.15.132:0/1622829184 >> 172.21.15.132:0/1622829184 conn(0x7f522406a500 msgr2=0x7f522406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:09.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.200+0000 7f522bc90640 1 -- 172.21.15.132:0/1622829184 shutdown_connections 2023-11-18T20:41:09.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.200+0000 7f522bc90640 1 -- 172.21.15.132:0/1622829184 wait complete. 2023-11-18T20:41:09.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.202+0000 7f522bc90640 1 Processor -- start 2023-11-18T20:41:09.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.202+0000 7f522bc90640 1 -- start start 2023-11-18T20:41:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f522bc90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52240c1500 0x7f52240707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f522bc90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52240c4080 0x7f52240a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f522bc90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5224155490 0x7f5224140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f522bc90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52241dc920 con 0x7f52240c1500 2023-11-18T20:41:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f522bc90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52240712e0 con 0x7f5224155490 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f522bc90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52241dad90 con 0x7f52240c4080 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f5229a2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52240c1500 0x7f52240707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f5229a2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52240c1500 0x7f52240707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32942/0 (socket says 172.21.15.132:32942) 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f5229a2c640 1 -- 172.21.15.132:0/1858321444 learned_addr learned my addr 172.21.15.132:0/1858321444 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f5229a2c640 1 -- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52240c4080 msgr2=0x7f52240a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f5229a2c640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52240c4080 0x7f52240a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f5229a2c640 1 -- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5224155490 msgr2=0x7f5224140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f5229a2c640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5224155490 0x7f5224140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.203+0000 7f5229a2c640 1 -- 172.21.15.132:0/1858321444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5214009400 con 0x7f52240c1500 2023-11-18T20:41:09.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.204+0000 7f5229a2c640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52240c1500 0x7f52240707b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f522000e8a0 tx=0x7f522000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:09.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.204+0000 7f521a7fc640 1 -- 172.21.15.132:0/1858321444 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000c940 con 0x7f52240c1500 2023-11-18T20:41:09.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.204+0000 7f521a7fc640 1 -- 172.21.15.132:0/1858321444 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522000caa0 con 0x7f52240c1500 2023-11-18T20:41:09.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.204+0000 7f521a7fc640 1 -- 172.21.15.132:0/1858321444 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000ce50 con 0x7f52240c1500 2023-11-18T20:41:09.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.204+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52241daa40 con 0x7f52240c1500 2023-11-18T20:41:09.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.204+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5224071810 con 0x7f52240c1500 2023-11-18T20:41:09.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.205+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5224068350 con 0x7f52240c1500 2023-11-18T20:41:09.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.206+0000 7f521a7fc640 1 -- 172.21.15.132:0/1858321444 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5220013470 con 0x7f52240c1500 2023-11-18T20:41:09.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.207+0000 7f521a7fc640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f520806ae40 0x7f520806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.207+0000 7f521a7fc640 1 -- 172.21.15.132:0/1858321444 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5220089410 con 0x7f52240c1500 2023-11-18T20:41:09.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.208+0000 7f522922b640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f520806ae40 0x7f520806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.209+0000 7f522922b640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f520806ae40 0x7f520806d300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5214034000 tx=0x7f521402f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:09.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.211+0000 7f521a7fc640 1 -- 172.21.15.132:0/1858321444 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52200547f0 con 0x7f52240c1500 2023-11-18T20:41:09.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.404+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f52240c3e60 con 0x7f52240c1500 2023-11-18T20:41:09.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.410+0000 7f521a7fc640 1 -- 172.21.15.132:0/1858321444 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5220057e10 con 0x7f52240c1500 2023-11-18T20:41:09.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f520806ae40 msgr2=0x7f520806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f520806ae40 0x7f520806d300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5214034000 tx=0x7f521402f000 comp rx=0 tx=0).stop 2023-11-18T20:41:09.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52240c1500 msgr2=0x7f52240707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52240c1500 0x7f52240707b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f522000e8a0 tx=0x7f522000ed60 comp rx=0 tx=0).stop 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 shutdown_connections 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f520806ae40 0x7f520806d300 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5224155490 0x7f5224140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52240c4080 0x7f52240a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 --2- 172.21.15.132:0/1858321444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52240c1500 0x7f52240707b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 >> 172.21.15.132:0/1858321444 conn(0x7f522406a500 msgr2=0x7f5224153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 shutdown_connections 2023-11-18T20:41:09.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.413+0000 7f522bc90640 1 -- 172.21.15.132:0/1858321444 wait complete. 2023-11-18T20:41:09.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-11-18T20:41:09.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.636+0000 7faf7e747640 1 Processor -- start 2023-11-18T20:41:09.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.636+0000 7faf7e747640 1 -- start start 2023-11-18T20:41:09.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.637+0000 7faf7e747640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faf7806d0a0 0x7faf78152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.637+0000 7faf7e747640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf780c3ea0 0x7faf780c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.637+0000 7faf7e747640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf780c64a0 con 0x7faf7814fd30 2023-11-18T20:41:09.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf7e747640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf780c5c00 con 0x7faf7806d0a0 2023-11-18T20:41:09.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf7e747640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf780c5ee0 con 0x7faf780c3ea0 2023-11-18T20:41:09.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf77fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7faf7814fd30 0x7faf780a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45204/0 (socket says 172.21.15.132:45204) 2023-11-18T20:41:09.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf77fff640 1 -- 172.21.15.132:0/1969881419 learned_addr learned my addr 172.21.15.132:0/1969881419 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621379923 0 0) 0x7faf780c64a0 con 0x7faf7814fd30 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf64003520 con 0x7faf7814fd30 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf777fe640 1 --2- 172.21.15.132:0/1969881419 >> v2:172.21.15.161:3300/0 conn(0x7faf7806d0a0 0x7faf78152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf7cce4640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf780c3ea0 0x7faf780c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.638+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 601399653 0 0) 0x7faf64003520 con 0x7faf7814fd30 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf780c3ea0 msgr2=0x7faf780c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf780c3ea0 0x7faf780c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 >> v2:172.21.15.161:3300/0 conn(0x7faf7806d0a0 msgr2=0x7faf78152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 --2- 172.21.15.132:0/1969881419 >> v2:172.21.15.161:3300/0 conn(0x7faf7806d0a0 0x7faf78152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780c61c0 con 0x7faf7814fd30 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7faf68001670 con 0x7faf7814fd30 2023-11-18T20:41:09.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 >> v1:172.21.15.132:6789/0 conn(0x7faf7814fd30 legacy=0x7faf780a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64003970 0x7faf64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf780c3ea0 0x7faf640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf64004d00 0x7faf64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf780c5c00 con 0x7faf64004d00 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf780c5ee0 con 0x7faf64003970 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6400ba60 con 0x7faf780c3ea0 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf7cce4640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf64004d00 0x7faf64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf777fe640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf780c3ea0 0x7faf640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf77fff640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64003970 0x7faf64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf7cce4640 1 -- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf780c3ea0 msgr2=0x7faf640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf7cce4640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf780c3ea0 0x7faf640047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf7cce4640 1 -- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64003970 msgr2=0x7faf64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf7cce4640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64003970 0x7faf64003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.639+0000 7faf7cce4640 1 -- 172.21.15.132:0/1969881419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64003520 con 0x7faf64004d00 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.640+0000 7faf7cce4640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf64004d00 0x7faf64005180 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faf70007360 tx=0x7faf640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4bf2e5d7413b4b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7002ccb0 con 0x7faf64004d00 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7002ce10 con 0x7faf64004d00 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf76ffd640 1 -- 172.21.15.132:0/1969881419 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70034660 con 0x7faf64004d00 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf7e747640 1 -- 172.21.15.132:0/1969881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf64004d00 msgr2=0x7faf64005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf7e747640 1 --2- 172.21.15.132:0/1969881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf64004d00 0x7faf64005180 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faf70007360 tx=0x7faf640057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf7cce4640 1 -- 172.21.15.132:0/1969881419 reap_dead start 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf7e747640 1 -- 172.21.15.132:0/1969881419 shutdown_connections 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf7e747640 1 -- 172.21.15.132:0/1969881419 >> 172.21.15.132:0/1969881419 conn(0x7faf7806a500 msgr2=0x7faf7806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf7e747640 1 -- 172.21.15.132:0/1969881419 shutdown_connections 2023-11-18T20:41:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.641+0000 7faf7e747640 1 -- 172.21.15.132:0/1969881419 wait complete. 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.643+0000 7faf7e747640 1 Processor -- start 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.643+0000 7faf7e747640 1 -- start start 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7e747640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64004d00 0x7faf781e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7e747640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf781524b0 0x7faf781ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7e747640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf781ddf40 0x7faf781eded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7e747640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf781dbe40 con 0x7faf781ddf40 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7e747640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf780a8d80 con 0x7faf64004d00 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7e747640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf780a8aa0 con 0x7faf781524b0 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7cce4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf781ddf40 0x7faf781eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7cce4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf781ddf40 0x7faf781eded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32964/0 (socket says 172.21.15.132:32964) 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.644+0000 7faf7cce4640 1 -- 172.21.15.132:0/3674408389 learned_addr learned my addr 172.21.15.132:0/3674408389 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:09.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf777fe640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf781524b0 0x7faf781ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf77fff640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64004d00 0x7faf781e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf7cce4640 1 -- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf781524b0 msgr2=0x7faf781ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf7cce4640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf781524b0 0x7faf781ed990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf7cce4640 1 -- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64004d00 msgr2=0x7faf781e16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf7cce4640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64004d00 0x7faf781e16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf7cce4640 1 -- 172.21.15.132:0/3674408389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7814f010 con 0x7faf781ddf40 2023-11-18T20:41:09.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf7cce4640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf781ddf40 0x7faf781eded0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7faf70007360 tx=0x7faf70004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:09.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf74ff9640 1 -- 172.21.15.132:0/3674408389 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7003e600 con 0x7faf781ddf40 2023-11-18T20:41:09.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf74ff9640 1 -- 172.21.15.132:0/3674408389 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7003e780 con 0x7faf781ddf40 2023-11-18T20:41:09.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7814f2f0 con 0x7faf781ddf40 2023-11-18T20:41:09.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf74ff9640 1 -- 172.21.15.132:0/3674408389 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7003eb30 con 0x7faf781ddf40 2023-11-18T20:41:09.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.645+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf781dbad0 con 0x7faf781ddf40 2023-11-18T20:41:09.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.647+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf78068350 con 0x7faf781ddf40 2023-11-18T20:41:09.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.647+0000 7faf74ff9640 1 -- 172.21.15.132:0/3674408389 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf7003ec90 con 0x7faf781ddf40 2023-11-18T20:41:09.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.648+0000 7faf74ff9640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf5806ae40 0x7faf5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:09.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.648+0000 7faf74ff9640 1 -- 172.21.15.132:0/3674408389 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7faf700ab950 con 0x7faf781ddf40 2023-11-18T20:41:09.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.649+0000 7faf77fff640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf5806ae40 0x7faf5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.650+0000 7faf77fff640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf5806ae40 0x7faf5806d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faf68000c00 tx=0x7faf68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:09.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.653+0000 7faf74ff9640 1 -- 172.21.15.132:0/3674408389 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf70076e60 con 0x7faf781ddf40 2023-11-18T20:41:09.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.914+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7faf780c66d0 con 0x7faf781ddf40 2023-11-18T20:41:09.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.965+0000 7faf74ff9640 1 -- 172.21.15.132:0/3674408389 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v196) v1 ==== 184+0+0 (secure 0 0 0) 0x7faf7007a480 con 0x7faf781ddf40 2023-11-18T20:41:09.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf5806ae40 msgr2=0x7faf5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf5806ae40 0x7faf5806d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faf68000c00 tx=0x7faf68009040 comp rx=0 tx=0).stop 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf781ddf40 msgr2=0x7faf781eded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf781ddf40 0x7faf781eded0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7faf70007360 tx=0x7faf70004ab0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 shutdown_connections 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faf5806ae40 0x7faf5806d300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf781ddf40 0x7faf781eded0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf781524b0 0x7faf781ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 --2- 172.21.15.132:0/3674408389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf64004d00 0x7faf781e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.968+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 >> 172.21.15.132:0/3674408389 conn(0x7faf7806a500 msgr2=0x7faf780c49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.969+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 shutdown_connections 2023-11-18T20:41:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:09.969+0000 7faf7e747640 1 -- 172.21.15.132:0/3674408389 wait complete. 2023-11-18T20:41:09.989 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-11-18T20:41:09.989 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-18T20:41:09.989 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.199+0000 7f85f6927640 1 Processor -- start 2023-11-18T20:41:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.200+0000 7f85f6927640 1 -- start start 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f6927640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85f014c2e0 0x7f85f00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f6927640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f0152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f6927640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f85f0072310 0x7f85f00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f6927640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f0071470 con 0x7f85f014c2e0 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f6927640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f0071e80 con 0x7f85f0072310 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f6927640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f014c6c0 con 0x7f85f00c0440 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f5925640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85f014c2e0 0x7f85f00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f5925640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85f014c2e0 0x7f85f00c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32972/0 (socket says 172.21.15.132:32972) 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.201+0000 7f85f5925640 1 -- 172.21.15.132:0/2906048 learned_addr learned my addr 172.21.15.132:0/2906048 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.202+0000 7f85f5124640 1 --2- 172.21.15.132:0/2906048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f0152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.202+0000 7f85f6126640 1 --2- 172.21.15.132:0/2906048 >> v2:172.21.15.161:3300/0 conn(0x7f85f0072310 0x7f85f00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.202+0000 7f85f5925640 1 -- 172.21.15.132:0/2906048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 msgr2=0x7f85f0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.202+0000 7f85f5925640 1 --2- 172.21.15.132:0/2906048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f0152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.202+0000 7f85f5925640 1 -- 172.21.15.132:0/2906048 >> v2:172.21.15.161:3300/0 conn(0x7f85f0072310 msgr2=0x7f85f00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.202+0000 7f85f5925640 1 --2- 172.21.15.132:0/2906048 >> v2:172.21.15.161:3300/0 conn(0x7f85f0072310 0x7f85f00a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.202+0000 7f85f5925640 1 -- 172.21.15.132:0/2906048 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0153180 con 0x7f85f014c2e0 2023-11-18T20:41:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.203+0000 7f85f5925640 1 --2- 172.21.15.132:0/2906048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f00c0c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f85f006f680 tx=0x7f85ec02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde26632bdc17a4d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f4923640 1 -- 172.21.15.132:0/2906048 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec031750 con 0x7f85f014c2e0 2023-11-18T20:41:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f4923640 1 -- 172.21.15.132:0/2906048 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec0318b0 con 0x7f85f014c2e0 2023-11-18T20:41:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f4923640 1 -- 172.21.15.132:0/2906048 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec031c40 con 0x7f85f014c2e0 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 -- 172.21.15.132:0/2906048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 msgr2=0x7f85f00c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 --2- 172.21.15.132:0/2906048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f00c0c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f85f006f680 tx=0x7f85ec02b7f0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 -- 172.21.15.132:0/2906048 shutdown_connections 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 --2- 172.21.15.132:0/2906048 >> v2:172.21.15.161:3300/0 conn(0x7f85f0072310 0x7f85f00a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 --2- 172.21.15.132:0/2906048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f0152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 --2- 172.21.15.132:0/2906048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f00c0c80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 -- 172.21.15.132:0/2906048 >> 172.21.15.132:0/2906048 conn(0x7f85f00a77f0 msgr2=0x7f85f00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 -- 172.21.15.132:0/2906048 shutdown_connections 2023-11-18T20:41:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.204+0000 7f85f6927640 1 -- 172.21.15.132:0/2906048 wait complete. 2023-11-18T20:41:10.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.206+0000 7f85f6927640 1 Processor -- start 2023-11-18T20:41:10.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.206+0000 7f85f6927640 1 -- start start 2023-11-18T20:41:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6927640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f0072310 0x7f85f0140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6927640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f013c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6927640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f013c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6927640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00aa550 con 0x7f85f014c2e0 2023-11-18T20:41:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6927640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00aa830 con 0x7f85f0072310 2023-11-18T20:41:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6927640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00aab10 con 0x7f85f00c0440 2023-11-18T20:41:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6126640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f013c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6126640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f013c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32982/0 (socket says 172.21.15.132:32982) 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.207+0000 7f85f6126640 1 -- 172.21.15.132:0/3869169184 learned_addr learned my addr 172.21.15.132:0/3869169184 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f5925640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f0072310 0x7f85f0140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f5124640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f013c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f6126640 1 -- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 msgr2=0x7f85f013c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f6126640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f013c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f6126640 1 -- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f0072310 msgr2=0x7f85f0140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f6126640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f0072310 0x7f85f0140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f6126640 1 -- 172.21.15.132:0/3869169184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0094d0 con 0x7f85f014c2e0 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f5124640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f013c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:10.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f6126640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f013c880 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f85e8007e40 tx=0x7f85e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:10.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85e67fc640 1 -- 172.21.15.132:0/3869169184 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8014620 con 0x7f85f014c2e0 2023-11-18T20:41:10.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85e67fc640 1 -- 172.21.15.132:0/3869169184 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e800ee90 con 0x7f85f014c2e0 2023-11-18T20:41:10.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85e67fc640 1 -- 172.21.15.132:0/3869169184 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e80149e0 con 0x7f85f014c2e0 2023-11-18T20:41:10.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.208+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f00aadf0 con 0x7f85f014c2e0 2023-11-18T20:41:10.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.209+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f0140c40 con 0x7f85f014c2e0 2023-11-18T20:41:10.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.210+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f004e840 con 0x7f85f014c2e0 2023-11-18T20:41:10.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.211+0000 7f85e67fc640 1 -- 172.21.15.132:0/3869169184 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85e8014b40 con 0x7f85f014c2e0 2023-11-18T20:41:10.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.211+0000 7f85e67fc640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f85d406ae70 0x7f85d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.212+0000 7f85e67fc640 1 -- 172.21.15.132:0/3869169184 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f85e8089d80 con 0x7f85f014c2e0 2023-11-18T20:41:10.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.212+0000 7f85f5925640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f85d406ae70 0x7f85d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.213+0000 7f85f5925640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f85d406ae70 0x7f85d406d330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f85ec035000 tx=0x7f85ec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:10.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.216+0000 7f85e67fc640 1 -- 172.21.15.132:0/3869169184 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85e80550c0 con 0x7f85f014c2e0 2023-11-18T20:41:10.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.405+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85f00c5380 con 0x7f85f014c2e0 2023-11-18T20:41:10.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.407+0000 7f85e67fc640 1 -- 172.21.15.132:0/3869169184 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+13157 (secure 0 0 0) 0x7f85e80586e0 con 0x7f85f014c2e0 2023-11-18T20:41:10.409 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:10.410 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":67,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:08.959530+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6833/3297068463":"2023-11-19T20:41:05.948532+0000","172.21.15.132:6835/3392191515":"2023-11-19T20:40:58.199045+0000","172.21.15.132:6832/3297068463":"2023-11-19T20:41:05.948532+0000","172.21.15.132:6834/3392191515":"2023-11-19T20:40:58.199045+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:10.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.409+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f85d406ae70 msgr2=0x7f85d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.409+0000 7f85f6927640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f85d406ae70 0x7f85d406d330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f85ec035000 tx=0x7f85ec008030 comp rx=0 tx=0).stop 2023-11-18T20:41:10.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.409+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 msgr2=0x7f85f013c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.409+0000 7f85f6927640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f013c880 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f85e8007e40 tx=0x7f85e800e4b0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.410+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 shutdown_connections 2023-11-18T20:41:10.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.410+0000 7f85f6927640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f85d406ae70 0x7f85d406d330 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.410+0000 7f85f6927640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f014c2e0 0x7f85f013c880 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.410+0000 7f85f6927640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f00c0440 0x7f85f013c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.410+0000 7f85f6927640 1 --2- 172.21.15.132:0/3869169184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f0072310 0x7f85f0140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.410+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 >> 172.21.15.132:0/3869169184 conn(0x7f85f00a77f0 msgr2=0x7f85f00c0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:10.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.410+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 shutdown_connections 2023-11-18T20:41:10.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.410+0000 7f85f6927640 1 -- 172.21.15.132:0/3869169184 wait complete. 2023-11-18T20:41:10.431 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:41:10.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:41:10.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.646+0000 7faffab7c640 1 Processor -- start 2023-11-18T20:41:10.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.647+0000 7faffab7c640 1 -- start start 2023-11-18T20:41:10.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.648+0000 7faffab7c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faff40c7fc0 0x7faff40c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.648+0000 7faffab7c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40c1da0 con 0x7faff40c7700 2023-11-18T20:41:10.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.648+0000 7faffab7c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40c2080 con 0x7faff4155790 2023-11-18T20:41:10.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.648+0000 7faffab7c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40c3ee0 con 0x7faff40c7fc0 2023-11-18T20:41:10.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.648+0000 7faff3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7faff40c7700 0x7faff4155080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45208/0 (socket says 172.21.15.132:45208) 2023-11-18T20:41:10.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.648+0000 7faff3fff640 1 -- 172.21.15.132:0/2449062108 learned_addr learned my addr 172.21.15.132:0/2449062108 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:10.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.648+0000 7faff8918640 1 --2- 172.21.15.132:0/2449062108 >> v2:172.21.15.132:3300/0 conn(0x7faff40c7fc0 0x7faff40c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.649+0000 7faff8918640 1 -- 172.21.15.132:0/2449062108 >> v1:172.21.15.161:6789/0 conn(0x7faff4155790 legacy=0x7faff40c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:10.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.649+0000 7faff8918640 1 -- 172.21.15.132:0/2449062108 >> v1:172.21.15.132:6789/0 conn(0x7faff40c7700 legacy=0x7faff4155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.649+0000 7faff8918640 1 -- 172.21.15.132:0/2449062108 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40c5d60 con 0x7faff40c7fc0 2023-11-18T20:41:10.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.649+0000 7faff37fe640 1 -- 172.21.15.132:0/2449062108 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919180802 0 0) 0x7faff40c1da0 con 0x7faff40c7700 2023-11-18T20:41:10.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.650+0000 7faff8918640 1 --2- 172.21.15.132:0/2449062108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff40c30b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097a0 tx=0x7fafdc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d272df9da1a61e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:10.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.650+0000 7faff37fe640 1 -- 172.21.15.132:0/2449062108 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc02e070 con 0x7faff40c7fc0 2023-11-18T20:41:10.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.650+0000 7faff37fe640 1 -- 172.21.15.132:0/2449062108 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc0315a0 con 0x7faff40c7fc0 2023-11-18T20:41:10.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.650+0000 7faff37fe640 1 -- 172.21.15.132:0/2449062108 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc031930 con 0x7faff40c7fc0 2023-11-18T20:41:10.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.651+0000 7faffab7c640 1 -- 172.21.15.132:0/2449062108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 msgr2=0x7faff40c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.651+0000 7faffab7c640 1 --2- 172.21.15.132:0/2449062108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff40c30b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097a0 tx=0x7fafdc02b840 comp rx=0 tx=0).stop 2023-11-18T20:41:10.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.651+0000 7faffab7c640 1 -- 172.21.15.132:0/2449062108 shutdown_connections 2023-11-18T20:41:10.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.651+0000 7faffab7c640 1 --2- 172.21.15.132:0/2449062108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff40c30b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.651+0000 7faffab7c640 1 -- 172.21.15.132:0/2449062108 >> 172.21.15.132:0/2449062108 conn(0x7faff40a9b70 msgr2=0x7faff40a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:10.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.651+0000 7faffab7c640 1 -- 172.21.15.132:0/2449062108 shutdown_connections 2023-11-18T20:41:10.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.651+0000 7faffab7c640 1 -- 172.21.15.132:0/2449062108 wait complete. 2023-11-18T20:41:10.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.653+0000 7faffab7c640 1 Processor -- start 2023-11-18T20:41:10.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.653+0000 7faffab7c640 1 -- start start 2023-11-18T20:41:10.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faffab7c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff41581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faffab7c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff4155790 0x7faff406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faffab7c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff414f090 0x7faff414f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faffab7c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40c7b90 con 0x7faff40c7fc0 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faffab7c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40ac740 con 0x7faff4155790 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faffab7c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff4155c40 con 0x7faff414f090 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faff8918640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff41581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faff8918640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff41581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33008/0 (socket says 172.21.15.132:33008) 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faff8918640 1 -- 172.21.15.132:0/2461326974 learned_addr learned my addr 172.21.15.132:0/2461326974 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faff8918640 1 -- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff414f090 msgr2=0x7faff414f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faff8918640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff414f090 0x7faff414f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faff8918640 1 -- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff4155790 msgr2=0x7faff406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faff8918640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff4155790 0x7faff406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.654+0000 7faff8918640 1 -- 172.21.15.132:0/2461326974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009400 con 0x7faff40c7fc0 2023-11-18T20:41:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.655+0000 7faff8918640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff41581f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097a0 tx=0x7fafdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.655+0000 7faff17fa640 1 -- 172.21.15.132:0/2461326974 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc004230 con 0x7faff40c7fc0 2023-11-18T20:41:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.655+0000 7faff17fa640 1 -- 172.21.15.132:0/2461326974 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc004390 con 0x7faff40c7fc0 2023-11-18T20:41:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.655+0000 7faff17fa640 1 -- 172.21.15.132:0/2461326974 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc032880 con 0x7faff40c7fc0 2023-11-18T20:41:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.655+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff40abf30 con 0x7faff40c7fc0 2023-11-18T20:41:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.655+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff40ac180 con 0x7faff40c7fc0 2023-11-18T20:41:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.656+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff4068350 con 0x7faff40c7fc0 2023-11-18T20:41:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.657+0000 7faff17fa640 1 -- 172.21.15.132:0/2461326974 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafdc0329e0 con 0x7faff40c7fc0 2023-11-18T20:41:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.658+0000 7faff17fa640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fafd406ae40 0x7fafd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.658+0000 7faff17fa640 1 -- 172.21.15.132:0/2461326974 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fafdc0ab5c0 con 0x7faff40c7fc0 2023-11-18T20:41:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.659+0000 7faff3fff640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fafd406ae40 0x7fafd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.660+0000 7faff3fff640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fafd406ae40 0x7fafd406d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faff41ee510 tx=0x7fafe4007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.662+0000 7faff17fa640 1 -- 172.21.15.132:0/2461326974 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafdc076900 con 0x7faff40c7fc0 2023-11-18T20:41:10.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.850+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faff4068350 con 0x7faff40c7fc0 2023-11-18T20:41:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.851+0000 7faff17fa640 1 -- 172.21.15.132:0/2461326974 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafdc079f20 con 0x7faff40c7fc0 2023-11-18T20:41:10.854 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:41:10.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fafd406ae40 msgr2=0x7fafd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fafd406ae40 0x7fafd406d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faff41ee510 tx=0x7fafe4007ca0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 msgr2=0x7faff41581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff41581f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097a0 tx=0x7fafdc0046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 shutdown_connections 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fafd406ae40 0x7fafd406d300 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff414f090 0x7faff414f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff4155790 0x7faff406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 --2- 172.21.15.132:0/2461326974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff40c7fc0 0x7faff41581f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 >> 172.21.15.132:0/2461326974 conn(0x7faff40a9b70 msgr2=0x7faff406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 shutdown_connections 2023-11-18T20:41:10.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:10.854+0000 7faffab7c640 1 -- 172.21.15.132:0/2461326974 wait complete. 2023-11-18T20:41:10.874 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-11-18T20:41:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.080+0000 7f4bb5f67640 1 Processor -- start 2023-11-18T20:41:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.080+0000 7f4bb5f67640 1 -- start start 2023-11-18T20:41:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.081+0000 7f4bb5f67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4bb006cd20 0x7f4bb015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.081+0000 7f4bb5f67640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00a8380 con 0x7f4bb00c52e0 2023-11-18T20:41:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.082+0000 7f4bb5f67640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb01510b0 con 0x7f4bb014e7f0 2023-11-18T20:41:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.082+0000 7f4bb5f67640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb006bf60 con 0x7f4bb006cd20 2023-11-18T20:41:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.082+0000 7f4ba7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4bb00c52e0 0x7f4bb006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45210/0 (socket says 172.21.15.132:45210) 2023-11-18T20:41:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.082+0000 7f4ba7fff640 1 -- 172.21.15.132:0/1035731468 learned_addr learned my addr 172.21.15.132:0/1035731468 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:11.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.082+0000 7f4bb5766640 1 --2- 172.21.15.132:0/1035731468 >> v2:172.21.15.161:3300/0 conn(0x7f4bb006cd20 0x7f4bb015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:11.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.082+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021153235 0 0) 0x7f4bb00a8380 con 0x7f4bb00c52e0 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.082+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b98005730 con 0x7f4bb00c52e0 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.082+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 498837784 0 0) 0x7f4b98005730 con 0x7f4bb00c52e0 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 >> v2:172.21.15.161:3300/0 conn(0x7f4bb006cd20 msgr2=0x7f4bb015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 --2- 172.21.15.132:0/1035731468 >> v2:172.21.15.161:3300/0 conn(0x7f4bb006cd20 0x7f4bb015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 >> v1:172.21.15.161:6789/0 conn(0x7f4bb014e7f0 legacy=0x7f4bb00c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb006c240 con 0x7f4bb00c52e0 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f4ba0001670 con 0x7f4bb00c52e0 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 >> v1:172.21.15.132:6789/0 conn(0x7f4bb00c52e0 legacy=0x7f4bb006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b98005bd0 0x7f4b98005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4b98006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b980073e0 0x7f4b9800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:11.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb006bf60 con 0x7f4b980069d0 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9800e330 con 0x7f4b98005bd0 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9800e4f0 con 0x7f4b980073e0 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4ba7fff640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4b98006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4bb5766640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b980073e0 0x7f4b9800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.084+0000 7f4ba7fff640 1 -- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b980073e0 msgr2=0x7f4b9800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.084+0000 7f4ba7fff640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b980073e0 0x7f4b9800db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.084+0000 7f4ba7fff640 1 -- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b98005bd0 msgr2=0x7f4b98005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.083+0000 7f4bb4f65640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b98005bd0 0x7f4b98005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.084+0000 7f4ba7fff640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b98005bd0 0x7f4b98005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.084+0000 7f4bb5766640 1 -- 172.21.15.132:0/1035731468 reap_dead start 2023-11-18T20:41:11.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.084+0000 7f4ba7fff640 1 -- 172.21.15.132:0/1035731468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98005730 con 0x7f4b980069d0 2023-11-18T20:41:11.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.084+0000 7f4bb4f65640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b98005bd0 0x7f4b98005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:11.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4ba7fff640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4b98006e50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0007fb0 tx=0x7f4b98007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbfaf0d3bfcf0ee server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:11.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0005ad0 con 0x7f4b980069d0 2023-11-18T20:41:11.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba0005c50 con 0x7f4b980069d0 2023-11-18T20:41:11.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4ba77fe640 1 -- 172.21.15.132:0/1035731468 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0007070 con 0x7f4b980069d0 2023-11-18T20:41:11.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4bb5f67640 1 -- 172.21.15.132:0/1035731468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 msgr2=0x7f4b98006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:11.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4bb5f67640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4b98006e50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0007fb0 tx=0x7f4b98007a00 comp rx=0 tx=0).stop 2023-11-18T20:41:11.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4bb5f67640 1 -- 172.21.15.132:0/1035731468 shutdown_connections 2023-11-18T20:41:11.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4bb5f67640 1 --2- 172.21.15.132:0/1035731468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4b98006e50 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4bb5f67640 1 -- 172.21.15.132:0/1035731468 >> 172.21.15.132:0/1035731468 conn(0x7f4bb00a77f0 msgr2=0x7f4bb00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.085+0000 7f4bb5f67640 1 -- 172.21.15.132:0/1035731468 shutdown_connections 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.086+0000 7f4bb5f67640 1 -- 172.21.15.132:0/1035731468 wait complete. 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.087+0000 7f4bb5f67640 1 Processor -- start 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.087+0000 7f4bb5f67640 1 -- start start 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb5f67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4bb0144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb5f67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bb01454c0 0x7f4bb014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb5f67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bb014cdb0 0x7f4bb0146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb5f67640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0145fc0 con 0x7f4b980069d0 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb5f67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0145c90 con 0x7f4bb014cdb0 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb5f67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01ea990 con 0x7f4bb01454c0 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb4f65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4bb0144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:11.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb4f65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4bb0144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33020/0 (socket says 172.21.15.132:33020) 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.088+0000 7f4bb4f65640 1 -- 172.21.15.132:0/111761101 learned_addr learned my addr 172.21.15.132:0/111761101 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb4f65640 1 -- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bb01454c0 msgr2=0x7f4bb014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4ba7fff640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bb01454c0 0x7f4bb014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb5766640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bb014cdb0 0x7f4bb0146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb4f65640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bb01454c0 0x7f4bb014c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb4f65640 1 -- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bb014cdb0 msgr2=0x7f4bb0146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb4f65640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bb014cdb0 0x7f4bb0146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb4f65640 1 -- 172.21.15.132:0/111761101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb01eac70 con 0x7f4b980069d0 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb4f65640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4bb0144790 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00d400 tx=0x7f4bac00d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4ba57fa640 1 -- 172.21.15.132:0/111761101 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00b070 con 0x7f4b980069d0 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4ba57fa640 1 -- 172.21.15.132:0/111761101 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0054e0 con 0x7f4b980069d0 2023-11-18T20:41:11.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4ba57fa640 1 -- 172.21.15.132:0/111761101 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac003830 con 0x7f4b980069d0 2023-11-18T20:41:11.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb0144cd0 con 0x7f4b980069d0 2023-11-18T20:41:11.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.089+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb014dc40 con 0x7f4b980069d0 2023-11-18T20:41:11.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.091+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb014de60 con 0x7f4b980069d0 2023-11-18T20:41:11.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.091+0000 7f4ba57fa640 1 -- 172.21.15.132:0/111761101 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4bac003990 con 0x7f4b980069d0 2023-11-18T20:41:11.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.092+0000 7f4ba57fa640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4b9c06ae70 0x7f4b9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:11.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.092+0000 7f4ba57fa640 1 -- 172.21.15.132:0/111761101 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4bac088b40 con 0x7f4b980069d0 2023-11-18T20:41:11.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.093+0000 7f4ba7fff640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4b9c06ae70 0x7f4b9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:11.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.094+0000 7f4ba7fff640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4b9c06ae70 0x7f4b9c06d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0034000 tx=0x7f4ba0009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:11.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.097+0000 7f4ba57fa640 1 -- 172.21.15.132:0/111761101 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4bac053f30 con 0x7f4b980069d0 2023-11-18T20:41:11.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.334+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f4bb004e840 con 0x7f4b980069d0 2023-11-18T20:41:11.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.976+0000 7f4ba57fa640 1 -- 172.21.15.132:0/111761101 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v198) v1 ==== 162+0+0 (secure 0 0 0) 0x7f4bac018020 con 0x7f4b980069d0 2023-11-18T20:41:11.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4b9c06ae70 msgr2=0x7f4b9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:11.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4b9c06ae70 0x7f4b9c06d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0034000 tx=0x7f4ba0009030 comp rx=0 tx=0).stop 2023-11-18T20:41:11.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 msgr2=0x7f4bb0144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:11.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4bb0144790 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00d400 tx=0x7f4bac00d8c0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 shutdown_connections 2023-11-18T20:41:11.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4b9c06ae70 0x7f4b9c06d330 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bb014cdb0 0x7f4bb0146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bb01454c0 0x7f4bb014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 --2- 172.21.15.132:0/111761101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b980069d0 0x7f4bb0144790 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:11.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 >> 172.21.15.132:0/111761101 conn(0x7f4bb00a77f0 msgr2=0x7f4bb00a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:11.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 shutdown_connections 2023-11-18T20:41:11.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:11.981+0000 7f4bb5f67640 1 -- 172.21.15.132:0/111761101 wait complete. 2023-11-18T20:41:12.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-18T20:41:12.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.220+0000 7f677b414640 1 Processor -- start 2023-11-18T20:41:12.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.220+0000 7f677b414640 1 -- start start 2023-11-18T20:41:12.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.222+0000 7f677b414640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f67740c7cc0 0x7f67741585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:12.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.222+0000 7f677b414640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67740c5d80 con 0x7f677406bf80 2023-11-18T20:41:12.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.222+0000 7f677b414640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6774158b00 con 0x7f6774151dc0 2023-11-18T20:41:12.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.222+0000 7f677b414640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740c6970 con 0x7f67740c7cc0 2023-11-18T20:41:12.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.222+0000 7f677ac13640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f677406bf80 0x7f677406c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45216/0 (socket says 172.21.15.132:45216) 2023-11-18T20:41:12.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.222+0000 7f677ac13640 1 -- 172.21.15.132:0/1698610769 learned_addr learned my addr 172.21.15.132:0/1698610769 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:12.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779c11640 1 --2- 172.21.15.132:0/1698610769 >> v2:172.21.15.161:3300/0 conn(0x7f67740c7cc0 0x7f67741585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843818187 0 0) 0x7f676c001490 con 0x7f677406bf80 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6760003520 con 0x7f677406bf80 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 759777116 0 0) 0x7f6760003520 con 0x7f677406bf80 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 >> v2:172.21.15.161:3300/0 conn(0x7f67740c7cc0 msgr2=0x7f67741585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 --2- 172.21.15.132:0/1698610769 >> v2:172.21.15.161:3300/0 conn(0x7f67740c7cc0 0x7f67741585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 >> v1:172.21.15.161:6789/0 conn(0x7f6774151dc0 legacy=0x7f67740c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740c6c10 con 0x7f677406bf80 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f676c001b80 con 0x7f677406bf80 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 >> v1:172.21.15.132:6789/0 conn(0x7f677406bf80 legacy=0x7f677406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6760003970 0x7f6760003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67600047c0 0x7f6760004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:12.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6760005180 0x7f676000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c6970 con 0x7f6760005180 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676000c020 con 0x7f6760003970 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.223+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676000c1e0 con 0x7f67600047c0 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.224+0000 7f677ac13640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6760005180 0x7f676000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.224+0000 7f677a412640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6760003970 0x7f6760003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.224+0000 7f6779c11640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67600047c0 0x7f6760004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.224+0000 7f677ac13640 1 -- 172.21.15.132:0/1698610769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67600047c0 msgr2=0x7f6760004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.224+0000 7f677ac13640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67600047c0 0x7f6760004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.224+0000 7f677ac13640 1 -- 172.21.15.132:0/1698610769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6760003970 msgr2=0x7f6760003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.224+0000 7f677ac13640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6760003970 0x7f6760003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.224+0000 7f677ac13640 1 -- 172.21.15.132:0/1698610769 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760003520 con 0x7f6760005180 2023-11-18T20:41:12.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.225+0000 7f677ac13640 1 -- 172.21.15.132:0/1698610769 reap_dead start 2023-11-18T20:41:12.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.225+0000 7f677ac13640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6760005180 0x7f676000b980 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f676c00a830 tx=0x7f67600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540b31cd85b9eab5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c034630 con 0x7f6760005180 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c02f070 con 0x7f6760005180 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f6779410640 1 -- 172.21.15.132:0/1698610769 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0349f0 con 0x7f6760005180 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f677b414640 1 -- 172.21.15.132:0/1698610769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6760005180 msgr2=0x7f676000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f677b414640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6760005180 0x7f676000b980 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f676c00a830 tx=0x7f67600057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f677b414640 1 -- 172.21.15.132:0/1698610769 shutdown_connections 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f677b414640 1 --2- 172.21.15.132:0/1698610769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6760005180 0x7f676000b980 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f677b414640 1 -- 172.21.15.132:0/1698610769 >> 172.21.15.132:0/1698610769 conn(0x7f67740ab950 msgr2=0x7f67740abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f677b414640 1 -- 172.21.15.132:0/1698610769 shutdown_connections 2023-11-18T20:41:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.226+0000 7f677b414640 1 -- 172.21.15.132:0/1698610769 wait complete. 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.228+0000 7f677b414640 1 Processor -- start 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.228+0000 7f677b414640 1 -- start start 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677b414640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6760005180 0x7f677414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677b414640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f677414f1b0 0x7f67741ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677b414640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67741eda60 0x7f6774148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677b414640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740bfe30 con 0x7f67741eda60 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677b414640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c2ff0 con 0x7f677414f1b0 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677b414640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c35b0 con 0x7f6760005180 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677ac13640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67741eda60 0x7f6774148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677ac13640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67741eda60 0x7f6774148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33036/0 (socket says 172.21.15.132:33036) 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.229+0000 7f677ac13640 1 -- 172.21.15.132:0/2421034831 learned_addr learned my addr 172.21.15.132:0/2421034831 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f677a412640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6760005180 0x7f677414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f6779c11640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f677414f1b0 0x7f67741ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f677ac13640 1 -- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6760005180 msgr2=0x7f677414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f677ac13640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6760005180 0x7f677414ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f677ac13640 1 -- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f677414f1b0 msgr2=0x7f67741ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f677ac13640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f677414f1b0 0x7f67741ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f677ac13640 1 -- 172.21.15.132:0/2421034831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740c2630 con 0x7f67741eda60 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f6779c11640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f677414f1b0 0x7f67741ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f677ac13640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67741eda60 0x7f6774148140 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f676c00a920 tx=0x7f676c001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.230+0000 7f676affd640 1 -- 172.21.15.132:0/2421034831 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c004d60 con 0x7f67741eda60 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.231+0000 7f676affd640 1 -- 172.21.15.132:0/2421034831 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c001490 con 0x7f67741eda60 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.231+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67741edfd0 con 0x7f67741eda60 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.231+0000 7f676affd640 1 -- 172.21.15.132:0/2421034831 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c034630 con 0x7f67741eda60 2023-11-18T20:41:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.231+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67740c3240 con 0x7f67741eda60 2023-11-18T20:41:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.232+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67740c3400 con 0x7f67741eda60 2023-11-18T20:41:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.233+0000 7f676affd640 1 -- 172.21.15.132:0/2421034831 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f676c031030 con 0x7f67741eda60 2023-11-18T20:41:12.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.234+0000 7f676affd640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f675806ae70 0x7f675806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:12.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.234+0000 7f676affd640 1 -- 172.21.15.132:0/2421034831 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f676c0aacf0 con 0x7f67741eda60 2023-11-18T20:41:12.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.234+0000 7f677a412640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f675806ae70 0x7f675806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:12.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.235+0000 7f677a412640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f675806ae70 0x7f675806d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6770000c00 tx=0x7f6770009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:12.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.238+0000 7f676affd640 1 -- 172.21.15.132:0/2421034831 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f676c0760d0 con 0x7f67741eda60 2023-11-18T20:41:12.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.428+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f67740c3400 con 0x7f67741eda60 2023-11-18T20:41:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.433+0000 7f676affd640 1 -- 172.21.15.132:0/2421034831 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f676c0796f0 con 0x7f67741eda60 2023-11-18T20:41:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.435+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f675806ae70 msgr2=0x7f675806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.435+0000 7f677b414640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f675806ae70 0x7f675806d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6770000c00 tx=0x7f6770009040 comp rx=0 tx=0).stop 2023-11-18T20:41:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67741eda60 msgr2=0x7f6774148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67741eda60 0x7f6774148140 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f676c00a920 tx=0x7f676c001f10 comp rx=0 tx=0).stop 2023-11-18T20:41:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 shutdown_connections 2023-11-18T20:41:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f675806ae70 0x7f675806d330 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67741eda60 0x7f6774148140 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f677414f1b0 0x7f67741ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 --2- 172.21.15.132:0/2421034831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6760005180 0x7f677414ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 >> 172.21.15.132:0/2421034831 conn(0x7f67740ab950 msgr2=0x7f67740abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 shutdown_connections 2023-11-18T20:41:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:12.436+0000 7f677b414640 1 -- 172.21.15.132:0/2421034831 wait complete. 2023-11-18T20:41:12.458 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-18T20:41:12.458 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:41:12.569 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:41:12.695 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-18T20:41:12.695 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:12.695 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:12.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:41:12.755 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:12.755 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:12.813 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-18T20:41:12.813 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-18T20:41:12.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:41:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.035+0000 7fd79950f640 1 Processor -- start 2023-11-18T20:41:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.035+0000 7fd79950f640 1 -- start start 2023-11-18T20:41:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd79950f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c5ec0 0x7fd7940c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd79950f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7940c45d0 0x7fd7940c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd79950f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7940bfdc0 con 0x7fd7940721a0 2023-11-18T20:41:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd79950f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79406e390 con 0x7fd7940c45d0 2023-11-18T20:41:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd79950f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79406ddd0 con 0x7fd7940c5ec0 2023-11-18T20:41:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd7937fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd7940721a0 0x7fd794155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45228/0 (socket says 172.21.15.132:45228) 2023-11-18T20:41:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd7937fe640 1 -- 172.21.15.132:0/1244458035 learned_addr learned my addr 172.21.15.132:0/1244458035 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:13.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd78bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7940c45d0 0x7fd7940c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd792ffd640 1 --2- 172.21.15.132:0/1244458035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c5ec0 0x7fd7940c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd78bfff640 1 -- 172.21.15.132:0/1244458035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c5ec0 msgr2=0x7fd7940c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd78bfff640 1 --2- 172.21.15.132:0/1244458035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c5ec0 0x7fd7940c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd78bfff640 1 -- 172.21.15.132:0/1244458035 >> v1:172.21.15.132:6789/0 conn(0x7fd7940721a0 legacy=0x7fd794155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd78bfff640 1 -- 172.21.15.132:0/1244458035 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79406e0b0 con 0x7fd7940c45d0 2023-11-18T20:41:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.037+0000 7fd7927fc640 1 -- 172.21.15.132:0/1244458035 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159307014 0 0) 0x7fd7940bfdc0 con 0x7fd7940721a0 2023-11-18T20:41:13.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.038+0000 7fd78bfff640 1 --2- 172.21.15.132:0/1244458035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940c45d0 0x7fd7940c3170 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0097a0 tx=0x7fd77c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ba0731fb7802af server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.038+0000 7fd7927fc640 1 -- 172.21.15.132:0/1244458035 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0316f0 con 0x7fd7940c45d0 2023-11-18T20:41:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.038+0000 7fd7927fc640 1 -- 172.21.15.132:0/1244458035 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c031850 con 0x7fd7940c45d0 2023-11-18T20:41:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.038+0000 7fd7927fc640 1 -- 172.21.15.132:0/1244458035 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c031be0 con 0x7fd7940c45d0 2023-11-18T20:41:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.039+0000 7fd79950f640 1 -- 172.21.15.132:0/1244458035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940c45d0 msgr2=0x7fd7940c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.039+0000 7fd79950f640 1 --2- 172.21.15.132:0/1244458035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940c45d0 0x7fd7940c3170 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0097a0 tx=0x7fd77c02b790 comp rx=0 tx=0).stop 2023-11-18T20:41:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.039+0000 7fd79950f640 1 -- 172.21.15.132:0/1244458035 shutdown_connections 2023-11-18T20:41:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.039+0000 7fd79950f640 1 --2- 172.21.15.132:0/1244458035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940c45d0 0x7fd7940c3170 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.039+0000 7fd79950f640 1 --2- 172.21.15.132:0/1244458035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c5ec0 0x7fd7940c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.039+0000 7fd79950f640 1 -- 172.21.15.132:0/1244458035 >> 172.21.15.132:0/1244458035 conn(0x7fd79406a500 msgr2=0x7fd79406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.039+0000 7fd79950f640 1 -- 172.21.15.132:0/1244458035 shutdown_connections 2023-11-18T20:41:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.039+0000 7fd79950f640 1 -- 172.21.15.132:0/1244458035 wait complete. 2023-11-18T20:41:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.041+0000 7fd79950f640 1 Processor -- start 2023-11-18T20:41:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.041+0000 7fd79950f640 1 -- start start 2023-11-18T20:41:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd79950f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940721a0 0x7fd794158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd79950f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c45d0 0x7fd794155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd79950f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7940c5ec0 0x7fd7940a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd79950f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794150c00 con 0x7fd7940721a0 2023-11-18T20:41:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd79950f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941576a0 con 0x7fd7940c5ec0 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd79950f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd794157980 con 0x7fd7940c45d0 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd792ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940721a0 0x7fd794158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd792ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940721a0 0x7fd794158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33040/0 (socket says 172.21.15.132:33040) 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd792ffd640 1 -- 172.21.15.132:0/3733975021 learned_addr learned my addr 172.21.15.132:0/3733975021 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd792ffd640 1 -- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c45d0 msgr2=0x7fd794155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd792ffd640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c45d0 0x7fd794155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd792ffd640 1 -- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7940c5ec0 msgr2=0x7fd7940a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd792ffd640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7940c5ec0 0x7fd7940a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.042+0000 7fd792ffd640 1 -- 172.21.15.132:0/3733975021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c009400 con 0x7fd7940721a0 2023-11-18T20:41:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.043+0000 7fd792ffd640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940721a0 0x7fd794158460 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd78400d5f0 tx=0x7fd78400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.043+0000 7fd78b7fe640 1 -- 172.21.15.132:0/3733975021 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840125f0 con 0x7fd7940721a0 2023-11-18T20:41:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.043+0000 7fd78b7fe640 1 -- 172.21.15.132:0/3733975021 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784012750 con 0x7fd7940721a0 2023-11-18T20:41:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.043+0000 7fd78b7fe640 1 -- 172.21.15.132:0/3733975021 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784012b00 con 0x7fd7940721a0 2023-11-18T20:41:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.043+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd794157c60 con 0x7fd7940721a0 2023-11-18T20:41:13.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.043+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd794155e80 con 0x7fd7940721a0 2023-11-18T20:41:13.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.044+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd794068350 con 0x7fd7940721a0 2023-11-18T20:41:13.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.045+0000 7fd78b7fe640 1 -- 172.21.15.132:0/3733975021 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd784012c60 con 0x7fd7940721a0 2023-11-18T20:41:13.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.046+0000 7fd78b7fe640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd77406ae40 0x7fd77406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.047+0000 7fd78b7fe640 1 -- 172.21.15.132:0/3733975021 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd784089850 con 0x7fd7940721a0 2023-11-18T20:41:13.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.047+0000 7fd78bfff640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd77406ae40 0x7fd77406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.048+0000 7fd78bfff640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd77406ae40 0x7fd77406d300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd77c036000 tx=0x7fd77c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:13.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.051+0000 7fd78b7fe640 1 -- 172.21.15.132:0/3733975021 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd784054b90 con 0x7fd7940721a0 2023-11-18T20:41:13.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.277+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7940bfa00 con 0x7fd7940721a0 2023-11-18T20:41:13.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.278+0000 7fd78b7fe640 1 -- 172.21.15.132:0/3733975021 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fd7840581b0 con 0x7fd7940721a0 2023-11-18T20:41:13.280 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:13.280 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3344598223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3344598223},{"type":"v1","addr":"172.21.15.161:6835","nonce":3344598223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/675139347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":675139347},{"type":"v1","addr":"172.21.15.161:6837","nonce":675139347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/417491622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":417491622},{"type":"v1","addr":"172.21.15.132:6835","nonce":417491622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37},{"gid":6420,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/1522223373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1522223373},{"type":"v1","addr":"172.21.15.132:6833","nonce":1522223373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[]} 2023-11-18T20:41:13.281 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 39 2023-11-18T20:41:13.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd77406ae40 msgr2=0x7fd77406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd77406ae40 0x7fd77406d300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd77c036000 tx=0x7fd77c030000 comp rx=0 tx=0).stop 2023-11-18T20:41:13.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940721a0 msgr2=0x7fd794158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940721a0 0x7fd794158460 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd78400d5f0 tx=0x7fd78400dab0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 shutdown_connections 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd77406ae40 0x7fd77406d300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7940c5ec0 0x7fd7940a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7940c45d0 0x7fd794155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 --2- 172.21.15.132:0/3733975021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7940721a0 0x7fd794158460 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 >> 172.21.15.132:0/3733975021 conn(0x7fd79406a500 msgr2=0x7fd794153d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 shutdown_connections 2023-11-18T20:41:13.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.281+0000 7fd79950f640 1 -- 172.21.15.132:0/3733975021 wait complete. 2023-11-18T20:41:13.302 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-18T20:41:13.302 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-18T20:41:13.302 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-18T20:41:13.302 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:41:13.302 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-18T20:41:13.303 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-18T20:41:13.303 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-18T20:41:13.303 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:41:13.303 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-18T20:41:13.303 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-18T20:41:13.303 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-18T20:41:13.304 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:41:13.304 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-18T20:41:13.304 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-18T20:41:13.304 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-18T20:41:13.304 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:41:13.320 INFO:tasks.ceph.mds.a:Stopped 2023-11-18T20:41:13.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-18T20:41:13.321 INFO:tasks.ceph.mds.c:Stopped 2023-11-18T20:41:13.321 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-18T20:41:13.326 INFO:tasks.ceph.mds.b:Stopped 2023-11-18T20:41:13.326 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-18T20:41:13.332 INFO:tasks.ceph.mds.d:Stopped 2023-11-18T20:41:13.332 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-18T20:41:13.369 INFO:tasks.ceph.mds.a:Started 2023-11-18T20:41:13.369 DEBUG:teuthology.parallel:result is None 2023-11-18T20:41:13.376 INFO:tasks.ceph.mds.c:Started 2023-11-18T20:41:13.376 DEBUG:teuthology.parallel:result is None 2023-11-18T20:41:13.377 INFO:tasks.ceph.mds.b:Started 2023-11-18T20:41:13.378 DEBUG:teuthology.parallel:result is None 2023-11-18T20:41:13.382 INFO:tasks.ceph.mds.d:Started 2023-11-18T20:41:13.382 DEBUG:teuthology.parallel:result is None 2023-11-18T20:41:13.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-18T20:41:13.529 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-11-18T20:41:13.530 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-11-18T20:41:13.543 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-11-18T20:41:13.545 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-11-18T20:41:13.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.564+0000 7f3868108640 1 Processor -- start 2023-11-18T20:41:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.565+0000 7f3868108640 1 -- start start 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f3868108640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f386014fd30 0x7f3860152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f3868108640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f386006d0a0 0x7f38600a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f3868108640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38600c64a0 con 0x7f38600a5260 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f3868108640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600c5c00 con 0x7f386006d0a0 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f3868108640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600c5ee0 con 0x7f386014fd30 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f38656a3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f386006d0a0 0x7f38600a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f38656a3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f386006d0a0 0x7f38600a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33072/0 (socket says 172.21.15.132:33072) 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f38656a3640 1 -- 172.21.15.132:0/3992390257 learned_addr learned my addr 172.21.15.132:0/3992390257 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.566+0000 7f3865ea4640 1 --2- 172.21.15.132:0/3992390257 >> v2:172.21.15.161:3300/0 conn(0x7f386014fd30 0x7f3860152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.567+0000 7f38656a3640 1 -- 172.21.15.132:0/3992390257 >> v2:172.21.15.161:3300/0 conn(0x7f386014fd30 msgr2=0x7f3860152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.567+0000 7f38656a3640 1 --2- 172.21.15.132:0/3992390257 >> v2:172.21.15.161:3300/0 conn(0x7f386014fd30 0x7f3860152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.567+0000 7f38656a3640 1 -- 172.21.15.132:0/3992390257 >> v1:172.21.15.161:6789/0 conn(0x7f38600a5260 legacy=0x7f38600c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.567+0000 7f38656a3640 1 -- 172.21.15.132:0/3992390257 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600c61c0 con 0x7f386006d0a0 2023-11-18T20:41:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.567+0000 7f3864ea2640 1 -- 172.21.15.132:0/3992390257 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280811473 0 0) 0x7f38600c64a0 con 0x7f38600a5260 2023-11-18T20:41:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.568+0000 7f38656a3640 1 --2- 172.21.15.132:0/3992390257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38600a4d20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f386006b200 tx=0x7f385002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd0cc2f62d8b902 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.568+0000 7f3864ea2640 1 -- 172.21.15.132:0/3992390257 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850030860 con 0x7f386006d0a0 2023-11-18T20:41:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.568+0000 7f3864ea2640 1 -- 172.21.15.132:0/3992390257 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38500309c0 con 0x7f386006d0a0 2023-11-18T20:41:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.568+0000 7f3864ea2640 1 -- 172.21.15.132:0/3992390257 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850030d50 con 0x7f386006d0a0 2023-11-18T20:41:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.568+0000 7f3868108640 1 -- 172.21.15.132:0/3992390257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 msgr2=0x7f38600a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.568+0000 7f3868108640 1 --2- 172.21.15.132:0/3992390257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38600a4d20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f386006b200 tx=0x7f385002b9a0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.569+0000 7f3868108640 1 -- 172.21.15.132:0/3992390257 shutdown_connections 2023-11-18T20:41:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.569+0000 7f3868108640 1 --2- 172.21.15.132:0/3992390257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38600a4d20 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.569+0000 7f3868108640 1 --2- 172.21.15.132:0/3992390257 >> v2:172.21.15.161:3300/0 conn(0x7f386014fd30 0x7f3860152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.569+0000 7f3868108640 1 -- 172.21.15.132:0/3992390257 >> 172.21.15.132:0/3992390257 conn(0x7f386006a500 msgr2=0x7f386006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.569+0000 7f3868108640 1 -- 172.21.15.132:0/3992390257 shutdown_connections 2023-11-18T20:41:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.569+0000 7f3868108640 1 -- 172.21.15.132:0/3992390257 wait complete. 2023-11-18T20:41:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.570+0000 7f3868108640 1 Processor -- start 2023-11-18T20:41:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.570+0000 7f3868108640 1 -- start start 2023-11-18T20:41:13.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.571+0000 7f3868108640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38601543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.571+0000 7f3868108640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38600a5260 0x7f3860156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.571+0000 7f3868108640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f386014fd30 0x7f38600bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.571+0000 7f3868108640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860153ec0 con 0x7f386006d0a0 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.571+0000 7f3868108640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38601df6f0 con 0x7f38600a5260 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.571+0000 7f3868108640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38601548e0 con 0x7f386014fd30 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38601543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38601543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33078/0 (socket says 172.21.15.132:33078) 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 -- 172.21.15.132:0/4155734298 learned_addr learned my addr 172.21.15.132:0/4155734298 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f38666a5640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f386014fd30 0x7f38600bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f38656a3640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38600a5260 0x7f3860156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 -- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f386014fd30 msgr2=0x7f38600bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f386014fd30 0x7f38600bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 -- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38600a5260 msgr2=0x7f3860156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38600a5260 0x7f3860156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 -- 172.21.15.132:0/4155734298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38500094d0 con 0x7f386006d0a0 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f38656a3640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38600a5260 0x7f3860156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.572+0000 7f3865ea4640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38601543a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f385c00e870 tx=0x7f385c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.573+0000 7f38567fc640 1 -- 172.21.15.132:0/4155734298 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0094f0 con 0x7f386006d0a0 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.573+0000 7f38567fc640 1 -- 172.21.15.132:0/4155734298 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c00c940 con 0x7f386006d0a0 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.573+0000 7f38567fc640 1 -- 172.21.15.132:0/4155734298 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00ccf0 con 0x7f386006d0a0 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.573+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38601df3c0 con 0x7f386006d0a0 2023-11-18T20:41:13.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.573+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38601ee230 con 0x7f386006d0a0 2023-11-18T20:41:13.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.574+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3860068350 con 0x7f386006d0a0 2023-11-18T20:41:13.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.575+0000 7f38567fc640 1 -- 172.21.15.132:0/4155734298 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f385c013470 con 0x7f386006d0a0 2023-11-18T20:41:13.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.576+0000 7f38567fc640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f384406ae40 0x7f384406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:13.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.576+0000 7f38567fc640 1 -- 172.21.15.132:0/4155734298 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f385c0892e0 con 0x7f386006d0a0 2023-11-18T20:41:13.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.576+0000 7f38656a3640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f384406ae40 0x7f384406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:13.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.577+0000 7f38656a3640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f384406ae40 0x7f384406d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3850036000 tx=0x7f3850008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:13.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.580+0000 7f38567fc640 1 -- 172.21.15.132:0/4155734298 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f385c054770 con 0x7f386006d0a0 2023-11-18T20:41:13.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:13.773+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f38600c04a0 con 0x7f386006d0a0 2023-11-18T20:41:15.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.017+0000 7f38567fc640 1 -- 172.21.15.132:0/4155734298 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v72) v1 ==== 97+0+0 (secure 0 0 0) 0x7f385c057d90 con 0x7f386006d0a0 2023-11-18T20:41:15.019 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-11-18T20:41:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f384406ae40 msgr2=0x7f384406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f384406ae40 0x7f384406d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3850036000 tx=0x7f3850008030 comp rx=0 tx=0).stop 2023-11-18T20:41:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 msgr2=0x7f38601543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38601543a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f385c00e870 tx=0x7f385c00ed30 comp rx=0 tx=0).stop 2023-11-18T20:41:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 shutdown_connections 2023-11-18T20:41:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f384406ae40 0x7f384406d300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f386014fd30 0x7f38600bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38600a5260 0x7f3860156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 --2- 172.21.15.132:0/4155734298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386006d0a0 0x7f38601543a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.021+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 >> 172.21.15.132:0/4155734298 conn(0x7f386006a500 msgr2=0x7f38600a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.022+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 shutdown_connections 2023-11-18T20:41:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.022+0000 7f3868108640 1 -- 172.21.15.132:0/4155734298 wait complete. 2023-11-18T20:41:15.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-18T20:41:15.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.235+0000 7f28d8bcc640 1 Processor -- start 2023-11-18T20:41:15.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.235+0000 7f28d8bcc640 1 -- start start 2023-11-18T20:41:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.236+0000 7f28d8bcc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28d40a9b40 0x7f28d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.236+0000 7f28d8bcc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28d40c1500 0x7f28d40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.236+0000 7f28d8bcc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d40c06c0 con 0x7f28d4155490 2023-11-18T20:41:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.236+0000 7f28d8bcc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40a5820 con 0x7f28d40a9b40 2023-11-18T20:41:15.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.237+0000 7f28d8bcc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40c1020 con 0x7f28d40c1500 2023-11-18T20:41:15.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.237+0000 7f28d259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f28d4155490 0x7f28d40a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45248/0 (socket says 172.21.15.132:45248) 2023-11-18T20:41:15.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.237+0000 7f28d259c640 1 -- 172.21.15.132:0/365732518 learned_addr learned my addr 172.21.15.132:0/365732518 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:15.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.237+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657785759 0 0) 0x7f28d40c06c0 con 0x7f28d4155490 2023-11-18T20:41:15.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.237+0000 7f28cbfff640 1 --2- 172.21.15.132:0/365732518 >> v2:172.21.15.161:3300/0 conn(0x7f28d40a9b40 0x7f28d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.237+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c0005730 con 0x7f28d4155490 2023-11-18T20:41:15.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.237+0000 7f28d2d9d640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28d40c1500 0x7f28d40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2425730571 0 0) 0x7f28c0005730 con 0x7f28d4155490 2023-11-18T20:41:15.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28d40c1500 msgr2=0x7f28d40c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:15.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28d40c1500 0x7f28d40c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 >> v2:172.21.15.161:3300/0 conn(0x7f28d40a9b40 msgr2=0x7f28d40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:15.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 --2- 172.21.15.132:0/365732518 >> v2:172.21.15.161:3300/0 conn(0x7f28d40a9b40 0x7f28d40a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40c0910 con 0x7f28d4155490 2023-11-18T20:41:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f28c4001670 con 0x7f28d4155490 2023-11-18T20:41:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 >> v1:172.21.15.132:6789/0 conn(0x7f28d4155490 legacy=0x7f28d40a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28c0005b80 0x7f28c0005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28d40c1500 0x7f28c00069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28c0006f10 0x7f28c0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40c1020 con 0x7f28c0006f10 2023-11-18T20:41:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c000db90 con 0x7f28c0005b80 2023-11-18T20:41:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c000dd00 con 0x7f28d40c1500 2023-11-18T20:41:15.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d2d9d640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28c0006f10 0x7f28c0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.238+0000 7f28d259c640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28c0005b80 0x7f28c0005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.239+0000 7f28cbfff640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28d40c1500 0x7f28c00069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.239+0000 7f28d2d9d640 1 -- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28d40c1500 msgr2=0x7f28c00069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.239+0000 7f28d2d9d640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28d40c1500 0x7f28c00069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.239+0000 7f28d2d9d640 1 -- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28c0005b80 msgr2=0x7f28c0005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.239+0000 7f28d2d9d640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28c0005b80 0x7f28c0005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.239+0000 7f28d2d9d640 1 -- 172.21.15.132:0/365732518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0005730 con 0x7f28c0006f10 2023-11-18T20:41:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.240+0000 7f28d2d9d640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28c0006f10 0x7f28c0007390 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f28d40ab440 tx=0x7f28c0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720c3f963c16223c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.240+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc02cc70 con 0x7f28c0006f10 2023-11-18T20:41:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.240+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc02cdd0 con 0x7f28c0006f10 2023-11-18T20:41:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.240+0000 7f28d1d9b640 1 -- 172.21.15.132:0/365732518 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc034680 con 0x7f28c0006f10 2023-11-18T20:41:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.241+0000 7f28d8bcc640 1 -- 172.21.15.132:0/365732518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28c0006f10 msgr2=0x7f28c0007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.241+0000 7f28d8bcc640 1 --2- 172.21.15.132:0/365732518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28c0006f10 0x7f28c0007390 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f28d40ab440 tx=0x7f28c0007a00 comp rx=0 tx=0).stop 2023-11-18T20:41:15.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.241+0000 7f28d2d9d640 1 -- 172.21.15.132:0/365732518 reap_dead start 2023-11-18T20:41:15.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.241+0000 7f28d8bcc640 1 -- 172.21.15.132:0/365732518 shutdown_connections 2023-11-18T20:41:15.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.241+0000 7f28d8bcc640 1 -- 172.21.15.132:0/365732518 >> 172.21.15.132:0/365732518 conn(0x7f28d406a500 msgr2=0x7f28d406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:15.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.241+0000 7f28d8bcc640 1 -- 172.21.15.132:0/365732518 shutdown_connections 2023-11-18T20:41:15.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.241+0000 7f28d8bcc640 1 -- 172.21.15.132:0/365732518 wait complete. 2023-11-18T20:41:15.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.242+0000 7f28d8bcc640 1 Processor -- start 2023-11-18T20:41:15.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.243+0000 7f28d8bcc640 1 -- start start 2023-11-18T20:41:15.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.243+0000 7f28d8bcc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28c0006f10 0x7f28d40bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.243+0000 7f28d8bcc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28d414d160 0x7f28d414c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28d8bcc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d414c9d0 0x7f28d41ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28d8bcc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41ed710 con 0x7f28d414d160 2023-11-18T20:41:15.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28d8bcc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41ed9f0 con 0x7f28d414c9d0 2023-11-18T20:41:15.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28d8bcc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41edcd0 con 0x7f28c0006f10 2023-11-18T20:41:15.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28d414d160 0x7f28d414c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28d414d160 0x7f28d414c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33092/0 (socket says 172.21.15.132:33092) 2023-11-18T20:41:15.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 -- 172.21.15.132:0/740850663 learned_addr learned my addr 172.21.15.132:0/740850663 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:15.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 -- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28c0006f10 msgr2=0x7f28d40bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28c0006f10 0x7f28d40bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 -- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d414c9d0 msgr2=0x7f28d41ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d414c9d0 0x7f28d41ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 -- 172.21.15.132:0/740850663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d41edfb0 con 0x7f28d414d160 2023-11-18T20:41:15.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.244+0000 7f28cbfff640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28d414d160 0x7f28d414c490 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0116d0 tx=0x7f28bc011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:15.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.245+0000 7f28caffd640 1 -- 172.21.15.132:0/740850663 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00f940 con 0x7f28d414d160 2023-11-18T20:41:15.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.245+0000 7f28caffd640 1 -- 172.21.15.132:0/740850663 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc00faa0 con 0x7f28d414d160 2023-11-18T20:41:15.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.245+0000 7f28caffd640 1 -- 172.21.15.132:0/740850663 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00fe10 con 0x7f28d414d160 2023-11-18T20:41:15.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.245+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d41ee290 con 0x7f28d414d160 2023-11-18T20:41:15.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.245+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d40aaee0 con 0x7f28d414d160 2023-11-18T20:41:15.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.246+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4068350 con 0x7f28d414d160 2023-11-18T20:41:15.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.247+0000 7f28caffd640 1 -- 172.21.15.132:0/740850663 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28bc015460 con 0x7f28d414d160 2023-11-18T20:41:15.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.248+0000 7f28caffd640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f28b406ae70 0x7f28b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.248+0000 7f28caffd640 1 -- 172.21.15.132:0/740850663 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f28bc089800 con 0x7f28d414d160 2023-11-18T20:41:15.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.249+0000 7f28d259c640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f28b406ae70 0x7f28b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.250+0000 7f28d259c640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f28b406ae70 0x7f28b406d330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f28c40059b0 tx=0x7f28c4001d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:15.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.252+0000 7f28caffd640 1 -- 172.21.15.132:0/740850663 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28bc054c10 con 0x7f28d414d160 2023-11-18T20:41:15.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.510+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f28d4154c20 con 0x7f28d414d160 2023-11-18T20:41:15.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.511+0000 7f28caffd640 1 -- 172.21.15.132:0/740850663 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5081 (secure 0 0 0) 0x7f28bc058230 con 0x7f28d414d160 2023-11-18T20:41:15.512 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:15.512 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:41:15.512 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-11-18T20:41:15.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.512 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-11-18T20:41:15.512 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFll67UuNhAAzMjJzHfHuMEnOrySo5rWkg==", 2023-11-18T20:41:15.512 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllppoxHBAAFb6gynzzJK+cDc3jFhAACg==", 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:41:15.513 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:41:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:41:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-11-18T20:41:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllLcurChAAvi5HiMzmlupLAkYw675TeQ==", 2023-11-18T20:41:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.515 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:41:15.515 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:41:15.515 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:41:15.515 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.515 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.515 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllGen8LBAAHV9S4/oQnKEkxUg+grOguA==", 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.516 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.518 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-11-18T20:41:15.518 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBwIFlloVfzAhAAR8uyp9rDYiQV+BhFjIuJvA==", 2023-11-18T20:41:15.518 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.518 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:41:15.518 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBzIFlloNl8DhAAkyClLe7G9fDXgg+zgwNkWw==", 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB2IFllDcRbJhAA6+fYI8hcxWhHNSpkw9vg0g==", 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.520 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB5IFllOnBaMRAAvOwUIZn1Jt2tAoDiRC6Gqw==", 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-11-18T20:41:15.521 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCAIFll5itZMBAASs5GAbUqVH0Xlrlqktz9xw==", 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCEIFll5uYKDxAANaYuUAsrCvw1xO9CoKqd/A==", 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.522 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCHIFllEZPyGRAASXuTF7aswO1KQfUH3BStpw==", 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.523 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCKIFllDT/tMRAAh3c/95I9x0FMZGXZ//TuWw==", 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.524 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBrIFllsbdTOxAAP60vfd0AqFNopXTOFb78Tw==", 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBsIFllrycwCxAAI7OVXj40YLGlQ4/hWY+mTA==", 2023-11-18T20:41:15.525 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw pool=cephfs2_data" 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBpIFllbT/WKBAAWaMN0vZkyb+SLPB29x0inw==", 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:41:15.526 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.testuser", 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBKIVll24xCHRAACieDcOUVt/oS9yqNZXzmMw==", 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow rw fsname=cephfs", 2023-11-18T20:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFllWW9dKhAAdaq1Wp1/FeVlv9IGXn6EhQ==", 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.528 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQBqIFllBY6bHRAApFJ5PvprGpoejUSSP7+hHw==", 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-11-18T20:41:15.529 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:41:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.513+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f28b406ae70 msgr2=0x7f28b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.513+0000 7f28d8bcc640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f28b406ae70 0x7f28b406d330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f28c40059b0 tx=0x7f28c4001d70 comp rx=0 tx=0).stop 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.513+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28d414d160 msgr2=0x7f28d414c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.513+0000 7f28d8bcc640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28d414d160 0x7f28d414c490 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0116d0 tx=0x7f28bc011b90 comp rx=0 tx=0).stop 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.514+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 shutdown_connections 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.514+0000 7f28d8bcc640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f28b406ae70 0x7f28b406d330 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.514+0000 7f28d8bcc640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d414c9d0 0x7f28d41ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.514+0000 7f28d8bcc640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28d414d160 0x7f28d414c490 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.514+0000 7f28d8bcc640 1 --2- 172.21.15.132:0/740850663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28c0006f10 0x7f28d40bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.514+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 >> 172.21.15.132:0/740850663 conn(0x7f28d406a500 msgr2=0x7f28d40c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.514+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 shutdown_connections 2023-11-18T20:41:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.514+0000 7f28d8bcc640 1 -- 172.21.15.132:0/740850663 wait complete. 2023-11-18T20:41:15.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-11-18T20:41:15.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.751+0000 7feccb133640 1 Processor -- start 2023-11-18T20:41:15.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.751+0000 7feccb133640 1 -- start start 2023-11-18T20:41:15.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.753+0000 7feccb133640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fecc40a5240 0x7fecc40c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.753+0000 7feccb133640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40c2c90 0x7fecc4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.753+0000 7feccb133640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc40aadc0 con 0x7fecc40c3bc0 2023-11-18T20:41:15.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.753+0000 7feccb133640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc4151be0 con 0x7fecc40a5240 2023-11-18T20:41:15.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.753+0000 7feccb133640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40c4170 con 0x7fecc40c2c90 2023-11-18T20:41:15.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.753+0000 7fecc3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fecc40c3bc0 0x7fecc4154500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45250/0 (socket says 172.21.15.132:45250) 2023-11-18T20:41:15.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.753+0000 7fecc3fff640 1 -- 172.21.15.132:0/612976136 learned_addr learned my addr 172.21.15.132:0/612976136 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:15.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.753+0000 7fecc8ecf640 1 --2- 172.21.15.132:0/612976136 >> v2:172.21.15.132:3300/0 conn(0x7fecc40a5240 0x7fecc40c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.754+0000 7fecc96d0640 1 --2- 172.21.15.132:0/612976136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40c2c90 0x7fecc4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.754+0000 7fecc37fe640 1 -- 172.21.15.132:0/612976136 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508509944 0 0) 0x7fecc40aadc0 con 0x7fecc40c3bc0 2023-11-18T20:41:15.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.754+0000 7fecc37fe640 1 -- 172.21.15.132:0/612976136 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb0003440 con 0x7fecc40c3bc0 2023-11-18T20:41:15.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.754+0000 7fecc8ecf640 1 -- 172.21.15.132:0/612976136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40c2c90 msgr2=0x7fecc4154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:15.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.754+0000 7fecc8ecf640 1 --2- 172.21.15.132:0/612976136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40c2c90 0x7fecc4154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.754+0000 7fecc8ecf640 1 -- 172.21.15.132:0/612976136 >> v1:172.21.15.132:6789/0 conn(0x7fecc40c3bc0 legacy=0x7fecc4154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.754+0000 7fecc8ecf640 1 -- 172.21.15.132:0/612976136 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40c4450 con 0x7fecc40a5240 2023-11-18T20:41:15.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.755+0000 7fecc8ecf640 1 --2- 172.21.15.132:0/612976136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40a5240 0x7fecc40c2750 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009d90 tx=0x7fecb402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ccb258fa702025 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:15.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7fecc37fe640 1 -- 172.21.15.132:0/612976136 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb402cb40 con 0x7fecc40a5240 2023-11-18T20:41:15.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7fecc37fe640 1 -- 172.21.15.132:0/612976136 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb402cca0 con 0x7fecc40a5240 2023-11-18T20:41:15.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7fecc37fe640 1 -- 172.21.15.132:0/612976136 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4034640 con 0x7fecc40a5240 2023-11-18T20:41:15.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7feccb133640 1 -- 172.21.15.132:0/612976136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40a5240 msgr2=0x7fecc40c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7feccb133640 1 --2- 172.21.15.132:0/612976136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40a5240 0x7fecc40c2750 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009d90 tx=0x7fecb402bd90 comp rx=0 tx=0).stop 2023-11-18T20:41:15.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7feccb133640 1 -- 172.21.15.132:0/612976136 shutdown_connections 2023-11-18T20:41:15.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7feccb133640 1 --2- 172.21.15.132:0/612976136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40c2c90 0x7fecc4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7feccb133640 1 --2- 172.21.15.132:0/612976136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40a5240 0x7fecc40c2750 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7feccb133640 1 -- 172.21.15.132:0/612976136 >> 172.21.15.132:0/612976136 conn(0x7fecc406a500 msgr2=0x7fecc406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:15.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7feccb133640 1 -- 172.21.15.132:0/612976136 shutdown_connections 2023-11-18T20:41:15.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.756+0000 7feccb133640 1 -- 172.21.15.132:0/612976136 wait complete. 2023-11-18T20:41:15.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.758+0000 7feccb133640 1 Processor -- start 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.758+0000 7feccb133640 1 -- start start 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7feccb133640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40a5240 0x7fecc4153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7feccb133640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40c2c90 0x7fecc41ec920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7feccb133640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecc40c3bc0 0x7fecc41ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7feccb133640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40a5c70 con 0x7fecc40c2c90 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7feccb133640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40a5f30 con 0x7fecc40c3bc0 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7feccb133640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40a8490 con 0x7fecc40a5240 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7fecc3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40c2c90 0x7fecc41ec920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7fecc3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40c2c90 0x7fecc41ec920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33114/0 (socket says 172.21.15.132:33114) 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.759+0000 7fecc3fff640 1 -- 172.21.15.132:0/2542820970 learned_addr learned my addr 172.21.15.132:0/2542820970 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:15.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc8ecf640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40a5240 0x7fecc4153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc96d0640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecc40c3bc0 0x7fecc41ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc3fff640 1 -- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40a5240 msgr2=0x7fecc4153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc3fff640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40a5240 0x7fecc4153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc3fff640 1 -- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecc40c3bc0 msgr2=0x7fecc41ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc3fff640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecc40c3bc0 0x7fecc41ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc3fff640 1 -- 172.21.15.132:0/2542820970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4009a70 con 0x7fecc40c2c90 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc96d0640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecc40c3bc0 0x7fecc41ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc3fff640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40c2c90 0x7fecc41ec920 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c400 tx=0x7fecac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.760+0000 7fecc17fa640 1 -- 172.21.15.132:0/2542820970 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac005ce0 con 0x7fecc40c2c90 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.761+0000 7fecc17fa640 1 -- 172.21.15.132:0/2542820970 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac005e60 con 0x7fecc40c2c90 2023-11-18T20:41:15.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.761+0000 7fecc17fa640 1 -- 172.21.15.132:0/2542820970 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac0072f0 con 0x7fecc40c2c90 2023-11-18T20:41:15.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.761+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc40a8770 con 0x7fecc40c2c90 2023-11-18T20:41:15.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.761+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc4153870 con 0x7fecc40c2c90 2023-11-18T20:41:15.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.762+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc4068350 con 0x7fecc40c2c90 2023-11-18T20:41:15.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.763+0000 7fecc17fa640 1 -- 172.21.15.132:0/2542820970 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecac007450 con 0x7fecc40c2c90 2023-11-18T20:41:15.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.764+0000 7fecc17fa640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca406ae40 0x7feca406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:15.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.764+0000 7fecc17fa640 1 -- 172.21.15.132:0/2542820970 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fecac088880 con 0x7fecc40c2c90 2023-11-18T20:41:15.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.764+0000 7fecc8ecf640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca406ae40 0x7feca406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:15.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.766+0000 7fecc8ecf640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca406ae40 0x7feca406d300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fecb4036000 tx=0x7fecb4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:15.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:15.768+0000 7fecc17fa640 1 -- 172.21.15.132:0/2542820970 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecac053d10 con 0x7fecc40c2c90 2023-11-18T20:41:16.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.030+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fecc40c58a0 con 0x7fecc40c2c90 2023-11-18T20:41:16.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.034+0000 7fecc17fa640 1 -- 172.21.15.132:0/2542820970 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7fecac017020 con 0x7fecc40c2c90 2023-11-18T20:41:16.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca406ae40 msgr2=0x7feca406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca406ae40 0x7feca406d300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fecb4036000 tx=0x7fecb4030000 comp rx=0 tx=0).stop 2023-11-18T20:41:16.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40c2c90 msgr2=0x7fecc41ec920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40c2c90 0x7fecc41ec920 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c400 tx=0x7fecac00c8c0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 shutdown_connections 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7feca406ae40 0x7feca406d300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecc40c3bc0 0x7fecc41ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecc40c2c90 0x7fecc41ec920 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 --2- 172.21.15.132:0/2542820970 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecc40a5240 0x7fecc4153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 >> 172.21.15.132:0/2542820970 conn(0x7fecc406a500 msgr2=0x7fecc40c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 shutdown_connections 2023-11-18T20:41:16.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.037+0000 7feccb133640 1 -- 172.21.15.132:0/2542820970 wait complete. 2023-11-18T20:41:16.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.259+0000 7ff86be0e640 1 Processor -- start 2023-11-18T20:41:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.260+0000 7ff86be0e640 1 -- start start 2023-11-18T20:41:16.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.261+0000 7ff86be0e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff864155490 0x7ff8640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.261+0000 7ff86be0e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8640c1500 0x7ff8640a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.261+0000 7ff86be0e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8640c06c0 con 0x7ff8640c4080 2023-11-18T20:41:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.261+0000 7ff86be0e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8640a5820 con 0x7ff8640c1500 2023-11-18T20:41:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.261+0000 7ff86be0e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640c1020 con 0x7ff864155490 2023-11-18T20:41:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.261+0000 7ff8693a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8640c1500 0x7ff8640a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.261+0000 7ff8693a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8640c1500 0x7ff8640a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33128/0 (socket says 172.21.15.132:33128) 2023-11-18T20:41:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.261+0000 7ff8693a9640 1 -- 172.21.15.132:0/3417043285 learned_addr learned my addr 172.21.15.132:0/3417043285 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:16.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.262+0000 7ff869baa640 1 --2- 172.21.15.132:0/3417043285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff864155490 0x7ff8640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.262+0000 7ff8693a9640 1 -- 172.21.15.132:0/3417043285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff864155490 msgr2=0x7ff8640a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:16.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.262+0000 7ff8693a9640 1 --2- 172.21.15.132:0/3417043285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff864155490 0x7ff8640a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.262+0000 7ff8693a9640 1 -- 172.21.15.132:0/3417043285 >> v1:172.21.15.161:6789/0 conn(0x7ff8640c4080 legacy=0x7ff8640c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:16.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.262+0000 7ff8693a9640 1 -- 172.21.15.132:0/3417043285 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8640c0910 con 0x7ff8640c1500 2023-11-18T20:41:16.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.263+0000 7ff8693a9640 1 --2- 172.21.15.132:0/3417043285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8640a9430 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff854009870 tx=0x7ff85402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3498e05171e0a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:16.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.263+0000 7ff868ba8640 1 -- 172.21.15.132:0/3417043285 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8540317c0 con 0x7ff8640c1500 2023-11-18T20:41:16.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.263+0000 7ff868ba8640 1 -- 172.21.15.132:0/3417043285 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff854031920 con 0x7ff8640c1500 2023-11-18T20:41:16.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.263+0000 7ff868ba8640 1 -- 172.21.15.132:0/3417043285 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854031cb0 con 0x7ff8640c1500 2023-11-18T20:41:16.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.264+0000 7ff86be0e640 1 -- 172.21.15.132:0/3417043285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 msgr2=0x7ff8640a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.264+0000 7ff86be0e640 1 --2- 172.21.15.132:0/3417043285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8640a9430 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff854009870 tx=0x7ff85402b860 comp rx=0 tx=0).stop 2023-11-18T20:41:16.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.264+0000 7ff86be0e640 1 -- 172.21.15.132:0/3417043285 shutdown_connections 2023-11-18T20:41:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.264+0000 7ff86be0e640 1 --2- 172.21.15.132:0/3417043285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8640a9430 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.264+0000 7ff86be0e640 1 --2- 172.21.15.132:0/3417043285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff864155490 0x7ff8640a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.264+0000 7ff86be0e640 1 -- 172.21.15.132:0/3417043285 >> 172.21.15.132:0/3417043285 conn(0x7ff86406a500 msgr2=0x7ff86406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.264+0000 7ff86be0e640 1 -- 172.21.15.132:0/3417043285 shutdown_connections 2023-11-18T20:41:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.264+0000 7ff86be0e640 1 -- 172.21.15.132:0/3417043285 wait complete. 2023-11-18T20:41:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.266+0000 7ff86be0e640 1 Processor -- start 2023-11-18T20:41:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.266+0000 7ff86be0e640 1 -- start start 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.267+0000 7ff86be0e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8641e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff86be0e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8640c4080 0x7ff8641e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff86be0e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff864155490 0x7ff8641e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff86be0e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8641501d0 con 0x7ff8640c1500 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff86be0e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8641e8a30 con 0x7ff864155490 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff86be0e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86414fe80 con 0x7ff8640c4080 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff869baa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8641e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff869baa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8641e84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33132/0 (socket says 172.21.15.132:33132) 2023-11-18T20:41:16.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff869baa640 1 -- 172.21.15.132:0/2254823013 learned_addr learned my addr 172.21.15.132:0/2254823013 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff8693a9640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8640c4080 0x7ff8641e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff869baa640 1 -- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8640c4080 msgr2=0x7ff8641e4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff86a3ab640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff864155490 0x7ff8641e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff869baa640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8640c4080 0x7ff8641e4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff869baa640 1 -- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff864155490 msgr2=0x7ff8641e52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff869baa640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff864155490 0x7ff8641e52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff869baa640 1 -- 172.21.15.132:0/2254823013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540094d0 con 0x7ff8640c1500 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.268+0000 7ff86a3ab640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff864155490 0x7ff8641e52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.269+0000 7ff869baa640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8641e84f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff86000c820 tx=0x7ff86000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.269+0000 7ff85a7fc640 1 -- 172.21.15.132:0/2254823013 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860004020 con 0x7ff8640c1500 2023-11-18T20:41:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.269+0000 7ff85a7fc640 1 -- 172.21.15.132:0/2254823013 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff860004180 con 0x7ff8640c1500 2023-11-18T20:41:16.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.269+0000 7ff85a7fc640 1 -- 172.21.15.132:0/2254823013 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600077d0 con 0x7ff8640c1500 2023-11-18T20:41:16.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.269+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8640bf6d0 con 0x7ff8640c1500 2023-11-18T20:41:16.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.269+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8640bfc90 con 0x7ff8640c1500 2023-11-18T20:41:16.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.270+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8640bfe80 con 0x7ff8640c1500 2023-11-18T20:41:16.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.271+0000 7ff85a7fc640 1 -- 172.21.15.132:0/2254823013 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff860007930 con 0x7ff8640c1500 2023-11-18T20:41:16.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.272+0000 7ff85a7fc640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff84806ae70 0x7ff84806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.273+0000 7ff85a7fc640 1 -- 172.21.15.132:0/2254823013 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff860088e60 con 0x7ff8640c1500 2023-11-18T20:41:16.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.273+0000 7ff8693a9640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff84806ae70 0x7ff84806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.274+0000 7ff8693a9640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff84806ae70 0x7ff84806d330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff854036000 tx=0x7ff85403d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:16.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.277+0000 7ff85a7fc640 1 -- 172.21.15.132:0/2254823013 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8600542f0 con 0x7ff8640c1500 2023-11-18T20:41:16.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.466+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8640c38b0 con 0x7ff8640c1500 2023-11-18T20:41:16.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.468+0000 7ff85a7fc640 1 -- 172.21.15.132:0/2254823013 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+12894 (secure 0 0 0) 0x7ff86001e090 con 0x7ff8640c1500 2023-11-18T20:41:16.469 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:16.469 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":72,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:15.014941+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:16.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.470+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff84806ae70 msgr2=0x7ff84806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.470+0000 7ff86be0e640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff84806ae70 0x7ff84806d330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff854036000 tx=0x7ff85403d040 comp rx=0 tx=0).stop 2023-11-18T20:41:16.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.470+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 msgr2=0x7ff8641e84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.470+0000 7ff86be0e640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8641e84f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff86000c820 tx=0x7ff86000cce0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.471+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 shutdown_connections 2023-11-18T20:41:16.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.471+0000 7ff86be0e640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff84806ae70 0x7ff84806d330 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.471+0000 7ff86be0e640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff864155490 0x7ff8641e52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.471+0000 7ff86be0e640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8640c4080 0x7ff8641e4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.471+0000 7ff86be0e640 1 --2- 172.21.15.132:0/2254823013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8640c1500 0x7ff8641e84f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.471+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 >> 172.21.15.132:0/2254823013 conn(0x7ff86406a500 msgr2=0x7ff8640a83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:16.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.471+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 shutdown_connections 2023-11-18T20:41:16.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.471+0000 7ff86be0e640 1 -- 172.21.15.132:0/2254823013 wait complete. 2023-11-18T20:41:16.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:41:16.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:41:16.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.707+0000 7f93adba9640 1 Processor -- start 2023-11-18T20:41:16.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.708+0000 7f93adba9640 1 -- start start 2023-11-18T20:41:16.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.709+0000 7f93adba9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.709+0000 7f93adba9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f93a80c3ea0 0x7f93a80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.709+0000 7f93adba9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a80c64a0 con 0x7f93a806d0a0 2023-11-18T20:41:16.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.709+0000 7f93adba9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a80c5c00 con 0x7f93a80c3ea0 2023-11-18T20:41:16.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.709+0000 7f93adba9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80c5ee0 con 0x7f93a814fd30 2023-11-18T20:41:16.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.710+0000 7f93a77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.710+0000 7f93a6ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f93a806d0a0 0x7f93a80a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:50594/0 (socket says 172.21.15.132:50594) 2023-11-18T20:41:16.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.710+0000 7f93a77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:58512/0 (socket says 172.21.15.132:58512) 2023-11-18T20:41:16.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.710+0000 7f93a6ffd640 1 -- 172.21.15.132:0/1660748854 learned_addr learned my addr 172.21.15.132:0/1660748854 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:16.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.710+0000 7f93a7fff640 1 --2- 172.21.15.132:0/1660748854 >> v2:172.21.15.161:3300/0 conn(0x7f93a80c3ea0 0x7f93a80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.711+0000 7f93a77fe640 1 -- 172.21.15.132:0/1660748854 >> v2:172.21.15.161:3300/0 conn(0x7f93a80c3ea0 msgr2=0x7f93a80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.711+0000 7f93a77fe640 1 --2- 172.21.15.132:0/1660748854 >> v2:172.21.15.161:3300/0 conn(0x7f93a80c3ea0 0x7f93a80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.711+0000 7f93a77fe640 1 -- 172.21.15.132:0/1660748854 >> v1:172.21.15.161:6789/0 conn(0x7f93a806d0a0 legacy=0x7f93a80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.711+0000 7f93a77fe640 1 -- 172.21.15.132:0/1660748854 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80c61c0 con 0x7f93a814fd30 2023-11-18T20:41:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.712+0000 7f93a77fe640 1 --2- 172.21.15.132:0/1660748854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a8152f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93900097a0 tx=0x7f939002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f944930e2518ccc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.713+0000 7f93a67fc640 1 -- 172.21.15.132:0/1660748854 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939002d040 con 0x7f93a814fd30 2023-11-18T20:41:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.713+0000 7f93a67fc640 1 -- 172.21.15.132:0/1660748854 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9390031810 con 0x7f93a814fd30 2023-11-18T20:41:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.713+0000 7f93a67fc640 1 -- 172.21.15.132:0/1660748854 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390031ba0 con 0x7f93a814fd30 2023-11-18T20:41:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.713+0000 7f93adba9640 1 -- 172.21.15.132:0/1660748854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 msgr2=0x7f93a8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.713+0000 7f93adba9640 1 --2- 172.21.15.132:0/1660748854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a8152f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93900097a0 tx=0x7f939002b8b0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.714+0000 7f93adba9640 1 -- 172.21.15.132:0/1660748854 shutdown_connections 2023-11-18T20:41:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.714+0000 7f93adba9640 1 --2- 172.21.15.132:0/1660748854 >> v2:172.21.15.161:3300/0 conn(0x7f93a80c3ea0 0x7f93a80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.714+0000 7f93adba9640 1 --2- 172.21.15.132:0/1660748854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a8152f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.714+0000 7f93adba9640 1 -- 172.21.15.132:0/1660748854 >> 172.21.15.132:0/1660748854 conn(0x7f93a806a500 msgr2=0x7f93a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.714+0000 7f93adba9640 1 -- 172.21.15.132:0/1660748854 shutdown_connections 2023-11-18T20:41:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.714+0000 7f93adba9640 1 -- 172.21.15.132:0/1660748854 wait complete. 2023-11-18T20:41:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.715+0000 7f93adba9640 1 Processor -- start 2023-11-18T20:41:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.715+0000 7f93adba9640 1 -- start start 2023-11-18T20:41:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.716+0000 7f93adba9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a806d0a0 0x7f93a80bb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.716+0000 7f93adba9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a80c3ea0 0x7f93a8153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.716+0000 7f93adba9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a81e9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.716+0000 7f93adba9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8071430 con 0x7f93a80c3ea0 2023-11-18T20:41:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.716+0000 7f93adba9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a814ea20 con 0x7f93a806d0a0 2023-11-18T20:41:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.716+0000 7f93adba9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a814ec70 con 0x7f93a814fd30 2023-11-18T20:41:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.716+0000 7f93a6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a80c3ea0 0x7f93a8153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a80c3ea0 0x7f93a8153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33136/0 (socket says 172.21.15.132:33136) 2023-11-18T20:41:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a6ffd640 1 -- 172.21.15.132:0/3436067582 learned_addr learned my addr 172.21.15.132:0/3436067582 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a77fe640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a806d0a0 0x7f93a80bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a7fff640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a81e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a6ffd640 1 -- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 msgr2=0x7f93a81e9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a6ffd640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a81e9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a6ffd640 1 -- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a806d0a0 msgr2=0x7f93a80bb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a6ffd640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a806d0a0 0x7f93a80bb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a6ffd640 1 -- 172.21.15.132:0/3436067582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390009400 con 0x7f93a80c3ea0 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.717+0000 7f93a6ffd640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a80c3ea0 0x7f93a8153cc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f939800cb40 tx=0x7f939800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.718+0000 7f939ffff640 1 -- 172.21.15.132:0/3436067582 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939800aca0 con 0x7f93a80c3ea0 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.718+0000 7f939ffff640 1 -- 172.21.15.132:0/3436067582 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939800ae00 con 0x7f93a80c3ea0 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.718+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a8070a90 con 0x7f93a80c3ea0 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.718+0000 7f939ffff640 1 -- 172.21.15.132:0/3436067582 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398012600 con 0x7f93a80c3ea0 2023-11-18T20:41:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.718+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a8071050 con 0x7f93a80c3ea0 2023-11-18T20:41:16.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.719+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a8071570 con 0x7f93a80c3ea0 2023-11-18T20:41:16.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.720+0000 7f939ffff640 1 -- 172.21.15.132:0/3436067582 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9398007070 con 0x7f93a80c3ea0 2023-11-18T20:41:16.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.721+0000 7f939ffff640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f938806ae70 0x7f938806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:16.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.721+0000 7f939ffff640 1 -- 172.21.15.132:0/3436067582 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9398089090 con 0x7f93a80c3ea0 2023-11-18T20:41:16.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.722+0000 7f93a77fe640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f938806ae70 0x7f938806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:16.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.723+0000 7f93a77fe640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f938806ae70 0x7f938806d330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9390036000 tx=0x7f939003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:16.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.725+0000 7f939ffff640 1 -- 172.21.15.132:0/3436067582 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93a8071570 con 0x7f93a80c3ea0 2023-11-18T20:41:16.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.913+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93a8071570 con 0x7f93a80c3ea0 2023-11-18T20:41:16.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.914+0000 7f939ffff640 1 -- 172.21.15.132:0/3436067582 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9398017020 con 0x7f93a80c3ea0 2023-11-18T20:41:16.960 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:41:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.916+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f938806ae70 msgr2=0x7f938806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f938806ae70 0x7f938806d330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9390036000 tx=0x7f939003c040 comp rx=0 tx=0).stop 2023-11-18T20:41:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a80c3ea0 msgr2=0x7f93a8153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a80c3ea0 0x7f93a8153cc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f939800cb40 tx=0x7f939800a060 comp rx=0 tx=0).stop 2023-11-18T20:41:16.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 shutdown_connections 2023-11-18T20:41:16.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f938806ae70 0x7f938806d330 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93a814fd30 0x7f93a81e9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a80c3ea0 0x7f93a8153cc0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 --2- 172.21.15.132:0/3436067582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a806d0a0 0x7f93a80bb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:16.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 >> 172.21.15.132:0/3436067582 conn(0x7f93a806a500 msgr2=0x7f93a81dbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:16.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 shutdown_connections 2023-11-18T20:41:16.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:16.917+0000 7f93adba9640 1 -- 172.21.15.132:0/3436067582 wait complete. 2023-11-18T20:41:16.963 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T20:41:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.183+0000 7fe6447a9640 1 Processor -- start 2023-11-18T20:41:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.183+0000 7fe6447a9640 1 -- start start 2023-11-18T20:41:17.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.184+0000 7fe6447a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe63c06d0a0 0x7fe63c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe6447a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c0c64a0 con 0x7fe63c0c3ea0 2023-11-18T20:41:17.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe6447a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c0c5c00 con 0x7fe63c14fd30 2023-11-18T20:41:17.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe6447a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c0c5ee0 con 0x7fe63c06d0a0 2023-11-18T20:41:17.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe642d46640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe63c0c3ea0 0x7fe63c0c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45254/0 (socket says 172.21.15.132:45254) 2023-11-18T20:41:17.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe642d46640 1 -- 172.21.15.132:0/4161306652 learned_addr learned my addr 172.21.15.132:0/4161306652 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:17.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe641d44640 1 --2- 172.21.15.132:0/4161306652 >> v2:172.21.15.132:3300/0 conn(0x7fe63c06d0a0 0x7fe63c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe641543640 1 -- 172.21.15.132:0/4161306652 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373288843 0 0) 0x7fe63c0c64a0 con 0x7fe63c0c3ea0 2023-11-18T20:41:17.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe641543640 1 -- 172.21.15.132:0/4161306652 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe628003520 con 0x7fe63c0c3ea0 2023-11-18T20:41:17.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe641d44640 1 -- 172.21.15.132:0/4161306652 >> v1:172.21.15.161:6789/0 conn(0x7fe63c14fd30 legacy=0x7fe63c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.185+0000 7fe641d44640 1 -- 172.21.15.132:0/4161306652 >> v1:172.21.15.132:6789/0 conn(0x7fe63c0c3ea0 legacy=0x7fe63c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.186+0000 7fe641d44640 1 -- 172.21.15.132:0/4161306652 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0c61c0 con 0x7fe63c06d0a0 2023-11-18T20:41:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.187+0000 7fe641d44640 1 --2- 172.21.15.132:0/4161306652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c152f20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0097a0 tx=0x7fe62c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9f556858c6ffff server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.187+0000 7fe641543640 1 -- 172.21.15.132:0/4161306652 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c030610 con 0x7fe63c06d0a0 2023-11-18T20:41:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.187+0000 7fe641543640 1 -- 172.21.15.132:0/4161306652 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c030770 con 0x7fe63c06d0a0 2023-11-18T20:41:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.187+0000 7fe641543640 1 -- 172.21.15.132:0/4161306652 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c030b00 con 0x7fe63c06d0a0 2023-11-18T20:41:17.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.188+0000 7fe6447a9640 1 -- 172.21.15.132:0/4161306652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 msgr2=0x7fe63c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.188+0000 7fe6447a9640 1 --2- 172.21.15.132:0/4161306652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c152f20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0097a0 tx=0x7fe62c02b960 comp rx=0 tx=0).stop 2023-11-18T20:41:17.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.188+0000 7fe6447a9640 1 -- 172.21.15.132:0/4161306652 shutdown_connections 2023-11-18T20:41:17.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.188+0000 7fe6447a9640 1 --2- 172.21.15.132:0/4161306652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c152f20 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.188+0000 7fe6447a9640 1 -- 172.21.15.132:0/4161306652 >> 172.21.15.132:0/4161306652 conn(0x7fe63c06a500 msgr2=0x7fe63c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:17.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.188+0000 7fe6447a9640 1 -- 172.21.15.132:0/4161306652 shutdown_connections 2023-11-18T20:41:17.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.188+0000 7fe6447a9640 1 -- 172.21.15.132:0/4161306652 wait complete. 2023-11-18T20:41:17.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.189+0000 7fe6447a9640 1 Processor -- start 2023-11-18T20:41:17.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.190+0000 7fe6447a9640 1 -- start start 2023-11-18T20:41:17.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.190+0000 7fe6447a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.190+0000 7fe6447a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c0c3ea0 0x7fe63c152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.190+0000 7fe6447a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c14fd30 0x7fe63c1ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.190+0000 7fe6447a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0aa550 con 0x7fe63c06d0a0 2023-11-18T20:41:17.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.190+0000 7fe6447a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0a5000 con 0x7fe63c14fd30 2023-11-18T20:41:17.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.190+0000 7fe6447a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c156780 con 0x7fe63c0c3ea0 2023-11-18T20:41:17.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c0bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33148/0 (socket says 172.21.15.132:33148) 2023-11-18T20:41:17.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 -- 172.21.15.132:0/960161103 learned_addr learned my addr 172.21.15.132:0/960161103 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:17.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 -- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c0c3ea0 msgr2=0x7fe63c152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c0c3ea0 0x7fe63c152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 -- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c14fd30 msgr2=0x7fe63c1ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c14fd30 0x7fe63c1ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 -- 172.21.15.132:0/960161103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c009400 con 0x7fe63c06d0a0 2023-11-18T20:41:17.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.191+0000 7fe642545640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c0bf360 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe63800c450 tx=0x7fe63800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:17.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.192+0000 7fe632ffd640 1 -- 172.21.15.132:0/960161103 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380052d0 con 0x7fe63c06d0a0 2023-11-18T20:41:17.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.192+0000 7fe632ffd640 1 -- 172.21.15.132:0/960161103 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe638005430 con 0x7fe63c06d0a0 2023-11-18T20:41:17.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.192+0000 7fe632ffd640 1 -- 172.21.15.132:0/960161103 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638012870 con 0x7fe63c06d0a0 2023-11-18T20:41:17.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.192+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c0aa7a0 con 0x7fe63c06d0a0 2023-11-18T20:41:17.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.192+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c0bf8a0 con 0x7fe63c06d0a0 2023-11-18T20:41:17.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.193+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c153b40 con 0x7fe63c06d0a0 2023-11-18T20:41:17.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.194+0000 7fe632ffd640 1 -- 172.21.15.132:0/960161103 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6380129d0 con 0x7fe63c06d0a0 2023-11-18T20:41:17.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.195+0000 7fe632ffd640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe62006ae40 0x7fe62006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.195+0000 7fe632ffd640 1 -- 172.21.15.132:0/960161103 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe638088d70 con 0x7fe63c06d0a0 2023-11-18T20:41:17.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.195+0000 7fe641d44640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe62006ae40 0x7fe62006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.196+0000 7fe641d44640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe62006ae40 0x7fe62006d300 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe62c036000 tx=0x7fe62c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:17.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.199+0000 7fe632ffd640 1 -- 172.21.15.132:0/960161103 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe63c153b40 con 0x7fe63c06d0a0 2023-11-18T20:41:17.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.395+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe63c153b40 con 0x7fe63c06d0a0 2023-11-18T20:41:17.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.395+0000 7fe632ffd640 1 -- 172.21.15.132:0/960161103 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe63c153b40 con 0x7fe63c06d0a0 2023-11-18T20:41:17.397 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:17.397 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-11-18T20:41:17.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:17.397 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-11-18T20:41:17.397 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-11-18T20:41:17.397 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:17.397 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-11-18T20:41:17.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe62006ae40 msgr2=0x7fe62006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe62006ae40 0x7fe62006d300 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe62c036000 tx=0x7fe62c030000 comp rx=0 tx=0).stop 2023-11-18T20:41:17.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 msgr2=0x7fe63c0bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c0bf360 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe63800c450 tx=0x7fe63800c910 comp rx=0 tx=0).stop 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 shutdown_connections 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fe62006ae40 0x7fe62006d300 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe63c14fd30 0x7fe63c1ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe63c0c3ea0 0x7fe63c152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 --2- 172.21.15.132:0/960161103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe63c06d0a0 0x7fe63c0bf360 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 >> 172.21.15.132:0/960161103 conn(0x7fe63c06a500 msgr2=0x7fe63c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 shutdown_connections 2023-11-18T20:41:17.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.398+0000 7fe6447a9640 1 -- 172.21.15.132:0/960161103 wait complete. 2023-11-18T20:41:17.417 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-18T20:41:17.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-18T20:41:17.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.634+0000 7f15a9f41640 1 Processor -- start 2023-11-18T20:41:17.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.635+0000 7f15a9f41640 1 -- start start 2023-11-18T20:41:17.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.636+0000 7f15a9f41640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f15a40c3020 0x7f15a40c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.636+0000 7f15a9f41640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a40c1d30 con 0x7f15a40c7fc0 2023-11-18T20:41:17.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.636+0000 7f15a9f41640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a40c2010 con 0x7f15a4157e40 2023-11-18T20:41:17.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.636+0000 7f15a9f41640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a40c6eb0 con 0x7f15a40c3020 2023-11-18T20:41:17.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.636+0000 7f15a37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f15a40c7fc0 0x7f15a4155220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45266/0 (socket says 172.21.15.132:45266) 2023-11-18T20:41:17.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.636+0000 7f15a37fe640 1 -- 172.21.15.132:0/2712972820 learned_addr learned my addr 172.21.15.132:0/2712972820 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513038195 0 0) 0x7f15a40c1d30 con 0x7f15a40c7fc0 2023-11-18T20:41:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1590003520 con 0x7f15a40c7fc0 2023-11-18T20:41:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a2ffd640 1 --2- 172.21.15.132:0/2712972820 >> v2:172.21.15.161:3300/0 conn(0x7f15a40c3020 0x7f15a40c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4086137268 0 0) 0x7f1590003520 con 0x7f15a40c7fc0 2023-11-18T20:41:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 >> v2:172.21.15.161:3300/0 conn(0x7f15a40c3020 msgr2=0x7f15a40c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 --2- 172.21.15.132:0/2712972820 >> v2:172.21.15.161:3300/0 conn(0x7f15a40c3020 0x7f15a40c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 >> v1:172.21.15.161:6789/0 conn(0x7f15a4157e40 legacy=0x7f15a4158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40c7190 con 0x7f15a40c7fc0 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f15940019f0 con 0x7f15a40c7fc0 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.637+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 >> v1:172.21.15.132:6789/0 conn(0x7f15a40c7fc0 legacy=0x7f15a4155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a27fc640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15900039c0 0x7f1590003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a27fc640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15900047c0 0x7f1590004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a27fc640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f159000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40c6eb0 con 0x7f15900052a0 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159000c1a0 con 0x7f15900047c0 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159000c360 con 0x7f15900039c0 2023-11-18T20:41:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a3fff640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f159000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a2ffd640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15900047c0 0x7f1590004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a3fff640 1 -- 172.21.15.132:0/2712972820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15900039c0 msgr2=0x7f1590003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a3fff640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15900039c0 0x7f1590003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a3fff640 1 -- 172.21.15.132:0/2712972820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15900047c0 msgr2=0x7f1590004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a3fff640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15900047c0 0x7f1590004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.638+0000 7f15a3fff640 1 -- 172.21.15.132:0/2712972820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590003520 con 0x7f15900052a0 2023-11-18T20:41:17.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.639+0000 7f15a3fff640 1 -- 172.21.15.132:0/2712972820 reap_dead start 2023-11-18T20:41:17.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.639+0000 7f15a3fff640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f159000b980 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f159c001750 tx=0x7f15900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b723eeb0538a1991 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:17.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0052d0 con 0x7f15900052a0 2023-11-18T20:41:17.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c02e050 con 0x7f15900052a0 2023-11-18T20:41:17.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a27fc640 1 -- 172.21.15.132:0/2712972820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0035f0 con 0x7f15900052a0 2023-11-18T20:41:17.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a9f41640 1 -- 172.21.15.132:0/2712972820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 msgr2=0x7f159000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a9f41640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f159000b980 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f159c001750 tx=0x7f15900057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a9f41640 1 -- 172.21.15.132:0/2712972820 shutdown_connections 2023-11-18T20:41:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a9f41640 1 --2- 172.21.15.132:0/2712972820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f159000b980 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a9f41640 1 -- 172.21.15.132:0/2712972820 >> 172.21.15.132:0/2712972820 conn(0x7f15a40a9b70 msgr2=0x7f15a40a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a9f41640 1 -- 172.21.15.132:0/2712972820 shutdown_connections 2023-11-18T20:41:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.640+0000 7f15a9f41640 1 -- 172.21.15.132:0/2712972820 wait complete. 2023-11-18T20:41:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.642+0000 7f15a9f41640 1 Processor -- start 2023-11-18T20:41:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.642+0000 7f15a9f41640 1 -- start start 2023-11-18T20:41:17.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a9f41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f15a40c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a9f41640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a414e1a0 0x7f15a414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a9f41640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a414d6e0 0x7f15a41ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a9f41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a414db60 con 0x7f15900052a0 2023-11-18T20:41:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a9f41640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a406ed90 con 0x7f15a414d6e0 2023-11-18T20:41:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a9f41640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4157720 con 0x7f15a414e1a0 2023-11-18T20:41:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f15a40c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f15a40c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33170/0 (socket says 172.21.15.132:33170) 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.643+0000 7f15a37fe640 1 -- 172.21.15.132:0/3163738699 learned_addr learned my addr 172.21.15.132:0/3163738699 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a37fe640 1 -- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a414e1a0 msgr2=0x7f15a414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a3fff640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a414d6e0 0x7f15a41ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a2ffd640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a414e1a0 0x7f15a414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a37fe640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a414e1a0 0x7f15a414d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a37fe640 1 -- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a414d6e0 msgr2=0x7f15a41ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a37fe640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a414d6e0 0x7f15a41ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a37fe640 1 -- 172.21.15.132:0/3163738699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a414eb50 con 0x7f15900052a0 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a3fff640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a414d6e0 0x7f15a41ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a2ffd640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a414e1a0 0x7f15a414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a37fe640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f15a40c62f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f159400caa0 tx=0x7f159400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f159bfff640 1 -- 172.21.15.132:0/3163738699 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400a650 con 0x7f15900052a0 2023-11-18T20:41:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f159bfff640 1 -- 172.21.15.132:0/3163738699 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159400a7b0 con 0x7f15900052a0 2023-11-18T20:41:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f159bfff640 1 -- 172.21.15.132:0/3163738699 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400ab60 con 0x7f15900052a0 2023-11-18T20:41:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.644+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a414ee30 con 0x7f15900052a0 2023-11-18T20:41:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.645+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a40c6830 con 0x7f15900052a0 2023-11-18T20:41:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.646+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a4156020 con 0x7f15900052a0 2023-11-18T20:41:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.647+0000 7f159bfff640 1 -- 172.21.15.132:0/3163738699 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f159400acc0 con 0x7f15900052a0 2023-11-18T20:41:17.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.647+0000 7f159bfff640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f158406ae70 0x7f158406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:17.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.648+0000 7f159bfff640 1 -- 172.21.15.132:0/3163738699 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f15940888c0 con 0x7f15900052a0 2023-11-18T20:41:17.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.648+0000 7f15a2ffd640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f158406ae70 0x7f158406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:17.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.649+0000 7f15a2ffd640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f158406ae70 0x7f158406d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f15a414de20 tx=0x7f158c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:17.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.652+0000 7f159bfff640 1 -- 172.21.15.132:0/3163738699 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15a4156020 con 0x7f15900052a0 2023-11-18T20:41:17.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:17.839+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f15a4156020 con 0x7f15900052a0 2023-11-18T20:41:18.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.043+0000 7f159bfff640 1 -- 172.21.15.132:0/3163738699 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) v1 ==== 138+0+0 (secure 0 0 0) 0x7f15a4156020 con 0x7f15900052a0 2023-11-18T20:41:18.045 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-11-18T20:41:18.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.047+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f158406ae70 msgr2=0x7f158406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:18.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.047+0000 7f15a9f41640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f158406ae70 0x7f158406d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f15a414de20 tx=0x7f158c008040 comp rx=0 tx=0).stop 2023-11-18T20:41:18.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.047+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 msgr2=0x7f15a40c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:18.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.047+0000 7f15a9f41640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f15a40c62f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f159400caa0 tx=0x7f159400cf60 comp rx=0 tx=0).stop 2023-11-18T20:41:18.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.047+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 shutdown_connections 2023-11-18T20:41:18.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.048+0000 7f15a9f41640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f158406ae70 0x7f158406d330 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:18.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.048+0000 7f15a9f41640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a414d6e0 0x7f15a41ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:18.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.048+0000 7f15a9f41640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a414e1a0 0x7f15a414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:18.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.048+0000 7f15a9f41640 1 --2- 172.21.15.132:0/3163738699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15900052a0 0x7f15a40c62f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:18.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.048+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 >> 172.21.15.132:0/3163738699 conn(0x7f15a40a9b70 msgr2=0x7f15a4154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:18.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.048+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 shutdown_connections 2023-11-18T20:41:18.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.048+0000 7f15a9f41640 1 -- 172.21.15.132:0/3163738699 wait complete. 2023-11-18T20:41:18.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T20:41:18.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.275+0000 7f6fc564b640 1 Processor -- start 2023-11-18T20:41:18.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.275+0000 7f6fc564b640 1 -- start start 2023-11-18T20:41:18.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fc564b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6fc006d0a0 0x7f6fc0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:18.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fc564b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc00c64a0 con 0x7f6fc00c3ea0 2023-11-18T20:41:18.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fc564b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc00c5c00 con 0x7f6fc014fd30 2023-11-18T20:41:18.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fc564b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc00c5ee0 con 0x7f6fc006d0a0 2023-11-18T20:41:18.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fbe7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6fc006d0a0 0x7f6fc0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:18.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fbf7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6fc00c3ea0 0x7f6fc00c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45278/0 (socket says 172.21.15.132:45278) 2023-11-18T20:41:18.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fbf7fe640 1 -- 172.21.15.132:0/950471149 learned_addr learned my addr 172.21.15.132:0/950471149 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:18.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fbe7fc640 1 -- 172.21.15.132:0/950471149 >> v1:172.21.15.161:6789/0 conn(0x7f6fc014fd30 legacy=0x7f6fc00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:18.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fbe7fc640 1 -- 172.21.15.132:0/950471149 >> v1:172.21.15.132:6789/0 conn(0x7f6fc00c3ea0 legacy=0x7f6fc00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:18.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.277+0000 7f6fbe7fc640 1 -- 172.21.15.132:0/950471149 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc00c61c0 con 0x7f6fc006d0a0 2023-11-18T20:41:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fbe7fc640 1 --2- 172.21.15.132:0/950471149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0152f20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40097a0 tx=0x7f6fb402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c670d54d1dab6e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fbdffb640 1 -- 172.21.15.132:0/950471149 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4031830 con 0x7f6fc006d0a0 2023-11-18T20:41:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fbdffb640 1 -- 172.21.15.132:0/950471149 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb4031990 con 0x7f6fc006d0a0 2023-11-18T20:41:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fbdffb640 1 -- 172.21.15.132:0/950471149 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4031d20 con 0x7f6fc006d0a0 2023-11-18T20:41:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fc564b640 1 -- 172.21.15.132:0/950471149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 msgr2=0x7f6fc0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fc564b640 1 --2- 172.21.15.132:0/950471149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0152f20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40097a0 tx=0x7f6fb402b8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fc564b640 1 -- 172.21.15.132:0/950471149 shutdown_connections 2023-11-18T20:41:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fc564b640 1 --2- 172.21.15.132:0/950471149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0152f20 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.279+0000 7f6fc564b640 1 -- 172.21.15.132:0/950471149 >> 172.21.15.132:0/950471149 conn(0x7f6fc006a500 msgr2=0x7f6fc006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.280+0000 7f6fc564b640 1 -- 172.21.15.132:0/950471149 shutdown_connections 2023-11-18T20:41:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.280+0000 7f6fc564b640 1 -- 172.21.15.132:0/950471149 wait complete. 2023-11-18T20:41:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.281+0000 7f6fc564b640 1 Processor -- start 2023-11-18T20:41:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.281+0000 7f6fc564b640 1 -- start start 2023-11-18T20:41:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fc564b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fc564b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fc00c3ea0 0x7f6fc00c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fc564b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fc014fd30 0x7f6fc01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fc564b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc01eb140 con 0x7f6fc006d0a0 2023-11-18T20:41:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fc564b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc01eb670 con 0x7f6fc00c3ea0 2023-11-18T20:41:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fc564b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc014d0e0 con 0x7f6fc014fd30 2023-11-18T20:41:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fbeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fbeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33200/0 (socket says 172.21.15.132:33200) 2023-11-18T20:41:18.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.282+0000 7f6fbeffd640 1 -- 172.21.15.132:0/2049470883 learned_addr learned my addr 172.21.15.132:0/2049470883 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:18.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fbe7fc640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fc00c3ea0 0x7f6fc00c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:18.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fbeffd640 1 -- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fc014fd30 msgr2=0x7f6fc01548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:18.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fbeffd640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fc014fd30 0x7f6fc01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:18.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fbeffd640 1 -- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fc00c3ea0 msgr2=0x7f6fc00c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:18.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fbeffd640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fc00c3ea0 0x7f6fc00c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:18.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fbeffd640 1 -- 172.21.15.132:0/2049470883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4009400 con 0x7f6fc006d0a0 2023-11-18T20:41:18.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fbeffd640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0155860 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c460 tx=0x7f6fb000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:18.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fa77fe640 1 -- 172.21.15.132:0/2049470883 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0012830 con 0x7f6fc006d0a0 2023-11-18T20:41:18.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fa77fe640 1 -- 172.21.15.132:0/2049470883 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb00129d0 con 0x7f6fc006d0a0 2023-11-18T20:41:18.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc00a51a0 con 0x7f6fc006d0a0 2023-11-18T20:41:18.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fa77fe640 1 -- 172.21.15.132:0/2049470883 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0012d80 con 0x7f6fc006d0a0 2023-11-18T20:41:18.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.283+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc00bfc80 con 0x7f6fc006d0a0 2023-11-18T20:41:18.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.285+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc0068350 con 0x7f6fc006d0a0 2023-11-18T20:41:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.287+0000 7f6fa77fe640 1 -- 172.21.15.132:0/2049470883 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6fb0024430 con 0x7f6fc006d0a0 2023-11-18T20:41:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.288+0000 7f6fa77fe640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6fac06ae40 0x7f6fac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.288+0000 7f6fa77fe640 1 -- 172.21.15.132:0/2049470883 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6fb0089660 con 0x7f6fc006d0a0 2023-11-18T20:41:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.289+0000 7f6fbe7fc640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6fac06ae40 0x7f6fac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:18.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.290+0000 7f6fbe7fc640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6fac06ae40 0x7f6fac06d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4036000 tx=0x7f6fb403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.292+0000 7f6fa77fe640 1 -- 172.21.15.132:0/2049470883 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6fb0054b10 con 0x7f6fc006d0a0 2023-11-18T20:41:18.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:18.466+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6fc014d880 con 0x7f6fc006d0a0 2023-11-18T20:41:19.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.050+0000 7f6fa77fe640 1 -- 172.21.15.132:0/2049470883 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v74) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6fb0058130 con 0x7f6fc006d0a0 2023-11-18T20:41:19.051 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-11-18T20:41:19.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.055+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6fac06ae40 msgr2=0x7f6fac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:19.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.055+0000 7f6fc564b640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6fac06ae40 0x7f6fac06d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4036000 tx=0x7f6fb403c040 comp rx=0 tx=0).stop 2023-11-18T20:41:19.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.055+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 msgr2=0x7f6fc0155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:19.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.055+0000 7f6fc564b640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0155860 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c460 tx=0x7f6fb000c920 comp rx=0 tx=0).stop 2023-11-18T20:41:19.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.059+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 shutdown_connections 2023-11-18T20:41:19.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.059+0000 7f6fc564b640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6fac06ae40 0x7f6fac06d300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.059+0000 7f6fc564b640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fc014fd30 0x7f6fc01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.059+0000 7f6fc564b640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fc00c3ea0 0x7f6fc00c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.059+0000 7f6fc564b640 1 --2- 172.21.15.132:0/2049470883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc006d0a0 0x7f6fc0155860 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.059+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 >> 172.21.15.132:0/2049470883 conn(0x7f6fc006a500 msgr2=0x7f6fc0152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:19.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.061+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 shutdown_connections 2023-11-18T20:41:19.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.061+0000 7f6fc564b640 1 -- 172.21.15.132:0/2049470883 wait complete. 2023-11-18T20:41:19.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-18T20:41:19.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.279+0000 7fa12791d640 1 Processor -- start 2023-11-18T20:41:19.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.279+0000 7fa12791d640 1 -- start start 2023-11-18T20:41:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.280+0000 7fa12791d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa12014fd30 0x7fa120152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa12791d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa1200c3ea0 0x7fa1200c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa12791d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200c64a0 con 0x7fa12006d0a0 2023-11-18T20:41:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa12791d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200c5c00 con 0x7fa12014fd30 2023-11-18T20:41:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa12791d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200c5ee0 con 0x7fa1200c3ea0 2023-11-18T20:41:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa124eb8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa12006d0a0 0x7fa1200a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39528/0 (socket says 172.21.15.132:39528) 2023-11-18T20:41:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa124eb8640 1 -- 172.21.15.132:0/3552543531 learned_addr learned my addr 172.21.15.132:0/3552543531 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa1256b9640 1 --2- 172.21.15.132:0/3552543531 >> v2:172.21.15.132:3300/0 conn(0x7fa12014fd30 0x7fa120152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:19.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa125eba640 1 --2- 172.21.15.132:0/3552543531 >> v2:172.21.15.161:3300/0 conn(0x7fa1200c3ea0 0x7fa1200c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:19.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa117fff640 1 -- 172.21.15.132:0/3552543531 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829034399 0 0) 0x7fa1200c64a0 con 0x7fa12006d0a0 2023-11-18T20:41:19.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.281+0000 7fa117fff640 1 -- 172.21.15.132:0/3552543531 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa10c003520 con 0x7fa12006d0a0 2023-11-18T20:41:19.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.282+0000 7fa1256b9640 1 -- 172.21.15.132:0/3552543531 >> v2:172.21.15.161:3300/0 conn(0x7fa1200c3ea0 msgr2=0x7fa1200c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:19.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.282+0000 7fa1256b9640 1 --2- 172.21.15.132:0/3552543531 >> v2:172.21.15.161:3300/0 conn(0x7fa1200c3ea0 0x7fa1200c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.282+0000 7fa1256b9640 1 -- 172.21.15.132:0/3552543531 >> v1:172.21.15.132:6789/0 conn(0x7fa12006d0a0 legacy=0x7fa1200a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:19.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.282+0000 7fa1256b9640 1 -- 172.21.15.132:0/3552543531 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200c61c0 con 0x7fa12014fd30 2023-11-18T20:41:19.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.283+0000 7fa1256b9640 1 --2- 172.21.15.132:0/3552543531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12014fd30 0x7fa120152f20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa12006e430 tx=0x7fa11c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9691ae72126328f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:19.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.283+0000 7fa117fff640 1 -- 172.21.15.132:0/3552543531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c031830 con 0x7fa12014fd30 2023-11-18T20:41:19.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.283+0000 7fa117fff640 1 -- 172.21.15.132:0/3552543531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c031990 con 0x7fa12014fd30 2023-11-18T20:41:19.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.283+0000 7fa117fff640 1 -- 172.21.15.132:0/3552543531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c031d00 con 0x7fa12014fd30 2023-11-18T20:41:19.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.284+0000 7fa12791d640 1 -- 172.21.15.132:0/3552543531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12014fd30 msgr2=0x7fa120152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.284+0000 7fa12791d640 1 --2- 172.21.15.132:0/3552543531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12014fd30 0x7fa120152f20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa12006e430 tx=0x7fa11c02b8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.284+0000 7fa12791d640 1 -- 172.21.15.132:0/3552543531 shutdown_connections 2023-11-18T20:41:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.284+0000 7fa12791d640 1 --2- 172.21.15.132:0/3552543531 >> v2:172.21.15.161:3300/0 conn(0x7fa1200c3ea0 0x7fa1200c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.284+0000 7fa12791d640 1 --2- 172.21.15.132:0/3552543531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12014fd30 0x7fa120152f20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.284+0000 7fa12791d640 1 -- 172.21.15.132:0/3552543531 >> 172.21.15.132:0/3552543531 conn(0x7fa12006a500 msgr2=0x7fa12006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.284+0000 7fa12791d640 1 -- 172.21.15.132:0/3552543531 shutdown_connections 2023-11-18T20:41:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.284+0000 7fa12791d640 1 -- 172.21.15.132:0/3552543531 wait complete. 2023-11-18T20:41:19.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.286+0000 7fa12791d640 1 Processor -- start 2023-11-18T20:41:19.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.286+0000 7fa12791d640 1 -- start start 2023-11-18T20:41:19.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa12791d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12006d0a0 0x7fa1201dbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:19.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa12791d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c3ea0 0x7fa12014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:19.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa12791d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa12014fd30 0x7fa12014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:19.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa12791d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1201dcbb0 con 0x7fa12006d0a0 2023-11-18T20:41:19.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa12791d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12014d510 con 0x7fa1200c3ea0 2023-11-18T20:41:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa12791d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1201eaaf0 con 0x7fa12014fd30 2023-11-18T20:41:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa1256b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12006d0a0 0x7fa1201dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa1256b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12006d0a0 0x7fa1201dbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56158/0 (socket says 172.21.15.132:56158) 2023-11-18T20:41:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa1256b9640 1 -- 172.21.15.132:0/710204464 learned_addr learned my addr 172.21.15.132:0/710204464 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa1256b9640 1 -- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa12014fd30 msgr2=0x7fa12014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa1256b9640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa12014fd30 0x7fa12014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa1256b9640 1 -- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c3ea0 msgr2=0x7fa12014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.287+0000 7fa1256b9640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c3ea0 0x7fa12014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.288+0000 7fa1256b9640 1 -- 172.21.15.132:0/710204464 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c009400 con 0x7fa12006d0a0 2023-11-18T20:41:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.288+0000 7fa1256b9640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12006d0a0 0x7fa1201dbd40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa11c02b910 tx=0x7fa11c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.288+0000 7fa115ffb640 1 -- 172.21.15.132:0/710204464 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c03a630 con 0x7fa12006d0a0 2023-11-18T20:41:19.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.288+0000 7fa115ffb640 1 -- 172.21.15.132:0/710204464 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c03a790 con 0x7fa12006d0a0 2023-11-18T20:41:19.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.288+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1201e9c20 con 0x7fa12006d0a0 2023-11-18T20:41:19.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.288+0000 7fa115ffb640 1 -- 172.21.15.132:0/710204464 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c03ab40 con 0x7fa12006d0a0 2023-11-18T20:41:19.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.288+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1201ea1c0 con 0x7fa12006d0a0 2023-11-18T20:41:19.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.289+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa120068350 con 0x7fa12006d0a0 2023-11-18T20:41:19.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.290+0000 7fa115ffb640 1 -- 172.21.15.132:0/710204464 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa11c03aca0 con 0x7fa12006d0a0 2023-11-18T20:41:19.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.291+0000 7fa115ffb640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10406ae70 0x7fa10406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:19.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.291+0000 7fa115ffb640 1 -- 172.21.15.132:0/710204464 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa11c0ab320 con 0x7fa12006d0a0 2023-11-18T20:41:19.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.292+0000 7fa124eb8640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10406ae70 0x7fa10406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:19.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.293+0000 7fa124eb8640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10406ae70 0x7fa10406d330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa110000f60 tx=0x7fa1100078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.296+0000 7fa115ffb640 1 -- 172.21.15.132:0/710204464 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa11c076540 con 0x7fa12006d0a0 2023-11-18T20:41:19.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:19.527+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa12006d540 con 0x7fa12006d0a0 2023-11-18T20:41:20.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.339+0000 7fa115ffb640 1 -- 172.21.15.132:0/710204464 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa11c079b60 con 0x7fa12006d0a0 2023-11-18T20:41:20.341 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 12 and data pool 13 2023-11-18T20:41:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10406ae70 msgr2=0x7fa10406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10406ae70 0x7fa10406d330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa110000f60 tx=0x7fa1100078f0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12006d0a0 msgr2=0x7fa1201dbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12006d0a0 0x7fa1201dbd40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa11c02b910 tx=0x7fa11c0046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 shutdown_connections 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10406ae70 0x7fa10406d330 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa12014fd30 0x7fa12014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c3ea0 0x7fa12014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 --2- 172.21.15.132:0/710204464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa12006d0a0 0x7fa1201dbd40 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 >> 172.21.15.132:0/710204464 conn(0x7fa12006a500 msgr2=0x7fa120150360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 shutdown_connections 2023-11-18T20:41:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.343+0000 7fa12791d640 1 -- 172.21.15.132:0/710204464 wait complete. 2023-11-18T20:41:20.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:20.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.550+0000 7f231f621640 1 Processor -- start 2023-11-18T20:41:20.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.551+0000 7f231f621640 1 -- start start 2023-11-18T20:41:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.552+0000 7f231f621640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f231814fc20 0x7f23180c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.552+0000 7f231f621640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2318152560 0x7f2318152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.552+0000 7f231f621640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2318150000 con 0x7f2318072320 2023-11-18T20:41:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.552+0000 7f231f621640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2318156800 con 0x7f231814fc20 2023-11-18T20:41:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.552+0000 7f231f621640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2318155bf0 con 0x7f2318152560 2023-11-18T20:41:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.552+0000 7f231cbbc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2318072320 0x7f231806f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39538/0 (socket says 172.21.15.132:39538) 2023-11-18T20:41:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.552+0000 7f231cbbc640 1 -- 172.21.15.132:0/1846043589 learned_addr learned my addr 172.21.15.132:0/1846043589 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.552+0000 7f231d3bd640 1 --2- 172.21.15.132:0/1846043589 >> v2:172.21.15.132:3300/0 conn(0x7f231814fc20 0x7f23180c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.553+0000 7f231dbbe640 1 --2- 172.21.15.132:0/1846043589 >> v2:172.21.15.161:3300/0 conn(0x7f2318152560 0x7f2318152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.553+0000 7f231d3bd640 1 -- 172.21.15.132:0/1846043589 >> v2:172.21.15.161:3300/0 conn(0x7f2318152560 msgr2=0x7f2318152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.553+0000 7f231d3bd640 1 --2- 172.21.15.132:0/1846043589 >> v2:172.21.15.161:3300/0 conn(0x7f2318152560 0x7f2318152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.553+0000 7f231d3bd640 1 -- 172.21.15.132:0/1846043589 >> v1:172.21.15.132:6789/0 conn(0x7f2318072320 legacy=0x7f231806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.553+0000 7f231d3bd640 1 -- 172.21.15.132:0/1846043589 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318155ed0 con 0x7f231814fc20 2023-11-18T20:41:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.553+0000 7f2317fff640 1 -- 172.21.15.132:0/1846043589 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034094762 0 0) 0x7f230c001110 con 0x7f2318072320 2023-11-18T20:41:20.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.554+0000 7f231d3bd640 1 --2- 172.21.15.132:0/1846043589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f231814fc20 0x7f23180c1970 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f23180c4a80 tx=0x7f230802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432c8e6c37c3bab8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.554+0000 7f2317fff640 1 -- 172.21.15.132:0/1846043589 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230802cbf0 con 0x7f231814fc20 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.554+0000 7f2317fff640 1 -- 172.21.15.132:0/1846043589 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230802cd50 con 0x7f231814fc20 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.554+0000 7f2317fff640 1 -- 172.21.15.132:0/1846043589 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308034660 con 0x7f231814fc20 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.555+0000 7f231f621640 1 -- 172.21.15.132:0/1846043589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f231814fc20 msgr2=0x7f23180c1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.555+0000 7f231f621640 1 --2- 172.21.15.132:0/1846043589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f231814fc20 0x7f23180c1970 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f23180c4a80 tx=0x7f230802be40 comp rx=0 tx=0).stop 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.555+0000 7f231f621640 1 -- 172.21.15.132:0/1846043589 shutdown_connections 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.555+0000 7f231f621640 1 --2- 172.21.15.132:0/1846043589 >> v2:172.21.15.161:3300/0 conn(0x7f2318152560 0x7f2318152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.555+0000 7f231f621640 1 --2- 172.21.15.132:0/1846043589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f231814fc20 0x7f23180c1970 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.555+0000 7f231f621640 1 -- 172.21.15.132:0/1846043589 >> 172.21.15.132:0/1846043589 conn(0x7f23180c39e0 msgr2=0x7f23180c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.555+0000 7f231f621640 1 -- 172.21.15.132:0/1846043589 shutdown_connections 2023-11-18T20:41:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.555+0000 7f231f621640 1 -- 172.21.15.132:0/1846043589 wait complete. 2023-11-18T20:41:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.557+0000 7f231f621640 1 Processor -- start 2023-11-18T20:41:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.557+0000 7f231f621640 1 -- start start 2023-11-18T20:41:20.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231f621640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2318072320 0x7f23180c0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231f621640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f231814fc20 0x7f23180c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231f621640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2318152560 0x7f23181458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231f621640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181ed140 con 0x7f2318072320 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231f621640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181ed420 con 0x7f231814fc20 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231f621640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23181ed700 con 0x7f2318152560 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231d3bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2318072320 0x7f23180c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231d3bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2318072320 0x7f23180c0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56174/0 (socket says 172.21.15.132:56174) 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231d3bd640 1 -- 172.21.15.132:0/1209426811 learned_addr learned my addr 172.21.15.132:0/1209426811 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231d3bd640 1 -- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2318152560 msgr2=0x7f23181458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231d3bd640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2318152560 0x7f23181458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231d3bd640 1 -- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f231814fc20 msgr2=0x7f23180c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.558+0000 7f231d3bd640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f231814fc20 0x7f23180c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.559+0000 7f231d3bd640 1 -- 172.21.15.132:0/1209426811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009a70 con 0x7f2318072320 2023-11-18T20:41:20.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.559+0000 7f231d3bd640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2318072320 0x7f23180c0580 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2308037040 tx=0x7f2308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.559+0000 7f2315ffb640 1 -- 172.21.15.132:0/1209426811 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230803e610 con 0x7f2318072320 2023-11-18T20:41:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.559+0000 7f2315ffb640 1 -- 172.21.15.132:0/1209426811 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230803e770 con 0x7f2318072320 2023-11-18T20:41:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.559+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23181ed9e0 con 0x7f2318072320 2023-11-18T20:41:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.559+0000 7f2315ffb640 1 -- 172.21.15.132:0/1209426811 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230803eb20 con 0x7f2318072320 2023-11-18T20:41:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.559+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23180c0ac0 con 0x7f2318072320 2023-11-18T20:41:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.560+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23181e99d0 con 0x7f2318072320 2023-11-18T20:41:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.561+0000 7f2315ffb640 1 -- 172.21.15.132:0/1209426811 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f230803b050 con 0x7f2318072320 2023-11-18T20:41:20.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.562+0000 7f2315ffb640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f230406ae40 0x7f230406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.563+0000 7f2315ffb640 1 -- 172.21.15.132:0/1209426811 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23080ac0e0 con 0x7f2318072320 2023-11-18T20:41:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.563+0000 7f231cbbc640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f230406ae40 0x7f230406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.564+0000 7f231cbbc640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f230406ae40 0x7f230406d300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f230c007fd0 tx=0x7f230c007960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.567+0000 7f2315ffb640 1 -- 172.21.15.132:0/1209426811 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23080770f0 con 0x7f2318072320 2023-11-18T20:41:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.746+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f231804e840 con 0x7f2318072320 2023-11-18T20:41:20.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.749+0000 7f2315ffb640 1 -- 172.21.15.132:0/1209426811 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16621 (secure 0 0 0) 0x7f230807a710 con 0x7f2318072320 2023-11-18T20:41:20.750 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:20.750 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":75,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:19.529659+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:20.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.751+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f230406ae40 msgr2=0x7f230406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.751+0000 7f231f621640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f230406ae40 0x7f230406d300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f230c007fd0 tx=0x7f230c007960 comp rx=0 tx=0).stop 2023-11-18T20:41:20.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.751+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2318072320 msgr2=0x7f23180c0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.751+0000 7f231f621640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2318072320 0x7f23180c0580 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2308037040 tx=0x7f2308004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:20.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.752+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 shutdown_connections 2023-11-18T20:41:20.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.752+0000 7f231f621640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f230406ae40 0x7f230406d300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.752+0000 7f231f621640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2318152560 0x7f23181458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.752+0000 7f231f621640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f231814fc20 0x7f23180c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.752+0000 7f231f621640 1 --2- 172.21.15.132:0/1209426811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2318072320 0x7f23180c0580 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.752+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 >> 172.21.15.132:0/1209426811 conn(0x7f23180c39e0 msgr2=0x7f23180c2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:20.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.752+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 shutdown_connections 2023-11-18T20:41:20.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.752+0000 7f231f621640 1 -- 172.21.15.132:0/1209426811 wait complete. 2023-11-18T20:41:20.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:20.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.957+0000 7f1f1efa0640 1 Processor -- start 2023-11-18T20:41:20.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.957+0000 7f1f1efa0640 1 -- start start 2023-11-18T20:41:20.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1efa0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f1814e7c0 0x7f1f180c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1efa0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1f180c4c00 0x7f1f180ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1efa0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f18158a60 con 0x7f1f180ca990 2023-11-18T20:41:20.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1efa0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f180c5b10 con 0x7f1f180c4c00 2023-11-18T20:41:20.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1efa0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f18157ca0 con 0x7f1f1814e7c0 2023-11-18T20:41:20.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1d79d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1f180c4c00 0x7f1f180ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1e79f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1f180ca990 0x7f1f18154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39544/0 (socket says 172.21.15.132:39544) 2023-11-18T20:41:20.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1e79f640 1 -- 172.21.15.132:0/3432994659 learned_addr learned my addr 172.21.15.132:0/3432994659 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:20.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.959+0000 7f1f1df9e640 1 --2- 172.21.15.132:0/3432994659 >> v2:172.21.15.161:3300/0 conn(0x7f1f1814e7c0 0x7f1f180c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.960+0000 7f1f1d79d640 1 -- 172.21.15.132:0/3432994659 >> v2:172.21.15.161:3300/0 conn(0x7f1f1814e7c0 msgr2=0x7f1f180c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.960+0000 7f1f1d79d640 1 --2- 172.21.15.132:0/3432994659 >> v2:172.21.15.161:3300/0 conn(0x7f1f1814e7c0 0x7f1f180c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.960+0000 7f1f1d79d640 1 -- 172.21.15.132:0/3432994659 >> v1:172.21.15.132:6789/0 conn(0x7f1f180ca990 legacy=0x7f1f18154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.960+0000 7f1f1d79d640 1 -- 172.21.15.132:0/3432994659 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18157f80 con 0x7f1f180c4c00 2023-11-18T20:41:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.960+0000 7f1f1cf9c640 1 -- 172.21.15.132:0/3432994659 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342153424 0 0) 0x7f1f18158a60 con 0x7f1f180ca990 2023-11-18T20:41:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.961+0000 7f1f1d79d640 1 --2- 172.21.15.132:0/3432994659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180c4c00 0x7f1f180ca450 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1f1808b7c0 tx=0x7f1f0802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f872b9be86529bd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.961+0000 7f1f1cf9c640 1 -- 172.21.15.132:0/3432994659 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08031710 con 0x7f1f180c4c00 2023-11-18T20:41:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.961+0000 7f1f1cf9c640 1 -- 172.21.15.132:0/3432994659 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0802f050 con 0x7f1f180c4c00 2023-11-18T20:41:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.961+0000 7f1f1cf9c640 1 -- 172.21.15.132:0/3432994659 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08031a90 con 0x7f1f180c4c00 2023-11-18T20:41:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.962+0000 7f1f1efa0640 1 -- 172.21.15.132:0/3432994659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180c4c00 msgr2=0x7f1f180ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.962+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/3432994659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180c4c00 0x7f1f180ca450 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1f1808b7c0 tx=0x7f1f0802b7b0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.962+0000 7f1f1efa0640 1 -- 172.21.15.132:0/3432994659 shutdown_connections 2023-11-18T20:41:20.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.962+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/3432994659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180c4c00 0x7f1f180ca450 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.962+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/3432994659 >> v2:172.21.15.161:3300/0 conn(0x7f1f1814e7c0 0x7f1f180c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.962+0000 7f1f1efa0640 1 -- 172.21.15.132:0/3432994659 >> 172.21.15.132:0/3432994659 conn(0x7f1f180abf00 msgr2=0x7f1f180c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:20.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.962+0000 7f1f1efa0640 1 -- 172.21.15.132:0/3432994659 shutdown_connections 2023-11-18T20:41:20.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.962+0000 7f1f1efa0640 1 -- 172.21.15.132:0/3432994659 wait complete. 2023-11-18T20:41:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.963+0000 7f1f1efa0640 1 Processor -- start 2023-11-18T20:41:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.963+0000 7f1f1efa0640 1 -- start start 2023-11-18T20:41:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.964+0000 7f1f1efa0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f180c4c00 0x7f1f18146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.964+0000 7f1f1efa0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180ca990 0x7f1f181ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.964+0000 7f1f1efa0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1814e7c0 0x7f1f181edca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.964+0000 7f1f1efa0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f181ed2d0 con 0x7f1f180ca990 2023-11-18T20:41:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.964+0000 7f1f1efa0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180c03c0 con 0x7f1f1814e7c0 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.964+0000 7f1f1efa0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180c06a0 con 0x7f1f180c4c00 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180ca990 0x7f1f181ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180ca990 0x7f1f181ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56198/0 (socket says 172.21.15.132:56198) 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 -- 172.21.15.132:0/2305202146 learned_addr learned my addr 172.21.15.132:0/2305202146 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1e79f640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1814e7c0 0x7f1f181edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1df9e640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f180c4c00 0x7f1f18146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 -- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f180c4c00 msgr2=0x7f1f18146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f180c4c00 0x7f1f18146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 -- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1814e7c0 msgr2=0x7f1f181edca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1814e7c0 0x7f1f181edca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:20.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 -- 172.21.15.132:0/2305202146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f08009400 con 0x7f1f180ca990 2023-11-18T20:41:20.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.965+0000 7f1f1d79d640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180ca990 0x7f1f181ed760 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1f08000c00 tx=0x7f1f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:20.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.966+0000 7f1f0e7fc640 1 -- 172.21.15.132:0/2305202146 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08033910 con 0x7f1f180ca990 2023-11-18T20:41:20.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.966+0000 7f1f0e7fc640 1 -- 172.21.15.132:0/2305202146 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f08033a70 con 0x7f1f180ca990 2023-11-18T20:41:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.966+0000 7f1f0e7fc640 1 -- 172.21.15.132:0/2305202146 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08033e20 con 0x7f1f180ca990 2023-11-18T20:41:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.966+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f18147480 con 0x7f1f180ca990 2023-11-18T20:41:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.966+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f18147870 con 0x7f1f180ca990 2023-11-18T20:41:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.967+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f18149410 con 0x7f1f180ca990 2023-11-18T20:41:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.968+0000 7f1f0e7fc640 1 -- 172.21.15.132:0/2305202146 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f0803a040 con 0x7f1f180ca990 2023-11-18T20:41:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.969+0000 7f1f0e7fc640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1efc06ae40 0x7f1efc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.969+0000 7f1f0e7fc640 1 -- 172.21.15.132:0/2305202146 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f080aab70 con 0x7f1f180ca990 2023-11-18T20:41:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.969+0000 7f1f1df9e640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1efc06ae40 0x7f1efc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.970+0000 7f1f1df9e640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1efc06ae40 0x7f1efc06d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1f14006fd0 tx=0x7f1f14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:20.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:20.973+0000 7f1f0e7fc640 1 -- 172.21.15.132:0/2305202146 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f08075cb0 con 0x7f1f180ca990 2023-11-18T20:41:21.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.168+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f180c7910 con 0x7f1f180ca990 2023-11-18T20:41:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.172+0000 7f1f0e7fc640 1 -- 172.21.15.132:0/2305202146 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f1f080792d0 con 0x7f1f180ca990 2023-11-18T20:41:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:21.173 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":76,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:21.071396+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:21.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.174+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1efc06ae40 msgr2=0x7f1efc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.174+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1efc06ae40 0x7f1efc06d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1f14006fd0 tx=0x7f1f14008040 comp rx=0 tx=0).stop 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.174+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180ca990 msgr2=0x7f1f181ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.174+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180ca990 0x7f1f181ed760 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1f08000c00 tx=0x7f1f080046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.175+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 shutdown_connections 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.175+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1efc06ae40 0x7f1efc06d300 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.175+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f1814e7c0 0x7f1f181edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.175+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f180ca990 0x7f1f181ed760 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.175+0000 7f1f1efa0640 1 --2- 172.21.15.132:0/2305202146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f180c4c00 0x7f1f18146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.175+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 >> 172.21.15.132:0/2305202146 conn(0x7f1f180abf00 msgr2=0x7f1f1814a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.175+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 shutdown_connections 2023-11-18T20:41:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.175+0000 7f1f1efa0640 1 -- 172.21.15.132:0/2305202146 wait complete. 2023-11-18T20:41:21.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-18T20:41:21.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.416+0000 7f774ffff640 1 Processor -- start 2023-11-18T20:41:21.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.416+0000 7f774ffff640 1 -- start start 2023-11-18T20:41:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.417+0000 7f774ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77500c0c80 0x7f77500a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.417+0000 7f774ffff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7750071e80 con 0x7f775014c2e0 2023-11-18T20:41:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.417+0000 7f774ffff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7750072a20 con 0x7f77500c0440 2023-11-18T20:41:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.417+0000 7f774ffff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7750071470 con 0x7f77500c0c80 2023-11-18T20:41:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f775014c2e0 0x7f7750152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39554/0 (socket says 172.21.15.132:39554) 2023-11-18T20:41:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774effd640 1 -- 172.21.15.132:0/286962544 learned_addr learned my addr 172.21.15.132:0/286962544 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620881760 0 0) 0x7f7750071e80 con 0x7f775014c2e0 2023-11-18T20:41:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f773c003520 con 0x7f775014c2e0 2023-11-18T20:41:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774f7fe640 1 --2- 172.21.15.132:0/286962544 >> v2:172.21.15.161:3300/0 conn(0x7f77500c0c80 0x7f77500a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827834553 0 0) 0x7f773c003520 con 0x7f775014c2e0 2023-11-18T20:41:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 >> v2:172.21.15.161:3300/0 conn(0x7f77500c0c80 msgr2=0x7f77500a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 --2- 172.21.15.132:0/286962544 >> v2:172.21.15.161:3300/0 conn(0x7f77500c0c80 0x7f77500a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 >> v1:172.21.15.161:6789/0 conn(0x7f77500c0440 legacy=0x7f7750072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775014c6c0 con 0x7f775014c2e0 2023-11-18T20:41:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f77400019f0 con 0x7f775014c2e0 2023-11-18T20:41:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.418+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 >> v1:172.21.15.132:6789/0 conn(0x7f775014c2e0 legacy=0x7f7750152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774e7fc640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f773c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774e7fc640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0047c0 0x7f773c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774e7fc640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f773c005380 0x7f773c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c00c1e0 con 0x7f773c003970 2023-11-18T20:41:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c00c350 con 0x7f773c0047c0 2023-11-18T20:41:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c00c510 con 0x7f773c005380 2023-11-18T20:41:21.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774effd640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f773c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:21.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774effd640 1 -- 172.21.15.132:0/286962544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f773c005380 msgr2=0x7f773c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:21.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774effd640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f773c005380 0x7f773c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774effd640 1 -- 172.21.15.132:0/286962544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0047c0 msgr2=0x7f773c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:21.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774effd640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0047c0 0x7f773c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774effd640 1 -- 172.21.15.132:0/286962544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c003520 con 0x7f773c003970 2023-11-18T20:41:21.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.419+0000 7f774f7fe640 1 -- 172.21.15.132:0/286962544 reap_dead start 2023-11-18T20:41:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.420+0000 7f774effd640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f773c003d90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f774000a800 tx=0x7f773c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18afa9e706e509f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740034630 con 0x7f773c003970 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774002f070 con 0x7f773c003970 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774e7fc640 1 -- 172.21.15.132:0/286962544 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740034a50 con 0x7f773c003970 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774ffff640 1 -- 172.21.15.132:0/286962544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 msgr2=0x7f773c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774ffff640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f773c003d90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f774000a800 tx=0x7f773c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774ffff640 1 -- 172.21.15.132:0/286962544 shutdown_connections 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774ffff640 1 --2- 172.21.15.132:0/286962544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f773c003d90 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774ffff640 1 -- 172.21.15.132:0/286962544 >> 172.21.15.132:0/286962544 conn(0x7f77500a77f0 msgr2=0x7f77500a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774ffff640 1 -- 172.21.15.132:0/286962544 shutdown_connections 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.421+0000 7f774ffff640 1 -- 172.21.15.132:0/286962544 wait complete. 2023-11-18T20:41:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.423+0000 7f774ffff640 1 Processor -- start 2023-11-18T20:41:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.423+0000 7f774ffff640 1 -- start start 2023-11-18T20:41:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f775014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77500ab450 0x7f77500a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77500a8d20 0x7f77501481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774ffff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7750155c20 con 0x7f773c003970 2023-11-18T20:41:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774ffff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77500aac80 con 0x7f77500ab450 2023-11-18T20:41:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774ffff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500aaf60 con 0x7f77500a8d20 2023-11-18T20:41:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f775014ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f775014ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56222/0 (socket says 172.21.15.132:56222) 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.424+0000 7f774effd640 1 -- 172.21.15.132:0/3686324271 learned_addr learned my addr 172.21.15.132:0/3686324271 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f774effd640 1 -- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77500a8d20 msgr2=0x7f77501481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f774effd640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77500a8d20 0x7f77501481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f774effd640 1 -- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77500ab450 msgr2=0x7f77500a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f77467fc640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77500ab450 0x7f77500a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f774effd640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77500ab450 0x7f77500a87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f774effd640 1 -- 172.21.15.132:0/3686324271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750155e50 con 0x7f773c003970 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f774effd640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f775014ad60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f774002cb50 tx=0x7f77501521c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f7747fff640 1 -- 172.21.15.132:0/3686324271 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740034430 con 0x7f773c003970 2023-11-18T20:41:21.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f7747fff640 1 -- 172.21.15.132:0/3686324271 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774002ce90 con 0x7f773c003970 2023-11-18T20:41:21.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f7747fff640 1 -- 172.21.15.132:0/3686324271 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400347b0 con 0x7f773c003970 2023-11-18T20:41:21.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.425+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7750156130 con 0x7f773c003970 2023-11-18T20:41:21.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.426+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77501503a0 con 0x7f773c003970 2023-11-18T20:41:21.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.427+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77501562c0 con 0x7f773c003970 2023-11-18T20:41:21.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.427+0000 7f7747fff640 1 -- 172.21.15.132:0/3686324271 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7740031030 con 0x7f773c003970 2023-11-18T20:41:21.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.428+0000 7f7747fff640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f773006ae40 0x7f773006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:21.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.428+0000 7f7747fff640 1 -- 172.21.15.132:0/3686324271 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77400aba60 con 0x7f773c003970 2023-11-18T20:41:21.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.429+0000 7f77467fc640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f773006ae40 0x7f773006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:21.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.430+0000 7f77467fc640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f773006ae40 0x7f773006d300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7738000f20 tx=0x7f7738009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:21.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.433+0000 7f7747fff640 1 -- 172.21.15.132:0/3686324271 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7740076b10 con 0x7f773c003970 2023-11-18T20:41:21.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:21.659+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f77501562c0 con 0x7f773c003970 2023-11-18T20:41:22.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.355+0000 7f7747fff640 1 -- 172.21.15.132:0/3686324271 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7f774007a130 con 0x7f773c003970 2023-11-18T20:41:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.358+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f773006ae40 msgr2=0x7f773006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.358+0000 7f774ffff640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f773006ae40 0x7f773006d300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7738000f20 tx=0x7f7738009040 comp rx=0 tx=0).stop 2023-11-18T20:41:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 msgr2=0x7f775014ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f775014ad60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f774002cb50 tx=0x7f77501521c0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 shutdown_connections 2023-11-18T20:41:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f773006ae40 0x7f773006d300 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77500a8d20 0x7f77501481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77500ab450 0x7f77500a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 --2- 172.21.15.132:0/3686324271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773c003970 0x7f775014ad60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 >> 172.21.15.132:0/3686324271 conn(0x7f77500a77f0 msgr2=0x7f77501518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 shutdown_connections 2023-11-18T20:41:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.359+0000 7f774ffff640 1 -- 172.21.15.132:0/3686324271 wait complete. 2023-11-18T20:41:22.381 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T20:41:22.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-18T20:41:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.589+0000 7fb656ebb640 1 Processor -- start 2023-11-18T20:41:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.589+0000 7fb656ebb640 1 -- start start 2023-11-18T20:41:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.590+0000 7fb656ebb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb6500a4d20 0x7fb6500a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.590+0000 7fb656ebb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb650154430 0x7fb6501548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.590+0000 7fb656ebb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb650157ad0 con 0x7fb6500c0440 2023-11-18T20:41:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.590+0000 7fb656ebb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb650158890 con 0x7fb650154430 2023-11-18T20:41:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.590+0000 7fb656ebb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb650157db0 con 0x7fb6500a4d20 2023-11-18T20:41:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.591+0000 7fb6556b8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb650154430 0x7fb6501548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.591+0000 7fb6556b8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb650154430 0x7fb6501548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56230/0 (socket says 172.21.15.132:56230) 2023-11-18T20:41:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.591+0000 7fb6556b8640 1 -- 172.21.15.132:0/778922085 learned_addr learned my addr 172.21.15.132:0/778922085 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.591+0000 7fb6556b8640 1 -- 172.21.15.132:0/778922085 >> v2:172.21.15.161:3300/0 conn(0x7fb6500a4d20 msgr2=0x7fb6500a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.591+0000 7fb6556b8640 1 --2- 172.21.15.132:0/778922085 >> v2:172.21.15.161:3300/0 conn(0x7fb6500a4d20 0x7fb6500a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.591+0000 7fb6556b8640 1 -- 172.21.15.132:0/778922085 >> v1:172.21.15.161:6789/0 conn(0x7fb6500c0440 legacy=0x7fb6500c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.591+0000 7fb6556b8640 1 -- 172.21.15.132:0/778922085 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650158090 con 0x7fb650154430 2023-11-18T20:41:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.592+0000 7fb6556b8640 1 --2- 172.21.15.132:0/778922085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb650154430 0x7fb6501548c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb650067910 tx=0x7fb64002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee16a500692bdc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.592+0000 7fb654eb7640 1 -- 172.21.15.132:0/778922085 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400317e0 con 0x7fb650154430 2023-11-18T20:41:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.592+0000 7fb654eb7640 1 -- 172.21.15.132:0/778922085 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb640031940 con 0x7fb650154430 2023-11-18T20:41:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.592+0000 7fb654eb7640 1 -- 172.21.15.132:0/778922085 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640031cd0 con 0x7fb650154430 2023-11-18T20:41:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.593+0000 7fb656ebb640 1 -- 172.21.15.132:0/778922085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb650154430 msgr2=0x7fb6501548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.593+0000 7fb656ebb640 1 --2- 172.21.15.132:0/778922085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb650154430 0x7fb6501548c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb650067910 tx=0x7fb64002b880 comp rx=0 tx=0).stop 2023-11-18T20:41:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.593+0000 7fb656ebb640 1 -- 172.21.15.132:0/778922085 shutdown_connections 2023-11-18T20:41:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.593+0000 7fb656ebb640 1 --2- 172.21.15.132:0/778922085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb650154430 0x7fb6501548c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.593+0000 7fb656ebb640 1 --2- 172.21.15.132:0/778922085 >> v2:172.21.15.161:3300/0 conn(0x7fb6500a4d20 0x7fb6500a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.593+0000 7fb656ebb640 1 -- 172.21.15.132:0/778922085 >> 172.21.15.132:0/778922085 conn(0x7fb6500a77f0 msgr2=0x7fb6500a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.593+0000 7fb656ebb640 1 -- 172.21.15.132:0/778922085 shutdown_connections 2023-11-18T20:41:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.593+0000 7fb656ebb640 1 -- 172.21.15.132:0/778922085 wait complete. 2023-11-18T20:41:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.595+0000 7fb656ebb640 1 Processor -- start 2023-11-18T20:41:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.595+0000 7fb656ebb640 1 -- start start 2023-11-18T20:41:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb656ebb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6500a4d20 0x7fb650157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb656ebb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6500c0440 0x7fb65014c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb656ebb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb650154430 0x7fb650149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb656ebb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65014cda0 con 0x7fb6500c0440 2023-11-18T20:41:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb656ebb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650156300 con 0x7fb6500a4d20 2023-11-18T20:41:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb656ebb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6501565e0 con 0x7fb650154430 2023-11-18T20:41:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb6556b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6500c0440 0x7fb65014c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb6556b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6500c0440 0x7fb65014c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56240/0 (socket says 172.21.15.132:56240) 2023-11-18T20:41:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb6556b8640 1 -- 172.21.15.132:0/3199839583 learned_addr learned my addr 172.21.15.132:0/3199839583 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb6556b8640 1 -- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb650154430 msgr2=0x7fb650149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.596+0000 7fb6556b8640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb650154430 0x7fb650149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb6556b8640 1 -- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6500a4d20 msgr2=0x7fb650157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb6556b8640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6500a4d20 0x7fb650157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb6556b8640 1 -- 172.21.15.132:0/3199839583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400094d0 con 0x7fb6500c0440 2023-11-18T20:41:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb6556b8640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6500c0440 0x7fb65014c330 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb64002b8c0 tx=0x7fb6400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb6467fc640 1 -- 172.21.15.132:0/3199839583 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640032900 con 0x7fb6500c0440 2023-11-18T20:41:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb6467fc640 1 -- 172.21.15.132:0/3199839583 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb640032a80 con 0x7fb6500c0440 2023-11-18T20:41:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb6467fc640 1 -- 172.21.15.132:0/3199839583 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640032e30 con 0x7fb6500c0440 2023-11-18T20:41:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6501568c0 con 0x7fb6500c0440 2023-11-18T20:41:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.597+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb650156e80 con 0x7fb6500c0440 2023-11-18T20:41:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.599+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb650156720 con 0x7fb6500c0440 2023-11-18T20:41:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.599+0000 7fb6467fc640 1 -- 172.21.15.132:0/3199839583 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb64004d3f0 con 0x7fb6500c0440 2023-11-18T20:41:22.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.601+0000 7fb6467fc640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb63406ae40 0x7fb63406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:22.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.601+0000 7fb6467fc640 1 -- 172.21.15.132:0/3199839583 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6400ab5b0 con 0x7fb6500c0440 2023-11-18T20:41:22.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.601+0000 7fb655eb9640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb63406ae40 0x7fb63406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.603+0000 7fb655eb9640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb63406ae40 0x7fb63406d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009710 tx=0x7fb64c006c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:22.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.605+0000 7fb6467fc640 1 -- 172.21.15.132:0/3199839583 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb650156720 con 0x7fb6500c0440 2023-11-18T20:41:22.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:22.838+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb650156720 con 0x7fb6500c0440 2023-11-18T20:41:23.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.368+0000 7fb6467fc640 1 -- 172.21.15.132:0/3199839583 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb650156720 con 0x7fb6500c0440 2023-11-18T20:41:23.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb63406ae40 msgr2=0x7fb63406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:23.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb63406ae40 0x7fb63406d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009710 tx=0x7fb64c006c80 comp rx=0 tx=0).stop 2023-11-18T20:41:23.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6500c0440 msgr2=0x7fb65014c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:23.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6500c0440 0x7fb65014c330 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb64002b8c0 tx=0x7fb6400046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 shutdown_connections 2023-11-18T20:41:23.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb63406ae40 0x7fb63406d300 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb650154430 0x7fb650149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6500c0440 0x7fb65014c330 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 --2- 172.21.15.132:0/3199839583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6500a4d20 0x7fb650157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 >> 172.21.15.132:0/3199839583 conn(0x7fb6500a77f0 msgr2=0x7fb65014fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:23.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 shutdown_connections 2023-11-18T20:41:23.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.372+0000 7fb656ebb640 1 -- 172.21.15.132:0/3199839583 wait complete. 2023-11-18T20:41:23.394 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-18T20:41:23.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:41:23.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.603+0000 7f993f075640 1 Processor -- start 2023-11-18T20:41:23.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.603+0000 7f993f075640 1 -- start start 2023-11-18T20:41:23.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.604+0000 7f993f075640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f993814fd30 0x7f9938152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:23.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.604+0000 7f993f075640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99380c3ea0 0x7f99380c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:23.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.604+0000 7f993f075640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380c64a0 con 0x7f993806d0a0 2023-11-18T20:41:23.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.604+0000 7f993f075640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380c5c00 con 0x7f993814fd30 2023-11-18T20:41:23.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.604+0000 7f993f075640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380c5ee0 con 0x7f99380c3ea0 2023-11-18T20:41:23.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.605+0000 7f993ce11640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f993814fd30 0x7f9938152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:23.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.605+0000 7f993ce11640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f993814fd30 0x7f9938152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56254/0 (socket says 172.21.15.132:56254) 2023-11-18T20:41:23.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.605+0000 7f993ce11640 1 -- 172.21.15.132:0/1653172303 learned_addr learned my addr 172.21.15.132:0/1653172303 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:23.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.605+0000 7f993ce11640 1 -- 172.21.15.132:0/1653172303 >> v2:172.21.15.161:3300/0 conn(0x7f99380c3ea0 msgr2=0x7f99380c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:23.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.605+0000 7f993ce11640 1 --2- 172.21.15.132:0/1653172303 >> v2:172.21.15.161:3300/0 conn(0x7f99380c3ea0 0x7f99380c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.605+0000 7f993ce11640 1 -- 172.21.15.132:0/1653172303 >> v1:172.21.15.132:6789/0 conn(0x7f993806d0a0 legacy=0x7f99380a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:23.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.605+0000 7f993ce11640 1 -- 172.21.15.132:0/1653172303 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380c61c0 con 0x7f993814fd30 2023-11-18T20:41:23.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.606+0000 7f993ce11640 1 --2- 172.21.15.132:0/1653172303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993814fd30 0x7f9938152f20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f993806e430 tx=0x7f992c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255e1d19f6196125 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:23.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f99377fe640 1 -- 172.21.15.132:0/1653172303 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c030860 con 0x7f993814fd30 2023-11-18T20:41:23.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f99377fe640 1 -- 172.21.15.132:0/1653172303 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c0309c0 con 0x7f993814fd30 2023-11-18T20:41:23.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f99377fe640 1 -- 172.21.15.132:0/1653172303 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c030d50 con 0x7f993814fd30 2023-11-18T20:41:23.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f993f075640 1 -- 172.21.15.132:0/1653172303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993814fd30 msgr2=0x7f9938152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:23.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f993f075640 1 --2- 172.21.15.132:0/1653172303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993814fd30 0x7f9938152f20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f993806e430 tx=0x7f992c02b9a0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f993f075640 1 -- 172.21.15.132:0/1653172303 shutdown_connections 2023-11-18T20:41:23.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f993f075640 1 --2- 172.21.15.132:0/1653172303 >> v2:172.21.15.161:3300/0 conn(0x7f99380c3ea0 0x7f99380c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f993f075640 1 --2- 172.21.15.132:0/1653172303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993814fd30 0x7f9938152f20 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f993f075640 1 -- 172.21.15.132:0/1653172303 >> 172.21.15.132:0/1653172303 conn(0x7f993806a500 msgr2=0x7f993806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:23.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f993f075640 1 -- 172.21.15.132:0/1653172303 shutdown_connections 2023-11-18T20:41:23.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.607+0000 7f993f075640 1 -- 172.21.15.132:0/1653172303 wait complete. 2023-11-18T20:41:23.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.609+0000 7f993f075640 1 Processor -- start 2023-11-18T20:41:23.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.609+0000 7f993f075640 1 -- start start 2023-11-18T20:41:23.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f993f075640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f993806d0a0 0x7f99380a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:23.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f993f075640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99380c3ea0 0x7f99380aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:23.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f993f075640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f993814fd30 0x7f993814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:23.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f993f075640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99381dc8b0 con 0x7f99380c3ea0 2023-11-18T20:41:23.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f993f075640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99381ee6d0 con 0x7f993806d0a0 2023-11-18T20:41:23.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f993f075640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9938153fc0 con 0x7f993814fd30 2023-11-18T20:41:23.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f9937fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99380c3ea0 0x7f99380aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:23.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f9937fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99380c3ea0 0x7f99380aa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56262/0 (socket says 172.21.15.132:56262) 2023-11-18T20:41:23.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.610+0000 7f9937fff640 1 -- 172.21.15.132:0/2878834020 learned_addr learned my addr 172.21.15.132:0/2878834020 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:23.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f9937fff640 1 -- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f993814fd30 msgr2=0x7f993814eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:23.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f993d612640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f993814fd30 0x7f993814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:23.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f993ce11640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f993806d0a0 0x7f99380a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:23.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f9937fff640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f993814fd30 0x7f993814eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f9937fff640 1 -- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f993806d0a0 msgr2=0x7f99380a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:23.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f9937fff640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f993806d0a0 0x7f99380a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f9937fff640 1 -- 172.21.15.132:0/2878834020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0094d0 con 0x7f99380c3ea0 2023-11-18T20:41:23.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f993d612640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f993814fd30 0x7f993814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:23.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f9937fff640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99380c3ea0 0x7f99380aa0c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f992400c3c0 tx=0x7f992400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:23.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.611+0000 7f99357fa640 1 -- 172.21.15.132:0/2878834020 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240052d0 con 0x7f99380c3ea0 2023-11-18T20:41:23.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.612+0000 7f99357fa640 1 -- 172.21.15.132:0/2878834020 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9924005450 con 0x7f99380c3ea0 2023-11-18T20:41:23.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.612+0000 7f99357fa640 1 -- 172.21.15.132:0/2878834020 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924003830 con 0x7f99380c3ea0 2023-11-18T20:41:23.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.612+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9938153a00 con 0x7f99380c3ea0 2023-11-18T20:41:23.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.612+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99380a9660 con 0x7f99380c3ea0 2023-11-18T20:41:23.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.613+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99380a9880 con 0x7f99380c3ea0 2023-11-18T20:41:23.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.614+0000 7f99357fa640 1 -- 172.21.15.132:0/2878834020 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9924003990 con 0x7f99380c3ea0 2023-11-18T20:41:23.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.615+0000 7f99357fa640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f991c06ae40 0x7f991c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:23.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.615+0000 7f99357fa640 1 -- 172.21.15.132:0/2878834020 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9924088ab0 con 0x7f99380c3ea0 2023-11-18T20:41:23.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.615+0000 7f993ce11640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f991c06ae40 0x7f991c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:23.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.617+0000 7f993ce11640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f991c06ae40 0x7f991c06d300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f992c036000 tx=0x7f992c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:23.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.619+0000 7f99357fa640 1 -- 172.21.15.132:0/2878834020 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9924053b50 con 0x7f99380c3ea0 2023-11-18T20:41:23.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.846+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9938068350 con 0x7f99380c3ea0 2023-11-18T20:41:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.847+0000 7f99357fa640 1 -- 172.21.15.132:0/2878834020 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f9924017090 con 0x7f99380c3ea0 2023-11-18T20:41:23.849 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:23.849 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:19.530586+0000","modified":"2023-11-18T20:41:22.840145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/726664783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":726664783},{"type":"v1","addr":"172.21.15.132:6835","nonce":726664783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-18T20:41:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-11-18T20:41:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f991c06ae40 msgr2=0x7f991c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f991c06ae40 0x7f991c06d300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f992c036000 tx=0x7f992c03b040 comp rx=0 tx=0).stop 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99380c3ea0 msgr2=0x7f99380aa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99380c3ea0 0x7f99380aa0c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f992400c3c0 tx=0x7f992400c880 comp rx=0 tx=0).stop 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 shutdown_connections 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f991c06ae40 0x7f991c06d300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f993814fd30 0x7f993814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99380c3ea0 0x7f99380aa0c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 --2- 172.21.15.132:0/2878834020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f993806d0a0 0x7f99380a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 >> 172.21.15.132:0/2878834020 conn(0x7f993806a500 msgr2=0x7f99380a7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 shutdown_connections 2023-11-18T20:41:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:23.850+0000 7f993f075640 1 -- 172.21.15.132:0/2878834020 wait complete. 2023-11-18T20:41:23.870 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:24.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.080+0000 7f0acdd4e640 1 Processor -- start 2023-11-18T20:41:24.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.080+0000 7f0acdd4e640 1 -- start start 2023-11-18T20:41:24.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0acdd4e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ac814e7f0 0x7f0ac80c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0acdd4e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac806cd20 0x7f0ac815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0acdd4e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80a8380 con 0x7f0ac80c52e0 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0acdd4e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac81510b0 con 0x7f0ac814e7f0 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0acdd4e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac806bf60 con 0x7f0ac806cd20 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0accd4c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ac814e7f0 0x7f0ac80c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0accd4c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ac814e7f0 0x7f0ac80c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56264/0 (socket says 172.21.15.132:56264) 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0accd4c640 1 -- 172.21.15.132:0/3186425256 learned_addr learned my addr 172.21.15.132:0/3186425256 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0accd4c640 1 -- 172.21.15.132:0/3186425256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac806cd20 msgr2=0x7f0ac815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0accd4c640 1 --2- 172.21.15.132:0/3186425256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac806cd20 0x7f0ac815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0accd4c640 1 -- 172.21.15.132:0/3186425256 >> v1:172.21.15.161:6789/0 conn(0x7f0ac80c52e0 legacy=0x7f0ac806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.082+0000 7f0accd4c640 1 -- 172.21.15.132:0/3186425256 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac806c240 con 0x7f0ac814e7f0 2023-11-18T20:41:24.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.083+0000 7f0accd4c640 1 --2- 172.21.15.132:0/3186425256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac814e7f0 0x7f0ac80c0440 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009870 tx=0x7f0abc02da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1454d030470d5607 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:24.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.084+0000 7f0ac77fe640 1 -- 172.21.15.132:0/3186425256 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc02f830 con 0x7f0ac814e7f0 2023-11-18T20:41:24.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.084+0000 7f0ac77fe640 1 -- 172.21.15.132:0/3186425256 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc02f990 con 0x7f0ac814e7f0 2023-11-18T20:41:24.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.084+0000 7f0ac77fe640 1 -- 172.21.15.132:0/3186425256 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc02fd20 con 0x7f0ac814e7f0 2023-11-18T20:41:24.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.084+0000 7f0acdd4e640 1 -- 172.21.15.132:0/3186425256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac814e7f0 msgr2=0x7f0ac80c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.084+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/3186425256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac814e7f0 0x7f0ac80c0440 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009870 tx=0x7f0abc02da70 comp rx=0 tx=0).stop 2023-11-18T20:41:24.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.084+0000 7f0acdd4e640 1 -- 172.21.15.132:0/3186425256 shutdown_connections 2023-11-18T20:41:24.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.085+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/3186425256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac806cd20 0x7f0ac815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.085+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/3186425256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac814e7f0 0x7f0ac80c0440 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.085+0000 7f0acdd4e640 1 -- 172.21.15.132:0/3186425256 >> 172.21.15.132:0/3186425256 conn(0x7f0ac80a77f0 msgr2=0x7f0ac80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:24.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.085+0000 7f0acdd4e640 1 -- 172.21.15.132:0/3186425256 shutdown_connections 2023-11-18T20:41:24.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.085+0000 7f0acdd4e640 1 -- 172.21.15.132:0/3186425256 wait complete. 2023-11-18T20:41:24.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.086+0000 7f0acdd4e640 1 Processor -- start 2023-11-18T20:41:24.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.086+0000 7f0acdd4e640 1 -- start start 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.087+0000 7f0acdd4e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac806cd20 0x7f0ac8149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.087+0000 7f0acdd4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80c52e0 0x7f0ac81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.087+0000 7f0acdd4e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac814e7f0 0x7f0ac814d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.087+0000 7f0acdd4e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81ead50 con 0x7f0ac80c52e0 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.087+0000 7f0acdd4e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8149ee0 con 0x7f0ac806cd20 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.087+0000 7f0acdd4e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac814c590 con 0x7f0ac814e7f0 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80c52e0 0x7f0ac81499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80c52e0 0x7f0ac81499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56282/0 (socket says 172.21.15.132:56282) 2023-11-18T20:41:24.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 -- 172.21.15.132:0/307105986 learned_addr learned my addr 172.21.15.132:0/307105986 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:24.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0acd54d640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac814e7f0 0x7f0ac814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0accd4c640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac806cd20 0x7f0ac8149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 -- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac814e7f0 msgr2=0x7f0ac814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac814e7f0 0x7f0ac814d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 -- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac806cd20 msgr2=0x7f0ac8149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac806cd20 0x7f0ac8149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 -- 172.21.15.132:0/307105986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0094d0 con 0x7f0ac80c52e0 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.088+0000 7f0ac7fff640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80c52e0 0x7f0ac81499a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c410 tx=0x7f0ab400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.089+0000 7f0ac57fa640 1 -- 172.21.15.132:0/307105986 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40035f0 con 0x7f0ac80c52e0 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.089+0000 7f0ac57fa640 1 -- 172.21.15.132:0/307105986 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4003750 con 0x7f0ac80c52e0 2023-11-18T20:41:24.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.089+0000 7f0ac57fa640 1 -- 172.21.15.132:0/307105986 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4003b40 con 0x7f0ac80c52e0 2023-11-18T20:41:24.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.089+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac814c870 con 0x7f0ac80c52e0 2023-11-18T20:41:24.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.089+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac8150990 con 0x7f0ac80c52e0 2023-11-18T20:41:24.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.090+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac814cd90 con 0x7f0ac80c52e0 2023-11-18T20:41:24.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.091+0000 7f0ac57fa640 1 -- 172.21.15.132:0/307105986 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ab4003ca0 con 0x7f0ac80c52e0 2023-11-18T20:41:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.092+0000 7f0ac57fa640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0aac06ae40 0x7f0aac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.092+0000 7f0ac57fa640 1 -- 172.21.15.132:0/307105986 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ab40888a0 con 0x7f0ac80c52e0 2023-11-18T20:41:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.093+0000 7f0accd4c640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0aac06ae40 0x7f0aac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.094+0000 7f0accd4c640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0aac06ae40 0x7f0aac06d300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0abc038000 tx=0x7f0abc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:24.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.096+0000 7f0ac57fa640 1 -- 172.21.15.132:0/307105986 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ac814cd90 con 0x7f0ac80c52e0 2023-11-18T20:41:24.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.288+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ac814cd90 con 0x7f0ac80c52e0 2023-11-18T20:41:24.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.291+0000 7f0ac57fa640 1 -- 172.21.15.132:0/307105986 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f0ac814cd90 con 0x7f0ac80c52e0 2023-11-18T20:41:24.293 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:24.293 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":76,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:21.071396+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:24.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0aac06ae40 msgr2=0x7f0aac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0aac06ae40 0x7f0aac06d300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0abc038000 tx=0x7f0abc008030 comp rx=0 tx=0).stop 2023-11-18T20:41:24.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80c52e0 msgr2=0x7f0ac81499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80c52e0 0x7f0ac81499a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c410 tx=0x7f0ab400c8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 shutdown_connections 2023-11-18T20:41:24.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f0aac06ae40 0x7f0aac06d300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ac814e7f0 0x7f0ac814d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80c52e0 0x7f0ac81499a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 --2- 172.21.15.132:0/307105986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac806cd20 0x7f0ac8149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 >> 172.21.15.132:0/307105986 conn(0x7f0ac80a77f0 msgr2=0x7f0ac80bee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:24.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 shutdown_connections 2023-11-18T20:41:24.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.294+0000 7f0acdd4e640 1 -- 172.21.15.132:0/307105986 wait complete. 2023-11-18T20:41:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T20:41:24.313 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:41:24.452 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-11-18T20:41:24.451+0000 7fe1e3a35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:41:24.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.514+0000 7fb816bf5640 1 Processor -- start 2023-11-18T20:41:24.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.514+0000 7fb816bf5640 1 -- start start 2023-11-18T20:41:24.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.516+0000 7fb816bf5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 0x7fb810152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.516+0000 7fb816bf5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8100c64a0 con 0x7fb81006d0a0 2023-11-18T20:41:24.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.516+0000 7fb816bf5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8100c5c00 con 0x7fb8100c3ea0 2023-11-18T20:41:24.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.516+0000 7fb816bf5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100c5ee0 con 0x7fb81014fd30 2023-11-18T20:41:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.516+0000 7fb80ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb81006d0a0 0x7fb8100a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39568/0 (socket says 172.21.15.132:39568) 2023-11-18T20:41:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.516+0000 7fb80ffff640 1 -- 172.21.15.132:0/4283700345 learned_addr learned my addr 172.21.15.132:0/4283700345 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.516+0000 7fb814991640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 0x7fb810152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471056641 0 0) 0x7fb8100c64a0 con 0x7fb81006d0a0 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb800003520 con 0x7fb81006d0a0 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 603188823 0 0) 0x7fb800003520 con 0x7fb81006d0a0 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 msgr2=0x7fb810152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 0x7fb810152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 >> v1:172.21.15.161:6789/0 conn(0x7fb8100c3ea0 legacy=0x7fb8100c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100c61c0 con 0x7fb81006d0a0 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fb7fc001670 con 0x7fb81006d0a0 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 >> v1:172.21.15.132:6789/0 conn(0x7fb81006d0a0 legacy=0x7fb8100a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8000039a0 0x7fb800003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb800004350 0x7fb800004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 0x7fb800005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100c5ee0 con 0x7fb800004350 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80000b980 con 0x7fb8000039a0 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80000bb40 con 0x7fb81014fd30 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.517+0000 7fb80ffff640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb800004350 0x7fb800004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.518+0000 7fb814991640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8000039a0 0x7fb800003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.518+0000 7fb815192640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 0x7fb800005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.518+0000 7fb80ffff640 1 -- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 msgr2=0x7fb800005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.518+0000 7fb80ffff640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 0x7fb800005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.518+0000 7fb80ffff640 1 -- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8000039a0 msgr2=0x7fb800003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.518+0000 7fb80ffff640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8000039a0 0x7fb800003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.518+0000 7fb80ffff640 1 -- 172.21.15.132:0/4283700345 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800003520 con 0x7fb800004350 2023-11-18T20:41:24.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.518+0000 7fb815192640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb81014fd30 0x7fb800005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.519+0000 7fb80ffff640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb800004350 0x7fb800004820 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb81006d4e0 tx=0x7fb8000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf1e81ae7b5b7ce server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.519+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc005ad0 con 0x7fb800004350 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.519+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc005c50 con 0x7fb800004350 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.519+0000 7fb80f7fe640 1 -- 172.21.15.132:0/4283700345 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc02c890 con 0x7fb800004350 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.520+0000 7fb816bf5640 1 -- 172.21.15.132:0/4283700345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb800004350 msgr2=0x7fb800004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.520+0000 7fb816bf5640 1 --2- 172.21.15.132:0/4283700345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb800004350 0x7fb800004820 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb81006d4e0 tx=0x7fb8000057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.520+0000 7fb815192640 1 -- 172.21.15.132:0/4283700345 reap_dead start 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.520+0000 7fb816bf5640 1 -- 172.21.15.132:0/4283700345 shutdown_connections 2023-11-18T20:41:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.520+0000 7fb816bf5640 1 -- 172.21.15.132:0/4283700345 >> 172.21.15.132:0/4283700345 conn(0x7fb81006a500 msgr2=0x7fb81006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:24.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.520+0000 7fb816bf5640 1 -- 172.21.15.132:0/4283700345 shutdown_connections 2023-11-18T20:41:24.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.520+0000 7fb816bf5640 1 -- 172.21.15.132:0/4283700345 wait complete. 2023-11-18T20:41:24.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.522+0000 7fb816bf5640 1 Processor -- start 2023-11-18T20:41:24.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.522+0000 7fb816bf5640 1 -- start start 2023-11-18T20:41:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb816bf5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800004350 0x7fb810154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb816bf5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb810155530 0x7fb810150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb816bf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb810151070 0x7fb8101e9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb816bf5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8101506a0 con 0x7fb810151070 2023-11-18T20:41:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb816bf5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100a81d0 con 0x7fb800004350 2023-11-18T20:41:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb816bf5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb810154660 con 0x7fb810155530 2023-11-18T20:41:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb815192640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb810151070 0x7fb8101e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb815192640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb810151070 0x7fb8101e9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56296/0 (socket says 172.21.15.132:56296) 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.523+0000 7fb815192640 1 -- 172.21.15.132:0/2322423546 learned_addr learned my addr 172.21.15.132:0/2322423546 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb814991640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800004350 0x7fb810154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb80ffff640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb810155530 0x7fb810150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb815192640 1 -- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb810155530 msgr2=0x7fb810150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb815192640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb810155530 0x7fb810150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb815192640 1 -- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800004350 msgr2=0x7fb810154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb815192640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800004350 0x7fb810154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb815192640 1 -- 172.21.15.132:0/2322423546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100a7c10 con 0x7fb810151070 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb80ffff640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb810155530 0x7fb810150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb815192640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb810151070 0x7fb8101e9280 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb81006b250 tx=0x7fb80800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb80d7fa640 1 -- 172.21.15.132:0/2322423546 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808003b70 con 0x7fb810151070 2023-11-18T20:41:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.524+0000 7fb80d7fa640 1 -- 172.21.15.132:0/2322423546 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb808003cd0 con 0x7fb810151070 2023-11-18T20:41:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.525+0000 7fb80d7fa640 1 -- 172.21.15.132:0/2322423546 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8080052b0 con 0x7fb810151070 2023-11-18T20:41:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.525+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8100a7ef0 con 0x7fb810151070 2023-11-18T20:41:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.525+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8101559b0 con 0x7fb810151070 2023-11-18T20:41:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.526+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81006e2a0 con 0x7fb810151070 2023-11-18T20:41:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.527+0000 7fb80d7fa640 1 -- 172.21.15.132:0/2322423546 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb808005410 con 0x7fb810151070 2023-11-18T20:41:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.528+0000 7fb80d7fa640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb7f406ae70 0x7fb7f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.528+0000 7fb80d7fa640 1 -- 172.21.15.132:0/2322423546 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb808088ac0 con 0x7fb810151070 2023-11-18T20:41:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.528+0000 7fb814991640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb7f406ae70 0x7fb7f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:24.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.530+0000 7fb814991640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb7f406ae70 0x7fb7f406d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb804009a10 tx=0x7fb804008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.532+0000 7fb80d7fa640 1 -- 172.21.15.132:0/2322423546 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb808053c00 con 0x7fb810151070 2023-11-18T20:41:24.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.715+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8100c4a40 con 0x7fb7f406ae70 2023-11-18T20:41:24.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.738+0000 7fb80d7fa640 1 -- 172.21.15.132:0/2322423546 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286545 (secure 0 0 0) 0x7fb804013a10 con 0x7fb7f406ae70 2023-11-18T20:41:24.743 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:24.745 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:41:24.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.744+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb7f406ae70 msgr2=0x7fb7f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.744+0000 7fb816bf5640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb7f406ae70 0x7fb7f406d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb804009a10 tx=0x7fb804008040 comp rx=0 tx=0).stop 2023-11-18T20:41:24.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.744+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb810151070 msgr2=0x7fb8101e9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.744+0000 7fb816bf5640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb810151070 0x7fb8101e9280 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb81006b250 tx=0x7fb80800db90 comp rx=0 tx=0).stop 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.744+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 shutdown_connections 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.745+0000 7fb816bf5640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb7f406ae70 0x7fb7f406d330 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.745+0000 7fb816bf5640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb810151070 0x7fb8101e9280 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.745+0000 7fb816bf5640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb810155530 0x7fb810150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.745+0000 7fb816bf5640 1 --2- 172.21.15.132:0/2322423546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800004350 0x7fb810154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.745+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 >> 172.21.15.132:0/2322423546 conn(0x7fb81006a500 msgr2=0x7fb810070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.745+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 shutdown_connections 2023-11-18T20:41:24.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:24.745+0000 7fb816bf5640 1 -- 172.21.15.132:0/2322423546 wait complete. 2023-11-18T20:41:24.764 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2023-11-18T20:41:24.713819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249588,"kb_used_data":8452,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725132,"statfs":{"total":773094113280,"available":772838535168,"internally_reserved":0,"allocated":8654848,"data_stored":4485832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002190"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.121054+0000","last_change":"2023-11-18T20:41:20.117635+0000","last_active":"2023-11-18T20:41:20.121054+0000","last_peered":"2023-11-18T20:41:20.121054+0000","last_clean":"2023-11-18T20:41:20.121054+0000","last_became_active":"2023-11-18T20:41:20.117273+0000","last_became_peered":"2023-11-18T20:41:20.117273+0000","last_unstale":"2023-11-18T20:41:20.121054+0000","last_undegraded":"2023-11-18T20:41:20.121054+0000","last_fullsized":"2023-11-18T20:41:20.121054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:06.042909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082153+0000","last_change":"2023-11-18T20:41:20.104801+0000","last_active":"2023-11-18T20:41:21.082153+0000","last_peered":"2023-11-18T20:41:21.082153+0000","last_clean":"2023-11-18T20:41:21.082153+0000","last_became_active":"2023-11-18T20:41:20.103230+0000","last_became_peered":"2023-11-18T20:41:20.103230+0000","last_unstale":"2023-11-18T20:41:21.082153+0000","last_undegraded":"2023-11-18T20:41:21.082153+0000","last_fullsized":"2023-11-18T20:41:21.082153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.122126+0000","last_change":"2023-11-18T20:41:20.116375+0000","last_active":"2023-11-18T20:41:20.122126+0000","last_peered":"2023-11-18T20:41:20.122126+0000","last_clean":"2023-11-18T20:41:20.122126+0000","last_became_active":"2023-11-18T20:41:20.115271+0000","last_became_peered":"2023-11-18T20:41:20.115271+0000","last_unstale":"2023-11-18T20:41:20.122126+0000","last_undegraded":"2023-11-18T20:41:20.122126+0000","last_fullsized":"2023-11-18T20:41:20.122126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:11.096872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886285+0000","last_change":"2023-11-18T20:41:20.115993+0000","last_active":"2023-11-18T20:41:21.886285+0000","last_peered":"2023-11-18T20:41:21.886285+0000","last_clean":"2023-11-18T20:41:21.886285+0000","last_became_active":"2023-11-18T20:41:20.111554+0000","last_became_peered":"2023-11-18T20:41:20.111554+0000","last_unstale":"2023-11-18T20:41:21.886285+0000","last_undegraded":"2023-11-18T20:41:21.886285+0000","last_fullsized":"2023-11-18T20:41:21.886285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:31.666571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081061+0000","last_change":"2023-11-18T20:41:20.104778+0000","last_active":"2023-11-18T20:41:21.081061+0000","last_peered":"2023-11-18T20:41:21.081061+0000","last_clean":"2023-11-18T20:41:21.081061+0000","last_became_active":"2023-11-18T20:41:20.104320+0000","last_became_peered":"2023-11-18T20:41:20.104320+0000","last_unstale":"2023-11-18T20:41:21.081061+0000","last_undegraded":"2023-11-18T20:41:21.081061+0000","last_fullsized":"2023-11-18T20:41:21.081061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:01:59.745970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.115827+0000","last_change":"2023-11-18T20:41:20.107543+0000","last_active":"2023-11-18T20:41:20.115827+0000","last_peered":"2023-11-18T20:41:20.115827+0000","last_clean":"2023-11-18T20:41:20.115827+0000","last_became_active":"2023-11-18T20:41:20.107257+0000","last_became_peered":"2023-11-18T20:41:20.107257+0000","last_unstale":"2023-11-18T20:41:20.115827+0000","last_undegraded":"2023-11-18T20:41:20.115827+0000","last_fullsized":"2023-11-18T20:41:20.115827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:22.171586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081425+0000","last_change":"2023-11-18T20:41:20.109616+0000","last_active":"2023-11-18T20:41:21.081425+0000","last_peered":"2023-11-18T20:41:21.081425+0000","last_clean":"2023-11-18T20:41:21.081425+0000","last_became_active":"2023-11-18T20:41:20.108985+0000","last_became_peered":"2023-11-18T20:41:20.108985+0000","last_unstale":"2023-11-18T20:41:21.081425+0000","last_undegraded":"2023-11-18T20:41:21.081425+0000","last_fullsized":"2023-11-18T20:41:21.081425+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:11:51.719786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.113288+0000","last_change":"2023-11-18T20:41:20.109011+0000","last_active":"2023-11-18T20:41:20.113288+0000","last_peered":"2023-11-18T20:41:20.113288+0000","last_clean":"2023-11-18T20:41:20.113288+0000","last_became_active":"2023-11-18T20:41:20.107749+0000","last_became_peered":"2023-11-18T20:41:20.107749+0000","last_unstale":"2023-11-18T20:41:20.113288+0000","last_undegraded":"2023-11-18T20:41:20.113288+0000","last_fullsized":"2023-11-18T20:41:20.113288+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:37:06.311276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.116646+0000","last_change":"2023-11-18T20:41:20.111675+0000","last_active":"2023-11-18T20:41:20.116646+0000","last_peered":"2023-11-18T20:41:20.116646+0000","last_clean":"2023-11-18T20:41:20.116646+0000","last_became_active":"2023-11-18T20:41:20.111344+0000","last_became_peered":"2023-11-18T20:41:20.111344+0000","last_unstale":"2023-11-18T20:41:20.116646+0000","last_undegraded":"2023-11-18T20:41:20.116646+0000","last_fullsized":"2023-11-18T20:41:20.116646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:21:24.567321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.108539+0000","last_change":"2023-11-18T20:41:20.101257+0000","last_active":"2023-11-18T20:41:20.108539+0000","last_peered":"2023-11-18T20:41:20.108539+0000","last_clean":"2023-11-18T20:41:20.108539+0000","last_became_active":"2023-11-18T20:41:20.100858+0000","last_became_peered":"2023-11-18T20:41:20.100858+0000","last_unstale":"2023-11-18T20:41:20.108539+0000","last_undegraded":"2023-11-18T20:41:20.108539+0000","last_fullsized":"2023-11-18T20:41:20.108539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:52.964496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848639+0000","last_change":"2023-11-18T20:41:20.099422+0000","last_active":"2023-11-18T20:41:21.848639+0000","last_peered":"2023-11-18T20:41:21.848639+0000","last_clean":"2023-11-18T20:41:21.848639+0000","last_became_active":"2023-11-18T20:41:20.099063+0000","last_became_peered":"2023-11-18T20:41:20.099063+0000","last_unstale":"2023-11-18T20:41:21.848639+0000","last_undegraded":"2023-11-18T20:41:21.848639+0000","last_fullsized":"2023-11-18T20:41:21.848639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:39.186938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.110877+0000","last_change":"2023-11-18T20:41:20.098674+0000","last_active":"2023-11-18T20:41:20.110877+0000","last_peered":"2023-11-18T20:41:20.110877+0000","last_clean":"2023-11-18T20:41:20.110877+0000","last_became_active":"2023-11-18T20:41:20.098290+0000","last_became_peered":"2023-11-18T20:41:20.098290+0000","last_unstale":"2023-11-18T20:41:20.110877+0000","last_undegraded":"2023-11-18T20:41:20.110877+0000","last_fullsized":"2023-11-18T20:41:20.110877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:23.768744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081115+0000","last_change":"2023-11-18T20:41:20.104041+0000","last_active":"2023-11-18T20:41:21.081115+0000","last_peered":"2023-11-18T20:41:21.081115+0000","last_clean":"2023-11-18T20:41:21.081115+0000","last_became_active":"2023-11-18T20:41:20.103344+0000","last_became_peered":"2023-11-18T20:41:20.103344+0000","last_unstale":"2023-11-18T20:41:21.081115+0000","last_undegraded":"2023-11-18T20:41:21.081115+0000","last_fullsized":"2023-11-18T20:41:21.081115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:56:39.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082854+0000","last_change":"2023-11-18T20:41:20.112751+0000","last_active":"2023-11-18T20:41:21.082854+0000","last_peered":"2023-11-18T20:41:21.082854+0000","last_clean":"2023-11-18T20:41:21.082854+0000","last_became_active":"2023-11-18T20:41:20.112163+0000","last_became_peered":"2023-11-18T20:41:20.112163+0000","last_unstale":"2023-11-18T20:41:21.082854+0000","last_undegraded":"2023-11-18T20:41:21.082854+0000","last_fullsized":"2023-11-18T20:41:21.082854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:07.262178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081801+0000","last_change":"2023-11-18T20:41:20.113124+0000","last_active":"2023-11-18T20:41:21.081801+0000","last_peered":"2023-11-18T20:41:21.081801+0000","last_clean":"2023-11-18T20:41:21.081801+0000","last_became_active":"2023-11-18T20:41:20.112677+0000","last_became_peered":"2023-11-18T20:41:20.112677+0000","last_unstale":"2023-11-18T20:41:21.081801+0000","last_undegraded":"2023-11-18T20:41:21.081801+0000","last_fullsized":"2023-11-18T20:41:21.081801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:19.506976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.115714+0000","last_change":"2023-11-18T20:41:20.110907+0000","last_active":"2023-11-18T20:41:20.115714+0000","last_peered":"2023-11-18T20:41:20.115714+0000","last_clean":"2023-11-18T20:41:20.115714+0000","last_became_active":"2023-11-18T20:41:20.110466+0000","last_became_peered":"2023-11-18T20:41:20.110466+0000","last_unstale":"2023-11-18T20:41:20.115714+0000","last_undegraded":"2023-11-18T20:41:20.115714+0000","last_fullsized":"2023-11-18T20:41:20.115714+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.113111+0000","last_change":"2023-11-18T20:41:20.104532+0000","last_active":"2023-11-18T20:41:20.113111+0000","last_peered":"2023-11-18T20:41:20.113111+0000","last_clean":"2023-11-18T20:41:20.113111+0000","last_became_active":"2023-11-18T20:41:20.104235+0000","last_became_peered":"2023-11-18T20:41:20.104235+0000","last_unstale":"2023-11-18T20:41:20.113111+0000","last_undegraded":"2023-11-18T20:41:20.113111+0000","last_fullsized":"2023-11-18T20:41:20.113111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:11:51.719786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848479+0000","last_change":"2023-11-18T20:41:20.115645+0000","last_active":"2023-11-18T20:41:21.848479+0000","last_peered":"2023-11-18T20:41:21.848479+0000","last_clean":"2023-11-18T20:41:21.848479+0000","last_became_active":"2023-11-18T20:41:20.115236+0000","last_became_peered":"2023-11-18T20:41:20.115236+0000","last_unstale":"2023-11-18T20:41:21.848479+0000","last_undegraded":"2023-11-18T20:41:21.848479+0000","last_fullsized":"2023-11-18T20:41:21.848479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:38.518205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084554+0000","last_change":"2023-11-18T20:41:20.113295+0000","last_active":"2023-11-18T20:41:21.084554+0000","last_peered":"2023-11-18T20:41:21.084554+0000","last_clean":"2023-11-18T20:41:21.084554+0000","last_became_active":"2023-11-18T20:41:20.112041+0000","last_became_peered":"2023-11-18T20:41:20.112041+0000","last_unstale":"2023-11-18T20:41:21.084554+0000","last_undegraded":"2023-11-18T20:41:21.084554+0000","last_fullsized":"2023-11-18T20:41:21.084554+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:16.917978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083942+0000","last_change":"2023-11-18T20:41:20.116700+0000","last_active":"2023-11-18T20:41:21.083942+0000","last_peered":"2023-11-18T20:41:21.083942+0000","last_clean":"2023-11-18T20:41:21.083942+0000","last_became_active":"2023-11-18T20:41:20.112782+0000","last_became_peered":"2023-11-18T20:41:20.112782+0000","last_unstale":"2023-11-18T20:41:21.083942+0000","last_undegraded":"2023-11-18T20:41:21.083942+0000","last_fullsized":"2023-11-18T20:41:21.083942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:12.856780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.885907+0000","last_change":"2023-11-18T20:41:20.117339+0000","last_active":"2023-11-18T20:41:21.885907+0000","last_peered":"2023-11-18T20:41:21.885907+0000","last_clean":"2023-11-18T20:41:21.885907+0000","last_became_active":"2023-11-18T20:41:20.115272+0000","last_became_peered":"2023-11-18T20:41:20.115272+0000","last_unstale":"2023-11-18T20:41:21.885907+0000","last_undegraded":"2023-11-18T20:41:21.885907+0000","last_fullsized":"2023-11-18T20:41:21.885907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:26.942016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083227+0000","last_change":"2023-11-18T20:41:20.102268+0000","last_active":"2023-11-18T20:41:21.083227+0000","last_peered":"2023-11-18T20:41:21.083227+0000","last_clean":"2023-11-18T20:41:21.083227+0000","last_became_active":"2023-11-18T20:41:20.101961+0000","last_became_peered":"2023-11-18T20:41:20.101961+0000","last_unstale":"2023-11-18T20:41:21.083227+0000","last_undegraded":"2023-11-18T20:41:21.083227+0000","last_fullsized":"2023-11-18T20:41:21.083227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:20.621597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.112976+0000","last_change":"2023-11-18T20:41:20.103507+0000","last_active":"2023-11-18T20:41:20.112976+0000","last_peered":"2023-11-18T20:41:20.112976+0000","last_clean":"2023-11-18T20:41:20.112976+0000","last_became_active":"2023-11-18T20:41:20.103229+0000","last_became_peered":"2023-11-18T20:41:20.103229+0000","last_unstale":"2023-11-18T20:41:20.112976+0000","last_undegraded":"2023-11-18T20:41:20.112976+0000","last_fullsized":"2023-11-18T20:41:20.112976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847859+0000","last_change":"2023-11-18T20:41:20.091675+0000","last_active":"2023-11-18T20:41:21.847859+0000","last_peered":"2023-11-18T20:41:21.847859+0000","last_clean":"2023-11-18T20:41:21.847859+0000","last_became_active":"2023-11-18T20:41:20.090899+0000","last_became_peered":"2023-11-18T20:41:20.090899+0000","last_unstale":"2023-11-18T20:41:21.847859+0000","last_undegraded":"2023-11-18T20:41:21.847859+0000","last_fullsized":"2023-11-18T20:41:21.847859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:48.975726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848597+0000","last_change":"2023-11-18T20:41:20.108207+0000","last_active":"2023-11-18T20:41:21.848597+0000","last_peered":"2023-11-18T20:41:21.848597+0000","last_clean":"2023-11-18T20:41:21.848597+0000","last_became_active":"2023-11-18T20:41:20.107904+0000","last_became_peered":"2023-11-18T20:41:20.107904+0000","last_unstale":"2023-11-18T20:41:21.848597+0000","last_undegraded":"2023-11-18T20:41:21.848597+0000","last_fullsized":"2023-11-18T20:41:21.848597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:51:46.638757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082048+0000","last_change":"2023-11-18T20:41:20.113713+0000","last_active":"2023-11-18T20:41:21.082048+0000","last_peered":"2023-11-18T20:41:21.082048+0000","last_clean":"2023-11-18T20:41:21.082048+0000","last_became_active":"2023-11-18T20:41:20.110227+0000","last_became_peered":"2023-11-18T20:41:20.110227+0000","last_unstale":"2023-11-18T20:41:21.082048+0000","last_undegraded":"2023-11-18T20:41:21.082048+0000","last_fullsized":"2023-11-18T20:41:21.082048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:59.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081577+0000","last_change":"2023-11-18T20:41:20.112885+0000","last_active":"2023-11-18T20:41:21.081577+0000","last_peered":"2023-11-18T20:41:21.081577+0000","last_clean":"2023-11-18T20:41:21.081577+0000","last_became_active":"2023-11-18T20:41:20.112261+0000","last_became_peered":"2023-11-18T20:41:20.112261+0000","last_unstale":"2023-11-18T20:41:21.081577+0000","last_undegraded":"2023-11-18T20:41:21.081577+0000","last_fullsized":"2023-11-18T20:41:21.081577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:41.942790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.116570+0000","last_change":"2023-11-18T20:41:20.111059+0000","last_active":"2023-11-18T20:41:20.116570+0000","last_peered":"2023-11-18T20:41:20.116570+0000","last_clean":"2023-11-18T20:41:20.116570+0000","last_became_active":"2023-11-18T20:41:20.110792+0000","last_became_peered":"2023-11-18T20:41:20.110792+0000","last_unstale":"2023-11-18T20:41:20.116570+0000","last_undegraded":"2023-11-18T20:41:20.116570+0000","last_fullsized":"2023-11-18T20:41:20.116570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:20:54.784422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886112+0000","last_change":"2023-11-18T20:41:20.111828+0000","last_active":"2023-11-18T20:41:21.886112+0000","last_peered":"2023-11-18T20:41:21.886112+0000","last_clean":"2023-11-18T20:41:21.886112+0000","last_became_active":"2023-11-18T20:41:20.110560+0000","last_became_peered":"2023-11-18T20:41:20.110560+0000","last_unstale":"2023-11-18T20:41:21.886112+0000","last_undegraded":"2023-11-18T20:41:21.886112+0000","last_fullsized":"2023-11-18T20:41:21.886112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:00.507967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083339+0000","last_change":"2023-11-18T20:41:20.112929+0000","last_active":"2023-11-18T20:41:21.083339+0000","last_peered":"2023-11-18T20:41:21.083339+0000","last_clean":"2023-11-18T20:41:21.083339+0000","last_became_active":"2023-11-18T20:41:20.112458+0000","last_became_peered":"2023-11-18T20:41:20.112458+0000","last_unstale":"2023-11-18T20:41:21.083339+0000","last_undegraded":"2023-11-18T20:41:21.083339+0000","last_fullsized":"2023-11-18T20:41:21.083339+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:07:39.968375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.117722+0000","last_change":"2023-11-18T20:41:20.112777+0000","last_active":"2023-11-18T20:41:20.117722+0000","last_peered":"2023-11-18T20:41:20.117722+0000","last_clean":"2023-11-18T20:41:20.117722+0000","last_became_active":"2023-11-18T20:41:20.112503+0000","last_became_peered":"2023-11-18T20:41:20.112503+0000","last_unstale":"2023-11-18T20:41:20.117722+0000","last_undegraded":"2023-11-18T20:41:20.117722+0000","last_fullsized":"2023-11-18T20:41:20.117722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:40.732784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.115694+0000","last_change":"2023-11-18T20:41:20.110729+0000","last_active":"2023-11-18T20:41:20.115694+0000","last_peered":"2023-11-18T20:41:20.115694+0000","last_clean":"2023-11-18T20:41:20.115694+0000","last_became_active":"2023-11-18T20:41:20.110065+0000","last_became_peered":"2023-11-18T20:41:20.110065+0000","last_unstale":"2023-11-18T20:41:20.115694+0000","last_undegraded":"2023-11-18T20:41:20.115694+0000","last_fullsized":"2023-11-18T20:41:20.115694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:05.564325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.121896+0000","last_change":"2023-11-18T20:41:20.119005+0000","last_active":"2023-11-18T20:41:20.121896+0000","last_peered":"2023-11-18T20:41:20.121896+0000","last_clean":"2023-11-18T20:41:20.121896+0000","last_became_active":"2023-11-18T20:41:20.117330+0000","last_became_peered":"2023-11-18T20:41:20.117330+0000","last_unstale":"2023-11-18T20:41:20.121896+0000","last_undegraded":"2023-11-18T20:41:20.121896+0000","last_fullsized":"2023-11-18T20:41:20.121896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:40.732784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"75'4","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081843+0000","last_change":"2023-11-18T20:41:19.079310+0000","last_active":"2023-11-18T20:41:21.081843+0000","last_peered":"2023-11-18T20:41:21.081843+0000","last_clean":"2023-11-18T20:41:21.081843+0000","last_became_active":"2023-11-18T20:41:19.078074+0000","last_became_peered":"2023-11-18T20:41:19.078074+0000","last_unstale":"2023-11-18T20:41:21.081843+0000","last_undegraded":"2023-11-18T20:41:21.081843+0000","last_fullsized":"2023-11-18T20:41:21.081843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:52.898832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.121095+0000","last_change":"2023-11-18T20:41:20.117940+0000","last_active":"2023-11-18T20:41:20.121095+0000","last_peered":"2023-11-18T20:41:20.121095+0000","last_clean":"2023-11-18T20:41:20.121095+0000","last_became_active":"2023-11-18T20:41:20.117297+0000","last_became_peered":"2023-11-18T20:41:20.117297+0000","last_unstale":"2023-11-18T20:41:20.121095+0000","last_undegraded":"2023-11-18T20:41:20.121095+0000","last_fullsized":"2023-11-18T20:41:20.121095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:50.585865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.369241+0000","last_change":"2023-11-18T20:41:19.093632+0000","last_active":"2023-11-18T20:41:20.369241+0000","last_peered":"2023-11-18T20:41:20.369241+0000","last_clean":"2023-11-18T20:41:20.369241+0000","last_became_active":"2023-11-18T20:41:19.093359+0000","last_became_peered":"2023-11-18T20:41:19.093359+0000","last_unstale":"2023-11-18T20:41:20.369241+0000","last_undegraded":"2023-11-18T20:41:20.369241+0000","last_fullsized":"2023-11-18T20:41:20.369241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:17.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.112975+0000","last_change":"2023-11-18T20:41:20.106958+0000","last_active":"2023-11-18T20:41:20.112975+0000","last_peered":"2023-11-18T20:41:20.112975+0000","last_clean":"2023-11-18T20:41:20.112975+0000","last_became_active":"2023-11-18T20:41:20.106528+0000","last_became_peered":"2023-11-18T20:41:20.106528+0000","last_unstale":"2023-11-18T20:41:20.112975+0000","last_undegraded":"2023-11-18T20:41:20.112975+0000","last_fullsized":"2023-11-18T20:41:20.112975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:19.506976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848495+0000","last_change":"2023-11-18T20:41:19.081952+0000","last_active":"2023-11-18T20:41:21.848495+0000","last_peered":"2023-11-18T20:41:21.848495+0000","last_clean":"2023-11-18T20:41:21.848495+0000","last_became_active":"2023-11-18T20:41:19.081212+0000","last_became_peered":"2023-11-18T20:41:19.081212+0000","last_unstale":"2023-11-18T20:41:21.848495+0000","last_undegraded":"2023-11-18T20:41:21.848495+0000","last_fullsized":"2023-11-18T20:41:21.848495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:05.630660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.120380+0000","last_change":"2023-11-18T20:41:20.113390+0000","last_active":"2023-11-18T20:41:20.120380+0000","last_peered":"2023-11-18T20:41:20.120380+0000","last_clean":"2023-11-18T20:41:20.120380+0000","last_became_active":"2023-11-18T20:41:20.112062+0000","last_became_peered":"2023-11-18T20:41:20.112062+0000","last_unstale":"2023-11-18T20:41:20.120380+0000","last_undegraded":"2023-11-18T20:41:20.120380+0000","last_fullsized":"2023-11-18T20:41:20.120380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:21:15.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886414+0000","last_change":"2023-11-18T20:41:19.086892+0000","last_active":"2023-11-18T20:41:21.886414+0000","last_peered":"2023-11-18T20:41:21.886414+0000","last_clean":"2023-11-18T20:41:21.886414+0000","last_became_active":"2023-11-18T20:41:19.086603+0000","last_became_peered":"2023-11-18T20:41:19.086603+0000","last_unstale":"2023-11-18T20:41:21.886414+0000","last_undegraded":"2023-11-18T20:41:21.886414+0000","last_fullsized":"2023-11-18T20:41:21.886414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:28.062703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886130+0000","last_change":"2023-11-18T20:41:20.108036+0000","last_active":"2023-11-18T20:41:21.886130+0000","last_peered":"2023-11-18T20:41:21.886130+0000","last_clean":"2023-11-18T20:41:21.886130+0000","last_became_active":"2023-11-18T20:41:20.107708+0000","last_became_peered":"2023-11-18T20:41:20.107708+0000","last_unstale":"2023-11-18T20:41:21.886130+0000","last_undegraded":"2023-11-18T20:41:21.886130+0000","last_fullsized":"2023-11-18T20:41:21.886130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:01.604211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.361331+0000","last_change":"2023-11-18T20:41:19.076738+0000","last_active":"2023-11-18T20:41:20.361331+0000","last_peered":"2023-11-18T20:41:20.361331+0000","last_clean":"2023-11-18T20:41:20.361331+0000","last_became_active":"2023-11-18T20:41:19.076471+0000","last_became_peered":"2023-11-18T20:41:19.076471+0000","last_unstale":"2023-11-18T20:41:20.361331+0000","last_undegraded":"2023-11-18T20:41:20.361331+0000","last_fullsized":"2023-11-18T20:41:20.361331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:10.091348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.115663+0000","last_change":"2023-11-18T20:41:20.109360+0000","last_active":"2023-11-18T20:41:20.115663+0000","last_peered":"2023-11-18T20:41:20.115663+0000","last_clean":"2023-11-18T20:41:20.115663+0000","last_became_active":"2023-11-18T20:41:20.108559+0000","last_became_peered":"2023-11-18T20:41:20.108559+0000","last_unstale":"2023-11-18T20:41:20.115663+0000","last_undegraded":"2023-11-18T20:41:20.115663+0000","last_fullsized":"2023-11-18T20:41:20.115663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:37:06.311276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.370673+0000","last_change":"2023-11-18T20:41:19.089704+0000","last_active":"2023-11-18T20:41:20.370673+0000","last_peered":"2023-11-18T20:41:20.370673+0000","last_clean":"2023-11-18T20:41:20.370673+0000","last_became_active":"2023-11-18T20:41:19.089474+0000","last_became_peered":"2023-11-18T20:41:19.089474+0000","last_unstale":"2023-11-18T20:41:20.370673+0000","last_undegraded":"2023-11-18T20:41:20.370673+0000","last_fullsized":"2023-11-18T20:41:20.370673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:42.131164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.120415+0000","last_change":"2023-11-18T20:41:20.114441+0000","last_active":"2023-11-18T20:41:20.120415+0000","last_peered":"2023-11-18T20:41:20.120415+0000","last_clean":"2023-11-18T20:41:20.120415+0000","last_became_active":"2023-11-18T20:41:20.113948+0000","last_became_peered":"2023-11-18T20:41:20.113948+0000","last_unstale":"2023-11-18T20:41:20.120415+0000","last_undegraded":"2023-11-18T20:41:20.120415+0000","last_fullsized":"2023-11-18T20:41:20.120415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:54.473086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083056+0000","last_change":"2023-11-18T20:41:19.088925+0000","last_active":"2023-11-18T20:41:21.083056+0000","last_peered":"2023-11-18T20:41:21.083056+0000","last_clean":"2023-11-18T20:41:21.083056+0000","last_became_active":"2023-11-18T20:41:19.088630+0000","last_became_peered":"2023-11-18T20:41:19.088630+0000","last_unstale":"2023-11-18T20:41:21.083056+0000","last_undegraded":"2023-11-18T20:41:21.083056+0000","last_fullsized":"2023-11-18T20:41:21.083056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:03:59.906289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082907+0000","last_change":"2023-11-18T20:41:20.110933+0000","last_active":"2023-11-18T20:41:21.082907+0000","last_peered":"2023-11-18T20:41:21.082907+0000","last_clean":"2023-11-18T20:41:21.082907+0000","last_became_active":"2023-11-18T20:41:20.110639+0000","last_became_peered":"2023-11-18T20:41:20.110639+0000","last_unstale":"2023-11-18T20:41:21.082907+0000","last_undegraded":"2023-11-18T20:41:21.082907+0000","last_fullsized":"2023-11-18T20:41:21.082907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:36.140134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082231+0000","last_change":"2023-11-18T20:41:19.089119+0000","last_active":"2023-11-18T20:41:21.082231+0000","last_peered":"2023-11-18T20:41:21.082231+0000","last_clean":"2023-11-18T20:41:21.082231+0000","last_became_active":"2023-11-18T20:41:19.088734+0000","last_became_peered":"2023-11-18T20:41:19.088734+0000","last_unstale":"2023-11-18T20:41:21.082231+0000","last_undegraded":"2023-11-18T20:41:21.082231+0000","last_fullsized":"2023-11-18T20:41:21.082231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:53.467562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084511+0000","last_change":"2023-11-18T20:41:20.109465+0000","last_active":"2023-11-18T20:41:21.084511+0000","last_peered":"2023-11-18T20:41:21.084511+0000","last_clean":"2023-11-18T20:41:21.084511+0000","last_became_active":"2023-11-18T20:41:20.109152+0000","last_became_peered":"2023-11-18T20:41:20.109152+0000","last_unstale":"2023-11-18T20:41:21.084511+0000","last_undegraded":"2023-11-18T20:41:21.084511+0000","last_fullsized":"2023-11-18T20:41:21.084511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:35.394592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.105354+0000","last_change":"2023-11-18T20:41:19.082301+0000","last_active":"2023-11-18T20:41:20.105354+0000","last_peered":"2023-11-18T20:41:20.105354+0000","last_clean":"2023-11-18T20:41:20.105354+0000","last_became_active":"2023-11-18T20:41:19.082037+0000","last_became_peered":"2023-11-18T20:41:19.082037+0000","last_unstale":"2023-11-18T20:41:20.105354+0000","last_undegraded":"2023-11-18T20:41:20.105354+0000","last_fullsized":"2023-11-18T20:41:20.105354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:19.616073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.114257+0000","last_change":"2023-11-18T20:41:20.106833+0000","last_active":"2023-11-18T20:41:20.114257+0000","last_peered":"2023-11-18T20:41:20.114257+0000","last_clean":"2023-11-18T20:41:20.114257+0000","last_became_active":"2023-11-18T20:41:20.105983+0000","last_became_peered":"2023-11-18T20:41:20.105983+0000","last_unstale":"2023-11-18T20:41:20.114257+0000","last_undegraded":"2023-11-18T20:41:20.114257+0000","last_fullsized":"2023-11-18T20:41:20.114257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:00.911813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.082431+0000","last_change":"2023-11-18T20:41:19.080666+0000","last_active":"2023-11-18T20:41:20.082431+0000","last_peered":"2023-11-18T20:41:20.082431+0000","last_clean":"2023-11-18T20:41:20.082431+0000","last_became_active":"2023-11-18T20:41:19.080383+0000","last_became_peered":"2023-11-18T20:41:19.080383+0000","last_unstale":"2023-11-18T20:41:20.082431+0000","last_undegraded":"2023-11-18T20:41:20.082431+0000","last_fullsized":"2023-11-18T20:41:20.082431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:43.180235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847763+0000","last_change":"2023-11-18T20:41:20.108858+0000","last_active":"2023-11-18T20:41:21.847763+0000","last_peered":"2023-11-18T20:41:21.847763+0000","last_clean":"2023-11-18T20:41:21.847763+0000","last_became_active":"2023-11-18T20:41:20.108539+0000","last_became_peered":"2023-11-18T20:41:20.108539+0000","last_unstale":"2023-11-18T20:41:21.847763+0000","last_undegraded":"2023-11-18T20:41:21.847763+0000","last_fullsized":"2023-11-18T20:41:21.847763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:40:48.087061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"75'3","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.370390+0000","last_change":"2023-11-18T20:41:19.084632+0000","last_active":"2023-11-18T20:41:20.370390+0000","last_peered":"2023-11-18T20:41:20.370390+0000","last_clean":"2023-11-18T20:41:20.370390+0000","last_became_active":"2023-11-18T20:41:19.084201+0000","last_became_peered":"2023-11-18T20:41:19.084201+0000","last_unstale":"2023-11-18T20:41:20.370390+0000","last_undegraded":"2023-11-18T20:41:20.370390+0000","last_fullsized":"2023-11-18T20:41:20.370390+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:35.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081516+0000","last_change":"2023-11-18T20:41:20.109082+0000","last_active":"2023-11-18T20:41:21.081516+0000","last_peered":"2023-11-18T20:41:21.081516+0000","last_clean":"2023-11-18T20:41:21.081516+0000","last_became_active":"2023-11-18T20:41:20.108734+0000","last_became_peered":"2023-11-18T20:41:20.108734+0000","last_unstale":"2023-11-18T20:41:21.081516+0000","last_undegraded":"2023-11-18T20:41:21.081516+0000","last_fullsized":"2023-11-18T20:41:21.081516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:26:46.701720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"75'6","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.376661+0000","last_change":"2023-11-18T20:41:19.080895+0000","last_active":"2023-11-18T20:41:20.376661+0000","last_peered":"2023-11-18T20:41:20.376661+0000","last_clean":"2023-11-18T20:41:20.376661+0000","last_became_active":"2023-11-18T20:41:19.080271+0000","last_became_peered":"2023-11-18T20:41:19.080271+0000","last_unstale":"2023-11-18T20:41:20.376661+0000","last_undegraded":"2023-11-18T20:41:20.376661+0000","last_fullsized":"2023-11-18T20:41:20.376661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:21.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847861+0000","last_change":"2023-11-18T20:41:20.097893+0000","last_active":"2023-11-18T20:41:21.847861+0000","last_peered":"2023-11-18T20:41:21.847861+0000","last_clean":"2023-11-18T20:41:21.847861+0000","last_became_active":"2023-11-18T20:41:20.097607+0000","last_became_peered":"2023-11-18T20:41:20.097607+0000","last_unstale":"2023-11-18T20:41:21.847861+0000","last_undegraded":"2023-11-18T20:41:21.847861+0000","last_fullsized":"2023-11-18T20:41:21.847861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:38:34.750195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886251+0000","last_change":"2023-11-18T20:41:19.087665+0000","last_active":"2023-11-18T20:41:21.886251+0000","last_peered":"2023-11-18T20:41:21.886251+0000","last_clean":"2023-11-18T20:41:21.886251+0000","last_became_active":"2023-11-18T20:41:19.087088+0000","last_became_peered":"2023-11-18T20:41:19.087088+0000","last_unstale":"2023-11-18T20:41:21.886251+0000","last_undegraded":"2023-11-18T20:41:21.886251+0000","last_fullsized":"2023-11-18T20:41:21.886251+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:22.770805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.120450+0000","last_change":"2023-11-18T20:41:20.114816+0000","last_active":"2023-11-18T20:41:20.120450+0000","last_peered":"2023-11-18T20:41:20.120450+0000","last_clean":"2023-11-18T20:41:20.120450+0000","last_became_active":"2023-11-18T20:41:20.114497+0000","last_became_peered":"2023-11-18T20:41:20.114497+0000","last_unstale":"2023-11-18T20:41:20.120450+0000","last_undegraded":"2023-11-18T20:41:20.120450+0000","last_fullsized":"2023-11-18T20:41:20.120450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:24:27.236906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081506+0000","last_change":"2023-11-18T20:41:19.087895+0000","last_active":"2023-11-18T20:41:21.081506+0000","last_peered":"2023-11-18T20:41:21.081506+0000","last_clean":"2023-11-18T20:41:21.081506+0000","last_became_active":"2023-11-18T20:41:19.086348+0000","last_became_peered":"2023-11-18T20:41:19.086348+0000","last_unstale":"2023-11-18T20:41:21.081506+0000","last_undegraded":"2023-11-18T20:41:21.081506+0000","last_fullsized":"2023-11-18T20:41:21.081506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:34.389068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082186+0000","last_change":"2023-11-18T20:41:20.107939+0000","last_active":"2023-11-18T20:41:21.082186+0000","last_peered":"2023-11-18T20:41:21.082186+0000","last_clean":"2023-11-18T20:41:21.082186+0000","last_became_active":"2023-11-18T20:41:20.107496+0000","last_became_peered":"2023-11-18T20:41:20.107496+0000","last_unstale":"2023-11-18T20:41:21.082186+0000","last_undegraded":"2023-11-18T20:41:21.082186+0000","last_fullsized":"2023-11-18T20:41:21.082186+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:21:15.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.079806+0000","last_change":"2023-11-18T20:41:19.074899+0000","last_active":"2023-11-18T20:41:20.079806+0000","last_peered":"2023-11-18T20:41:20.079806+0000","last_clean":"2023-11-18T20:41:20.079806+0000","last_became_active":"2023-11-18T20:41:19.074605+0000","last_became_peered":"2023-11-18T20:41:19.074605+0000","last_unstale":"2023-11-18T20:41:20.079806+0000","last_undegraded":"2023-11-18T20:41:20.079806+0000","last_fullsized":"2023-11-18T20:41:20.079806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:27.958410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847471+0000","last_change":"2023-11-18T20:41:20.095956+0000","last_active":"2023-11-18T20:41:21.847471+0000","last_peered":"2023-11-18T20:41:21.847471+0000","last_clean":"2023-11-18T20:41:21.847471+0000","last_became_active":"2023-11-18T20:41:20.095673+0000","last_became_peered":"2023-11-18T20:41:20.095673+0000","last_unstale":"2023-11-18T20:41:21.847471+0000","last_undegraded":"2023-11-18T20:41:21.847471+0000","last_fullsized":"2023-11-18T20:41:21.847471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:37:23.617511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"75'8","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847735+0000","last_change":"2023-11-18T20:41:19.078210+0000","last_active":"2023-11-18T20:41:21.847735+0000","last_peered":"2023-11-18T20:41:21.847735+0000","last_clean":"2023-11-18T20:41:21.847735+0000","last_became_active":"2023-11-18T20:41:19.077797+0000","last_became_peered":"2023-11-18T20:41:19.077797+0000","last_unstale":"2023-11-18T20:41:21.847735+0000","last_undegraded":"2023-11-18T20:41:21.847735+0000","last_fullsized":"2023-11-18T20:41:21.847735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:05:12.665710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.117516+0000","last_change":"2023-11-18T20:41:20.112739+0000","last_active":"2023-11-18T20:41:20.117516+0000","last_peered":"2023-11-18T20:41:20.117516+0000","last_clean":"2023-11-18T20:41:20.117516+0000","last_became_active":"2023-11-18T20:41:20.112440+0000","last_became_peered":"2023-11-18T20:41:20.112440+0000","last_unstale":"2023-11-18T20:41:20.117516+0000","last_undegraded":"2023-11-18T20:41:20.117516+0000","last_fullsized":"2023-11-18T20:41:20.117516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:48.052540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"75'1","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082080+0000","last_change":"2023-11-18T20:41:19.068646+0000","last_active":"2023-11-18T20:41:21.082080+0000","last_peered":"2023-11-18T20:41:21.082080+0000","last_clean":"2023-11-18T20:41:21.082080+0000","last_became_active":"2023-11-18T20:41:19.068382+0000","last_became_peered":"2023-11-18T20:41:19.068382+0000","last_unstale":"2023-11-18T20:41:21.082080+0000","last_undegraded":"2023-11-18T20:41:21.082080+0000","last_fullsized":"2023-11-18T20:41:21.082080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:39.661723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.118408+0000","last_change":"2023-11-18T20:41:20.111835+0000","last_active":"2023-11-18T20:41:20.118408+0000","last_peered":"2023-11-18T20:41:20.118408+0000","last_clean":"2023-11-18T20:41:20.118408+0000","last_became_active":"2023-11-18T20:41:20.111061+0000","last_became_peered":"2023-11-18T20:41:20.111061+0000","last_unstale":"2023-11-18T20:41:20.118408+0000","last_undegraded":"2023-11-18T20:41:20.118408+0000","last_fullsized":"2023-11-18T20:41:20.118408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:58.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084512+0000","last_change":"2023-11-18T20:41:19.092466+0000","last_active":"2023-11-18T20:41:21.084512+0000","last_peered":"2023-11-18T20:41:21.084512+0000","last_clean":"2023-11-18T20:41:21.084512+0000","last_became_active":"2023-11-18T20:41:19.092213+0000","last_became_peered":"2023-11-18T20:41:19.092213+0000","last_unstale":"2023-11-18T20:41:21.084512+0000","last_undegraded":"2023-11-18T20:41:21.084512+0000","last_fullsized":"2023-11-18T20:41:21.084512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:52.157671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.118954+0000","last_change":"2023-11-18T20:41:20.113889+0000","last_active":"2023-11-18T20:41:20.118954+0000","last_peered":"2023-11-18T20:41:20.118954+0000","last_clean":"2023-11-18T20:41:20.118954+0000","last_became_active":"2023-11-18T20:41:20.113461+0000","last_became_peered":"2023-11-18T20:41:20.113461+0000","last_unstale":"2023-11-18T20:41:20.118954+0000","last_undegraded":"2023-11-18T20:41:20.118954+0000","last_fullsized":"2023-11-18T20:41:20.118954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:47.673490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084157+0000","last_change":"2023-11-18T20:41:19.092541+0000","last_active":"2023-11-18T20:41:21.084157+0000","last_peered":"2023-11-18T20:41:21.084157+0000","last_clean":"2023-11-18T20:41:21.084157+0000","last_became_active":"2023-11-18T20:41:19.092232+0000","last_became_peered":"2023-11-18T20:41:19.092232+0000","last_unstale":"2023-11-18T20:41:21.084157+0000","last_undegraded":"2023-11-18T20:41:21.084157+0000","last_fullsized":"2023-11-18T20:41:21.084157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:06.269774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081315+0000","last_change":"2023-11-18T20:41:20.098020+0000","last_active":"2023-11-18T20:41:21.081315+0000","last_peered":"2023-11-18T20:41:21.081315+0000","last_clean":"2023-11-18T20:41:21.081315+0000","last_became_active":"2023-11-18T20:41:20.097510+0000","last_became_peered":"2023-11-18T20:41:20.097510+0000","last_unstale":"2023-11-18T20:41:21.081315+0000","last_undegraded":"2023-11-18T20:41:21.081315+0000","last_fullsized":"2023-11-18T20:41:21.081315+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:47.673490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083500+0000","last_change":"2023-11-18T20:41:19.096453+0000","last_active":"2023-11-18T20:41:21.083500+0000","last_peered":"2023-11-18T20:41:21.083500+0000","last_clean":"2023-11-18T20:41:21.083500+0000","last_became_active":"2023-11-18T20:41:19.096109+0000","last_became_peered":"2023-11-18T20:41:19.096109+0000","last_unstale":"2023-11-18T20:41:21.083500+0000","last_undegraded":"2023-11-18T20:41:21.083500+0000","last_fullsized":"2023-11-18T20:41:21.083500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:08.511122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081418+0000","last_change":"2023-11-18T20:41:20.104587+0000","last_active":"2023-11-18T20:41:21.081418+0000","last_peered":"2023-11-18T20:41:21.081418+0000","last_clean":"2023-11-18T20:41:21.081418+0000","last_became_active":"2023-11-18T20:41:20.103758+0000","last_became_peered":"2023-11-18T20:41:20.103758+0000","last_unstale":"2023-11-18T20:41:21.081418+0000","last_undegraded":"2023-11-18T20:41:21.081418+0000","last_fullsized":"2023-11-18T20:41:21.081418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:55.966402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081673+0000","last_change":"2023-11-18T20:41:19.090852+0000","last_active":"2023-11-18T20:41:21.081673+0000","last_peered":"2023-11-18T20:41:21.081673+0000","last_clean":"2023-11-18T20:41:21.081673+0000","last_became_active":"2023-11-18T20:41:19.090491+0000","last_became_peered":"2023-11-18T20:41:19.090491+0000","last_unstale":"2023-11-18T20:41:21.081673+0000","last_undegraded":"2023-11-18T20:41:21.081673+0000","last_fullsized":"2023-11-18T20:41:21.081673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:15.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.885480+0000","last_change":"2023-11-18T20:41:20.116318+0000","last_active":"2023-11-18T20:41:21.885480+0000","last_peered":"2023-11-18T20:41:21.885480+0000","last_clean":"2023-11-18T20:41:21.885480+0000","last_became_active":"2023-11-18T20:41:20.115292+0000","last_became_peered":"2023-11-18T20:41:20.115292+0000","last_unstale":"2023-11-18T20:41:21.885480+0000","last_undegraded":"2023-11-18T20:41:21.885480+0000","last_fullsized":"2023-11-18T20:41:21.885480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:20.038509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847442+0000","last_change":"2023-11-18T20:41:19.078588+0000","last_active":"2023-11-18T20:41:21.847442+0000","last_peered":"2023-11-18T20:41:21.847442+0000","last_clean":"2023-11-18T20:41:21.847442+0000","last_became_active":"2023-11-18T20:41:19.078208+0000","last_became_peered":"2023-11-18T20:41:19.078208+0000","last_unstale":"2023-11-18T20:41:21.847442+0000","last_undegraded":"2023-11-18T20:41:21.847442+0000","last_fullsized":"2023-11-18T20:41:21.847442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:40:21.584581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.112996+0000","last_change":"2023-11-18T20:41:20.109542+0000","last_active":"2023-11-18T20:41:20.112996+0000","last_peered":"2023-11-18T20:41:20.112996+0000","last_clean":"2023-11-18T20:41:20.112996+0000","last_became_active":"2023-11-18T20:41:20.109219+0000","last_became_peered":"2023-11-18T20:41:20.109219+0000","last_unstale":"2023-11-18T20:41:20.112996+0000","last_undegraded":"2023-11-18T20:41:20.112996+0000","last_fullsized":"2023-11-18T20:41:20.112996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:00.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082401+0000","last_change":"2023-11-18T20:41:19.091570+0000","last_active":"2023-11-18T20:41:21.082401+0000","last_peered":"2023-11-18T20:41:21.082401+0000","last_clean":"2023-11-18T20:41:21.082401+0000","last_became_active":"2023-11-18T20:41:19.091260+0000","last_became_peered":"2023-11-18T20:41:19.091260+0000","last_unstale":"2023-11-18T20:41:21.082401+0000","last_undegraded":"2023-11-18T20:41:21.082401+0000","last_fullsized":"2023-11-18T20:41:21.082401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:49.580341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082219+0000","last_change":"2023-11-18T20:41:20.108499+0000","last_active":"2023-11-18T20:41:21.082219+0000","last_peered":"2023-11-18T20:41:21.082219+0000","last_clean":"2023-11-18T20:41:21.082219+0000","last_became_active":"2023-11-18T20:41:20.108213+0000","last_became_peered":"2023-11-18T20:41:20.108213+0000","last_unstale":"2023-11-18T20:41:21.082219+0000","last_undegraded":"2023-11-18T20:41:21.082219+0000","last_fullsized":"2023-11-18T20:41:21.082219+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:47:05.642911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084676+0000","last_change":"2023-11-18T20:41:19.091596+0000","last_active":"2023-11-18T20:41:21.084676+0000","last_peered":"2023-11-18T20:41:21.084676+0000","last_clean":"2023-11-18T20:41:21.084676+0000","last_became_active":"2023-11-18T20:41:19.091224+0000","last_became_peered":"2023-11-18T20:41:19.091224+0000","last_unstale":"2023-11-18T20:41:21.084676+0000","last_undegraded":"2023-11-18T20:41:21.084676+0000","last_fullsized":"2023-11-18T20:41:21.084676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:20:53.778898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081710+0000","last_change":"2023-11-18T20:41:20.108830+0000","last_active":"2023-11-18T20:41:21.081710+0000","last_peered":"2023-11-18T20:41:21.081710+0000","last_clean":"2023-11-18T20:41:21.081710+0000","last_became_active":"2023-11-18T20:41:20.108492+0000","last_became_peered":"2023-11-18T20:41:20.108492+0000","last_unstale":"2023-11-18T20:41:21.081710+0000","last_undegraded":"2023-11-18T20:41:21.081710+0000","last_fullsized":"2023-11-18T20:41:21.081710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:51:02.700363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848323+0000","last_change":"2023-11-18T20:41:19.084636+0000","last_active":"2023-11-18T20:41:21.848323+0000","last_peered":"2023-11-18T20:41:21.848323+0000","last_clean":"2023-11-18T20:41:21.848323+0000","last_became_active":"2023-11-18T20:41:19.084334+0000","last_became_peered":"2023-11-18T20:41:19.084334+0000","last_unstale":"2023-11-18T20:41:21.848323+0000","last_undegraded":"2023-11-18T20:41:21.848323+0000","last_fullsized":"2023-11-18T20:41:21.848323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:23.195665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081647+0000","last_change":"2023-11-18T20:41:20.106214+0000","last_active":"2023-11-18T20:41:21.081647+0000","last_peered":"2023-11-18T20:41:21.081647+0000","last_clean":"2023-11-18T20:41:21.081647+0000","last_became_active":"2023-11-18T20:41:20.105702+0000","last_became_peered":"2023-11-18T20:41:20.105702+0000","last_unstale":"2023-11-18T20:41:21.081647+0000","last_undegraded":"2023-11-18T20:41:21.081647+0000","last_fullsized":"2023-11-18T20:41:21.081647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:45:15.838878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.091940+0000","last_change":"2023-11-18T20:41:19.078495+0000","last_active":"2023-11-18T20:41:20.091940+0000","last_peered":"2023-11-18T20:41:20.091940+0000","last_clean":"2023-11-18T20:41:20.091940+0000","last_became_active":"2023-11-18T20:41:19.078230+0000","last_became_peered":"2023-11-18T20:41:19.078230+0000","last_unstale":"2023-11-18T20:41:20.091940+0000","last_undegraded":"2023-11-18T20:41:20.091940+0000","last_fullsized":"2023-11-18T20:41:20.091940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:59.396819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.116482+0000","last_change":"2023-11-18T20:41:20.108454+0000","last_active":"2023-11-18T20:41:20.116482+0000","last_peered":"2023-11-18T20:41:20.116482+0000","last_clean":"2023-11-18T20:41:20.116482+0000","last_became_active":"2023-11-18T20:41:20.107160+0000","last_became_peered":"2023-11-18T20:41:20.107160+0000","last_unstale":"2023-11-18T20:41:20.116482+0000","last_undegraded":"2023-11-18T20:41:20.116482+0000","last_fullsized":"2023-11-18T20:41:20.116482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:48.052540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.079843+0000","last_change":"2023-11-18T20:41:19.090705+0000","last_active":"2023-11-18T20:41:20.079843+0000","last_peered":"2023-11-18T20:41:20.079843+0000","last_clean":"2023-11-18T20:41:20.079843+0000","last_became_active":"2023-11-18T20:41:19.090456+0000","last_became_peered":"2023-11-18T20:41:19.090456+0000","last_unstale":"2023-11-18T20:41:20.079843+0000","last_undegraded":"2023-11-18T20:41:20.079843+0000","last_fullsized":"2023-11-18T20:41:20.079843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:59.396819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.120522+0000","last_change":"2023-11-18T20:41:20.114986+0000","last_active":"2023-11-18T20:41:20.120522+0000","last_peered":"2023-11-18T20:41:20.120522+0000","last_clean":"2023-11-18T20:41:20.120522+0000","last_became_active":"2023-11-18T20:41:20.114633+0000","last_became_peered":"2023-11-18T20:41:20.114633+0000","last_unstale":"2023-11-18T20:41:20.120522+0000","last_undegraded":"2023-11-18T20:41:20.120522+0000","last_fullsized":"2023-11-18T20:41:20.120522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:17:01.778514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081935+0000","last_change":"2023-11-18T20:41:19.086338+0000","last_active":"2023-11-18T20:41:21.081935+0000","last_peered":"2023-11-18T20:41:21.081935+0000","last_clean":"2023-11-18T20:41:21.081935+0000","last_became_active":"2023-11-18T20:41:19.086004+0000","last_became_peered":"2023-11-18T20:41:19.086004+0000","last_unstale":"2023-11-18T20:41:21.081935+0000","last_undegraded":"2023-11-18T20:41:21.081935+0000","last_fullsized":"2023-11-18T20:41:21.081935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:59.604368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848032+0000","last_change":"2023-11-18T20:41:20.105693+0000","last_active":"2023-11-18T20:41:21.848032+0000","last_peered":"2023-11-18T20:41:21.848032+0000","last_clean":"2023-11-18T20:41:21.848032+0000","last_became_active":"2023-11-18T20:41:20.104048+0000","last_became_peered":"2023-11-18T20:41:20.104048+0000","last_unstale":"2023-11-18T20:41:21.848032+0000","last_undegraded":"2023-11-18T20:41:21.848032+0000","last_fullsized":"2023-11-18T20:41:21.848032+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:46:07.215841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.081068+0000","last_change":"2023-11-18T20:41:19.084853+0000","last_active":"2023-11-18T20:41:20.081068+0000","last_peered":"2023-11-18T20:41:20.081068+0000","last_clean":"2023-11-18T20:41:20.081068+0000","last_became_active":"2023-11-18T20:41:19.084525+0000","last_became_peered":"2023-11-18T20:41:19.084525+0000","last_unstale":"2023-11-18T20:41:20.081068+0000","last_undegraded":"2023-11-18T20:41:20.081068+0000","last_fullsized":"2023-11-18T20:41:20.081068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:11.638539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.121074+0000","last_change":"2023-11-18T20:41:20.117843+0000","last_active":"2023-11-18T20:41:20.121074+0000","last_peered":"2023-11-18T20:41:20.121074+0000","last_clean":"2023-11-18T20:41:20.121074+0000","last_became_active":"2023-11-18T20:41:20.117505+0000","last_became_peered":"2023-11-18T20:41:20.117505+0000","last_unstale":"2023-11-18T20:41:20.121074+0000","last_undegraded":"2023-11-18T20:41:20.121074+0000","last_fullsized":"2023-11-18T20:41:20.121074+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:09.516646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.103338+0000","last_change":"2023-11-18T20:41:19.078072+0000","last_active":"2023-11-18T20:41:20.103338+0000","last_peered":"2023-11-18T20:41:20.103338+0000","last_clean":"2023-11-18T20:41:20.103338+0000","last_became_active":"2023-11-18T20:41:19.077794+0000","last_became_peered":"2023-11-18T20:41:19.077794+0000","last_unstale":"2023-11-18T20:41:20.103338+0000","last_undegraded":"2023-11-18T20:41:20.103338+0000","last_fullsized":"2023-11-18T20:41:20.103338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:06.256655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.112279+0000","last_change":"2023-11-18T20:41:20.109900+0000","last_active":"2023-11-18T20:41:20.112279+0000","last_peered":"2023-11-18T20:41:20.112279+0000","last_clean":"2023-11-18T20:41:20.112279+0000","last_became_active":"2023-11-18T20:41:20.109595+0000","last_became_peered":"2023-11-18T20:41:20.109595+0000","last_unstale":"2023-11-18T20:41:20.112279+0000","last_undegraded":"2023-11-18T20:41:20.112279+0000","last_fullsized":"2023-11-18T20:41:20.112279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:53:01.177107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.089557+0000","last_change":"2023-11-18T20:41:19.074145+0000","last_active":"2023-11-18T20:41:20.089557+0000","last_peered":"2023-11-18T20:41:20.089557+0000","last_clean":"2023-11-18T20:41:20.089557+0000","last_became_active":"2023-11-18T20:41:19.073833+0000","last_became_peered":"2023-11-18T20:41:19.073833+0000","last_unstale":"2023-11-18T20:41:20.089557+0000","last_undegraded":"2023-11-18T20:41:20.089557+0000","last_fullsized":"2023-11-18T20:41:20.089557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:27.958410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848019+0000","last_change":"2023-11-18T20:41:20.109331+0000","last_active":"2023-11-18T20:41:21.848019+0000","last_peered":"2023-11-18T20:41:21.848019+0000","last_clean":"2023-11-18T20:41:21.848019+0000","last_became_active":"2023-11-18T20:41:20.109021+0000","last_became_peered":"2023-11-18T20:41:20.109021+0000","last_unstale":"2023-11-18T20:41:21.848019+0000","last_undegraded":"2023-11-18T20:41:21.848019+0000","last_fullsized":"2023-11-18T20:41:21.848019+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:06:30.165657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"75'1","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081649+0000","last_change":"2023-11-18T20:41:19.086459+0000","last_active":"2023-11-18T20:41:21.081649+0000","last_peered":"2023-11-18T20:41:21.081649+0000","last_clean":"2023-11-18T20:41:21.081649+0000","last_became_active":"2023-11-18T20:41:19.086134+0000","last_became_peered":"2023-11-18T20:41:19.086134+0000","last_unstale":"2023-11-18T20:41:21.081649+0000","last_undegraded":"2023-11-18T20:41:21.081649+0000","last_fullsized":"2023-11-18T20:41:21.081649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:11:21.092893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-18T20:41:19.074689+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:41:19.074689+0000","last_peered":"2023-11-18T20:41:19.074689+0000","last_clean":"2023-11-18T20:41:19.074689+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:41:19.074689+0000","last_undegraded":"2023-11-18T20:41:19.074689+0000","last_fullsized":"2023-11-18T20:41:19.074689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":414967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.67300000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.079,"15min":1.091},"min":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5049999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.5129999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.1839999999999999,"15min":1.2050000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7829999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.367},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.2350000000000001,"15min":1.254},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.929,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.6379999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.107,"15min":1.1200000000000001},"min":{"1min":0.72899999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.042},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.294,"15min":1.298},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.4399999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.92300000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.532,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.298,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5609999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.524,"15min":1.5700000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.788,"5min":2.601,"15min":2.601},"last":1.284},{"interface":"front","average":{"1min":1.248,"5min":1.48,"15min":1.534},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7250000000000001,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.175}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.581,"15min":1.615},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1560000000000001,"5min":3.02,"15min":3.02},"last":1.24},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.6719999999999999,"15min":1.722},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.04,"5min":3.488,"15min":3.488},"last":1.7330000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.728,"15min":1.766},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.109,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.8300000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.6699999999999999,"15min":1.7270000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.1970000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.115}]}]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":415569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.97899999999999998,"15min":0.96999999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.464,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.26},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4590000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0169999999999999,"15min":1.0049999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.151,"15min":1.1559999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.52,"5min":1.653,"15min":1.653},"last":1.409}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.68200000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6479999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.22,"15min":1.23},"min":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.5549999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3220000000000001,"15min":1.341},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.722},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2030000000000001,"15min":1.1970000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.3720000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3400000000000001,"15min":1.3520000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8959999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.371,"15min":1.373},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9390000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3029999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.3799999999999999,"15min":1.333},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.55,"15min":1.534},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.778}]},{"osd":7,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.575,"15min":1.5649999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":5.0369999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.742,"5min":1.5469999999999999,"15min":1.5169999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":6.1769999999999996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.508}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":1006911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1739999999999999,"15min":1.1899999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.7130000000000001,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.78800000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5780000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.1060000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1000000000000001,"15min":1.123},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.466,"5min":1.897,"15min":1.897},"last":1.621},{"interface":"front","average":{"1min":1.202,"5min":1.278,"15min":1.3240000000000001},"min":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.968,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.054}]},{"osd":2,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.3160000000000001,"15min":1.3799999999999999},"min":{"1min":0.81299999999999994,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5329999999999999,"5min":2.004,"15min":2.004},"last":1.25},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.194,"15min":1.202},"min":{"1min":0.88700000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.3200000000000001,"5min":2.214,"15min":2.214},"last":1.208}]},{"osd":3,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.452,"15min":1.496},"min":{"1min":0.80700000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.1019999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.155},{"interface":"front","average":{"1min":1.353,"5min":1.4370000000000001,"15min":1.454},"min":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.762,"5min":2.024,"15min":2.024},"last":1.6839999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.879,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.657,"5min":2.359,"15min":2.359},"last":1.401},{"interface":"front","average":{"1min":1.518,"5min":1.508,"15min":1.5089999999999999},"min":{"1min":0.76800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.3129999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.615,"15min":1.657},"min":{"1min":1.288,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.907,"5min":2.181,"15min":2.181},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.569,"15min":1.605},"min":{"1min":1.044,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.04,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.7290000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.6459999999999999,"15min":1.6659999999999999},"min":{"1min":1.2170000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.1699999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.778},{"interface":"front","average":{"1min":1.659,"5min":1.724,"15min":1.754},"min":{"1min":1.2569999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.972,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.5700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":414931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0249999999999999,"15min":1.032},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.4390000000000001,"5min":1.635,"15min":1.635},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.091,"15min":1.101},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.6659999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.3}]},{"osd":1,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1100000000000001,"15min":1.0900000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.647,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.419},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.1459999999999999,"15min":1.214},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.367,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.379,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.212,"5min":1.335,"15min":1.393},"min":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.76,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.6799999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1839999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.593,"5min":1.823,"15min":1.823},"last":1.361},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.4159999999999999,"15min":1.484},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.667,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.1579999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.70099999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7490000000000001,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.514,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.464}]},{"osd":6,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.488,"15min":1.5409999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.7030000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.571,"15min":1.605},"min":{"1min":0.77500000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8580000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.5980000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4410000000000001,"15min":1.4650000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.629,"5min":1.929,"15min":1.929},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.6000000000000001,"15min":1.6319999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.74,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.26}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":942080,"data_stored":415571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.55700000000000005,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1990000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84999999999999998,"15min":0.83099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.99299999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94199999999999995,"15min":0.93600000000000005},"min":{"1min":0.45600000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4550000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.86599999999999999,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.4390000000000001,"5min":1.595,"15min":1.595},"last":0.82999999999999996}]},{"osd":2,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.069,"15min":1.0660000000000001},"min":{"1min":0.77500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.581,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.0069999999999999},"min":{"1min":0.69699999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.377,"5min":1.675,"15min":1.675},"last":1.252}]},{"osd":4,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.177,"15min":1.161},"min":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.135},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91800000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.159}]},{"osd":5,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.95099999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6359999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.254,"15min":1.248},"min":{"1min":0.86499999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7529999999999999,"5min":1.901,"15min":1.901},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2789999999999999,"15min":1.2669999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8109999999999999,"5min":1.837,"15min":1.837},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.3300000000000001,"15min":1.3180000000000001},"min":{"1min":1.1220000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.712,"5min":1.962,"15min":1.962},"last":1.373}]},{"osd":7,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3420000000000001,"15min":1.3480000000000001},"min":{"1min":1.0149999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8560000000000001,"5min":1.907,"15min":1.907},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.347,"15min":1.325},"min":{"1min":0.88300000000000001,"5min":0.754,"15min":0.754},"max":{"1min":1.903,"5min":2.081,"15min":2.081},"last":1.5349999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":408597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.177,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.98599999999999999,"15min":1.028},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3899999999999999,"5min":2.081,"15min":2.081},"last":0.59199999999999997}]},{"osd":1,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83899999999999997,"15min":0.85899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.367,"5min":1.919,"15min":1.919},"last":0.5},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83599999999999997,"15min":0.84299999999999997},"min":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.345,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0660000000000001,"15min":1.1000000000000001},"min":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.516,"5min":2.024,"15min":2.024},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.006,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.59999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.637,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.629}]},{"osd":4,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.276,"15min":1.319},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9630000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1819999999999999,"15min":1.2110000000000001},"min":{"1min":0.753,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6799999999999999,"5min":2.254,"15min":2.254},"last":0.80600000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.28,"15min":1.3120000000000001},"min":{"1min":0.94199999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5329999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.264},{"interface":"front","average":{"1min":1.3,"5min":1.393,"15min":1.4379999999999999},"min":{"1min":0.89000000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8779999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.387,"15min":1.4450000000000001},"min":{"1min":0.78100000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.738,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.214,"5min":1.282,"15min":1.319},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.9219999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.86199999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.419,"15min":1.458},"min":{"1min":0.82799999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.0830000000000002,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.377,"15min":1.4279999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.917,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.1299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1515520,"data_stored":999055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2190000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.333},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.873,"15min":0.90900000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.288,"5min":1.524,"15min":1.524},"last":0.74199999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.872,"15min":0.89400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.004,"15min":1.028},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.518,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.052}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.024,"15min":1.054},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.468,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.163},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4099999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.179,"15min":1.2110000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.486,"5min":1.927,"15min":1.927},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.3500000000000001,"15min":1.415},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6879999999999999,"5min":3.343,"15min":3.343},"last":1.2450000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.375,"15min":1.4630000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.671,"5min":3.206,"15min":3.206},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.3340000000000001,"15min":1.383},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5229999999999999,"5min":2.165,"15min":2.165},"last":1.0940000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.4099999999999999,"15min":1.4670000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.766,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4930000000000001,"15min":1.5740000000000001},"min":{"1min":0.84499999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6399999999999999,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.94999999999999996}]},{"osd":7,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.5,"15min":1.5920000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6699999999999999,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1},{"interface":"front","average":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.581,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.276}]}]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":410231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90300000000000002,"15min":0.96199999999999997},"min":{"1min":0.442,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.347,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95899999999999996,"15min":1.006},"min":{"1min":0.625,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.661,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.522}]},{"osd":2,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.383,"15min":1.6060000000000001},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.421,"5min":14.169,"15min":14.169},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":0.93700000000000006},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6080000000000001,"5min":2.173,"15min":2.173},"last":1.0589999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.3680000000000001,"15min":1.5620000000000001},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5609999999999999,"5min":11.629,"15min":11.629},"last":0.876},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.2749999999999999,"15min":1.387},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.524,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.252}]},{"osd":4,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3620000000000001,"15min":1.4239999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6579999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.329},{"interface":"front","average":{"1min":1.202,"5min":1.367,"15min":1.4079999999999999},"min":{"1min":0.81399999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.476,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.625}]},{"osd":5,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.466,"15min":1.5940000000000001},"min":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.71,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.53,"15min":1.647},"min":{"1min":0.80300000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.8600000000000001,"5min":6.202,"15min":6.202},"last":1.2190000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.454,"15min":1.466},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.794,"5min":5.085,"15min":5.085},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.583,"15min":1.7130000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.831,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.486}]},{"osd":7,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.5169999999999999,"15min":1.6220000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9099999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.639,"15min":1.7669999999999999},"min":{"1min":0.81000000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.954,"5min":6.149,"15min":6.149},"last":1.5549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:41:24.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:41:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.019+0000 7f554924b640 1 Processor -- start 2023-11-18T20:41:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.019+0000 7f554924b640 1 -- start start 2023-11-18T20:41:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.020+0000 7f554924b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f554406d0a0 0x7f5544152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.020+0000 7f554924b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55440c3ea0 0x7f55440c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.020+0000 7f554924b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55440c64a0 con 0x7f554414fd30 2023-11-18T20:41:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.020+0000 7f554924b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55440c5c00 con 0x7f554406d0a0 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.020+0000 7f554924b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c5ee0 con 0x7f55440c3ea0 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5542d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f554414fd30 0x7f55440a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39576/0 (socket says 172.21.15.132:39576) 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5542d9d640 1 -- 172.21.15.132:0/2771861323 learned_addr learned my addr 172.21.15.132:0/2771861323 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f554359e640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55440c3ea0 0x7f55440c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f554259c640 1 --2- 172.21.15.132:0/2771861323 >> v2:172.21.15.161:3300/0 conn(0x7f554406d0a0 0x7f5544152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779543056 0 0) 0x7f55440c64a0 con 0x7f554414fd30 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f552c003520 con 0x7f554414fd30 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4137497682 0 0) 0x7f552c003520 con 0x7f554414fd30 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55440c3ea0 msgr2=0x7f55440c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55440c3ea0 0x7f55440c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 >> v2:172.21.15.161:3300/0 conn(0x7f554406d0a0 msgr2=0x7f5544152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 --2- 172.21.15.132:0/2771861323 >> v2:172.21.15.161:3300/0 conn(0x7f554406d0a0 0x7f5544152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440c61c0 con 0x7f554414fd30 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f5534001670 con 0x7f554414fd30 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.021+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 >> v1:172.21.15.132:6789/0 conn(0x7f554414fd30 legacy=0x7f55440a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f5541d9b640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f552c003970 0x7f552c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f5541d9b640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55440c3ea0 0x7f552c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f5541d9b640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f552c004d00 0x7f552c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c5c00 con 0x7f552c004d00 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c5ee0 con 0x7f552c003970 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c00ba60 con 0x7f55440c3ea0 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f554259c640 1 --2- 172.21.15.132:0/2771861323 >> v2:172.21.15.161:3300/0 conn(0x7f554406d0a0 0x7f5544152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:41:25.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f554359e640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f552c004d00 0x7f552c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f5542d9d640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f552c003970 0x7f552c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f554359e640 1 -- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55440c3ea0 msgr2=0x7f552c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:25.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f554359e640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55440c3ea0 0x7f552c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f554359e640 1 -- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f552c003970 msgr2=0x7f552c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:25.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f554359e640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f552c003970 0x7f552c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f554359e640 1 -- 172.21.15.132:0/2771861323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c003520 con 0x7f552c004d00 2023-11-18T20:41:25.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.022+0000 7f5542d9d640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f552c003970 0x7f552c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:25.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.023+0000 7f554359e640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f552c004d00 0x7f552c005180 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f553c007360 tx=0x7f552c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc0e0d458cf71b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:25.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c02cce0 con 0x7f552c004d00 2023-11-18T20:41:25.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c02ce40 con 0x7f552c004d00 2023-11-18T20:41:25.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f5541d9b640 1 -- 172.21.15.132:0/2771861323 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c034660 con 0x7f552c004d00 2023-11-18T20:41:25.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f554924b640 1 -- 172.21.15.132:0/2771861323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f552c004d00 msgr2=0x7f552c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f554924b640 1 --2- 172.21.15.132:0/2771861323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f552c004d00 0x7f552c005180 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f553c007360 tx=0x7f552c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f554359e640 1 -- 172.21.15.132:0/2771861323 reap_dead start 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f554924b640 1 -- 172.21.15.132:0/2771861323 shutdown_connections 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f554924b640 1 -- 172.21.15.132:0/2771861323 >> 172.21.15.132:0/2771861323 conn(0x7f554406a500 msgr2=0x7f554406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f554924b640 1 -- 172.21.15.132:0/2771861323 shutdown_connections 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.024+0000 7f554924b640 1 -- 172.21.15.132:0/2771861323 wait complete. 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.026+0000 7f554924b640 1 Processor -- start 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.026+0000 7f554924b640 1 -- start start 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f554924b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5544149cd0 0x7f5544151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f554924b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554414a7e0 0x7f554414d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f554924b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5544152000 0x7f554414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f554924b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440aa6d0 con 0x7f5544149cd0 2023-11-18T20:41:25.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f554924b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55441555a0 con 0x7f554414a7e0 2023-11-18T20:41:25.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f554924b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554414a2b0 con 0x7f5544152000 2023-11-18T20:41:25.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5544149cd0 0x7f5544151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5544149cd0 0x7f5544151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56310/0 (socket says 172.21.15.132:56310) 2023-11-18T20:41:25.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.027+0000 7f5542d9d640 1 -- 172.21.15.132:0/1527475555 learned_addr learned my addr 172.21.15.132:0/1527475555 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:25.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f554359e640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5544152000 0x7f554414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f554259c640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554414a7e0 0x7f554414d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f5542d9d640 1 -- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5544152000 msgr2=0x7f554414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f5542d9d640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5544152000 0x7f554414d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f5542d9d640 1 -- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554414a7e0 msgr2=0x7f554414d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f5542d9d640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554414a7e0 0x7f554414d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f5542d9d640 1 -- 172.21.15.132:0/1527475555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5544156560 con 0x7f5544149cd0 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f554259c640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554414a7e0 0x7f554414d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f5542d9d640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5544149cd0 0x7f5544151ac0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f553400daf0 tx=0x7f5534007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f552b7fe640 1 -- 172.21.15.132:0/1527475555 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534004cb0 con 0x7f5544149cd0 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f552b7fe640 1 -- 172.21.15.132:0/1527475555 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5534004e10 con 0x7f5544149cd0 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f552b7fe640 1 -- 172.21.15.132:0/1527475555 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340072d0 con 0x7f5544149cd0 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554414a0b0 con 0x7f5544149cd0 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.028+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55441e9f00 con 0x7f5544149cd0 2023-11-18T20:41:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.029+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554414d0e0 con 0x7f5544149cd0 2023-11-18T20:41:25.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.031+0000 7f552b7fe640 1 -- 172.21.15.132:0/1527475555 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5534007430 con 0x7f5544149cd0 2023-11-18T20:41:25.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.032+0000 7f552b7fe640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f553006ae00 0x7f553006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.032+0000 7f552b7fe640 1 -- 172.21.15.132:0/1527475555 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55340890b0 con 0x7f5544149cd0 2023-11-18T20:41:25.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.032+0000 7f554259c640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f553006ae00 0x7f553006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.033+0000 7f554259c640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f553006ae00 0x7f553006d2c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f554414abc0 tx=0x7f5538008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:25.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.036+0000 7f552b7fe640 1 -- 172.21.15.132:0/1527475555 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5534054150 con 0x7f5544149cd0 2023-11-18T20:41:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.222+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5544072980 con 0x7f553006ae00 2023-11-18T20:41:25.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.244+0000 7f552b7fe640 1 -- 172.21.15.132:0/1527475555 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286545 (secure 0 0 0) 0x7f553800d550 con 0x7f553006ae00 2023-11-18T20:41:25.249 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:25.251 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:41:25.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.250+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f553006ae00 msgr2=0x7f553006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.250+0000 7f554924b640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f553006ae00 0x7f553006d2c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f554414abc0 tx=0x7f5538008040 comp rx=0 tx=0).stop 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5544149cd0 msgr2=0x7f5544151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5544149cd0 0x7f5544151ac0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f553400daf0 tx=0x7f5534007e30 comp rx=0 tx=0).stop 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 shutdown_connections 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f553006ae00 0x7f553006d2c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5544152000 0x7f554414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554414a7e0 0x7f554414d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 --2- 172.21.15.132:0/1527475555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5544149cd0 0x7f5544151ac0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 >> 172.21.15.132:0/1527475555 conn(0x7f554406a500 msgr2=0x7f55440713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:25.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 shutdown_connections 2023-11-18T20:41:25.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.251+0000 7f554924b640 1 -- 172.21.15.132:0/1527475555 wait complete. 2023-11-18T20:41:25.271 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2023-11-18T20:41:24.713819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249588,"kb_used_data":8452,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725132,"statfs":{"total":773094113280,"available":772838535168,"internally_reserved":0,"allocated":8654848,"data_stored":4485832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002190"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.121054+0000","last_change":"2023-11-18T20:41:20.117635+0000","last_active":"2023-11-18T20:41:20.121054+0000","last_peered":"2023-11-18T20:41:20.121054+0000","last_clean":"2023-11-18T20:41:20.121054+0000","last_became_active":"2023-11-18T20:41:20.117273+0000","last_became_peered":"2023-11-18T20:41:20.117273+0000","last_unstale":"2023-11-18T20:41:20.121054+0000","last_undegraded":"2023-11-18T20:41:20.121054+0000","last_fullsized":"2023-11-18T20:41:20.121054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:06.042909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082153+0000","last_change":"2023-11-18T20:41:20.104801+0000","last_active":"2023-11-18T20:41:21.082153+0000","last_peered":"2023-11-18T20:41:21.082153+0000","last_clean":"2023-11-18T20:41:21.082153+0000","last_became_active":"2023-11-18T20:41:20.103230+0000","last_became_peered":"2023-11-18T20:41:20.103230+0000","last_unstale":"2023-11-18T20:41:21.082153+0000","last_undegraded":"2023-11-18T20:41:21.082153+0000","last_fullsized":"2023-11-18T20:41:21.082153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.122126+0000","last_change":"2023-11-18T20:41:20.116375+0000","last_active":"2023-11-18T20:41:20.122126+0000","last_peered":"2023-11-18T20:41:20.122126+0000","last_clean":"2023-11-18T20:41:20.122126+0000","last_became_active":"2023-11-18T20:41:20.115271+0000","last_became_peered":"2023-11-18T20:41:20.115271+0000","last_unstale":"2023-11-18T20:41:20.122126+0000","last_undegraded":"2023-11-18T20:41:20.122126+0000","last_fullsized":"2023-11-18T20:41:20.122126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:11.096872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886285+0000","last_change":"2023-11-18T20:41:20.115993+0000","last_active":"2023-11-18T20:41:21.886285+0000","last_peered":"2023-11-18T20:41:21.886285+0000","last_clean":"2023-11-18T20:41:21.886285+0000","last_became_active":"2023-11-18T20:41:20.111554+0000","last_became_peered":"2023-11-18T20:41:20.111554+0000","last_unstale":"2023-11-18T20:41:21.886285+0000","last_undegraded":"2023-11-18T20:41:21.886285+0000","last_fullsized":"2023-11-18T20:41:21.886285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:31.666571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081061+0000","last_change":"2023-11-18T20:41:20.104778+0000","last_active":"2023-11-18T20:41:21.081061+0000","last_peered":"2023-11-18T20:41:21.081061+0000","last_clean":"2023-11-18T20:41:21.081061+0000","last_became_active":"2023-11-18T20:41:20.104320+0000","last_became_peered":"2023-11-18T20:41:20.104320+0000","last_unstale":"2023-11-18T20:41:21.081061+0000","last_undegraded":"2023-11-18T20:41:21.081061+0000","last_fullsized":"2023-11-18T20:41:21.081061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:01:59.745970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.115827+0000","last_change":"2023-11-18T20:41:20.107543+0000","last_active":"2023-11-18T20:41:20.115827+0000","last_peered":"2023-11-18T20:41:20.115827+0000","last_clean":"2023-11-18T20:41:20.115827+0000","last_became_active":"2023-11-18T20:41:20.107257+0000","last_became_peered":"2023-11-18T20:41:20.107257+0000","last_unstale":"2023-11-18T20:41:20.115827+0000","last_undegraded":"2023-11-18T20:41:20.115827+0000","last_fullsized":"2023-11-18T20:41:20.115827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:22.171586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081425+0000","last_change":"2023-11-18T20:41:20.109616+0000","last_active":"2023-11-18T20:41:21.081425+0000","last_peered":"2023-11-18T20:41:21.081425+0000","last_clean":"2023-11-18T20:41:21.081425+0000","last_became_active":"2023-11-18T20:41:20.108985+0000","last_became_peered":"2023-11-18T20:41:20.108985+0000","last_unstale":"2023-11-18T20:41:21.081425+0000","last_undegraded":"2023-11-18T20:41:21.081425+0000","last_fullsized":"2023-11-18T20:41:21.081425+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:11:51.719786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.113288+0000","last_change":"2023-11-18T20:41:20.109011+0000","last_active":"2023-11-18T20:41:20.113288+0000","last_peered":"2023-11-18T20:41:20.113288+0000","last_clean":"2023-11-18T20:41:20.113288+0000","last_became_active":"2023-11-18T20:41:20.107749+0000","last_became_peered":"2023-11-18T20:41:20.107749+0000","last_unstale":"2023-11-18T20:41:20.113288+0000","last_undegraded":"2023-11-18T20:41:20.113288+0000","last_fullsized":"2023-11-18T20:41:20.113288+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:37:06.311276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.116646+0000","last_change":"2023-11-18T20:41:20.111675+0000","last_active":"2023-11-18T20:41:20.116646+0000","last_peered":"2023-11-18T20:41:20.116646+0000","last_clean":"2023-11-18T20:41:20.116646+0000","last_became_active":"2023-11-18T20:41:20.111344+0000","last_became_peered":"2023-11-18T20:41:20.111344+0000","last_unstale":"2023-11-18T20:41:20.116646+0000","last_undegraded":"2023-11-18T20:41:20.116646+0000","last_fullsized":"2023-11-18T20:41:20.116646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:21:24.567321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.108539+0000","last_change":"2023-11-18T20:41:20.101257+0000","last_active":"2023-11-18T20:41:20.108539+0000","last_peered":"2023-11-18T20:41:20.108539+0000","last_clean":"2023-11-18T20:41:20.108539+0000","last_became_active":"2023-11-18T20:41:20.100858+0000","last_became_peered":"2023-11-18T20:41:20.100858+0000","last_unstale":"2023-11-18T20:41:20.108539+0000","last_undegraded":"2023-11-18T20:41:20.108539+0000","last_fullsized":"2023-11-18T20:41:20.108539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:52.964496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848639+0000","last_change":"2023-11-18T20:41:20.099422+0000","last_active":"2023-11-18T20:41:21.848639+0000","last_peered":"2023-11-18T20:41:21.848639+0000","last_clean":"2023-11-18T20:41:21.848639+0000","last_became_active":"2023-11-18T20:41:20.099063+0000","last_became_peered":"2023-11-18T20:41:20.099063+0000","last_unstale":"2023-11-18T20:41:21.848639+0000","last_undegraded":"2023-11-18T20:41:21.848639+0000","last_fullsized":"2023-11-18T20:41:21.848639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:39.186938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.110877+0000","last_change":"2023-11-18T20:41:20.098674+0000","last_active":"2023-11-18T20:41:20.110877+0000","last_peered":"2023-11-18T20:41:20.110877+0000","last_clean":"2023-11-18T20:41:20.110877+0000","last_became_active":"2023-11-18T20:41:20.098290+0000","last_became_peered":"2023-11-18T20:41:20.098290+0000","last_unstale":"2023-11-18T20:41:20.110877+0000","last_undegraded":"2023-11-18T20:41:20.110877+0000","last_fullsized":"2023-11-18T20:41:20.110877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:23.768744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081115+0000","last_change":"2023-11-18T20:41:20.104041+0000","last_active":"2023-11-18T20:41:21.081115+0000","last_peered":"2023-11-18T20:41:21.081115+0000","last_clean":"2023-11-18T20:41:21.081115+0000","last_became_active":"2023-11-18T20:41:20.103344+0000","last_became_peered":"2023-11-18T20:41:20.103344+0000","last_unstale":"2023-11-18T20:41:21.081115+0000","last_undegraded":"2023-11-18T20:41:21.081115+0000","last_fullsized":"2023-11-18T20:41:21.081115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:56:39.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082854+0000","last_change":"2023-11-18T20:41:20.112751+0000","last_active":"2023-11-18T20:41:21.082854+0000","last_peered":"2023-11-18T20:41:21.082854+0000","last_clean":"2023-11-18T20:41:21.082854+0000","last_became_active":"2023-11-18T20:41:20.112163+0000","last_became_peered":"2023-11-18T20:41:20.112163+0000","last_unstale":"2023-11-18T20:41:21.082854+0000","last_undegraded":"2023-11-18T20:41:21.082854+0000","last_fullsized":"2023-11-18T20:41:21.082854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:07.262178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081801+0000","last_change":"2023-11-18T20:41:20.113124+0000","last_active":"2023-11-18T20:41:21.081801+0000","last_peered":"2023-11-18T20:41:21.081801+0000","last_clean":"2023-11-18T20:41:21.081801+0000","last_became_active":"2023-11-18T20:41:20.112677+0000","last_became_peered":"2023-11-18T20:41:20.112677+0000","last_unstale":"2023-11-18T20:41:21.081801+0000","last_undegraded":"2023-11-18T20:41:21.081801+0000","last_fullsized":"2023-11-18T20:41:21.081801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:19.506976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.115714+0000","last_change":"2023-11-18T20:41:20.110907+0000","last_active":"2023-11-18T20:41:20.115714+0000","last_peered":"2023-11-18T20:41:20.115714+0000","last_clean":"2023-11-18T20:41:20.115714+0000","last_became_active":"2023-11-18T20:41:20.110466+0000","last_became_peered":"2023-11-18T20:41:20.110466+0000","last_unstale":"2023-11-18T20:41:20.115714+0000","last_undegraded":"2023-11-18T20:41:20.115714+0000","last_fullsized":"2023-11-18T20:41:20.115714+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.113111+0000","last_change":"2023-11-18T20:41:20.104532+0000","last_active":"2023-11-18T20:41:20.113111+0000","last_peered":"2023-11-18T20:41:20.113111+0000","last_clean":"2023-11-18T20:41:20.113111+0000","last_became_active":"2023-11-18T20:41:20.104235+0000","last_became_peered":"2023-11-18T20:41:20.104235+0000","last_unstale":"2023-11-18T20:41:20.113111+0000","last_undegraded":"2023-11-18T20:41:20.113111+0000","last_fullsized":"2023-11-18T20:41:20.113111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:11:51.719786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848479+0000","last_change":"2023-11-18T20:41:20.115645+0000","last_active":"2023-11-18T20:41:21.848479+0000","last_peered":"2023-11-18T20:41:21.848479+0000","last_clean":"2023-11-18T20:41:21.848479+0000","last_became_active":"2023-11-18T20:41:20.115236+0000","last_became_peered":"2023-11-18T20:41:20.115236+0000","last_unstale":"2023-11-18T20:41:21.848479+0000","last_undegraded":"2023-11-18T20:41:21.848479+0000","last_fullsized":"2023-11-18T20:41:21.848479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:38.518205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084554+0000","last_change":"2023-11-18T20:41:20.113295+0000","last_active":"2023-11-18T20:41:21.084554+0000","last_peered":"2023-11-18T20:41:21.084554+0000","last_clean":"2023-11-18T20:41:21.084554+0000","last_became_active":"2023-11-18T20:41:20.112041+0000","last_became_peered":"2023-11-18T20:41:20.112041+0000","last_unstale":"2023-11-18T20:41:21.084554+0000","last_undegraded":"2023-11-18T20:41:21.084554+0000","last_fullsized":"2023-11-18T20:41:21.084554+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:16.917978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083942+0000","last_change":"2023-11-18T20:41:20.116700+0000","last_active":"2023-11-18T20:41:21.083942+0000","last_peered":"2023-11-18T20:41:21.083942+0000","last_clean":"2023-11-18T20:41:21.083942+0000","last_became_active":"2023-11-18T20:41:20.112782+0000","last_became_peered":"2023-11-18T20:41:20.112782+0000","last_unstale":"2023-11-18T20:41:21.083942+0000","last_undegraded":"2023-11-18T20:41:21.083942+0000","last_fullsized":"2023-11-18T20:41:21.083942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:12.856780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.885907+0000","last_change":"2023-11-18T20:41:20.117339+0000","last_active":"2023-11-18T20:41:21.885907+0000","last_peered":"2023-11-18T20:41:21.885907+0000","last_clean":"2023-11-18T20:41:21.885907+0000","last_became_active":"2023-11-18T20:41:20.115272+0000","last_became_peered":"2023-11-18T20:41:20.115272+0000","last_unstale":"2023-11-18T20:41:21.885907+0000","last_undegraded":"2023-11-18T20:41:21.885907+0000","last_fullsized":"2023-11-18T20:41:21.885907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:26.942016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083227+0000","last_change":"2023-11-18T20:41:20.102268+0000","last_active":"2023-11-18T20:41:21.083227+0000","last_peered":"2023-11-18T20:41:21.083227+0000","last_clean":"2023-11-18T20:41:21.083227+0000","last_became_active":"2023-11-18T20:41:20.101961+0000","last_became_peered":"2023-11-18T20:41:20.101961+0000","last_unstale":"2023-11-18T20:41:21.083227+0000","last_undegraded":"2023-11-18T20:41:21.083227+0000","last_fullsized":"2023-11-18T20:41:21.083227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:20.621597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.112976+0000","last_change":"2023-11-18T20:41:20.103507+0000","last_active":"2023-11-18T20:41:20.112976+0000","last_peered":"2023-11-18T20:41:20.112976+0000","last_clean":"2023-11-18T20:41:20.112976+0000","last_became_active":"2023-11-18T20:41:20.103229+0000","last_became_peered":"2023-11-18T20:41:20.103229+0000","last_unstale":"2023-11-18T20:41:20.112976+0000","last_undegraded":"2023-11-18T20:41:20.112976+0000","last_fullsized":"2023-11-18T20:41:20.112976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847859+0000","last_change":"2023-11-18T20:41:20.091675+0000","last_active":"2023-11-18T20:41:21.847859+0000","last_peered":"2023-11-18T20:41:21.847859+0000","last_clean":"2023-11-18T20:41:21.847859+0000","last_became_active":"2023-11-18T20:41:20.090899+0000","last_became_peered":"2023-11-18T20:41:20.090899+0000","last_unstale":"2023-11-18T20:41:21.847859+0000","last_undegraded":"2023-11-18T20:41:21.847859+0000","last_fullsized":"2023-11-18T20:41:21.847859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:48.975726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848597+0000","last_change":"2023-11-18T20:41:20.108207+0000","last_active":"2023-11-18T20:41:21.848597+0000","last_peered":"2023-11-18T20:41:21.848597+0000","last_clean":"2023-11-18T20:41:21.848597+0000","last_became_active":"2023-11-18T20:41:20.107904+0000","last_became_peered":"2023-11-18T20:41:20.107904+0000","last_unstale":"2023-11-18T20:41:21.848597+0000","last_undegraded":"2023-11-18T20:41:21.848597+0000","last_fullsized":"2023-11-18T20:41:21.848597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:51:46.638757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082048+0000","last_change":"2023-11-18T20:41:20.113713+0000","last_active":"2023-11-18T20:41:21.082048+0000","last_peered":"2023-11-18T20:41:21.082048+0000","last_clean":"2023-11-18T20:41:21.082048+0000","last_became_active":"2023-11-18T20:41:20.110227+0000","last_became_peered":"2023-11-18T20:41:20.110227+0000","last_unstale":"2023-11-18T20:41:21.082048+0000","last_undegraded":"2023-11-18T20:41:21.082048+0000","last_fullsized":"2023-11-18T20:41:21.082048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:59.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081577+0000","last_change":"2023-11-18T20:41:20.112885+0000","last_active":"2023-11-18T20:41:21.081577+0000","last_peered":"2023-11-18T20:41:21.081577+0000","last_clean":"2023-11-18T20:41:21.081577+0000","last_became_active":"2023-11-18T20:41:20.112261+0000","last_became_peered":"2023-11-18T20:41:20.112261+0000","last_unstale":"2023-11-18T20:41:21.081577+0000","last_undegraded":"2023-11-18T20:41:21.081577+0000","last_fullsized":"2023-11-18T20:41:21.081577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:41.942790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.116570+0000","last_change":"2023-11-18T20:41:20.111059+0000","last_active":"2023-11-18T20:41:20.116570+0000","last_peered":"2023-11-18T20:41:20.116570+0000","last_clean":"2023-11-18T20:41:20.116570+0000","last_became_active":"2023-11-18T20:41:20.110792+0000","last_became_peered":"2023-11-18T20:41:20.110792+0000","last_unstale":"2023-11-18T20:41:20.116570+0000","last_undegraded":"2023-11-18T20:41:20.116570+0000","last_fullsized":"2023-11-18T20:41:20.116570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:20:54.784422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886112+0000","last_change":"2023-11-18T20:41:20.111828+0000","last_active":"2023-11-18T20:41:21.886112+0000","last_peered":"2023-11-18T20:41:21.886112+0000","last_clean":"2023-11-18T20:41:21.886112+0000","last_became_active":"2023-11-18T20:41:20.110560+0000","last_became_peered":"2023-11-18T20:41:20.110560+0000","last_unstale":"2023-11-18T20:41:21.886112+0000","last_undegraded":"2023-11-18T20:41:21.886112+0000","last_fullsized":"2023-11-18T20:41:21.886112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:00.507967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083339+0000","last_change":"2023-11-18T20:41:20.112929+0000","last_active":"2023-11-18T20:41:21.083339+0000","last_peered":"2023-11-18T20:41:21.083339+0000","last_clean":"2023-11-18T20:41:21.083339+0000","last_became_active":"2023-11-18T20:41:20.112458+0000","last_became_peered":"2023-11-18T20:41:20.112458+0000","last_unstale":"2023-11-18T20:41:21.083339+0000","last_undegraded":"2023-11-18T20:41:21.083339+0000","last_fullsized":"2023-11-18T20:41:21.083339+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:07:39.968375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.117722+0000","last_change":"2023-11-18T20:41:20.112777+0000","last_active":"2023-11-18T20:41:20.117722+0000","last_peered":"2023-11-18T20:41:20.117722+0000","last_clean":"2023-11-18T20:41:20.117722+0000","last_became_active":"2023-11-18T20:41:20.112503+0000","last_became_peered":"2023-11-18T20:41:20.112503+0000","last_unstale":"2023-11-18T20:41:20.117722+0000","last_undegraded":"2023-11-18T20:41:20.117722+0000","last_fullsized":"2023-11-18T20:41:20.117722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:40.732784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.115694+0000","last_change":"2023-11-18T20:41:20.110729+0000","last_active":"2023-11-18T20:41:20.115694+0000","last_peered":"2023-11-18T20:41:20.115694+0000","last_clean":"2023-11-18T20:41:20.115694+0000","last_became_active":"2023-11-18T20:41:20.110065+0000","last_became_peered":"2023-11-18T20:41:20.110065+0000","last_unstale":"2023-11-18T20:41:20.115694+0000","last_undegraded":"2023-11-18T20:41:20.115694+0000","last_fullsized":"2023-11-18T20:41:20.115694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:05.564325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.121896+0000","last_change":"2023-11-18T20:41:20.119005+0000","last_active":"2023-11-18T20:41:20.121896+0000","last_peered":"2023-11-18T20:41:20.121896+0000","last_clean":"2023-11-18T20:41:20.121896+0000","last_became_active":"2023-11-18T20:41:20.117330+0000","last_became_peered":"2023-11-18T20:41:20.117330+0000","last_unstale":"2023-11-18T20:41:20.121896+0000","last_undegraded":"2023-11-18T20:41:20.121896+0000","last_fullsized":"2023-11-18T20:41:20.121896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:40.732784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"75'4","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081843+0000","last_change":"2023-11-18T20:41:19.079310+0000","last_active":"2023-11-18T20:41:21.081843+0000","last_peered":"2023-11-18T20:41:21.081843+0000","last_clean":"2023-11-18T20:41:21.081843+0000","last_became_active":"2023-11-18T20:41:19.078074+0000","last_became_peered":"2023-11-18T20:41:19.078074+0000","last_unstale":"2023-11-18T20:41:21.081843+0000","last_undegraded":"2023-11-18T20:41:21.081843+0000","last_fullsized":"2023-11-18T20:41:21.081843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:52.898832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.121095+0000","last_change":"2023-11-18T20:41:20.117940+0000","last_active":"2023-11-18T20:41:20.121095+0000","last_peered":"2023-11-18T20:41:20.121095+0000","last_clean":"2023-11-18T20:41:20.121095+0000","last_became_active":"2023-11-18T20:41:20.117297+0000","last_became_peered":"2023-11-18T20:41:20.117297+0000","last_unstale":"2023-11-18T20:41:20.121095+0000","last_undegraded":"2023-11-18T20:41:20.121095+0000","last_fullsized":"2023-11-18T20:41:20.121095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:50.585865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.369241+0000","last_change":"2023-11-18T20:41:19.093632+0000","last_active":"2023-11-18T20:41:20.369241+0000","last_peered":"2023-11-18T20:41:20.369241+0000","last_clean":"2023-11-18T20:41:20.369241+0000","last_became_active":"2023-11-18T20:41:19.093359+0000","last_became_peered":"2023-11-18T20:41:19.093359+0000","last_unstale":"2023-11-18T20:41:20.369241+0000","last_undegraded":"2023-11-18T20:41:20.369241+0000","last_fullsized":"2023-11-18T20:41:20.369241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:17.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.112975+0000","last_change":"2023-11-18T20:41:20.106958+0000","last_active":"2023-11-18T20:41:20.112975+0000","last_peered":"2023-11-18T20:41:20.112975+0000","last_clean":"2023-11-18T20:41:20.112975+0000","last_became_active":"2023-11-18T20:41:20.106528+0000","last_became_peered":"2023-11-18T20:41:20.106528+0000","last_unstale":"2023-11-18T20:41:20.112975+0000","last_undegraded":"2023-11-18T20:41:20.112975+0000","last_fullsized":"2023-11-18T20:41:20.112975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:19.506976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848495+0000","last_change":"2023-11-18T20:41:19.081952+0000","last_active":"2023-11-18T20:41:21.848495+0000","last_peered":"2023-11-18T20:41:21.848495+0000","last_clean":"2023-11-18T20:41:21.848495+0000","last_became_active":"2023-11-18T20:41:19.081212+0000","last_became_peered":"2023-11-18T20:41:19.081212+0000","last_unstale":"2023-11-18T20:41:21.848495+0000","last_undegraded":"2023-11-18T20:41:21.848495+0000","last_fullsized":"2023-11-18T20:41:21.848495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:05.630660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.120380+0000","last_change":"2023-11-18T20:41:20.113390+0000","last_active":"2023-11-18T20:41:20.120380+0000","last_peered":"2023-11-18T20:41:20.120380+0000","last_clean":"2023-11-18T20:41:20.120380+0000","last_became_active":"2023-11-18T20:41:20.112062+0000","last_became_peered":"2023-11-18T20:41:20.112062+0000","last_unstale":"2023-11-18T20:41:20.120380+0000","last_undegraded":"2023-11-18T20:41:20.120380+0000","last_fullsized":"2023-11-18T20:41:20.120380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:21:15.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886414+0000","last_change":"2023-11-18T20:41:19.086892+0000","last_active":"2023-11-18T20:41:21.886414+0000","last_peered":"2023-11-18T20:41:21.886414+0000","last_clean":"2023-11-18T20:41:21.886414+0000","last_became_active":"2023-11-18T20:41:19.086603+0000","last_became_peered":"2023-11-18T20:41:19.086603+0000","last_unstale":"2023-11-18T20:41:21.886414+0000","last_undegraded":"2023-11-18T20:41:21.886414+0000","last_fullsized":"2023-11-18T20:41:21.886414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:28.062703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886130+0000","last_change":"2023-11-18T20:41:20.108036+0000","last_active":"2023-11-18T20:41:21.886130+0000","last_peered":"2023-11-18T20:41:21.886130+0000","last_clean":"2023-11-18T20:41:21.886130+0000","last_became_active":"2023-11-18T20:41:20.107708+0000","last_became_peered":"2023-11-18T20:41:20.107708+0000","last_unstale":"2023-11-18T20:41:21.886130+0000","last_undegraded":"2023-11-18T20:41:21.886130+0000","last_fullsized":"2023-11-18T20:41:21.886130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:01.604211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.361331+0000","last_change":"2023-11-18T20:41:19.076738+0000","last_active":"2023-11-18T20:41:20.361331+0000","last_peered":"2023-11-18T20:41:20.361331+0000","last_clean":"2023-11-18T20:41:20.361331+0000","last_became_active":"2023-11-18T20:41:19.076471+0000","last_became_peered":"2023-11-18T20:41:19.076471+0000","last_unstale":"2023-11-18T20:41:20.361331+0000","last_undegraded":"2023-11-18T20:41:20.361331+0000","last_fullsized":"2023-11-18T20:41:20.361331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:10.091348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.115663+0000","last_change":"2023-11-18T20:41:20.109360+0000","last_active":"2023-11-18T20:41:20.115663+0000","last_peered":"2023-11-18T20:41:20.115663+0000","last_clean":"2023-11-18T20:41:20.115663+0000","last_became_active":"2023-11-18T20:41:20.108559+0000","last_became_peered":"2023-11-18T20:41:20.108559+0000","last_unstale":"2023-11-18T20:41:20.115663+0000","last_undegraded":"2023-11-18T20:41:20.115663+0000","last_fullsized":"2023-11-18T20:41:20.115663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:37:06.311276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.370673+0000","last_change":"2023-11-18T20:41:19.089704+0000","last_active":"2023-11-18T20:41:20.370673+0000","last_peered":"2023-11-18T20:41:20.370673+0000","last_clean":"2023-11-18T20:41:20.370673+0000","last_became_active":"2023-11-18T20:41:19.089474+0000","last_became_peered":"2023-11-18T20:41:19.089474+0000","last_unstale":"2023-11-18T20:41:20.370673+0000","last_undegraded":"2023-11-18T20:41:20.370673+0000","last_fullsized":"2023-11-18T20:41:20.370673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:42.131164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.120415+0000","last_change":"2023-11-18T20:41:20.114441+0000","last_active":"2023-11-18T20:41:20.120415+0000","last_peered":"2023-11-18T20:41:20.120415+0000","last_clean":"2023-11-18T20:41:20.120415+0000","last_became_active":"2023-11-18T20:41:20.113948+0000","last_became_peered":"2023-11-18T20:41:20.113948+0000","last_unstale":"2023-11-18T20:41:20.120415+0000","last_undegraded":"2023-11-18T20:41:20.120415+0000","last_fullsized":"2023-11-18T20:41:20.120415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:54.473086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083056+0000","last_change":"2023-11-18T20:41:19.088925+0000","last_active":"2023-11-18T20:41:21.083056+0000","last_peered":"2023-11-18T20:41:21.083056+0000","last_clean":"2023-11-18T20:41:21.083056+0000","last_became_active":"2023-11-18T20:41:19.088630+0000","last_became_peered":"2023-11-18T20:41:19.088630+0000","last_unstale":"2023-11-18T20:41:21.083056+0000","last_undegraded":"2023-11-18T20:41:21.083056+0000","last_fullsized":"2023-11-18T20:41:21.083056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:03:59.906289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082907+0000","last_change":"2023-11-18T20:41:20.110933+0000","last_active":"2023-11-18T20:41:21.082907+0000","last_peered":"2023-11-18T20:41:21.082907+0000","last_clean":"2023-11-18T20:41:21.082907+0000","last_became_active":"2023-11-18T20:41:20.110639+0000","last_became_peered":"2023-11-18T20:41:20.110639+0000","last_unstale":"2023-11-18T20:41:21.082907+0000","last_undegraded":"2023-11-18T20:41:21.082907+0000","last_fullsized":"2023-11-18T20:41:21.082907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:36.140134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082231+0000","last_change":"2023-11-18T20:41:19.089119+0000","last_active":"2023-11-18T20:41:21.082231+0000","last_peered":"2023-11-18T20:41:21.082231+0000","last_clean":"2023-11-18T20:41:21.082231+0000","last_became_active":"2023-11-18T20:41:19.088734+0000","last_became_peered":"2023-11-18T20:41:19.088734+0000","last_unstale":"2023-11-18T20:41:21.082231+0000","last_undegraded":"2023-11-18T20:41:21.082231+0000","last_fullsized":"2023-11-18T20:41:21.082231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:53.467562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084511+0000","last_change":"2023-11-18T20:41:20.109465+0000","last_active":"2023-11-18T20:41:21.084511+0000","last_peered":"2023-11-18T20:41:21.084511+0000","last_clean":"2023-11-18T20:41:21.084511+0000","last_became_active":"2023-11-18T20:41:20.109152+0000","last_became_peered":"2023-11-18T20:41:20.109152+0000","last_unstale":"2023-11-18T20:41:21.084511+0000","last_undegraded":"2023-11-18T20:41:21.084511+0000","last_fullsized":"2023-11-18T20:41:21.084511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:35.394592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.105354+0000","last_change":"2023-11-18T20:41:19.082301+0000","last_active":"2023-11-18T20:41:20.105354+0000","last_peered":"2023-11-18T20:41:20.105354+0000","last_clean":"2023-11-18T20:41:20.105354+0000","last_became_active":"2023-11-18T20:41:19.082037+0000","last_became_peered":"2023-11-18T20:41:19.082037+0000","last_unstale":"2023-11-18T20:41:20.105354+0000","last_undegraded":"2023-11-18T20:41:20.105354+0000","last_fullsized":"2023-11-18T20:41:20.105354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:19.616073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.114257+0000","last_change":"2023-11-18T20:41:20.106833+0000","last_active":"2023-11-18T20:41:20.114257+0000","last_peered":"2023-11-18T20:41:20.114257+0000","last_clean":"2023-11-18T20:41:20.114257+0000","last_became_active":"2023-11-18T20:41:20.105983+0000","last_became_peered":"2023-11-18T20:41:20.105983+0000","last_unstale":"2023-11-18T20:41:20.114257+0000","last_undegraded":"2023-11-18T20:41:20.114257+0000","last_fullsized":"2023-11-18T20:41:20.114257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:00.911813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.082431+0000","last_change":"2023-11-18T20:41:19.080666+0000","last_active":"2023-11-18T20:41:20.082431+0000","last_peered":"2023-11-18T20:41:20.082431+0000","last_clean":"2023-11-18T20:41:20.082431+0000","last_became_active":"2023-11-18T20:41:19.080383+0000","last_became_peered":"2023-11-18T20:41:19.080383+0000","last_unstale":"2023-11-18T20:41:20.082431+0000","last_undegraded":"2023-11-18T20:41:20.082431+0000","last_fullsized":"2023-11-18T20:41:20.082431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:43.180235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847763+0000","last_change":"2023-11-18T20:41:20.108858+0000","last_active":"2023-11-18T20:41:21.847763+0000","last_peered":"2023-11-18T20:41:21.847763+0000","last_clean":"2023-11-18T20:41:21.847763+0000","last_became_active":"2023-11-18T20:41:20.108539+0000","last_became_peered":"2023-11-18T20:41:20.108539+0000","last_unstale":"2023-11-18T20:41:21.847763+0000","last_undegraded":"2023-11-18T20:41:21.847763+0000","last_fullsized":"2023-11-18T20:41:21.847763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:40:48.087061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"75'3","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.370390+0000","last_change":"2023-11-18T20:41:19.084632+0000","last_active":"2023-11-18T20:41:20.370390+0000","last_peered":"2023-11-18T20:41:20.370390+0000","last_clean":"2023-11-18T20:41:20.370390+0000","last_became_active":"2023-11-18T20:41:19.084201+0000","last_became_peered":"2023-11-18T20:41:19.084201+0000","last_unstale":"2023-11-18T20:41:20.370390+0000","last_undegraded":"2023-11-18T20:41:20.370390+0000","last_fullsized":"2023-11-18T20:41:20.370390+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:35.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081516+0000","last_change":"2023-11-18T20:41:20.109082+0000","last_active":"2023-11-18T20:41:21.081516+0000","last_peered":"2023-11-18T20:41:21.081516+0000","last_clean":"2023-11-18T20:41:21.081516+0000","last_became_active":"2023-11-18T20:41:20.108734+0000","last_became_peered":"2023-11-18T20:41:20.108734+0000","last_unstale":"2023-11-18T20:41:21.081516+0000","last_undegraded":"2023-11-18T20:41:21.081516+0000","last_fullsized":"2023-11-18T20:41:21.081516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:26:46.701720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"75'6","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.376661+0000","last_change":"2023-11-18T20:41:19.080895+0000","last_active":"2023-11-18T20:41:20.376661+0000","last_peered":"2023-11-18T20:41:20.376661+0000","last_clean":"2023-11-18T20:41:20.376661+0000","last_became_active":"2023-11-18T20:41:19.080271+0000","last_became_peered":"2023-11-18T20:41:19.080271+0000","last_unstale":"2023-11-18T20:41:20.376661+0000","last_undegraded":"2023-11-18T20:41:20.376661+0000","last_fullsized":"2023-11-18T20:41:20.376661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:21.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847861+0000","last_change":"2023-11-18T20:41:20.097893+0000","last_active":"2023-11-18T20:41:21.847861+0000","last_peered":"2023-11-18T20:41:21.847861+0000","last_clean":"2023-11-18T20:41:21.847861+0000","last_became_active":"2023-11-18T20:41:20.097607+0000","last_became_peered":"2023-11-18T20:41:20.097607+0000","last_unstale":"2023-11-18T20:41:21.847861+0000","last_undegraded":"2023-11-18T20:41:21.847861+0000","last_fullsized":"2023-11-18T20:41:21.847861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:38:34.750195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.886251+0000","last_change":"2023-11-18T20:41:19.087665+0000","last_active":"2023-11-18T20:41:21.886251+0000","last_peered":"2023-11-18T20:41:21.886251+0000","last_clean":"2023-11-18T20:41:21.886251+0000","last_became_active":"2023-11-18T20:41:19.087088+0000","last_became_peered":"2023-11-18T20:41:19.087088+0000","last_unstale":"2023-11-18T20:41:21.886251+0000","last_undegraded":"2023-11-18T20:41:21.886251+0000","last_fullsized":"2023-11-18T20:41:21.886251+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:22.770805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.120450+0000","last_change":"2023-11-18T20:41:20.114816+0000","last_active":"2023-11-18T20:41:20.120450+0000","last_peered":"2023-11-18T20:41:20.120450+0000","last_clean":"2023-11-18T20:41:20.120450+0000","last_became_active":"2023-11-18T20:41:20.114497+0000","last_became_peered":"2023-11-18T20:41:20.114497+0000","last_unstale":"2023-11-18T20:41:20.120450+0000","last_undegraded":"2023-11-18T20:41:20.120450+0000","last_fullsized":"2023-11-18T20:41:20.120450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:24:27.236906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081506+0000","last_change":"2023-11-18T20:41:19.087895+0000","last_active":"2023-11-18T20:41:21.081506+0000","last_peered":"2023-11-18T20:41:21.081506+0000","last_clean":"2023-11-18T20:41:21.081506+0000","last_became_active":"2023-11-18T20:41:19.086348+0000","last_became_peered":"2023-11-18T20:41:19.086348+0000","last_unstale":"2023-11-18T20:41:21.081506+0000","last_undegraded":"2023-11-18T20:41:21.081506+0000","last_fullsized":"2023-11-18T20:41:21.081506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:34.389068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082186+0000","last_change":"2023-11-18T20:41:20.107939+0000","last_active":"2023-11-18T20:41:21.082186+0000","last_peered":"2023-11-18T20:41:21.082186+0000","last_clean":"2023-11-18T20:41:21.082186+0000","last_became_active":"2023-11-18T20:41:20.107496+0000","last_became_peered":"2023-11-18T20:41:20.107496+0000","last_unstale":"2023-11-18T20:41:21.082186+0000","last_undegraded":"2023-11-18T20:41:21.082186+0000","last_fullsized":"2023-11-18T20:41:21.082186+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:21:15.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.079806+0000","last_change":"2023-11-18T20:41:19.074899+0000","last_active":"2023-11-18T20:41:20.079806+0000","last_peered":"2023-11-18T20:41:20.079806+0000","last_clean":"2023-11-18T20:41:20.079806+0000","last_became_active":"2023-11-18T20:41:19.074605+0000","last_became_peered":"2023-11-18T20:41:19.074605+0000","last_unstale":"2023-11-18T20:41:20.079806+0000","last_undegraded":"2023-11-18T20:41:20.079806+0000","last_fullsized":"2023-11-18T20:41:20.079806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:27.958410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847471+0000","last_change":"2023-11-18T20:41:20.095956+0000","last_active":"2023-11-18T20:41:21.847471+0000","last_peered":"2023-11-18T20:41:21.847471+0000","last_clean":"2023-11-18T20:41:21.847471+0000","last_became_active":"2023-11-18T20:41:20.095673+0000","last_became_peered":"2023-11-18T20:41:20.095673+0000","last_unstale":"2023-11-18T20:41:21.847471+0000","last_undegraded":"2023-11-18T20:41:21.847471+0000","last_fullsized":"2023-11-18T20:41:21.847471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:37:23.617511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"75'8","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847735+0000","last_change":"2023-11-18T20:41:19.078210+0000","last_active":"2023-11-18T20:41:21.847735+0000","last_peered":"2023-11-18T20:41:21.847735+0000","last_clean":"2023-11-18T20:41:21.847735+0000","last_became_active":"2023-11-18T20:41:19.077797+0000","last_became_peered":"2023-11-18T20:41:19.077797+0000","last_unstale":"2023-11-18T20:41:21.847735+0000","last_undegraded":"2023-11-18T20:41:21.847735+0000","last_fullsized":"2023-11-18T20:41:21.847735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:05:12.665710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.117516+0000","last_change":"2023-11-18T20:41:20.112739+0000","last_active":"2023-11-18T20:41:20.117516+0000","last_peered":"2023-11-18T20:41:20.117516+0000","last_clean":"2023-11-18T20:41:20.117516+0000","last_became_active":"2023-11-18T20:41:20.112440+0000","last_became_peered":"2023-11-18T20:41:20.112440+0000","last_unstale":"2023-11-18T20:41:20.117516+0000","last_undegraded":"2023-11-18T20:41:20.117516+0000","last_fullsized":"2023-11-18T20:41:20.117516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:48.052540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"75'1","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082080+0000","last_change":"2023-11-18T20:41:19.068646+0000","last_active":"2023-11-18T20:41:21.082080+0000","last_peered":"2023-11-18T20:41:21.082080+0000","last_clean":"2023-11-18T20:41:21.082080+0000","last_became_active":"2023-11-18T20:41:19.068382+0000","last_became_peered":"2023-11-18T20:41:19.068382+0000","last_unstale":"2023-11-18T20:41:21.082080+0000","last_undegraded":"2023-11-18T20:41:21.082080+0000","last_fullsized":"2023-11-18T20:41:21.082080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:39.661723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.118408+0000","last_change":"2023-11-18T20:41:20.111835+0000","last_active":"2023-11-18T20:41:20.118408+0000","last_peered":"2023-11-18T20:41:20.118408+0000","last_clean":"2023-11-18T20:41:20.118408+0000","last_became_active":"2023-11-18T20:41:20.111061+0000","last_became_peered":"2023-11-18T20:41:20.111061+0000","last_unstale":"2023-11-18T20:41:20.118408+0000","last_undegraded":"2023-11-18T20:41:20.118408+0000","last_fullsized":"2023-11-18T20:41:20.118408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:58.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084512+0000","last_change":"2023-11-18T20:41:19.092466+0000","last_active":"2023-11-18T20:41:21.084512+0000","last_peered":"2023-11-18T20:41:21.084512+0000","last_clean":"2023-11-18T20:41:21.084512+0000","last_became_active":"2023-11-18T20:41:19.092213+0000","last_became_peered":"2023-11-18T20:41:19.092213+0000","last_unstale":"2023-11-18T20:41:21.084512+0000","last_undegraded":"2023-11-18T20:41:21.084512+0000","last_fullsized":"2023-11-18T20:41:21.084512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:52.157671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.118954+0000","last_change":"2023-11-18T20:41:20.113889+0000","last_active":"2023-11-18T20:41:20.118954+0000","last_peered":"2023-11-18T20:41:20.118954+0000","last_clean":"2023-11-18T20:41:20.118954+0000","last_became_active":"2023-11-18T20:41:20.113461+0000","last_became_peered":"2023-11-18T20:41:20.113461+0000","last_unstale":"2023-11-18T20:41:20.118954+0000","last_undegraded":"2023-11-18T20:41:20.118954+0000","last_fullsized":"2023-11-18T20:41:20.118954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:47.673490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084157+0000","last_change":"2023-11-18T20:41:19.092541+0000","last_active":"2023-11-18T20:41:21.084157+0000","last_peered":"2023-11-18T20:41:21.084157+0000","last_clean":"2023-11-18T20:41:21.084157+0000","last_became_active":"2023-11-18T20:41:19.092232+0000","last_became_peered":"2023-11-18T20:41:19.092232+0000","last_unstale":"2023-11-18T20:41:21.084157+0000","last_undegraded":"2023-11-18T20:41:21.084157+0000","last_fullsized":"2023-11-18T20:41:21.084157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:06.269774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081315+0000","last_change":"2023-11-18T20:41:20.098020+0000","last_active":"2023-11-18T20:41:21.081315+0000","last_peered":"2023-11-18T20:41:21.081315+0000","last_clean":"2023-11-18T20:41:21.081315+0000","last_became_active":"2023-11-18T20:41:20.097510+0000","last_became_peered":"2023-11-18T20:41:20.097510+0000","last_unstale":"2023-11-18T20:41:21.081315+0000","last_undegraded":"2023-11-18T20:41:21.081315+0000","last_fullsized":"2023-11-18T20:41:21.081315+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:47.673490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.083500+0000","last_change":"2023-11-18T20:41:19.096453+0000","last_active":"2023-11-18T20:41:21.083500+0000","last_peered":"2023-11-18T20:41:21.083500+0000","last_clean":"2023-11-18T20:41:21.083500+0000","last_became_active":"2023-11-18T20:41:19.096109+0000","last_became_peered":"2023-11-18T20:41:19.096109+0000","last_unstale":"2023-11-18T20:41:21.083500+0000","last_undegraded":"2023-11-18T20:41:21.083500+0000","last_fullsized":"2023-11-18T20:41:21.083500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:08.511122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081418+0000","last_change":"2023-11-18T20:41:20.104587+0000","last_active":"2023-11-18T20:41:21.081418+0000","last_peered":"2023-11-18T20:41:21.081418+0000","last_clean":"2023-11-18T20:41:21.081418+0000","last_became_active":"2023-11-18T20:41:20.103758+0000","last_became_peered":"2023-11-18T20:41:20.103758+0000","last_unstale":"2023-11-18T20:41:21.081418+0000","last_undegraded":"2023-11-18T20:41:21.081418+0000","last_fullsized":"2023-11-18T20:41:21.081418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:55.966402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081673+0000","last_change":"2023-11-18T20:41:19.090852+0000","last_active":"2023-11-18T20:41:21.081673+0000","last_peered":"2023-11-18T20:41:21.081673+0000","last_clean":"2023-11-18T20:41:21.081673+0000","last_became_active":"2023-11-18T20:41:19.090491+0000","last_became_peered":"2023-11-18T20:41:19.090491+0000","last_unstale":"2023-11-18T20:41:21.081673+0000","last_undegraded":"2023-11-18T20:41:21.081673+0000","last_fullsized":"2023-11-18T20:41:21.081673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:15.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.885480+0000","last_change":"2023-11-18T20:41:20.116318+0000","last_active":"2023-11-18T20:41:21.885480+0000","last_peered":"2023-11-18T20:41:21.885480+0000","last_clean":"2023-11-18T20:41:21.885480+0000","last_became_active":"2023-11-18T20:41:20.115292+0000","last_became_peered":"2023-11-18T20:41:20.115292+0000","last_unstale":"2023-11-18T20:41:21.885480+0000","last_undegraded":"2023-11-18T20:41:21.885480+0000","last_fullsized":"2023-11-18T20:41:21.885480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:20.038509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.847442+0000","last_change":"2023-11-18T20:41:19.078588+0000","last_active":"2023-11-18T20:41:21.847442+0000","last_peered":"2023-11-18T20:41:21.847442+0000","last_clean":"2023-11-18T20:41:21.847442+0000","last_became_active":"2023-11-18T20:41:19.078208+0000","last_became_peered":"2023-11-18T20:41:19.078208+0000","last_unstale":"2023-11-18T20:41:21.847442+0000","last_undegraded":"2023-11-18T20:41:21.847442+0000","last_fullsized":"2023-11-18T20:41:21.847442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:40:21.584581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.112996+0000","last_change":"2023-11-18T20:41:20.109542+0000","last_active":"2023-11-18T20:41:20.112996+0000","last_peered":"2023-11-18T20:41:20.112996+0000","last_clean":"2023-11-18T20:41:20.112996+0000","last_became_active":"2023-11-18T20:41:20.109219+0000","last_became_peered":"2023-11-18T20:41:20.109219+0000","last_unstale":"2023-11-18T20:41:20.112996+0000","last_undegraded":"2023-11-18T20:41:20.112996+0000","last_fullsized":"2023-11-18T20:41:20.112996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:00.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082401+0000","last_change":"2023-11-18T20:41:19.091570+0000","last_active":"2023-11-18T20:41:21.082401+0000","last_peered":"2023-11-18T20:41:21.082401+0000","last_clean":"2023-11-18T20:41:21.082401+0000","last_became_active":"2023-11-18T20:41:19.091260+0000","last_became_peered":"2023-11-18T20:41:19.091260+0000","last_unstale":"2023-11-18T20:41:21.082401+0000","last_undegraded":"2023-11-18T20:41:21.082401+0000","last_fullsized":"2023-11-18T20:41:21.082401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:49.580341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.082219+0000","last_change":"2023-11-18T20:41:20.108499+0000","last_active":"2023-11-18T20:41:21.082219+0000","last_peered":"2023-11-18T20:41:21.082219+0000","last_clean":"2023-11-18T20:41:21.082219+0000","last_became_active":"2023-11-18T20:41:20.108213+0000","last_became_peered":"2023-11-18T20:41:20.108213+0000","last_unstale":"2023-11-18T20:41:21.082219+0000","last_undegraded":"2023-11-18T20:41:21.082219+0000","last_fullsized":"2023-11-18T20:41:21.082219+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:47:05.642911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"75'2","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.084676+0000","last_change":"2023-11-18T20:41:19.091596+0000","last_active":"2023-11-18T20:41:21.084676+0000","last_peered":"2023-11-18T20:41:21.084676+0000","last_clean":"2023-11-18T20:41:21.084676+0000","last_became_active":"2023-11-18T20:41:19.091224+0000","last_became_peered":"2023-11-18T20:41:19.091224+0000","last_unstale":"2023-11-18T20:41:21.084676+0000","last_undegraded":"2023-11-18T20:41:21.084676+0000","last_fullsized":"2023-11-18T20:41:21.084676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:20:53.778898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081710+0000","last_change":"2023-11-18T20:41:20.108830+0000","last_active":"2023-11-18T20:41:21.081710+0000","last_peered":"2023-11-18T20:41:21.081710+0000","last_clean":"2023-11-18T20:41:21.081710+0000","last_became_active":"2023-11-18T20:41:20.108492+0000","last_became_peered":"2023-11-18T20:41:20.108492+0000","last_unstale":"2023-11-18T20:41:21.081710+0000","last_undegraded":"2023-11-18T20:41:21.081710+0000","last_fullsized":"2023-11-18T20:41:21.081710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:51:02.700363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848323+0000","last_change":"2023-11-18T20:41:19.084636+0000","last_active":"2023-11-18T20:41:21.848323+0000","last_peered":"2023-11-18T20:41:21.848323+0000","last_clean":"2023-11-18T20:41:21.848323+0000","last_became_active":"2023-11-18T20:41:19.084334+0000","last_became_peered":"2023-11-18T20:41:19.084334+0000","last_unstale":"2023-11-18T20:41:21.848323+0000","last_undegraded":"2023-11-18T20:41:21.848323+0000","last_fullsized":"2023-11-18T20:41:21.848323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:23.195665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081647+0000","last_change":"2023-11-18T20:41:20.106214+0000","last_active":"2023-11-18T20:41:21.081647+0000","last_peered":"2023-11-18T20:41:21.081647+0000","last_clean":"2023-11-18T20:41:21.081647+0000","last_became_active":"2023-11-18T20:41:20.105702+0000","last_became_peered":"2023-11-18T20:41:20.105702+0000","last_unstale":"2023-11-18T20:41:21.081647+0000","last_undegraded":"2023-11-18T20:41:21.081647+0000","last_fullsized":"2023-11-18T20:41:21.081647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:45:15.838878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.091940+0000","last_change":"2023-11-18T20:41:19.078495+0000","last_active":"2023-11-18T20:41:20.091940+0000","last_peered":"2023-11-18T20:41:20.091940+0000","last_clean":"2023-11-18T20:41:20.091940+0000","last_became_active":"2023-11-18T20:41:19.078230+0000","last_became_peered":"2023-11-18T20:41:19.078230+0000","last_unstale":"2023-11-18T20:41:20.091940+0000","last_undegraded":"2023-11-18T20:41:20.091940+0000","last_fullsized":"2023-11-18T20:41:20.091940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:59.396819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.116482+0000","last_change":"2023-11-18T20:41:20.108454+0000","last_active":"2023-11-18T20:41:20.116482+0000","last_peered":"2023-11-18T20:41:20.116482+0000","last_clean":"2023-11-18T20:41:20.116482+0000","last_became_active":"2023-11-18T20:41:20.107160+0000","last_became_peered":"2023-11-18T20:41:20.107160+0000","last_unstale":"2023-11-18T20:41:20.116482+0000","last_undegraded":"2023-11-18T20:41:20.116482+0000","last_fullsized":"2023-11-18T20:41:20.116482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:21:48.052540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.079843+0000","last_change":"2023-11-18T20:41:19.090705+0000","last_active":"2023-11-18T20:41:20.079843+0000","last_peered":"2023-11-18T20:41:20.079843+0000","last_clean":"2023-11-18T20:41:20.079843+0000","last_became_active":"2023-11-18T20:41:19.090456+0000","last_became_peered":"2023-11-18T20:41:19.090456+0000","last_unstale":"2023-11-18T20:41:20.079843+0000","last_undegraded":"2023-11-18T20:41:20.079843+0000","last_fullsized":"2023-11-18T20:41:20.079843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:59.396819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.120522+0000","last_change":"2023-11-18T20:41:20.114986+0000","last_active":"2023-11-18T20:41:20.120522+0000","last_peered":"2023-11-18T20:41:20.120522+0000","last_clean":"2023-11-18T20:41:20.120522+0000","last_became_active":"2023-11-18T20:41:20.114633+0000","last_became_peered":"2023-11-18T20:41:20.114633+0000","last_unstale":"2023-11-18T20:41:20.120522+0000","last_undegraded":"2023-11-18T20:41:20.120522+0000","last_fullsized":"2023-11-18T20:41:20.120522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:17:01.778514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081935+0000","last_change":"2023-11-18T20:41:19.086338+0000","last_active":"2023-11-18T20:41:21.081935+0000","last_peered":"2023-11-18T20:41:21.081935+0000","last_clean":"2023-11-18T20:41:21.081935+0000","last_became_active":"2023-11-18T20:41:19.086004+0000","last_became_peered":"2023-11-18T20:41:19.086004+0000","last_unstale":"2023-11-18T20:41:21.081935+0000","last_undegraded":"2023-11-18T20:41:21.081935+0000","last_fullsized":"2023-11-18T20:41:21.081935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:59.604368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848032+0000","last_change":"2023-11-18T20:41:20.105693+0000","last_active":"2023-11-18T20:41:21.848032+0000","last_peered":"2023-11-18T20:41:21.848032+0000","last_clean":"2023-11-18T20:41:21.848032+0000","last_became_active":"2023-11-18T20:41:20.104048+0000","last_became_peered":"2023-11-18T20:41:20.104048+0000","last_unstale":"2023-11-18T20:41:21.848032+0000","last_undegraded":"2023-11-18T20:41:21.848032+0000","last_fullsized":"2023-11-18T20:41:21.848032+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:46:07.215841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.081068+0000","last_change":"2023-11-18T20:41:19.084853+0000","last_active":"2023-11-18T20:41:20.081068+0000","last_peered":"2023-11-18T20:41:20.081068+0000","last_clean":"2023-11-18T20:41:20.081068+0000","last_became_active":"2023-11-18T20:41:19.084525+0000","last_became_peered":"2023-11-18T20:41:19.084525+0000","last_unstale":"2023-11-18T20:41:20.081068+0000","last_undegraded":"2023-11-18T20:41:20.081068+0000","last_fullsized":"2023-11-18T20:41:20.081068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:11.638539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.121074+0000","last_change":"2023-11-18T20:41:20.117843+0000","last_active":"2023-11-18T20:41:20.121074+0000","last_peered":"2023-11-18T20:41:20.121074+0000","last_clean":"2023-11-18T20:41:20.121074+0000","last_became_active":"2023-11-18T20:41:20.117505+0000","last_became_peered":"2023-11-18T20:41:20.117505+0000","last_unstale":"2023-11-18T20:41:20.121074+0000","last_undegraded":"2023-11-18T20:41:20.121074+0000","last_fullsized":"2023-11-18T20:41:20.121074+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:09.516646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.103338+0000","last_change":"2023-11-18T20:41:19.078072+0000","last_active":"2023-11-18T20:41:20.103338+0000","last_peered":"2023-11-18T20:41:20.103338+0000","last_clean":"2023-11-18T20:41:20.103338+0000","last_became_active":"2023-11-18T20:41:19.077794+0000","last_became_peered":"2023-11-18T20:41:19.077794+0000","last_unstale":"2023-11-18T20:41:20.103338+0000","last_undegraded":"2023-11-18T20:41:20.103338+0000","last_fullsized":"2023-11-18T20:41:20.103338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:06.256655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.112279+0000","last_change":"2023-11-18T20:41:20.109900+0000","last_active":"2023-11-18T20:41:20.112279+0000","last_peered":"2023-11-18T20:41:20.112279+0000","last_clean":"2023-11-18T20:41:20.112279+0000","last_became_active":"2023-11-18T20:41:20.109595+0000","last_became_peered":"2023-11-18T20:41:20.109595+0000","last_unstale":"2023-11-18T20:41:20.112279+0000","last_undegraded":"2023-11-18T20:41:20.112279+0000","last_fullsized":"2023-11-18T20:41:20.112279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:53:01.177107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-18T20:41:20.089557+0000","last_change":"2023-11-18T20:41:19.074145+0000","last_active":"2023-11-18T20:41:20.089557+0000","last_peered":"2023-11-18T20:41:20.089557+0000","last_clean":"2023-11-18T20:41:20.089557+0000","last_became_active":"2023-11-18T20:41:19.073833+0000","last_became_peered":"2023-11-18T20:41:19.073833+0000","last_unstale":"2023-11-18T20:41:20.089557+0000","last_undegraded":"2023-11-18T20:41:20.089557+0000","last_fullsized":"2023-11-18T20:41:20.089557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:27.958410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.848019+0000","last_change":"2023-11-18T20:41:20.109331+0000","last_active":"2023-11-18T20:41:21.848019+0000","last_peered":"2023-11-18T20:41:21.848019+0000","last_clean":"2023-11-18T20:41:21.848019+0000","last_became_active":"2023-11-18T20:41:20.109021+0000","last_became_peered":"2023-11-18T20:41:20.109021+0000","last_unstale":"2023-11-18T20:41:21.848019+0000","last_undegraded":"2023-11-18T20:41:21.848019+0000","last_fullsized":"2023-11-18T20:41:21.848019+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:06:30.165657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"75'1","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-11-18T20:41:21.081649+0000","last_change":"2023-11-18T20:41:19.086459+0000","last_active":"2023-11-18T20:41:21.081649+0000","last_peered":"2023-11-18T20:41:21.081649+0000","last_clean":"2023-11-18T20:41:21.081649+0000","last_became_active":"2023-11-18T20:41:19.086134+0000","last_became_peered":"2023-11-18T20:41:19.086134+0000","last_unstale":"2023-11-18T20:41:21.081649+0000","last_undegraded":"2023-11-18T20:41:21.081649+0000","last_fullsized":"2023-11-18T20:41:21.081649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:11:21.092893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-18T20:41:19.074689+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:41:19.074689+0000","last_peered":"2023-11-18T20:41:19.074689+0000","last_clean":"2023-11-18T20:41:19.074689+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:41:19.074689+0000","last_undegraded":"2023-11-18T20:41:19.074689+0000","last_fullsized":"2023-11-18T20:41:19.074689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":414967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.67300000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.079,"15min":1.091},"min":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5049999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.5129999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.1839999999999999,"15min":1.2050000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7829999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.367},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.2350000000000001,"15min":1.254},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.929,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.6379999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.107,"15min":1.1200000000000001},"min":{"1min":0.72899999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.042},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.294,"15min":1.298},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.4399999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.92300000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.532,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.298,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5609999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.524,"15min":1.5700000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.788,"5min":2.601,"15min":2.601},"last":1.284},{"interface":"front","average":{"1min":1.248,"5min":1.48,"15min":1.534},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7250000000000001,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.175}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.581,"15min":1.615},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1560000000000001,"5min":3.02,"15min":3.02},"last":1.24},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.6719999999999999,"15min":1.722},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.04,"5min":3.488,"15min":3.488},"last":1.7330000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.728,"15min":1.766},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.109,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.8300000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.6699999999999999,"15min":1.7270000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.1970000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.115}]}]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":415569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.97899999999999998,"15min":0.96999999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.464,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.26},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4590000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0169999999999999,"15min":1.0049999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.151,"15min":1.1559999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.52,"5min":1.653,"15min":1.653},"last":1.409}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.68200000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6479999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.22,"15min":1.23},"min":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.5549999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3220000000000001,"15min":1.341},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.722},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2030000000000001,"15min":1.1970000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.3720000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3400000000000001,"15min":1.3520000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8959999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.371,"15min":1.373},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9390000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3029999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.3799999999999999,"15min":1.333},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.55,"15min":1.534},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.778}]},{"osd":7,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.575,"15min":1.5649999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":5.0369999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.742,"5min":1.5469999999999999,"15min":1.5169999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":6.1769999999999996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.508}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":1006911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1739999999999999,"15min":1.1899999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.7130000000000001,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.78800000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5780000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.1060000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1000000000000001,"15min":1.123},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.466,"5min":1.897,"15min":1.897},"last":1.621},{"interface":"front","average":{"1min":1.202,"5min":1.278,"15min":1.3240000000000001},"min":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.968,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.054}]},{"osd":2,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.3160000000000001,"15min":1.3799999999999999},"min":{"1min":0.81299999999999994,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5329999999999999,"5min":2.004,"15min":2.004},"last":1.25},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.194,"15min":1.202},"min":{"1min":0.88700000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.3200000000000001,"5min":2.214,"15min":2.214},"last":1.208}]},{"osd":3,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.452,"15min":1.496},"min":{"1min":0.80700000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.1019999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.155},{"interface":"front","average":{"1min":1.353,"5min":1.4370000000000001,"15min":1.454},"min":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.762,"5min":2.024,"15min":2.024},"last":1.6839999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.879,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.657,"5min":2.359,"15min":2.359},"last":1.401},{"interface":"front","average":{"1min":1.518,"5min":1.508,"15min":1.5089999999999999},"min":{"1min":0.76800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.3129999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.615,"15min":1.657},"min":{"1min":1.288,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.907,"5min":2.181,"15min":2.181},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.569,"15min":1.605},"min":{"1min":1.044,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.04,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.7290000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.6459999999999999,"15min":1.6659999999999999},"min":{"1min":1.2170000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.1699999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.778},{"interface":"front","average":{"1min":1.659,"5min":1.724,"15min":1.754},"min":{"1min":1.2569999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.972,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.5700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":414931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0249999999999999,"15min":1.032},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.4390000000000001,"5min":1.635,"15min":1.635},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.091,"15min":1.101},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.6659999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.3}]},{"osd":1,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1100000000000001,"15min":1.0900000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.647,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.419},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.1459999999999999,"15min":1.214},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.367,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.379,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.212,"5min":1.335,"15min":1.393},"min":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.76,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.6799999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1839999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.593,"5min":1.823,"15min":1.823},"last":1.361},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.4159999999999999,"15min":1.484},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.667,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.1579999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.70099999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7490000000000001,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.514,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.464}]},{"osd":6,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.488,"15min":1.5409999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.7030000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.571,"15min":1.605},"min":{"1min":0.77500000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8580000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.5980000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4410000000000001,"15min":1.4650000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.629,"5min":1.929,"15min":1.929},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.6000000000000001,"15min":1.6319999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.74,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.26}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":942080,"data_stored":415571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.55700000000000005,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1990000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84999999999999998,"15min":0.83099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.99299999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94199999999999995,"15min":0.93600000000000005},"min":{"1min":0.45600000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4550000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.86599999999999999,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.4390000000000001,"5min":1.595,"15min":1.595},"last":0.82999999999999996}]},{"osd":2,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.069,"15min":1.0660000000000001},"min":{"1min":0.77500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.581,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.0069999999999999},"min":{"1min":0.69699999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.377,"5min":1.675,"15min":1.675},"last":1.252}]},{"osd":4,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.177,"15min":1.161},"min":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.135},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91800000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.159}]},{"osd":5,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.95099999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6359999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.254,"15min":1.248},"min":{"1min":0.86499999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7529999999999999,"5min":1.901,"15min":1.901},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2789999999999999,"15min":1.2669999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8109999999999999,"5min":1.837,"15min":1.837},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.3300000000000001,"15min":1.3180000000000001},"min":{"1min":1.1220000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.712,"5min":1.962,"15min":1.962},"last":1.373}]},{"osd":7,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3420000000000001,"15min":1.3480000000000001},"min":{"1min":1.0149999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8560000000000001,"5min":1.907,"15min":1.907},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.347,"15min":1.325},"min":{"1min":0.88300000000000001,"5min":0.754,"15min":0.754},"max":{"1min":1.903,"5min":2.081,"15min":2.081},"last":1.5349999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":408597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.177,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.98599999999999999,"15min":1.028},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3899999999999999,"5min":2.081,"15min":2.081},"last":0.59199999999999997}]},{"osd":1,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83899999999999997,"15min":0.85899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.367,"5min":1.919,"15min":1.919},"last":0.5},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83599999999999997,"15min":0.84299999999999997},"min":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.345,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0660000000000001,"15min":1.1000000000000001},"min":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.516,"5min":2.024,"15min":2.024},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.006,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.59999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.637,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.629}]},{"osd":4,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.276,"15min":1.319},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9630000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1819999999999999,"15min":1.2110000000000001},"min":{"1min":0.753,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6799999999999999,"5min":2.254,"15min":2.254},"last":0.80600000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.28,"15min":1.3120000000000001},"min":{"1min":0.94199999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5329999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.264},{"interface":"front","average":{"1min":1.3,"5min":1.393,"15min":1.4379999999999999},"min":{"1min":0.89000000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8779999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.387,"15min":1.4450000000000001},"min":{"1min":0.78100000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.738,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.214,"5min":1.282,"15min":1.319},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.9219999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.86199999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.419,"15min":1.458},"min":{"1min":0.82799999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.0830000000000002,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.377,"15min":1.4279999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.917,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.1299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1515520,"data_stored":999055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2190000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.333},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.873,"15min":0.90900000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.288,"5min":1.524,"15min":1.524},"last":0.74199999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.872,"15min":0.89400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.004,"15min":1.028},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.518,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.052}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.024,"15min":1.054},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.468,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.163},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4099999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.179,"15min":1.2110000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.486,"5min":1.927,"15min":1.927},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.3500000000000001,"15min":1.415},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6879999999999999,"5min":3.343,"15min":3.343},"last":1.2450000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.375,"15min":1.4630000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.671,"5min":3.206,"15min":3.206},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.3340000000000001,"15min":1.383},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5229999999999999,"5min":2.165,"15min":2.165},"last":1.0940000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.4099999999999999,"15min":1.4670000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.766,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4930000000000001,"15min":1.5740000000000001},"min":{"1min":0.84499999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6399999999999999,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.94999999999999996}]},{"osd":7,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.5,"15min":1.5920000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6699999999999999,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1},{"interface":"front","average":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.581,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.276}]}]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":410231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90300000000000002,"15min":0.96199999999999997},"min":{"1min":0.442,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.347,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95899999999999996,"15min":1.006},"min":{"1min":0.625,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.661,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.522}]},{"osd":2,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.383,"15min":1.6060000000000001},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.421,"5min":14.169,"15min":14.169},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":0.93700000000000006},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6080000000000001,"5min":2.173,"15min":2.173},"last":1.0589999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.3680000000000001,"15min":1.5620000000000001},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5609999999999999,"5min":11.629,"15min":11.629},"last":0.876},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.2749999999999999,"15min":1.387},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.524,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.252}]},{"osd":4,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3620000000000001,"15min":1.4239999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6579999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.329},{"interface":"front","average":{"1min":1.202,"5min":1.367,"15min":1.4079999999999999},"min":{"1min":0.81399999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.476,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.625}]},{"osd":5,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.466,"15min":1.5940000000000001},"min":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.71,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.53,"15min":1.647},"min":{"1min":0.80300000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.8600000000000001,"5min":6.202,"15min":6.202},"last":1.2190000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.454,"15min":1.466},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.794,"5min":5.085,"15min":5.085},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.583,"15min":1.7130000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.831,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.486}]},{"osd":7,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.5169999999999999,"15min":1.6220000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9099999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.639,"15min":1.7669999999999999},"min":{"1min":0.81000000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.954,"5min":6.149,"15min":6.149},"last":1.5549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:41:25.276 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T20:41:25.276 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-18T20:41:25.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.540+0000 7f3a01b33640 1 Processor -- start 2023-11-18T20:41:25.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.540+0000 7f3a01b33640 1 -- start start 2023-11-18T20:41:25.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.542+0000 7f3a01b33640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc0a9b40 0x7f39fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.542+0000 7f3a01b33640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f39fc0c1500 0x7f39fc0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.542+0000 7f3a01b33640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39fc0c06c0 con 0x7f39fc155490 2023-11-18T20:41:25.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.542+0000 7f3a01b33640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39fc0a5820 con 0x7f39fc0c1500 2023-11-18T20:41:25.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.542+0000 7f3a01b33640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc0c1020 con 0x7f39fc0a9b40 2023-11-18T20:41:25.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.542+0000 7f39f2ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc0a9b40 0x7f39fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.542+0000 7f39f2ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc0a9b40 0x7f39fc0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:36380/0 (socket says 172.21.15.132:36380) 2023-11-18T20:41:25.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.543+0000 7f39f2ffd640 1 -- 172.21.15.132:0/1226021277 learned_addr learned my addr 172.21.15.132:0/1226021277 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:25.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.543+0000 7f39fbfff640 1 --2- 172.21.15.132:0/1226021277 >> v2:172.21.15.161:3300/0 conn(0x7f39fc0c1500 0x7f39fc0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.543+0000 7f39f2ffd640 1 -- 172.21.15.132:0/1226021277 >> v2:172.21.15.161:3300/0 conn(0x7f39fc0c1500 msgr2=0x7f39fc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:25.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.543+0000 7f39f2ffd640 1 --2- 172.21.15.132:0/1226021277 >> v2:172.21.15.161:3300/0 conn(0x7f39fc0c1500 0x7f39fc0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.543+0000 7f39f2ffd640 1 -- 172.21.15.132:0/1226021277 >> v1:172.21.15.161:6789/0 conn(0x7f39fc155490 legacy=0x7f39fc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.543+0000 7f39f2ffd640 1 -- 172.21.15.132:0/1226021277 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc0c0910 con 0x7f39fc0a9b40 2023-11-18T20:41:25.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.545+0000 7f39f2ffd640 1 --2- 172.21.15.132:0/1226021277 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc0a9b40 0x7f39fc0a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009870 tx=0x7f39e402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17459a7c582cb703 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:25.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.545+0000 7f39faffd640 1 -- 172.21.15.132:0/1226021277 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4030840 con 0x7f39fc0a9b40 2023-11-18T20:41:25.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.545+0000 7f39faffd640 1 -- 172.21.15.132:0/1226021277 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e40309a0 con 0x7f39fc0a9b40 2023-11-18T20:41:25.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.545+0000 7f39faffd640 1 -- 172.21.15.132:0/1226021277 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4030d30 con 0x7f39fc0a9b40 2023-11-18T20:41:25.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.546+0000 7f3a01b33640 1 -- 172.21.15.132:0/1226021277 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc0a9b40 msgr2=0x7f39fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.546+0000 7f3a01b33640 1 --2- 172.21.15.132:0/1226021277 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc0a9b40 0x7f39fc0a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009870 tx=0x7f39e402b980 comp rx=0 tx=0).stop 2023-11-18T20:41:25.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.546+0000 7f3a01b33640 1 -- 172.21.15.132:0/1226021277 shutdown_connections 2023-11-18T20:41:25.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.546+0000 7f3a01b33640 1 --2- 172.21.15.132:0/1226021277 >> v2:172.21.15.161:3300/0 conn(0x7f39fc0c1500 0x7f39fc0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.546+0000 7f3a01b33640 1 --2- 172.21.15.132:0/1226021277 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc0a9b40 0x7f39fc0a51b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.546+0000 7f3a01b33640 1 -- 172.21.15.132:0/1226021277 >> 172.21.15.132:0/1226021277 conn(0x7f39fc06a500 msgr2=0x7f39fc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:25.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.546+0000 7f3a01b33640 1 -- 172.21.15.132:0/1226021277 shutdown_connections 2023-11-18T20:41:25.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.546+0000 7f3a01b33640 1 -- 172.21.15.132:0/1226021277 wait complete. 2023-11-18T20:41:25.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.548+0000 7f3a01b33640 1 Processor -- start 2023-11-18T20:41:25.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.548+0000 7f3a01b33640 1 -- start start 2023-11-18T20:41:25.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f3a01b33640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39fc0c1500 0x7f39fc071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f3a01b33640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc155490 0x7f39fc14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f3a01b33640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39fc14b9f0 0x7f39fc152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f3a01b33640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc0709a0 con 0x7f39fc0c1500 2023-11-18T20:41:25.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f3a01b33640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1e05e0 con 0x7f39fc14b9f0 2023-11-18T20:41:25.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f3a01b33640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1e0300 con 0x7f39fc155490 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f39fb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39fc0c1500 0x7f39fc071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f39fb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39fc0c1500 0x7f39fc071a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56322/0 (socket says 172.21.15.132:56322) 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f39fb7fe640 1 -- 172.21.15.132:0/3155722634 learned_addr learned my addr 172.21.15.132:0/3155722634 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.549+0000 7f39f2ffd640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc155490 0x7f39fc14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39fb7fe640 1 -- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc155490 msgr2=0x7f39fc14dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39fb7fe640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc155490 0x7f39fc14dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39fbfff640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39fc14b9f0 0x7f39fc152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39fb7fe640 1 -- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39fc14b9f0 msgr2=0x7f39fc152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39fb7fe640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39fc14b9f0 0x7f39fc152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39fb7fe640 1 -- 172.21.15.132:0/3155722634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e40094d0 con 0x7f39fc0c1500 2023-11-18T20:41:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39fbfff640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39fc14b9f0 0x7f39fc152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39fb7fe640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39fc0c1500 0x7f39fc071a80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00c730 tx=0x7f39ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39f8ff9640 1 -- 172.21.15.132:0/3155722634 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec006d50 con 0x7f39fc0c1500 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39f8ff9640 1 -- 172.21.15.132:0/3155722634 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec00ce40 con 0x7f39fc0c1500 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f39f8ff9640 1 -- 172.21.15.132:0/3155722634 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec003bb0 con 0x7f39fc0c1500 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc071fc0 con 0x7f39fc0c1500 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.550+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc1ea8d0 con 0x7f39fc0c1500 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.551+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc068350 con 0x7f39fc0c1500 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.552+0000 7f39f8ff9640 1 -- 172.21.15.132:0/3155722634 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39ec003d10 con 0x7f39fc0c1500 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.553+0000 7f39f8ff9640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f39dc06ae70 0x7f39dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.553+0000 7f39f8ff9640 1 -- 172.21.15.132:0/3155722634 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39ec089130 con 0x7f39fc0c1500 2023-11-18T20:41:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.554+0000 7f39f2ffd640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f39dc06ae70 0x7f39dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.555+0000 7f39f2ffd640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f39dc06ae70 0x7f39dc06d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f39e4036000 tx=0x7f39e403b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.558+0000 7f39f8ff9640 1 -- 172.21.15.132:0/3155722634 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39ec057d00 con 0x7f39fc0c1500 2023-11-18T20:41:25.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.806+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f39fc0a8ae0 con 0x7f39fc0c1500 2023-11-18T20:41:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.810+0000 7f39f8ff9640 1 -- 172.21.15.132:0/3155722634 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f39ec057890 con 0x7f39fc0c1500 2023-11-18T20:41:25.811 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-11-18T20:41:25.811 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBrIFllsbdTOxAAP60vfd0AqFNopXTOFb78Tw== 2023-11-18T20:41:25.812 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow" 2023-11-18T20:41:25.812 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2023-11-18T20:41:25.812 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-18T20:41:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-11-18T20:41:25.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f39dc06ae70 msgr2=0x7f39dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f39dc06ae70 0x7f39dc06d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f39e4036000 tx=0x7f39e403b040 comp rx=0 tx=0).stop 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39fc0c1500 msgr2=0x7f39fc071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39fc0c1500 0x7f39fc071a80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00c730 tx=0x7f39ec00cbf0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 shutdown_connections 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f39dc06ae70 0x7f39dc06d330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39fc14b9f0 0x7f39fc152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39fc155490 0x7f39fc14dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 --2- 172.21.15.132:0/3155722634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39fc0c1500 0x7f39fc071a80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 >> 172.21.15.132:0/3155722634 conn(0x7f39fc06a500 msgr2=0x7f39fc0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 shutdown_connections 2023-11-18T20:41:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:25.813+0000 7f3a01b33640 1 -- 172.21.15.132:0/3155722634 wait complete. 2023-11-18T20:41:25.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:41:26.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.035+0000 7f40e3105640 1 Processor -- start 2023-11-18T20:41:26.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.036+0000 7f40e3105640 1 -- start start 2023-11-18T20:41:26.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.037+0000 7f40e3105640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40dc06d0a0 0x7f40dc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.037+0000 7f40e3105640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc0c3ea0 0x7f40dc0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.037+0000 7f40e3105640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc0c64a0 con 0x7f40dc14fd30 2023-11-18T20:41:26.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.037+0000 7f40e3105640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc0c5c00 con 0x7f40dc06d0a0 2023-11-18T20:41:26.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.037+0000 7f40e3105640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0c5ee0 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.037+0000 7f40dbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40dc06d0a0 0x7f40dc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.037+0000 7f40e0ea1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f40dc14fd30 0x7f40dc0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39590/0 (socket says 172.21.15.132:39590) 2023-11-18T20:41:26.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.037+0000 7f40e0ea1640 1 -- 172.21.15.132:0/433459770 learned_addr learned my addr 172.21.15.132:0/433459770 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:26.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.038+0000 7f40e16a2640 1 --2- 172.21.15.132:0/433459770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc0c3ea0 0x7f40dc0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.038+0000 7f40dbfff640 1 -- 172.21.15.132:0/433459770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc0c3ea0 msgr2=0x7f40dc0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.038+0000 7f40dbfff640 1 --2- 172.21.15.132:0/433459770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc0c3ea0 0x7f40dc0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.038+0000 7f40dbfff640 1 -- 172.21.15.132:0/433459770 >> v1:172.21.15.132:6789/0 conn(0x7f40dc14fd30 legacy=0x7f40dc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.038+0000 7f40dbfff640 1 -- 172.21.15.132:0/433459770 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc0c61c0 con 0x7f40dc06d0a0 2023-11-18T20:41:26.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.038+0000 7f40db7fe640 1 -- 172.21.15.132:0/433459770 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930640986 0 0) 0x7f40dc0c64a0 con 0x7f40dc14fd30 2023-11-18T20:41:26.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.039+0000 7f40dbfff640 1 --2- 172.21.15.132:0/433459770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc06d0a0 0x7f40dc152f20 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f40c80097a0 tx=0x7f40c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303952edc6027790 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.039+0000 7f40db7fe640 1 -- 172.21.15.132:0/433459770 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8031830 con 0x7f40dc06d0a0 2023-11-18T20:41:26.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.039+0000 7f40db7fe640 1 -- 172.21.15.132:0/433459770 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c8031990 con 0x7f40dc06d0a0 2023-11-18T20:41:26.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.039+0000 7f40db7fe640 1 -- 172.21.15.132:0/433459770 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8031d20 con 0x7f40dc06d0a0 2023-11-18T20:41:26.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.040+0000 7f40e3105640 1 -- 172.21.15.132:0/433459770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc06d0a0 msgr2=0x7f40dc152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.040+0000 7f40e3105640 1 --2- 172.21.15.132:0/433459770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc06d0a0 0x7f40dc152f20 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f40c80097a0 tx=0x7f40c802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.040+0000 7f40e3105640 1 -- 172.21.15.132:0/433459770 shutdown_connections 2023-11-18T20:41:26.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.040+0000 7f40e3105640 1 --2- 172.21.15.132:0/433459770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc0c3ea0 0x7f40dc0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.040+0000 7f40e3105640 1 --2- 172.21.15.132:0/433459770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc06d0a0 0x7f40dc152f20 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.040+0000 7f40e3105640 1 -- 172.21.15.132:0/433459770 >> 172.21.15.132:0/433459770 conn(0x7f40dc06a500 msgr2=0x7f40dc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:26.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.040+0000 7f40e3105640 1 -- 172.21.15.132:0/433459770 shutdown_connections 2023-11-18T20:41:26.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.040+0000 7f40e3105640 1 -- 172.21.15.132:0/433459770 wait complete. 2023-11-18T20:41:26.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.042+0000 7f40e3105640 1 Processor -- start 2023-11-18T20:41:26.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.042+0000 7f40e3105640 1 -- start start 2023-11-18T20:41:26.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.042+0000 7f40e3105640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc06d0a0 0x7f40dc0bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40e3105640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc0c3ea0 0x7f40dc0bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40e3105640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40dc14fd30 0x7f40dc0bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40e3105640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc1eb880 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40e3105640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0bc730 con 0x7f40dc14fd30 2023-11-18T20:41:26.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40e3105640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0c03a0 con 0x7f40dc06d0a0 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc0c3ea0 0x7f40dc0bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc0c3ea0 0x7f40dc0bb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56340/0 (socket says 172.21.15.132:56340) 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40dbfff640 1 -- 172.21.15.132:0/4037693921 learned_addr learned my addr 172.21.15.132:0/4037693921 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40e0ea1640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc06d0a0 0x7f40dc0bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40dbfff640 1 -- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc06d0a0 msgr2=0x7f40dc0bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40dbfff640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc06d0a0 0x7f40dc0bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40dbfff640 1 -- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40dc14fd30 msgr2=0x7f40dc0bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40dbfff640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40dc14fd30 0x7f40dc0bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.043+0000 7f40dbfff640 1 -- 172.21.15.132:0/4037693921 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8009400 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.044+0000 7f40dbfff640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc0c3ea0 0x7f40dc0bb8e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f40c8034040 tx=0x7f40c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.044+0000 7f40d97fa640 1 -- 172.21.15.132:0/4037693921 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c803aa60 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.044+0000 7f40d97fa640 1 -- 172.21.15.132:0/4037693921 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c803abe0 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.044+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc0bc9d0 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.044+0000 7f40d97fa640 1 -- 172.21.15.132:0/4037693921 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8044400 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.044+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc0a44f0 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.045+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc154be0 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.046+0000 7f40d97fa640 1 -- 172.21.15.132:0/4037693921 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40c804d440 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.047+0000 7f40d97fa640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40c006ae40 0x7f40c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.047+0000 7f40d97fa640 1 -- 172.21.15.132:0/4037693921 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40c80ab800 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.047+0000 7f40e0ea1640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40c006ae40 0x7f40c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.048+0000 7f40e0ea1640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40c006ae40 0x7f40c006d300 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f40d0000f60 tx=0x7f40d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.051+0000 7f40d97fa640 1 -- 172.21.15.132:0/4037693921 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40dc154be0 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.231 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:41:26.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:41:26.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.278+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40dc154be0 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.279+0000 7f40d97fa640 1 -- 172.21.15.132:0/4037693921 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f40dc154be0 con 0x7f40dc0c3ea0 2023-11-18T20:41:26.280 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:26.281 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:19.530586+0000","modified":"2023-11-18T20:41:22.840145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/726664783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":726664783},{"type":"v1","addr":"172.21.15.132:6835","nonce":726664783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-18T20:41:26.281 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-11-18T20:41:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40c006ae40 msgr2=0x7f40c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40c006ae40 0x7f40c006d300 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f40d0000f60 tx=0x7f40d0009040 comp rx=0 tx=0).stop 2023-11-18T20:41:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc0c3ea0 msgr2=0x7f40dc0bb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc0c3ea0 0x7f40dc0bb8e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f40c8034040 tx=0x7f40c80046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 shutdown_connections 2023-11-18T20:41:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40c006ae40 0x7f40c006d300 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40dc14fd30 0x7f40dc0bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40dc0c3ea0 0x7f40dc0bb8e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 --2- 172.21.15.132:0/4037693921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40dc06d0a0 0x7f40dc0bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 >> 172.21.15.132:0/4037693921 conn(0x7f40dc06a500 msgr2=0x7f40dc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 shutdown_connections 2023-11-18T20:41:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.282+0000 7f40e3105640 1 -- 172.21.15.132:0/4037693921 wait complete. 2023-11-18T20:41:26.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T20:41:19.530586+0000', 'modified': '2023-11-18T20:41:22.840145+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6507}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6507': {'gid': 6507, 'name': 'a', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6835/726664783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6833', 'nonce': 726664783}, {'type': 'v1', 'addr': '172.21.15.132:6835', 'nonce': 726664783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-18T20:41:26.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T20:41:26.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-18T20:41:26.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.913+0000 7fed8e597640 1 Processor -- start 2023-11-18T20:41:26.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.913+0000 7fed8e597640 1 -- start start 2023-11-18T20:41:26.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8e597640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 0x7fed880c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8e597640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fed88072320 0x7fed8806f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8e597640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed8806f5c0 0x7fed88152560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8e597640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed88150000 con 0x7fed8806f5c0 2023-11-18T20:41:26.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8e597640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed88156800 con 0x7fed88072320 2023-11-18T20:41:26.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8e597640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed88155bf0 con 0x7fed8814fc20 2023-11-18T20:41:26.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8cb34640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed8806f5c0 0x7fed88152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8cb34640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed8806f5c0 0x7fed88152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56354/0 (socket says 172.21.15.132:56354) 2023-11-18T20:41:26.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8cb34640 1 -- 172.21.15.132:0/686522758 learned_addr learned my addr 172.21.15.132:0/686522758 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:26.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed877fe640 1 --2- 172.21.15.132:0/686522758 >> v2:172.21.15.161:3300/0 conn(0x7fed88072320 0x7fed8806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed87fff640 1 --2- 172.21.15.132:0/686522758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 0x7fed880c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.915+0000 7fed8cb34640 1 -- 172.21.15.132:0/686522758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 msgr2=0x7fed880c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.916+0000 7fed8cb34640 1 --2- 172.21.15.132:0/686522758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 0x7fed880c1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.916+0000 7fed8cb34640 1 -- 172.21.15.132:0/686522758 >> v2:172.21.15.161:3300/0 conn(0x7fed88072320 msgr2=0x7fed8806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.916+0000 7fed8cb34640 1 --2- 172.21.15.132:0/686522758 >> v2:172.21.15.161:3300/0 conn(0x7fed88072320 0x7fed8806f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.916+0000 7fed8cb34640 1 -- 172.21.15.132:0/686522758 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88155ed0 con 0x7fed8806f5c0 2023-11-18T20:41:26.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.916+0000 7fed877fe640 1 --2- 172.21.15.132:0/686522758 >> v2:172.21.15.161:3300/0 conn(0x7fed88072320 0x7fed8806f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:26.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.917+0000 7fed8cb34640 1 --2- 172.21.15.132:0/686522758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8806f5c0 0x7fed88152560 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fed880727f0 tx=0x7fed8002b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd5ab196a55294 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.917+0000 7fed86ffd640 1 -- 172.21.15.132:0/686522758 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800317f0 con 0x7fed8806f5c0 2023-11-18T20:41:26.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.917+0000 7fed86ffd640 1 -- 172.21.15.132:0/686522758 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80031950 con 0x7fed8806f5c0 2023-11-18T20:41:26.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.917+0000 7fed86ffd640 1 -- 172.21.15.132:0/686522758 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80031ce0 con 0x7fed8806f5c0 2023-11-18T20:41:26.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 -- 172.21.15.132:0/686522758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8806f5c0 msgr2=0x7fed88152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 --2- 172.21.15.132:0/686522758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8806f5c0 0x7fed88152560 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fed880727f0 tx=0x7fed8002b890 comp rx=0 tx=0).stop 2023-11-18T20:41:26.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 -- 172.21.15.132:0/686522758 shutdown_connections 2023-11-18T20:41:26.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 --2- 172.21.15.132:0/686522758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8806f5c0 0x7fed88152560 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 --2- 172.21.15.132:0/686522758 >> v2:172.21.15.161:3300/0 conn(0x7fed88072320 0x7fed8806f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 --2- 172.21.15.132:0/686522758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 0x7fed880c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 -- 172.21.15.132:0/686522758 >> 172.21.15.132:0/686522758 conn(0x7fed880c39e0 msgr2=0x7fed880c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:26.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 -- 172.21.15.132:0/686522758 shutdown_connections 2023-11-18T20:41:26.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.918+0000 7fed8e597640 1 -- 172.21.15.132:0/686522758 wait complete. 2023-11-18T20:41:26.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.919+0000 7fed8e597640 1 Processor -- start 2023-11-18T20:41:26.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.920+0000 7fed8e597640 1 -- start start 2023-11-18T20:41:26.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.920+0000 7fed8e597640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806f5c0 0x7fed881eb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.920+0000 7fed8e597640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed88072320 0x7fed881e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.920+0000 7fed8e597640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 0x7fed8814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.920+0000 7fed8e597640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed881e7a70 con 0x7fed88072320 2023-11-18T20:41:26.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.920+0000 7fed8e597640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed880c6110 con 0x7fed8806f5c0 2023-11-18T20:41:26.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.920+0000 7fed8e597640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed880c5900 con 0x7fed8814fc20 2023-11-18T20:41:26.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed88072320 0x7fed881e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed88072320 0x7fed881e81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56356/0 (socket says 172.21.15.132:56356) 2023-11-18T20:41:26.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 -- 172.21.15.132:0/2141486820 learned_addr learned my addr 172.21.15.132:0/2141486820 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:26.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed87fff640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806f5c0 0x7fed881eb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 -- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 msgr2=0x7fed8814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed8cb34640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 0x7fed8814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 0x7fed8814acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 -- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806f5c0 msgr2=0x7fed881eb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806f5c0 0x7fed881eb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 -- 172.21.15.132:0/2141486820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed800094d0 con 0x7fed88072320 2023-11-18T20:41:26.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed87fff640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806f5c0 0x7fed881eb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:26.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.921+0000 7fed877fe640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed88072320 0x7fed881e81a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c820 tx=0x7fed7000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.922+0000 7fed84ff9640 1 -- 172.21.15.132:0/2141486820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70007a30 con 0x7fed88072320 2023-11-18T20:41:26.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.922+0000 7fed84ff9640 1 -- 172.21.15.132:0/2141486820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70007b90 con 0x7fed88072320 2023-11-18T20:41:26.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.922+0000 7fed84ff9640 1 -- 172.21.15.132:0/2141486820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7000ce10 con 0x7fed88072320 2023-11-18T20:41:26.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.922+0000 7fed8e597640 1 -- 172.21.15.132:0/2141486820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed880c5b50 con 0x7fed88072320 2023-11-18T20:41:26.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.922+0000 7fed8e597640 1 -- 172.21.15.132:0/2141486820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed881e7c80 con 0x7fed88072320 2023-11-18T20:41:26.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.924+0000 7fed84ff9640 1 -- 172.21.15.132:0/2141486820 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed700113f0 con 0x7fed88072320 2023-11-18T20:41:26.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.925+0000 7fed84ff9640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed6806ae40 0x7fed6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.925+0000 7fed84ff9640 1 -- 172.21.15.132:0/2141486820 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed70089740 con 0x7fed88072320 2023-11-18T20:41:26.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.925+0000 7fed91209740 1 Processor -- start 2023-11-18T20:41:26.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.925+0000 7fed87fff640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed6806ae40 0x7fed6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.925+0000 7fed91209740 1 -- start start 2023-11-18T20:41:26.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.926+0000 7fed91209740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f15432b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.926+0000 7fed91209740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542ed040 0x55f15432df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.926+0000 7fed91209740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 0x55f15432e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.926+0000 7fed91209740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15424a880 con 0x55f1542ed040 2023-11-18T20:41:26.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.926+0000 7fed91209740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f154259ae0 con 0x55f1542f19d0 2023-11-18T20:41:26.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.926+0000 7fed91209740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1542571d0 con 0x55f15432acb0 2023-11-18T20:41:26.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.926+0000 7fed87fff640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed6806ae40 0x7fed6806d300 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fed78007eb0 tx=0x7fed78007400 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542ed040 0x55f15432df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542ed040 0x55f15432df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56368/0 (socket says 172.21.15.132:56368) 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 -- 172.21.15.132:0/1814179448 learned_addr learned my addr 172.21.15.132:0/1814179448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed8cb34640 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 0x55f15432e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed87fff640 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f15432b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 -- 172.21.15.132:0/1814179448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 msgr2=0x55f15432b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f15432b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 -- 172.21.15.132:0/1814179448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 msgr2=0x55f15432e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 0x55f15432e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 -- 172.21.15.132:0/1814179448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f15421a860 con 0x55f1542ed040 2023-11-18T20:41:26.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed877fe640 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542ed040 0x55f15432df80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fed70054920 tx=0x7fed70058b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e092a5aef52fe86e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed7dffb640 1 -- 172.21.15.132:0/1814179448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7005c570 con 0x55f1542ed040 2023-11-18T20:41:26.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed7dffb640 1 -- 172.21.15.132:0/1814179448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70060720 con 0x55f1542ed040 2023-11-18T20:41:26.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.927+0000 7fed7dffb640 1 -- 172.21.15.132:0/1814179448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70054b30 con 0x55f1542ed040 2023-11-18T20:41:26.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 -- 172.21.15.132:0/1814179448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542ed040 msgr2=0x55f15432df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542ed040 0x55f15432df80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fed70054920 tx=0x7fed70058b20 comp rx=0 tx=0).stop 2023-11-18T20:41:26.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 -- 172.21.15.132:0/1814179448 shutdown_connections 2023-11-18T20:41:26.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 0x55f15432e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542ed040 0x55f15432df80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 --2- 172.21.15.132:0/1814179448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f15432b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 -- 172.21.15.132:0/1814179448 >> 172.21.15.132:0/1814179448 conn(0x55f1542adbb0 msgr2=0x55f154311a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:26.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 -- 172.21.15.132:0/1814179448 shutdown_connections 2023-11-18T20:41:26.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.928+0000 7fed91209740 1 -- 172.21.15.132:0/1814179448 wait complete. 2023-11-18T20:41:26.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.929+0000 7fed91209740 1 -- start start 2023-11-18T20:41:26.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.929+0000 7fed91209740 1 Processor -- start 2023-11-18T20:41:26.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed91209740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 0x55f154324a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed91209740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f154329080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed91209740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f15430db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed91209740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f154252ac0 con 0x55f1543108c0 2023-11-18T20:41:26.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed91209740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1541ef2f0 con 0x55f1542f19d0 2023-11-18T20:41:26.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed91209740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f15420cc70 con 0x55f15432acb0 2023-11-18T20:41:26.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed91209740 10 client.0 _ll_register_callbacks cb 0x55f1542113b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:41:26.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed8cb34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f15430db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed8cb34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f15430db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56374/0 (socket says 172.21.15.132:56374) 2023-11-18T20:41:26.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.930+0000 7fed8cb34640 1 -- 172.21.15.132:0/3848324196 learned_addr learned my addr 172.21.15.132:0/3848324196 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:26.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed87fff640 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 0x55f154324a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed877fe640 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f154329080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed8cb34640 1 -- 172.21.15.132:0/3848324196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 msgr2=0x55f154329080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed8cb34640 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f154329080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed8cb34640 1 -- 172.21.15.132:0/3848324196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 msgr2=0x55f154324a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed8cb34640 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 0x55f154324a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed8cb34640 1 -- 172.21.15.132:0/3848324196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed881e7c80 con 0x55f1543108c0 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed8cb34640 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f15430db80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fed80009960 tx=0x7fed8002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6e1f4ce5da3698 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed66ffd640 1 -- 172.21.15.132:0/3848324196 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80032950 con 0x55f1543108c0 2023-11-18T20:41:26.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed91209740 1 -- 172.21.15.132:0/3848324196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f15424baa0 con 0x55f1543108c0 2023-11-18T20:41:26.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.931+0000 7fed66ffd640 1 -- 172.21.15.132:0/3848324196 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed80040070 con 0x55f1543108c0 2023-11-18T20:41:26.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed66ffd640 1 -- 172.21.15.132:0/3848324196 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed80032ab0 con 0x55f1543108c0 2023-11-18T20:41:26.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed91209740 10 client.6666 fetch_fsmap learned FSMap version 45 2023-11-18T20:41:26.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed91209740 1 -- 172.21.15.132:0/3848324196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x55f154251140 con 0x55f1543108c0 2023-11-18T20:41:26.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed66ffd640 1 -- 172.21.15.132:0/3848324196 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f15424baa0 con 0x55f1543108c0 2023-11-18T20:41:26.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed66ffd640 1 -- 172.21.15.132:0/3848324196 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fed80032c10 con 0x55f1543108c0 2023-11-18T20:41:26.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed91209740 10 client.6666 fetch_fsmap finished waiting for FSMap version 45 2023-11-18T20:41:26.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed91209740 10 client.6666 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-18T20:41:26.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed91209740 20 client.6666 populate_metadata read hostname 'smithi132' 2023-11-18T20:41:26.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed91209740 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] conn(0x55f15430eb70 0x55f15433fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed91209740 4 client.6666 mds_command: new command op to 6507 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T20:41:26.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed91209740 1 -- 172.21.15.132:0/3848324196 --> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f15424b7c0 con 0x55f15430eb70 2023-11-18T20:41:26.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.932+0000 7fed87fff640 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] conn(0x55f15430eb70 0x55f15433fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.933+0000 7fed87fff640 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] conn(0x55f15430eb70 0x55f15433fda0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27ba6b6f60dd8722 server_cookie=2e45f901aea671b2 in_seq=0 out_seq=0 2023-11-18T20:41:26.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.933+0000 7fed66ffd640 10 client.6666 ms_handle_connect on v2:172.21.15.132:6833/726664783 2023-11-18T20:41:26.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed66ffd640 1 -- 172.21.15.132:0/3848324196 <== mds.0 v2:172.21.15.132:6833/726664783 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f15424b7c0 con 0x55f15430eb70 2023-11-18T20:41:26.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed66ffd640 10 client.6666 handle_command_reply: tid=0 2023-11-18T20:41:26.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 client.6666 shutdown 2023-11-18T20:41:26.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 -- 172.21.15.132:0/3848324196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 msgr2=0x55f15430db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f15430db80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fed80009960 tx=0x7fed8002e000 comp rx=0 tx=0).stop 2023-11-18T20:41:26.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 -- 172.21.15.132:0/3848324196 shutdown_connections 2023-11-18T20:41:26.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] conn(0x55f15430eb70 0x55f15433fda0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f15430db80 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f154329080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed66ffd640 0 client.6666 ms_handle_reset on v2:172.21.15.132:6833/726664783 2023-11-18T20:41:26.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 --2- 172.21.15.132:0/3848324196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1542f19d0 0x55f154324a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 -- 172.21.15.132:0/3848324196 >> 172.21.15.132:0/3848324196 conn(0x55f1542adbb0 msgr2=0x55f1542f0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:26.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 -- 172.21.15.132:0/3848324196 shutdown_connections 2023-11-18T20:41:26.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 1 -- 172.21.15.132:0/3848324196 wait complete. 2023-11-18T20:41:26.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.934+0000 7fed91209740 20 client.6666 trim_cache size 0 max 16384 2023-11-18T20:41:26.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.951+0000 7fed91209740 1 Processor -- start 2023-11-18T20:41:26.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.951+0000 7fed91209740 1 -- start start 2023-11-18T20:41:26.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.951+0000 7fed91209740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542f19d0 0x55f15433c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.951+0000 7fed91209740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1543108c0 0x55f1542e5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed91209740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f154326720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed91209740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f153fb5f20 con 0x55f1542f19d0 2023-11-18T20:41:26.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed91209740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1542ed660 con 0x55f1543108c0 2023-11-18T20:41:26.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed91209740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f154328ad0 con 0x55f15432acb0 2023-11-18T20:41:26.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542f19d0 0x55f15433c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542f19d0 0x55f15433c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56384/0 (socket says 172.21.15.132:56384) 2023-11-18T20:41:26.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 -- 172.21.15.132:0/3164250539 learned_addr learned my addr 172.21.15.132:0/3164250539 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:26.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 -- 172.21.15.132:0/3164250539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 msgr2=0x55f154326720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 --2- 172.21.15.132:0/3164250539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f154326720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 -- 172.21.15.132:0/3164250539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1543108c0 msgr2=0x55f1542e5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 --2- 172.21.15.132:0/3164250539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1543108c0 0x55f1542e5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 -- 172.21.15.132:0/3164250539 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1541eeb80 con 0x55f1542f19d0 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.952+0000 7fed87fff640 1 --2- 172.21.15.132:0/3164250539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542f19d0 0x55f15433c990 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fed7800db40 tx=0x7fed78013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee5dfe6f009527d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed7e7fc640 1 -- 172.21.15.132:0/3164250539 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78023070 con 0x55f1542f19d0 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed7e7fc640 1 -- 172.21.15.132:0/3164250539 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed78010be0 con 0x55f1542f19d0 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed7e7fc640 1 -- 172.21.15.132:0/3164250539 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78010d70 con 0x55f1542f19d0 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 -- 172.21.15.132:0/3164250539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542f19d0 msgr2=0x55f15433c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 --2- 172.21.15.132:0/3164250539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542f19d0 0x55f15433c990 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fed7800db40 tx=0x7fed78013000 comp rx=0 tx=0).stop 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 -- 172.21.15.132:0/3164250539 shutdown_connections 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 --2- 172.21.15.132:0/3164250539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f15432acb0 0x55f154326720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 --2- 172.21.15.132:0/3164250539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f1543108c0 0x55f1542e5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 --2- 172.21.15.132:0/3164250539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1542f19d0 0x55f15433c990 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 -- 172.21.15.132:0/3164250539 >> 172.21.15.132:0/3164250539 conn(0x55f1542adbb0 msgr2=0x55f1542e21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 -- 172.21.15.132:0/3164250539 shutdown_connections 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.953+0000 7fed91209740 1 -- 172.21.15.132:0/3164250539 wait complete. 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.954+0000 7fed91209740 1 -- start start 2023-11-18T20:41:26.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.954+0000 7fed91209740 1 Processor -- start 2023-11-18T20:41:26.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed91209740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f1542e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed91209740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f15432acb0 0x55f15439a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed91209740 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f154310fc0 0x55f154393fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed91209740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15439b120 con 0x55f1543108c0 2023-11-18T20:41:26.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed91209740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f154346520 con 0x55f15432acb0 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed91209740 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1543395c0 con 0x55f154310fc0 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed91209740 10 client.0 _ll_register_callbacks cb 0x7fed800096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed87fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f1542e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed87fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f1542e5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56390/0 (socket says 172.21.15.132:56390) 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.955+0000 7fed87fff640 1 -- 172.21.15.132:0/3206774245 learned_addr learned my addr 172.21.15.132:0/3206774245 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed87fff640 1 -- 172.21.15.132:0/3206774245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f154310fc0 msgr2=0x55f154393fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed87fff640 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f154310fc0 0x55f154393fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed87fff640 1 -- 172.21.15.132:0/3206774245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f15432acb0 msgr2=0x55f15439a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed87fff640 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f15432acb0 0x55f15439a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed87fff640 1 -- 172.21.15.132:0/3206774245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed78008040 con 0x55f1543108c0 2023-11-18T20:41:26.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed87fff640 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f1542e5ec0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fed78028040 tx=0x7fed78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11b45c006961bf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed66ffd640 1 -- 172.21.15.132:0/3206774245 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78024720 con 0x55f1543108c0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed66ffd640 1 -- 172.21.15.132:0/3206774245 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed78024880 con 0x55f1543108c0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed91209740 1 -- 172.21.15.132:0/3206774245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed70060720 con 0x55f1543108c0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed66ffd640 1 -- 172.21.15.132:0/3206774245 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed78030460 con 0x55f1543108c0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed91209740 10 client.6672 fetch_fsmap learned FSMap version 45 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.956+0000 7fed91209740 1 -- 172.21.15.132:0/3206774245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x55f154214170 con 0x55f1543108c0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed66ffd640 1 -- 172.21.15.132:0/3206774245 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70060720 con 0x55f1543108c0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed66ffd640 1 -- 172.21.15.132:0/3206774245 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fed78030640 con 0x55f1543108c0 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed91209740 10 client.6672 fetch_fsmap finished waiting for FSMap version 45 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed91209740 10 client.6672 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-18T20:41:26.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed91209740 20 client.6672 populate_metadata read hostname 'smithi132' 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed91209740 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] conn(0x55f1543947f0 0x55f15430a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed91209740 4 client.6672 mds_command: new command op to 6507 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed91209740 1 -- 172.21.15.132:0/3206774245 --> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f153f536c0 con 0x55f1543947f0 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed877fe640 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] conn(0x55f1543947f0 0x55f15430a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed877fe640 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] conn(0x55f1543947f0 0x55f15430a1d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffa2c69a30e38e server_cookie=105e226666d0b792 in_seq=0 out_seq=0 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.957+0000 7fed66ffd640 10 client.6672 ms_handle_connect on v2:172.21.15.132:6833/726664783 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed66ffd640 1 -- 172.21.15.132:0/3206774245 <== mds.0 v2:172.21.15.132:6833/726664783 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f153f536c0 con 0x55f1543947f0 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed66ffd640 10 client.6672 handle_command_reply: tid=0 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 client.6672 shutdown 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 -- 172.21.15.132:0/3206774245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 msgr2=0x55f1542e5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f1542e5ec0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fed78028040 tx=0x7fed78004ab0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 -- 172.21.15.132:0/3206774245 shutdown_connections 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.132:6833/726664783,v1:172.21.15.132:6835/726664783] conn(0x55f1543947f0 0x55f15430a1d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55f154310fc0 0x55f154393fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f15432acb0 0x55f15439a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 --2- 172.21.15.132:0/3206774245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f1543108c0 0x55f1542e5ec0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed66ffd640 0 client.6672 ms_handle_reset on v2:172.21.15.132:6833/726664783 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 -- 172.21.15.132:0/3206774245 >> 172.21.15.132:0/3206774245 conn(0x55f1542adbb0 msgr2=0x55f1542ec350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 -- 172.21.15.132:0/3206774245 shutdown_connections 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 1 -- 172.21.15.132:0/3206774245 wait complete. 2023-11-18T20:41:26.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.958+0000 7fed91209740 20 client.6672 trim_cache size 0 max 16384 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "95273225-bfbe-4b9a-893d-dfaf6292d673", 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 6507, 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 6.6166454290000001, 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 45, 2023-11-18T20:41:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 76, 2023-11-18T20:41:26.966 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 76, 2023-11-18T20:41:26.966 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 13.424378710999999 2023-11-18T20:41:26.966 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:41:26.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 -- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed6806ae40 msgr2=0x7fed6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed6806ae40 0x7fed6806d300 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fed78007eb0 tx=0x7fed78007400 comp rx=0 tx=0).stop 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 -- 172.21.15.132:0/2141486820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed88072320 msgr2=0x7fed881e81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed88072320 0x7fed881e81a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c820 tx=0x7fed7000cce0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 -- 172.21.15.132:0/2141486820 shutdown_connections 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed6806ae40 0x7fed6806d300 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8814fc20 0x7fed8814acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed88072320 0x7fed881e81a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 --2- 172.21.15.132:0/2141486820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806f5c0 0x7fed881eb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 -- 172.21.15.132:0/2141486820 >> 172.21.15.132:0/2141486820 conn(0x7fed880c39e0 msgr2=0x7fed8814dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 -- 172.21.15.132:0/2141486820 shutdown_connections 2023-11-18T20:41:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:26.959+0000 7fed8e597640 1 -- 172.21.15.132:0/2141486820 wait complete. 2023-11-18T20:41:26.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:41:27.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.169+0000 7f5aeaca9640 1 Processor -- start 2023-11-18T20:41:27.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.170+0000 7f5aeaca9640 1 -- start start 2023-11-18T20:41:27.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5aeaca9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ae4155490 0x7f5ae40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:27.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5aeaca9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ae40c1500 0x7f5ae40a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:27.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5aeaca9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 0x7f5ae40a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:27.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5aeaca9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae40a5820 con 0x7f5ae4155490 2023-11-18T20:41:27.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5aeaca9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae40c06c0 con 0x7f5ae40c1500 2023-11-18T20:41:27.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5aeaca9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40c1020 con 0x7f5ae40c4080 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5ae8a45640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ae4155490 0x7f5ae40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5ae8a45640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ae4155490 0x7f5ae40a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56396/0 (socket says 172.21.15.132:56396) 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.171+0000 7f5ae8a45640 1 -- 172.21.15.132:0/443816467 learned_addr learned my addr 172.21.15.132:0/443816467 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.172+0000 7f5ae3fff640 1 --2- 172.21.15.132:0/443816467 >> v2:172.21.15.161:3300/0 conn(0x7f5ae40c1500 0x7f5ae40a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.172+0000 7f5ae8a45640 1 -- 172.21.15.132:0/443816467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 msgr2=0x7f5ae40a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.172+0000 7f5ae9246640 1 --2- 172.21.15.132:0/443816467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 0x7f5ae40a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.172+0000 7f5ae8a45640 1 --2- 172.21.15.132:0/443816467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 0x7f5ae40a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.172+0000 7f5ae8a45640 1 -- 172.21.15.132:0/443816467 >> v2:172.21.15.161:3300/0 conn(0x7f5ae40c1500 msgr2=0x7f5ae40a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.172+0000 7f5ae8a45640 1 --2- 172.21.15.132:0/443816467 >> v2:172.21.15.161:3300/0 conn(0x7f5ae40c1500 0x7f5ae40a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.172+0000 7f5ae8a45640 1 -- 172.21.15.132:0/443816467 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae40c0910 con 0x7f5ae4155490 2023-11-18T20:41:27.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.172+0000 7f5ae3fff640 1 --2- 172.21.15.132:0/443816467 >> v2:172.21.15.161:3300/0 conn(0x7f5ae40c1500 0x7f5ae40a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:27.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.173+0000 7f5ae8a45640 1 --2- 172.21.15.132:0/443816467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae40a51b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40a5160 tx=0x7f5ad802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18dfb9c52cbc1ec2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:27.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.173+0000 7f5ae37fe640 1 -- 172.21.15.132:0/443816467 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad80317d0 con 0x7f5ae4155490 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.173+0000 7f5ae37fe640 1 -- 172.21.15.132:0/443816467 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad8031930 con 0x7f5ae4155490 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.173+0000 7f5ae37fe640 1 -- 172.21.15.132:0/443816467 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8031cc0 con 0x7f5ae4155490 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 -- 172.21.15.132:0/443816467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 msgr2=0x7f5ae40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/443816467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae40a51b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40a5160 tx=0x7f5ad802b870 comp rx=0 tx=0).stop 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 -- 172.21.15.132:0/443816467 shutdown_connections 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/443816467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 0x7f5ae40a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/443816467 >> v2:172.21.15.161:3300/0 conn(0x7f5ae40c1500 0x7f5ae40a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/443816467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae40a51b0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 -- 172.21.15.132:0/443816467 >> 172.21.15.132:0/443816467 conn(0x7f5ae406a500 msgr2=0x7f5ae406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:27.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 -- 172.21.15.132:0/443816467 shutdown_connections 2023-11-18T20:41:27.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.174+0000 7f5aeaca9640 1 -- 172.21.15.132:0/443816467 wait complete. 2023-11-18T20:41:27.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.176+0000 7f5aeaca9640 1 Processor -- start 2023-11-18T20:41:27.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.176+0000 7f5aeaca9640 1 -- start start 2023-11-18T20:41:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5aeaca9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ae40c1500 0x7f5ae414b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5aeaca9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 0x7f5ae4149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5aeaca9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae4149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5aeaca9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae414aad0 con 0x7f5ae4155490 2023-11-18T20:41:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5aeaca9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae41e8750 con 0x7f5ae40c1500 2023-11-18T20:41:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5aeaca9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae406fed0 con 0x7f5ae40c4080 2023-11-18T20:41:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5ae9246640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae4149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5ae9246640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae4149550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56400/0 (socket says 172.21.15.132:56400) 2023-11-18T20:41:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5ae9246640 1 -- 172.21.15.132:0/529814345 learned_addr learned my addr 172.21.15.132:0/529814345 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5ae8a45640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ae40c1500 0x7f5ae414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.177+0000 7f5ae3fff640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 0x7f5ae4149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae9246640 1 -- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 msgr2=0x7f5ae4149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae9246640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 0x7f5ae4149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae9246640 1 -- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ae40c1500 msgr2=0x7f5ae414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae9246640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ae40c1500 0x7f5ae414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae9246640 1 -- 172.21.15.132:0/529814345 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80094d0 con 0x7f5ae4155490 2023-11-18T20:41:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae9246640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae4149550 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00cda0 tx=0x7f5adc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae17fa640 1 -- 172.21.15.132:0/529814345 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc003b90 con 0x7f5ae4155490 2023-11-18T20:41:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae17fa640 1 -- 172.21.15.132:0/529814345 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc003cf0 con 0x7f5ae4155490 2023-11-18T20:41:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5ae17fa640 1 -- 172.21.15.132:0/529814345 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc004240 con 0x7f5ae4155490 2023-11-18T20:41:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae414bfb0 con 0x7f5ae4155490 2023-11-18T20:41:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.178+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae414acb0 con 0x7f5ae4155490 2023-11-18T20:41:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.179+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae4070080 con 0x7f5ae4155490 2023-11-18T20:41:27.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.180+0000 7f5ae17fa640 1 -- 172.21.15.132:0/529814345 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5adc0043a0 con 0x7f5ae4155490 2023-11-18T20:41:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.182+0000 7f5ae17fa640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ac806ae40 0x7f5ac806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.182+0000 7f5ae17fa640 1 -- 172.21.15.132:0/529814345 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5adc012070 con 0x7f5ae4155490 2023-11-18T20:41:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.182+0000 7f5ae8a45640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ac806ae40 0x7f5ac806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.183+0000 7f5ae8a45640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ac806ae40 0x7f5ac806d300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8036000 tx=0x7f5ad803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:27.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.186+0000 7f5ae17fa640 1 -- 172.21.15.132:0/529814345 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ae4070080 con 0x7f5ae4155490 2023-11-18T20:41:27.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.414+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ae4066af0 con 0x7f5ae4155490 2023-11-18T20:41:27.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.415+0000 7f5ae17fa640 1 -- 172.21.15.132:0/529814345 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5ae4066af0 con 0x7f5ae4155490 2023-11-18T20:41:27.416 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ac806ae40 msgr2=0x7f5ac806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ac806ae40 0x7f5ac806d300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8036000 tx=0x7f5ad803d040 comp rx=0 tx=0).stop 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 msgr2=0x7f5ae4149550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae4149550 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00cda0 tx=0x7f5adc00a660 comp rx=0 tx=0).stop 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 shutdown_connections 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ac806ae40 0x7f5ac806d300 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae4155490 0x7f5ae4149550 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ae40c4080 0x7f5ae4149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 --2- 172.21.15.132:0/529814345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ae40c1500 0x7f5ae414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:27.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 >> 172.21.15.132:0/529814345 conn(0x7f5ae406a500 msgr2=0x7f5ae406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:27.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 shutdown_connections 2023-11-18T20:41:27.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:27.418+0000 7f5aeaca9640 1 -- 172.21.15.132:0/529814345 wait complete. 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:41:27.437 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:41:27.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:27.438 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-18T20:41:27.490 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:27.491 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42223sec preferred_lft 42223sec 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:41:27.492 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:27.493 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::84fc:84ff:fe41:e5e7/64 scope link 2023-11-18T20:41:27.493 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:27.493 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:41:27.493 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T20:41:27.493 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a88f:ebff:fe95:c612/64 scope link 2023-11-18T20:41:27.493 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:27.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:27.494 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:41:27.581 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-18T20:41:27.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:27.585 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-18T20:41:27.637 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-18T20:41:27.638 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:41:27.638 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:41:27.638 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:41:27.638 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:41:27.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:27.638 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:41:27.639 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:41:27.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:41:27.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:41:27.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:41:27.639 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:41:27.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:27.820 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:41:27.870 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T20:41:27.871 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:41:27.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:27.871 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-18T20:41:27.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:27.959 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:28.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:28.011 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:28.061 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:41:28.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:28.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:41:28.191 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:41:28.191 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:41:28.192 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:41:28.211 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:41:28.211 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:41:28.212 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:41:28.212 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:28.212 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:28.240 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-18T20:41:28.240 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-18T20:41:28.240 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:41:28.240 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:28.240 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:28.241 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:41:28.241 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:41:28.241 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:41:28.243 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-18T20:41:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:41:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:41:28.243 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:41:28.244 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:41:28.248 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:41:28.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:28.248 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:28.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:28.334 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:41:28.399 INFO:teuthology.orchestra.run.smithi132.stdout:client5422 2023-11-18T20:41:28.399 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:28.399 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:28.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:41:28.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.707+0000 7f19f417d640 1 Processor -- start 2023-11-18T20:41:28.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.707+0000 7f19f417d640 1 -- start start 2023-11-18T20:41:28.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.708+0000 7f19f417d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19ec0a9b40 0x7f19ec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:28.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.708+0000 7f19f417d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:28.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.708+0000 7f19f417d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec0c06c0 con 0x7f19ec155490 2023-11-18T20:41:28.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.708+0000 7f19f417d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0a5820 con 0x7f19ec0a9b40 2023-11-18T20:41:28.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.708+0000 7f19f417d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0c1020 con 0x7f19ec0c1500 2023-11-18T20:41:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.709+0000 7f19f1718640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19ec0a9b40 0x7f19ec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.709+0000 7f19f271a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.709+0000 7f19f1f19640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f19ec155490 0x7f19ec0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:42448/0 (socket says 172.21.15.132:42448) 2023-11-18T20:41:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.709+0000 7f19f1718640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19ec0a9b40 0x7f19ec0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:54420/0 (socket says 172.21.15.132:54420) 2023-11-18T20:41:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.709+0000 7f19f1f19640 1 -- 172.21.15.132:0/3618398956 learned_addr learned my addr 172.21.15.132:0/3618398956 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.710+0000 7f19f271a640 1 -- 172.21.15.132:0/3618398956 >> v2:172.21.15.161:3300/0 conn(0x7f19ec0a9b40 msgr2=0x7f19ec0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.710+0000 7f19f271a640 1 --2- 172.21.15.132:0/3618398956 >> v2:172.21.15.161:3300/0 conn(0x7f19ec0a9b40 0x7f19ec0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.710+0000 7f19f271a640 1 -- 172.21.15.132:0/3618398956 >> v1:172.21.15.161:6789/0 conn(0x7f19ec155490 legacy=0x7f19ec0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.710+0000 7f19f271a640 1 -- 172.21.15.132:0/3618398956 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec0c0910 con 0x7f19ec0c1500 2023-11-18T20:41:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.711+0000 7f19f271a640 1 --2- 172.21.15.132:0/3618398956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec0c24d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009d90 tx=0x7f19e402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90e31d6f99b8f0e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.712+0000 7f19f0f17640 1 -- 172.21.15.132:0/3618398956 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e402cc50 con 0x7f19ec0c1500 2023-11-18T20:41:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.712+0000 7f19f0f17640 1 -- 172.21.15.132:0/3618398956 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e402cdb0 con 0x7f19ec0c1500 2023-11-18T20:41:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.712+0000 7f19f0f17640 1 -- 172.21.15.132:0/3618398956 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4034660 con 0x7f19ec0c1500 2023-11-18T20:41:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.713+0000 7f19f417d640 1 -- 172.21.15.132:0/3618398956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 msgr2=0x7f19ec0c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.713+0000 7f19f417d640 1 --2- 172.21.15.132:0/3618398956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec0c24d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009d90 tx=0x7f19e402bea0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.713+0000 7f19f417d640 1 -- 172.21.15.132:0/3618398956 shutdown_connections 2023-11-18T20:41:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.713+0000 7f19f417d640 1 --2- 172.21.15.132:0/3618398956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec0c24d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.713+0000 7f19f417d640 1 --2- 172.21.15.132:0/3618398956 >> v2:172.21.15.161:3300/0 conn(0x7f19ec0a9b40 0x7f19ec0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.713+0000 7f19f417d640 1 -- 172.21.15.132:0/3618398956 >> 172.21.15.132:0/3618398956 conn(0x7f19ec06a500 msgr2=0x7f19ec06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.713+0000 7f19f417d640 1 -- 172.21.15.132:0/3618398956 shutdown_connections 2023-11-18T20:41:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.713+0000 7f19f417d640 1 -- 172.21.15.132:0/3618398956 wait complete. 2023-11-18T20:41:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.715+0000 7f19f417d640 1 Processor -- start 2023-11-18T20:41:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.715+0000 7f19f417d640 1 -- start start 2023-11-18T20:41:28.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f417d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec1ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f417d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ec155490 0x7f19ec150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f417d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19ec151340 0x7f19ec150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f417d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1deb00 con 0x7f19ec151340 2023-11-18T20:41:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f417d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1dbf70 con 0x7f19ec155490 2023-11-18T20:41:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f417d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1db940 con 0x7f19ec0c1500 2023-11-18T20:41:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f271a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19ec151340 0x7f19ec150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f271a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19ec151340 0x7f19ec150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36622/0 (socket says 172.21.15.132:36622) 2023-11-18T20:41:28.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f271a640 1 -- 172.21.15.132:0/3531476789 learned_addr learned my addr 172.21.15.132:0/3531476789 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:28.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f1f19640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec1ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:28.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f1718640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ec155490 0x7f19ec150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:28.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f271a640 1 -- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 msgr2=0x7f19ec1ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:28.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f271a640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec1ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f271a640 1 -- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ec155490 msgr2=0x7f19ec150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:28.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f271a640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ec155490 0x7f19ec150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.716+0000 7f19f271a640 1 -- 172.21.15.132:0/3531476789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4009a70 con 0x7f19ec151340 2023-11-18T20:41:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.717+0000 7f19f1f19640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec1ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.717+0000 7f19f271a640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19ec151340 0x7f19ec150780 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009eb0 tx=0x7f19e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.717+0000 7f19de7fc640 1 -- 172.21.15.132:0/3531476789 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e403e610 con 0x7f19ec151340 2023-11-18T20:41:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.717+0000 7f19de7fc640 1 -- 172.21.15.132:0/3531476789 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e403e770 con 0x7f19ec151340 2023-11-18T20:41:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.717+0000 7f19de7fc640 1 -- 172.21.15.132:0/3531476789 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e403eb20 con 0x7f19ec151340 2023-11-18T20:41:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.717+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec1ede40 con 0x7f19ec151340 2023-11-18T20:41:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.717+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec1dbb90 con 0x7f19ec151340 2023-11-18T20:41:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.719+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec068350 con 0x7f19ec151340 2023-11-18T20:41:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.719+0000 7f19de7fc640 1 -- 172.21.15.132:0/3531476789 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19e403b050 con 0x7f19ec151340 2023-11-18T20:41:28.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.720+0000 7f19de7fc640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19d006ae40 0x7f19d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:28.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.720+0000 7f19de7fc640 1 -- 172.21.15.132:0/3531476789 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19e40abe20 con 0x7f19ec151340 2023-11-18T20:41:28.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.721+0000 7f19f1f19640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19d006ae40 0x7f19d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:28.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.722+0000 7f19f1f19640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19d006ae40 0x7f19d006d300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005880 tx=0x7f19e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:28.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.725+0000 7f19de7fc640 1 -- 172.21.15.132:0/3531476789 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19e4076f60 con 0x7f19ec151340 2023-11-18T20:41:28.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.959+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19ec0675d0 con 0x7f19ec151340 2023-11-18T20:41:28.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.960+0000 7f19de7fc640 1 -- 172.21.15.132:0/3531476789 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7f19e407a580 con 0x7f19ec151340 2023-11-18T20:41:28.961 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:41:28.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19d006ae40 msgr2=0x7f19d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:28.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19d006ae40 0x7f19d006d300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005880 tx=0x7f19e8009040 comp rx=0 tx=0).stop 2023-11-18T20:41:28.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19ec151340 msgr2=0x7f19ec150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:28.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19ec151340 0x7f19ec150780 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009eb0 tx=0x7f19e4004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:28.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 shutdown_connections 2023-11-18T20:41:28.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f19d006ae40 0x7f19d006d300 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19ec151340 0x7f19ec150780 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ec155490 0x7f19ec150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 --2- 172.21.15.132:0/3531476789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ec0c1500 0x7f19ec1ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:28.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 >> 172.21.15.132:0/3531476789 conn(0x7f19ec06a500 msgr2=0x7f19ec0aa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:28.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 shutdown_connections 2023-11-18T20:41:28.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:28.963+0000 7f19f417d640 1 -- 172.21.15.132:0/3531476789 wait complete. 2023-11-18T20:41:28.983 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T20:41:28.984 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:41:28.984 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-18T20:41:28.984 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T20:41:28.984 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:28.984 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T20:41:28.984 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:41:28.985 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:41:28.985 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:28.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:28.985 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-18T20:41:29.047 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:41:29.047 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:41:29.048 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:41:29.048 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:29.048 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-18T20:41:29.048 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:29.048 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:29.048 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:29.048 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-18T20:41:29.049 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:29.049 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:29.049 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-18T20:41:29.049 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:29.049 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:29.049 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:41:29.049 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:29.049 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:41:29.050 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42220sec preferred_lft 42220sec 2023-11-18T20:41:29.050 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-18T20:41:29.050 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:29.050 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:41:29.050 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:29.050 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:41:29.050 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:29.051 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::78f3:28ff:fe93:897/64 scope link 2023-11-18T20:41:29.051 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:29.051 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:41:29.051 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:41:29.051 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::442e:5aff:fe28:3e67/64 scope link 2023-11-18T20:41:29.051 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:29.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:29.053 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:41:29.145 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:41:29.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:29.150 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-18T20:41:29.204 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-18T20:41:29.205 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:41:29.205 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:41:29.205 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:41:29.205 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:41:29.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:29.206 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:41:29.206 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:41:29.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:41:29.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:41:29.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:41:29.206 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:41:29.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:29.388 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:41:29.445 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T20:41:29.447 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:29.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:29.447 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-18T20:41:29.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:29.547 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:29.604 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:29.605 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:29.605 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:29.657 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:41:29.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:29.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:41:29.794 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:41:29.794 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:41:29.794 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:29.816 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:41:29.817 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:41:29.817 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:29.817 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:29.817 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:29.844 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-18T20:41:29.844 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-18T20:41:29.844 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:29.845 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:29.845 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:29.845 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:41:29.845 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:41:29.845 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:41:29.847 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T20:41:29.847 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:41:29.847 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:41:29.847 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:41:29.848 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:41:29.852 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:41:29.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:29.852 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:29.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:29.945 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:41:30.005 INFO:teuthology.orchestra.run.smithi161.stdout:client6684 2023-11-18T20:41:30.005 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:30.005 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:30.062 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-18T20:41:30.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.292+0000 7f40c3147640 1 Processor -- start 2023-11-18T20:41:30.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.292+0000 7f40c3147640 1 -- start start 2023-11-18T20:41:30.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c3147640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 0x7f40bc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c3147640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40bc06cd20 0x7f40bc15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c3147640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc0a8380 con 0x7f40bc14e7f0 2023-11-18T20:41:30.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c3147640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc1510b0 con 0x7f40bc06cd20 2023-11-18T20:41:30.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c3147640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc06bf60 con 0x7f40bc0c52e0 2023-11-18T20:41:30.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c2946640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40bc06cd20 0x7f40bc15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c2145640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f40bc14e7f0 0x7f40bc0c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39448/0 (socket says 172.21.15.132:39448) 2023-11-18T20:41:30.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c2946640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40bc06cd20 0x7f40bc15ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36638/0 (socket says 172.21.15.132:36638) 2023-11-18T20:41:30.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c2145640 1 -- 172.21.15.132:0/2401216215 learned_addr learned my addr 172.21.15.132:0/2401216215 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:30.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.294+0000 7f40c1944640 1 --2- 172.21.15.132:0/2401216215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 0x7f40bc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.295+0000 7f40c2946640 1 -- 172.21.15.132:0/2401216215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 msgr2=0x7f40bc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:30.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.295+0000 7f40c2946640 1 --2- 172.21.15.132:0/2401216215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 0x7f40bc06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.295+0000 7f40c2946640 1 -- 172.21.15.132:0/2401216215 >> v1:172.21.15.132:6789/0 conn(0x7f40bc14e7f0 legacy=0x7f40bc0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.295+0000 7f40c2946640 1 -- 172.21.15.132:0/2401216215 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc06c240 con 0x7f40bc06cd20 2023-11-18T20:41:30.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.295+0000 7f40c1143640 1 -- 172.21.15.132:0/2401216215 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310985549 0 0) 0x7f40bc0a8380 con 0x7f40bc14e7f0 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.296+0000 7f40c2946640 1 --2- 172.21.15.132:0/2401216215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc15ba30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009d90 tx=0x7f40b402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a591fddf911f7821 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.296+0000 7f40c1143640 1 -- 172.21.15.132:0/2401216215 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b402cbc0 con 0x7f40bc06cd20 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.296+0000 7f40c1143640 1 -- 172.21.15.132:0/2401216215 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b402cd20 con 0x7f40bc06cd20 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.296+0000 7f40c1143640 1 -- 172.21.15.132:0/2401216215 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4034660 con 0x7f40bc06cd20 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.296+0000 7f40c3147640 1 -- 172.21.15.132:0/2401216215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 msgr2=0x7f40bc15ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.296+0000 7f40c3147640 1 --2- 172.21.15.132:0/2401216215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc15ba30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009d90 tx=0x7f40b402be10 comp rx=0 tx=0).stop 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.297+0000 7f40c3147640 1 -- 172.21.15.132:0/2401216215 shutdown_connections 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.297+0000 7f40c3147640 1 --2- 172.21.15.132:0/2401216215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc15ba30 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.297+0000 7f40c3147640 1 --2- 172.21.15.132:0/2401216215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 0x7f40bc06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.297+0000 7f40c3147640 1 -- 172.21.15.132:0/2401216215 >> 172.21.15.132:0/2401216215 conn(0x7f40bc0a77f0 msgr2=0x7f40bc0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:30.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.297+0000 7f40c3147640 1 -- 172.21.15.132:0/2401216215 shutdown_connections 2023-11-18T20:41:30.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.297+0000 7f40c3147640 1 -- 172.21.15.132:0/2401216215 wait complete. 2023-11-18T20:41:30.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.298+0000 7f40c3147640 1 Processor -- start 2023-11-18T20:41:30.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.299+0000 7f40c3147640 1 -- start start 2023-11-18T20:41:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.299+0000 7f40c3147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.299+0000 7f40c3147640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 0x7f40bc14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.299+0000 7f40c3147640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40bc14e7f0 0x7f40bc148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.299+0000 7f40c3147640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc14a360 con 0x7f40bc06cd20 2023-11-18T20:41:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.299+0000 7f40c3147640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0a56a0 con 0x7f40bc14e7f0 2023-11-18T20:41:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.299+0000 7f40c3147640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc14b380 con 0x7f40bc0c52e0 2023-11-18T20:41:30.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc0a5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36654/0 (socket says 172.21.15.132:36654) 2023-11-18T20:41:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 -- 172.21.15.132:0/3185479826 learned_addr learned my addr 172.21.15.132:0/3185479826 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c1944640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 0x7f40bc14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 -- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 msgr2=0x7f40bc14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 0x7f40bc14aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 -- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40bc14e7f0 msgr2=0x7f40bc148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40bc14e7f0 0x7f40bc148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 -- 172.21.15.132:0/3185479826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4009a70 con 0x7f40bc06cd20 2023-11-18T20:41:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.300+0000 7f40c2145640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc0a5160 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c430 tx=0x7f40b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.301+0000 7f40b2ffd640 1 -- 172.21.15.132:0/3185479826 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b80074e0 con 0x7f40bc06cd20 2023-11-18T20:41:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.301+0000 7f40b2ffd640 1 -- 172.21.15.132:0/3185479826 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b8007660 con 0x7f40bc06cd20 2023-11-18T20:41:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.301+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc14b660 con 0x7f40bc06cd20 2023-11-18T20:41:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.301+0000 7f40b2ffd640 1 -- 172.21.15.132:0/3185479826 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8004a20 con 0x7f40bc06cd20 2023-11-18T20:41:30.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.301+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc14a5b0 con 0x7f40bc06cd20 2023-11-18T20:41:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.302+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc14a7a0 con 0x7f40bc06cd20 2023-11-18T20:41:30.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.303+0000 7f40b2ffd640 1 -- 172.21.15.132:0/3185479826 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40b8004b80 con 0x7f40bc06cd20 2023-11-18T20:41:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.304+0000 7f40b2ffd640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40a006ae40 0x7f40a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.305+0000 7f40b2ffd640 1 -- 172.21.15.132:0/3185479826 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40b8089550 con 0x7f40bc06cd20 2023-11-18T20:41:30.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.305+0000 7f40c1944640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40a006ae40 0x7f40a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.306+0000 7f40c1944640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40a006ae40 0x7f40a006d300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0c4240 tx=0x7f40ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:30.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.309+0000 7f40b2ffd640 1 -- 172.21.15.132:0/3185479826 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40b80544d0 con 0x7f40bc06cd20 2023-11-18T20:41:30.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.568+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f40bc04e840 con 0x7f40bc06cd20 2023-11-18T20:41:30.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.569+0000 7f40b2ffd640 1 -- 172.21.15.132:0/3185479826 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7f40b8057af0 con 0x7f40bc06cd20 2023-11-18T20:41:30.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40a006ae40 msgr2=0x7f40a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40a006ae40 0x7f40a006d300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0c4240 tx=0x7f40ac008040 comp rx=0 tx=0).stop 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 msgr2=0x7f40bc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc0a5160 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c430 tx=0x7f40b800c8f0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 shutdown_connections 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f40a006ae40 0x7f40a006d300 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40bc14e7f0 0x7f40bc148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40bc0c52e0 0x7f40bc14aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 --2- 172.21.15.132:0/3185479826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40bc06cd20 0x7f40bc0a5160 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 >> 172.21.15.132:0/3185479826 conn(0x7f40bc0a77f0 msgr2=0x7f40bc0c44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 shutdown_connections 2023-11-18T20:41:30.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.572+0000 7f40c3147640 1 -- 172.21.15.132:0/3185479826 wait complete. 2023-11-18T20:41:30.591 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.801+0000 7fda24dfc640 1 Processor -- start 2023-11-18T20:41:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.801+0000 7fda24dfc640 1 -- start start 2023-11-18T20:41:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.802+0000 7fda24dfc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda20152f20 0x7fda200c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.803+0000 7fda24dfc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda200c64a0 con 0x7fda2006d0a0 2023-11-18T20:41:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.803+0000 7fda24dfc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda200c5c00 con 0x7fda2014fd30 2023-11-18T20:41:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.803+0000 7fda24dfc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda200c5ee0 con 0x7fda20152f20 2023-11-18T20:41:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.803+0000 7fda1dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fda2006d0a0 0x7fda200c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39452/0 (socket says 172.21.15.132:39452) 2023-11-18T20:41:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.803+0000 7fda1dd9b640 1 -- 172.21.15.132:0/48170547 learned_addr learned my addr 172.21.15.132:0/48170547 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.803+0000 7fda1ed9d640 1 --2- 172.21.15.132:0/48170547 >> v2:172.21.15.161:3300/0 conn(0x7fda20152f20 0x7fda200c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.803+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717292535 0 0) 0x7fda200c64a0 con 0x7fda2006d0a0 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda08003520 con 0x7fda2006d0a0 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 270582526 0 0) 0x7fda08003520 con 0x7fda2006d0a0 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 >> v2:172.21.15.161:3300/0 conn(0x7fda20152f20 msgr2=0x7fda200c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 --2- 172.21.15.132:0/48170547 >> v2:172.21.15.161:3300/0 conn(0x7fda20152f20 0x7fda200c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 >> v1:172.21.15.161:6789/0 conn(0x7fda2014fd30 legacy=0x7fda200a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200c61c0 con 0x7fda2006d0a0 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fda14001670 con 0x7fda2006d0a0 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 >> v1:172.21.15.132:6789/0 conn(0x7fda2006d0a0 legacy=0x7fda200c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda080039c0 0x7fda08003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda080047c0 0x7fda08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda08005180 0x7fda0800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c5ee0 con 0x7fda08005180 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0800c080 con 0x7fda080039c0 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0800c240 con 0x7fda080047c0 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.804+0000 7fda1ed9d640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda08005180 0x7fda0800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.805+0000 7fda1ed9d640 1 -- 172.21.15.132:0/48170547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda080047c0 msgr2=0x7fda08004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.805+0000 7fda1ed9d640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda080047c0 0x7fda08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.805+0000 7fda1ed9d640 1 -- 172.21.15.132:0/48170547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda080039c0 msgr2=0x7fda08003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.805+0000 7fda1e59c640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda080039c0 0x7fda08003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.805+0000 7fda1ed9d640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda080039c0 0x7fda08003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.805+0000 7fda1ed9d640 1 -- 172.21.15.132:0/48170547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda08003520 con 0x7fda08005180 2023-11-18T20:41:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.805+0000 7fda1e59c640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda080039c0 0x7fda08003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.806+0000 7fda1ed9d640 1 -- 172.21.15.132:0/48170547 reap_dead start 2023-11-18T20:41:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.806+0000 7fda1ed9d640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda08005180 0x7fda0800b980 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fda18009fc0 tx=0x7fda080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d5d22eb05e8ead server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.806+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1802cc60 con 0x7fda08005180 2023-11-18T20:41:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.806+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800f040 con 0x7fda08005180 2023-11-18T20:41:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.806+0000 7fda1d59a640 1 -- 172.21.15.132:0/48170547 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18003990 con 0x7fda08005180 2023-11-18T20:41:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.807+0000 7fda24dfc640 1 -- 172.21.15.132:0/48170547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda08005180 msgr2=0x7fda0800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.807+0000 7fda24dfc640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda08005180 0x7fda0800b980 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fda18009fc0 tx=0x7fda080057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.807+0000 7fda24dfc640 1 -- 172.21.15.132:0/48170547 shutdown_connections 2023-11-18T20:41:30.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.807+0000 7fda24dfc640 1 --2- 172.21.15.132:0/48170547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda08005180 0x7fda0800b980 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.807+0000 7fda24dfc640 1 -- 172.21.15.132:0/48170547 >> 172.21.15.132:0/48170547 conn(0x7fda2006a500 msgr2=0x7fda2006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:30.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.807+0000 7fda24dfc640 1 -- 172.21.15.132:0/48170547 shutdown_connections 2023-11-18T20:41:30.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.807+0000 7fda24dfc640 1 -- 172.21.15.132:0/48170547 wait complete. 2023-11-18T20:41:30.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.809+0000 7fda24dfc640 1 Processor -- start 2023-11-18T20:41:30.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.809+0000 7fda24dfc640 1 -- start start 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda24dfc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda08005180 0x7fda20149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda24dfc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda200c00b0 0x7fda200a7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda24dfc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda200a7d80 0x7fda200a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda24dfc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201e35e0 con 0x7fda200c00b0 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda24dfc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2014a440 con 0x7fda08005180 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda24dfc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda20153b10 con 0x7fda200a7d80 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda200c00b0 0x7fda200a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda200c00b0 0x7fda200a7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36674/0 (socket says 172.21.15.132:36674) 2023-11-18T20:41:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1dd9b640 1 -- 172.21.15.132:0/2378921147 learned_addr learned my addr 172.21.15.132:0/2378921147 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1e59c640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda08005180 0x7fda20149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1dd9b640 1 -- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda200a7d80 msgr2=0x7fda200a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1dd9b640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda200a7d80 0x7fda200a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1dd9b640 1 -- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda08005180 msgr2=0x7fda20149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1dd9b640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda08005180 0x7fda20149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1dd9b640 1 -- 172.21.15.132:0/2378921147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200a5950 con 0x7fda200c00b0 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.810+0000 7fda1e59c640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda08005180 0x7fda20149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.811+0000 7fda1dd9b640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda200c00b0 0x7fda200a7840 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c700 tx=0x7fda1400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.811+0000 7fda0effd640 1 -- 172.21.15.132:0/2378921147 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140072d0 con 0x7fda200c00b0 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.811+0000 7fda0effd640 1 -- 172.21.15.132:0/2378921147 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14007430 con 0x7fda200c00b0 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.811+0000 7fda0effd640 1 -- 172.21.15.132:0/2378921147 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140047e0 con 0x7fda200c00b0 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.811+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda20156500 con 0x7fda200c00b0 2023-11-18T20:41:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.811+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda200a5c10 con 0x7fda200c00b0 2023-11-18T20:41:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.812+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda20068350 con 0x7fda200c00b0 2023-11-18T20:41:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.813+0000 7fda0effd640 1 -- 172.21.15.132:0/2378921147 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda14004940 con 0x7fda200c00b0 2023-11-18T20:41:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.814+0000 7fda0effd640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda0006ae70 0x7fda0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.814+0000 7fda0effd640 1 -- 172.21.15.132:0/2378921147 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda14088900 con 0x7fda200c00b0 2023-11-18T20:41:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.815+0000 7fda1e59c640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda0006ae70 0x7fda0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.816+0000 7fda1e59c640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda0006ae70 0x7fda0006d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda100016f0 tx=0x7fda10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:30.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:30.818+0000 7fda0effd640 1 -- 172.21.15.132:0/2378921147 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda14053910 con 0x7fda200c00b0 2023-11-18T20:41:31.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.010+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda200c66d0 con 0x7fda200c00b0 2023-11-18T20:41:31.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.012+0000 7fda0effd640 1 -- 172.21.15.132:0/2378921147 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16608 (secure 0 0 0) 0x7fda14018020 con 0x7fda200c00b0 2023-11-18T20:41:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:31.014 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":76,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:21.071396+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.014+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda0006ae70 msgr2=0x7fda0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.014+0000 7fda24dfc640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda0006ae70 0x7fda0006d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda100016f0 tx=0x7fda10009040 comp rx=0 tx=0).stop 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.014+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda200c00b0 msgr2=0x7fda200a7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.014+0000 7fda24dfc640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda200c00b0 0x7fda200a7840 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c700 tx=0x7fda1400cbc0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.014+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 shutdown_connections 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.014+0000 7fda24dfc640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fda0006ae70 0x7fda0006d330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.014+0000 7fda24dfc640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda200a7d80 0x7fda200a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.014+0000 7fda24dfc640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda200c00b0 0x7fda200a7840 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.015+0000 7fda24dfc640 1 --2- 172.21.15.132:0/2378921147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda08005180 0x7fda20149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.015+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 >> 172.21.15.132:0/2378921147 conn(0x7fda2006a500 msgr2=0x7fda2014cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:31.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.015+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 shutdown_connections 2023-11-18T20:41:31.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.015+0000 7fda24dfc640 1 -- 172.21.15.132:0/2378921147 wait complete. 2023-11-18T20:41:31.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:41:17.894376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:41:18.520471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:41:31.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:41:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.251+0000 7f22701d5640 1 Processor -- start 2023-11-18T20:41:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.251+0000 7f22701d5640 1 -- start start 2023-11-18T20:41:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.252+0000 7f22701d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226806c3c0 0x7f22680c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.252+0000 7f22701d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226806ce10 con 0x7f2268158760 2023-11-18T20:41:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.252+0000 7f22701d5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22680c1e80 con 0x7f22680c11c0 2023-11-18T20:41:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.252+0000 7f22701d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2268155800 con 0x7f226806c3c0 2023-11-18T20:41:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.253+0000 7f226e772640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2268158760 0x7f2268151ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39468/0 (socket says 172.21.15.132:39468) 2023-11-18T20:41:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.253+0000 7f226e772640 1 -- 172.21.15.132:0/1239495033 learned_addr learned my addr 172.21.15.132:0/1239495033 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.253+0000 7f226d770640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226806c3c0 0x7f22680c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.253+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924228413 0 0) 0x7f226806ce10 con 0x7f2268158760 2023-11-18T20:41:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.253+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2254003520 con 0x7f2268158760 2023-11-18T20:41:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3989225966 0 0) 0x7f2254003520 con 0x7f2268158760 2023-11-18T20:41:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226806c3c0 msgr2=0x7f22680c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226806c3c0 0x7f22680c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 >> v1:172.21.15.161:6789/0 conn(0x7f22680c11c0 legacy=0x7f22681550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226806c850 con 0x7f2268158760 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f22600019f0 con 0x7f2268158760 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 >> v1:172.21.15.132:6789/0 conn(0x7f2268158760 legacy=0x7f2268151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22540039a0 0x7f2254003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f22540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2254005010 0x7f225400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268155800 con 0x7f22540042e0 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225400bf20 con 0x7f2254005010 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225400c0e0 con 0x7f22540039a0 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.254+0000 7f226d770640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f22540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.255+0000 7f226e772640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2254005010 0x7f225400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.255+0000 7f226d770640 1 -- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22540039a0 msgr2=0x7f2254003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.255+0000 7f226d770640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22540039a0 0x7f2254003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.255+0000 7f226d770640 1 -- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2254005010 msgr2=0x7f225400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:31.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.255+0000 7f226d770640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2254005010 0x7f225400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.255+0000 7f226d770640 1 -- 172.21.15.132:0/1239495033 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254003520 con 0x7f22540042e0 2023-11-18T20:41:31.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.255+0000 7f226e772640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2254005010 0x7f225400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.256+0000 7f226d770640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f22540047c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2258009ac0 tx=0x7f22540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433acecb06d2f33d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.256+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225802c710 con 0x7f22540042e0 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.256+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225802c870 con 0x7f22540042e0 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.256+0000 7f226cf6f640 1 -- 172.21.15.132:0/1239495033 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225802cc00 con 0x7f22540042e0 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.257+0000 7f22701d5640 1 -- 172.21.15.132:0/1239495033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 msgr2=0x7f22540047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.257+0000 7f22701d5640 1 --2- 172.21.15.132:0/1239495033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f22540047c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2258009ac0 tx=0x7f22540057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.257+0000 7f226e772640 1 -- 172.21.15.132:0/1239495033 reap_dead start 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.257+0000 7f22701d5640 1 -- 172.21.15.132:0/1239495033 shutdown_connections 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.257+0000 7f22701d5640 1 -- 172.21.15.132:0/1239495033 >> 172.21.15.132:0/1239495033 conn(0x7f226806a500 msgr2=0x7f226806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.257+0000 7f22701d5640 1 -- 172.21.15.132:0/1239495033 shutdown_connections 2023-11-18T20:41:31.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.257+0000 7f22701d5640 1 -- 172.21.15.132:0/1239495033 wait complete. 2023-11-18T20:41:31.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.259+0000 7f22701d5640 1 Processor -- start 2023-11-18T20:41:31.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.259+0000 7f22701d5640 1 -- start start 2023-11-18T20:41:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f22701d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f2268071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f22701d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2268155bc0 0x7f226814f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f22701d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2268146b70 0x7f2268147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f22701d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268070db0 con 0x7f22540042e0 2023-11-18T20:41:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f22701d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22681df510 con 0x7f2268146b70 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f22701d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2268070340 con 0x7f2268155bc0 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f226df71640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f2268071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f226df71640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f2268071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36684/0 (socket says 172.21.15.132:36684) 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f226df71640 1 -- 172.21.15.132:0/4227666118 learned_addr learned my addr 172.21.15.132:0/4227666118 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f226df71640 1 -- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2268155bc0 msgr2=0x7f226814f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f226df71640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2268155bc0 0x7f226814f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f226df71640 1 -- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2268146b70 msgr2=0x7f2268147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f226df71640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2268146b70 0x7f2268147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.260+0000 7f226df71640 1 -- 172.21.15.132:0/4227666118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22681eda90 con 0x7f22540042e0 2023-11-18T20:41:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.261+0000 7f226df71640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f2268071ea0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f226400c7b0 tx=0x7f226400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.261+0000 7f225e7fc640 1 -- 172.21.15.132:0/4227666118 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264005270 con 0x7f22540042e0 2023-11-18T20:41:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.261+0000 7f225e7fc640 1 -- 172.21.15.132:0/4227666118 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22640053d0 con 0x7f22540042e0 2023-11-18T20:41:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.261+0000 7f225e7fc640 1 -- 172.21.15.132:0/4227666118 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226400a860 con 0x7f22540042e0 2023-11-18T20:41:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.261+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22681df760 con 0x7f22540042e0 2023-11-18T20:41:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.261+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226814ff00 con 0x7f22540042e0 2023-11-18T20:41:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.262+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22680c1b60 con 0x7f22540042e0 2023-11-18T20:41:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.263+0000 7f225e7fc640 1 -- 172.21.15.132:0/4227666118 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f226400a9c0 con 0x7f22540042e0 2023-11-18T20:41:31.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.264+0000 7f225e7fc640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.264+0000 7f225e7fc640 1 -- 172.21.15.132:0/4227666118 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2264088cc0 con 0x7f22540042e0 2023-11-18T20:41:31.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.265+0000 7f226d770640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.266+0000 7f226d770640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f224c06ae70 0x7f224c06d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2258036000 tx=0x7f225802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.269+0000 7f225e7fc640 1 -- 172.21.15.132:0/4227666118 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f226408f080 con 0x7f22540042e0 2023-11-18T20:41:31.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.457+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2268070500 con 0x7f22540042e0 2023-11-18T20:41:31.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.457+0000 7f225e7fc640 1 -- 172.21.15.132:0/4227666118 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2264017070 con 0x7f22540042e0 2023-11-18T20:41:31.459 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:41:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f224c06ae70 msgr2=0x7f224c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f224c06ae70 0x7f224c06d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2258036000 tx=0x7f225802e000 comp rx=0 tx=0).stop 2023-11-18T20:41:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 msgr2=0x7f2268071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f2268071ea0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f226400c7b0 tx=0x7f226400cc70 comp rx=0 tx=0).stop 2023-11-18T20:41:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 shutdown_connections 2023-11-18T20:41:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2268146b70 0x7f2268147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2268155bc0 0x7f226814f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 --2- 172.21.15.132:0/4227666118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540042e0 0x7f2268071ea0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 >> 172.21.15.132:0/4227666118 conn(0x7f226806a500 msgr2=0x7f2268148da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.460+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 shutdown_connections 2023-11-18T20:41:31.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.461+0000 7f22701d5640 1 -- 172.21.15.132:0/4227666118 wait complete. 2023-11-18T20:41:31.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:41:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.685+0000 7f1c3386f640 1 Processor -- start 2023-11-18T20:41:31.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.685+0000 7f1c3386f640 1 -- start start 2023-11-18T20:41:31.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.686+0000 7f1c3386f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c155490 0x7f1c2c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.687+0000 7f1c3386f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c0c06c0 con 0x7f1c2c0c1500 2023-11-18T20:41:31.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.687+0000 7f1c3386f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c0c1020 con 0x7f1c2c0a9b40 2023-11-18T20:41:31.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.687+0000 7f1c3386f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0a5820 con 0x7f1c2c155490 2023-11-18T20:41:31.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.687+0000 7f1c30e0a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1c2c0c1500 0x7f1c2c0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39476/0 (socket says 172.21.15.132:39476) 2023-11-18T20:41:31.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.687+0000 7f1c30e0a640 1 -- 172.21.15.132:0/1321990983 learned_addr learned my addr 172.21.15.132:0/1321990983 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.687+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347059070 0 0) 0x7f1c2c0c06c0 con 0x7f1c2c0c1500 2023-11-18T20:41:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.687+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c18003520 con 0x7f1c2c0c1500 2023-11-18T20:41:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.687+0000 7f1c3160b640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c155490 0x7f1c2c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986398995 0 0) 0x7f1c18003520 con 0x7f1c2c0c1500 2023-11-18T20:41:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c155490 msgr2=0x7f1c2c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c155490 0x7f1c2c0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 >> v1:172.21.15.161:6789/0 conn(0x7f1c2c0a9b40 legacy=0x7f1c2c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0c0910 con 0x7f1c2c0c1500 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f1c1c001670 con 0x7f1c2c0c1500 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 >> v1:172.21.15.132:6789/0 conn(0x7f1c2c0c1500 legacy=0x7f1c2c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c18003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c180047c0 0x7f1c18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c155490 0x7f1c180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800ba80 con 0x7f1c180039a0 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800bbf0 con 0x7f1c180047c0 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800dfc0 con 0x7f1c2c155490 2023-11-18T20:41:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.688+0000 7f1c3160b640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c18003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.689+0000 7f1c3160b640 1 -- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c155490 msgr2=0x7f1c180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:31.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.689+0000 7f1c3160b640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c155490 0x7f1c180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.689+0000 7f1c30e0a640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c180047c0 0x7f1c18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.689+0000 7f1c3160b640 1 -- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c180047c0 msgr2=0x7f1c18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:31.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.689+0000 7f1c3160b640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c180047c0 0x7f1c18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.689+0000 7f1c3160b640 1 -- 172.21.15.132:0/1321990983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18003520 con 0x7f1c180039a0 2023-11-18T20:41:31.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.689+0000 7f1c30e0a640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c180047c0 0x7f1c18004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:31.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.690+0000 7f1c3160b640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c18003dc0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800ba30 tx=0x7f1c180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242568e7177f3026 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:31.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.690+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28032680 con 0x7f1c180039a0 2023-11-18T20:41:31.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.690+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c280327e0 con 0x7f1c180039a0 2023-11-18T20:41:31.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.690+0000 7f1c23fff640 1 -- 172.21.15.132:0/1321990983 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28032b70 con 0x7f1c180039a0 2023-11-18T20:41:31.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.690+0000 7f1c3386f640 1 -- 172.21.15.132:0/1321990983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 msgr2=0x7f1c18003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.690+0000 7f1c3386f640 1 --2- 172.21.15.132:0/1321990983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c18003dc0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800ba30 tx=0x7f1c180057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.690+0000 7f1c31e0c640 1 -- 172.21.15.132:0/1321990983 reap_dead start 2023-11-18T20:41:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.691+0000 7f1c3386f640 1 -- 172.21.15.132:0/1321990983 shutdown_connections 2023-11-18T20:41:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.691+0000 7f1c3386f640 1 -- 172.21.15.132:0/1321990983 >> 172.21.15.132:0/1321990983 conn(0x7f1c2c06a500 msgr2=0x7f1c2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.691+0000 7f1c3386f640 1 -- 172.21.15.132:0/1321990983 shutdown_connections 2023-11-18T20:41:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.691+0000 7f1c3386f640 1 -- 172.21.15.132:0/1321990983 wait complete. 2023-11-18T20:41:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.693+0000 7f1c3386f640 1 Processor -- start 2023-11-18T20:41:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.693+0000 7f1c3386f640 1 -- start start 2023-11-18T20:41:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3386f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c2c1e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3386f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c2c0a7220 0x7f1c2c150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3386f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c0bc7e0 0x7f1c2c1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3386f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0a6840 con 0x7f1c180039a0 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3386f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0a6de0 con 0x7f1c2c0a7220 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3386f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0a6b00 con 0x7f1c2c0bc7e0 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3160b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c2c1e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3160b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c2c1e8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36692/0 (socket says 172.21.15.132:36692) 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3160b640 1 -- 172.21.15.132:0/3968970251 learned_addr learned my addr 172.21.15.132:0/3968970251 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3160b640 1 -- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c0bc7e0 msgr2=0x7f1c2c1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3160b640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c0bc7e0 0x7f1c2c1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3160b640 1 -- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c2c0a7220 msgr2=0x7f1c2c150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3160b640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c2c0a7220 0x7f1c2c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.694+0000 7f1c3160b640 1 -- 172.21.15.132:0/3968970251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0bc2c0 con 0x7f1c180039a0 2023-11-18T20:41:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.695+0000 7f1c3160b640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c2c1e8c70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1c28035040 tx=0x7f1c28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.695+0000 7f1c21ffb640 1 -- 172.21.15.132:0/3968970251 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28030aa0 con 0x7f1c180039a0 2023-11-18T20:41:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.695+0000 7f1c21ffb640 1 -- 172.21.15.132:0/3968970251 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c28030c20 con 0x7f1c180039a0 2023-11-18T20:41:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.695+0000 7f1c21ffb640 1 -- 172.21.15.132:0/3968970251 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2803b420 con 0x7f1c180039a0 2023-11-18T20:41:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.695+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c1e6180 con 0x7f1c180039a0 2023-11-18T20:41:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.695+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c1e91b0 con 0x7f1c180039a0 2023-11-18T20:41:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.696+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c0bc110 con 0x7f1c180039a0 2023-11-18T20:41:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.697+0000 7f1c21ffb640 1 -- 172.21.15.132:0/3968970251 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c2803b580 con 0x7f1c180039a0 2023-11-18T20:41:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.699+0000 7f1c21ffb640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1006ae70 0x7f1c1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.699+0000 7f1c21ffb640 1 -- 172.21.15.132:0/3968970251 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c280abea0 con 0x7f1c180039a0 2023-11-18T20:41:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.699+0000 7f1c30e0a640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1006ae70 0x7f1c1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:31.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.700+0000 7f1c30e0a640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1006ae70 0x7f1c1006d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0017a0 tx=0x7f1c1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:31.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.703+0000 7f1c21ffb640 1 -- 172.21.15.132:0/3968970251 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c280770e0 con 0x7f1c180039a0 2023-11-18T20:41:31.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.894+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c2c0bc450 con 0x7f1c180039a0 2023-11-18T20:41:31.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.895+0000 7f1c21ffb640 1 -- 172.21.15.132:0/3968970251 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c280360a0 con 0x7f1c180039a0 2023-11-18T20:41:31.897 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:41:31.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.897+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1006ae70 msgr2=0x7f1c1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.897+0000 7f1c3386f640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1006ae70 0x7f1c1006d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0017a0 tx=0x7f1c1c009040 comp rx=0 tx=0).stop 2023-11-18T20:41:31.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.897+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 msgr2=0x7f1c2c1e8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:31.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.897+0000 7f1c3386f640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c2c1e8c70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1c28035040 tx=0x7f1c28004730 comp rx=0 tx=0).stop 2023-11-18T20:41:31.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.898+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 shutdown_connections 2023-11-18T20:41:31.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.898+0000 7f1c3386f640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1c1006ae70 0x7f1c1006d330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.898+0000 7f1c3386f640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1c2c0bc7e0 0x7f1c2c1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.898+0000 7f1c3386f640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c2c0a7220 0x7f1c2c150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.898+0000 7f1c3386f640 1 --2- 172.21.15.132:0/3968970251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c180039a0 0x7f1c2c1e8c70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:31.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.898+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 >> 172.21.15.132:0/3968970251 conn(0x7f1c2c06a500 msgr2=0x7f1c2c0c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:31.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.898+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 shutdown_connections 2023-11-18T20:41:31.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:31.898+0000 7f1c3386f640 1 -- 172.21.15.132:0/3968970251 wait complete. 2023-11-18T20:41:31.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:41:32.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.119+0000 7fee6359e640 1 Processor -- start 2023-11-18T20:41:32.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.119+0000 7fee6359e640 1 -- start start 2023-11-18T20:41:32.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee6359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155f60 0x7fee640c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee6359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee6406e000 0x7fee6415be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee6359e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee64159800 con 0x7fee640c1100 2023-11-18T20:41:32.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee6359e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6406c440 con 0x7fee6406e000 2023-11-18T20:41:32.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee6359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee64156340 con 0x7fee64155f60 2023-11-18T20:41:32.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee5bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee6406e000 0x7fee6415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee5bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee6406e000 0x7fee6415be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36698/0 (socket says 172.21.15.132:36698) 2023-11-18T20:41:32.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee62d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fee640c1100 0x7fee6415c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39482/0 (socket says 172.21.15.132:39482) 2023-11-18T20:41:32.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee5bfff640 1 -- 172.21.15.132:0/1407377035 learned_addr learned my addr 172.21.15.132:0/1407377035 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:32.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.121+0000 7fee6259c640 1 --2- 172.21.15.132:0/1407377035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155f60 0x7fee640c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.122+0000 7fee5bfff640 1 -- 172.21.15.132:0/1407377035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155f60 msgr2=0x7fee640c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:32.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.122+0000 7fee5bfff640 1 --2- 172.21.15.132:0/1407377035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155f60 0x7fee640c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.122+0000 7fee5bfff640 1 -- 172.21.15.132:0/1407377035 >> v1:172.21.15.132:6789/0 conn(0x7fee640c1100 legacy=0x7fee6415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.122+0000 7fee61d9b640 1 -- 172.21.15.132:0/1407377035 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917402802 0 0) 0x7fee64159800 con 0x7fee640c1100 2023-11-18T20:41:32.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.122+0000 7fee5bfff640 1 -- 172.21.15.132:0/1407377035 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64158a40 con 0x7fee6406e000 2023-11-18T20:41:32.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.123+0000 7fee5bfff640 1 --2- 172.21.15.132:0/1407377035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee6415be20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009870 tx=0x7fee4c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8f5cc129e841be server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:32.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee61d9b640 1 -- 172.21.15.132:0/1407377035 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c030840 con 0x7fee6406e000 2023-11-18T20:41:32.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee61d9b640 1 -- 172.21.15.132:0/1407377035 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c0309a0 con 0x7fee6406e000 2023-11-18T20:41:32.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee61d9b640 1 -- 172.21.15.132:0/1407377035 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c030d30 con 0x7fee6406e000 2023-11-18T20:41:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee6359e640 1 -- 172.21.15.132:0/1407377035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 msgr2=0x7fee6415be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee6359e640 1 --2- 172.21.15.132:0/1407377035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee6415be20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009870 tx=0x7fee4c02b980 comp rx=0 tx=0).stop 2023-11-18T20:41:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee6359e640 1 -- 172.21.15.132:0/1407377035 shutdown_connections 2023-11-18T20:41:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee6359e640 1 --2- 172.21.15.132:0/1407377035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee6415be20 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee6359e640 1 --2- 172.21.15.132:0/1407377035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155f60 0x7fee640c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee6359e640 1 -- 172.21.15.132:0/1407377035 >> 172.21.15.132:0/1407377035 conn(0x7fee640a77f0 msgr2=0x7fee640a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.124+0000 7fee6359e640 1 -- 172.21.15.132:0/1407377035 shutdown_connections 2023-11-18T20:41:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.125+0000 7fee6359e640 1 -- 172.21.15.132:0/1407377035 wait complete. 2023-11-18T20:41:32.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.126+0000 7fee6359e640 1 Processor -- start 2023-11-18T20:41:32.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.126+0000 7fee6359e640 1 -- start start 2023-11-18T20:41:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee640ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee640c1100 0x7fee640a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee64155f60 0x7fee6415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6359e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6415a260 con 0x7fee6406e000 2023-11-18T20:41:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640aba30 con 0x7fee64155f60 2023-11-18T20:41:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6415a500 con 0x7fee640c1100 2023-11-18T20:41:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee640ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee640ab4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36712/0 (socket says 172.21.15.132:36712) 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.127+0000 7fee6259c640 1 -- 172.21.15.132:0/1009005738 learned_addr learned my addr 172.21.15.132:0/1009005738 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee5bfff640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee640c1100 0x7fee640a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee6259c640 1 -- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee640c1100 msgr2=0x7fee640a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee6259c640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee640c1100 0x7fee640a45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee6259c640 1 -- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee64155f60 msgr2=0x7fee6415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee6259c640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee64155f60 0x7fee6415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee6259c640 1 -- 172.21.15.132:0/1009005738 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0094d0 con 0x7fee6406e000 2023-11-18T20:41:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee6259c640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee640ab4f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fee5400d620 tx=0x7fee5400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:32.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee5affd640 1 -- 172.21.15.132:0/1009005738 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400b620 con 0x7fee6406e000 2023-11-18T20:41:32.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee5affd640 1 -- 172.21.15.132:0/1009005738 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5400b780 con 0x7fee6406e000 2023-11-18T20:41:32.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee5affd640 1 -- 172.21.15.132:0/1009005738 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400bb30 con 0x7fee6406e000 2023-11-18T20:41:32.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.128+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee640a5070 con 0x7fee6406e000 2023-11-18T20:41:32.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.129+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee640a3830 con 0x7fee6406e000 2023-11-18T20:41:32.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.130+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6406d890 con 0x7fee6406e000 2023-11-18T20:41:32.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.131+0000 7fee5affd640 1 -- 172.21.15.132:0/1009005738 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee5400bc90 con 0x7fee6406e000 2023-11-18T20:41:32.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.132+0000 7fee5affd640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee4406ae40 0x7fee4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.132+0000 7fee5affd640 1 -- 172.21.15.132:0/1009005738 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee54089bf0 con 0x7fee6406e000 2023-11-18T20:41:32.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.132+0000 7fee5bfff640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee4406ae40 0x7fee4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.133+0000 7fee5bfff640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee4406ae40 0x7fee4406d300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fee4c036000 tx=0x7fee4c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:32.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.136+0000 7fee5affd640 1 -- 172.21.15.132:0/1009005738 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee54054c00 con 0x7fee6406e000 2023-11-18T20:41:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.328+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee6404e840 con 0x7fee6406e000 2023-11-18T20:41:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.329+0000 7fee5affd640 1 -- 172.21.15.132:0/1009005738 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee54058220 con 0x7fee6406e000 2023-11-18T20:41:32.330 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.331+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee4406ae40 msgr2=0x7fee4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.331+0000 7fee6359e640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee4406ae40 0x7fee4406d300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fee4c036000 tx=0x7fee4c03b040 comp rx=0 tx=0).stop 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.331+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 msgr2=0x7fee640ab4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.331+0000 7fee6359e640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee640ab4f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fee5400d620 tx=0x7fee5400dae0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.332+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 shutdown_connections 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.332+0000 7fee6359e640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee4406ae40 0x7fee4406d300 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.332+0000 7fee6359e640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee64155f60 0x7fee6415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.332+0000 7fee6359e640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee640c1100 0x7fee640a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.332+0000 7fee6359e640 1 --2- 172.21.15.132:0/1009005738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee6406e000 0x7fee640ab4f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.332+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 >> 172.21.15.132:0/1009005738 conn(0x7fee640a77f0 msgr2=0x7fee64156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.332+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 shutdown_connections 2023-11-18T20:41:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.332+0000 7fee6359e640 1 -- 172.21.15.132:0/1009005738 wait complete. 2023-11-18T20:41:32.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T20:41:32.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.563+0000 7fb10b82b640 1 Processor -- start 2023-11-18T20:41:32.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.563+0000 7fb10b82b640 1 -- start start 2023-11-18T20:41:32.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.564+0000 7fb10b82b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb10414fd30 0x7fb104152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.564+0000 7fb10b82b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 0x7fb1040c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb10b82b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1040c64a0 con 0x7fb10406d0a0 2023-11-18T20:41:32.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb10b82b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1040c5c00 con 0x7fb10414fd30 2023-11-18T20:41:32.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb10b82b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040c5ee0 con 0x7fb1040c3ea0 2023-11-18T20:41:32.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb1095c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb10414fd30 0x7fb104152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb108dc6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb10406d0a0 0x7fb1040a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39496/0 (socket says 172.21.15.132:39496) 2023-11-18T20:41:32.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb108dc6640 1 -- 172.21.15.132:0/1157141438 learned_addr learned my addr 172.21.15.132:0/1157141438 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:32.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb1095c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb10414fd30 0x7fb104152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36718/0 (socket says 172.21.15.132:36718) 2023-11-18T20:41:32.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb1095c7640 1 -- 172.21.15.132:0/1157141438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 msgr2=0x7fb1040c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:32.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb1095c7640 1 --2- 172.21.15.132:0/1157141438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 0x7fb1040c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb1095c7640 1 -- 172.21.15.132:0/1157141438 >> v1:172.21.15.132:6789/0 conn(0x7fb10406d0a0 legacy=0x7fb1040a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.565+0000 7fb1095c7640 1 -- 172.21.15.132:0/1157141438 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1040c61c0 con 0x7fb10414fd30 2023-11-18T20:41:32.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.566+0000 7fb1095c7640 1 --2- 172.21.15.132:0/1157141438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10414fd30 0x7fb104152f20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097a0 tx=0x7fb10002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586fd2dac94c5a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:32.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb0fbfff640 1 -- 172.21.15.132:0/1157141438 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10002d040 con 0x7fb10414fd30 2023-11-18T20:41:32.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb0fbfff640 1 -- 172.21.15.132:0/1157141438 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100031810 con 0x7fb10414fd30 2023-11-18T20:41:32.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb0fbfff640 1 -- 172.21.15.132:0/1157141438 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100031ba0 con 0x7fb10414fd30 2023-11-18T20:41:32.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb10b82b640 1 -- 172.21.15.132:0/1157141438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10414fd30 msgr2=0x7fb104152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb10b82b640 1 --2- 172.21.15.132:0/1157141438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10414fd30 0x7fb104152f20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097a0 tx=0x7fb10002b8b0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb10b82b640 1 -- 172.21.15.132:0/1157141438 shutdown_connections 2023-11-18T20:41:32.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb10b82b640 1 --2- 172.21.15.132:0/1157141438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 0x7fb1040c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb10b82b640 1 --2- 172.21.15.132:0/1157141438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10414fd30 0x7fb104152f20 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb10b82b640 1 -- 172.21.15.132:0/1157141438 >> 172.21.15.132:0/1157141438 conn(0x7fb10406a500 msgr2=0x7fb10406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:32.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb10b82b640 1 -- 172.21.15.132:0/1157141438 shutdown_connections 2023-11-18T20:41:32.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.567+0000 7fb10b82b640 1 -- 172.21.15.132:0/1157141438 wait complete. 2023-11-18T20:41:32.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.569+0000 7fb10b82b640 1 Processor -- start 2023-11-18T20:41:32.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.569+0000 7fb10b82b640 1 -- start start 2023-11-18T20:41:32.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.570+0000 7fb10b82b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10406d0a0 0x7fb1040a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.570+0000 7fb10b82b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 0x7fb10414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.570+0000 7fb10b82b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb10414fd30 0x7fb10414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.570+0000 7fb10b82b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10414efd0 con 0x7fb10406d0a0 2023-11-18T20:41:32.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.570+0000 7fb10b82b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1041eb0a0 con 0x7fb10414fd30 2023-11-18T20:41:32.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.570+0000 7fb10b82b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb104150360 con 0x7fb1040c3ea0 2023-11-18T20:41:32.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.570+0000 7fb1095c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10406d0a0 0x7fb1040a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb1095c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10406d0a0 0x7fb1040a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36732/0 (socket says 172.21.15.132:36732) 2023-11-18T20:41:32.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb1095c7640 1 -- 172.21.15.132:0/3760532142 learned_addr learned my addr 172.21.15.132:0/3760532142 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb1095c7640 1 -- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 msgr2=0x7fb10414af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb108dc6640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 0x7fb10414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb109dc8640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb10414fd30 0x7fb10414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb1095c7640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 0x7fb10414af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb1095c7640 1 -- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb10414fd30 msgr2=0x7fb10414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb1095c7640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb10414fd30 0x7fb10414b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb1095c7640 1 -- 172.21.15.132:0/3760532142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100009400 con 0x7fb10406d0a0 2023-11-18T20:41:32.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.571+0000 7fb1095c7640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10406d0a0 0x7fb1040a9ec0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb1000098c0 tx=0x7fb1000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:32.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.572+0000 7fb0f9ffb640 1 -- 172.21.15.132:0/3760532142 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10003ad60 con 0x7fb10406d0a0 2023-11-18T20:41:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.572+0000 7fb0f9ffb640 1 -- 172.21.15.132:0/3760532142 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000443f0 con 0x7fb10406d0a0 2023-11-18T20:41:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.572+0000 7fb0f9ffb640 1 -- 172.21.15.132:0/3760532142 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000447a0 con 0x7fb10406d0a0 2023-11-18T20:41:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.572+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1041515a0 con 0x7fb10406d0a0 2023-11-18T20:41:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.572+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb104151b60 con 0x7fb10406d0a0 2023-11-18T20:41:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.573+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10406fd80 con 0x7fb10406d0a0 2023-11-18T20:41:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.574+0000 7fb0f9ffb640 1 -- 172.21.15.132:0/3760532142 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb10004d450 con 0x7fb10406d0a0 2023-11-18T20:41:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.575+0000 7fb0f9ffb640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0e806ae40 0x7fb0e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.575+0000 7fb0f9ffb640 1 -- 172.21.15.132:0/3760532142 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1000aba60 con 0x7fb10406d0a0 2023-11-18T20:41:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.576+0000 7fb108dc6640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0e806ae40 0x7fb0e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.577+0000 7fb108dc6640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0e806ae40 0x7fb0e806d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb1040c4d30 tx=0x7fb0f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:32.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.579+0000 7fb0f9ffb640 1 -- 172.21.15.132:0/3760532142 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb100076b00 con 0x7fb10406d0a0 2023-11-18T20:41:32.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.774+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb104150520 con 0x7fb10406d0a0 2023-11-18T20:41:32.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.775+0000 7fb0f9ffb640 1 -- 172.21.15.132:0/3760532142 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+209 (secure 0 0 0) 0x7fb10007a120 con 0x7fb10406d0a0 2023-11-18T20:41:32.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:32.776 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-11-18T20:41:32.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:32.776 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 12, 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": "cephfs_metadata" 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 13, 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": "cephfs_data" 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-11-18T20:41:32.777 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-11-18T20:41:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.777+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0e806ae40 msgr2=0x7fb0e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.777+0000 7fb10b82b640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0e806ae40 0x7fb0e806d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb1040c4d30 tx=0x7fb0f4009040 comp rx=0 tx=0).stop 2023-11-18T20:41:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10406d0a0 msgr2=0x7fb1040a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10406d0a0 0x7fb1040a9ec0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb1000098c0 tx=0x7fb1000046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 shutdown_connections 2023-11-18T20:41:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb0e806ae40 0x7fb0e806d300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb10414fd30 0x7fb10414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1040c3ea0 0x7fb10414af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 --2- 172.21.15.132:0/3760532142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10406d0a0 0x7fb1040a9ec0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:32.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 >> 172.21.15.132:0/3760532142 conn(0x7fb10406a500 msgr2=0x7fb10406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:32.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 shutdown_connections 2023-11-18T20:41:32.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:32.778+0000 7fb10b82b640 1 -- 172.21.15.132:0/3760532142 wait complete. 2023-11-18T20:41:32.798 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-18T20:41:32.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-18T20:41:33.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.011+0000 7f505f59e640 1 Processor -- start 2023-11-18T20:41:33.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.011+0000 7f505f59e640 1 -- start start 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5060151910 0x7f50600aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505f59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 0x7f50600c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505f59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50600c8070 con 0x7f50600c98c0 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505f59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50600add40 con 0x7f5060151910 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505f59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600af330 con 0x7f5060154ea0 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5060151910 0x7f50600aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5060151910 0x7f50600aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36746/0 (socket says 172.21.15.132:36746) 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505ed9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f50600c98c0 0x7f50600c8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39512/0 (socket says 172.21.15.132:39512) 2023-11-18T20:41:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f505e59c640 1 -- 172.21.15.132:0/4040961562 learned_addr learned my addr 172.21.15.132:0/4040961562 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:33.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.013+0000 7f5057fff640 1 --2- 172.21.15.132:0/4040961562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 0x7f50600c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.014+0000 7f505e59c640 1 -- 172.21.15.132:0/4040961562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 msgr2=0x7f50600c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:33.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.014+0000 7f505e59c640 1 --2- 172.21.15.132:0/4040961562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 0x7f50600c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.014+0000 7f505e59c640 1 -- 172.21.15.132:0/4040961562 >> v1:172.21.15.132:6789/0 conn(0x7f50600c98c0 legacy=0x7f50600c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.014+0000 7f505e59c640 1 -- 172.21.15.132:0/4040961562 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50600aceb0 con 0x7f5060151910 2023-11-18T20:41:33.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.014+0000 7f505dd9b640 1 -- 172.21.15.132:0/4040961562 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748814095 0 0) 0x7f50600c8070 con 0x7f50600c98c0 2023-11-18T20:41:33.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.015+0000 7f505e59c640 1 --2- 172.21.15.132:0/4040961562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5060151910 0x7f50600aeb40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5050009870 tx=0x7f505002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379acb5c48cfda93 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:33.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.015+0000 7f505dd9b640 1 -- 172.21.15.132:0/4040961562 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050030840 con 0x7f5060151910 2023-11-18T20:41:33.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.015+0000 7f505dd9b640 1 -- 172.21.15.132:0/4040961562 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50500309a0 con 0x7f5060151910 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.015+0000 7f505dd9b640 1 -- 172.21.15.132:0/4040961562 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050030d30 con 0x7f5060151910 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.015+0000 7f505f59e640 1 -- 172.21.15.132:0/4040961562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5060151910 msgr2=0x7f50600aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.016+0000 7f505f59e640 1 --2- 172.21.15.132:0/4040961562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5060151910 0x7f50600aeb40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5050009870 tx=0x7f505002b980 comp rx=0 tx=0).stop 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.016+0000 7f505f59e640 1 -- 172.21.15.132:0/4040961562 shutdown_connections 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.016+0000 7f505f59e640 1 --2- 172.21.15.132:0/4040961562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 0x7f50600c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.016+0000 7f505f59e640 1 --2- 172.21.15.132:0/4040961562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5060151910 0x7f50600aeb40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.016+0000 7f505f59e640 1 -- 172.21.15.132:0/4040961562 >> 172.21.15.132:0/4040961562 conn(0x7f5060072830 msgr2=0x7f50600abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.016+0000 7f505f59e640 1 -- 172.21.15.132:0/4040961562 shutdown_connections 2023-11-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.016+0000 7f505f59e640 1 -- 172.21.15.132:0/4040961562 wait complete. 2023-11-18T20:41:33.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.017+0000 7f505f59e640 1 Processor -- start 2023-11-18T20:41:33.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.018+0000 7f505f59e640 1 -- start start 2023-11-18T20:41:33.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.018+0000 7f505f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50600c98c0 0x7f50601ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.018+0000 7f505f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5060151910 0x7f506006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.018+0000 7f505f59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 0x7f5060152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.018+0000 7f505f59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50600c0ca0 con 0x7f50600c98c0 2023-11-18T20:41:33.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.018+0000 7f505f59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060151cf0 con 0x7f5060151910 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.018+0000 7f505f59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5060151fd0 con 0x7f5060154ea0 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50600c98c0 0x7f50601ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50600c98c0 0x7f50601ea3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36760/0 (socket says 172.21.15.132:36760) 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505e59c640 1 -- 172.21.15.132:0/3792324645 learned_addr learned my addr 172.21.15.132:0/3792324645 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f5057fff640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5060151910 0x7f506006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505e59c640 1 -- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 msgr2=0x7f5060152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505ed9d640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 0x7f5060152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505e59c640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 0x7f5060152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505e59c640 1 -- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5060151910 msgr2=0x7f506006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505e59c640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5060151910 0x7f506006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f505e59c640 1 -- 172.21.15.132:0/3792324645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500094d0 con 0x7f50600c98c0 2023-11-18T20:41:33.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.019+0000 7f5057fff640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5060151910 0x7f506006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:33.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.020+0000 7f505e59c640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50600c98c0 0x7f50601ea3c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f5050000c00 tx=0x7f5050004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:33.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.020+0000 7f5056ffd640 1 -- 172.21.15.132:0/3792324645 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050039c90 con 0x7f50600c98c0 2023-11-18T20:41:33.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.020+0000 7f5056ffd640 1 -- 172.21.15.132:0/3792324645 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5050039df0 con 0x7f50600c98c0 2023-11-18T20:41:33.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.020+0000 7f5056ffd640 1 -- 172.21.15.132:0/3792324645 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050043640 con 0x7f50600c98c0 2023-11-18T20:41:33.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.020+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50601ea900 con 0x7f50600c98c0 2023-11-18T20:41:33.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.020+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5060153400 con 0x7f50600c98c0 2023-11-18T20:41:33.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.021+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506004e840 con 0x7f50600c98c0 2023-11-18T20:41:33.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.022+0000 7f5056ffd640 1 -- 172.21.15.132:0/3792324645 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50500437a0 con 0x7f50600c98c0 2023-11-18T20:41:33.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.023+0000 7f5056ffd640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f504006ae40 0x7f504006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.023+0000 7f5056ffd640 1 -- 172.21.15.132:0/3792324645 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f505003e070 con 0x7f50600c98c0 2023-11-18T20:41:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.024+0000 7f5057fff640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f504006ae40 0x7f504006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.025+0000 7f5057fff640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f504006ae40 0x7f504006d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5048006fd0 tx=0x7f5048008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:33.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.028+0000 7f5056ffd640 1 -- 172.21.15.132:0/3792324645 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5050077800 con 0x7f50600c98c0 2023-11-18T20:41:33.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.216+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f50600c9680 con 0x7f50600c98c0 2023-11-18T20:41:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.422+0000 7f5056ffd640 1 -- 172.21.15.132:0/3792324645 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v77) v1 ==== 140+0+0 (secure 0 0 0) 0x7f505007ae20 con 0x7f50600c98c0 2023-11-18T20:41:33.424 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_metadata' created 2023-11-18T20:41:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f504006ae40 msgr2=0x7f504006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f504006ae40 0x7f504006d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5048006fd0 tx=0x7f5048008040 comp rx=0 tx=0).stop 2023-11-18T20:41:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50600c98c0 msgr2=0x7f50601ea3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50600c98c0 0x7f50601ea3c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f5050000c00 tx=0x7f5050004730 comp rx=0 tx=0).stop 2023-11-18T20:41:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 shutdown_connections 2023-11-18T20:41:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f504006ae40 0x7f504006d300 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5060154ea0 0x7f5060152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5060151910 0x7f506006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 --2- 172.21.15.132:0/3792324645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50600c98c0 0x7f50601ea3c0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 >> 172.21.15.132:0/3792324645 conn(0x7f5060072830 msgr2=0x7f50600abaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:33.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 shutdown_connections 2023-11-18T20:41:33.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.427+0000 7f505f59e640 1 -- 172.21.15.132:0/3792324645 wait complete. 2023-11-18T20:41:33.455 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T20:41:33.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.661+0000 7f2d315ef640 1 Processor -- start 2023-11-18T20:41:33.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.661+0000 7f2d315ef640 1 -- start start 2023-11-18T20:41:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.663+0000 7f2d315ef640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d2c14c2e0 0x7f2d2c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.663+0000 7f2d315ef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c0c0440 0x7f2d2c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.663+0000 7f2d315ef640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c071e80 con 0x7f2d2c072310 2023-11-18T20:41:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.663+0000 7f2d315ef640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c071470 con 0x7f2d2c14c2e0 2023-11-18T20:41:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.663+0000 7f2d315ef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c14c6c0 con 0x7f2d2c0c0440 2023-11-18T20:41:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.663+0000 7f2d2bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d2c14c2e0 0x7f2d2c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.663+0000 7f2d2bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d2c14c2e0 0x7f2d2c0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36774/0 (socket says 172.21.15.132:36774) 2023-11-18T20:41:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.663+0000 7f2d2bfff640 1 -- 172.21.15.132:0/2231026071 learned_addr learned my addr 172.21.15.132:0/2231026071 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.664+0000 7f2d2b7fe640 1 --2- 172.21.15.132:0/2231026071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c0c0440 0x7f2d2c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.664+0000 7f2d2bfff640 1 -- 172.21.15.132:0/2231026071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c0c0440 msgr2=0x7f2d2c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.664+0000 7f2d2bfff640 1 --2- 172.21.15.132:0/2231026071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c0c0440 0x7f2d2c152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.664+0000 7f2d2bfff640 1 -- 172.21.15.132:0/2231026071 >> v1:172.21.15.161:6789/0 conn(0x7f2d2c072310 legacy=0x7f2d2c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.664+0000 7f2d2bfff640 1 -- 172.21.15.132:0/2231026071 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c153180 con 0x7f2d2c14c2e0 2023-11-18T20:41:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.665+0000 7f2d2bfff640 1 --2- 172.21.15.132:0/2231026071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c14c2e0 0x7f2d2c0c0c80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009870 tx=0x7f2d1c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9af792d37bebf6f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.665+0000 7f2d2affd640 1 -- 172.21.15.132:0/2231026071 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0317c0 con 0x7f2d2c14c2e0 2023-11-18T20:41:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.665+0000 7f2d2affd640 1 -- 172.21.15.132:0/2231026071 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c031920 con 0x7f2d2c14c2e0 2023-11-18T20:41:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.665+0000 7f2d2affd640 1 -- 172.21.15.132:0/2231026071 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c031cb0 con 0x7f2d2c14c2e0 2023-11-18T20:41:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.666+0000 7f2d315ef640 1 -- 172.21.15.132:0/2231026071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c14c2e0 msgr2=0x7f2d2c0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.666+0000 7f2d315ef640 1 --2- 172.21.15.132:0/2231026071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c14c2e0 0x7f2d2c0c0c80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009870 tx=0x7f2d1c02b860 comp rx=0 tx=0).stop 2023-11-18T20:41:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.666+0000 7f2d315ef640 1 -- 172.21.15.132:0/2231026071 shutdown_connections 2023-11-18T20:41:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.666+0000 7f2d315ef640 1 --2- 172.21.15.132:0/2231026071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c0c0440 0x7f2d2c152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.666+0000 7f2d315ef640 1 --2- 172.21.15.132:0/2231026071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c14c2e0 0x7f2d2c0c0c80 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.666+0000 7f2d315ef640 1 -- 172.21.15.132:0/2231026071 >> 172.21.15.132:0/2231026071 conn(0x7f2d2c0a77f0 msgr2=0x7f2d2c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.666+0000 7f2d315ef640 1 -- 172.21.15.132:0/2231026071 shutdown_connections 2023-11-18T20:41:33.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.666+0000 7f2d315ef640 1 -- 172.21.15.132:0/2231026071 wait complete. 2023-11-18T20:41:33.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.668+0000 7f2d315ef640 1 Processor -- start 2023-11-18T20:41:33.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.668+0000 7f2d315ef640 1 -- start start 2023-11-18T20:41:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d315ef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c072310 0x7f2d2c0c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d315ef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0c0440 0x7f2d2c1eb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d315ef640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2c14c2e0 0x7f2d2c1eb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d315ef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0bbad0 con 0x7f2d2c0c0440 2023-11-18T20:41:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d315ef640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0bf100 con 0x7f2d2c14c2e0 2023-11-18T20:41:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d315ef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0bb510 con 0x7f2d2c072310 2023-11-18T20:41:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d2b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0c0440 0x7f2d2c1eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d2b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0c0440 0x7f2d2c1eb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36784/0 (socket says 172.21.15.132:36784) 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.669+0000 7f2d2b7fe640 1 -- 172.21.15.132:0/3489660006 learned_addr learned my addr 172.21.15.132:0/3489660006 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d30dee640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2c14c2e0 0x7f2d2c1eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d2bfff640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c072310 0x7f2d2c0c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d2b7fe640 1 -- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c072310 msgr2=0x7f2d2c0c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d2b7fe640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c072310 0x7f2d2c0c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d2b7fe640 1 -- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2c14c2e0 msgr2=0x7f2d2c1eb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d2b7fe640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2c14c2e0 0x7f2d2c1eb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d2b7fe640 1 -- 172.21.15.132:0/3489660006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c0094d0 con 0x7f2d2c0c0440 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d2bfff640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c072310 0x7f2d2c0c19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d2b7fe640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0c0440 0x7f2d2c1eb350 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d800 tx=0x7f2d2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d28ff9640 1 -- 172.21.15.132:0/3489660006 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000b6c0 con 0x7f2d2c0c0440 2023-11-18T20:41:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d28ff9640 1 -- 172.21.15.132:0/3489660006 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000b820 con 0x7f2d2c0c0440 2023-11-18T20:41:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.670+0000 7f2d28ff9640 1 -- 172.21.15.132:0/3489660006 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000bbb0 con 0x7f2d2c0c0440 2023-11-18T20:41:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.671+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c0bb7f0 con 0x7f2d2c0c0440 2023-11-18T20:41:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.671+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c0c1f10 con 0x7f2d2c0c0440 2023-11-18T20:41:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.672+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c04e840 con 0x7f2d2c0c0440 2023-11-18T20:41:33.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.673+0000 7f2d28ff9640 1 -- 172.21.15.132:0/3489660006 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d2000bd10 con 0x7f2d2c0c0440 2023-11-18T20:41:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.674+0000 7f2d28ff9640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1806ae40 0x7f2d1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.674+0000 7f2d28ff9640 1 -- 172.21.15.132:0/3489660006 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f2d20089cd0 con 0x7f2d2c0c0440 2023-11-18T20:41:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.674+0000 7f2d2bfff640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1806ae40 0x7f2d1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.675+0000 7f2d2bfff640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1806ae40 0x7f2d1806d300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c036000 tx=0x7f2d1c03d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:33.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.679+0000 7f2d28ff9640 1 -- 172.21.15.132:0/3489660006 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d20054c20 con 0x7f2d2c0c0440 2023-11-18T20:41:33.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:33.870+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2d2c0c5380 con 0x7f2d2c0c0440 2023-11-18T20:41:34.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.434+0000 7f2d28ff9640 1 -- 172.21.15.132:0/3489660006 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v78) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2d20058240 con 0x7f2d2c0c0440 2023-11-18T20:41:34.436 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_data' created 2023-11-18T20:41:34.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.440+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1806ae40 msgr2=0x7f2d1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:34.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.440+0000 7f2d315ef640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1806ae40 0x7f2d1806d300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c036000 tx=0x7f2d1c03d040 comp rx=0 tx=0).stop 2023-11-18T20:41:34.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.441+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0c0440 msgr2=0x7f2d2c1eb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:34.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.441+0000 7f2d315ef640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0c0440 0x7f2d2c1eb350 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d800 tx=0x7f2d2000dcc0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.442+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 shutdown_connections 2023-11-18T20:41:34.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.442+0000 7f2d315ef640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1806ae40 0x7f2d1806d300 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.442+0000 7f2d315ef640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2c14c2e0 0x7f2d2c1eb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.442+0000 7f2d315ef640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0c0440 0x7f2d2c1eb350 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.442+0000 7f2d315ef640 1 --2- 172.21.15.132:0/3489660006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2c072310 0x7f2d2c0c19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.442+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 >> 172.21.15.132:0/3489660006 conn(0x7f2d2c0a77f0 msgr2=0x7f2d2c14a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:34.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.443+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 shutdown_connections 2023-11-18T20:41:34.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.443+0000 7f2d315ef640 1 -- 172.21.15.132:0/3489660006 wait complete. 2023-11-18T20:41:34.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-18T20:41:34.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.661+0000 7f05e8ecf640 1 Processor -- start 2023-11-18T20:41:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.661+0000 7f05e8ecf640 1 -- start start 2023-11-18T20:41:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05e8ecf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f05e4155490 0x7f05e40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05e8ecf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f05e40c1500 0x7f05e40a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05e8ecf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e40c4080 0x7f05e40a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05e8ecf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e40a5820 con 0x7f05e40c1500 2023-11-18T20:41:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05e8ecf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e40c06c0 con 0x7f05e4155490 2023-11-18T20:41:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05e8ecf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e40c1020 con 0x7f05e40c4080 2023-11-18T20:41:34.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05d9d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f05e40c1500 0x7f05e40a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:34.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05d9d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f05e40c1500 0x7f05e40a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36788/0 (socket says 172.21.15.132:36788) 2023-11-18T20:41:34.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05d9d9b640 1 -- 172.21.15.132:0/2144812327 learned_addr learned my addr 172.21.15.132:0/2144812327 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:34.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05e259c640 1 --2- 172.21.15.132:0/2144812327 >> v2:172.21.15.161:3300/0 conn(0x7f05e4155490 0x7f05e40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.663+0000 7f05e2d9d640 1 --2- 172.21.15.132:0/2144812327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e40c4080 0x7f05e40a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.664+0000 7f05d9d9b640 1 -- 172.21.15.132:0/2144812327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e40c4080 msgr2=0x7f05e40a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.664+0000 7f05d9d9b640 1 --2- 172.21.15.132:0/2144812327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e40c4080 0x7f05e40a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.664+0000 7f05d9d9b640 1 -- 172.21.15.132:0/2144812327 >> v2:172.21.15.161:3300/0 conn(0x7f05e4155490 msgr2=0x7f05e40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.664+0000 7f05d9d9b640 1 --2- 172.21.15.132:0/2144812327 >> v2:172.21.15.161:3300/0 conn(0x7f05e4155490 0x7f05e40a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.664+0000 7f05d9d9b640 1 -- 172.21.15.132:0/2144812327 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e40c0910 con 0x7f05e40c1500 2023-11-18T20:41:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.665+0000 7f05d9d9b640 1 --2- 172.21.15.132:0/2144812327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e40a9430 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f05e406dff0 tx=0x7f05cc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8172ed47baa67d7e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.665+0000 7f05e1d9b640 1 -- 172.21.15.132:0/2144812327 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0317e0 con 0x7f05e40c1500 2023-11-18T20:41:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.665+0000 7f05e1d9b640 1 -- 172.21.15.132:0/2144812327 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc031940 con 0x7f05e40c1500 2023-11-18T20:41:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.665+0000 7f05e1d9b640 1 -- 172.21.15.132:0/2144812327 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc031cd0 con 0x7f05e40c1500 2023-11-18T20:41:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 -- 172.21.15.132:0/2144812327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 msgr2=0x7f05e40a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:34.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/2144812327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e40a9430 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f05e406dff0 tx=0x7f05cc02b880 comp rx=0 tx=0).stop 2023-11-18T20:41:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 -- 172.21.15.132:0/2144812327 shutdown_connections 2023-11-18T20:41:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/2144812327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e40c4080 0x7f05e40a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/2144812327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e40a9430 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/2144812327 >> v2:172.21.15.161:3300/0 conn(0x7f05e4155490 0x7f05e40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 -- 172.21.15.132:0/2144812327 >> 172.21.15.132:0/2144812327 conn(0x7f05e406a500 msgr2=0x7f05e406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 -- 172.21.15.132:0/2144812327 shutdown_connections 2023-11-18T20:41:34.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.666+0000 7f05e8ecf640 1 -- 172.21.15.132:0/2144812327 wait complete. 2023-11-18T20:41:34.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.668+0000 7f05e8ecf640 1 Processor -- start 2023-11-18T20:41:34.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.668+0000 7f05e8ecf640 1 -- start start 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e8ecf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e414b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e8ecf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05e40c4080 0x7f05e41eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e8ecf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e4155490 0x7f05e41eb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e8ecf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e414f430 con 0x7f05e40c1500 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e8ecf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e414bc50 con 0x7f05e40c4080 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e8ecf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e41535d0 con 0x7f05e4155490 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e414b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36798/0 (socket says 172.21.15.132:36798) 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e259c640 1 -- 172.21.15.132:0/1060825705 learned_addr learned my addr 172.21.15.132:0/1060825705 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e259c640 1 -- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e4155490 msgr2=0x7f05e41eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:34.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e259c640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e4155490 0x7f05e41eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e259c640 1 -- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05e40c4080 msgr2=0x7f05e41eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:34.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e259c640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05e40c4080 0x7f05e41eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:34.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.669+0000 7f05e259c640 1 -- 172.21.15.132:0/1060825705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0094d0 con 0x7f05e40c1500 2023-11-18T20:41:34.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.670+0000 7f05e259c640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e414b470 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f05d400d5f0 tx=0x7f05d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:34.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.670+0000 7f05db7fe640 1 -- 172.21.15.132:0/1060825705 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40125f0 con 0x7f05e40c1500 2023-11-18T20:41:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.670+0000 7f05db7fe640 1 -- 172.21.15.132:0/1060825705 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4012750 con 0x7f05e40c1500 2023-11-18T20:41:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.670+0000 7f05db7fe640 1 -- 172.21.15.132:0/1060825705 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4012ae0 con 0x7f05e40c1500 2023-11-18T20:41:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.670+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e414b9b0 con 0x7f05e40c1500 2023-11-18T20:41:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.670+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e4153b50 con 0x7f05e40c1500 2023-11-18T20:41:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.671+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e4068350 con 0x7f05e40c1500 2023-11-18T20:41:34.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.672+0000 7f05db7fe640 1 -- 172.21.15.132:0/1060825705 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05d4012c40 con 0x7f05e40c1500 2023-11-18T20:41:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.673+0000 7f05db7fe640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f05c406ae40 0x7f05c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:34.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.673+0000 7f05db7fe640 1 -- 172.21.15.132:0/1060825705 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f05d4089df0 con 0x7f05e40c1500 2023-11-18T20:41:34.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.674+0000 7f05d9d9b640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f05c406ae40 0x7f05c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:34.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.675+0000 7f05d9d9b640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f05c406ae40 0x7f05c406d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05cc036000 tx=0x7f05cc030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:34.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.678+0000 7f05db7fe640 1 -- 172.21.15.132:0/1060825705 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05d4054ba0 con 0x7f05e40c1500 2023-11-18T20:41:34.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:34.904+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f05e40c3e00 con 0x7f05e40c1500 2023-11-18T20:41:35.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.460+0000 7f05db7fe640 1 -- 172.21.15.132:0/1060825705 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v46) v1 ==== 177+0+0 (secure 0 0 0) 0x7f05d40581c0 con 0x7f05e40c1500 2023-11-18T20:41:35.465 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 14 and data pool 15 2023-11-18T20:41:35.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.469+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f05c406ae40 msgr2=0x7f05c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.469+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f05c406ae40 0x7f05c406d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05cc036000 tx=0x7f05cc030000 comp rx=0 tx=0).stop 2023-11-18T20:41:35.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.469+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 msgr2=0x7f05e414b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.469+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e414b470 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f05d400d5f0 tx=0x7f05d400dab0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.474+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 shutdown_connections 2023-11-18T20:41:35.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.474+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f05c406ae40 0x7f05c406d300 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.474+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05e4155490 0x7f05e41eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.474+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05e40c4080 0x7f05e41eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.474+0000 7f05e8ecf640 1 --2- 172.21.15.132:0/1060825705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05e40c1500 0x7f05e414b470 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.474+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 >> 172.21.15.132:0/1060825705 conn(0x7f05e406a500 msgr2=0x7f05e40a9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:35.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.475+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 shutdown_connections 2023-11-18T20:41:35.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.475+0000 7f05e8ecf640 1 -- 172.21.15.132:0/1060825705 wait complete. 2023-11-18T20:41:35.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:35.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.683+0000 7f96bce90640 1 Processor -- start 2023-11-18T20:41:35.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.683+0000 7f96bce90640 1 -- start start 2023-11-18T20:41:35.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.684+0000 7f96bce90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b8152f20 0x7f96b80c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:35.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.684+0000 7f96bce90640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b80c64a0 con 0x7f96b806d0a0 2023-11-18T20:41:35.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.684+0000 7f96bce90640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b80c5c00 con 0x7f96b814fd30 2023-11-18T20:41:35.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.684+0000 7f96bce90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80c5ee0 con 0x7f96b8152f20 2023-11-18T20:41:35.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.684+0000 7f96b5d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f96b806d0a0 0x7f96b80c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39518/0 (socket says 172.21.15.132:39518) 2023-11-18T20:41:35.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.684+0000 7f96b5d9b640 1 -- 172.21.15.132:0/1701231533 learned_addr learned my addr 172.21.15.132:0/1701231533 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:35.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b6d9d640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b8152f20 0x7f96b80c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:35.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848424272 0 0) 0x7f96b80c64a0 con 0x7f96b806d0a0 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a4003520 con 0x7f96b806d0a0 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871037820 0 0) 0x7f96a4003520 con 0x7f96b806d0a0 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b8152f20 msgr2=0x7f96b80c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b8152f20 0x7f96b80c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 >> v1:172.21.15.161:6789/0 conn(0x7f96b814fd30 legacy=0x7f96b80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80c61c0 con 0x7f96b806d0a0 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f96a00019f0 con 0x7f96b806d0a0 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 >> v1:172.21.15.132:6789/0 conn(0x7f96b806d0a0 legacy=0x7f96b80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b8152f20 0x7f96a40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96a4004d00 0x7f96a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80c5ee0 con 0x7f96a4003f70 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a400bac0 con 0x7f96a4004d00 2023-11-18T20:41:35.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.685+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a400bc80 con 0x7f96b8152f20 2023-11-18T20:41:35.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.686+0000 7f96b5d9b640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:35.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.686+0000 7f96b6d9d640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96a4004d00 0x7f96a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:35.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.686+0000 7f96b5d9b640 1 -- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b8152f20 msgr2=0x7f96a40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:35.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.686+0000 7f96b5d9b640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b8152f20 0x7f96a40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.686+0000 7f96b5d9b640 1 -- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96a4004d00 msgr2=0x7f96a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:35.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.686+0000 7f96b5d9b640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96a4004d00 0x7f96a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.686+0000 7f96b5d9b640 1 -- 172.21.15.132:0/1701231533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a4003520 con 0x7f96a4003f70 2023-11-18T20:41:35.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.686+0000 7f96b6d9d640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96a4004d00 0x7f96a4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:35.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.687+0000 7f96b5d9b640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96a40047c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f96b806d4e0 tx=0x7f96a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deebc3ee956d653d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:35.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.687+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0034630 con 0x7f96a4003f70 2023-11-18T20:41:35.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.687+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a002f070 con 0x7f96a4003f70 2023-11-18T20:41:35.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.687+0000 7f96b559a640 1 -- 172.21.15.132:0/1701231533 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0034a50 con 0x7f96a4003f70 2023-11-18T20:41:35.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.688+0000 7f96bce90640 1 -- 172.21.15.132:0/1701231533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 msgr2=0x7f96a40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.688+0000 7f96bce90640 1 --2- 172.21.15.132:0/1701231533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96a40047c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f96b806d4e0 tx=0x7f96a40057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.688+0000 7f96b6d9d640 1 -- 172.21.15.132:0/1701231533 reap_dead start 2023-11-18T20:41:35.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.688+0000 7f96bce90640 1 -- 172.21.15.132:0/1701231533 shutdown_connections 2023-11-18T20:41:35.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.688+0000 7f96bce90640 1 -- 172.21.15.132:0/1701231533 >> 172.21.15.132:0/1701231533 conn(0x7f96b806a500 msgr2=0x7f96b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:35.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.688+0000 7f96bce90640 1 -- 172.21.15.132:0/1701231533 shutdown_connections 2023-11-18T20:41:35.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.688+0000 7f96bce90640 1 -- 172.21.15.132:0/1701231533 wait complete. 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.690+0000 7f96bce90640 1 Processor -- start 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.690+0000 7f96bce90640 1 -- start start 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96bce90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96b8151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96bce90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b81ea140 0x7f96b80a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96bce90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96b8151e90 0x7f96b80a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96bce90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8156620 con 0x7f96a4003f70 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96bce90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8155ba0 con 0x7f96b8151e90 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96bce90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80a8900 con 0x7f96b81ea140 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96b659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96b8151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96b659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96b8151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36806/0 (socket says 172.21.15.132:36806) 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96b659c640 1 -- 172.21.15.132:0/3085027519 learned_addr learned my addr 172.21.15.132:0/3085027519 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96b659c640 1 -- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b81ea140 msgr2=0x7f96b80a8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96b659c640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b81ea140 0x7f96b80a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96b659c640 1 -- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96b8151e90 msgr2=0x7f96b80a92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96b659c640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96b8151e90 0x7f96b80a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.691+0000 7f96b659c640 1 -- 172.21.15.132:0/3085027519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b8153860 con 0x7f96a4003f70 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.692+0000 7f96b659c640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96b8151950 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c500 tx=0x7f96a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.692+0000 7f96aeffd640 1 -- 172.21.15.132:0/3085027519 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a80052d0 con 0x7f96a4003f70 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.692+0000 7f96aeffd640 1 -- 172.21.15.132:0/3085027519 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a8005430 con 0x7f96a4003f70 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.692+0000 7f96aeffd640 1 -- 172.21.15.132:0/3085027519 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a8012870 con 0x7f96a4003f70 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.692+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b81ea640 con 0x7f96a4003f70 2023-11-18T20:41:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.692+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b81eac00 con 0x7f96a4003f70 2023-11-18T20:41:35.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.693+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b8068350 con 0x7f96a4003f70 2023-11-18T20:41:35.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.694+0000 7f96aeffd640 1 -- 172.21.15.132:0/3085027519 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96a80129d0 con 0x7f96a4003f70 2023-11-18T20:41:35.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.695+0000 7f96aeffd640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f969806ae40 0x7f969806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:35.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.695+0000 7f96aeffd640 1 -- 172.21.15.132:0/3085027519 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f96a8089580 con 0x7f96a4003f70 2023-11-18T20:41:35.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.695+0000 7f96b5d9b640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f969806ae40 0x7f969806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:35.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.697+0000 7f96b5d9b640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f969806ae40 0x7f969806d300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f96a0034000 tx=0x7f96a0009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:35.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.699+0000 7f96aeffd640 1 -- 172.21.15.132:0/3085027519 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96a80542c0 con 0x7f96a4003f70 2023-11-18T20:41:35.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.875+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96b806ab00 con 0x7f96a4003f70 2023-11-18T20:41:35.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.877+0000 7f96aeffd640 1 -- 172.21.15.132:0/3085027519 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+20275 (secure 0 0 0) 0x7f96a80578e0 con 0x7f96a4003f70 2023-11-18T20:41:35.878 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:35.879 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":79,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:34.906443+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:35.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f969806ae40 msgr2=0x7f969806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f969806ae40 0x7f969806d300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f96a0034000 tx=0x7f96a0009030 comp rx=0 tx=0).stop 2023-11-18T20:41:35.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 msgr2=0x7f96b8151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:35.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96b8151950 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c500 tx=0x7f96a800c9c0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 shutdown_connections 2023-11-18T20:41:35.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f969806ae40 0x7f969806d300 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96b8151e90 0x7f96b80a92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96b81ea140 0x7f96b80a8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 --2- 172.21.15.132:0/3085027519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96a4003f70 0x7f96b8151950 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:35.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 >> 172.21.15.132:0/3085027519 conn(0x7f96b806a500 msgr2=0x7f96b814def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:35.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.879+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 shutdown_connections 2023-11-18T20:41:35.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:35.880+0000 7f96bce90640 1 -- 172.21.15.132:0/3085027519 wait complete. 2023-11-18T20:41:35.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:36.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.109+0000 7fa4bf333640 1 Processor -- start 2023-11-18T20:41:36.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.109+0000 7fa4bf333640 1 -- start start 2023-11-18T20:41:36.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.111+0000 7fa4bf333640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813d0d0 0x7fa4b806e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.111+0000 7fa4bf333640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4b813d6e0 0x7fa4b806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.111+0000 7fa4bf333640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa4b813dc30 0x7fa4b8158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.111+0000 7fa4bf333640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b806b350 con 0x7fa4b813d6e0 2023-11-18T20:41:36.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.111+0000 7fa4bf333640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b8157cb0 con 0x7fa4b813dc30 2023-11-18T20:41:36.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.111+0000 7fa4bf333640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b806ef10 con 0x7fa4b813d0d0 2023-11-18T20:41:36.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.111+0000 7fa4bc8ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4b813d6e0 0x7fa4b806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.112+0000 7fa4bc8ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4b813d6e0 0x7fa4b806e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36814/0 (socket says 172.21.15.132:36814) 2023-11-18T20:41:36.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.112+0000 7fa4bc8ce640 1 -- 172.21.15.132:0/510848352 learned_addr learned my addr 172.21.15.132:0/510848352 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:36.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.112+0000 7fa4bc8ce640 1 -- 172.21.15.132:0/510848352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813d0d0 msgr2=0x7fa4b806e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:36.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.112+0000 7fa4bc8ce640 1 --2- 172.21.15.132:0/510848352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813d0d0 0x7fa4b806e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.112+0000 7fa4bc8ce640 1 -- 172.21.15.132:0/510848352 >> v2:172.21.15.161:3300/0 conn(0x7fa4b813dc30 msgr2=0x7fa4b8158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:36.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.112+0000 7fa4bc8ce640 1 --2- 172.21.15.132:0/510848352 >> v2:172.21.15.161:3300/0 conn(0x7fa4b813dc30 0x7fa4b8158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.112+0000 7fa4bc8ce640 1 -- 172.21.15.132:0/510848352 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b806b0b0 con 0x7fa4b813d6e0 2023-11-18T20:41:36.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.113+0000 7fa4bc8ce640 1 --2- 172.21.15.132:0/510848352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b806e740 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8152330 tx=0x7fa4a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bee3c177bd87e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:36.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4affff640 1 -- 172.21.15.132:0/510848352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8031870 con 0x7fa4b813d6e0 2023-11-18T20:41:36.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4affff640 1 -- 172.21.15.132:0/510848352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a80319d0 con 0x7fa4b813d6e0 2023-11-18T20:41:36.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4affff640 1 -- 172.21.15.132:0/510848352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8031d60 con 0x7fa4b813d6e0 2023-11-18T20:41:36.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4bf333640 1 -- 172.21.15.132:0/510848352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 msgr2=0x7fa4b806e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4bf333640 1 --2- 172.21.15.132:0/510848352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b806e740 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8152330 tx=0x7fa4a802b910 comp rx=0 tx=0).stop 2023-11-18T20:41:36.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4bf333640 1 -- 172.21.15.132:0/510848352 shutdown_connections 2023-11-18T20:41:36.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4bf333640 1 --2- 172.21.15.132:0/510848352 >> v2:172.21.15.161:3300/0 conn(0x7fa4b813dc30 0x7fa4b8158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4bf333640 1 --2- 172.21.15.132:0/510848352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b806e740 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4bf333640 1 --2- 172.21.15.132:0/510848352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813d0d0 0x7fa4b806e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.114+0000 7fa4bf333640 1 -- 172.21.15.132:0/510848352 >> 172.21.15.132:0/510848352 conn(0x7fa4b80c39e0 msgr2=0x7fa4b80c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:36.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.115+0000 7fa4bf333640 1 -- 172.21.15.132:0/510848352 shutdown_connections 2023-11-18T20:41:36.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.115+0000 7fa4bf333640 1 -- 172.21.15.132:0/510848352 wait complete. 2023-11-18T20:41:36.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.116+0000 7fa4bf333640 1 Processor -- start 2023-11-18T20:41:36.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.117+0000 7fa4bf333640 1 -- start start 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.117+0000 7fa4bf333640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b813d0d0 0x7fa4b81ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.117+0000 7fa4bf333640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b8138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.117+0000 7fa4bf333640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813dc30 0x7fa4b81eb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bf333640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8152380 con 0x7fa4b813d6e0 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bf333640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81ea650 con 0x7fa4b813d0d0 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bf333640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81eeb90 con 0x7fa4b813dc30 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bc8ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b8138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bc8ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b8138430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36830/0 (socket says 172.21.15.132:36830) 2023-11-18T20:41:36.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bc8ce640 1 -- 172.21.15.132:0/3828732629 learned_addr learned my addr 172.21.15.132:0/3828732629 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:36.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bd8d0640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813dc30 0x7fa4b81eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bd0cf640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b813d0d0 0x7fa4b81ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bc8ce640 1 -- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813dc30 msgr2=0x7fa4b81eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bc8ce640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813dc30 0x7fa4b81eb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bc8ce640 1 -- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b813d0d0 msgr2=0x7fa4b81ee650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bc8ce640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b813d0d0 0x7fa4b81ee650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bc8ce640 1 -- 172.21.15.132:0/3828732629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a80094d0 con 0x7fa4b813d6e0 2023-11-18T20:41:36.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.118+0000 7fa4bd0cf640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b813d0d0 0x7fa4b81ee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:36.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.119+0000 7fa4bc8ce640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b8138430 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8000c00 tx=0x7fa4a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:36.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.119+0000 7fa4adffb640 1 -- 172.21.15.132:0/3828732629 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8031840 con 0x7fa4b813d6e0 2023-11-18T20:41:36.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.119+0000 7fa4adffb640 1 -- 172.21.15.132:0/3828732629 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a80443f0 con 0x7fa4b813d6e0 2023-11-18T20:41:36.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.119+0000 7fa4adffb640 1 -- 172.21.15.132:0/3828732629 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a80447a0 con 0x7fa4b813d6e0 2023-11-18T20:41:36.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.119+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b8138970 con 0x7fa4b813d6e0 2023-11-18T20:41:36.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.119+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b81520a0 con 0x7fa4b813d6e0 2023-11-18T20:41:36.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.120+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b804e840 con 0x7fa4b813d6e0 2023-11-18T20:41:36.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.121+0000 7fa4adffb640 1 -- 172.21.15.132:0/3828732629 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4a804d450 con 0x7fa4b813d6e0 2023-11-18T20:41:36.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.122+0000 7fa4adffb640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa49c06ae40 0x7fa49c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.123+0000 7fa4adffb640 1 -- 172.21.15.132:0/3828732629 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa4a802d040 con 0x7fa4b813d6e0 2023-11-18T20:41:36.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.123+0000 7fa4bd0cf640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa49c06ae40 0x7fa49c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.124+0000 7fa4bd0cf640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa49c06ae40 0x7fa49c06d300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400a870 tx=0x7fa4b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:36.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.127+0000 7fa4adffb640 1 -- 172.21.15.132:0/3828732629 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4a8076e80 con 0x7fa4b813d6e0 2023-11-18T20:41:36.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.317+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4b8068350 con 0x7fa4b813d6e0 2023-11-18T20:41:36.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.321+0000 7fa4adffb640 1 -- 172.21.15.132:0/3828732629 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+20275 (secure 0 0 0) 0x7fa4a8035090 con 0x7fa4b813d6e0 2023-11-18T20:41:36.324 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:36.324 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":79,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:34.906443+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:36.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa49c06ae40 msgr2=0x7fa49c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa49c06ae40 0x7fa49c06d300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400a870 tx=0x7fa4b4008040 comp rx=0 tx=0).stop 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 msgr2=0x7fa4b8138430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b8138430 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8000c00 tx=0x7fa4a80046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 shutdown_connections 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa49c06ae40 0x7fa49c06d300 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4b813dc30 0x7fa4b81eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4b813d6e0 0x7fa4b8138430 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 --2- 172.21.15.132:0/3828732629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b813d0d0 0x7fa4b81ee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.324+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 >> 172.21.15.132:0/3828732629 conn(0x7fa4b80c39e0 msgr2=0x7fa4b8158380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:36.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.325+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 shutdown_connections 2023-11-18T20:41:36.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.325+0000 7fa4bf333640 1 -- 172.21.15.132:0/3828732629 wait complete. 2023-11-18T20:41:36.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-18T20:41:36.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.553+0000 7f9505a64640 1 Processor -- start 2023-11-18T20:41:36.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.553+0000 7f9505a64640 1 -- start start 2023-11-18T20:41:36.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.555+0000 7f9505a64640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f950006d0a0 0x7f9500152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.555+0000 7f9505a64640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95000c64a0 con 0x7f950014fd30 2023-11-18T20:41:36.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.555+0000 7f9505a64640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95000c5c00 con 0x7f95000c3ea0 2023-11-18T20:41:36.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.555+0000 7f9505a64640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95000c5ee0 con 0x7f950006d0a0 2023-11-18T20:41:36.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.555+0000 7f94ff7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f950014fd30 0x7f95000a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39530/0 (socket says 172.21.15.132:39530) 2023-11-18T20:41:36.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.555+0000 7f94ff7fe640 1 -- 172.21.15.132:0/307371619 learned_addr learned my addr 172.21.15.132:0/307371619 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:36.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94f7fff640 1 --2- 172.21.15.132:0/307371619 >> v2:172.21.15.161:3300/0 conn(0x7f950006d0a0 0x7f9500152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589017797 0 0) 0x7f95000c64a0 con 0x7f950014fd30 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94ec003520 con 0x7f950014fd30 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423700642 0 0) 0x7f94ec003520 con 0x7f950014fd30 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 >> v2:172.21.15.161:3300/0 conn(0x7f950006d0a0 msgr2=0x7f9500152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 --2- 172.21.15.132:0/307371619 >> v2:172.21.15.161:3300/0 conn(0x7f950006d0a0 0x7f9500152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 >> v1:172.21.15.161:6789/0 conn(0x7f95000c3ea0 legacy=0x7f95000c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95000c61c0 con 0x7f950014fd30 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f94f0001670 con 0x7f950014fd30 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 >> v1:172.21.15.132:6789/0 conn(0x7f950014fd30 legacy=0x7f95000a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94ec003970 0x7f94ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f94ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ec005180 0x7f94ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c5ee0 con 0x7f94ec0047c0 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec00c020 con 0x7f94ec005180 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.556+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec00c1e0 con 0x7f94ec003970 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94f7fff640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f94ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94ff7fe640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94ec003970 0x7f94ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94f7fff640 1 -- 172.21.15.132:0/307371619 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94ec003970 msgr2=0x7f94ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94f7fff640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94ec003970 0x7f94ec003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94fffff640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ec005180 0x7f94ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94f7fff640 1 -- 172.21.15.132:0/307371619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ec005180 msgr2=0x7f94ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94f7fff640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94ec005180 0x7f94ec00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94fffff640 1 -- 172.21.15.132:0/307371619 reap_dead start 2023-11-18T20:41:36.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.557+0000 7f94f7fff640 1 -- 172.21.15.132:0/307371619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec003520 con 0x7f94ec0047c0 2023-11-18T20:41:36.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.558+0000 7f94f7fff640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f94ec004c40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009a90 tx=0x7f94ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c269d3fdda1557af server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:36.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e802c680 con 0x7f94ec0047c0 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e802c7e0 con 0x7f94ec0047c0 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f94feffd640 1 -- 172.21.15.132:0/307371619 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e802cb70 con 0x7f94ec0047c0 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f9505a64640 1 -- 172.21.15.132:0/307371619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 msgr2=0x7f94ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f9505a64640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f94ec004c40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009a90 tx=0x7f94ec0057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f9505a64640 1 -- 172.21.15.132:0/307371619 shutdown_connections 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f9505a64640 1 --2- 172.21.15.132:0/307371619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f94ec004c40 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f9505a64640 1 -- 172.21.15.132:0/307371619 >> 172.21.15.132:0/307371619 conn(0x7f950006a500 msgr2=0x7f950006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f9505a64640 1 -- 172.21.15.132:0/307371619 shutdown_connections 2023-11-18T20:41:36.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.559+0000 7f9505a64640 1 -- 172.21.15.132:0/307371619 wait complete. 2023-11-18T20:41:36.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.561+0000 7f9505a64640 1 Processor -- start 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.561+0000 7f9505a64640 1 -- start start 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f9505a64640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f95000a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f9505a64640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95001e95f0 0x7f95001e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f9505a64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95001e9fb0 0x7f95001eb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f9505a64640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500152380 con 0x7f94ec0047c0 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f9505a64640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500151dc0 con 0x7f95001e9fb0 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f9505a64640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95001520a0 con 0x7f95001e95f0 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f94ff7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f95000a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f94ff7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f95000a6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36840/0 (socket says 172.21.15.132:36840) 2023-11-18T20:41:36.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.562+0000 7f94ff7fe640 1 -- 172.21.15.132:0/1352119034 learned_addr learned my addr 172.21.15.132:0/1352119034 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:36.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94f7fff640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95001e95f0 0x7f95001e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94ff7fe640 1 -- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95001e95f0 msgr2=0x7f95001e9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94ff7fe640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95001e95f0 0x7f95001e9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94fffff640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95001e9fb0 0x7f95001eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94ff7fe640 1 -- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95001e9fb0 msgr2=0x7f95001eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94ff7fe640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95001e9fb0 0x7f95001eb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94ff7fe640 1 -- 172.21.15.132:0/1352119034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500153a00 con 0x7f94ec0047c0 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94ff7fe640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f95000a6c10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f94f000d810 tx=0x7f94f000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94fcff9640 1 -- 172.21.15.132:0/1352119034 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f00074e0 con 0x7f94ec0047c0 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94fcff9640 1 -- 172.21.15.132:0/1352119034 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f0007640 con 0x7f94ec0047c0 2023-11-18T20:41:36.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f94fcff9640 1 -- 172.21.15.132:0/1352119034 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0004a00 con 0x7f94ec0047c0 2023-11-18T20:41:36.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.563+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9500153ce0 con 0x7f94ec0047c0 2023-11-18T20:41:36.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.564+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95000a75a0 con 0x7f94ec0047c0 2023-11-18T20:41:36.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.565+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9500153860 con 0x7f94ec0047c0 2023-11-18T20:41:36.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.565+0000 7f94fcff9640 1 -- 172.21.15.132:0/1352119034 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94f0004b60 con 0x7f94ec0047c0 2023-11-18T20:41:36.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.566+0000 7f94fcff9640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94e006ae40 0x7f94e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:36.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.566+0000 7f94fcff9640 1 -- 172.21.15.132:0/1352119034 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f94f00891d0 con 0x7f94ec0047c0 2023-11-18T20:41:36.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.567+0000 7f94f7fff640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94e006ae40 0x7f94e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:36.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.568+0000 7f94f7fff640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94e006ae40 0x7f94e006d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f94e8036000 tx=0x7f94e8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:36.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.571+0000 7f94fcff9640 1 -- 172.21.15.132:0/1352119034 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9500153860 con 0x7f94ec0047c0 2023-11-18T20:41:36.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:36.805+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9500153860 con 0x7f94ec0047c0 2023-11-18T20:41:37.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.482+0000 7f94fcff9640 1 -- 172.21.15.132:0/1352119034 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 119+0+0 (secure 0 0 0) 0x7f9500153860 con 0x7f94ec0047c0 2023-11-18T20:41:37.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94e006ae40 msgr2=0x7f94e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:37.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94e006ae40 0x7f94e006d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f94e8036000 tx=0x7f94e8030000 comp rx=0 tx=0).stop 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 msgr2=0x7f95000a6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f95000a6c10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f94f000d810 tx=0x7f94f000dcd0 comp rx=0 tx=0).stop 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 shutdown_connections 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f94e006ae40 0x7f94e006d300 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95001e9fb0 0x7f95001eb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95001e95f0 0x7f95001e9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 --2- 172.21.15.132:0/1352119034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0047c0 0x7f95000a6c10 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 >> 172.21.15.132:0/1352119034 conn(0x7f950006a500 msgr2=0x7f95001dbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 shutdown_connections 2023-11-18T20:41:37.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.486+0000 7f9505a64640 1 -- 172.21.15.132:0/1352119034 wait complete. 2023-11-18T20:41:37.508 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T20:41:37.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-18T20:41:37.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.723+0000 7f4fbeb90640 1 Processor -- start 2023-11-18T20:41:37.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.723+0000 7f4fbeb90640 1 -- start start 2023-11-18T20:41:37.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbeb90640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4fb80c3340 0x7f4fb8156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:37.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbeb90640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb80bfdc0 con 0x7f4fb80c5ec0 2023-11-18T20:41:37.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbeb90640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb8156a80 con 0x7f4fb80c45d0 2023-11-18T20:41:37.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbeb90640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb806e390 con 0x7f4fb80c3340 2023-11-18T20:41:37.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbc92c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4fb80c5ec0 0x7f4fb80c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39542/0 (socket says 172.21.15.132:39542) 2023-11-18T20:41:37.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbc92c640 1 -- 172.21.15.132:0/492780889 learned_addr learned my addr 172.21.15.132:0/492780889 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:37.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbd12d640 1 --2- 172.21.15.132:0/492780889 >> v2:172.21.15.132:3300/0 conn(0x7f4fb80c3340 0x7f4fb8156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:37.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fb77fe640 1 -- 172.21.15.132:0/492780889 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569078860 0 0) 0x7f4fb80bfdc0 con 0x7f4fb80c5ec0 2023-11-18T20:41:37.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fb77fe640 1 -- 172.21.15.132:0/492780889 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa0003520 con 0x7f4fb80c5ec0 2023-11-18T20:41:37.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbd12d640 1 -- 172.21.15.132:0/492780889 >> v1:172.21.15.161:6789/0 conn(0x7f4fb80c45d0 legacy=0x7f4fb8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:37.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbd12d640 1 -- 172.21.15.132:0/492780889 >> v1:172.21.15.132:6789/0 conn(0x7f4fb80c5ec0 legacy=0x7f4fb80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:37.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.725+0000 7f4fbd12d640 1 -- 172.21.15.132:0/492780889 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb806ddd0 con 0x7f4fb80c3340 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.727+0000 7f4fbd12d640 1 --2- 172.21.15.132:0/492780889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb8156540 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009dc0 tx=0x7f4fb002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e689103646ee1037 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.727+0000 7f4fb77fe640 1 -- 172.21.15.132:0/492780889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb002cb20 con 0x7f4fb80c3340 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.727+0000 7f4fb77fe640 1 -- 172.21.15.132:0/492780889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb002cc80 con 0x7f4fb80c3340 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.727+0000 7f4fb77fe640 1 -- 172.21.15.132:0/492780889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0034440 con 0x7f4fb80c3340 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.727+0000 7f4fbeb90640 1 -- 172.21.15.132:0/492780889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 msgr2=0x7f4fb8156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.727+0000 7f4fbeb90640 1 --2- 172.21.15.132:0/492780889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb8156540 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009dc0 tx=0x7f4fb002bd70 comp rx=0 tx=0).stop 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.728+0000 7f4fbeb90640 1 -- 172.21.15.132:0/492780889 shutdown_connections 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.728+0000 7f4fbeb90640 1 --2- 172.21.15.132:0/492780889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb8156540 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.728+0000 7f4fbeb90640 1 -- 172.21.15.132:0/492780889 >> 172.21.15.132:0/492780889 conn(0x7f4fb806a500 msgr2=0x7f4fb806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.728+0000 7f4fbeb90640 1 -- 172.21.15.132:0/492780889 shutdown_connections 2023-11-18T20:41:37.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.728+0000 7f4fbeb90640 1 -- 172.21.15.132:0/492780889 wait complete. 2023-11-18T20:41:37.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.729+0000 7f4fbeb90640 1 Processor -- start 2023-11-18T20:41:37.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.730+0000 7f4fbeb90640 1 -- start start 2023-11-18T20:41:37.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbeb90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb81ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:37.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbeb90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fb80c45d0 0x7f4fb814a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbeb90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fb80c5ec0 0x7f4fb814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbeb90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb81ee220 con 0x7f4fb80c3340 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbeb90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80a5bc0 con 0x7f4fb80c5ec0 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbeb90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb81edf40 con 0x7f4fb80c45d0 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbc92c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb81ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbc92c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb81ed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36864/0 (socket says 172.21.15.132:36864) 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbc92c640 1 -- 172.21.15.132:0/709511696 learned_addr learned my addr 172.21.15.132:0/709511696 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbd12d640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fb80c5ec0 0x7f4fb814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbc92c640 1 -- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fb80c45d0 msgr2=0x7f4fb814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbc92c640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fb80c45d0 0x7f4fb814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbc92c640 1 -- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fb80c5ec0 msgr2=0x7f4fb814a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbc92c640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fb80c5ec0 0x7f4fb814a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.731+0000 7f4fbc92c640 1 -- 172.21.15.132:0/709511696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0009a70 con 0x7f4fb80c3340 2023-11-18T20:41:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.732+0000 7f4fbc92c640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb81ed4c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c410 tx=0x7f4fac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.732+0000 7f4fb57fa640 1 -- 172.21.15.132:0/709511696 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac005ce0 con 0x7f4fb80c3340 2023-11-18T20:41:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.732+0000 7f4fb57fa640 1 -- 172.21.15.132:0/709511696 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac005e40 con 0x7f4fb80c3340 2023-11-18T20:41:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.732+0000 7f4fb57fa640 1 -- 172.21.15.132:0/709511696 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac0072f0 con 0x7f4fb80c3340 2023-11-18T20:41:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.732+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb80a5850 con 0x7f4fb80c3340 2023-11-18T20:41:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.732+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb80a8cf0 con 0x7f4fb80c3340 2023-11-18T20:41:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.733+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb80a56b0 con 0x7f4fb80c3340 2023-11-18T20:41:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.734+0000 7f4fb57fa640 1 -- 172.21.15.132:0/709511696 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4fac007450 con 0x7f4fb80c3340 2023-11-18T20:41:37.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.736+0000 7f4fb57fa640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4fa406ae40 0x7f4fa406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:37.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.736+0000 7f4fb57fa640 1 -- 172.21.15.132:0/709511696 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4fac088ff0 con 0x7f4fb80c3340 2023-11-18T20:41:37.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.736+0000 7f4fb7fff640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4fa406ae40 0x7f4fa406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.737+0000 7f4fb7fff640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4fa406ae40 0x7f4fa406d300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8150a10 tx=0x7f4fa80079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.740+0000 7f4fb57fa640 1 -- 172.21.15.132:0/709511696 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4fb80a56b0 con 0x7f4fb80c3340 2023-11-18T20:41:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:37.971+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4fb80a56b0 con 0x7f4fb80c3340 2023-11-18T20:41:38.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.486+0000 7f4fb57fa640 1 -- 172.21.15.132:0/709511696 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v50) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4fb80a56b0 con 0x7f4fb80c3340 2023-11-18T20:41:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4fa406ae40 msgr2=0x7f4fa406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4fa406ae40 0x7f4fa406d300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8150a10 tx=0x7f4fa80079b0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 msgr2=0x7f4fb81ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb81ed4c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c410 tx=0x7f4fac00c8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 shutdown_connections 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4fa406ae40 0x7f4fa406d300 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fb80c5ec0 0x7f4fb814a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fb80c45d0 0x7f4fb814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 --2- 172.21.15.132:0/709511696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fb80c3340 0x7f4fb81ed4c0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 >> 172.21.15.132:0/709511696 conn(0x7f4fb806a500 msgr2=0x7f4fb806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 shutdown_connections 2023-11-18T20:41:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.490+0000 7f4fbeb90640 1 -- 172.21.15.132:0/709511696 wait complete. 2023-11-18T20:41:38.513 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-18T20:41:38.513 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:41:38.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.725+0000 7f5d9f59e640 1 Processor -- start 2023-11-18T20:41:38.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.725+0000 7f5d9f59e640 1 -- start start 2023-11-18T20:41:38.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.727+0000 7f5d9f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5da00c52e0 0x7f5da006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:38.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.727+0000 7f5d9f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5da006cd20 0x7f5da015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.727+0000 7f5d9f59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da00a8380 con 0x7f5da014e7f0 2023-11-18T20:41:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.727+0000 7f5d9f59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da01510b0 con 0x7f5da006cd20 2023-11-18T20:41:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.727+0000 7f5d9f59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da006bf60 con 0x7f5da00c52e0 2023-11-18T20:41:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.727+0000 7f5d9ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5da006cd20 0x7f5da015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.727+0000 7f5d9ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5da006cd20 0x7f5da015ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50334/0 (socket says 172.21.15.132:50334) 2023-11-18T20:41:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.727+0000 7f5d9ed9d640 1 -- 172.21.15.132:0/3070966438 learned_addr learned my addr 172.21.15.132:0/3070966438 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.728+0000 7f5d97fff640 1 --2- 172.21.15.132:0/3070966438 >> v2:172.21.15.161:3300/0 conn(0x7f5da00c52e0 0x7f5da006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.728+0000 7f5d9ed9d640 1 -- 172.21.15.132:0/3070966438 >> v2:172.21.15.161:3300/0 conn(0x7f5da00c52e0 msgr2=0x7f5da006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.728+0000 7f5d9ed9d640 1 --2- 172.21.15.132:0/3070966438 >> v2:172.21.15.161:3300/0 conn(0x7f5da00c52e0 0x7f5da006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.728+0000 7f5d9ed9d640 1 -- 172.21.15.132:0/3070966438 >> v1:172.21.15.161:6789/0 conn(0x7f5da014e7f0 legacy=0x7f5da00c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.728+0000 7f5d9ed9d640 1 -- 172.21.15.132:0/3070966438 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da006c240 con 0x7f5da006cd20 2023-11-18T20:41:38.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.729+0000 7f5d9ed9d640 1 --2- 172.21.15.132:0/3070966438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da006cd20 0x7f5da015ba30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f5da006f680 tx=0x7f5d9802e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fffadbcb5d1691d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:38.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.729+0000 7f5d9dd9b640 1 -- 172.21.15.132:0/3070966438 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9802ea00 con 0x7f5da006cd20 2023-11-18T20:41:38.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.729+0000 7f5d9dd9b640 1 -- 172.21.15.132:0/3070966438 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9802eb60 con 0x7f5da006cd20 2023-11-18T20:41:38.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.729+0000 7f5d9dd9b640 1 -- 172.21.15.132:0/3070966438 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98009600 con 0x7f5da006cd20 2023-11-18T20:41:38.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.730+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3070966438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da006cd20 msgr2=0x7f5da015ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:38.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.730+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3070966438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da006cd20 0x7f5da015ba30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f5da006f680 tx=0x7f5d9802e060 comp rx=0 tx=0).stop 2023-11-18T20:41:38.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.730+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3070966438 shutdown_connections 2023-11-18T20:41:38.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.730+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3070966438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da006cd20 0x7f5da015ba30 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.730+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3070966438 >> v2:172.21.15.161:3300/0 conn(0x7f5da00c52e0 0x7f5da006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.730+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3070966438 >> 172.21.15.132:0/3070966438 conn(0x7f5da00a77f0 msgr2=0x7f5da00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:38.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.730+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3070966438 shutdown_connections 2023-11-18T20:41:38.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.730+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3070966438 wait complete. 2023-11-18T20:41:38.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.732+0000 7f5d9f59e640 1 Processor -- start 2023-11-18T20:41:38.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.732+0000 7f5d9f59e640 1 -- start start 2023-11-18T20:41:38.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da006cd20 0x7f5da0071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:38.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9f59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5da00c52e0 0x7f5da014a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:38.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da014e7f0 0x7f5da014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:38.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9f59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0148bc0 con 0x7f5da014e7f0 2023-11-18T20:41:38.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9f59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da014b170 con 0x7f5da006cd20 2023-11-18T20:41:38.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9f59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0150130 con 0x7f5da00c52e0 2023-11-18T20:41:38.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da014e7f0 0x7f5da014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:38.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da014e7f0 0x7f5da014ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50340/0 (socket says 172.21.15.132:50340) 2023-11-18T20:41:38.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9ed9d640 1 -- 172.21.15.132:0/3367914864 learned_addr learned my addr 172.21.15.132:0/3367914864 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:38.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9ed9d640 1 -- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5da00c52e0 msgr2=0x7f5da014a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9ed9d640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5da00c52e0 0x7f5da014a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9ed9d640 1 -- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da006cd20 msgr2=0x7f5da0071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9ed9d640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da006cd20 0x7f5da0071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.733+0000 7f5d9ed9d640 1 -- 172.21.15.132:0/3367914864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9800bd40 con 0x7f5da014e7f0 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.734+0000 7f5d9ed9d640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da014e7f0 0x7f5da014ac30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5d98038040 tx=0x7f5d98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.734+0000 7f5d96ffd640 1 -- 172.21.15.132:0/3367914864 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9802ea00 con 0x7f5da014e7f0 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.734+0000 7f5d96ffd640 1 -- 172.21.15.132:0/3367914864 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9800b720 con 0x7f5da014e7f0 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.734+0000 7f5d96ffd640 1 -- 172.21.15.132:0/3367914864 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98040880 con 0x7f5da014e7f0 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.734+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da014f880 con 0x7f5da014e7f0 2023-11-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.734+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da014fe40 con 0x7f5da014e7f0 2023-11-18T20:41:38.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.735+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da004e840 con 0x7f5da014e7f0 2023-11-18T20:41:38.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.736+0000 7f5d96ffd640 1 -- 172.21.15.132:0/3367914864 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d980409e0 con 0x7f5da014e7f0 2023-11-18T20:41:38.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.737+0000 7f5d96ffd640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d8006ae40 0x7f5d8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:38.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.737+0000 7f5d96ffd640 1 -- 172.21.15.132:0/3367914864 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5d980ae960 con 0x7f5da014e7f0 2023-11-18T20:41:38.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.738+0000 7f5d9e59c640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d8006ae40 0x7f5d8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:38.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.739+0000 7f5d9e59c640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d8006ae40 0x7f5d8006d300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5d90006fd0 tx=0x7f5d90006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:38.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.741+0000 7f5d96ffd640 1 -- 172.21.15.132:0/3367914864 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d980796c0 con 0x7f5da014e7f0 2023-11-18T20:41:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.971+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5da0148d00 con 0x7f5da014e7f0 2023-11-18T20:41:38.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.972+0000 7f5d96ffd640 1 -- 172.21.15.132:0/3367914864 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f5d9807cce0 con 0x7f5da014e7f0 2023-11-18T20:41:38.973 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:38.974 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:19.530586+0000","modified":"2023-11-18T20:41:22.840145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/726664783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":726664783},{"type":"v1","addr":"172.21.15.132:6835","nonce":726664783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:34.907589+0000","modified":"2023-11-18T20:41:37.972696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-18T20:41:38.974 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 50 2023-11-18T20:41:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.975+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d8006ae40 msgr2=0x7f5d8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.975+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d8006ae40 0x7f5d8006d300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5d90006fd0 tx=0x7f5d90006bc0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.975+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da014e7f0 msgr2=0x7f5da014ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.975+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da014e7f0 0x7f5da014ac30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5d98038040 tx=0x7f5d98004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:38.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.976+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 shutdown_connections 2023-11-18T20:41:38.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.976+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d8006ae40 0x7f5d8006d300 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.976+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5da014e7f0 0x7f5da014ac30 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.976+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5da00c52e0 0x7f5da014a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.976+0000 7f5d9f59e640 1 --2- 172.21.15.132:0/3367914864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da006cd20 0x7f5da0071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:38.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.976+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 >> 172.21.15.132:0/3367914864 conn(0x7f5da00a77f0 msgr2=0x7f5da00c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:38.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.976+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 shutdown_connections 2023-11-18T20:41:38.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:38.976+0000 7f5d9f59e640 1 -- 172.21.15.132:0/3367914864 wait complete. 2023-11-18T20:41:38.994 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:39.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.201+0000 7f46a8de9640 1 Processor -- start 2023-11-18T20:41:39.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.201+0000 7f46a8de9640 1 -- start start 2023-11-18T20:41:39.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.203+0000 7f46a8de9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.203+0000 7f46a8de9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46a406cd20 0x7f46a415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.203+0000 7f46a8de9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40a8380 con 0x7f46a414e7f0 2023-11-18T20:41:39.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.203+0000 7f46a8de9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a41510b0 con 0x7f46a406cd20 2023-11-18T20:41:39.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.203+0000 7f46a8de9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a406bf60 con 0x7f46a40c52e0 2023-11-18T20:41:39.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46a406cd20 0x7f46a415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a2ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46a406cd20 0x7f46a415ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:54780/0 (socket says 172.21.15.132:54780) 2023-11-18T20:41:39.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a3fff640 1 -- 172.21.15.132:0/1393854813 learned_addr learned my addr 172.21.15.132:0/1393854813 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:39.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a37fe640 1 --1- 172.21.15.132:0/1393854813 >> v1:172.21.15.161:6789/0 conn(0x7f46a414e7f0 0x7f46a40c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:38666/0 (socket says 172.21.15.132:38666) 2023-11-18T20:41:39.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a3fff640 1 -- 172.21.15.132:0/1393854813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 msgr2=0x7f46a406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:39.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a3fff640 1 --2- 172.21.15.132:0/1393854813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a3fff640 1 -- 172.21.15.132:0/1393854813 >> v1:172.21.15.161:6789/0 conn(0x7f46a414e7f0 legacy=0x7f46a40c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.204+0000 7f46a3fff640 1 -- 172.21.15.132:0/1393854813 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a406c240 con 0x7f46a406cd20 2023-11-18T20:41:39.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.206+0000 7f46a3fff640 1 --2- 172.21.15.132:0/1393854813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a406cd20 0x7f46a415ba30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f469c009e50 tx=0x7f469c02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8630c908c0fbcb25 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.206+0000 7f46a27fc640 1 -- 172.21.15.132:0/1393854813 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c02ca70 con 0x7f46a406cd20 2023-11-18T20:41:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.206+0000 7f46a27fc640 1 -- 172.21.15.132:0/1393854813 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c02cbd0 con 0x7f46a406cd20 2023-11-18T20:41:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.206+0000 7f46a27fc640 1 -- 172.21.15.132:0/1393854813 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0343f0 con 0x7f46a406cd20 2023-11-18T20:41:39.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.207+0000 7f46a8de9640 1 -- 172.21.15.132:0/1393854813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a406cd20 msgr2=0x7f46a415ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.207+0000 7f46a8de9640 1 --2- 172.21.15.132:0/1393854813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a406cd20 0x7f46a415ba30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f469c009e50 tx=0x7f469c02bed0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.207+0000 7f46a8de9640 1 -- 172.21.15.132:0/1393854813 shutdown_connections 2023-11-18T20:41:39.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.207+0000 7f46a8de9640 1 --2- 172.21.15.132:0/1393854813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a406cd20 0x7f46a415ba30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.207+0000 7f46a8de9640 1 --2- 172.21.15.132:0/1393854813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.207+0000 7f46a8de9640 1 -- 172.21.15.132:0/1393854813 >> 172.21.15.132:0/1393854813 conn(0x7f46a40a77f0 msgr2=0x7f46a40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:39.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.207+0000 7f46a8de9640 1 -- 172.21.15.132:0/1393854813 shutdown_connections 2023-11-18T20:41:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.207+0000 7f46a8de9640 1 -- 172.21.15.132:0/1393854813 wait complete. 2023-11-18T20:41:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.209+0000 7f46a8de9640 1 Processor -- start 2023-11-18T20:41:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.209+0000 7f46a8de9640 1 -- start start 2023-11-18T20:41:39.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.210+0000 7f46a8de9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46a406cd20 0x7f46a41eba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a8de9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a4071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a8de9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a414e7f0 0x7f46a414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a8de9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a41ec070 con 0x7f46a406cd20 2023-11-18T20:41:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a8de9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40a7120 con 0x7f46a414e7f0 2023-11-18T20:41:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a8de9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40a6940 con 0x7f46a40c52e0 2023-11-18T20:41:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46a406cd20 0x7f46a41eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46a406cd20 0x7f46a41eba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50352/0 (socket says 172.21.15.132:50352) 2023-11-18T20:41:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a37fe640 1 -- 172.21.15.132:0/3872228317 learned_addr learned my addr 172.21.15.132:0/3872228317 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a3fff640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a414e7f0 0x7f46a414cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a2ffd640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a4071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a37fe640 1 -- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 msgr2=0x7f46a4071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a37fe640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a4071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a37fe640 1 -- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a414e7f0 msgr2=0x7f46a414cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a37fe640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a414e7f0 0x7f46a414cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a37fe640 1 -- 172.21.15.132:0/3872228317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c009b30 con 0x7f46a406cd20 2023-11-18T20:41:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.211+0000 7f46a2ffd640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a4071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.212+0000 7f46a37fe640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46a406cd20 0x7f46a41eba90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f469400c3e0 tx=0x7f469400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.212+0000 7f468bfff640 1 -- 172.21.15.132:0/3872228317 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940074e0 con 0x7f46a406cd20 2023-11-18T20:41:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.212+0000 7f468bfff640 1 -- 172.21.15.132:0/3872228317 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694007640 con 0x7f46a406cd20 2023-11-18T20:41:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.212+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a413ebf0 con 0x7f46a406cd20 2023-11-18T20:41:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.212+0000 7f468bfff640 1 -- 172.21.15.132:0/3872228317 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940049e0 con 0x7f46a406cd20 2023-11-18T20:41:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.212+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a40a6c00 con 0x7f46a406cd20 2023-11-18T20:41:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.214+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a404e840 con 0x7f46a406cd20 2023-11-18T20:41:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.214+0000 7f468bfff640 1 -- 172.21.15.132:0/3872228317 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4694004b40 con 0x7f46a406cd20 2023-11-18T20:41:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.215+0000 7f468bfff640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f469006ae70 0x7f469006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.215+0000 7f468bfff640 1 -- 172.21.15.132:0/3872228317 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4694089340 con 0x7f46a406cd20 2023-11-18T20:41:39.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.216+0000 7f46a2ffd640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f469006ae70 0x7f469006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.217+0000 7f46a2ffd640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f469006ae70 0x7f469006d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f46a40a50f0 tx=0x7f4698008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:39.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.219+0000 7f468bfff640 1 -- 172.21.15.132:0/3872228317 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4694054080 con 0x7f46a406cd20 2023-11-18T20:41:39.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.413+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46a40c3c70 con 0x7f46a406cd20 2023-11-18T20:41:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.415+0000 7f468bfff640 1 -- 172.21.15.132:0/3872228317 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+20262 (secure 0 0 0) 0x7f46940576a0 con 0x7f46a406cd20 2023-11-18T20:41:39.417 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:39.417 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":80,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:36.459020+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:39.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f469006ae70 msgr2=0x7f469006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f469006ae70 0x7f469006d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f46a40a50f0 tx=0x7f4698008040 comp rx=0 tx=0).stop 2023-11-18T20:41:39.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46a406cd20 msgr2=0x7f46a41eba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46a406cd20 0x7f46a41eba90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f469400c3e0 tx=0x7f469400c8a0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 shutdown_connections 2023-11-18T20:41:39.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f469006ae70 0x7f469006d330 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46a414e7f0 0x7f46a414cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f46a40c52e0 0x7f46a4071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 --2- 172.21.15.132:0/3872228317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46a406cd20 0x7f46a41eba90 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 >> 172.21.15.132:0/3872228317 conn(0x7f46a40a77f0 msgr2=0x7f46a40c2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:39.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 shutdown_connections 2023-11-18T20:41:39.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.418+0000 7f46a8de9640 1 -- 172.21.15.132:0/3872228317 wait complete. 2023-11-18T20:41:39.439 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T20:41:39.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:41:39.452 INFO:tasks.ceph.mds.c.smithi132.stderr:2023-11-18T20:41:39.451+0000 7f57f2dcf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:41:39.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.646+0000 7f9d613b3640 1 Processor -- start 2023-11-18T20:41:39.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.646+0000 7f9d613b3640 1 -- start start 2023-11-18T20:41:39.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.647+0000 7f9d613b3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 0x7f9d5c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.647+0000 7f9d613b3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d5c06cd20 0x7f9d5c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.647+0000 7f9d613b3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c0a8380 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.647+0000 7f9d613b3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c1510b0 con 0x7f9d5c06cd20 2023-11-18T20:41:39.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.647+0000 7f9d613b3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c06bf60 con 0x7f9d5c0c52e0 2023-11-18T20:41:39.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.648+0000 7f9d60bb2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d5c06cd20 0x7f9d5c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.648+0000 7f9d53fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 0x7f9d5c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.648+0000 7f9d60bb2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d5c06cd20 0x7f9d5c15ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:54806/0 (socket says 172.21.15.132:54806) 2023-11-18T20:41:39.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.648+0000 7f9d60bb2640 1 -- 172.21.15.132:0/138338614 learned_addr learned my addr 172.21.15.132:0/138338614 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:39.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.648+0000 7f9d60bb2640 1 -- 172.21.15.132:0/138338614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 msgr2=0x7f9d5c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:39.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.648+0000 7f9d60bb2640 1 --2- 172.21.15.132:0/138338614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 0x7f9d5c06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.648+0000 7f9d60bb2640 1 -- 172.21.15.132:0/138338614 >> v1:172.21.15.161:6789/0 conn(0x7f9d5c14e7f0 legacy=0x7f9d5c0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.648+0000 7f9d60bb2640 1 -- 172.21.15.132:0/138338614 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c06c240 con 0x7f9d5c06cd20 2023-11-18T20:41:39.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.650+0000 7f9d60bb2640 1 --2- 172.21.15.132:0/138338614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 0x7f9d5c15ba30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009e50 tx=0x7f9d5402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3520d98eaad3887c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:39.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.650+0000 7f9d5b7fe640 1 -- 172.21.15.132:0/138338614 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5402ca70 con 0x7f9d5c06cd20 2023-11-18T20:41:39.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.650+0000 7f9d5b7fe640 1 -- 172.21.15.132:0/138338614 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5402cbd0 con 0x7f9d5c06cd20 2023-11-18T20:41:39.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.650+0000 7f9d5b7fe640 1 -- 172.21.15.132:0/138338614 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540343f0 con 0x7f9d5c06cd20 2023-11-18T20:41:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.651+0000 7f9d613b3640 1 -- 172.21.15.132:0/138338614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 msgr2=0x7f9d5c15ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.651+0000 7f9d613b3640 1 --2- 172.21.15.132:0/138338614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 0x7f9d5c15ba30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009e50 tx=0x7f9d5402bed0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.651+0000 7f9d613b3640 1 -- 172.21.15.132:0/138338614 shutdown_connections 2023-11-18T20:41:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.651+0000 7f9d613b3640 1 --2- 172.21.15.132:0/138338614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 0x7f9d5c15ba30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.651+0000 7f9d613b3640 1 --2- 172.21.15.132:0/138338614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 0x7f9d5c06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.651+0000 7f9d613b3640 1 -- 172.21.15.132:0/138338614 >> 172.21.15.132:0/138338614 conn(0x7f9d5c0a77f0 msgr2=0x7f9d5c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.651+0000 7f9d613b3640 1 -- 172.21.15.132:0/138338614 shutdown_connections 2023-11-18T20:41:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.651+0000 7f9d613b3640 1 -- 172.21.15.132:0/138338614 wait complete. 2023-11-18T20:41:39.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.653+0000 7f9d613b3640 1 Processor -- start 2023-11-18T20:41:39.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.653+0000 7f9d613b3640 1 -- start start 2023-11-18T20:41:39.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d613b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 0x7f9d5c1ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d613b3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 0x7f9d5c1ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d613b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c14e7f0 0x7f9d5c1ded60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d613b3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1ea480 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d613b3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0a5620 con 0x7f9d5c06cd20 2023-11-18T20:41:39.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d613b3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0a5900 con 0x7f9d5c0c52e0 2023-11-18T20:41:39.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d60bb2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c14e7f0 0x7f9d5c1ded60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d60bb2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c14e7f0 0x7f9d5c1ded60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50366/0 (socket says 172.21.15.132:50366) 2023-11-18T20:41:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d60bb2640 1 -- 172.21.15.132:0/436017424 learned_addr learned my addr 172.21.15.132:0/436017424 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d5bfff640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 0x7f9d5c1ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d60bb2640 1 -- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 msgr2=0x7f9d5c1ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d60bb2640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 0x7f9d5c1ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d60bb2640 1 -- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 msgr2=0x7f9d5c1ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d60bb2640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 0x7f9d5c1ea8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d60bb2640 1 -- 172.21.15.132:0/436017424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009b30 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.654+0000 7f9d5bfff640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 0x7f9d5c1ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.655+0000 7f9d60bb2640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c14e7f0 0x7f9d5c1ded60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009e50 tx=0x7f9d54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.655+0000 7f9d597fa640 1 -- 172.21.15.132:0/436017424 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54009510 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.655+0000 7f9d597fa640 1 -- 172.21.15.132:0/436017424 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5403e450 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.655+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c1ea0a0 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.655+0000 7f9d597fa640 1 -- 172.21.15.132:0/436017424 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5403e800 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.655+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c0c11f0 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.656+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c1ea5c0 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.657+0000 7f9d597fa640 1 -- 172.21.15.132:0/436017424 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d5403e960 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.658+0000 7f9d597fa640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3c06ae40 0x7f9d3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.658+0000 7f9d597fa640 1 -- 172.21.15.132:0/436017424 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9d540ac5d0 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.659+0000 7f9d5bfff640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3c06ae40 0x7f9d3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:39.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.660+0000 7f9d5bfff640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3c06ae40 0x7f9d3c06d300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c1df7e0 tx=0x7f9d4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:39.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.662+0000 7f9d597fa640 1 -- 172.21.15.132:0/436017424 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d5c1ea5c0 con 0x7f9d5c14e7f0 2023-11-18T20:41:39.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.849+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d5c151370 con 0x7f9d3c06ae40 2023-11-18T20:41:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.892+0000 7f9d597fa640 1 -- 172.21.15.132:0/436017424 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525178 (secure 0 0 0) 0x7f9d4c0050d0 con 0x7f9d3c06ae40 2023-11-18T20:41:39.900 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:39.904 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.902+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3c06ae40 msgr2=0x7f9d3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.902+0000 7f9d613b3640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3c06ae40 0x7f9d3c06d300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c1df7e0 tx=0x7f9d4c009040 comp rx=0 tx=0).stop 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.902+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c14e7f0 msgr2=0x7f9d5c1ded60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.902+0000 7f9d613b3640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c14e7f0 0x7f9d5c1ded60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009e50 tx=0x7f9d54004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.903+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 shutdown_connections 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.903+0000 7f9d613b3640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3c06ae40 0x7f9d3c06d300 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.903+0000 7f9d613b3640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c14e7f0 0x7f9d5c1ded60 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.903+0000 7f9d613b3640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d5c0c52e0 0x7f9d5c1ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.903+0000 7f9d613b3640 1 --2- 172.21.15.132:0/436017424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d5c06cd20 0x7f9d5c1ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:39.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.903+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 >> 172.21.15.132:0/436017424 conn(0x7f9d5c0a77f0 msgr2=0x7f9d5c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:39.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.903+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 shutdown_connections 2023-11-18T20:41:39.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:39.903+0000 7f9d613b3640 1 -- 172.21.15.132:0/436017424 wait complete. 2023-11-18T20:41:39.928 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-18T20:41:38.719220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":360,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250008,"kb_used_data":8876,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724712,"statfs":{"total":773094113280,"available":772838105088,"internally_reserved":0,"allocated":9089024,"data_stored":4705485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.293498"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481326+0000","last_change":"2023-11-18T20:41:35.475461+0000","last_active":"2023-11-18T20:41:36.481326+0000","last_peered":"2023-11-18T20:41:36.481326+0000","last_clean":"2023-11-18T20:41:36.481326+0000","last_became_active":"2023-11-18T20:41:35.475156+0000","last_became_peered":"2023-11-18T20:41:35.475156+0000","last_unstale":"2023-11-18T20:41:36.481326+0000","last_undegraded":"2023-11-18T20:41:36.481326+0000","last_fullsized":"2023-11-18T20:41:36.481326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:44.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456434+0000","last_change":"2023-11-18T20:41:20.117635+0000","last_active":"2023-11-18T20:41:34.456434+0000","last_peered":"2023-11-18T20:41:34.456434+0000","last_clean":"2023-11-18T20:41:34.456434+0000","last_became_active":"2023-11-18T20:41:20.117273+0000","last_became_peered":"2023-11-18T20:41:20.117273+0000","last_unstale":"2023-11-18T20:41:34.456434+0000","last_undegraded":"2023-11-18T20:41:34.456434+0000","last_fullsized":"2023-11-18T20:41:34.456434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:47.673490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.480320+0000","last_change":"2023-11-18T20:41:35.465470+0000","last_active":"2023-11-18T20:41:36.480320+0000","last_peered":"2023-11-18T20:41:36.480320+0000","last_clean":"2023-11-18T20:41:36.480320+0000","last_became_active":"2023-11-18T20:41:35.465192+0000","last_became_peered":"2023-11-18T20:41:35.465192+0000","last_unstale":"2023-11-18T20:41:36.480320+0000","last_undegraded":"2023-11-18T20:41:36.480320+0000","last_fullsized":"2023-11-18T20:41:36.480320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:20.622297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.470337+0000","last_change":"2023-11-18T20:41:20.104801+0000","last_active":"2023-11-18T20:41:35.470337+0000","last_peered":"2023-11-18T20:41:35.470337+0000","last_clean":"2023-11-18T20:41:35.470337+0000","last_became_active":"2023-11-18T20:41:20.103230+0000","last_became_peered":"2023-11-18T20:41:20.103230+0000","last_unstale":"2023-11-18T20:41:35.470337+0000","last_undegraded":"2023-11-18T20:41:35.470337+0000","last_fullsized":"2023-11-18T20:41:35.470337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.480981+0000","last_change":"2023-11-18T20:41:35.485011+0000","last_active":"2023-11-18T20:41:36.480981+0000","last_peered":"2023-11-18T20:41:36.480981+0000","last_clean":"2023-11-18T20:41:36.480981+0000","last_became_active":"2023-11-18T20:41:35.484718+0000","last_became_peered":"2023-11-18T20:41:35.484718+0000","last_unstale":"2023-11-18T20:41:36.480981+0000","last_undegraded":"2023-11-18T20:41:36.480981+0000","last_fullsized":"2023-11-18T20:41:36.480981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:39:52.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458382+0000","last_change":"2023-11-18T20:41:20.116375+0000","last_active":"2023-11-18T20:41:34.458382+0000","last_peered":"2023-11-18T20:41:34.458382+0000","last_clean":"2023-11-18T20:41:34.458382+0000","last_became_active":"2023-11-18T20:41:20.115271+0000","last_became_peered":"2023-11-18T20:41:20.115271+0000","last_unstale":"2023-11-18T20:41:34.458382+0000","last_undegraded":"2023-11-18T20:41:34.458382+0000","last_fullsized":"2023-11-18T20:41:34.458382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:47:17.588940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.482144+0000","last_change":"2023-11-18T20:41:35.477395+0000","last_active":"2023-11-18T20:41:36.482144+0000","last_peered":"2023-11-18T20:41:36.482144+0000","last_clean":"2023-11-18T20:41:36.482144+0000","last_became_active":"2023-11-18T20:41:35.476981+0000","last_became_peered":"2023-11-18T20:41:35.476981+0000","last_unstale":"2023-11-18T20:41:36.482144+0000","last_undegraded":"2023-11-18T20:41:36.482144+0000","last_fullsized":"2023-11-18T20:41:36.482144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:31:18.048271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467245+0000","last_change":"2023-11-18T20:41:20.115993+0000","last_active":"2023-11-18T20:41:34.467245+0000","last_peered":"2023-11-18T20:41:34.467245+0000","last_clean":"2023-11-18T20:41:34.467245+0000","last_became_active":"2023-11-18T20:41:20.111554+0000","last_became_peered":"2023-11-18T20:41:20.111554+0000","last_unstale":"2023-11-18T20:41:34.467245+0000","last_undegraded":"2023-11-18T20:41:34.467245+0000","last_fullsized":"2023-11-18T20:41:34.467245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:31.666571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477000+0000","last_change":"2023-11-18T20:41:35.479499+0000","last_active":"2023-11-18T20:41:36.477000+0000","last_peered":"2023-11-18T20:41:36.477000+0000","last_clean":"2023-11-18T20:41:36.477000+0000","last_became_active":"2023-11-18T20:41:35.479178+0000","last_became_peered":"2023-11-18T20:41:35.479178+0000","last_unstale":"2023-11-18T20:41:36.477000+0000","last_undegraded":"2023-11-18T20:41:36.477000+0000","last_fullsized":"2023-11-18T20:41:36.477000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:33.164275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.473895+0000","last_change":"2023-11-18T20:41:20.104778+0000","last_active":"2023-11-18T20:41:35.473895+0000","last_peered":"2023-11-18T20:41:35.473895+0000","last_clean":"2023-11-18T20:41:35.473895+0000","last_became_active":"2023-11-18T20:41:20.104320+0000","last_became_peered":"2023-11-18T20:41:20.104320+0000","last_unstale":"2023-11-18T20:41:35.473895+0000","last_undegraded":"2023-11-18T20:41:35.473895+0000","last_fullsized":"2023-11-18T20:41:35.473895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:01:59.745970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.476716+0000","last_change":"2023-11-18T20:41:35.478978+0000","last_active":"2023-11-18T20:41:36.476716+0000","last_peered":"2023-11-18T20:41:36.476716+0000","last_clean":"2023-11-18T20:41:36.476716+0000","last_became_active":"2023-11-18T20:41:35.478236+0000","last_became_peered":"2023-11-18T20:41:35.478236+0000","last_unstale":"2023-11-18T20:41:36.476716+0000","last_undegraded":"2023-11-18T20:41:36.476716+0000","last_fullsized":"2023-11-18T20:41:36.476716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:47.046362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455241+0000","last_change":"2023-11-18T20:41:20.107543+0000","last_active":"2023-11-18T20:41:34.455241+0000","last_peered":"2023-11-18T20:41:34.455241+0000","last_clean":"2023-11-18T20:41:34.455241+0000","last_became_active":"2023-11-18T20:41:20.107257+0000","last_became_peered":"2023-11-18T20:41:20.107257+0000","last_unstale":"2023-11-18T20:41:34.455241+0000","last_undegraded":"2023-11-18T20:41:34.455241+0000","last_fullsized":"2023-11-18T20:41:34.455241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:02.110658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477568+0000","last_change":"2023-11-18T20:41:35.490436+0000","last_active":"2023-11-18T20:41:36.477568+0000","last_peered":"2023-11-18T20:41:36.477568+0000","last_clean":"2023-11-18T20:41:36.477568+0000","last_became_active":"2023-11-18T20:41:35.485371+0000","last_became_peered":"2023-11-18T20:41:35.485371+0000","last_unstale":"2023-11-18T20:41:36.477568+0000","last_undegraded":"2023-11-18T20:41:36.477568+0000","last_fullsized":"2023-11-18T20:41:36.477568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:14.037436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467045+0000","last_change":"2023-11-18T20:41:20.109616+0000","last_active":"2023-11-18T20:41:35.467045+0000","last_peered":"2023-11-18T20:41:35.467045+0000","last_clean":"2023-11-18T20:41:35.467045+0000","last_became_active":"2023-11-18T20:41:20.108985+0000","last_became_peered":"2023-11-18T20:41:20.108985+0000","last_unstale":"2023-11-18T20:41:35.467045+0000","last_undegraded":"2023-11-18T20:41:35.467045+0000","last_fullsized":"2023-11-18T20:41:35.467045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:11:51.719786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477161+0000","last_change":"2023-11-18T20:41:35.483183+0000","last_active":"2023-11-18T20:41:36.477161+0000","last_peered":"2023-11-18T20:41:36.477161+0000","last_clean":"2023-11-18T20:41:36.477161+0000","last_became_active":"2023-11-18T20:41:35.482888+0000","last_became_peered":"2023-11-18T20:41:35.482888+0000","last_unstale":"2023-11-18T20:41:36.477161+0000","last_undegraded":"2023-11-18T20:41:36.477161+0000","last_fullsized":"2023-11-18T20:41:36.477161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:27.937737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441587+0000","last_change":"2023-11-18T20:41:20.109011+0000","last_active":"2023-11-18T20:41:34.441587+0000","last_peered":"2023-11-18T20:41:34.441587+0000","last_clean":"2023-11-18T20:41:34.441587+0000","last_became_active":"2023-11-18T20:41:20.107749+0000","last_became_peered":"2023-11-18T20:41:20.107749+0000","last_unstale":"2023-11-18T20:41:34.441587+0000","last_undegraded":"2023-11-18T20:41:34.441587+0000","last_fullsized":"2023-11-18T20:41:34.441587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:12.644063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477941+0000","last_change":"2023-11-18T20:41:35.496542+0000","last_active":"2023-11-18T20:41:36.477941+0000","last_peered":"2023-11-18T20:41:36.477941+0000","last_clean":"2023-11-18T20:41:36.477941+0000","last_became_active":"2023-11-18T20:41:35.496253+0000","last_became_peered":"2023-11-18T20:41:35.496253+0000","last_unstale":"2023-11-18T20:41:36.477941+0000","last_undegraded":"2023-11-18T20:41:36.477941+0000","last_fullsized":"2023-11-18T20:41:36.477941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:10.413270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456351+0000","last_change":"2023-11-18T20:41:20.111675+0000","last_active":"2023-11-18T20:41:34.456351+0000","last_peered":"2023-11-18T20:41:34.456351+0000","last_clean":"2023-11-18T20:41:34.456351+0000","last_became_active":"2023-11-18T20:41:20.111344+0000","last_became_peered":"2023-11-18T20:41:20.111344+0000","last_unstale":"2023-11-18T20:41:34.456351+0000","last_undegraded":"2023-11-18T20:41:34.456351+0000","last_fullsized":"2023-11-18T20:41:34.456351+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:11:51.719786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.473479+0000","last_change":"2023-11-18T20:41:35.460266+0000","last_active":"2023-11-18T20:41:35.473479+0000","last_peered":"2023-11-18T20:41:35.473479+0000","last_clean":"2023-11-18T20:41:35.473479+0000","last_became_active":"2023-11-18T20:41:35.459436+0000","last_became_peered":"2023-11-18T20:41:35.459436+0000","last_unstale":"2023-11-18T20:41:35.473479+0000","last_undegraded":"2023-11-18T20:41:35.473479+0000","last_fullsized":"2023-11-18T20:41:35.473479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:59.565550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458410+0000","last_change":"2023-11-18T20:41:20.101257+0000","last_active":"2023-11-18T20:41:34.458410+0000","last_peered":"2023-11-18T20:41:34.458410+0000","last_clean":"2023-11-18T20:41:34.458410+0000","last_became_active":"2023-11-18T20:41:20.100858+0000","last_became_peered":"2023-11-18T20:41:20.100858+0000","last_unstale":"2023-11-18T20:41:34.458410+0000","last_undegraded":"2023-11-18T20:41:34.458410+0000","last_fullsized":"2023-11-18T20:41:34.458410+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:29.068227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477295+0000","last_change":"2023-11-18T20:41:35.482326+0000","last_active":"2023-11-18T20:41:36.477295+0000","last_peered":"2023-11-18T20:41:36.477295+0000","last_clean":"2023-11-18T20:41:36.477295+0000","last_became_active":"2023-11-18T20:41:35.481947+0000","last_became_peered":"2023-11-18T20:41:35.481947+0000","last_unstale":"2023-11-18T20:41:36.477295+0000","last_undegraded":"2023-11-18T20:41:36.477295+0000","last_fullsized":"2023-11-18T20:41:36.477295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:54.699054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.454542+0000","last_change":"2023-11-18T20:41:20.099422+0000","last_active":"2023-11-18T20:41:35.454542+0000","last_peered":"2023-11-18T20:41:35.454542+0000","last_clean":"2023-11-18T20:41:35.454542+0000","last_became_active":"2023-11-18T20:41:20.099063+0000","last_became_peered":"2023-11-18T20:41:20.099063+0000","last_unstale":"2023-11-18T20:41:35.454542+0000","last_undegraded":"2023-11-18T20:41:35.454542+0000","last_fullsized":"2023-11-18T20:41:35.454542+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:39.186938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.470640+0000","last_change":"2023-11-18T20:41:35.467793+0000","last_active":"2023-11-18T20:41:35.470640+0000","last_peered":"2023-11-18T20:41:35.470640+0000","last_clean":"2023-11-18T20:41:35.470640+0000","last_became_active":"2023-11-18T20:41:35.467381+0000","last_became_peered":"2023-11-18T20:41:35.467381+0000","last_unstale":"2023-11-18T20:41:35.470640+0000","last_undegraded":"2023-11-18T20:41:35.470640+0000","last_fullsized":"2023-11-18T20:41:35.470640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:35.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441672+0000","last_change":"2023-11-18T20:41:20.098674+0000","last_active":"2023-11-18T20:41:34.441672+0000","last_peered":"2023-11-18T20:41:34.441672+0000","last_clean":"2023-11-18T20:41:34.441672+0000","last_became_active":"2023-11-18T20:41:20.098290+0000","last_became_peered":"2023-11-18T20:41:20.098290+0000","last_unstale":"2023-11-18T20:41:34.441672+0000","last_undegraded":"2023-11-18T20:41:34.441672+0000","last_fullsized":"2023-11-18T20:41:34.441672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:52.964496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479240+0000","last_change":"2023-11-18T20:41:35.479490+0000","last_active":"2023-11-18T20:41:36.479240+0000","last_peered":"2023-11-18T20:41:36.479240+0000","last_clean":"2023-11-18T20:41:36.479240+0000","last_became_active":"2023-11-18T20:41:35.479205+0000","last_became_peered":"2023-11-18T20:41:35.479205+0000","last_unstale":"2023-11-18T20:41:36.479240+0000","last_undegraded":"2023-11-18T20:41:36.479240+0000","last_fullsized":"2023-11-18T20:41:36.479240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:01:31.291589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.474028+0000","last_change":"2023-11-18T20:41:20.104041+0000","last_active":"2023-11-18T20:41:35.474028+0000","last_peered":"2023-11-18T20:41:35.474028+0000","last_clean":"2023-11-18T20:41:35.474028+0000","last_became_active":"2023-11-18T20:41:20.103344+0000","last_became_peered":"2023-11-18T20:41:20.103344+0000","last_unstale":"2023-11-18T20:41:35.474028+0000","last_undegraded":"2023-11-18T20:41:35.474028+0000","last_fullsized":"2023-11-18T20:41:35.474028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:56:39.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.476686+0000","last_change":"2023-11-18T20:41:35.489443+0000","last_active":"2023-11-18T20:41:36.476686+0000","last_peered":"2023-11-18T20:41:36.476686+0000","last_clean":"2023-11-18T20:41:36.476686+0000","last_became_active":"2023-11-18T20:41:35.489193+0000","last_became_peered":"2023-11-18T20:41:35.489193+0000","last_unstale":"2023-11-18T20:41:36.476686+0000","last_undegraded":"2023-11-18T20:41:36.476686+0000","last_fullsized":"2023-11-18T20:41:36.476686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:29:31.143027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.469372+0000","last_change":"2023-11-18T20:41:20.112751+0000","last_active":"2023-11-18T20:41:34.469372+0000","last_peered":"2023-11-18T20:41:34.469372+0000","last_clean":"2023-11-18T20:41:34.469372+0000","last_became_active":"2023-11-18T20:41:20.112163+0000","last_became_peered":"2023-11-18T20:41:20.112163+0000","last_unstale":"2023-11-18T20:41:34.469372+0000","last_undegraded":"2023-11-18T20:41:34.469372+0000","last_fullsized":"2023-11-18T20:41:34.469372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:07.262178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.487450+0000","last_change":"2023-11-18T20:41:35.478953+0000","last_active":"2023-11-18T20:41:35.487450+0000","last_peered":"2023-11-18T20:41:35.487450+0000","last_clean":"2023-11-18T20:41:35.487450+0000","last_became_active":"2023-11-18T20:41:35.478674+0000","last_became_peered":"2023-11-18T20:41:35.478674+0000","last_unstale":"2023-11-18T20:41:35.487450+0000","last_undegraded":"2023-11-18T20:41:35.487450+0000","last_fullsized":"2023-11-18T20:41:35.487450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:05.627633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467195+0000","last_change":"2023-11-18T20:41:20.113124+0000","last_active":"2023-11-18T20:41:35.467195+0000","last_peered":"2023-11-18T20:41:35.467195+0000","last_clean":"2023-11-18T20:41:35.467195+0000","last_became_active":"2023-11-18T20:41:20.112677+0000","last_became_peered":"2023-11-18T20:41:20.112677+0000","last_unstale":"2023-11-18T20:41:35.467195+0000","last_undegraded":"2023-11-18T20:41:35.467195+0000","last_fullsized":"2023-11-18T20:41:35.467195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:19.506976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477825+0000","last_change":"2023-11-18T20:41:35.477546+0000","last_active":"2023-11-18T20:41:36.477825+0000","last_peered":"2023-11-18T20:41:36.477825+0000","last_clean":"2023-11-18T20:41:36.477825+0000","last_became_active":"2023-11-18T20:41:35.477212+0000","last_became_peered":"2023-11-18T20:41:35.477212+0000","last_unstale":"2023-11-18T20:41:36.477825+0000","last_undegraded":"2023-11-18T20:41:36.477825+0000","last_fullsized":"2023-11-18T20:41:36.477825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:09:40.570173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.450188+0000","last_change":"2023-11-18T20:41:20.110907+0000","last_active":"2023-11-18T20:41:34.450188+0000","last_peered":"2023-11-18T20:41:34.450188+0000","last_clean":"2023-11-18T20:41:34.450188+0000","last_became_active":"2023-11-18T20:41:20.110466+0000","last_became_peered":"2023-11-18T20:41:20.110466+0000","last_unstale":"2023-11-18T20:41:34.450188+0000","last_undegraded":"2023-11-18T20:41:34.450188+0000","last_fullsized":"2023-11-18T20:41:34.450188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:23.776329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.475731+0000","last_change":"2023-11-18T20:41:35.470404+0000","last_active":"2023-11-18T20:41:35.475731+0000","last_peered":"2023-11-18T20:41:35.475731+0000","last_clean":"2023-11-18T20:41:35.475731+0000","last_became_active":"2023-11-18T20:41:35.467157+0000","last_became_peered":"2023-11-18T20:41:35.467157+0000","last_unstale":"2023-11-18T20:41:35.475731+0000","last_undegraded":"2023-11-18T20:41:35.475731+0000","last_fullsized":"2023-11-18T20:41:35.475731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:41.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442860+0000","last_change":"2023-11-18T20:41:20.104532+0000","last_active":"2023-11-18T20:41:34.442860+0000","last_peered":"2023-11-18T20:41:34.442860+0000","last_clean":"2023-11-18T20:41:34.442860+0000","last_became_active":"2023-11-18T20:41:20.104235+0000","last_became_peered":"2023-11-18T20:41:20.104235+0000","last_unstale":"2023-11-18T20:41:34.442860+0000","last_undegraded":"2023-11-18T20:41:34.442860+0000","last_fullsized":"2023-11-18T20:41:34.442860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:09:19.926012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.496851+0000","last_change":"2023-11-18T20:41:35.487372+0000","last_active":"2023-11-18T20:41:35.496851+0000","last_peered":"2023-11-18T20:41:35.496851+0000","last_clean":"2023-11-18T20:41:35.496851+0000","last_became_active":"2023-11-18T20:41:35.487010+0000","last_became_peered":"2023-11-18T20:41:35.487010+0000","last_unstale":"2023-11-18T20:41:35.496851+0000","last_undegraded":"2023-11-18T20:41:35.496851+0000","last_fullsized":"2023-11-18T20:41:35.496851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:20.944116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.455657+0000","last_change":"2023-11-18T20:41:20.115645+0000","last_active":"2023-11-18T20:41:35.455657+0000","last_peered":"2023-11-18T20:41:35.455657+0000","last_clean":"2023-11-18T20:41:35.455657+0000","last_became_active":"2023-11-18T20:41:20.115236+0000","last_became_peered":"2023-11-18T20:41:20.115236+0000","last_unstale":"2023-11-18T20:41:35.455657+0000","last_undegraded":"2023-11-18T20:41:35.455657+0000","last_fullsized":"2023-11-18T20:41:35.455657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:38.518205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488892+0000","last_change":"2023-11-18T20:41:35.485723+0000","last_active":"2023-11-18T20:41:35.488892+0000","last_peered":"2023-11-18T20:41:35.488892+0000","last_clean":"2023-11-18T20:41:35.488892+0000","last_became_active":"2023-11-18T20:41:35.485282+0000","last_became_peered":"2023-11-18T20:41:35.485282+0000","last_unstale":"2023-11-18T20:41:35.488892+0000","last_undegraded":"2023-11-18T20:41:35.488892+0000","last_fullsized":"2023-11-18T20:41:35.488892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:26.268599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474829+0000","last_change":"2023-11-18T20:41:20.113295+0000","last_active":"2023-11-18T20:41:34.474829+0000","last_peered":"2023-11-18T20:41:34.474829+0000","last_clean":"2023-11-18T20:41:34.474829+0000","last_became_active":"2023-11-18T20:41:20.112041+0000","last_became_peered":"2023-11-18T20:41:20.112041+0000","last_unstale":"2023-11-18T20:41:34.474829+0000","last_undegraded":"2023-11-18T20:41:34.474829+0000","last_fullsized":"2023-11-18T20:41:34.474829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:16.917978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.482748+0000","last_change":"2023-11-18T20:41:35.470167+0000","last_active":"2023-11-18T20:41:36.482748+0000","last_peered":"2023-11-18T20:41:36.482748+0000","last_clean":"2023-11-18T20:41:36.482748+0000","last_became_active":"2023-11-18T20:41:35.469725+0000","last_became_peered":"2023-11-18T20:41:35.469725+0000","last_unstale":"2023-11-18T20:41:36.482748+0000","last_undegraded":"2023-11-18T20:41:36.482748+0000","last_fullsized":"2023-11-18T20:41:36.482748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:04.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474569+0000","last_change":"2023-11-18T20:41:20.116700+0000","last_active":"2023-11-18T20:41:34.474569+0000","last_peered":"2023-11-18T20:41:34.474569+0000","last_clean":"2023-11-18T20:41:34.474569+0000","last_became_active":"2023-11-18T20:41:20.112782+0000","last_became_peered":"2023-11-18T20:41:20.112782+0000","last_unstale":"2023-11-18T20:41:34.474569+0000","last_undegraded":"2023-11-18T20:41:34.474569+0000","last_fullsized":"2023-11-18T20:41:34.474569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:12.856780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479437+0000","last_change":"2023-11-18T20:41:35.483996+0000","last_active":"2023-11-18T20:41:36.479437+0000","last_peered":"2023-11-18T20:41:36.479437+0000","last_clean":"2023-11-18T20:41:36.479437+0000","last_became_active":"2023-11-18T20:41:35.482754+0000","last_became_peered":"2023-11-18T20:41:35.482754+0000","last_unstale":"2023-11-18T20:41:36.479437+0000","last_undegraded":"2023-11-18T20:41:36.479437+0000","last_fullsized":"2023-11-18T20:41:36.479437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:53:20.381092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.465135+0000","last_change":"2023-11-18T20:41:20.117339+0000","last_active":"2023-11-18T20:41:34.465135+0000","last_peered":"2023-11-18T20:41:34.465135+0000","last_clean":"2023-11-18T20:41:34.465135+0000","last_became_active":"2023-11-18T20:41:20.115272+0000","last_became_peered":"2023-11-18T20:41:20.115272+0000","last_unstale":"2023-11-18T20:41:34.465135+0000","last_undegraded":"2023-11-18T20:41:34.465135+0000","last_fullsized":"2023-11-18T20:41:34.465135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:26.942016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.476547+0000","last_change":"2023-11-18T20:41:35.474365+0000","last_active":"2023-11-18T20:41:35.476547+0000","last_peered":"2023-11-18T20:41:35.476547+0000","last_clean":"2023-11-18T20:41:35.476547+0000","last_became_active":"2023-11-18T20:41:35.474065+0000","last_became_peered":"2023-11-18T20:41:35.474065+0000","last_unstale":"2023-11-18T20:41:35.476547+0000","last_undegraded":"2023-11-18T20:41:35.476547+0000","last_fullsized":"2023-11-18T20:41:35.476547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:15.720731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.469467+0000","last_change":"2023-11-18T20:41:20.102268+0000","last_active":"2023-11-18T20:41:34.469467+0000","last_peered":"2023-11-18T20:41:34.469467+0000","last_clean":"2023-11-18T20:41:34.469467+0000","last_became_active":"2023-11-18T20:41:20.101961+0000","last_became_peered":"2023-11-18T20:41:20.101961+0000","last_unstale":"2023-11-18T20:41:34.469467+0000","last_undegraded":"2023-11-18T20:41:34.469467+0000","last_fullsized":"2023-11-18T20:41:34.469467+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:20.621597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478958+0000","last_change":"2023-11-18T20:41:35.479661+0000","last_active":"2023-11-18T20:41:36.478958+0000","last_peered":"2023-11-18T20:41:36.478958+0000","last_clean":"2023-11-18T20:41:36.478958+0000","last_became_active":"2023-11-18T20:41:35.479321+0000","last_became_peered":"2023-11-18T20:41:35.479321+0000","last_unstale":"2023-11-18T20:41:36.478958+0000","last_undegraded":"2023-11-18T20:41:36.478958+0000","last_fullsized":"2023-11-18T20:41:36.478958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:39:49.659639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441479+0000","last_change":"2023-11-18T20:41:20.103507+0000","last_active":"2023-11-18T20:41:34.441479+0000","last_peered":"2023-11-18T20:41:34.441479+0000","last_clean":"2023-11-18T20:41:34.441479+0000","last_became_active":"2023-11-18T20:41:20.103229+0000","last_became_peered":"2023-11-18T20:41:20.103229+0000","last_unstale":"2023-11-18T20:41:34.441479+0000","last_undegraded":"2023-11-18T20:41:34.441479+0000","last_fullsized":"2023-11-18T20:41:34.441479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:18.565605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477400+0000","last_change":"2023-11-18T20:41:35.482739+0000","last_active":"2023-11-18T20:41:36.477400+0000","last_peered":"2023-11-18T20:41:36.477400+0000","last_clean":"2023-11-18T20:41:36.477400+0000","last_became_active":"2023-11-18T20:41:35.482108+0000","last_became_peered":"2023-11-18T20:41:35.482108+0000","last_unstale":"2023-11-18T20:41:36.477400+0000","last_undegraded":"2023-11-18T20:41:36.477400+0000","last_fullsized":"2023-11-18T20:41:36.477400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:44:44.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.455375+0000","last_change":"2023-11-18T20:41:20.091675+0000","last_active":"2023-11-18T20:41:35.455375+0000","last_peered":"2023-11-18T20:41:35.455375+0000","last_clean":"2023-11-18T20:41:35.455375+0000","last_became_active":"2023-11-18T20:41:20.090899+0000","last_became_peered":"2023-11-18T20:41:20.090899+0000","last_unstale":"2023-11-18T20:41:35.455375+0000","last_undegraded":"2023-11-18T20:41:35.455375+0000","last_fullsized":"2023-11-18T20:41:35.455375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:48.975726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.489645+0000","last_change":"2023-11-18T20:41:35.486797+0000","last_active":"2023-11-18T20:41:35.489645+0000","last_peered":"2023-11-18T20:41:35.489645+0000","last_clean":"2023-11-18T20:41:35.489645+0000","last_became_active":"2023-11-18T20:41:35.486050+0000","last_became_peered":"2023-11-18T20:41:35.486050+0000","last_unstale":"2023-11-18T20:41:35.489645+0000","last_undegraded":"2023-11-18T20:41:35.489645+0000","last_fullsized":"2023-11-18T20:41:35.489645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:34.776296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.456720+0000","last_change":"2023-11-18T20:41:20.108207+0000","last_active":"2023-11-18T20:41:35.456720+0000","last_peered":"2023-11-18T20:41:35.456720+0000","last_clean":"2023-11-18T20:41:35.456720+0000","last_became_active":"2023-11-18T20:41:20.107904+0000","last_became_peered":"2023-11-18T20:41:20.107904+0000","last_unstale":"2023-11-18T20:41:35.456720+0000","last_undegraded":"2023-11-18T20:41:35.456720+0000","last_fullsized":"2023-11-18T20:41:35.456720+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:51:46.638757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485388+0000","last_change":"2023-11-18T20:41:35.477889+0000","last_active":"2023-11-18T20:41:35.485388+0000","last_peered":"2023-11-18T20:41:35.485388+0000","last_clean":"2023-11-18T20:41:35.485388+0000","last_became_active":"2023-11-18T20:41:35.477620+0000","last_became_peered":"2023-11-18T20:41:35.477620+0000","last_unstale":"2023-11-18T20:41:35.485388+0000","last_undegraded":"2023-11-18T20:41:35.485388+0000","last_fullsized":"2023-11-18T20:41:35.485388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:44.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.472888+0000","last_change":"2023-11-18T20:41:20.113713+0000","last_active":"2023-11-18T20:41:35.472888+0000","last_peered":"2023-11-18T20:41:35.472888+0000","last_clean":"2023-11-18T20:41:35.472888+0000","last_became_active":"2023-11-18T20:41:20.110227+0000","last_became_peered":"2023-11-18T20:41:20.110227+0000","last_unstale":"2023-11-18T20:41:35.472888+0000","last_undegraded":"2023-11-18T20:41:35.472888+0000","last_fullsized":"2023-11-18T20:41:35.472888+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:59.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.479305+0000","last_change":"2023-11-18T20:41:35.476066+0000","last_active":"2023-11-18T20:41:35.479305+0000","last_peered":"2023-11-18T20:41:35.479305+0000","last_clean":"2023-11-18T20:41:35.479305+0000","last_became_active":"2023-11-18T20:41:35.475734+0000","last_became_peered":"2023-11-18T20:41:35.475734+0000","last_unstale":"2023-11-18T20:41:35.479305+0000","last_undegraded":"2023-11-18T20:41:35.479305+0000","last_fullsized":"2023-11-18T20:41:35.479305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:15.887758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.478826+0000","last_change":"2023-11-18T20:41:20.112885+0000","last_active":"2023-11-18T20:41:35.478826+0000","last_peered":"2023-11-18T20:41:35.478826+0000","last_clean":"2023-11-18T20:41:35.478826+0000","last_became_active":"2023-11-18T20:41:20.112261+0000","last_became_peered":"2023-11-18T20:41:20.112261+0000","last_unstale":"2023-11-18T20:41:35.478826+0000","last_undegraded":"2023-11-18T20:41:35.478826+0000","last_fullsized":"2023-11-18T20:41:35.478826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:41.942790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488113+0000","last_change":"2023-11-18T20:41:35.484598+0000","last_active":"2023-11-18T20:41:35.488113+0000","last_peered":"2023-11-18T20:41:35.488113+0000","last_clean":"2023-11-18T20:41:35.488113+0000","last_became_active":"2023-11-18T20:41:35.484246+0000","last_became_peered":"2023-11-18T20:41:35.484246+0000","last_unstale":"2023-11-18T20:41:35.488113+0000","last_undegraded":"2023-11-18T20:41:35.488113+0000","last_fullsized":"2023-11-18T20:41:35.488113+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:48:15.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455458+0000","last_change":"2023-11-18T20:41:20.111059+0000","last_active":"2023-11-18T20:41:34.455458+0000","last_peered":"2023-11-18T20:41:34.455458+0000","last_clean":"2023-11-18T20:41:34.455458+0000","last_became_active":"2023-11-18T20:41:20.110792+0000","last_became_peered":"2023-11-18T20:41:20.110792+0000","last_unstale":"2023-11-18T20:41:34.455458+0000","last_undegraded":"2023-11-18T20:41:34.455458+0000","last_fullsized":"2023-11-18T20:41:34.455458+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:00.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479347+0000","last_change":"2023-11-18T20:41:35.473992+0000","last_active":"2023-11-18T20:41:36.479347+0000","last_peered":"2023-11-18T20:41:36.479347+0000","last_clean":"2023-11-18T20:41:36.479347+0000","last_became_active":"2023-11-18T20:41:35.473675+0000","last_became_peered":"2023-11-18T20:41:35.473675+0000","last_unstale":"2023-11-18T20:41:36.479347+0000","last_undegraded":"2023-11-18T20:41:36.479347+0000","last_fullsized":"2023-11-18T20:41:36.479347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:33:47.509189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.465233+0000","last_change":"2023-11-18T20:41:20.111828+0000","last_active":"2023-11-18T20:41:34.465233+0000","last_peered":"2023-11-18T20:41:34.465233+0000","last_clean":"2023-11-18T20:41:34.465233+0000","last_became_active":"2023-11-18T20:41:20.110560+0000","last_became_peered":"2023-11-18T20:41:20.110560+0000","last_unstale":"2023-11-18T20:41:34.465233+0000","last_undegraded":"2023-11-18T20:41:34.465233+0000","last_fullsized":"2023-11-18T20:41:34.465233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:00.507967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478568+0000","last_change":"2023-11-18T20:41:35.475985+0000","last_active":"2023-11-18T20:41:36.478568+0000","last_peered":"2023-11-18T20:41:36.478568+0000","last_clean":"2023-11-18T20:41:36.478568+0000","last_became_active":"2023-11-18T20:41:35.475367+0000","last_became_peered":"2023-11-18T20:41:35.475367+0000","last_unstale":"2023-11-18T20:41:36.478568+0000","last_undegraded":"2023-11-18T20:41:36.478568+0000","last_fullsized":"2023-11-18T20:41:36.478568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:05:00.712942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.469583+0000","last_change":"2023-11-18T20:41:20.112929+0000","last_active":"2023-11-18T20:41:34.469583+0000","last_peered":"2023-11-18T20:41:34.469583+0000","last_clean":"2023-11-18T20:41:34.469583+0000","last_became_active":"2023-11-18T20:41:20.112458+0000","last_became_peered":"2023-11-18T20:41:20.112458+0000","last_unstale":"2023-11-18T20:41:34.469583+0000","last_undegraded":"2023-11-18T20:41:34.469583+0000","last_fullsized":"2023-11-18T20:41:34.469583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:07:39.968375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.484293+0000","last_change":"2023-11-18T20:41:35.473813+0000","last_active":"2023-11-18T20:41:35.484293+0000","last_peered":"2023-11-18T20:41:35.484293+0000","last_clean":"2023-11-18T20:41:35.484293+0000","last_became_active":"2023-11-18T20:41:35.473509+0000","last_became_peered":"2023-11-18T20:41:35.473509+0000","last_unstale":"2023-11-18T20:41:35.484293+0000","last_undegraded":"2023-11-18T20:41:35.484293+0000","last_fullsized":"2023-11-18T20:41:35.484293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:56.112575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455024+0000","last_change":"2023-11-18T20:41:20.112777+0000","last_active":"2023-11-18T20:41:34.455024+0000","last_peered":"2023-11-18T20:41:34.455024+0000","last_clean":"2023-11-18T20:41:34.455024+0000","last_became_active":"2023-11-18T20:41:20.112503+0000","last_became_peered":"2023-11-18T20:41:20.112503+0000","last_unstale":"2023-11-18T20:41:34.455024+0000","last_undegraded":"2023-11-18T20:41:34.455024+0000","last_fullsized":"2023-11-18T20:41:34.455024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:06.680384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.489229+0000","last_change":"2023-11-18T20:41:35.485663+0000","last_active":"2023-11-18T20:41:35.489229+0000","last_peered":"2023-11-18T20:41:35.489229+0000","last_clean":"2023-11-18T20:41:35.489229+0000","last_became_active":"2023-11-18T20:41:35.484301+0000","last_became_peered":"2023-11-18T20:41:35.484301+0000","last_unstale":"2023-11-18T20:41:35.489229+0000","last_undegraded":"2023-11-18T20:41:35.489229+0000","last_fullsized":"2023-11-18T20:41:35.489229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:37:21.691067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.450275+0000","last_change":"2023-11-18T20:41:20.110729+0000","last_active":"2023-11-18T20:41:34.450275+0000","last_peered":"2023-11-18T20:41:34.450275+0000","last_clean":"2023-11-18T20:41:34.450275+0000","last_became_active":"2023-11-18T20:41:20.110065+0000","last_became_peered":"2023-11-18T20:41:20.110065+0000","last_unstale":"2023-11-18T20:41:34.450275+0000","last_undegraded":"2023-11-18T20:41:34.450275+0000","last_fullsized":"2023-11-18T20:41:34.450275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:19:08.144001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478438+0000","last_change":"2023-11-18T20:41:35.472605+0000","last_active":"2023-11-18T20:41:36.478438+0000","last_peered":"2023-11-18T20:41:36.478438+0000","last_clean":"2023-11-18T20:41:36.478438+0000","last_became_active":"2023-11-18T20:41:35.471987+0000","last_became_peered":"2023-11-18T20:41:35.471987+0000","last_unstale":"2023-11-18T20:41:36.478438+0000","last_undegraded":"2023-11-18T20:41:36.478438+0000","last_fullsized":"2023-11-18T20:41:36.478438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:41:29.138639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481596+0000","last_change":"2023-11-18T20:41:34.474217+0000","last_active":"2023-11-18T20:41:36.481596+0000","last_peered":"2023-11-18T20:41:36.481596+0000","last_clean":"2023-11-18T20:41:36.481596+0000","last_became_active":"2023-11-18T20:41:34.473723+0000","last_became_peered":"2023-11-18T20:41:34.473723+0000","last_unstale":"2023-11-18T20:41:36.481596+0000","last_undegraded":"2023-11-18T20:41:36.481596+0000","last_fullsized":"2023-11-18T20:41:36.481596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:14.873070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441766+0000","last_change":"2023-11-18T20:41:20.119005+0000","last_active":"2023-11-18T20:41:34.441766+0000","last_peered":"2023-11-18T20:41:34.441766+0000","last_clean":"2023-11-18T20:41:34.441766+0000","last_became_active":"2023-11-18T20:41:20.117330+0000","last_became_peered":"2023-11-18T20:41:20.117330+0000","last_unstale":"2023-11-18T20:41:34.441766+0000","last_undegraded":"2023-11-18T20:41:34.441766+0000","last_fullsized":"2023-11-18T20:41:34.441766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:06.680384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"75'4","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.474366+0000","last_change":"2023-11-18T20:41:19.079310+0000","last_active":"2023-11-18T20:41:35.474366+0000","last_peered":"2023-11-18T20:41:35.474366+0000","last_clean":"2023-11-18T20:41:35.474366+0000","last_became_active":"2023-11-18T20:41:19.078074+0000","last_became_peered":"2023-11-18T20:41:19.078074+0000","last_unstale":"2023-11-18T20:41:35.474366+0000","last_undegraded":"2023-11-18T20:41:35.474366+0000","last_fullsized":"2023-11-18T20:41:35.474366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:52.898832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.490156+0000","last_change":"2023-11-18T20:41:35.484239+0000","last_active":"2023-11-18T20:41:35.490156+0000","last_peered":"2023-11-18T20:41:35.490156+0000","last_clean":"2023-11-18T20:41:35.490156+0000","last_became_active":"2023-11-18T20:41:35.483717+0000","last_became_peered":"2023-11-18T20:41:35.483717+0000","last_unstale":"2023-11-18T20:41:35.490156+0000","last_undegraded":"2023-11-18T20:41:35.490156+0000","last_fullsized":"2023-11-18T20:41:35.490156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:42.321807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.480029+0000","last_change":"2023-11-18T20:41:34.468941+0000","last_active":"2023-11-18T20:41:36.480029+0000","last_peered":"2023-11-18T20:41:36.480029+0000","last_clean":"2023-11-18T20:41:36.480029+0000","last_became_active":"2023-11-18T20:41:34.467226+0000","last_became_peered":"2023-11-18T20:41:34.467226+0000","last_unstale":"2023-11-18T20:41:36.480029+0000","last_undegraded":"2023-11-18T20:41:36.480029+0000","last_fullsized":"2023-11-18T20:41:36.480029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:07.510930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456443+0000","last_change":"2023-11-18T20:41:20.117940+0000","last_active":"2023-11-18T20:41:34.456443+0000","last_peered":"2023-11-18T20:41:34.456443+0000","last_clean":"2023-11-18T20:41:34.456443+0000","last_became_active":"2023-11-18T20:41:20.117297+0000","last_became_peered":"2023-11-18T20:41:20.117297+0000","last_unstale":"2023-11-18T20:41:34.456443+0000","last_undegraded":"2023-11-18T20:41:34.456443+0000","last_fullsized":"2023-11-18T20:41:34.456443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"75'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458507+0000","last_change":"2023-11-18T20:41:19.093632+0000","last_active":"2023-11-18T20:41:34.458507+0000","last_peered":"2023-11-18T20:41:34.458507+0000","last_clean":"2023-11-18T20:41:34.458507+0000","last_became_active":"2023-11-18T20:41:19.093359+0000","last_became_peered":"2023-11-18T20:41:19.093359+0000","last_unstale":"2023-11-18T20:41:34.458507+0000","last_undegraded":"2023-11-18T20:41:34.458507+0000","last_fullsized":"2023-11-18T20:41:34.458507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:17.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.477084+0000","last_change":"2023-11-18T20:41:35.471234+0000","last_active":"2023-11-18T20:41:35.477084+0000","last_peered":"2023-11-18T20:41:35.477084+0000","last_clean":"2023-11-18T20:41:35.477084+0000","last_became_active":"2023-11-18T20:41:35.470948+0000","last_became_peered":"2023-11-18T20:41:35.470948+0000","last_unstale":"2023-11-18T20:41:35.477084+0000","last_undegraded":"2023-11-18T20:41:35.477084+0000","last_fullsized":"2023-11-18T20:41:35.477084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:06.597982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"79'4","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.498550+0000","last_change":"2023-11-18T20:41:34.479995+0000","last_active":"2023-11-18T20:41:35.498550+0000","last_peered":"2023-11-18T20:41:35.498550+0000","last_clean":"2023-11-18T20:41:35.498550+0000","last_became_active":"2023-11-18T20:41:34.479750+0000","last_became_peered":"2023-11-18T20:41:34.479750+0000","last_unstale":"2023-11-18T20:41:35.498550+0000","last_undegraded":"2023-11-18T20:41:35.498550+0000","last_fullsized":"2023-11-18T20:41:35.498550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:36.536690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441755+0000","last_change":"2023-11-18T20:41:20.106958+0000","last_active":"2023-11-18T20:41:34.441755+0000","last_peered":"2023-11-18T20:41:34.441755+0000","last_clean":"2023-11-18T20:41:34.441755+0000","last_became_active":"2023-11-18T20:41:20.106528+0000","last_became_peered":"2023-11-18T20:41:20.106528+0000","last_unstale":"2023-11-18T20:41:34.441755+0000","last_undegraded":"2023-11-18T20:41:34.441755+0000","last_fullsized":"2023-11-18T20:41:34.441755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:05.564325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.454652+0000","last_change":"2023-11-18T20:41:19.081952+0000","last_active":"2023-11-18T20:41:35.454652+0000","last_peered":"2023-11-18T20:41:35.454652+0000","last_clean":"2023-11-18T20:41:35.454652+0000","last_became_active":"2023-11-18T20:41:19.081212+0000","last_became_peered":"2023-11-18T20:41:19.081212+0000","last_unstale":"2023-11-18T20:41:35.454652+0000","last_undegraded":"2023-11-18T20:41:35.454652+0000","last_fullsized":"2023-11-18T20:41:35.454652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:05.630660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488079+0000","last_change":"2023-11-18T20:41:35.484780+0000","last_active":"2023-11-18T20:41:35.488079+0000","last_peered":"2023-11-18T20:41:35.488079+0000","last_clean":"2023-11-18T20:41:35.488079+0000","last_became_active":"2023-11-18T20:41:35.484420+0000","last_became_peered":"2023-11-18T20:41:35.484420+0000","last_unstale":"2023-11-18T20:41:35.488079+0000","last_undegraded":"2023-11-18T20:41:35.488079+0000","last_fullsized":"2023-11-18T20:41:35.488079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:44.343724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478125+0000","last_change":"2023-11-18T20:41:34.474939+0000","last_active":"2023-11-18T20:41:36.478125+0000","last_peered":"2023-11-18T20:41:36.478125+0000","last_clean":"2023-11-18T20:41:36.478125+0000","last_became_active":"2023-11-18T20:41:34.474665+0000","last_became_peered":"2023-11-18T20:41:34.474665+0000","last_unstale":"2023-11-18T20:41:36.478125+0000","last_undegraded":"2023-11-18T20:41:36.478125+0000","last_fullsized":"2023-11-18T20:41:36.478125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:46.194568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.457635+0000","last_change":"2023-11-18T20:41:20.113390+0000","last_active":"2023-11-18T20:41:34.457635+0000","last_peered":"2023-11-18T20:41:34.457635+0000","last_clean":"2023-11-18T20:41:34.457635+0000","last_became_active":"2023-11-18T20:41:20.112062+0000","last_became_peered":"2023-11-18T20:41:20.112062+0000","last_unstale":"2023-11-18T20:41:34.457635+0000","last_undegraded":"2023-11-18T20:41:34.457635+0000","last_fullsized":"2023-11-18T20:41:34.457635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:23.768744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467432+0000","last_change":"2023-11-18T20:41:19.086892+0000","last_active":"2023-11-18T20:41:34.467432+0000","last_peered":"2023-11-18T20:41:34.467432+0000","last_clean":"2023-11-18T20:41:34.467432+0000","last_became_active":"2023-11-18T20:41:19.086603+0000","last_became_peered":"2023-11-18T20:41:19.086603+0000","last_unstale":"2023-11-18T20:41:34.467432+0000","last_undegraded":"2023-11-18T20:41:34.467432+0000","last_fullsized":"2023-11-18T20:41:34.467432+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:28.062703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.484787+0000","last_change":"2023-11-18T20:41:35.475475+0000","last_active":"2023-11-18T20:41:35.484787+0000","last_peered":"2023-11-18T20:41:35.484787+0000","last_clean":"2023-11-18T20:41:35.484787+0000","last_became_active":"2023-11-18T20:41:35.474704+0000","last_became_peered":"2023-11-18T20:41:35.474704+0000","last_unstale":"2023-11-18T20:41:35.484787+0000","last_undegraded":"2023-11-18T20:41:35.484787+0000","last_fullsized":"2023-11-18T20:41:35.484787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:34.886767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477163+0000","last_change":"2023-11-18T20:41:34.468744+0000","last_active":"2023-11-18T20:41:36.477163+0000","last_peered":"2023-11-18T20:41:36.477163+0000","last_clean":"2023-11-18T20:41:36.477163+0000","last_became_active":"2023-11-18T20:41:34.468184+0000","last_became_peered":"2023-11-18T20:41:34.468184+0000","last_unstale":"2023-11-18T20:41:36.477163+0000","last_undegraded":"2023-11-18T20:41:36.477163+0000","last_fullsized":"2023-11-18T20:41:36.477163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:15:37.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.465800+0000","last_change":"2023-11-18T20:41:20.108036+0000","last_active":"2023-11-18T20:41:34.465800+0000","last_peered":"2023-11-18T20:41:34.465800+0000","last_clean":"2023-11-18T20:41:34.465800+0000","last_became_active":"2023-11-18T20:41:20.107708+0000","last_became_peered":"2023-11-18T20:41:20.107708+0000","last_unstale":"2023-11-18T20:41:34.465800+0000","last_undegraded":"2023-11-18T20:41:34.465800+0000","last_fullsized":"2023-11-18T20:41:34.465800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:01.604211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"75'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442611+0000","last_change":"2023-11-18T20:41:19.076738+0000","last_active":"2023-11-18T20:41:34.442611+0000","last_peered":"2023-11-18T20:41:34.442611+0000","last_clean":"2023-11-18T20:41:34.442611+0000","last_became_active":"2023-11-18T20:41:19.076471+0000","last_became_peered":"2023-11-18T20:41:19.076471+0000","last_unstale":"2023-11-18T20:41:34.442611+0000","last_undegraded":"2023-11-18T20:41:34.442611+0000","last_fullsized":"2023-11-18T20:41:34.442611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:10.091348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.494442+0000","last_change":"2023-11-18T20:41:35.484427+0000","last_active":"2023-11-18T20:41:35.494442+0000","last_peered":"2023-11-18T20:41:35.494442+0000","last_clean":"2023-11-18T20:41:35.494442+0000","last_became_active":"2023-11-18T20:41:35.484175+0000","last_became_peered":"2023-11-18T20:41:35.484175+0000","last_unstale":"2023-11-18T20:41:35.494442+0000","last_undegraded":"2023-11-18T20:41:35.494442+0000","last_fullsized":"2023-11-18T20:41:35.494442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:19:23.523792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.453741+0000","last_change":"2023-11-18T20:41:34.474022+0000","last_active":"2023-11-18T20:41:35.453741+0000","last_peered":"2023-11-18T20:41:35.453741+0000","last_clean":"2023-11-18T20:41:35.453741+0000","last_became_active":"2023-11-18T20:41:34.472473+0000","last_became_peered":"2023-11-18T20:41:34.472473+0000","last_unstale":"2023-11-18T20:41:35.453741+0000","last_undegraded":"2023-11-18T20:41:35.453741+0000","last_fullsized":"2023-11-18T20:41:35.453741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:39.212320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456783+0000","last_change":"2023-11-18T20:41:20.109360+0000","last_active":"2023-11-18T20:41:34.456783+0000","last_peered":"2023-11-18T20:41:34.456783+0000","last_clean":"2023-11-18T20:41:34.456783+0000","last_became_active":"2023-11-18T20:41:20.108559+0000","last_became_peered":"2023-11-18T20:41:20.108559+0000","last_unstale":"2023-11-18T20:41:34.456783+0000","last_undegraded":"2023-11-18T20:41:34.456783+0000","last_fullsized":"2023-11-18T20:41:34.456783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:03.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"75'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455342+0000","last_change":"2023-11-18T20:41:19.089704+0000","last_active":"2023-11-18T20:41:34.455342+0000","last_peered":"2023-11-18T20:41:34.455342+0000","last_clean":"2023-11-18T20:41:34.455342+0000","last_became_active":"2023-11-18T20:41:19.089474+0000","last_became_peered":"2023-11-18T20:41:19.089474+0000","last_unstale":"2023-11-18T20:41:34.455342+0000","last_undegraded":"2023-11-18T20:41:34.455342+0000","last_fullsized":"2023-11-18T20:41:34.455342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:42.131164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.494702+0000","last_change":"2023-11-18T20:41:35.491328+0000","last_active":"2023-11-18T20:41:35.494702+0000","last_peered":"2023-11-18T20:41:35.494702+0000","last_clean":"2023-11-18T20:41:35.494702+0000","last_became_active":"2023-11-18T20:41:35.488557+0000","last_became_peered":"2023-11-18T20:41:35.488557+0000","last_unstale":"2023-11-18T20:41:35.494702+0000","last_undegraded":"2023-11-18T20:41:35.494702+0000","last_fullsized":"2023-11-18T20:41:35.494702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:33.945396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478051+0000","last_change":"2023-11-18T20:41:34.462822+0000","last_active":"2023-11-18T20:41:36.478051+0000","last_peered":"2023-11-18T20:41:36.478051+0000","last_clean":"2023-11-18T20:41:36.478051+0000","last_became_active":"2023-11-18T20:41:34.462510+0000","last_became_peered":"2023-11-18T20:41:34.462510+0000","last_unstale":"2023-11-18T20:41:36.478051+0000","last_undegraded":"2023-11-18T20:41:36.478051+0000","last_fullsized":"2023-11-18T20:41:36.478051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:35.677808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.454664+0000","last_change":"2023-11-18T20:41:20.114441+0000","last_active":"2023-11-18T20:41:34.454664+0000","last_peered":"2023-11-18T20:41:34.454664+0000","last_clean":"2023-11-18T20:41:34.454664+0000","last_became_active":"2023-11-18T20:41:20.113948+0000","last_became_peered":"2023-11-18T20:41:20.113948+0000","last_unstale":"2023-11-18T20:41:34.454664+0000","last_undegraded":"2023-11-18T20:41:34.454664+0000","last_fullsized":"2023-11-18T20:41:34.454664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:07:39.968375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474311+0000","last_change":"2023-11-18T20:41:19.088925+0000","last_active":"2023-11-18T20:41:34.474311+0000","last_peered":"2023-11-18T20:41:34.474311+0000","last_clean":"2023-11-18T20:41:34.474311+0000","last_became_active":"2023-11-18T20:41:19.088630+0000","last_became_peered":"2023-11-18T20:41:19.088630+0000","last_unstale":"2023-11-18T20:41:34.474311+0000","last_undegraded":"2023-11-18T20:41:34.474311+0000","last_fullsized":"2023-11-18T20:41:34.474311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:03:59.906289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478282+0000","last_change":"2023-11-18T20:41:35.495727+0000","last_active":"2023-11-18T20:41:36.478282+0000","last_peered":"2023-11-18T20:41:36.478282+0000","last_clean":"2023-11-18T20:41:36.478282+0000","last_became_active":"2023-11-18T20:41:35.495446+0000","last_became_peered":"2023-11-18T20:41:35.495446+0000","last_unstale":"2023-11-18T20:41:36.478282+0000","last_undegraded":"2023-11-18T20:41:36.478282+0000","last_fullsized":"2023-11-18T20:41:36.478282+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:01:10.966302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.482327+0000","last_change":"2023-11-18T20:41:34.471515+0000","last_active":"2023-11-18T20:41:36.482327+0000","last_peered":"2023-11-18T20:41:36.482327+0000","last_clean":"2023-11-18T20:41:36.482327+0000","last_became_active":"2023-11-18T20:41:34.471192+0000","last_became_peered":"2023-11-18T20:41:34.471192+0000","last_unstale":"2023-11-18T20:41:36.482327+0000","last_undegraded":"2023-11-18T20:41:36.482327+0000","last_fullsized":"2023-11-18T20:41:36.482327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:47:31.954044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.469347+0000","last_change":"2023-11-18T20:41:20.110933+0000","last_active":"2023-11-18T20:41:34.469347+0000","last_peered":"2023-11-18T20:41:34.469347+0000","last_clean":"2023-11-18T20:41:34.469347+0000","last_became_active":"2023-11-18T20:41:20.110639+0000","last_became_peered":"2023-11-18T20:41:20.110639+0000","last_unstale":"2023-11-18T20:41:34.469347+0000","last_undegraded":"2023-11-18T20:41:34.469347+0000","last_fullsized":"2023-11-18T20:41:34.469347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:36.140134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467776+0000","last_change":"2023-11-18T20:41:19.089119+0000","last_active":"2023-11-18T20:41:34.467776+0000","last_peered":"2023-11-18T20:41:34.467776+0000","last_clean":"2023-11-18T20:41:34.467776+0000","last_became_active":"2023-11-18T20:41:19.088734+0000","last_became_peered":"2023-11-18T20:41:19.088734+0000","last_unstale":"2023-11-18T20:41:34.467776+0000","last_undegraded":"2023-11-18T20:41:34.467776+0000","last_fullsized":"2023-11-18T20:41:34.467776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:53.467562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477607+0000","last_change":"2023-11-18T20:41:35.491018+0000","last_active":"2023-11-18T20:41:36.477607+0000","last_peered":"2023-11-18T20:41:36.477607+0000","last_clean":"2023-11-18T20:41:36.477607+0000","last_became_active":"2023-11-18T20:41:35.490542+0000","last_became_peered":"2023-11-18T20:41:35.490542+0000","last_unstale":"2023-11-18T20:41:36.477607+0000","last_undegraded":"2023-11-18T20:41:36.477607+0000","last_fullsized":"2023-11-18T20:41:36.477607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:14.536499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"79'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478109+0000","last_change":"2023-11-18T20:41:34.464435+0000","last_active":"2023-11-18T20:41:36.478109+0000","last_peered":"2023-11-18T20:41:36.478109+0000","last_clean":"2023-11-18T20:41:36.478109+0000","last_became_active":"2023-11-18T20:41:34.464178+0000","last_became_peered":"2023-11-18T20:41:34.464178+0000","last_unstale":"2023-11-18T20:41:36.478109+0000","last_undegraded":"2023-11-18T20:41:36.478109+0000","last_fullsized":"2023-11-18T20:41:36.478109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:40:09.250947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.475533+0000","last_change":"2023-11-18T20:41:20.109465+0000","last_active":"2023-11-18T20:41:34.475533+0000","last_peered":"2023-11-18T20:41:34.475533+0000","last_clean":"2023-11-18T20:41:34.475533+0000","last_became_active":"2023-11-18T20:41:20.109152+0000","last_became_peered":"2023-11-18T20:41:20.109152+0000","last_unstale":"2023-11-18T20:41:34.475533+0000","last_undegraded":"2023-11-18T20:41:34.475533+0000","last_fullsized":"2023-11-18T20:41:34.475533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:35.394592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456548+0000","last_change":"2023-11-18T20:41:19.082301+0000","last_active":"2023-11-18T20:41:34.456548+0000","last_peered":"2023-11-18T20:41:34.456548+0000","last_clean":"2023-11-18T20:41:34.456548+0000","last_became_active":"2023-11-18T20:41:19.082037+0000","last_became_peered":"2023-11-18T20:41:19.082037+0000","last_unstale":"2023-11-18T20:41:34.456548+0000","last_undegraded":"2023-11-18T20:41:34.456548+0000","last_fullsized":"2023-11-18T20:41:34.456548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:19.616073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485354+0000","last_change":"2023-11-18T20:41:35.478776+0000","last_active":"2023-11-18T20:41:35.485354+0000","last_peered":"2023-11-18T20:41:35.485354+0000","last_clean":"2023-11-18T20:41:35.485354+0000","last_became_active":"2023-11-18T20:41:35.477225+0000","last_became_peered":"2023-11-18T20:41:35.477225+0000","last_unstale":"2023-11-18T20:41:35.485354+0000","last_undegraded":"2023-11-18T20:41:35.485354+0000","last_fullsized":"2023-11-18T20:41:35.485354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:13.320680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"79'6","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.503368+0000","last_change":"2023-11-18T20:41:34.472192+0000","last_active":"2023-11-18T20:41:35.503368+0000","last_peered":"2023-11-18T20:41:35.503368+0000","last_clean":"2023-11-18T20:41:35.503368+0000","last_became_active":"2023-11-18T20:41:34.471867+0000","last_became_peered":"2023-11-18T20:41:34.471867+0000","last_unstale":"2023-11-18T20:41:35.503368+0000","last_undegraded":"2023-11-18T20:41:35.503368+0000","last_fullsized":"2023-11-18T20:41:35.503368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:16.475762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456524+0000","last_change":"2023-11-18T20:41:20.106833+0000","last_active":"2023-11-18T20:41:34.456524+0000","last_peered":"2023-11-18T20:41:34.456524+0000","last_clean":"2023-11-18T20:41:34.456524+0000","last_became_active":"2023-11-18T20:41:20.105983+0000","last_became_peered":"2023-11-18T20:41:20.105983+0000","last_unstale":"2023-11-18T20:41:34.456524+0000","last_undegraded":"2023-11-18T20:41:34.456524+0000","last_fullsized":"2023-11-18T20:41:34.456524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:19.506976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458592+0000","last_change":"2023-11-18T20:41:19.080666+0000","last_active":"2023-11-18T20:41:34.458592+0000","last_peered":"2023-11-18T20:41:34.458592+0000","last_clean":"2023-11-18T20:41:34.458592+0000","last_became_active":"2023-11-18T20:41:19.080383+0000","last_became_peered":"2023-11-18T20:41:19.080383+0000","last_unstale":"2023-11-18T20:41:34.458592+0000","last_undegraded":"2023-11-18T20:41:34.458592+0000","last_fullsized":"2023-11-18T20:41:34.458592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:43.180235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481338+0000","last_change":"2023-11-18T20:41:35.473994+0000","last_active":"2023-11-18T20:41:36.481338+0000","last_peered":"2023-11-18T20:41:36.481338+0000","last_clean":"2023-11-18T20:41:36.481338+0000","last_became_active":"2023-11-18T20:41:35.473710+0000","last_became_peered":"2023-11-18T20:41:35.473710+0000","last_unstale":"2023-11-18T20:41:36.481338+0000","last_undegraded":"2023-11-18T20:41:36.481338+0000","last_fullsized":"2023-11-18T20:41:36.481338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:18:08.947504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481578+0000","last_change":"2023-11-18T20:41:34.468184+0000","last_active":"2023-11-18T20:41:36.481578+0000","last_peered":"2023-11-18T20:41:36.481578+0000","last_clean":"2023-11-18T20:41:36.481578+0000","last_became_active":"2023-11-18T20:41:34.466639+0000","last_became_peered":"2023-11-18T20:41:34.466639+0000","last_unstale":"2023-11-18T20:41:36.481578+0000","last_undegraded":"2023-11-18T20:41:36.481578+0000","last_fullsized":"2023-11-18T20:41:36.481578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:41.307120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449466+0000","last_change":"2023-11-18T20:41:20.108858+0000","last_active":"2023-11-18T20:41:35.449466+0000","last_peered":"2023-11-18T20:41:35.449466+0000","last_clean":"2023-11-18T20:41:35.449466+0000","last_became_active":"2023-11-18T20:41:20.108539+0000","last_became_peered":"2023-11-18T20:41:20.108539+0000","last_unstale":"2023-11-18T20:41:35.449466+0000","last_undegraded":"2023-11-18T20:41:35.449466+0000","last_fullsized":"2023-11-18T20:41:35.449466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:40:48.087061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"75'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.457747+0000","last_change":"2023-11-18T20:41:19.084632+0000","last_active":"2023-11-18T20:41:34.457747+0000","last_peered":"2023-11-18T20:41:34.457747+0000","last_clean":"2023-11-18T20:41:34.457747+0000","last_became_active":"2023-11-18T20:41:19.084201+0000","last_became_peered":"2023-11-18T20:41:19.084201+0000","last_unstale":"2023-11-18T20:41:34.457747+0000","last_undegraded":"2023-11-18T20:41:34.457747+0000","last_fullsized":"2023-11-18T20:41:34.457747+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:35.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485295+0000","last_change":"2023-11-18T20:41:35.477429+0000","last_active":"2023-11-18T20:41:35.485295+0000","last_peered":"2023-11-18T20:41:35.485295+0000","last_clean":"2023-11-18T20:41:35.485295+0000","last_became_active":"2023-11-18T20:41:35.477090+0000","last_became_peered":"2023-11-18T20:41:35.477090+0000","last_unstale":"2023-11-18T20:41:35.485295+0000","last_undegraded":"2023-11-18T20:41:35.485295+0000","last_fullsized":"2023-11-18T20:41:35.485295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:21.267998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481595+0000","last_change":"2023-11-18T20:41:34.473697+0000","last_active":"2023-11-18T20:41:36.481595+0000","last_peered":"2023-11-18T20:41:36.481595+0000","last_clean":"2023-11-18T20:41:36.481595+0000","last_became_active":"2023-11-18T20:41:34.473363+0000","last_became_peered":"2023-11-18T20:41:34.473363+0000","last_unstale":"2023-11-18T20:41:36.481595+0000","last_undegraded":"2023-11-18T20:41:36.481595+0000","last_fullsized":"2023-11-18T20:41:36.481595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:43:23.213306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.478614+0000","last_change":"2023-11-18T20:41:20.109082+0000","last_active":"2023-11-18T20:41:35.478614+0000","last_peered":"2023-11-18T20:41:35.478614+0000","last_clean":"2023-11-18T20:41:35.478614+0000","last_became_active":"2023-11-18T20:41:20.108734+0000","last_became_peered":"2023-11-18T20:41:20.108734+0000","last_unstale":"2023-11-18T20:41:35.478614+0000","last_undegraded":"2023-11-18T20:41:35.478614+0000","last_fullsized":"2023-11-18T20:41:35.478614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:26:46.701720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"76'9","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441853+0000","last_change":"2023-11-18T20:41:19.080895+0000","last_active":"2023-11-18T20:41:34.441853+0000","last_peered":"2023-11-18T20:41:34.441853+0000","last_clean":"2023-11-18T20:41:34.441853+0000","last_became_active":"2023-11-18T20:41:19.080271+0000","last_became_peered":"2023-11-18T20:41:19.080271+0000","last_unstale":"2023-11-18T20:41:34.441853+0000","last_undegraded":"2023-11-18T20:41:34.441853+0000","last_fullsized":"2023-11-18T20:41:34.441853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:21.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.476897+0000","last_change":"2023-11-18T20:41:35.488644+0000","last_active":"2023-11-18T20:41:36.476897+0000","last_peered":"2023-11-18T20:41:36.476897+0000","last_clean":"2023-11-18T20:41:36.476897+0000","last_became_active":"2023-11-18T20:41:35.483590+0000","last_became_peered":"2023-11-18T20:41:35.483590+0000","last_unstale":"2023-11-18T20:41:36.476897+0000","last_undegraded":"2023-11-18T20:41:36.476897+0000","last_fullsized":"2023-11-18T20:41:36.476897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:53:11.042880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.447810+0000","last_change":"2023-11-18T20:41:34.460680+0000","last_active":"2023-11-18T20:41:35.447810+0000","last_peered":"2023-11-18T20:41:35.447810+0000","last_clean":"2023-11-18T20:41:35.447810+0000","last_became_active":"2023-11-18T20:41:34.459176+0000","last_became_peered":"2023-11-18T20:41:34.459176+0000","last_unstale":"2023-11-18T20:41:35.447810+0000","last_undegraded":"2023-11-18T20:41:35.447810+0000","last_fullsized":"2023-11-18T20:41:35.447810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:12.852751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.451372+0000","last_change":"2023-11-18T20:41:20.097893+0000","last_active":"2023-11-18T20:41:35.451372+0000","last_peered":"2023-11-18T20:41:35.451372+0000","last_clean":"2023-11-18T20:41:35.451372+0000","last_became_active":"2023-11-18T20:41:20.097607+0000","last_became_peered":"2023-11-18T20:41:20.097607+0000","last_unstale":"2023-11-18T20:41:35.451372+0000","last_undegraded":"2023-11-18T20:41:35.451372+0000","last_fullsized":"2023-11-18T20:41:35.451372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:38:34.750195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.465330+0000","last_change":"2023-11-18T20:41:19.087665+0000","last_active":"2023-11-18T20:41:34.465330+0000","last_peered":"2023-11-18T20:41:34.465330+0000","last_clean":"2023-11-18T20:41:34.465330+0000","last_became_active":"2023-11-18T20:41:19.087088+0000","last_became_peered":"2023-11-18T20:41:19.087088+0000","last_unstale":"2023-11-18T20:41:34.465330+0000","last_undegraded":"2023-11-18T20:41:34.465330+0000","last_fullsized":"2023-11-18T20:41:34.465330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:22.770805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479704+0000","last_change":"2023-11-18T20:41:35.481260+0000","last_active":"2023-11-18T20:41:36.479704+0000","last_peered":"2023-11-18T20:41:36.479704+0000","last_clean":"2023-11-18T20:41:36.479704+0000","last_became_active":"2023-11-18T20:41:35.479816+0000","last_became_peered":"2023-11-18T20:41:35.479816+0000","last_unstale":"2023-11-18T20:41:36.479704+0000","last_undegraded":"2023-11-18T20:41:36.479704+0000","last_fullsized":"2023-11-18T20:41:36.479704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:25:11.348254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"79'8","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479124+0000","last_change":"2023-11-18T20:41:34.464590+0000","last_active":"2023-11-18T20:41:36.479124+0000","last_peered":"2023-11-18T20:41:36.479124+0000","last_clean":"2023-11-18T20:41:36.479124+0000","last_became_active":"2023-11-18T20:41:34.464339+0000","last_became_peered":"2023-11-18T20:41:34.464339+0000","last_unstale":"2023-11-18T20:41:36.479124+0000","last_undegraded":"2023-11-18T20:41:36.479124+0000","last_fullsized":"2023-11-18T20:41:36.479124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:49.407916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456617+0000","last_change":"2023-11-18T20:41:20.114816+0000","last_active":"2023-11-18T20:41:34.456617+0000","last_peered":"2023-11-18T20:41:34.456617+0000","last_clean":"2023-11-18T20:41:34.456617+0000","last_became_active":"2023-11-18T20:41:20.114497+0000","last_became_peered":"2023-11-18T20:41:20.114497+0000","last_unstale":"2023-11-18T20:41:34.456617+0000","last_undegraded":"2023-11-18T20:41:34.456617+0000","last_fullsized":"2023-11-18T20:41:34.456617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:01.963195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467693+0000","last_change":"2023-11-18T20:41:19.087895+0000","last_active":"2023-11-18T20:41:35.467693+0000","last_peered":"2023-11-18T20:41:35.467693+0000","last_clean":"2023-11-18T20:41:35.467693+0000","last_became_active":"2023-11-18T20:41:19.086348+0000","last_became_peered":"2023-11-18T20:41:19.086348+0000","last_unstale":"2023-11-18T20:41:35.467693+0000","last_undegraded":"2023-11-18T20:41:35.467693+0000","last_fullsized":"2023-11-18T20:41:35.467693+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:34.389068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478760+0000","last_change":"2023-11-18T20:41:35.483090+0000","last_active":"2023-11-18T20:41:36.478760+0000","last_peered":"2023-11-18T20:41:36.478760+0000","last_clean":"2023-11-18T20:41:36.478760+0000","last_became_active":"2023-11-18T20:41:35.482802+0000","last_became_peered":"2023-11-18T20:41:35.482802+0000","last_unstale":"2023-11-18T20:41:36.478760+0000","last_undegraded":"2023-11-18T20:41:36.478760+0000","last_fullsized":"2023-11-18T20:41:36.478760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:52:21.509816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"79'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.501623+0000","last_change":"2023-11-18T20:41:34.467505+0000","last_active":"2023-11-18T20:41:35.501623+0000","last_peered":"2023-11-18T20:41:35.501623+0000","last_clean":"2023-11-18T20:41:35.501623+0000","last_became_active":"2023-11-18T20:41:34.467243+0000","last_became_peered":"2023-11-18T20:41:34.467243+0000","last_unstale":"2023-11-18T20:41:35.501623+0000","last_undegraded":"2023-11-18T20:41:35.501623+0000","last_fullsized":"2023-11-18T20:41:35.501623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:13.305993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467708+0000","last_change":"2023-11-18T20:41:20.107939+0000","last_active":"2023-11-18T20:41:34.467708+0000","last_peered":"2023-11-18T20:41:34.467708+0000","last_clean":"2023-11-18T20:41:34.467708+0000","last_became_active":"2023-11-18T20:41:20.107496+0000","last_became_peered":"2023-11-18T20:41:20.107496+0000","last_unstale":"2023-11-18T20:41:34.467708+0000","last_undegraded":"2023-11-18T20:41:34.467708+0000","last_fullsized":"2023-11-18T20:41:34.467708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:21:15.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455202+0000","last_change":"2023-11-18T20:41:19.074899+0000","last_active":"2023-11-18T20:41:34.455202+0000","last_peered":"2023-11-18T20:41:34.455202+0000","last_clean":"2023-11-18T20:41:34.455202+0000","last_became_active":"2023-11-18T20:41:19.074605+0000","last_became_peered":"2023-11-18T20:41:19.074605+0000","last_unstale":"2023-11-18T20:41:34.455202+0000","last_undegraded":"2023-11-18T20:41:34.455202+0000","last_fullsized":"2023-11-18T20:41:34.455202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:27.958410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.480030+0000","last_change":"2023-11-18T20:41:35.480991+0000","last_active":"2023-11-18T20:41:36.480030+0000","last_peered":"2023-11-18T20:41:36.480030+0000","last_clean":"2023-11-18T20:41:36.480030+0000","last_became_active":"2023-11-18T20:41:35.480569+0000","last_became_peered":"2023-11-18T20:41:35.480569+0000","last_unstale":"2023-11-18T20:41:36.480030+0000","last_undegraded":"2023-11-18T20:41:36.480030+0000","last_fullsized":"2023-11-18T20:41:36.480030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:34.776296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479110+0000","last_change":"2023-11-18T20:41:34.470626+0000","last_active":"2023-11-18T20:41:36.479110+0000","last_peered":"2023-11-18T20:41:36.479110+0000","last_clean":"2023-11-18T20:41:36.479110+0000","last_became_active":"2023-11-18T20:41:34.470352+0000","last_became_peered":"2023-11-18T20:41:34.470352+0000","last_unstale":"2023-11-18T20:41:36.479110+0000","last_undegraded":"2023-11-18T20:41:36.479110+0000","last_fullsized":"2023-11-18T20:41:36.479110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:33:19.179192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449662+0000","last_change":"2023-11-18T20:41:20.095956+0000","last_active":"2023-11-18T20:41:35.449662+0000","last_peered":"2023-11-18T20:41:35.449662+0000","last_clean":"2023-11-18T20:41:35.449662+0000","last_became_active":"2023-11-18T20:41:20.095673+0000","last_became_peered":"2023-11-18T20:41:20.095673+0000","last_unstale":"2023-11-18T20:41:35.449662+0000","last_undegraded":"2023-11-18T20:41:35.449662+0000","last_fullsized":"2023-11-18T20:41:35.449662+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:37:23.617511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"75'8","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.455499+0000","last_change":"2023-11-18T20:41:19.078210+0000","last_active":"2023-11-18T20:41:35.455499+0000","last_peered":"2023-11-18T20:41:35.455499+0000","last_clean":"2023-11-18T20:41:35.455499+0000","last_became_active":"2023-11-18T20:41:19.077797+0000","last_became_peered":"2023-11-18T20:41:19.077797+0000","last_unstale":"2023-11-18T20:41:35.455499+0000","last_undegraded":"2023-11-18T20:41:35.455499+0000","last_fullsized":"2023-11-18T20:41:35.455499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:05:12.665710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485366+0000","last_change":"2023-11-18T20:41:35.477446+0000","last_active":"2023-11-18T20:41:35.485366+0000","last_peered":"2023-11-18T20:41:35.485366+0000","last_clean":"2023-11-18T20:41:35.485366+0000","last_became_active":"2023-11-18T20:41:35.477117+0000","last_became_peered":"2023-11-18T20:41:35.477117+0000","last_unstale":"2023-11-18T20:41:35.485366+0000","last_undegraded":"2023-11-18T20:41:35.485366+0000","last_fullsized":"2023-11-18T20:41:35.485366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:25:11.348254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477925+0000","last_change":"2023-11-18T20:41:34.466608+0000","last_active":"2023-11-18T20:41:36.477925+0000","last_peered":"2023-11-18T20:41:36.477925+0000","last_clean":"2023-11-18T20:41:36.477925+0000","last_became_active":"2023-11-18T20:41:34.466307+0000","last_became_peered":"2023-11-18T20:41:34.466307+0000","last_unstale":"2023-11-18T20:41:36.477925+0000","last_undegraded":"2023-11-18T20:41:36.477925+0000","last_fullsized":"2023-11-18T20:41:36.477925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:42.370642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442036+0000","last_change":"2023-11-18T20:41:20.112739+0000","last_active":"2023-11-18T20:41:34.442036+0000","last_peered":"2023-11-18T20:41:34.442036+0000","last_clean":"2023-11-18T20:41:34.442036+0000","last_became_active":"2023-11-18T20:41:20.112440+0000","last_became_peered":"2023-11-18T20:41:20.112440+0000","last_unstale":"2023-11-18T20:41:34.442036+0000","last_undegraded":"2023-11-18T20:41:34.442036+0000","last_fullsized":"2023-11-18T20:41:34.442036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:02.110658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.479125+0000","last_change":"2023-11-18T20:41:19.068646+0000","last_active":"2023-11-18T20:41:35.479125+0000","last_peered":"2023-11-18T20:41:35.479125+0000","last_clean":"2023-11-18T20:41:35.479125+0000","last_became_active":"2023-11-18T20:41:19.068382+0000","last_became_peered":"2023-11-18T20:41:19.068382+0000","last_unstale":"2023-11-18T20:41:35.479125+0000","last_undegraded":"2023-11-18T20:41:35.479125+0000","last_fullsized":"2023-11-18T20:41:35.479125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:39.661723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.494759+0000","last_change":"2023-11-18T20:41:35.486441+0000","last_active":"2023-11-18T20:41:35.494759+0000","last_peered":"2023-11-18T20:41:35.494759+0000","last_clean":"2023-11-18T20:41:35.494759+0000","last_became_active":"2023-11-18T20:41:35.486105+0000","last_became_peered":"2023-11-18T20:41:35.486105+0000","last_unstale":"2023-11-18T20:41:35.494759+0000","last_undegraded":"2023-11-18T20:41:35.494759+0000","last_fullsized":"2023-11-18T20:41:35.494759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:09:35.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449918+0000","last_change":"2023-11-18T20:41:34.470265+0000","last_active":"2023-11-18T20:41:35.449918+0000","last_peered":"2023-11-18T20:41:35.449918+0000","last_clean":"2023-11-18T20:41:35.449918+0000","last_became_active":"2023-11-18T20:41:34.467676+0000","last_became_peered":"2023-11-18T20:41:34.467676+0000","last_unstale":"2023-11-18T20:41:35.449918+0000","last_undegraded":"2023-11-18T20:41:35.449918+0000","last_fullsized":"2023-11-18T20:41:35.449918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:27:46.841832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.460867+0000","last_change":"2023-11-18T20:41:20.111835+0000","last_active":"2023-11-18T20:41:34.460867+0000","last_peered":"2023-11-18T20:41:34.460867+0000","last_clean":"2023-11-18T20:41:34.460867+0000","last_became_active":"2023-11-18T20:41:20.111061+0000","last_became_peered":"2023-11-18T20:41:20.111061+0000","last_unstale":"2023-11-18T20:41:34.460867+0000","last_undegraded":"2023-11-18T20:41:34.460867+0000","last_fullsized":"2023-11-18T20:41:34.460867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:26.942016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.475604+0000","last_change":"2023-11-18T20:41:19.092466+0000","last_active":"2023-11-18T20:41:34.475604+0000","last_peered":"2023-11-18T20:41:34.475604+0000","last_clean":"2023-11-18T20:41:34.475604+0000","last_became_active":"2023-11-18T20:41:19.092213+0000","last_became_peered":"2023-11-18T20:41:19.092213+0000","last_unstale":"2023-11-18T20:41:34.475604+0000","last_undegraded":"2023-11-18T20:41:34.475604+0000","last_fullsized":"2023-11-18T20:41:34.475604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:52.157671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488793+0000","last_change":"2023-11-18T20:41:35.480440+0000","last_active":"2023-11-18T20:41:35.488793+0000","last_peered":"2023-11-18T20:41:35.488793+0000","last_clean":"2023-11-18T20:41:35.488793+0000","last_became_active":"2023-11-18T20:41:35.480115+0000","last_became_peered":"2023-11-18T20:41:35.480115+0000","last_unstale":"2023-11-18T20:41:35.488793+0000","last_undegraded":"2023-11-18T20:41:35.488793+0000","last_fullsized":"2023-11-18T20:41:35.488793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:16.134469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"79'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.500333+0000","last_change":"2023-11-18T20:41:34.467838+0000","last_active":"2023-11-18T20:41:35.500333+0000","last_peered":"2023-11-18T20:41:35.500333+0000","last_clean":"2023-11-18T20:41:35.500333+0000","last_became_active":"2023-11-18T20:41:34.467528+0000","last_became_peered":"2023-11-18T20:41:34.467528+0000","last_unstale":"2023-11-18T20:41:35.500333+0000","last_undegraded":"2023-11-18T20:41:35.500333+0000","last_fullsized":"2023-11-18T20:41:35.500333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:21.045488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442643+0000","last_change":"2023-11-18T20:41:20.113889+0000","last_active":"2023-11-18T20:41:34.442643+0000","last_peered":"2023-11-18T20:41:34.442643+0000","last_clean":"2023-11-18T20:41:34.442643+0000","last_became_active":"2023-11-18T20:41:20.113461+0000","last_became_peered":"2023-11-18T20:41:20.113461+0000","last_unstale":"2023-11-18T20:41:34.442643+0000","last_undegraded":"2023-11-18T20:41:34.442643+0000","last_fullsized":"2023-11-18T20:41:34.442643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:58.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474661+0000","last_change":"2023-11-18T20:41:19.092541+0000","last_active":"2023-11-18T20:41:34.474661+0000","last_peered":"2023-11-18T20:41:34.474661+0000","last_clean":"2023-11-18T20:41:34.474661+0000","last_became_active":"2023-11-18T20:41:19.092232+0000","last_became_peered":"2023-11-18T20:41:19.092232+0000","last_unstale":"2023-11-18T20:41:34.474661+0000","last_undegraded":"2023-11-18T20:41:34.474661+0000","last_fullsized":"2023-11-18T20:41:34.474661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:06.269774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478179+0000","last_change":"2023-11-18T20:41:35.484101+0000","last_active":"2023-11-18T20:41:36.478179+0000","last_peered":"2023-11-18T20:41:36.478179+0000","last_clean":"2023-11-18T20:41:36.478179+0000","last_became_active":"2023-11-18T20:41:35.483181+0000","last_became_peered":"2023-11-18T20:41:35.483181+0000","last_unstale":"2023-11-18T20:41:36.478179+0000","last_undegraded":"2023-11-18T20:41:36.478179+0000","last_fullsized":"2023-11-18T20:41:36.478179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:43:43.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.458045+0000","last_change":"2023-11-18T20:41:34.469655+0000","last_active":"2023-11-18T20:41:35.458045+0000","last_peered":"2023-11-18T20:41:35.458045+0000","last_clean":"2023-11-18T20:41:35.458045+0000","last_became_active":"2023-11-18T20:41:34.468967+0000","last_became_peered":"2023-11-18T20:41:34.468967+0000","last_unstale":"2023-11-18T20:41:35.458045+0000","last_undegraded":"2023-11-18T20:41:35.458045+0000","last_fullsized":"2023-11-18T20:41:35.458045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:15.969315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467593+0000","last_change":"2023-11-18T20:41:20.098020+0000","last_active":"2023-11-18T20:41:35.467593+0000","last_peered":"2023-11-18T20:41:35.467593+0000","last_clean":"2023-11-18T20:41:35.467593+0000","last_became_active":"2023-11-18T20:41:20.097510+0000","last_became_peered":"2023-11-18T20:41:20.097510+0000","last_unstale":"2023-11-18T20:41:35.467593+0000","last_undegraded":"2023-11-18T20:41:35.467593+0000","last_fullsized":"2023-11-18T20:41:35.467593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:47.673490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474079+0000","last_change":"2023-11-18T20:41:19.096453+0000","last_active":"2023-11-18T20:41:34.474079+0000","last_peered":"2023-11-18T20:41:34.474079+0000","last_clean":"2023-11-18T20:41:34.474079+0000","last_became_active":"2023-11-18T20:41:19.096109+0000","last_became_peered":"2023-11-18T20:41:19.096109+0000","last_unstale":"2023-11-18T20:41:34.474079+0000","last_undegraded":"2023-11-18T20:41:34.474079+0000","last_fullsized":"2023-11-18T20:41:34.474079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:08.511122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485645+0000","last_change":"2023-11-18T20:41:35.478602+0000","last_active":"2023-11-18T20:41:35.485645+0000","last_peered":"2023-11-18T20:41:35.485645+0000","last_clean":"2023-11-18T20:41:35.485645+0000","last_became_active":"2023-11-18T20:41:35.477503+0000","last_became_peered":"2023-11-18T20:41:35.477503+0000","last_unstale":"2023-11-18T20:41:35.485645+0000","last_undegraded":"2023-11-18T20:41:35.485645+0000","last_fullsized":"2023-11-18T20:41:35.485645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:27:47.856519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.476953+0000","last_change":"2023-11-18T20:41:34.469314+0000","last_active":"2023-11-18T20:41:36.476953+0000","last_peered":"2023-11-18T20:41:36.476953+0000","last_clean":"2023-11-18T20:41:36.476953+0000","last_became_active":"2023-11-18T20:41:34.468435+0000","last_became_peered":"2023-11-18T20:41:34.468435+0000","last_unstale":"2023-11-18T20:41:36.476953+0000","last_undegraded":"2023-11-18T20:41:36.476953+0000","last_fullsized":"2023-11-18T20:41:36.476953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:18.053169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.474129+0000","last_change":"2023-11-18T20:41:20.104587+0000","last_active":"2023-11-18T20:41:35.474129+0000","last_peered":"2023-11-18T20:41:35.474129+0000","last_clean":"2023-11-18T20:41:35.474129+0000","last_became_active":"2023-11-18T20:41:20.103758+0000","last_became_peered":"2023-11-18T20:41:20.103758+0000","last_unstale":"2023-11-18T20:41:35.474129+0000","last_undegraded":"2023-11-18T20:41:35.474129+0000","last_fullsized":"2023-11-18T20:41:35.474129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:55.966402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467767+0000","last_change":"2023-11-18T20:41:19.090852+0000","last_active":"2023-11-18T20:41:35.467767+0000","last_peered":"2023-11-18T20:41:35.467767+0000","last_clean":"2023-11-18T20:41:35.467767+0000","last_became_active":"2023-11-18T20:41:19.090491+0000","last_became_peered":"2023-11-18T20:41:19.090491+0000","last_unstale":"2023-11-18T20:41:35.467767+0000","last_undegraded":"2023-11-18T20:41:35.467767+0000","last_fullsized":"2023-11-18T20:41:35.467767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:15.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488681+0000","last_change":"2023-11-18T20:41:35.480926+0000","last_active":"2023-11-18T20:41:35.488681+0000","last_peered":"2023-11-18T20:41:35.488681+0000","last_clean":"2023-11-18T20:41:35.488681+0000","last_became_active":"2023-11-18T20:41:35.477908+0000","last_became_peered":"2023-11-18T20:41:35.477908+0000","last_unstale":"2023-11-18T20:41:35.488681+0000","last_undegraded":"2023-11-18T20:41:35.488681+0000","last_fullsized":"2023-11-18T20:41:35.488681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:52:09.335068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478128+0000","last_change":"2023-11-18T20:41:34.469728+0000","last_active":"2023-11-18T20:41:36.478128+0000","last_peered":"2023-11-18T20:41:36.478128+0000","last_clean":"2023-11-18T20:41:36.478128+0000","last_became_active":"2023-11-18T20:41:34.469394+0000","last_became_peered":"2023-11-18T20:41:34.469394+0000","last_unstale":"2023-11-18T20:41:36.478128+0000","last_undegraded":"2023-11-18T20:41:36.478128+0000","last_fullsized":"2023-11-18T20:41:36.478128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:20.365003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.463836+0000","last_change":"2023-11-18T20:41:20.116318+0000","last_active":"2023-11-18T20:41:34.463836+0000","last_peered":"2023-11-18T20:41:34.463836+0000","last_clean":"2023-11-18T20:41:34.463836+0000","last_became_active":"2023-11-18T20:41:20.115292+0000","last_became_peered":"2023-11-18T20:41:20.115292+0000","last_unstale":"2023-11-18T20:41:34.463836+0000","last_undegraded":"2023-11-18T20:41:34.463836+0000","last_fullsized":"2023-11-18T20:41:34.463836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:20.038509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449900+0000","last_change":"2023-11-18T20:41:19.078588+0000","last_active":"2023-11-18T20:41:35.449900+0000","last_peered":"2023-11-18T20:41:35.449900+0000","last_clean":"2023-11-18T20:41:35.449900+0000","last_became_active":"2023-11-18T20:41:19.078208+0000","last_became_peered":"2023-11-18T20:41:19.078208+0000","last_unstale":"2023-11-18T20:41:35.449900+0000","last_undegraded":"2023-11-18T20:41:35.449900+0000","last_fullsized":"2023-11-18T20:41:35.449900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:40:21.584581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488630+0000","last_change":"2023-11-18T20:41:35.480507+0000","last_active":"2023-11-18T20:41:35.488630+0000","last_peered":"2023-11-18T20:41:35.488630+0000","last_clean":"2023-11-18T20:41:35.488630+0000","last_became_active":"2023-11-18T20:41:35.480204+0000","last_became_peered":"2023-11-18T20:41:35.480204+0000","last_unstale":"2023-11-18T20:41:35.488630+0000","last_undegraded":"2023-11-18T20:41:35.488630+0000","last_fullsized":"2023-11-18T20:41:35.488630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:32:47.240987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.471965+0000","last_change":"2023-11-18T20:41:34.470394+0000","last_active":"2023-11-18T20:41:35.471965+0000","last_peered":"2023-11-18T20:41:35.471965+0000","last_clean":"2023-11-18T20:41:35.471965+0000","last_became_active":"2023-11-18T20:41:34.470063+0000","last_became_peered":"2023-11-18T20:41:34.470063+0000","last_unstale":"2023-11-18T20:41:35.471965+0000","last_undegraded":"2023-11-18T20:41:35.471965+0000","last_fullsized":"2023-11-18T20:41:35.471965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:40.441706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441572+0000","last_change":"2023-11-18T20:41:20.109542+0000","last_active":"2023-11-18T20:41:34.441572+0000","last_peered":"2023-11-18T20:41:34.441572+0000","last_clean":"2023-11-18T20:41:34.441572+0000","last_became_active":"2023-11-18T20:41:20.109219+0000","last_became_peered":"2023-11-18T20:41:20.109219+0000","last_unstale":"2023-11-18T20:41:34.441572+0000","last_undegraded":"2023-11-18T20:41:34.441572+0000","last_fullsized":"2023-11-18T20:41:34.441572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:44.185759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467907+0000","last_change":"2023-11-18T20:41:19.091570+0000","last_active":"2023-11-18T20:41:34.467907+0000","last_peered":"2023-11-18T20:41:34.467907+0000","last_clean":"2023-11-18T20:41:34.467907+0000","last_became_active":"2023-11-18T20:41:19.091260+0000","last_became_peered":"2023-11-18T20:41:19.091260+0000","last_unstale":"2023-11-18T20:41:34.467907+0000","last_undegraded":"2023-11-18T20:41:34.467907+0000","last_fullsized":"2023-11-18T20:41:34.467907+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:49.580341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479543+0000","last_change":"2023-11-18T20:41:35.478643+0000","last_active":"2023-11-18T20:41:36.479543+0000","last_peered":"2023-11-18T20:41:36.479543+0000","last_clean":"2023-11-18T20:41:36.479543+0000","last_became_active":"2023-11-18T20:41:35.478334+0000","last_became_peered":"2023-11-18T20:41:35.478334+0000","last_unstale":"2023-11-18T20:41:36.479543+0000","last_undegraded":"2023-11-18T20:41:36.479543+0000","last_fullsized":"2023-11-18T20:41:36.479543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:15.720731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.457584+0000","last_change":"2023-11-18T20:41:34.468640+0000","last_active":"2023-11-18T20:41:35.457584+0000","last_peered":"2023-11-18T20:41:35.457584+0000","last_clean":"2023-11-18T20:41:35.457584+0000","last_became_active":"2023-11-18T20:41:34.468180+0000","last_became_peered":"2023-11-18T20:41:34.468180+0000","last_unstale":"2023-11-18T20:41:35.457584+0000","last_undegraded":"2023-11-18T20:41:35.457584+0000","last_fullsized":"2023-11-18T20:41:35.457584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:28:06.465118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.472987+0000","last_change":"2023-11-18T20:41:20.108499+0000","last_active":"2023-11-18T20:41:35.472987+0000","last_peered":"2023-11-18T20:41:35.472987+0000","last_clean":"2023-11-18T20:41:35.472987+0000","last_became_active":"2023-11-18T20:41:20.108213+0000","last_became_peered":"2023-11-18T20:41:20.108213+0000","last_unstale":"2023-11-18T20:41:35.472987+0000","last_undegraded":"2023-11-18T20:41:35.472987+0000","last_fullsized":"2023-11-18T20:41:35.472987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:47:05.642911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.475859+0000","last_change":"2023-11-18T20:41:19.091596+0000","last_active":"2023-11-18T20:41:34.475859+0000","last_peered":"2023-11-18T20:41:34.475859+0000","last_clean":"2023-11-18T20:41:34.475859+0000","last_became_active":"2023-11-18T20:41:19.091224+0000","last_became_peered":"2023-11-18T20:41:19.091224+0000","last_unstale":"2023-11-18T20:41:34.475859+0000","last_undegraded":"2023-11-18T20:41:34.475859+0000","last_fullsized":"2023-11-18T20:41:34.475859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:20:53.778898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477817+0000","last_change":"2023-11-18T20:41:35.483254+0000","last_active":"2023-11-18T20:41:36.477817+0000","last_peered":"2023-11-18T20:41:36.477817+0000","last_clean":"2023-11-18T20:41:36.477817+0000","last_became_active":"2023-11-18T20:41:35.482924+0000","last_became_peered":"2023-11-18T20:41:35.482924+0000","last_unstale":"2023-11-18T20:41:36.477817+0000","last_undegraded":"2023-11-18T20:41:36.477817+0000","last_fullsized":"2023-11-18T20:41:36.477817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:05.475338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.469059+0000","last_change":"2023-11-18T20:41:34.461166+0000","last_active":"2023-11-18T20:41:35.469059+0000","last_peered":"2023-11-18T20:41:35.469059+0000","last_clean":"2023-11-18T20:41:35.469059+0000","last_became_active":"2023-11-18T20:41:34.459748+0000","last_became_peered":"2023-11-18T20:41:34.459748+0000","last_unstale":"2023-11-18T20:41:35.469059+0000","last_undegraded":"2023-11-18T20:41:35.469059+0000","last_fullsized":"2023-11-18T20:41:35.469059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:39.212320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.474264+0000","last_change":"2023-11-18T20:41:20.108830+0000","last_active":"2023-11-18T20:41:35.474264+0000","last_peered":"2023-11-18T20:41:35.474264+0000","last_clean":"2023-11-18T20:41:35.474264+0000","last_became_active":"2023-11-18T20:41:20.108492+0000","last_became_peered":"2023-11-18T20:41:20.108492+0000","last_unstale":"2023-11-18T20:41:35.474264+0000","last_undegraded":"2023-11-18T20:41:35.474264+0000","last_fullsized":"2023-11-18T20:41:35.474264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:51:02.700363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"76'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.456636+0000","last_change":"2023-11-18T20:41:19.084636+0000","last_active":"2023-11-18T20:41:35.456636+0000","last_peered":"2023-11-18T20:41:35.456636+0000","last_clean":"2023-11-18T20:41:35.456636+0000","last_became_active":"2023-11-18T20:41:19.084334+0000","last_became_peered":"2023-11-18T20:41:19.084334+0000","last_unstale":"2023-11-18T20:41:35.456636+0000","last_undegraded":"2023-11-18T20:41:35.456636+0000","last_fullsized":"2023-11-18T20:41:35.456636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:23.195665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488725+0000","last_change":"2023-11-18T20:41:35.481987+0000","last_active":"2023-11-18T20:41:35.488725+0000","last_peered":"2023-11-18T20:41:35.488725+0000","last_clean":"2023-11-18T20:41:35.488725+0000","last_became_active":"2023-11-18T20:41:35.481674+0000","last_became_peered":"2023-11-18T20:41:35.481674+0000","last_unstale":"2023-11-18T20:41:35.488725+0000","last_undegraded":"2023-11-18T20:41:35.488725+0000","last_fullsized":"2023-11-18T20:41:35.488725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:39.748423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"79'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.498778+0000","last_change":"2023-11-18T20:41:34.463101+0000","last_active":"2023-11-18T20:41:35.498778+0000","last_peered":"2023-11-18T20:41:35.498778+0000","last_clean":"2023-11-18T20:41:35.498778+0000","last_became_active":"2023-11-18T20:41:34.462714+0000","last_became_peered":"2023-11-18T20:41:34.462714+0000","last_unstale":"2023-11-18T20:41:35.498778+0000","last_undegraded":"2023-11-18T20:41:35.498778+0000","last_fullsized":"2023-11-18T20:41:35.498778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:38.141433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.478124+0000","last_change":"2023-11-18T20:41:20.106214+0000","last_active":"2023-11-18T20:41:35.478124+0000","last_peered":"2023-11-18T20:41:35.478124+0000","last_clean":"2023-11-18T20:41:35.478124+0000","last_became_active":"2023-11-18T20:41:20.105702+0000","last_became_peered":"2023-11-18T20:41:20.105702+0000","last_unstale":"2023-11-18T20:41:35.478124+0000","last_undegraded":"2023-11-18T20:41:35.478124+0000","last_fullsized":"2023-11-18T20:41:35.478124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:45:15.838878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442861+0000","last_change":"2023-11-18T20:41:19.078495+0000","last_active":"2023-11-18T20:41:34.442861+0000","last_peered":"2023-11-18T20:41:34.442861+0000","last_clean":"2023-11-18T20:41:34.442861+0000","last_became_active":"2023-11-18T20:41:19.078230+0000","last_became_peered":"2023-11-18T20:41:19.078230+0000","last_unstale":"2023-11-18T20:41:34.442861+0000","last_undegraded":"2023-11-18T20:41:34.442861+0000","last_fullsized":"2023-11-18T20:41:34.442861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:59.396819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.475790+0000","last_change":"2023-11-18T20:41:35.470795+0000","last_active":"2023-11-18T20:41:35.475790+0000","last_peered":"2023-11-18T20:41:35.475790+0000","last_clean":"2023-11-18T20:41:35.475790+0000","last_became_active":"2023-11-18T20:41:35.469144+0000","last_became_peered":"2023-11-18T20:41:35.469144+0000","last_unstale":"2023-11-18T20:41:35.475790+0000","last_undegraded":"2023-11-18T20:41:35.475790+0000","last_fullsized":"2023-11-18T20:41:35.475790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:26.684465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.460212+0000","last_change":"2023-11-18T20:41:34.474266+0000","last_active":"2023-11-18T20:41:35.460212+0000","last_peered":"2023-11-18T20:41:35.460212+0000","last_clean":"2023-11-18T20:41:35.460212+0000","last_became_active":"2023-11-18T20:41:34.471535+0000","last_became_peered":"2023-11-18T20:41:34.471535+0000","last_unstale":"2023-11-18T20:41:35.460212+0000","last_undegraded":"2023-11-18T20:41:35.460212+0000","last_fullsized":"2023-11-18T20:41:35.460212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:01:18.038133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458470+0000","last_change":"2023-11-18T20:41:20.108454+0000","last_active":"2023-11-18T20:41:34.458470+0000","last_peered":"2023-11-18T20:41:34.458470+0000","last_clean":"2023-11-18T20:41:34.458470+0000","last_became_active":"2023-11-18T20:41:20.107160+0000","last_became_peered":"2023-11-18T20:41:20.107160+0000","last_unstale":"2023-11-18T20:41:34.458470+0000","last_undegraded":"2023-11-18T20:41:34.458470+0000","last_fullsized":"2023-11-18T20:41:34.458470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:20.038509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.459289+0000","last_change":"2023-11-18T20:41:19.090705+0000","last_active":"2023-11-18T20:41:34.459289+0000","last_peered":"2023-11-18T20:41:34.459289+0000","last_clean":"2023-11-18T20:41:34.459289+0000","last_became_active":"2023-11-18T20:41:19.090456+0000","last_became_peered":"2023-11-18T20:41:19.090456+0000","last_unstale":"2023-11-18T20:41:34.459289+0000","last_undegraded":"2023-11-18T20:41:34.459289+0000","last_fullsized":"2023-11-18T20:41:34.459289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:59.396819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.486511+0000","last_change":"2023-11-18T20:41:35.478693+0000","last_active":"2023-11-18T20:41:35.486511+0000","last_peered":"2023-11-18T20:41:35.486511+0000","last_clean":"2023-11-18T20:41:35.486511+0000","last_became_active":"2023-11-18T20:41:35.477886+0000","last_became_peered":"2023-11-18T20:41:35.477886+0000","last_unstale":"2023-11-18T20:41:35.486511+0000","last_undegraded":"2023-11-18T20:41:35.486511+0000","last_fullsized":"2023-11-18T20:41:35.486511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:13.320680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.465825+0000","last_change":"2023-11-18T20:41:34.478336+0000","last_active":"2023-11-18T20:41:35.465825+0000","last_peered":"2023-11-18T20:41:35.465825+0000","last_clean":"2023-11-18T20:41:35.465825+0000","last_became_active":"2023-11-18T20:41:34.478043+0000","last_became_peered":"2023-11-18T20:41:34.478043+0000","last_unstale":"2023-11-18T20:41:35.465825+0000","last_undegraded":"2023-11-18T20:41:35.465825+0000","last_fullsized":"2023-11-18T20:41:35.465825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:22:02.417644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456675+0000","last_change":"2023-11-18T20:41:20.114986+0000","last_active":"2023-11-18T20:41:34.456675+0000","last_peered":"2023-11-18T20:41:34.456675+0000","last_clean":"2023-11-18T20:41:34.456675+0000","last_became_active":"2023-11-18T20:41:20.114633+0000","last_became_peered":"2023-11-18T20:41:20.114633+0000","last_unstale":"2023-11-18T20:41:34.456675+0000","last_undegraded":"2023-11-18T20:41:34.456675+0000","last_fullsized":"2023-11-18T20:41:34.456675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:16.917978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.468270+0000","last_change":"2023-11-18T20:41:19.086338+0000","last_active":"2023-11-18T20:41:35.468270+0000","last_peered":"2023-11-18T20:41:35.468270+0000","last_clean":"2023-11-18T20:41:35.468270+0000","last_became_active":"2023-11-18T20:41:19.086004+0000","last_became_peered":"2023-11-18T20:41:19.086004+0000","last_unstale":"2023-11-18T20:41:35.468270+0000","last_undegraded":"2023-11-18T20:41:35.468270+0000","last_fullsized":"2023-11-18T20:41:35.468270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:59.604368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.472352+0000","last_change":"2023-11-18T20:41:35.460284+0000","last_active":"2023-11-18T20:41:35.472352+0000","last_peered":"2023-11-18T20:41:35.472352+0000","last_clean":"2023-11-18T20:41:35.472352+0000","last_became_active":"2023-11-18T20:41:35.459624+0000","last_became_peered":"2023-11-18T20:41:35.459624+0000","last_unstale":"2023-11-18T20:41:35.472352+0000","last_undegraded":"2023-11-18T20:41:35.472352+0000","last_fullsized":"2023-11-18T20:41:35.472352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.344287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477182+0000","last_change":"2023-11-18T20:41:34.472660+0000","last_active":"2023-11-18T20:41:36.477182+0000","last_peered":"2023-11-18T20:41:36.477182+0000","last_clean":"2023-11-18T20:41:36.477182+0000","last_became_active":"2023-11-18T20:41:34.468083+0000","last_became_peered":"2023-11-18T20:41:34.468083+0000","last_unstale":"2023-11-18T20:41:36.477182+0000","last_undegraded":"2023-11-18T20:41:36.477182+0000","last_fullsized":"2023-11-18T20:41:36.477182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:43.433331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.453386+0000","last_change":"2023-11-18T20:41:20.105693+0000","last_active":"2023-11-18T20:41:35.453386+0000","last_peered":"2023-11-18T20:41:35.453386+0000","last_clean":"2023-11-18T20:41:35.453386+0000","last_became_active":"2023-11-18T20:41:20.104048+0000","last_became_peered":"2023-11-18T20:41:20.104048+0000","last_unstale":"2023-11-18T20:41:35.453386+0000","last_undegraded":"2023-11-18T20:41:35.453386+0000","last_fullsized":"2023-11-18T20:41:35.453386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:46:07.215841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455429+0000","last_change":"2023-11-18T20:41:19.084853+0000","last_active":"2023-11-18T20:41:34.455429+0000","last_peered":"2023-11-18T20:41:34.455429+0000","last_clean":"2023-11-18T20:41:34.455429+0000","last_became_active":"2023-11-18T20:41:19.084525+0000","last_became_peered":"2023-11-18T20:41:19.084525+0000","last_unstale":"2023-11-18T20:41:34.455429+0000","last_undegraded":"2023-11-18T20:41:34.455429+0000","last_fullsized":"2023-11-18T20:41:34.455429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:11.638539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.486773+0000","last_change":"2023-11-18T20:41:35.479546+0000","last_active":"2023-11-18T20:41:35.486773+0000","last_peered":"2023-11-18T20:41:35.486773+0000","last_clean":"2023-11-18T20:41:35.486773+0000","last_became_active":"2023-11-18T20:41:35.478004+0000","last_became_peered":"2023-11-18T20:41:35.478004+0000","last_unstale":"2023-11-18T20:41:35.486773+0000","last_undegraded":"2023-11-18T20:41:35.486773+0000","last_fullsized":"2023-11-18T20:41:35.486773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:05:56.579657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478798+0000","last_change":"2023-11-18T20:41:34.477397+0000","last_active":"2023-11-18T20:41:36.478798+0000","last_peered":"2023-11-18T20:41:36.478798+0000","last_clean":"2023-11-18T20:41:36.478798+0000","last_became_active":"2023-11-18T20:41:34.476715+0000","last_became_peered":"2023-11-18T20:41:34.476715+0000","last_unstale":"2023-11-18T20:41:36.478798+0000","last_undegraded":"2023-11-18T20:41:36.478798+0000","last_fullsized":"2023-11-18T20:41:36.478798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:34.403612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.454651+0000","last_change":"2023-11-18T20:41:20.117843+0000","last_active":"2023-11-18T20:41:34.454651+0000","last_peered":"2023-11-18T20:41:34.454651+0000","last_clean":"2023-11-18T20:41:34.454651+0000","last_became_active":"2023-11-18T20:41:20.117505+0000","last_became_peered":"2023-11-18T20:41:20.117505+0000","last_unstale":"2023-11-18T20:41:34.454651+0000","last_undegraded":"2023-11-18T20:41:34.454651+0000","last_fullsized":"2023-11-18T20:41:34.454651+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:35.394592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455866+0000","last_change":"2023-11-18T20:41:19.078072+0000","last_active":"2023-11-18T20:41:34.455866+0000","last_peered":"2023-11-18T20:41:34.455866+0000","last_clean":"2023-11-18T20:41:34.455866+0000","last_became_active":"2023-11-18T20:41:19.077794+0000","last_became_peered":"2023-11-18T20:41:19.077794+0000","last_unstale":"2023-11-18T20:41:34.455866+0000","last_undegraded":"2023-11-18T20:41:34.455866+0000","last_fullsized":"2023-11-18T20:41:34.455866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:06.256655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477826+0000","last_change":"2023-11-18T20:41:35.482205+0000","last_active":"2023-11-18T20:41:36.477826+0000","last_peered":"2023-11-18T20:41:36.477826+0000","last_clean":"2023-11-18T20:41:36.477826+0000","last_became_active":"2023-11-18T20:41:35.481876+0000","last_became_peered":"2023-11-18T20:41:35.481876+0000","last_unstale":"2023-11-18T20:41:36.477826+0000","last_undegraded":"2023-11-18T20:41:36.477826+0000","last_fullsized":"2023-11-18T20:41:36.477826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:59:01.056831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.472105+0000","last_change":"2023-11-18T20:41:34.465697+0000","last_active":"2023-11-18T20:41:35.472105+0000","last_peered":"2023-11-18T20:41:35.472105+0000","last_clean":"2023-11-18T20:41:35.472105+0000","last_became_active":"2023-11-18T20:41:34.465204+0000","last_became_peered":"2023-11-18T20:41:34.465204+0000","last_unstale":"2023-11-18T20:41:35.472105+0000","last_undegraded":"2023-11-18T20:41:35.472105+0000","last_fullsized":"2023-11-18T20:41:35.472105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:32:46.226299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455757+0000","last_change":"2023-11-18T20:41:20.109900+0000","last_active":"2023-11-18T20:41:34.455757+0000","last_peered":"2023-11-18T20:41:34.455757+0000","last_clean":"2023-11-18T20:41:34.455757+0000","last_became_active":"2023-11-18T20:41:20.109595+0000","last_became_peered":"2023-11-18T20:41:20.109595+0000","last_unstale":"2023-11-18T20:41:34.455757+0000","last_undegraded":"2023-11-18T20:41:34.455757+0000","last_fullsized":"2023-11-18T20:41:34.455757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:12.856780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441784+0000","last_change":"2023-11-18T20:41:19.074145+0000","last_active":"2023-11-18T20:41:34.441784+0000","last_peered":"2023-11-18T20:41:34.441784+0000","last_clean":"2023-11-18T20:41:34.441784+0000","last_became_active":"2023-11-18T20:41:19.073833+0000","last_became_peered":"2023-11-18T20:41:19.073833+0000","last_unstale":"2023-11-18T20:41:34.441784+0000","last_undegraded":"2023-11-18T20:41:34.441784+0000","last_fullsized":"2023-11-18T20:41:34.441784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:27.958410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.482288+0000","last_change":"2023-11-18T20:41:35.473188+0000","last_active":"2023-11-18T20:41:36.482288+0000","last_peered":"2023-11-18T20:41:36.482288+0000","last_clean":"2023-11-18T20:41:36.482288+0000","last_became_active":"2023-11-18T20:41:35.471763+0000","last_became_peered":"2023-11-18T20:41:35.471763+0000","last_unstale":"2023-11-18T20:41:36.482288+0000","last_undegraded":"2023-11-18T20:41:36.482288+0000","last_fullsized":"2023-11-18T20:41:36.482288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:21.267998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.501210+0000","last_change":"2023-11-18T20:41:34.472123+0000","last_active":"2023-11-18T20:41:35.501210+0000","last_peered":"2023-11-18T20:41:35.501210+0000","last_clean":"2023-11-18T20:41:35.501210+0000","last_became_active":"2023-11-18T20:41:34.471850+0000","last_became_peered":"2023-11-18T20:41:34.471850+0000","last_unstale":"2023-11-18T20:41:35.501210+0000","last_undegraded":"2023-11-18T20:41:35.501210+0000","last_fullsized":"2023-11-18T20:41:35.501210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:18.053169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449722+0000","last_change":"2023-11-18T20:41:20.109331+0000","last_active":"2023-11-18T20:41:35.449722+0000","last_peered":"2023-11-18T20:41:35.449722+0000","last_clean":"2023-11-18T20:41:35.449722+0000","last_became_active":"2023-11-18T20:41:20.109021+0000","last_became_peered":"2023-11-18T20:41:20.109021+0000","last_unstale":"2023-11-18T20:41:35.449722+0000","last_undegraded":"2023-11-18T20:41:35.449722+0000","last_fullsized":"2023-11-18T20:41:35.449722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:06:30.165657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.478924+0000","last_change":"2023-11-18T20:41:19.086459+0000","last_active":"2023-11-18T20:41:35.478924+0000","last_peered":"2023-11-18T20:41:35.478924+0000","last_clean":"2023-11-18T20:41:35.478924+0000","last_became_active":"2023-11-18T20:41:19.086134+0000","last_became_peered":"2023-11-18T20:41:19.086134+0000","last_unstale":"2023-11-18T20:41:35.478924+0000","last_undegraded":"2023-11-18T20:41:35.478924+0000","last_fullsized":"2023-11-18T20:41:35.478924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:11:21.092893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.454743+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:41:34.454743+0000","last_peered":"2023-11-18T20:41:34.454743+0000","last_clean":"2023-11-18T20:41:34.454743+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:41:34.454743+0000","last_undegraded":"2023-11-18T20:41:34.454743+0000","last_fullsized":"2023-11-18T20:41:34.454743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":436983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.67300000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.749},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.079,"15min":1.091},"min":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5049999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.84999999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.1839999999999999,"15min":1.2050000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7829999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.2350000000000001,"15min":1.254},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.929,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.93999999999999995}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.107,"15min":1.1200000000000001},"min":{"1min":0.72899999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.294,"15min":1.298},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.105}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.92300000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.532,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.341},{"interface":"front","average":{"1min":1.298,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5609999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.524,"15min":1.5700000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.788,"5min":2.601,"15min":2.601},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.48,"15min":1.534},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7250000000000001,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.5209999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.581,"15min":1.615},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1560000000000001,"5min":3.02,"15min":3.02},"last":1.448},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.6719999999999999,"15min":1.722},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.04,"5min":3.488,"15min":3.488},"last":1.5800000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.728,"15min":1.766},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.109,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.796},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.6699999999999999,"15min":1.7270000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.1970000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.6359999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":444160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.97899999999999998,"15min":0.96999999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.464,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.997}]},{"osd":1,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0169999999999999,"15min":1.0049999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.125,"5min":1.151,"15min":1.1559999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.52,"5min":1.653,"15min":1.653},"last":1.2110000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.68200000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6479999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.381},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.22,"15min":1.23},"min":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.1200000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3220000000000001,"15min":1.341},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2030000000000001,"15min":1.1970000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.163}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3400000000000001,"15min":1.3520000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8959999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.538},{"interface":"front","average":{"1min":1.383,"5min":1.371,"15min":1.373},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9390000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.653}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.3799999999999999,"15min":1.333},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.55,"15min":1.534},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.706}]},{"osd":7,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.575,"15min":1.5649999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":5.0369999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.742,"5min":1.5469999999999999,"15min":1.5169999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":6.1769999999999996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.5860000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1597440,"data_stored":1031508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1739999999999999,"15min":1.1899999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.7130000000000001,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.78800000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5780000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1000000000000001,"15min":1.123},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.466,"5min":1.897,"15min":1.897},"last":1.012},{"interface":"front","average":{"1min":1.202,"5min":1.278,"15min":1.3240000000000001},"min":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.968,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.96299999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.3160000000000001,"15min":1.3799999999999999},"min":{"1min":0.81299999999999994,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5329999999999999,"5min":2.004,"15min":2.004},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.194,"15min":1.202},"min":{"1min":0.88700000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.3200000000000001,"5min":2.214,"15min":2.214},"last":1.212}]},{"osd":3,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.452,"15min":1.496},"min":{"1min":0.80700000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.1019999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.4370000000000001,"15min":1.454},"min":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.762,"5min":2.024,"15min":2.024},"last":1.452}]},{"osd":4,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.879,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.657,"5min":2.359,"15min":2.359},"last":1.351},{"interface":"front","average":{"1min":1.518,"5min":1.508,"15min":1.5089999999999999},"min":{"1min":0.76800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.6759999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.615,"15min":1.657},"min":{"1min":1.288,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.907,"5min":2.181,"15min":2.181},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.569,"15min":1.605},"min":{"1min":1.044,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.04,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.627}]},{"osd":7,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.6459999999999999,"15min":1.6659999999999999},"min":{"1min":1.2170000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.1699999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.75},{"interface":"front","average":{"1min":1.659,"5min":1.724,"15min":1.754},"min":{"1min":1.2569999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.972,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.659}]}]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":444104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0249999999999999,"15min":1.032},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.4390000000000001,"5min":1.635,"15min":1.635},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.131,"5min":1.091,"15min":1.101},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.6659999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.8979999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1100000000000001,"15min":1.0900000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.647,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":2.097},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.1459999999999999,"15min":1.214},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.367,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.7470000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.379,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.335,"15min":1.393},"min":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.76,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":2.0030000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1839999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.593,"5min":1.823,"15min":1.823},"last":2.056},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.4159999999999999,"15min":1.484},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.667,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.1519999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.70099999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7490000000000001,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":2.2160000000000002},{"interface":"front","average":{"1min":1.169,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.514,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.95}]},{"osd":6,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.488,"15min":1.5409999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.7030000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.339},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.571,"15min":1.605},"min":{"1min":0.77500000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8580000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":2.2970000000000002}]},{"osd":7,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4410000000000001,"15min":1.4650000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.629,"5min":1.929,"15min":1.929},"last":2.169},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.6000000000000001,"15min":1.6319999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.74,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542193,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1003520,"data_stored":444356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.55700000000000005,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1990000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84999999999999998,"15min":0.83099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.74099999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94199999999999995,"15min":0.93600000000000005},"min":{"1min":0.45600000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4550000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.86599999999999999,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.4390000000000001,"5min":1.595,"15min":1.595},"last":1.01}]},{"osd":2,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.069,"15min":1.0660000000000001},"min":{"1min":0.77500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.581,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.0069999999999999},"min":{"1min":0.69699999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.377,"5min":1.675,"15min":1.675},"last":0.84199999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.177,"15min":1.161},"min":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.45},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91800000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.222}]},{"osd":5,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.95099999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6359999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.107},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.254,"15min":1.248},"min":{"1min":0.86499999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7529999999999999,"5min":1.901,"15min":1.901},"last":0.98799999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2789999999999999,"15min":1.2669999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8109999999999999,"5min":1.837,"15min":1.837},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.3300000000000001,"15min":1.3180000000000001},"min":{"1min":1.1220000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.712,"5min":1.962,"15min":1.962},"last":1.379}]},{"osd":7,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3420000000000001,"15min":1.3480000000000001},"min":{"1min":1.0149999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8560000000000001,"5min":1.907,"15min":1.907},"last":1.155},{"interface":"front","average":{"1min":1.415,"5min":1.347,"15min":1.325},"min":{"1min":0.88300000000000001,"5min":0.754,"15min":0.754},"max":{"1min":1.903,"5min":2.081,"15min":2.081},"last":1.5720000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542192,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":436401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.177,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1},{"interface":"front","average":{"1min":0.88,"5min":0.98599999999999999,"15min":1.028},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3899999999999999,"5min":2.081,"15min":2.081},"last":1.157}]},{"osd":1,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83899999999999997,"15min":0.85899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.367,"5min":1.919,"15min":1.919},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83599999999999997,"15min":0.84299999999999997},"min":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.345,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.872}]},{"osd":3,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0660000000000001,"15min":1.1000000000000001},"min":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.516,"5min":2.024,"15min":2.024},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.59999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.637,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.276,"15min":1.319},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9630000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.9730000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1819999999999999,"15min":1.2110000000000001},"min":{"1min":0.753,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6799999999999999,"5min":2.254,"15min":2.254},"last":2.3639999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.28,"15min":1.3120000000000001},"min":{"1min":0.94199999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5329999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.21},{"interface":"front","average":{"1min":1.3,"5min":1.393,"15min":1.4379999999999999},"min":{"1min":0.89000000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8779999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.3520000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.387,"15min":1.4450000000000001},"min":{"1min":0.78100000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.738,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.282,"15min":1.319},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.9219999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.083}]},{"osd":7,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.419,"15min":1.458},"min":{"1min":0.82799999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.0830000000000002,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.377,"15min":1.4279999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.917,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.383}]}]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":1028513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2190000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.873,"15min":0.90900000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.288,"5min":1.524,"15min":1.524},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.872,"15min":0.89400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.004,"15min":1.028},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.518,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.024,"15min":1.054},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.468,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4099999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.179,"15min":1.2110000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.486,"5min":1.927,"15min":1.927},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.151,"5min":1.3500000000000001,"15min":1.415},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6879999999999999,"5min":3.343,"15min":3.343},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.375,"15min":1.4630000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.671,"5min":3.206,"15min":3.206},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.3340000000000001,"15min":1.383},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5229999999999999,"5min":2.165,"15min":2.165},"last":0.98199999999999998}]},{"osd":6,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.4099999999999999,"15min":1.4670000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.766,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4930000000000001,"15min":1.5740000000000001},"min":{"1min":0.84499999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6399999999999999,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.95799999999999996}]},{"osd":7,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.5,"15min":1.5920000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6699999999999999,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.581,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.0229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":439460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90300000000000002,"15min":0.96199999999999997},"min":{"1min":0.442,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.347,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95899999999999996,"15min":1.006},"min":{"1min":0.625,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.661,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.383,"15min":1.6060000000000001},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.421,"5min":14.169,"15min":14.169},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":0.93700000000000006},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6080000000000001,"5min":2.173,"15min":2.173},"last":0.74099999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.3680000000000001,"15min":1.5620000000000001},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5609999999999999,"5min":11.629,"15min":11.629},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.2749999999999999,"15min":1.387},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.524,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.1060000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3620000000000001,"15min":1.4239999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6579999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.367,"15min":1.4079999999999999},"min":{"1min":0.81399999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.476,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.286}]},{"osd":5,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.466,"15min":1.5940000000000001},"min":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.71,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.53,"15min":1.647},"min":{"1min":0.80300000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.8600000000000001,"5min":6.202,"15min":6.202},"last":1.252}]},{"osd":6,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.454,"15min":1.466},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.794,"5min":5.085,"15min":5.085},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.583,"15min":1.7130000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.831,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.4490000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.5169999999999999,"15min":1.6220000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9099999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.385},{"interface":"front","average":{"1min":1.375,"5min":1.639,"15min":1.7669999999999999},"min":{"1min":0.81000000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.954,"5min":6.149,"15min":6.149},"last":1.2110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:41:39.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:41:40.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.187+0000 7f653ae02640 1 Processor -- start 2023-11-18T20:41:40.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.188+0000 7f653ae02640 1 -- start start 2023-11-18T20:41:40.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.189+0000 7f653ae02640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653406d0a0 0x7f6534152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.189+0000 7f653ae02640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65340c3ea0 0x7f65340c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.189+0000 7f653ae02640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65340c64a0 con 0x7f653414fd30 2023-11-18T20:41:40.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.189+0000 7f653ae02640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65340c5c00 con 0x7f65340c3ea0 2023-11-18T20:41:40.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.189+0000 7f653ae02640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65340c5ee0 con 0x7f653406d0a0 2023-11-18T20:41:40.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.189+0000 7f653939f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65340c3ea0 0x7f65340c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.190+0000 7f653939f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65340c3ea0 0x7f65340c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50382/0 (socket says 172.21.15.132:50382) 2023-11-18T20:41:40.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.190+0000 7f653939f640 1 -- 172.21.15.132:0/3320545128 learned_addr learned my addr 172.21.15.132:0/3320545128 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:40.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.190+0000 7f6533fff640 1 --2- 172.21.15.132:0/3320545128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653406d0a0 0x7f6534152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.190+0000 7f653939f640 1 -- 172.21.15.132:0/3320545128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653406d0a0 msgr2=0x7f6534152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:40.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.190+0000 7f653939f640 1 --2- 172.21.15.132:0/3320545128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653406d0a0 0x7f6534152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.190+0000 7f653939f640 1 -- 172.21.15.132:0/3320545128 >> v1:172.21.15.161:6789/0 conn(0x7f653414fd30 legacy=0x7f65340a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.190+0000 7f653939f640 1 -- 172.21.15.132:0/3320545128 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65340c61c0 con 0x7f65340c3ea0 2023-11-18T20:41:40.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.191+0000 7f653939f640 1 --2- 172.21.15.132:0/3320545128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65340c3ea0 0x7f65340c4330 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f652c009e50 tx=0x7f652c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d56bc6afd8038a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:40.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.191+0000 7f65337fe640 1 -- 172.21.15.132:0/3320545128 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c02cb00 con 0x7f65340c3ea0 2023-11-18T20:41:40.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.191+0000 7f65337fe640 1 -- 172.21.15.132:0/3320545128 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c02cc60 con 0x7f65340c3ea0 2023-11-18T20:41:40.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.191+0000 7f65337fe640 1 -- 172.21.15.132:0/3320545128 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0343f0 con 0x7f65340c3ea0 2023-11-18T20:41:40.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.192+0000 7f653ae02640 1 -- 172.21.15.132:0/3320545128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65340c3ea0 msgr2=0x7f65340c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.192+0000 7f653ae02640 1 --2- 172.21.15.132:0/3320545128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65340c3ea0 0x7f65340c4330 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f652c009e50 tx=0x7f652c02bf60 comp rx=0 tx=0).stop 2023-11-18T20:41:40.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.192+0000 7f653ae02640 1 -- 172.21.15.132:0/3320545128 shutdown_connections 2023-11-18T20:41:40.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.192+0000 7f653ae02640 1 --2- 172.21.15.132:0/3320545128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65340c3ea0 0x7f65340c4330 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.192+0000 7f653ae02640 1 --2- 172.21.15.132:0/3320545128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653406d0a0 0x7f6534152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.192+0000 7f653ae02640 1 -- 172.21.15.132:0/3320545128 >> 172.21.15.132:0/3320545128 conn(0x7f653406a500 msgr2=0x7f653406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:40.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.192+0000 7f653ae02640 1 -- 172.21.15.132:0/3320545128 shutdown_connections 2023-11-18T20:41:40.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.192+0000 7f653ae02640 1 -- 172.21.15.132:0/3320545128 wait complete. 2023-11-18T20:41:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.194+0000 7f653ae02640 1 Processor -- start 2023-11-18T20:41:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.194+0000 7f653ae02640 1 -- start start 2023-11-18T20:41:40.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.195+0000 7f653ae02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653406d0a0 0x7f65340bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.195+0000 7f653ae02640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65340c3ea0 0x7f653414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.195+0000 7f653ae02640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653414fd30 0x7f653414f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.195+0000 7f653ae02640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65341ea080 con 0x7f653406d0a0 2023-11-18T20:41:40.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.195+0000 7f653ae02640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65341dc2c0 con 0x7f65340c3ea0 2023-11-18T20:41:40.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.195+0000 7f653ae02640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6534150240 con 0x7f653414fd30 2023-11-18T20:41:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.195+0000 7f6538b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653406d0a0 0x7f65340bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6533fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65340c3ea0 0x7f653414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6538b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653406d0a0 0x7f65340bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50398/0 (socket says 172.21.15.132:50398) 2023-11-18T20:41:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6538b9e640 1 -- 172.21.15.132:0/893200490 learned_addr learned my addr 172.21.15.132:0/893200490 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f653939f640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653414fd30 0x7f653414f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6538b9e640 1 -- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653414fd30 msgr2=0x7f653414f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6538b9e640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653414fd30 0x7f653414f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6538b9e640 1 -- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65340c3ea0 msgr2=0x7f653414ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6538b9e640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65340c3ea0 0x7f653414ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6538b9e640 1 -- 172.21.15.132:0/893200490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c009b30 con 0x7f653406d0a0 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6533fff640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65340c3ea0 0x7f653414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.196+0000 7f6538b9e640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653406d0a0 0x7f65340bf360 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f652800c450 tx=0x7f652800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.197+0000 7f65317fa640 1 -- 172.21.15.132:0/893200490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65280052d0 con 0x7f653406d0a0 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.197+0000 7f65317fa640 1 -- 172.21.15.132:0/893200490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6528005430 con 0x7f653406d0a0 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.197+0000 7f65317fa640 1 -- 172.21.15.132:0/893200490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528012870 con 0x7f653406d0a0 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.197+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65341dbc70 con 0x7f653406d0a0 2023-11-18T20:41:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.197+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653414f740 con 0x7f653406d0a0 2023-11-18T20:41:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.198+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65341dbad0 con 0x7f653406d0a0 2023-11-18T20:41:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.199+0000 7f65317fa640 1 -- 172.21.15.132:0/893200490 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65280129d0 con 0x7f653406d0a0 2023-11-18T20:41:40.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.200+0000 7f65317fa640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f651806ae40 0x7f651806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.200+0000 7f65317fa640 1 -- 172.21.15.132:0/893200490 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6528089480 con 0x7f653406d0a0 2023-11-18T20:41:40.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.201+0000 7f6533fff640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f651806ae40 0x7f651806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.202+0000 7f6533fff640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f651806ae40 0x7f651806d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6534150c40 tx=0x7f6520008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.204+0000 7f65317fa640 1 -- 172.21.15.132:0/893200490 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65341dbad0 con 0x7f653406d0a0 2023-11-18T20:41:40.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.390+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65340c1b60 con 0x7f651806ae40 2023-11-18T20:41:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.428+0000 7f65317fa640 1 -- 172.21.15.132:0/893200490 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525178 (secure 0 0 0) 0x7f65340c1b60 con 0x7f651806ae40 2023-11-18T20:41:40.436 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:40.440 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:41:40.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f651806ae40 msgr2=0x7f651806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f651806ae40 0x7f651806d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6534150c40 tx=0x7f6520008040 comp rx=0 tx=0).stop 2023-11-18T20:41:40.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653406d0a0 msgr2=0x7f65340bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653406d0a0 0x7f65340bf360 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f652800c450 tx=0x7f652800c910 comp rx=0 tx=0).stop 2023-11-18T20:41:40.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 shutdown_connections 2023-11-18T20:41:40.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f651806ae40 0x7f651806d300 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653414fd30 0x7f653414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65340c3ea0 0x7f653414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 --2- 172.21.15.132:0/893200490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653406d0a0 0x7f65340bf360 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.436+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 >> 172.21.15.132:0/893200490 conn(0x7f653406a500 msgr2=0x7f65340c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:40.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.437+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 shutdown_connections 2023-11-18T20:41:40.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.437+0000 7f653ae02640 1 -- 172.21.15.132:0/893200490 wait complete. 2023-11-18T20:41:40.459 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-18T20:41:38.719220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":360,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250008,"kb_used_data":8876,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724712,"statfs":{"total":773094113280,"available":772838105088,"internally_reserved":0,"allocated":9089024,"data_stored":4705485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.293498"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481326+0000","last_change":"2023-11-18T20:41:35.475461+0000","last_active":"2023-11-18T20:41:36.481326+0000","last_peered":"2023-11-18T20:41:36.481326+0000","last_clean":"2023-11-18T20:41:36.481326+0000","last_became_active":"2023-11-18T20:41:35.475156+0000","last_became_peered":"2023-11-18T20:41:35.475156+0000","last_unstale":"2023-11-18T20:41:36.481326+0000","last_undegraded":"2023-11-18T20:41:36.481326+0000","last_fullsized":"2023-11-18T20:41:36.481326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:44.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456434+0000","last_change":"2023-11-18T20:41:20.117635+0000","last_active":"2023-11-18T20:41:34.456434+0000","last_peered":"2023-11-18T20:41:34.456434+0000","last_clean":"2023-11-18T20:41:34.456434+0000","last_became_active":"2023-11-18T20:41:20.117273+0000","last_became_peered":"2023-11-18T20:41:20.117273+0000","last_unstale":"2023-11-18T20:41:34.456434+0000","last_undegraded":"2023-11-18T20:41:34.456434+0000","last_fullsized":"2023-11-18T20:41:34.456434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:47.673490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.480320+0000","last_change":"2023-11-18T20:41:35.465470+0000","last_active":"2023-11-18T20:41:36.480320+0000","last_peered":"2023-11-18T20:41:36.480320+0000","last_clean":"2023-11-18T20:41:36.480320+0000","last_became_active":"2023-11-18T20:41:35.465192+0000","last_became_peered":"2023-11-18T20:41:35.465192+0000","last_unstale":"2023-11-18T20:41:36.480320+0000","last_undegraded":"2023-11-18T20:41:36.480320+0000","last_fullsized":"2023-11-18T20:41:36.480320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:20.622297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.470337+0000","last_change":"2023-11-18T20:41:20.104801+0000","last_active":"2023-11-18T20:41:35.470337+0000","last_peered":"2023-11-18T20:41:35.470337+0000","last_clean":"2023-11-18T20:41:35.470337+0000","last_became_active":"2023-11-18T20:41:20.103230+0000","last_became_peered":"2023-11-18T20:41:20.103230+0000","last_unstale":"2023-11-18T20:41:35.470337+0000","last_undegraded":"2023-11-18T20:41:35.470337+0000","last_fullsized":"2023-11-18T20:41:35.470337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.480981+0000","last_change":"2023-11-18T20:41:35.485011+0000","last_active":"2023-11-18T20:41:36.480981+0000","last_peered":"2023-11-18T20:41:36.480981+0000","last_clean":"2023-11-18T20:41:36.480981+0000","last_became_active":"2023-11-18T20:41:35.484718+0000","last_became_peered":"2023-11-18T20:41:35.484718+0000","last_unstale":"2023-11-18T20:41:36.480981+0000","last_undegraded":"2023-11-18T20:41:36.480981+0000","last_fullsized":"2023-11-18T20:41:36.480981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:39:52.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458382+0000","last_change":"2023-11-18T20:41:20.116375+0000","last_active":"2023-11-18T20:41:34.458382+0000","last_peered":"2023-11-18T20:41:34.458382+0000","last_clean":"2023-11-18T20:41:34.458382+0000","last_became_active":"2023-11-18T20:41:20.115271+0000","last_became_peered":"2023-11-18T20:41:20.115271+0000","last_unstale":"2023-11-18T20:41:34.458382+0000","last_undegraded":"2023-11-18T20:41:34.458382+0000","last_fullsized":"2023-11-18T20:41:34.458382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:47:17.588940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.482144+0000","last_change":"2023-11-18T20:41:35.477395+0000","last_active":"2023-11-18T20:41:36.482144+0000","last_peered":"2023-11-18T20:41:36.482144+0000","last_clean":"2023-11-18T20:41:36.482144+0000","last_became_active":"2023-11-18T20:41:35.476981+0000","last_became_peered":"2023-11-18T20:41:35.476981+0000","last_unstale":"2023-11-18T20:41:36.482144+0000","last_undegraded":"2023-11-18T20:41:36.482144+0000","last_fullsized":"2023-11-18T20:41:36.482144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:31:18.048271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467245+0000","last_change":"2023-11-18T20:41:20.115993+0000","last_active":"2023-11-18T20:41:34.467245+0000","last_peered":"2023-11-18T20:41:34.467245+0000","last_clean":"2023-11-18T20:41:34.467245+0000","last_became_active":"2023-11-18T20:41:20.111554+0000","last_became_peered":"2023-11-18T20:41:20.111554+0000","last_unstale":"2023-11-18T20:41:34.467245+0000","last_undegraded":"2023-11-18T20:41:34.467245+0000","last_fullsized":"2023-11-18T20:41:34.467245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:31.666571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477000+0000","last_change":"2023-11-18T20:41:35.479499+0000","last_active":"2023-11-18T20:41:36.477000+0000","last_peered":"2023-11-18T20:41:36.477000+0000","last_clean":"2023-11-18T20:41:36.477000+0000","last_became_active":"2023-11-18T20:41:35.479178+0000","last_became_peered":"2023-11-18T20:41:35.479178+0000","last_unstale":"2023-11-18T20:41:36.477000+0000","last_undegraded":"2023-11-18T20:41:36.477000+0000","last_fullsized":"2023-11-18T20:41:36.477000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:33.164275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.473895+0000","last_change":"2023-11-18T20:41:20.104778+0000","last_active":"2023-11-18T20:41:35.473895+0000","last_peered":"2023-11-18T20:41:35.473895+0000","last_clean":"2023-11-18T20:41:35.473895+0000","last_became_active":"2023-11-18T20:41:20.104320+0000","last_became_peered":"2023-11-18T20:41:20.104320+0000","last_unstale":"2023-11-18T20:41:35.473895+0000","last_undegraded":"2023-11-18T20:41:35.473895+0000","last_fullsized":"2023-11-18T20:41:35.473895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:01:59.745970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.476716+0000","last_change":"2023-11-18T20:41:35.478978+0000","last_active":"2023-11-18T20:41:36.476716+0000","last_peered":"2023-11-18T20:41:36.476716+0000","last_clean":"2023-11-18T20:41:36.476716+0000","last_became_active":"2023-11-18T20:41:35.478236+0000","last_became_peered":"2023-11-18T20:41:35.478236+0000","last_unstale":"2023-11-18T20:41:36.476716+0000","last_undegraded":"2023-11-18T20:41:36.476716+0000","last_fullsized":"2023-11-18T20:41:36.476716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:58:47.046362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455241+0000","last_change":"2023-11-18T20:41:20.107543+0000","last_active":"2023-11-18T20:41:34.455241+0000","last_peered":"2023-11-18T20:41:34.455241+0000","last_clean":"2023-11-18T20:41:34.455241+0000","last_became_active":"2023-11-18T20:41:20.107257+0000","last_became_peered":"2023-11-18T20:41:20.107257+0000","last_unstale":"2023-11-18T20:41:34.455241+0000","last_undegraded":"2023-11-18T20:41:34.455241+0000","last_fullsized":"2023-11-18T20:41:34.455241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:02.110658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477568+0000","last_change":"2023-11-18T20:41:35.490436+0000","last_active":"2023-11-18T20:41:36.477568+0000","last_peered":"2023-11-18T20:41:36.477568+0000","last_clean":"2023-11-18T20:41:36.477568+0000","last_became_active":"2023-11-18T20:41:35.485371+0000","last_became_peered":"2023-11-18T20:41:35.485371+0000","last_unstale":"2023-11-18T20:41:36.477568+0000","last_undegraded":"2023-11-18T20:41:36.477568+0000","last_fullsized":"2023-11-18T20:41:36.477568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:26:14.037436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467045+0000","last_change":"2023-11-18T20:41:20.109616+0000","last_active":"2023-11-18T20:41:35.467045+0000","last_peered":"2023-11-18T20:41:35.467045+0000","last_clean":"2023-11-18T20:41:35.467045+0000","last_became_active":"2023-11-18T20:41:20.108985+0000","last_became_peered":"2023-11-18T20:41:20.108985+0000","last_unstale":"2023-11-18T20:41:35.467045+0000","last_undegraded":"2023-11-18T20:41:35.467045+0000","last_fullsized":"2023-11-18T20:41:35.467045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:11:51.719786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477161+0000","last_change":"2023-11-18T20:41:35.483183+0000","last_active":"2023-11-18T20:41:36.477161+0000","last_peered":"2023-11-18T20:41:36.477161+0000","last_clean":"2023-11-18T20:41:36.477161+0000","last_became_active":"2023-11-18T20:41:35.482888+0000","last_became_peered":"2023-11-18T20:41:35.482888+0000","last_unstale":"2023-11-18T20:41:36.477161+0000","last_undegraded":"2023-11-18T20:41:36.477161+0000","last_fullsized":"2023-11-18T20:41:36.477161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:27.937737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441587+0000","last_change":"2023-11-18T20:41:20.109011+0000","last_active":"2023-11-18T20:41:34.441587+0000","last_peered":"2023-11-18T20:41:34.441587+0000","last_clean":"2023-11-18T20:41:34.441587+0000","last_became_active":"2023-11-18T20:41:20.107749+0000","last_became_peered":"2023-11-18T20:41:20.107749+0000","last_unstale":"2023-11-18T20:41:34.441587+0000","last_undegraded":"2023-11-18T20:41:34.441587+0000","last_fullsized":"2023-11-18T20:41:34.441587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:12.644063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477941+0000","last_change":"2023-11-18T20:41:35.496542+0000","last_active":"2023-11-18T20:41:36.477941+0000","last_peered":"2023-11-18T20:41:36.477941+0000","last_clean":"2023-11-18T20:41:36.477941+0000","last_became_active":"2023-11-18T20:41:35.496253+0000","last_became_peered":"2023-11-18T20:41:35.496253+0000","last_unstale":"2023-11-18T20:41:36.477941+0000","last_undegraded":"2023-11-18T20:41:36.477941+0000","last_fullsized":"2023-11-18T20:41:36.477941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:10.413270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456351+0000","last_change":"2023-11-18T20:41:20.111675+0000","last_active":"2023-11-18T20:41:34.456351+0000","last_peered":"2023-11-18T20:41:34.456351+0000","last_clean":"2023-11-18T20:41:34.456351+0000","last_became_active":"2023-11-18T20:41:20.111344+0000","last_became_peered":"2023-11-18T20:41:20.111344+0000","last_unstale":"2023-11-18T20:41:34.456351+0000","last_undegraded":"2023-11-18T20:41:34.456351+0000","last_fullsized":"2023-11-18T20:41:34.456351+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:11:51.719786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.473479+0000","last_change":"2023-11-18T20:41:35.460266+0000","last_active":"2023-11-18T20:41:35.473479+0000","last_peered":"2023-11-18T20:41:35.473479+0000","last_clean":"2023-11-18T20:41:35.473479+0000","last_became_active":"2023-11-18T20:41:35.459436+0000","last_became_peered":"2023-11-18T20:41:35.459436+0000","last_unstale":"2023-11-18T20:41:35.473479+0000","last_undegraded":"2023-11-18T20:41:35.473479+0000","last_fullsized":"2023-11-18T20:41:35.473479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:59.565550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458410+0000","last_change":"2023-11-18T20:41:20.101257+0000","last_active":"2023-11-18T20:41:34.458410+0000","last_peered":"2023-11-18T20:41:34.458410+0000","last_clean":"2023-11-18T20:41:34.458410+0000","last_became_active":"2023-11-18T20:41:20.100858+0000","last_became_peered":"2023-11-18T20:41:20.100858+0000","last_unstale":"2023-11-18T20:41:34.458410+0000","last_undegraded":"2023-11-18T20:41:34.458410+0000","last_fullsized":"2023-11-18T20:41:34.458410+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:29.068227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477295+0000","last_change":"2023-11-18T20:41:35.482326+0000","last_active":"2023-11-18T20:41:36.477295+0000","last_peered":"2023-11-18T20:41:36.477295+0000","last_clean":"2023-11-18T20:41:36.477295+0000","last_became_active":"2023-11-18T20:41:35.481947+0000","last_became_peered":"2023-11-18T20:41:35.481947+0000","last_unstale":"2023-11-18T20:41:36.477295+0000","last_undegraded":"2023-11-18T20:41:36.477295+0000","last_fullsized":"2023-11-18T20:41:36.477295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:54.699054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.454542+0000","last_change":"2023-11-18T20:41:20.099422+0000","last_active":"2023-11-18T20:41:35.454542+0000","last_peered":"2023-11-18T20:41:35.454542+0000","last_clean":"2023-11-18T20:41:35.454542+0000","last_became_active":"2023-11-18T20:41:20.099063+0000","last_became_peered":"2023-11-18T20:41:20.099063+0000","last_unstale":"2023-11-18T20:41:35.454542+0000","last_undegraded":"2023-11-18T20:41:35.454542+0000","last_fullsized":"2023-11-18T20:41:35.454542+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:39.186938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.470640+0000","last_change":"2023-11-18T20:41:35.467793+0000","last_active":"2023-11-18T20:41:35.470640+0000","last_peered":"2023-11-18T20:41:35.470640+0000","last_clean":"2023-11-18T20:41:35.470640+0000","last_became_active":"2023-11-18T20:41:35.467381+0000","last_became_peered":"2023-11-18T20:41:35.467381+0000","last_unstale":"2023-11-18T20:41:35.470640+0000","last_undegraded":"2023-11-18T20:41:35.470640+0000","last_fullsized":"2023-11-18T20:41:35.470640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:35.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441672+0000","last_change":"2023-11-18T20:41:20.098674+0000","last_active":"2023-11-18T20:41:34.441672+0000","last_peered":"2023-11-18T20:41:34.441672+0000","last_clean":"2023-11-18T20:41:34.441672+0000","last_became_active":"2023-11-18T20:41:20.098290+0000","last_became_peered":"2023-11-18T20:41:20.098290+0000","last_unstale":"2023-11-18T20:41:34.441672+0000","last_undegraded":"2023-11-18T20:41:34.441672+0000","last_fullsized":"2023-11-18T20:41:34.441672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:42:52.964496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479240+0000","last_change":"2023-11-18T20:41:35.479490+0000","last_active":"2023-11-18T20:41:36.479240+0000","last_peered":"2023-11-18T20:41:36.479240+0000","last_clean":"2023-11-18T20:41:36.479240+0000","last_became_active":"2023-11-18T20:41:35.479205+0000","last_became_peered":"2023-11-18T20:41:35.479205+0000","last_unstale":"2023-11-18T20:41:36.479240+0000","last_undegraded":"2023-11-18T20:41:36.479240+0000","last_fullsized":"2023-11-18T20:41:36.479240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:01:31.291589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.474028+0000","last_change":"2023-11-18T20:41:20.104041+0000","last_active":"2023-11-18T20:41:35.474028+0000","last_peered":"2023-11-18T20:41:35.474028+0000","last_clean":"2023-11-18T20:41:35.474028+0000","last_became_active":"2023-11-18T20:41:20.103344+0000","last_became_peered":"2023-11-18T20:41:20.103344+0000","last_unstale":"2023-11-18T20:41:35.474028+0000","last_undegraded":"2023-11-18T20:41:35.474028+0000","last_fullsized":"2023-11-18T20:41:35.474028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:56:39.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.476686+0000","last_change":"2023-11-18T20:41:35.489443+0000","last_active":"2023-11-18T20:41:36.476686+0000","last_peered":"2023-11-18T20:41:36.476686+0000","last_clean":"2023-11-18T20:41:36.476686+0000","last_became_active":"2023-11-18T20:41:35.489193+0000","last_became_peered":"2023-11-18T20:41:35.489193+0000","last_unstale":"2023-11-18T20:41:36.476686+0000","last_undegraded":"2023-11-18T20:41:36.476686+0000","last_fullsized":"2023-11-18T20:41:36.476686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:29:31.143027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.469372+0000","last_change":"2023-11-18T20:41:20.112751+0000","last_active":"2023-11-18T20:41:34.469372+0000","last_peered":"2023-11-18T20:41:34.469372+0000","last_clean":"2023-11-18T20:41:34.469372+0000","last_became_active":"2023-11-18T20:41:20.112163+0000","last_became_peered":"2023-11-18T20:41:20.112163+0000","last_unstale":"2023-11-18T20:41:34.469372+0000","last_undegraded":"2023-11-18T20:41:34.469372+0000","last_fullsized":"2023-11-18T20:41:34.469372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:07.262178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.487450+0000","last_change":"2023-11-18T20:41:35.478953+0000","last_active":"2023-11-18T20:41:35.487450+0000","last_peered":"2023-11-18T20:41:35.487450+0000","last_clean":"2023-11-18T20:41:35.487450+0000","last_became_active":"2023-11-18T20:41:35.478674+0000","last_became_peered":"2023-11-18T20:41:35.478674+0000","last_unstale":"2023-11-18T20:41:35.487450+0000","last_undegraded":"2023-11-18T20:41:35.487450+0000","last_fullsized":"2023-11-18T20:41:35.487450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:10:05.627633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467195+0000","last_change":"2023-11-18T20:41:20.113124+0000","last_active":"2023-11-18T20:41:35.467195+0000","last_peered":"2023-11-18T20:41:35.467195+0000","last_clean":"2023-11-18T20:41:35.467195+0000","last_became_active":"2023-11-18T20:41:20.112677+0000","last_became_peered":"2023-11-18T20:41:20.112677+0000","last_unstale":"2023-11-18T20:41:35.467195+0000","last_undegraded":"2023-11-18T20:41:35.467195+0000","last_fullsized":"2023-11-18T20:41:35.467195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:19.506976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477825+0000","last_change":"2023-11-18T20:41:35.477546+0000","last_active":"2023-11-18T20:41:36.477825+0000","last_peered":"2023-11-18T20:41:36.477825+0000","last_clean":"2023-11-18T20:41:36.477825+0000","last_became_active":"2023-11-18T20:41:35.477212+0000","last_became_peered":"2023-11-18T20:41:35.477212+0000","last_unstale":"2023-11-18T20:41:36.477825+0000","last_undegraded":"2023-11-18T20:41:36.477825+0000","last_fullsized":"2023-11-18T20:41:36.477825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:09:40.570173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.450188+0000","last_change":"2023-11-18T20:41:20.110907+0000","last_active":"2023-11-18T20:41:34.450188+0000","last_peered":"2023-11-18T20:41:34.450188+0000","last_clean":"2023-11-18T20:41:34.450188+0000","last_became_active":"2023-11-18T20:41:20.110466+0000","last_became_peered":"2023-11-18T20:41:20.110466+0000","last_unstale":"2023-11-18T20:41:34.450188+0000","last_undegraded":"2023-11-18T20:41:34.450188+0000","last_fullsized":"2023-11-18T20:41:34.450188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:23.776329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.475731+0000","last_change":"2023-11-18T20:41:35.470404+0000","last_active":"2023-11-18T20:41:35.475731+0000","last_peered":"2023-11-18T20:41:35.475731+0000","last_clean":"2023-11-18T20:41:35.475731+0000","last_became_active":"2023-11-18T20:41:35.467157+0000","last_became_peered":"2023-11-18T20:41:35.467157+0000","last_unstale":"2023-11-18T20:41:35.475731+0000","last_undegraded":"2023-11-18T20:41:35.475731+0000","last_fullsized":"2023-11-18T20:41:35.475731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:41.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442860+0000","last_change":"2023-11-18T20:41:20.104532+0000","last_active":"2023-11-18T20:41:34.442860+0000","last_peered":"2023-11-18T20:41:34.442860+0000","last_clean":"2023-11-18T20:41:34.442860+0000","last_became_active":"2023-11-18T20:41:20.104235+0000","last_became_peered":"2023-11-18T20:41:20.104235+0000","last_unstale":"2023-11-18T20:41:34.442860+0000","last_undegraded":"2023-11-18T20:41:34.442860+0000","last_fullsized":"2023-11-18T20:41:34.442860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:09:19.926012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.496851+0000","last_change":"2023-11-18T20:41:35.487372+0000","last_active":"2023-11-18T20:41:35.496851+0000","last_peered":"2023-11-18T20:41:35.496851+0000","last_clean":"2023-11-18T20:41:35.496851+0000","last_became_active":"2023-11-18T20:41:35.487010+0000","last_became_peered":"2023-11-18T20:41:35.487010+0000","last_unstale":"2023-11-18T20:41:35.496851+0000","last_undegraded":"2023-11-18T20:41:35.496851+0000","last_fullsized":"2023-11-18T20:41:35.496851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:20.944116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.455657+0000","last_change":"2023-11-18T20:41:20.115645+0000","last_active":"2023-11-18T20:41:35.455657+0000","last_peered":"2023-11-18T20:41:35.455657+0000","last_clean":"2023-11-18T20:41:35.455657+0000","last_became_active":"2023-11-18T20:41:20.115236+0000","last_became_peered":"2023-11-18T20:41:20.115236+0000","last_unstale":"2023-11-18T20:41:35.455657+0000","last_undegraded":"2023-11-18T20:41:35.455657+0000","last_fullsized":"2023-11-18T20:41:35.455657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:38.518205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488892+0000","last_change":"2023-11-18T20:41:35.485723+0000","last_active":"2023-11-18T20:41:35.488892+0000","last_peered":"2023-11-18T20:41:35.488892+0000","last_clean":"2023-11-18T20:41:35.488892+0000","last_became_active":"2023-11-18T20:41:35.485282+0000","last_became_peered":"2023-11-18T20:41:35.485282+0000","last_unstale":"2023-11-18T20:41:35.488892+0000","last_undegraded":"2023-11-18T20:41:35.488892+0000","last_fullsized":"2023-11-18T20:41:35.488892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:26.268599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474829+0000","last_change":"2023-11-18T20:41:20.113295+0000","last_active":"2023-11-18T20:41:34.474829+0000","last_peered":"2023-11-18T20:41:34.474829+0000","last_clean":"2023-11-18T20:41:34.474829+0000","last_became_active":"2023-11-18T20:41:20.112041+0000","last_became_peered":"2023-11-18T20:41:20.112041+0000","last_unstale":"2023-11-18T20:41:34.474829+0000","last_undegraded":"2023-11-18T20:41:34.474829+0000","last_fullsized":"2023-11-18T20:41:34.474829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:16.917978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.482748+0000","last_change":"2023-11-18T20:41:35.470167+0000","last_active":"2023-11-18T20:41:36.482748+0000","last_peered":"2023-11-18T20:41:36.482748+0000","last_clean":"2023-11-18T20:41:36.482748+0000","last_became_active":"2023-11-18T20:41:35.469725+0000","last_became_peered":"2023-11-18T20:41:35.469725+0000","last_unstale":"2023-11-18T20:41:36.482748+0000","last_undegraded":"2023-11-18T20:41:36.482748+0000","last_fullsized":"2023-11-18T20:41:36.482748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:04.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474569+0000","last_change":"2023-11-18T20:41:20.116700+0000","last_active":"2023-11-18T20:41:34.474569+0000","last_peered":"2023-11-18T20:41:34.474569+0000","last_clean":"2023-11-18T20:41:34.474569+0000","last_became_active":"2023-11-18T20:41:20.112782+0000","last_became_peered":"2023-11-18T20:41:20.112782+0000","last_unstale":"2023-11-18T20:41:34.474569+0000","last_undegraded":"2023-11-18T20:41:34.474569+0000","last_fullsized":"2023-11-18T20:41:34.474569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:12.856780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479437+0000","last_change":"2023-11-18T20:41:35.483996+0000","last_active":"2023-11-18T20:41:36.479437+0000","last_peered":"2023-11-18T20:41:36.479437+0000","last_clean":"2023-11-18T20:41:36.479437+0000","last_became_active":"2023-11-18T20:41:35.482754+0000","last_became_peered":"2023-11-18T20:41:35.482754+0000","last_unstale":"2023-11-18T20:41:36.479437+0000","last_undegraded":"2023-11-18T20:41:36.479437+0000","last_fullsized":"2023-11-18T20:41:36.479437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:53:20.381092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.465135+0000","last_change":"2023-11-18T20:41:20.117339+0000","last_active":"2023-11-18T20:41:34.465135+0000","last_peered":"2023-11-18T20:41:34.465135+0000","last_clean":"2023-11-18T20:41:34.465135+0000","last_became_active":"2023-11-18T20:41:20.115272+0000","last_became_peered":"2023-11-18T20:41:20.115272+0000","last_unstale":"2023-11-18T20:41:34.465135+0000","last_undegraded":"2023-11-18T20:41:34.465135+0000","last_fullsized":"2023-11-18T20:41:34.465135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:26.942016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.476547+0000","last_change":"2023-11-18T20:41:35.474365+0000","last_active":"2023-11-18T20:41:35.476547+0000","last_peered":"2023-11-18T20:41:35.476547+0000","last_clean":"2023-11-18T20:41:35.476547+0000","last_became_active":"2023-11-18T20:41:35.474065+0000","last_became_peered":"2023-11-18T20:41:35.474065+0000","last_unstale":"2023-11-18T20:41:35.476547+0000","last_undegraded":"2023-11-18T20:41:35.476547+0000","last_fullsized":"2023-11-18T20:41:35.476547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:15.720731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.469467+0000","last_change":"2023-11-18T20:41:20.102268+0000","last_active":"2023-11-18T20:41:34.469467+0000","last_peered":"2023-11-18T20:41:34.469467+0000","last_clean":"2023-11-18T20:41:34.469467+0000","last_became_active":"2023-11-18T20:41:20.101961+0000","last_became_peered":"2023-11-18T20:41:20.101961+0000","last_unstale":"2023-11-18T20:41:34.469467+0000","last_undegraded":"2023-11-18T20:41:34.469467+0000","last_fullsized":"2023-11-18T20:41:34.469467+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:20.621597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478958+0000","last_change":"2023-11-18T20:41:35.479661+0000","last_active":"2023-11-18T20:41:36.478958+0000","last_peered":"2023-11-18T20:41:36.478958+0000","last_clean":"2023-11-18T20:41:36.478958+0000","last_became_active":"2023-11-18T20:41:35.479321+0000","last_became_peered":"2023-11-18T20:41:35.479321+0000","last_unstale":"2023-11-18T20:41:36.478958+0000","last_undegraded":"2023-11-18T20:41:36.478958+0000","last_fullsized":"2023-11-18T20:41:36.478958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:39:49.659639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441479+0000","last_change":"2023-11-18T20:41:20.103507+0000","last_active":"2023-11-18T20:41:34.441479+0000","last_peered":"2023-11-18T20:41:34.441479+0000","last_clean":"2023-11-18T20:41:34.441479+0000","last_became_active":"2023-11-18T20:41:20.103229+0000","last_became_peered":"2023-11-18T20:41:20.103229+0000","last_unstale":"2023-11-18T20:41:34.441479+0000","last_undegraded":"2023-11-18T20:41:34.441479+0000","last_fullsized":"2023-11-18T20:41:34.441479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:18.565605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477400+0000","last_change":"2023-11-18T20:41:35.482739+0000","last_active":"2023-11-18T20:41:36.477400+0000","last_peered":"2023-11-18T20:41:36.477400+0000","last_clean":"2023-11-18T20:41:36.477400+0000","last_became_active":"2023-11-18T20:41:35.482108+0000","last_became_peered":"2023-11-18T20:41:35.482108+0000","last_unstale":"2023-11-18T20:41:36.477400+0000","last_undegraded":"2023-11-18T20:41:36.477400+0000","last_fullsized":"2023-11-18T20:41:36.477400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:44:44.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.455375+0000","last_change":"2023-11-18T20:41:20.091675+0000","last_active":"2023-11-18T20:41:35.455375+0000","last_peered":"2023-11-18T20:41:35.455375+0000","last_clean":"2023-11-18T20:41:35.455375+0000","last_became_active":"2023-11-18T20:41:20.090899+0000","last_became_peered":"2023-11-18T20:41:20.090899+0000","last_unstale":"2023-11-18T20:41:35.455375+0000","last_undegraded":"2023-11-18T20:41:35.455375+0000","last_fullsized":"2023-11-18T20:41:35.455375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:48.975726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.489645+0000","last_change":"2023-11-18T20:41:35.486797+0000","last_active":"2023-11-18T20:41:35.489645+0000","last_peered":"2023-11-18T20:41:35.489645+0000","last_clean":"2023-11-18T20:41:35.489645+0000","last_became_active":"2023-11-18T20:41:35.486050+0000","last_became_peered":"2023-11-18T20:41:35.486050+0000","last_unstale":"2023-11-18T20:41:35.489645+0000","last_undegraded":"2023-11-18T20:41:35.489645+0000","last_fullsized":"2023-11-18T20:41:35.489645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:34.776296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.456720+0000","last_change":"2023-11-18T20:41:20.108207+0000","last_active":"2023-11-18T20:41:35.456720+0000","last_peered":"2023-11-18T20:41:35.456720+0000","last_clean":"2023-11-18T20:41:35.456720+0000","last_became_active":"2023-11-18T20:41:20.107904+0000","last_became_peered":"2023-11-18T20:41:20.107904+0000","last_unstale":"2023-11-18T20:41:35.456720+0000","last_undegraded":"2023-11-18T20:41:35.456720+0000","last_fullsized":"2023-11-18T20:41:35.456720+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:51:46.638757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485388+0000","last_change":"2023-11-18T20:41:35.477889+0000","last_active":"2023-11-18T20:41:35.485388+0000","last_peered":"2023-11-18T20:41:35.485388+0000","last_clean":"2023-11-18T20:41:35.485388+0000","last_became_active":"2023-11-18T20:41:35.477620+0000","last_became_peered":"2023-11-18T20:41:35.477620+0000","last_unstale":"2023-11-18T20:41:35.485388+0000","last_undegraded":"2023-11-18T20:41:35.485388+0000","last_fullsized":"2023-11-18T20:41:35.485388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:44.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.472888+0000","last_change":"2023-11-18T20:41:20.113713+0000","last_active":"2023-11-18T20:41:35.472888+0000","last_peered":"2023-11-18T20:41:35.472888+0000","last_clean":"2023-11-18T20:41:35.472888+0000","last_became_active":"2023-11-18T20:41:20.110227+0000","last_became_peered":"2023-11-18T20:41:20.110227+0000","last_unstale":"2023-11-18T20:41:35.472888+0000","last_undegraded":"2023-11-18T20:41:35.472888+0000","last_fullsized":"2023-11-18T20:41:35.472888+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:59.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.479305+0000","last_change":"2023-11-18T20:41:35.476066+0000","last_active":"2023-11-18T20:41:35.479305+0000","last_peered":"2023-11-18T20:41:35.479305+0000","last_clean":"2023-11-18T20:41:35.479305+0000","last_became_active":"2023-11-18T20:41:35.475734+0000","last_became_peered":"2023-11-18T20:41:35.475734+0000","last_unstale":"2023-11-18T20:41:35.479305+0000","last_undegraded":"2023-11-18T20:41:35.479305+0000","last_fullsized":"2023-11-18T20:41:35.479305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:15.887758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.478826+0000","last_change":"2023-11-18T20:41:20.112885+0000","last_active":"2023-11-18T20:41:35.478826+0000","last_peered":"2023-11-18T20:41:35.478826+0000","last_clean":"2023-11-18T20:41:35.478826+0000","last_became_active":"2023-11-18T20:41:20.112261+0000","last_became_peered":"2023-11-18T20:41:20.112261+0000","last_unstale":"2023-11-18T20:41:35.478826+0000","last_undegraded":"2023-11-18T20:41:35.478826+0000","last_fullsized":"2023-11-18T20:41:35.478826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:41.942790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488113+0000","last_change":"2023-11-18T20:41:35.484598+0000","last_active":"2023-11-18T20:41:35.488113+0000","last_peered":"2023-11-18T20:41:35.488113+0000","last_clean":"2023-11-18T20:41:35.488113+0000","last_became_active":"2023-11-18T20:41:35.484246+0000","last_became_peered":"2023-11-18T20:41:35.484246+0000","last_unstale":"2023-11-18T20:41:35.488113+0000","last_undegraded":"2023-11-18T20:41:35.488113+0000","last_fullsized":"2023-11-18T20:41:35.488113+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:48:15.782133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455458+0000","last_change":"2023-11-18T20:41:20.111059+0000","last_active":"2023-11-18T20:41:34.455458+0000","last_peered":"2023-11-18T20:41:34.455458+0000","last_clean":"2023-11-18T20:41:34.455458+0000","last_became_active":"2023-11-18T20:41:20.110792+0000","last_became_peered":"2023-11-18T20:41:20.110792+0000","last_unstale":"2023-11-18T20:41:34.455458+0000","last_undegraded":"2023-11-18T20:41:34.455458+0000","last_fullsized":"2023-11-18T20:41:34.455458+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:00.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479347+0000","last_change":"2023-11-18T20:41:35.473992+0000","last_active":"2023-11-18T20:41:36.479347+0000","last_peered":"2023-11-18T20:41:36.479347+0000","last_clean":"2023-11-18T20:41:36.479347+0000","last_became_active":"2023-11-18T20:41:35.473675+0000","last_became_peered":"2023-11-18T20:41:35.473675+0000","last_unstale":"2023-11-18T20:41:36.479347+0000","last_undegraded":"2023-11-18T20:41:36.479347+0000","last_fullsized":"2023-11-18T20:41:36.479347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:33:47.509189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.465233+0000","last_change":"2023-11-18T20:41:20.111828+0000","last_active":"2023-11-18T20:41:34.465233+0000","last_peered":"2023-11-18T20:41:34.465233+0000","last_clean":"2023-11-18T20:41:34.465233+0000","last_became_active":"2023-11-18T20:41:20.110560+0000","last_became_peered":"2023-11-18T20:41:20.110560+0000","last_unstale":"2023-11-18T20:41:34.465233+0000","last_undegraded":"2023-11-18T20:41:34.465233+0000","last_fullsized":"2023-11-18T20:41:34.465233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:00.507967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478568+0000","last_change":"2023-11-18T20:41:35.475985+0000","last_active":"2023-11-18T20:41:36.478568+0000","last_peered":"2023-11-18T20:41:36.478568+0000","last_clean":"2023-11-18T20:41:36.478568+0000","last_became_active":"2023-11-18T20:41:35.475367+0000","last_became_peered":"2023-11-18T20:41:35.475367+0000","last_unstale":"2023-11-18T20:41:36.478568+0000","last_undegraded":"2023-11-18T20:41:36.478568+0000","last_fullsized":"2023-11-18T20:41:36.478568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:05:00.712942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.469583+0000","last_change":"2023-11-18T20:41:20.112929+0000","last_active":"2023-11-18T20:41:34.469583+0000","last_peered":"2023-11-18T20:41:34.469583+0000","last_clean":"2023-11-18T20:41:34.469583+0000","last_became_active":"2023-11-18T20:41:20.112458+0000","last_became_peered":"2023-11-18T20:41:20.112458+0000","last_unstale":"2023-11-18T20:41:34.469583+0000","last_undegraded":"2023-11-18T20:41:34.469583+0000","last_fullsized":"2023-11-18T20:41:34.469583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:07:39.968375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.484293+0000","last_change":"2023-11-18T20:41:35.473813+0000","last_active":"2023-11-18T20:41:35.484293+0000","last_peered":"2023-11-18T20:41:35.484293+0000","last_clean":"2023-11-18T20:41:35.484293+0000","last_became_active":"2023-11-18T20:41:35.473509+0000","last_became_peered":"2023-11-18T20:41:35.473509+0000","last_unstale":"2023-11-18T20:41:35.484293+0000","last_undegraded":"2023-11-18T20:41:35.484293+0000","last_fullsized":"2023-11-18T20:41:35.484293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:26:56.112575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455024+0000","last_change":"2023-11-18T20:41:20.112777+0000","last_active":"2023-11-18T20:41:34.455024+0000","last_peered":"2023-11-18T20:41:34.455024+0000","last_clean":"2023-11-18T20:41:34.455024+0000","last_became_active":"2023-11-18T20:41:20.112503+0000","last_became_peered":"2023-11-18T20:41:20.112503+0000","last_unstale":"2023-11-18T20:41:34.455024+0000","last_undegraded":"2023-11-18T20:41:34.455024+0000","last_fullsized":"2023-11-18T20:41:34.455024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:06.680384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.489229+0000","last_change":"2023-11-18T20:41:35.485663+0000","last_active":"2023-11-18T20:41:35.489229+0000","last_peered":"2023-11-18T20:41:35.489229+0000","last_clean":"2023-11-18T20:41:35.489229+0000","last_became_active":"2023-11-18T20:41:35.484301+0000","last_became_peered":"2023-11-18T20:41:35.484301+0000","last_unstale":"2023-11-18T20:41:35.489229+0000","last_undegraded":"2023-11-18T20:41:35.489229+0000","last_fullsized":"2023-11-18T20:41:35.489229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:37:21.691067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.450275+0000","last_change":"2023-11-18T20:41:20.110729+0000","last_active":"2023-11-18T20:41:34.450275+0000","last_peered":"2023-11-18T20:41:34.450275+0000","last_clean":"2023-11-18T20:41:34.450275+0000","last_became_active":"2023-11-18T20:41:20.110065+0000","last_became_peered":"2023-11-18T20:41:20.110065+0000","last_unstale":"2023-11-18T20:41:34.450275+0000","last_undegraded":"2023-11-18T20:41:34.450275+0000","last_fullsized":"2023-11-18T20:41:34.450275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:19:08.144001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478438+0000","last_change":"2023-11-18T20:41:35.472605+0000","last_active":"2023-11-18T20:41:36.478438+0000","last_peered":"2023-11-18T20:41:36.478438+0000","last_clean":"2023-11-18T20:41:36.478438+0000","last_became_active":"2023-11-18T20:41:35.471987+0000","last_became_peered":"2023-11-18T20:41:35.471987+0000","last_unstale":"2023-11-18T20:41:36.478438+0000","last_undegraded":"2023-11-18T20:41:36.478438+0000","last_fullsized":"2023-11-18T20:41:36.478438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:41:29.138639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481596+0000","last_change":"2023-11-18T20:41:34.474217+0000","last_active":"2023-11-18T20:41:36.481596+0000","last_peered":"2023-11-18T20:41:36.481596+0000","last_clean":"2023-11-18T20:41:36.481596+0000","last_became_active":"2023-11-18T20:41:34.473723+0000","last_became_peered":"2023-11-18T20:41:34.473723+0000","last_unstale":"2023-11-18T20:41:36.481596+0000","last_undegraded":"2023-11-18T20:41:36.481596+0000","last_fullsized":"2023-11-18T20:41:36.481596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:02:14.873070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441766+0000","last_change":"2023-11-18T20:41:20.119005+0000","last_active":"2023-11-18T20:41:34.441766+0000","last_peered":"2023-11-18T20:41:34.441766+0000","last_clean":"2023-11-18T20:41:34.441766+0000","last_became_active":"2023-11-18T20:41:20.117330+0000","last_became_peered":"2023-11-18T20:41:20.117330+0000","last_unstale":"2023-11-18T20:41:34.441766+0000","last_undegraded":"2023-11-18T20:41:34.441766+0000","last_fullsized":"2023-11-18T20:41:34.441766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:06.680384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"75'4","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.474366+0000","last_change":"2023-11-18T20:41:19.079310+0000","last_active":"2023-11-18T20:41:35.474366+0000","last_peered":"2023-11-18T20:41:35.474366+0000","last_clean":"2023-11-18T20:41:35.474366+0000","last_became_active":"2023-11-18T20:41:19.078074+0000","last_became_peered":"2023-11-18T20:41:19.078074+0000","last_unstale":"2023-11-18T20:41:35.474366+0000","last_undegraded":"2023-11-18T20:41:35.474366+0000","last_fullsized":"2023-11-18T20:41:35.474366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:52.898832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.490156+0000","last_change":"2023-11-18T20:41:35.484239+0000","last_active":"2023-11-18T20:41:35.490156+0000","last_peered":"2023-11-18T20:41:35.490156+0000","last_clean":"2023-11-18T20:41:35.490156+0000","last_became_active":"2023-11-18T20:41:35.483717+0000","last_became_peered":"2023-11-18T20:41:35.483717+0000","last_unstale":"2023-11-18T20:41:35.490156+0000","last_undegraded":"2023-11-18T20:41:35.490156+0000","last_fullsized":"2023-11-18T20:41:35.490156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:42.321807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.480029+0000","last_change":"2023-11-18T20:41:34.468941+0000","last_active":"2023-11-18T20:41:36.480029+0000","last_peered":"2023-11-18T20:41:36.480029+0000","last_clean":"2023-11-18T20:41:36.480029+0000","last_became_active":"2023-11-18T20:41:34.467226+0000","last_became_peered":"2023-11-18T20:41:34.467226+0000","last_unstale":"2023-11-18T20:41:36.480029+0000","last_undegraded":"2023-11-18T20:41:36.480029+0000","last_fullsized":"2023-11-18T20:41:36.480029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:33:07.510930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456443+0000","last_change":"2023-11-18T20:41:20.117940+0000","last_active":"2023-11-18T20:41:34.456443+0000","last_peered":"2023-11-18T20:41:34.456443+0000","last_clean":"2023-11-18T20:41:34.456443+0000","last_became_active":"2023-11-18T20:41:20.117297+0000","last_became_peered":"2023-11-18T20:41:20.117297+0000","last_unstale":"2023-11-18T20:41:34.456443+0000","last_undegraded":"2023-11-18T20:41:34.456443+0000","last_fullsized":"2023-11-18T20:41:34.456443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:50.247842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"75'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458507+0000","last_change":"2023-11-18T20:41:19.093632+0000","last_active":"2023-11-18T20:41:34.458507+0000","last_peered":"2023-11-18T20:41:34.458507+0000","last_clean":"2023-11-18T20:41:34.458507+0000","last_became_active":"2023-11-18T20:41:19.093359+0000","last_became_peered":"2023-11-18T20:41:19.093359+0000","last_unstale":"2023-11-18T20:41:34.458507+0000","last_undegraded":"2023-11-18T20:41:34.458507+0000","last_fullsized":"2023-11-18T20:41:34.458507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:17.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.477084+0000","last_change":"2023-11-18T20:41:35.471234+0000","last_active":"2023-11-18T20:41:35.477084+0000","last_peered":"2023-11-18T20:41:35.477084+0000","last_clean":"2023-11-18T20:41:35.477084+0000","last_became_active":"2023-11-18T20:41:35.470948+0000","last_became_peered":"2023-11-18T20:41:35.470948+0000","last_unstale":"2023-11-18T20:41:35.477084+0000","last_undegraded":"2023-11-18T20:41:35.477084+0000","last_fullsized":"2023-11-18T20:41:35.477084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:06.597982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"79'4","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.498550+0000","last_change":"2023-11-18T20:41:34.479995+0000","last_active":"2023-11-18T20:41:35.498550+0000","last_peered":"2023-11-18T20:41:35.498550+0000","last_clean":"2023-11-18T20:41:35.498550+0000","last_became_active":"2023-11-18T20:41:34.479750+0000","last_became_peered":"2023-11-18T20:41:34.479750+0000","last_unstale":"2023-11-18T20:41:35.498550+0000","last_undegraded":"2023-11-18T20:41:35.498550+0000","last_fullsized":"2023-11-18T20:41:35.498550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:36.536690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441755+0000","last_change":"2023-11-18T20:41:20.106958+0000","last_active":"2023-11-18T20:41:34.441755+0000","last_peered":"2023-11-18T20:41:34.441755+0000","last_clean":"2023-11-18T20:41:34.441755+0000","last_became_active":"2023-11-18T20:41:20.106528+0000","last_became_peered":"2023-11-18T20:41:20.106528+0000","last_unstale":"2023-11-18T20:41:34.441755+0000","last_undegraded":"2023-11-18T20:41:34.441755+0000","last_fullsized":"2023-11-18T20:41:34.441755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:05.564325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.454652+0000","last_change":"2023-11-18T20:41:19.081952+0000","last_active":"2023-11-18T20:41:35.454652+0000","last_peered":"2023-11-18T20:41:35.454652+0000","last_clean":"2023-11-18T20:41:35.454652+0000","last_became_active":"2023-11-18T20:41:19.081212+0000","last_became_peered":"2023-11-18T20:41:19.081212+0000","last_unstale":"2023-11-18T20:41:35.454652+0000","last_undegraded":"2023-11-18T20:41:35.454652+0000","last_fullsized":"2023-11-18T20:41:35.454652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:05.630660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488079+0000","last_change":"2023-11-18T20:41:35.484780+0000","last_active":"2023-11-18T20:41:35.488079+0000","last_peered":"2023-11-18T20:41:35.488079+0000","last_clean":"2023-11-18T20:41:35.488079+0000","last_became_active":"2023-11-18T20:41:35.484420+0000","last_became_peered":"2023-11-18T20:41:35.484420+0000","last_unstale":"2023-11-18T20:41:35.488079+0000","last_undegraded":"2023-11-18T20:41:35.488079+0000","last_fullsized":"2023-11-18T20:41:35.488079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:44.343724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478125+0000","last_change":"2023-11-18T20:41:34.474939+0000","last_active":"2023-11-18T20:41:36.478125+0000","last_peered":"2023-11-18T20:41:36.478125+0000","last_clean":"2023-11-18T20:41:36.478125+0000","last_became_active":"2023-11-18T20:41:34.474665+0000","last_became_peered":"2023-11-18T20:41:34.474665+0000","last_unstale":"2023-11-18T20:41:36.478125+0000","last_undegraded":"2023-11-18T20:41:36.478125+0000","last_fullsized":"2023-11-18T20:41:36.478125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:46.194568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.457635+0000","last_change":"2023-11-18T20:41:20.113390+0000","last_active":"2023-11-18T20:41:34.457635+0000","last_peered":"2023-11-18T20:41:34.457635+0000","last_clean":"2023-11-18T20:41:34.457635+0000","last_became_active":"2023-11-18T20:41:20.112062+0000","last_became_peered":"2023-11-18T20:41:20.112062+0000","last_unstale":"2023-11-18T20:41:34.457635+0000","last_undegraded":"2023-11-18T20:41:34.457635+0000","last_fullsized":"2023-11-18T20:41:34.457635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:23.768744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467432+0000","last_change":"2023-11-18T20:41:19.086892+0000","last_active":"2023-11-18T20:41:34.467432+0000","last_peered":"2023-11-18T20:41:34.467432+0000","last_clean":"2023-11-18T20:41:34.467432+0000","last_became_active":"2023-11-18T20:41:19.086603+0000","last_became_peered":"2023-11-18T20:41:19.086603+0000","last_unstale":"2023-11-18T20:41:34.467432+0000","last_undegraded":"2023-11-18T20:41:34.467432+0000","last_fullsized":"2023-11-18T20:41:34.467432+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:28.062703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.484787+0000","last_change":"2023-11-18T20:41:35.475475+0000","last_active":"2023-11-18T20:41:35.484787+0000","last_peered":"2023-11-18T20:41:35.484787+0000","last_clean":"2023-11-18T20:41:35.484787+0000","last_became_active":"2023-11-18T20:41:35.474704+0000","last_became_peered":"2023-11-18T20:41:35.474704+0000","last_unstale":"2023-11-18T20:41:35.484787+0000","last_undegraded":"2023-11-18T20:41:35.484787+0000","last_fullsized":"2023-11-18T20:41:35.484787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:34.886767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477163+0000","last_change":"2023-11-18T20:41:34.468744+0000","last_active":"2023-11-18T20:41:36.477163+0000","last_peered":"2023-11-18T20:41:36.477163+0000","last_clean":"2023-11-18T20:41:36.477163+0000","last_became_active":"2023-11-18T20:41:34.468184+0000","last_became_peered":"2023-11-18T20:41:34.468184+0000","last_unstale":"2023-11-18T20:41:36.477163+0000","last_undegraded":"2023-11-18T20:41:36.477163+0000","last_fullsized":"2023-11-18T20:41:36.477163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:15:37.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.465800+0000","last_change":"2023-11-18T20:41:20.108036+0000","last_active":"2023-11-18T20:41:34.465800+0000","last_peered":"2023-11-18T20:41:34.465800+0000","last_clean":"2023-11-18T20:41:34.465800+0000","last_became_active":"2023-11-18T20:41:20.107708+0000","last_became_peered":"2023-11-18T20:41:20.107708+0000","last_unstale":"2023-11-18T20:41:34.465800+0000","last_undegraded":"2023-11-18T20:41:34.465800+0000","last_fullsized":"2023-11-18T20:41:34.465800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:01.604211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"75'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442611+0000","last_change":"2023-11-18T20:41:19.076738+0000","last_active":"2023-11-18T20:41:34.442611+0000","last_peered":"2023-11-18T20:41:34.442611+0000","last_clean":"2023-11-18T20:41:34.442611+0000","last_became_active":"2023-11-18T20:41:19.076471+0000","last_became_peered":"2023-11-18T20:41:19.076471+0000","last_unstale":"2023-11-18T20:41:34.442611+0000","last_undegraded":"2023-11-18T20:41:34.442611+0000","last_fullsized":"2023-11-18T20:41:34.442611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:10.091348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.494442+0000","last_change":"2023-11-18T20:41:35.484427+0000","last_active":"2023-11-18T20:41:35.494442+0000","last_peered":"2023-11-18T20:41:35.494442+0000","last_clean":"2023-11-18T20:41:35.494442+0000","last_became_active":"2023-11-18T20:41:35.484175+0000","last_became_peered":"2023-11-18T20:41:35.484175+0000","last_unstale":"2023-11-18T20:41:35.494442+0000","last_undegraded":"2023-11-18T20:41:35.494442+0000","last_fullsized":"2023-11-18T20:41:35.494442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:19:23.523792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.453741+0000","last_change":"2023-11-18T20:41:34.474022+0000","last_active":"2023-11-18T20:41:35.453741+0000","last_peered":"2023-11-18T20:41:35.453741+0000","last_clean":"2023-11-18T20:41:35.453741+0000","last_became_active":"2023-11-18T20:41:34.472473+0000","last_became_peered":"2023-11-18T20:41:34.472473+0000","last_unstale":"2023-11-18T20:41:35.453741+0000","last_undegraded":"2023-11-18T20:41:35.453741+0000","last_fullsized":"2023-11-18T20:41:35.453741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:39.212320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456783+0000","last_change":"2023-11-18T20:41:20.109360+0000","last_active":"2023-11-18T20:41:34.456783+0000","last_peered":"2023-11-18T20:41:34.456783+0000","last_clean":"2023-11-18T20:41:34.456783+0000","last_became_active":"2023-11-18T20:41:20.108559+0000","last_became_peered":"2023-11-18T20:41:20.108559+0000","last_unstale":"2023-11-18T20:41:34.456783+0000","last_undegraded":"2023-11-18T20:41:34.456783+0000","last_fullsized":"2023-11-18T20:41:34.456783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:03.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"75'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455342+0000","last_change":"2023-11-18T20:41:19.089704+0000","last_active":"2023-11-18T20:41:34.455342+0000","last_peered":"2023-11-18T20:41:34.455342+0000","last_clean":"2023-11-18T20:41:34.455342+0000","last_became_active":"2023-11-18T20:41:19.089474+0000","last_became_peered":"2023-11-18T20:41:19.089474+0000","last_unstale":"2023-11-18T20:41:34.455342+0000","last_undegraded":"2023-11-18T20:41:34.455342+0000","last_fullsized":"2023-11-18T20:41:34.455342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:42.131164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.494702+0000","last_change":"2023-11-18T20:41:35.491328+0000","last_active":"2023-11-18T20:41:35.494702+0000","last_peered":"2023-11-18T20:41:35.494702+0000","last_clean":"2023-11-18T20:41:35.494702+0000","last_became_active":"2023-11-18T20:41:35.488557+0000","last_became_peered":"2023-11-18T20:41:35.488557+0000","last_unstale":"2023-11-18T20:41:35.494702+0000","last_undegraded":"2023-11-18T20:41:35.494702+0000","last_fullsized":"2023-11-18T20:41:35.494702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:33.945396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478051+0000","last_change":"2023-11-18T20:41:34.462822+0000","last_active":"2023-11-18T20:41:36.478051+0000","last_peered":"2023-11-18T20:41:36.478051+0000","last_clean":"2023-11-18T20:41:36.478051+0000","last_became_active":"2023-11-18T20:41:34.462510+0000","last_became_peered":"2023-11-18T20:41:34.462510+0000","last_unstale":"2023-11-18T20:41:36.478051+0000","last_undegraded":"2023-11-18T20:41:36.478051+0000","last_fullsized":"2023-11-18T20:41:36.478051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:35.677808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.454664+0000","last_change":"2023-11-18T20:41:20.114441+0000","last_active":"2023-11-18T20:41:34.454664+0000","last_peered":"2023-11-18T20:41:34.454664+0000","last_clean":"2023-11-18T20:41:34.454664+0000","last_became_active":"2023-11-18T20:41:20.113948+0000","last_became_peered":"2023-11-18T20:41:20.113948+0000","last_unstale":"2023-11-18T20:41:34.454664+0000","last_undegraded":"2023-11-18T20:41:34.454664+0000","last_fullsized":"2023-11-18T20:41:34.454664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:07:39.968375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474311+0000","last_change":"2023-11-18T20:41:19.088925+0000","last_active":"2023-11-18T20:41:34.474311+0000","last_peered":"2023-11-18T20:41:34.474311+0000","last_clean":"2023-11-18T20:41:34.474311+0000","last_became_active":"2023-11-18T20:41:19.088630+0000","last_became_peered":"2023-11-18T20:41:19.088630+0000","last_unstale":"2023-11-18T20:41:34.474311+0000","last_undegraded":"2023-11-18T20:41:34.474311+0000","last_fullsized":"2023-11-18T20:41:34.474311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:03:59.906289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478282+0000","last_change":"2023-11-18T20:41:35.495727+0000","last_active":"2023-11-18T20:41:36.478282+0000","last_peered":"2023-11-18T20:41:36.478282+0000","last_clean":"2023-11-18T20:41:36.478282+0000","last_became_active":"2023-11-18T20:41:35.495446+0000","last_became_peered":"2023-11-18T20:41:35.495446+0000","last_unstale":"2023-11-18T20:41:36.478282+0000","last_undegraded":"2023-11-18T20:41:36.478282+0000","last_fullsized":"2023-11-18T20:41:36.478282+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:01:10.966302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.482327+0000","last_change":"2023-11-18T20:41:34.471515+0000","last_active":"2023-11-18T20:41:36.482327+0000","last_peered":"2023-11-18T20:41:36.482327+0000","last_clean":"2023-11-18T20:41:36.482327+0000","last_became_active":"2023-11-18T20:41:34.471192+0000","last_became_peered":"2023-11-18T20:41:34.471192+0000","last_unstale":"2023-11-18T20:41:36.482327+0000","last_undegraded":"2023-11-18T20:41:36.482327+0000","last_fullsized":"2023-11-18T20:41:36.482327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:47:31.954044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.469347+0000","last_change":"2023-11-18T20:41:20.110933+0000","last_active":"2023-11-18T20:41:34.469347+0000","last_peered":"2023-11-18T20:41:34.469347+0000","last_clean":"2023-11-18T20:41:34.469347+0000","last_became_active":"2023-11-18T20:41:20.110639+0000","last_became_peered":"2023-11-18T20:41:20.110639+0000","last_unstale":"2023-11-18T20:41:34.469347+0000","last_undegraded":"2023-11-18T20:41:34.469347+0000","last_fullsized":"2023-11-18T20:41:34.469347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:36.140134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467776+0000","last_change":"2023-11-18T20:41:19.089119+0000","last_active":"2023-11-18T20:41:34.467776+0000","last_peered":"2023-11-18T20:41:34.467776+0000","last_clean":"2023-11-18T20:41:34.467776+0000","last_became_active":"2023-11-18T20:41:19.088734+0000","last_became_peered":"2023-11-18T20:41:19.088734+0000","last_unstale":"2023-11-18T20:41:34.467776+0000","last_undegraded":"2023-11-18T20:41:34.467776+0000","last_fullsized":"2023-11-18T20:41:34.467776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:30:53.467562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477607+0000","last_change":"2023-11-18T20:41:35.491018+0000","last_active":"2023-11-18T20:41:36.477607+0000","last_peered":"2023-11-18T20:41:36.477607+0000","last_clean":"2023-11-18T20:41:36.477607+0000","last_became_active":"2023-11-18T20:41:35.490542+0000","last_became_peered":"2023-11-18T20:41:35.490542+0000","last_unstale":"2023-11-18T20:41:36.477607+0000","last_undegraded":"2023-11-18T20:41:36.477607+0000","last_fullsized":"2023-11-18T20:41:36.477607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:14.536499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"79'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478109+0000","last_change":"2023-11-18T20:41:34.464435+0000","last_active":"2023-11-18T20:41:36.478109+0000","last_peered":"2023-11-18T20:41:36.478109+0000","last_clean":"2023-11-18T20:41:36.478109+0000","last_became_active":"2023-11-18T20:41:34.464178+0000","last_became_peered":"2023-11-18T20:41:34.464178+0000","last_unstale":"2023-11-18T20:41:36.478109+0000","last_undegraded":"2023-11-18T20:41:36.478109+0000","last_fullsized":"2023-11-18T20:41:36.478109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:40:09.250947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.475533+0000","last_change":"2023-11-18T20:41:20.109465+0000","last_active":"2023-11-18T20:41:34.475533+0000","last_peered":"2023-11-18T20:41:34.475533+0000","last_clean":"2023-11-18T20:41:34.475533+0000","last_became_active":"2023-11-18T20:41:20.109152+0000","last_became_peered":"2023-11-18T20:41:20.109152+0000","last_unstale":"2023-11-18T20:41:34.475533+0000","last_undegraded":"2023-11-18T20:41:34.475533+0000","last_fullsized":"2023-11-18T20:41:34.475533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:35.394592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456548+0000","last_change":"2023-11-18T20:41:19.082301+0000","last_active":"2023-11-18T20:41:34.456548+0000","last_peered":"2023-11-18T20:41:34.456548+0000","last_clean":"2023-11-18T20:41:34.456548+0000","last_became_active":"2023-11-18T20:41:19.082037+0000","last_became_peered":"2023-11-18T20:41:19.082037+0000","last_unstale":"2023-11-18T20:41:34.456548+0000","last_undegraded":"2023-11-18T20:41:34.456548+0000","last_fullsized":"2023-11-18T20:41:34.456548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:19.616073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485354+0000","last_change":"2023-11-18T20:41:35.478776+0000","last_active":"2023-11-18T20:41:35.485354+0000","last_peered":"2023-11-18T20:41:35.485354+0000","last_clean":"2023-11-18T20:41:35.485354+0000","last_became_active":"2023-11-18T20:41:35.477225+0000","last_became_peered":"2023-11-18T20:41:35.477225+0000","last_unstale":"2023-11-18T20:41:35.485354+0000","last_undegraded":"2023-11-18T20:41:35.485354+0000","last_fullsized":"2023-11-18T20:41:35.485354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:13.320680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"79'6","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.503368+0000","last_change":"2023-11-18T20:41:34.472192+0000","last_active":"2023-11-18T20:41:35.503368+0000","last_peered":"2023-11-18T20:41:35.503368+0000","last_clean":"2023-11-18T20:41:35.503368+0000","last_became_active":"2023-11-18T20:41:34.471867+0000","last_became_peered":"2023-11-18T20:41:34.471867+0000","last_unstale":"2023-11-18T20:41:35.503368+0000","last_undegraded":"2023-11-18T20:41:35.503368+0000","last_fullsized":"2023-11-18T20:41:35.503368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:16.475762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456524+0000","last_change":"2023-11-18T20:41:20.106833+0000","last_active":"2023-11-18T20:41:34.456524+0000","last_peered":"2023-11-18T20:41:34.456524+0000","last_clean":"2023-11-18T20:41:34.456524+0000","last_became_active":"2023-11-18T20:41:20.105983+0000","last_became_peered":"2023-11-18T20:41:20.105983+0000","last_unstale":"2023-11-18T20:41:34.456524+0000","last_undegraded":"2023-11-18T20:41:34.456524+0000","last_fullsized":"2023-11-18T20:41:34.456524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:16:19.506976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458592+0000","last_change":"2023-11-18T20:41:19.080666+0000","last_active":"2023-11-18T20:41:34.458592+0000","last_peered":"2023-11-18T20:41:34.458592+0000","last_clean":"2023-11-18T20:41:34.458592+0000","last_became_active":"2023-11-18T20:41:19.080383+0000","last_became_peered":"2023-11-18T20:41:19.080383+0000","last_unstale":"2023-11-18T20:41:34.458592+0000","last_undegraded":"2023-11-18T20:41:34.458592+0000","last_fullsized":"2023-11-18T20:41:34.458592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:43.180235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481338+0000","last_change":"2023-11-18T20:41:35.473994+0000","last_active":"2023-11-18T20:41:36.481338+0000","last_peered":"2023-11-18T20:41:36.481338+0000","last_clean":"2023-11-18T20:41:36.481338+0000","last_became_active":"2023-11-18T20:41:35.473710+0000","last_became_peered":"2023-11-18T20:41:35.473710+0000","last_unstale":"2023-11-18T20:41:36.481338+0000","last_undegraded":"2023-11-18T20:41:36.481338+0000","last_fullsized":"2023-11-18T20:41:36.481338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:18:08.947504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481578+0000","last_change":"2023-11-18T20:41:34.468184+0000","last_active":"2023-11-18T20:41:36.481578+0000","last_peered":"2023-11-18T20:41:36.481578+0000","last_clean":"2023-11-18T20:41:36.481578+0000","last_became_active":"2023-11-18T20:41:34.466639+0000","last_became_peered":"2023-11-18T20:41:34.466639+0000","last_unstale":"2023-11-18T20:41:36.481578+0000","last_undegraded":"2023-11-18T20:41:36.481578+0000","last_fullsized":"2023-11-18T20:41:36.481578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:41.307120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449466+0000","last_change":"2023-11-18T20:41:20.108858+0000","last_active":"2023-11-18T20:41:35.449466+0000","last_peered":"2023-11-18T20:41:35.449466+0000","last_clean":"2023-11-18T20:41:35.449466+0000","last_became_active":"2023-11-18T20:41:20.108539+0000","last_became_peered":"2023-11-18T20:41:20.108539+0000","last_unstale":"2023-11-18T20:41:35.449466+0000","last_undegraded":"2023-11-18T20:41:35.449466+0000","last_fullsized":"2023-11-18T20:41:35.449466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:40:48.087061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"75'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.457747+0000","last_change":"2023-11-18T20:41:19.084632+0000","last_active":"2023-11-18T20:41:34.457747+0000","last_peered":"2023-11-18T20:41:34.457747+0000","last_clean":"2023-11-18T20:41:34.457747+0000","last_became_active":"2023-11-18T20:41:19.084201+0000","last_became_peered":"2023-11-18T20:41:19.084201+0000","last_unstale":"2023-11-18T20:41:34.457747+0000","last_undegraded":"2023-11-18T20:41:34.457747+0000","last_fullsized":"2023-11-18T20:41:34.457747+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:35.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485295+0000","last_change":"2023-11-18T20:41:35.477429+0000","last_active":"2023-11-18T20:41:35.485295+0000","last_peered":"2023-11-18T20:41:35.485295+0000","last_clean":"2023-11-18T20:41:35.485295+0000","last_became_active":"2023-11-18T20:41:35.477090+0000","last_became_peered":"2023-11-18T20:41:35.477090+0000","last_unstale":"2023-11-18T20:41:35.485295+0000","last_undegraded":"2023-11-18T20:41:35.485295+0000","last_fullsized":"2023-11-18T20:41:35.485295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:21.267998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.481595+0000","last_change":"2023-11-18T20:41:34.473697+0000","last_active":"2023-11-18T20:41:36.481595+0000","last_peered":"2023-11-18T20:41:36.481595+0000","last_clean":"2023-11-18T20:41:36.481595+0000","last_became_active":"2023-11-18T20:41:34.473363+0000","last_became_peered":"2023-11-18T20:41:34.473363+0000","last_unstale":"2023-11-18T20:41:36.481595+0000","last_undegraded":"2023-11-18T20:41:36.481595+0000","last_fullsized":"2023-11-18T20:41:36.481595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:43:23.213306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.478614+0000","last_change":"2023-11-18T20:41:20.109082+0000","last_active":"2023-11-18T20:41:35.478614+0000","last_peered":"2023-11-18T20:41:35.478614+0000","last_clean":"2023-11-18T20:41:35.478614+0000","last_became_active":"2023-11-18T20:41:20.108734+0000","last_became_peered":"2023-11-18T20:41:20.108734+0000","last_unstale":"2023-11-18T20:41:35.478614+0000","last_undegraded":"2023-11-18T20:41:35.478614+0000","last_fullsized":"2023-11-18T20:41:35.478614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:26:46.701720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"76'9","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441853+0000","last_change":"2023-11-18T20:41:19.080895+0000","last_active":"2023-11-18T20:41:34.441853+0000","last_peered":"2023-11-18T20:41:34.441853+0000","last_clean":"2023-11-18T20:41:34.441853+0000","last_became_active":"2023-11-18T20:41:19.080271+0000","last_became_peered":"2023-11-18T20:41:19.080271+0000","last_unstale":"2023-11-18T20:41:34.441853+0000","last_undegraded":"2023-11-18T20:41:34.441853+0000","last_fullsized":"2023-11-18T20:41:34.441853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:21.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.476897+0000","last_change":"2023-11-18T20:41:35.488644+0000","last_active":"2023-11-18T20:41:36.476897+0000","last_peered":"2023-11-18T20:41:36.476897+0000","last_clean":"2023-11-18T20:41:36.476897+0000","last_became_active":"2023-11-18T20:41:35.483590+0000","last_became_peered":"2023-11-18T20:41:35.483590+0000","last_unstale":"2023-11-18T20:41:36.476897+0000","last_undegraded":"2023-11-18T20:41:36.476897+0000","last_fullsized":"2023-11-18T20:41:36.476897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:53:11.042880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.447810+0000","last_change":"2023-11-18T20:41:34.460680+0000","last_active":"2023-11-18T20:41:35.447810+0000","last_peered":"2023-11-18T20:41:35.447810+0000","last_clean":"2023-11-18T20:41:35.447810+0000","last_became_active":"2023-11-18T20:41:34.459176+0000","last_became_peered":"2023-11-18T20:41:34.459176+0000","last_unstale":"2023-11-18T20:41:35.447810+0000","last_undegraded":"2023-11-18T20:41:35.447810+0000","last_fullsized":"2023-11-18T20:41:35.447810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:12.852751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.451372+0000","last_change":"2023-11-18T20:41:20.097893+0000","last_active":"2023-11-18T20:41:35.451372+0000","last_peered":"2023-11-18T20:41:35.451372+0000","last_clean":"2023-11-18T20:41:35.451372+0000","last_became_active":"2023-11-18T20:41:20.097607+0000","last_became_peered":"2023-11-18T20:41:20.097607+0000","last_unstale":"2023-11-18T20:41:35.451372+0000","last_undegraded":"2023-11-18T20:41:35.451372+0000","last_fullsized":"2023-11-18T20:41:35.451372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:38:34.750195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.465330+0000","last_change":"2023-11-18T20:41:19.087665+0000","last_active":"2023-11-18T20:41:34.465330+0000","last_peered":"2023-11-18T20:41:34.465330+0000","last_clean":"2023-11-18T20:41:34.465330+0000","last_became_active":"2023-11-18T20:41:19.087088+0000","last_became_peered":"2023-11-18T20:41:19.087088+0000","last_unstale":"2023-11-18T20:41:34.465330+0000","last_undegraded":"2023-11-18T20:41:34.465330+0000","last_fullsized":"2023-11-18T20:41:34.465330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:22.770805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479704+0000","last_change":"2023-11-18T20:41:35.481260+0000","last_active":"2023-11-18T20:41:36.479704+0000","last_peered":"2023-11-18T20:41:36.479704+0000","last_clean":"2023-11-18T20:41:36.479704+0000","last_became_active":"2023-11-18T20:41:35.479816+0000","last_became_peered":"2023-11-18T20:41:35.479816+0000","last_unstale":"2023-11-18T20:41:36.479704+0000","last_undegraded":"2023-11-18T20:41:36.479704+0000","last_fullsized":"2023-11-18T20:41:36.479704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:25:11.348254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"79'8","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479124+0000","last_change":"2023-11-18T20:41:34.464590+0000","last_active":"2023-11-18T20:41:36.479124+0000","last_peered":"2023-11-18T20:41:36.479124+0000","last_clean":"2023-11-18T20:41:36.479124+0000","last_became_active":"2023-11-18T20:41:34.464339+0000","last_became_peered":"2023-11-18T20:41:34.464339+0000","last_unstale":"2023-11-18T20:41:36.479124+0000","last_undegraded":"2023-11-18T20:41:36.479124+0000","last_fullsized":"2023-11-18T20:41:36.479124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:49.407916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456617+0000","last_change":"2023-11-18T20:41:20.114816+0000","last_active":"2023-11-18T20:41:34.456617+0000","last_peered":"2023-11-18T20:41:34.456617+0000","last_clean":"2023-11-18T20:41:34.456617+0000","last_became_active":"2023-11-18T20:41:20.114497+0000","last_became_peered":"2023-11-18T20:41:20.114497+0000","last_unstale":"2023-11-18T20:41:34.456617+0000","last_undegraded":"2023-11-18T20:41:34.456617+0000","last_fullsized":"2023-11-18T20:41:34.456617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:01.963195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467693+0000","last_change":"2023-11-18T20:41:19.087895+0000","last_active":"2023-11-18T20:41:35.467693+0000","last_peered":"2023-11-18T20:41:35.467693+0000","last_clean":"2023-11-18T20:41:35.467693+0000","last_became_active":"2023-11-18T20:41:19.086348+0000","last_became_peered":"2023-11-18T20:41:19.086348+0000","last_unstale":"2023-11-18T20:41:35.467693+0000","last_undegraded":"2023-11-18T20:41:35.467693+0000","last_fullsized":"2023-11-18T20:41:35.467693+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:34.389068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478760+0000","last_change":"2023-11-18T20:41:35.483090+0000","last_active":"2023-11-18T20:41:36.478760+0000","last_peered":"2023-11-18T20:41:36.478760+0000","last_clean":"2023-11-18T20:41:36.478760+0000","last_became_active":"2023-11-18T20:41:35.482802+0000","last_became_peered":"2023-11-18T20:41:35.482802+0000","last_unstale":"2023-11-18T20:41:36.478760+0000","last_undegraded":"2023-11-18T20:41:36.478760+0000","last_fullsized":"2023-11-18T20:41:36.478760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:52:21.509816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"79'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.501623+0000","last_change":"2023-11-18T20:41:34.467505+0000","last_active":"2023-11-18T20:41:35.501623+0000","last_peered":"2023-11-18T20:41:35.501623+0000","last_clean":"2023-11-18T20:41:35.501623+0000","last_became_active":"2023-11-18T20:41:34.467243+0000","last_became_peered":"2023-11-18T20:41:34.467243+0000","last_unstale":"2023-11-18T20:41:35.501623+0000","last_undegraded":"2023-11-18T20:41:35.501623+0000","last_fullsized":"2023-11-18T20:41:35.501623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:13.305993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467708+0000","last_change":"2023-11-18T20:41:20.107939+0000","last_active":"2023-11-18T20:41:34.467708+0000","last_peered":"2023-11-18T20:41:34.467708+0000","last_clean":"2023-11-18T20:41:34.467708+0000","last_became_active":"2023-11-18T20:41:20.107496+0000","last_became_peered":"2023-11-18T20:41:20.107496+0000","last_unstale":"2023-11-18T20:41:34.467708+0000","last_undegraded":"2023-11-18T20:41:34.467708+0000","last_fullsized":"2023-11-18T20:41:34.467708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:21:15.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455202+0000","last_change":"2023-11-18T20:41:19.074899+0000","last_active":"2023-11-18T20:41:34.455202+0000","last_peered":"2023-11-18T20:41:34.455202+0000","last_clean":"2023-11-18T20:41:34.455202+0000","last_became_active":"2023-11-18T20:41:19.074605+0000","last_became_peered":"2023-11-18T20:41:19.074605+0000","last_unstale":"2023-11-18T20:41:34.455202+0000","last_undegraded":"2023-11-18T20:41:34.455202+0000","last_fullsized":"2023-11-18T20:41:34.455202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:27.958410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.480030+0000","last_change":"2023-11-18T20:41:35.480991+0000","last_active":"2023-11-18T20:41:36.480030+0000","last_peered":"2023-11-18T20:41:36.480030+0000","last_clean":"2023-11-18T20:41:36.480030+0000","last_became_active":"2023-11-18T20:41:35.480569+0000","last_became_peered":"2023-11-18T20:41:35.480569+0000","last_unstale":"2023-11-18T20:41:36.480030+0000","last_undegraded":"2023-11-18T20:41:36.480030+0000","last_fullsized":"2023-11-18T20:41:36.480030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:34.776296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479110+0000","last_change":"2023-11-18T20:41:34.470626+0000","last_active":"2023-11-18T20:41:36.479110+0000","last_peered":"2023-11-18T20:41:36.479110+0000","last_clean":"2023-11-18T20:41:36.479110+0000","last_became_active":"2023-11-18T20:41:34.470352+0000","last_became_peered":"2023-11-18T20:41:34.470352+0000","last_unstale":"2023-11-18T20:41:36.479110+0000","last_undegraded":"2023-11-18T20:41:36.479110+0000","last_fullsized":"2023-11-18T20:41:36.479110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:33:19.179192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449662+0000","last_change":"2023-11-18T20:41:20.095956+0000","last_active":"2023-11-18T20:41:35.449662+0000","last_peered":"2023-11-18T20:41:35.449662+0000","last_clean":"2023-11-18T20:41:35.449662+0000","last_became_active":"2023-11-18T20:41:20.095673+0000","last_became_peered":"2023-11-18T20:41:20.095673+0000","last_unstale":"2023-11-18T20:41:35.449662+0000","last_undegraded":"2023-11-18T20:41:35.449662+0000","last_fullsized":"2023-11-18T20:41:35.449662+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:37:23.617511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"75'8","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.455499+0000","last_change":"2023-11-18T20:41:19.078210+0000","last_active":"2023-11-18T20:41:35.455499+0000","last_peered":"2023-11-18T20:41:35.455499+0000","last_clean":"2023-11-18T20:41:35.455499+0000","last_became_active":"2023-11-18T20:41:19.077797+0000","last_became_peered":"2023-11-18T20:41:19.077797+0000","last_unstale":"2023-11-18T20:41:35.455499+0000","last_undegraded":"2023-11-18T20:41:35.455499+0000","last_fullsized":"2023-11-18T20:41:35.455499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:05:12.665710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485366+0000","last_change":"2023-11-18T20:41:35.477446+0000","last_active":"2023-11-18T20:41:35.485366+0000","last_peered":"2023-11-18T20:41:35.485366+0000","last_clean":"2023-11-18T20:41:35.485366+0000","last_became_active":"2023-11-18T20:41:35.477117+0000","last_became_peered":"2023-11-18T20:41:35.477117+0000","last_unstale":"2023-11-18T20:41:35.485366+0000","last_undegraded":"2023-11-18T20:41:35.485366+0000","last_fullsized":"2023-11-18T20:41:35.485366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:25:11.348254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477925+0000","last_change":"2023-11-18T20:41:34.466608+0000","last_active":"2023-11-18T20:41:36.477925+0000","last_peered":"2023-11-18T20:41:36.477925+0000","last_clean":"2023-11-18T20:41:36.477925+0000","last_became_active":"2023-11-18T20:41:34.466307+0000","last_became_peered":"2023-11-18T20:41:34.466307+0000","last_unstale":"2023-11-18T20:41:36.477925+0000","last_undegraded":"2023-11-18T20:41:36.477925+0000","last_fullsized":"2023-11-18T20:41:36.477925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:42.370642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442036+0000","last_change":"2023-11-18T20:41:20.112739+0000","last_active":"2023-11-18T20:41:34.442036+0000","last_peered":"2023-11-18T20:41:34.442036+0000","last_clean":"2023-11-18T20:41:34.442036+0000","last_became_active":"2023-11-18T20:41:20.112440+0000","last_became_peered":"2023-11-18T20:41:20.112440+0000","last_unstale":"2023-11-18T20:41:34.442036+0000","last_undegraded":"2023-11-18T20:41:34.442036+0000","last_fullsized":"2023-11-18T20:41:34.442036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:02.110658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.479125+0000","last_change":"2023-11-18T20:41:19.068646+0000","last_active":"2023-11-18T20:41:35.479125+0000","last_peered":"2023-11-18T20:41:35.479125+0000","last_clean":"2023-11-18T20:41:35.479125+0000","last_became_active":"2023-11-18T20:41:19.068382+0000","last_became_peered":"2023-11-18T20:41:19.068382+0000","last_unstale":"2023-11-18T20:41:35.479125+0000","last_undegraded":"2023-11-18T20:41:35.479125+0000","last_fullsized":"2023-11-18T20:41:35.479125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:39.661723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.494759+0000","last_change":"2023-11-18T20:41:35.486441+0000","last_active":"2023-11-18T20:41:35.494759+0000","last_peered":"2023-11-18T20:41:35.494759+0000","last_clean":"2023-11-18T20:41:35.494759+0000","last_became_active":"2023-11-18T20:41:35.486105+0000","last_became_peered":"2023-11-18T20:41:35.486105+0000","last_unstale":"2023-11-18T20:41:35.494759+0000","last_undegraded":"2023-11-18T20:41:35.494759+0000","last_fullsized":"2023-11-18T20:41:35.494759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:09:35.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449918+0000","last_change":"2023-11-18T20:41:34.470265+0000","last_active":"2023-11-18T20:41:35.449918+0000","last_peered":"2023-11-18T20:41:35.449918+0000","last_clean":"2023-11-18T20:41:35.449918+0000","last_became_active":"2023-11-18T20:41:34.467676+0000","last_became_peered":"2023-11-18T20:41:34.467676+0000","last_unstale":"2023-11-18T20:41:35.449918+0000","last_undegraded":"2023-11-18T20:41:35.449918+0000","last_fullsized":"2023-11-18T20:41:35.449918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:27:46.841832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.460867+0000","last_change":"2023-11-18T20:41:20.111835+0000","last_active":"2023-11-18T20:41:34.460867+0000","last_peered":"2023-11-18T20:41:34.460867+0000","last_clean":"2023-11-18T20:41:34.460867+0000","last_became_active":"2023-11-18T20:41:20.111061+0000","last_became_peered":"2023-11-18T20:41:20.111061+0000","last_unstale":"2023-11-18T20:41:34.460867+0000","last_undegraded":"2023-11-18T20:41:34.460867+0000","last_fullsized":"2023-11-18T20:41:34.460867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:26.942016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.475604+0000","last_change":"2023-11-18T20:41:19.092466+0000","last_active":"2023-11-18T20:41:34.475604+0000","last_peered":"2023-11-18T20:41:34.475604+0000","last_clean":"2023-11-18T20:41:34.475604+0000","last_became_active":"2023-11-18T20:41:19.092213+0000","last_became_peered":"2023-11-18T20:41:19.092213+0000","last_unstale":"2023-11-18T20:41:34.475604+0000","last_undegraded":"2023-11-18T20:41:34.475604+0000","last_fullsized":"2023-11-18T20:41:34.475604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:52.157671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488793+0000","last_change":"2023-11-18T20:41:35.480440+0000","last_active":"2023-11-18T20:41:35.488793+0000","last_peered":"2023-11-18T20:41:35.488793+0000","last_clean":"2023-11-18T20:41:35.488793+0000","last_became_active":"2023-11-18T20:41:35.480115+0000","last_became_peered":"2023-11-18T20:41:35.480115+0000","last_unstale":"2023-11-18T20:41:35.488793+0000","last_undegraded":"2023-11-18T20:41:35.488793+0000","last_fullsized":"2023-11-18T20:41:35.488793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:36:16.134469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"79'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.500333+0000","last_change":"2023-11-18T20:41:34.467838+0000","last_active":"2023-11-18T20:41:35.500333+0000","last_peered":"2023-11-18T20:41:35.500333+0000","last_clean":"2023-11-18T20:41:35.500333+0000","last_became_active":"2023-11-18T20:41:34.467528+0000","last_became_peered":"2023-11-18T20:41:34.467528+0000","last_unstale":"2023-11-18T20:41:35.500333+0000","last_undegraded":"2023-11-18T20:41:35.500333+0000","last_fullsized":"2023-11-18T20:41:35.500333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:21.045488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442643+0000","last_change":"2023-11-18T20:41:20.113889+0000","last_active":"2023-11-18T20:41:34.442643+0000","last_peered":"2023-11-18T20:41:34.442643+0000","last_clean":"2023-11-18T20:41:34.442643+0000","last_became_active":"2023-11-18T20:41:20.113461+0000","last_became_peered":"2023-11-18T20:41:20.113461+0000","last_unstale":"2023-11-18T20:41:34.442643+0000","last_undegraded":"2023-11-18T20:41:34.442643+0000","last_fullsized":"2023-11-18T20:41:34.442643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:58.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474661+0000","last_change":"2023-11-18T20:41:19.092541+0000","last_active":"2023-11-18T20:41:34.474661+0000","last_peered":"2023-11-18T20:41:34.474661+0000","last_clean":"2023-11-18T20:41:34.474661+0000","last_became_active":"2023-11-18T20:41:19.092232+0000","last_became_peered":"2023-11-18T20:41:19.092232+0000","last_unstale":"2023-11-18T20:41:34.474661+0000","last_undegraded":"2023-11-18T20:41:34.474661+0000","last_fullsized":"2023-11-18T20:41:34.474661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:06.269774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478179+0000","last_change":"2023-11-18T20:41:35.484101+0000","last_active":"2023-11-18T20:41:36.478179+0000","last_peered":"2023-11-18T20:41:36.478179+0000","last_clean":"2023-11-18T20:41:36.478179+0000","last_became_active":"2023-11-18T20:41:35.483181+0000","last_became_peered":"2023-11-18T20:41:35.483181+0000","last_unstale":"2023-11-18T20:41:36.478179+0000","last_undegraded":"2023-11-18T20:41:36.478179+0000","last_fullsized":"2023-11-18T20:41:36.478179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:43:43.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.458045+0000","last_change":"2023-11-18T20:41:34.469655+0000","last_active":"2023-11-18T20:41:35.458045+0000","last_peered":"2023-11-18T20:41:35.458045+0000","last_clean":"2023-11-18T20:41:35.458045+0000","last_became_active":"2023-11-18T20:41:34.468967+0000","last_became_peered":"2023-11-18T20:41:34.468967+0000","last_unstale":"2023-11-18T20:41:35.458045+0000","last_undegraded":"2023-11-18T20:41:35.458045+0000","last_fullsized":"2023-11-18T20:41:35.458045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:09:15.969315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467593+0000","last_change":"2023-11-18T20:41:20.098020+0000","last_active":"2023-11-18T20:41:35.467593+0000","last_peered":"2023-11-18T20:41:35.467593+0000","last_clean":"2023-11-18T20:41:35.467593+0000","last_became_active":"2023-11-18T20:41:20.097510+0000","last_became_peered":"2023-11-18T20:41:20.097510+0000","last_unstale":"2023-11-18T20:41:35.467593+0000","last_undegraded":"2023-11-18T20:41:35.467593+0000","last_fullsized":"2023-11-18T20:41:35.467593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:23:47.673490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.474079+0000","last_change":"2023-11-18T20:41:19.096453+0000","last_active":"2023-11-18T20:41:34.474079+0000","last_peered":"2023-11-18T20:41:34.474079+0000","last_clean":"2023-11-18T20:41:34.474079+0000","last_became_active":"2023-11-18T20:41:19.096109+0000","last_became_peered":"2023-11-18T20:41:19.096109+0000","last_unstale":"2023-11-18T20:41:34.474079+0000","last_undegraded":"2023-11-18T20:41:34.474079+0000","last_fullsized":"2023-11-18T20:41:34.474079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:51:08.511122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.485645+0000","last_change":"2023-11-18T20:41:35.478602+0000","last_active":"2023-11-18T20:41:35.485645+0000","last_peered":"2023-11-18T20:41:35.485645+0000","last_clean":"2023-11-18T20:41:35.485645+0000","last_became_active":"2023-11-18T20:41:35.477503+0000","last_became_peered":"2023-11-18T20:41:35.477503+0000","last_unstale":"2023-11-18T20:41:35.485645+0000","last_undegraded":"2023-11-18T20:41:35.485645+0000","last_fullsized":"2023-11-18T20:41:35.485645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:27:47.856519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.476953+0000","last_change":"2023-11-18T20:41:34.469314+0000","last_active":"2023-11-18T20:41:36.476953+0000","last_peered":"2023-11-18T20:41:36.476953+0000","last_clean":"2023-11-18T20:41:36.476953+0000","last_became_active":"2023-11-18T20:41:34.468435+0000","last_became_peered":"2023-11-18T20:41:34.468435+0000","last_unstale":"2023-11-18T20:41:36.476953+0000","last_undegraded":"2023-11-18T20:41:36.476953+0000","last_fullsized":"2023-11-18T20:41:36.476953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:18.053169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.474129+0000","last_change":"2023-11-18T20:41:20.104587+0000","last_active":"2023-11-18T20:41:35.474129+0000","last_peered":"2023-11-18T20:41:35.474129+0000","last_clean":"2023-11-18T20:41:35.474129+0000","last_became_active":"2023-11-18T20:41:20.103758+0000","last_became_peered":"2023-11-18T20:41:20.103758+0000","last_unstale":"2023-11-18T20:41:35.474129+0000","last_undegraded":"2023-11-18T20:41:35.474129+0000","last_fullsized":"2023-11-18T20:41:35.474129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:55.966402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.467767+0000","last_change":"2023-11-18T20:41:19.090852+0000","last_active":"2023-11-18T20:41:35.467767+0000","last_peered":"2023-11-18T20:41:35.467767+0000","last_clean":"2023-11-18T20:41:35.467767+0000","last_became_active":"2023-11-18T20:41:19.090491+0000","last_became_peered":"2023-11-18T20:41:19.090491+0000","last_unstale":"2023-11-18T20:41:35.467767+0000","last_undegraded":"2023-11-18T20:41:35.467767+0000","last_fullsized":"2023-11-18T20:41:35.467767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:15.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488681+0000","last_change":"2023-11-18T20:41:35.480926+0000","last_active":"2023-11-18T20:41:35.488681+0000","last_peered":"2023-11-18T20:41:35.488681+0000","last_clean":"2023-11-18T20:41:35.488681+0000","last_became_active":"2023-11-18T20:41:35.477908+0000","last_became_peered":"2023-11-18T20:41:35.477908+0000","last_unstale":"2023-11-18T20:41:35.488681+0000","last_undegraded":"2023-11-18T20:41:35.488681+0000","last_fullsized":"2023-11-18T20:41:35.488681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:52:09.335068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478128+0000","last_change":"2023-11-18T20:41:34.469728+0000","last_active":"2023-11-18T20:41:36.478128+0000","last_peered":"2023-11-18T20:41:36.478128+0000","last_clean":"2023-11-18T20:41:36.478128+0000","last_became_active":"2023-11-18T20:41:34.469394+0000","last_became_peered":"2023-11-18T20:41:34.469394+0000","last_unstale":"2023-11-18T20:41:36.478128+0000","last_undegraded":"2023-11-18T20:41:36.478128+0000","last_fullsized":"2023-11-18T20:41:36.478128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:20.365003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.463836+0000","last_change":"2023-11-18T20:41:20.116318+0000","last_active":"2023-11-18T20:41:34.463836+0000","last_peered":"2023-11-18T20:41:34.463836+0000","last_clean":"2023-11-18T20:41:34.463836+0000","last_became_active":"2023-11-18T20:41:20.115292+0000","last_became_peered":"2023-11-18T20:41:20.115292+0000","last_unstale":"2023-11-18T20:41:34.463836+0000","last_undegraded":"2023-11-18T20:41:34.463836+0000","last_fullsized":"2023-11-18T20:41:34.463836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:20.038509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449900+0000","last_change":"2023-11-18T20:41:19.078588+0000","last_active":"2023-11-18T20:41:35.449900+0000","last_peered":"2023-11-18T20:41:35.449900+0000","last_clean":"2023-11-18T20:41:35.449900+0000","last_became_active":"2023-11-18T20:41:19.078208+0000","last_became_peered":"2023-11-18T20:41:19.078208+0000","last_unstale":"2023-11-18T20:41:35.449900+0000","last_undegraded":"2023-11-18T20:41:35.449900+0000","last_fullsized":"2023-11-18T20:41:35.449900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:40:21.584581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488630+0000","last_change":"2023-11-18T20:41:35.480507+0000","last_active":"2023-11-18T20:41:35.488630+0000","last_peered":"2023-11-18T20:41:35.488630+0000","last_clean":"2023-11-18T20:41:35.488630+0000","last_became_active":"2023-11-18T20:41:35.480204+0000","last_became_peered":"2023-11-18T20:41:35.480204+0000","last_unstale":"2023-11-18T20:41:35.488630+0000","last_undegraded":"2023-11-18T20:41:35.488630+0000","last_fullsized":"2023-11-18T20:41:35.488630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:32:47.240987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.471965+0000","last_change":"2023-11-18T20:41:34.470394+0000","last_active":"2023-11-18T20:41:35.471965+0000","last_peered":"2023-11-18T20:41:35.471965+0000","last_clean":"2023-11-18T20:41:35.471965+0000","last_became_active":"2023-11-18T20:41:34.470063+0000","last_became_peered":"2023-11-18T20:41:34.470063+0000","last_unstale":"2023-11-18T20:41:35.471965+0000","last_undegraded":"2023-11-18T20:41:35.471965+0000","last_fullsized":"2023-11-18T20:41:35.471965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:40.441706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441572+0000","last_change":"2023-11-18T20:41:20.109542+0000","last_active":"2023-11-18T20:41:34.441572+0000","last_peered":"2023-11-18T20:41:34.441572+0000","last_clean":"2023-11-18T20:41:34.441572+0000","last_became_active":"2023-11-18T20:41:20.109219+0000","last_became_peered":"2023-11-18T20:41:20.109219+0000","last_unstale":"2023-11-18T20:41:34.441572+0000","last_undegraded":"2023-11-18T20:41:34.441572+0000","last_fullsized":"2023-11-18T20:41:34.441572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:44.185759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.467907+0000","last_change":"2023-11-18T20:41:19.091570+0000","last_active":"2023-11-18T20:41:34.467907+0000","last_peered":"2023-11-18T20:41:34.467907+0000","last_clean":"2023-11-18T20:41:34.467907+0000","last_became_active":"2023-11-18T20:41:19.091260+0000","last_became_peered":"2023-11-18T20:41:19.091260+0000","last_unstale":"2023-11-18T20:41:34.467907+0000","last_undegraded":"2023-11-18T20:41:34.467907+0000","last_fullsized":"2023-11-18T20:41:34.467907+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:45:49.580341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.479543+0000","last_change":"2023-11-18T20:41:35.478643+0000","last_active":"2023-11-18T20:41:36.479543+0000","last_peered":"2023-11-18T20:41:36.479543+0000","last_clean":"2023-11-18T20:41:36.479543+0000","last_became_active":"2023-11-18T20:41:35.478334+0000","last_became_peered":"2023-11-18T20:41:35.478334+0000","last_unstale":"2023-11-18T20:41:36.479543+0000","last_undegraded":"2023-11-18T20:41:36.479543+0000","last_fullsized":"2023-11-18T20:41:36.479543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:13:15.720731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.457584+0000","last_change":"2023-11-18T20:41:34.468640+0000","last_active":"2023-11-18T20:41:35.457584+0000","last_peered":"2023-11-18T20:41:35.457584+0000","last_clean":"2023-11-18T20:41:35.457584+0000","last_became_active":"2023-11-18T20:41:34.468180+0000","last_became_peered":"2023-11-18T20:41:34.468180+0000","last_unstale":"2023-11-18T20:41:35.457584+0000","last_undegraded":"2023-11-18T20:41:35.457584+0000","last_fullsized":"2023-11-18T20:41:35.457584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:28:06.465118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.472987+0000","last_change":"2023-11-18T20:41:20.108499+0000","last_active":"2023-11-18T20:41:35.472987+0000","last_peered":"2023-11-18T20:41:35.472987+0000","last_clean":"2023-11-18T20:41:35.472987+0000","last_became_active":"2023-11-18T20:41:20.108213+0000","last_became_peered":"2023-11-18T20:41:20.108213+0000","last_unstale":"2023-11-18T20:41:35.472987+0000","last_undegraded":"2023-11-18T20:41:35.472987+0000","last_fullsized":"2023-11-18T20:41:35.472987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:47:05.642911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"75'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.475859+0000","last_change":"2023-11-18T20:41:19.091596+0000","last_active":"2023-11-18T20:41:34.475859+0000","last_peered":"2023-11-18T20:41:34.475859+0000","last_clean":"2023-11-18T20:41:34.475859+0000","last_became_active":"2023-11-18T20:41:19.091224+0000","last_became_peered":"2023-11-18T20:41:19.091224+0000","last_unstale":"2023-11-18T20:41:34.475859+0000","last_undegraded":"2023-11-18T20:41:34.475859+0000","last_fullsized":"2023-11-18T20:41:34.475859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:20:53.778898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477817+0000","last_change":"2023-11-18T20:41:35.483254+0000","last_active":"2023-11-18T20:41:36.477817+0000","last_peered":"2023-11-18T20:41:36.477817+0000","last_clean":"2023-11-18T20:41:36.477817+0000","last_became_active":"2023-11-18T20:41:35.482924+0000","last_became_peered":"2023-11-18T20:41:35.482924+0000","last_unstale":"2023-11-18T20:41:36.477817+0000","last_undegraded":"2023-11-18T20:41:36.477817+0000","last_fullsized":"2023-11-18T20:41:36.477817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:05.475338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.469059+0000","last_change":"2023-11-18T20:41:34.461166+0000","last_active":"2023-11-18T20:41:35.469059+0000","last_peered":"2023-11-18T20:41:35.469059+0000","last_clean":"2023-11-18T20:41:35.469059+0000","last_became_active":"2023-11-18T20:41:34.459748+0000","last_became_peered":"2023-11-18T20:41:34.459748+0000","last_unstale":"2023-11-18T20:41:35.469059+0000","last_undegraded":"2023-11-18T20:41:35.469059+0000","last_fullsized":"2023-11-18T20:41:35.469059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:39.212320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.474264+0000","last_change":"2023-11-18T20:41:20.108830+0000","last_active":"2023-11-18T20:41:35.474264+0000","last_peered":"2023-11-18T20:41:35.474264+0000","last_clean":"2023-11-18T20:41:35.474264+0000","last_became_active":"2023-11-18T20:41:20.108492+0000","last_became_peered":"2023-11-18T20:41:20.108492+0000","last_unstale":"2023-11-18T20:41:35.474264+0000","last_undegraded":"2023-11-18T20:41:35.474264+0000","last_fullsized":"2023-11-18T20:41:35.474264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:51:02.700363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"76'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.456636+0000","last_change":"2023-11-18T20:41:19.084636+0000","last_active":"2023-11-18T20:41:35.456636+0000","last_peered":"2023-11-18T20:41:35.456636+0000","last_clean":"2023-11-18T20:41:35.456636+0000","last_became_active":"2023-11-18T20:41:19.084334+0000","last_became_peered":"2023-11-18T20:41:19.084334+0000","last_unstale":"2023-11-18T20:41:35.456636+0000","last_undegraded":"2023-11-18T20:41:35.456636+0000","last_fullsized":"2023-11-18T20:41:35.456636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:08:23.195665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.488725+0000","last_change":"2023-11-18T20:41:35.481987+0000","last_active":"2023-11-18T20:41:35.488725+0000","last_peered":"2023-11-18T20:41:35.488725+0000","last_clean":"2023-11-18T20:41:35.488725+0000","last_became_active":"2023-11-18T20:41:35.481674+0000","last_became_peered":"2023-11-18T20:41:35.481674+0000","last_unstale":"2023-11-18T20:41:35.488725+0000","last_undegraded":"2023-11-18T20:41:35.488725+0000","last_fullsized":"2023-11-18T20:41:35.488725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:39.748423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"79'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.498778+0000","last_change":"2023-11-18T20:41:34.463101+0000","last_active":"2023-11-18T20:41:35.498778+0000","last_peered":"2023-11-18T20:41:35.498778+0000","last_clean":"2023-11-18T20:41:35.498778+0000","last_became_active":"2023-11-18T20:41:34.462714+0000","last_became_peered":"2023-11-18T20:41:34.462714+0000","last_unstale":"2023-11-18T20:41:35.498778+0000","last_undegraded":"2023-11-18T20:41:35.498778+0000","last_fullsized":"2023-11-18T20:41:35.498778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:38.141433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.478124+0000","last_change":"2023-11-18T20:41:20.106214+0000","last_active":"2023-11-18T20:41:35.478124+0000","last_peered":"2023-11-18T20:41:35.478124+0000","last_clean":"2023-11-18T20:41:35.478124+0000","last_became_active":"2023-11-18T20:41:20.105702+0000","last_became_peered":"2023-11-18T20:41:20.105702+0000","last_unstale":"2023-11-18T20:41:35.478124+0000","last_undegraded":"2023-11-18T20:41:35.478124+0000","last_fullsized":"2023-11-18T20:41:35.478124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:45:15.838878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.442861+0000","last_change":"2023-11-18T20:41:19.078495+0000","last_active":"2023-11-18T20:41:34.442861+0000","last_peered":"2023-11-18T20:41:34.442861+0000","last_clean":"2023-11-18T20:41:34.442861+0000","last_became_active":"2023-11-18T20:41:19.078230+0000","last_became_peered":"2023-11-18T20:41:19.078230+0000","last_unstale":"2023-11-18T20:41:34.442861+0000","last_undegraded":"2023-11-18T20:41:34.442861+0000","last_fullsized":"2023-11-18T20:41:34.442861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:59.396819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.475790+0000","last_change":"2023-11-18T20:41:35.470795+0000","last_active":"2023-11-18T20:41:35.475790+0000","last_peered":"2023-11-18T20:41:35.475790+0000","last_clean":"2023-11-18T20:41:35.475790+0000","last_became_active":"2023-11-18T20:41:35.469144+0000","last_became_peered":"2023-11-18T20:41:35.469144+0000","last_unstale":"2023-11-18T20:41:35.475790+0000","last_undegraded":"2023-11-18T20:41:35.475790+0000","last_fullsized":"2023-11-18T20:41:35.475790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:26.684465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.460212+0000","last_change":"2023-11-18T20:41:34.474266+0000","last_active":"2023-11-18T20:41:35.460212+0000","last_peered":"2023-11-18T20:41:35.460212+0000","last_clean":"2023-11-18T20:41:35.460212+0000","last_became_active":"2023-11-18T20:41:34.471535+0000","last_became_peered":"2023-11-18T20:41:34.471535+0000","last_unstale":"2023-11-18T20:41:35.460212+0000","last_undegraded":"2023-11-18T20:41:35.460212+0000","last_fullsized":"2023-11-18T20:41:35.460212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:01:18.038133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.458470+0000","last_change":"2023-11-18T20:41:20.108454+0000","last_active":"2023-11-18T20:41:34.458470+0000","last_peered":"2023-11-18T20:41:34.458470+0000","last_clean":"2023-11-18T20:41:34.458470+0000","last_became_active":"2023-11-18T20:41:20.107160+0000","last_became_peered":"2023-11-18T20:41:20.107160+0000","last_unstale":"2023-11-18T20:41:34.458470+0000","last_undegraded":"2023-11-18T20:41:34.458470+0000","last_fullsized":"2023-11-18T20:41:34.458470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:20.038509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.459289+0000","last_change":"2023-11-18T20:41:19.090705+0000","last_active":"2023-11-18T20:41:34.459289+0000","last_peered":"2023-11-18T20:41:34.459289+0000","last_clean":"2023-11-18T20:41:34.459289+0000","last_became_active":"2023-11-18T20:41:19.090456+0000","last_became_peered":"2023-11-18T20:41:19.090456+0000","last_unstale":"2023-11-18T20:41:34.459289+0000","last_undegraded":"2023-11-18T20:41:34.459289+0000","last_fullsized":"2023-11-18T20:41:34.459289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:59.396819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.486511+0000","last_change":"2023-11-18T20:41:35.478693+0000","last_active":"2023-11-18T20:41:35.486511+0000","last_peered":"2023-11-18T20:41:35.486511+0000","last_clean":"2023-11-18T20:41:35.486511+0000","last_became_active":"2023-11-18T20:41:35.477886+0000","last_became_peered":"2023-11-18T20:41:35.477886+0000","last_unstale":"2023-11-18T20:41:35.486511+0000","last_undegraded":"2023-11-18T20:41:35.486511+0000","last_fullsized":"2023-11-18T20:41:35.486511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:13.320680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.465825+0000","last_change":"2023-11-18T20:41:34.478336+0000","last_active":"2023-11-18T20:41:35.465825+0000","last_peered":"2023-11-18T20:41:35.465825+0000","last_clean":"2023-11-18T20:41:35.465825+0000","last_became_active":"2023-11-18T20:41:34.478043+0000","last_became_peered":"2023-11-18T20:41:34.478043+0000","last_unstale":"2023-11-18T20:41:35.465825+0000","last_undegraded":"2023-11-18T20:41:35.465825+0000","last_fullsized":"2023-11-18T20:41:35.465825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:22:02.417644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.456675+0000","last_change":"2023-11-18T20:41:20.114986+0000","last_active":"2023-11-18T20:41:34.456675+0000","last_peered":"2023-11-18T20:41:34.456675+0000","last_clean":"2023-11-18T20:41:34.456675+0000","last_became_active":"2023-11-18T20:41:20.114633+0000","last_became_peered":"2023-11-18T20:41:20.114633+0000","last_unstale":"2023-11-18T20:41:34.456675+0000","last_undegraded":"2023-11-18T20:41:34.456675+0000","last_fullsized":"2023-11-18T20:41:34.456675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:53:16.917978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.468270+0000","last_change":"2023-11-18T20:41:19.086338+0000","last_active":"2023-11-18T20:41:35.468270+0000","last_peered":"2023-11-18T20:41:35.468270+0000","last_clean":"2023-11-18T20:41:35.468270+0000","last_became_active":"2023-11-18T20:41:19.086004+0000","last_became_peered":"2023-11-18T20:41:19.086004+0000","last_unstale":"2023-11-18T20:41:35.468270+0000","last_undegraded":"2023-11-18T20:41:35.468270+0000","last_fullsized":"2023-11-18T20:41:35.468270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:59.604368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.472352+0000","last_change":"2023-11-18T20:41:35.460284+0000","last_active":"2023-11-18T20:41:35.472352+0000","last_peered":"2023-11-18T20:41:35.472352+0000","last_clean":"2023-11-18T20:41:35.472352+0000","last_became_active":"2023-11-18T20:41:35.459624+0000","last_became_peered":"2023-11-18T20:41:35.459624+0000","last_unstale":"2023-11-18T20:41:35.472352+0000","last_undegraded":"2023-11-18T20:41:35.472352+0000","last_fullsized":"2023-11-18T20:41:35.472352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:43:08.344287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477182+0000","last_change":"2023-11-18T20:41:34.472660+0000","last_active":"2023-11-18T20:41:36.477182+0000","last_peered":"2023-11-18T20:41:36.477182+0000","last_clean":"2023-11-18T20:41:36.477182+0000","last_became_active":"2023-11-18T20:41:34.468083+0000","last_became_peered":"2023-11-18T20:41:34.468083+0000","last_unstale":"2023-11-18T20:41:36.477182+0000","last_undegraded":"2023-11-18T20:41:36.477182+0000","last_fullsized":"2023-11-18T20:41:36.477182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:45:43.433331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.453386+0000","last_change":"2023-11-18T20:41:20.105693+0000","last_active":"2023-11-18T20:41:35.453386+0000","last_peered":"2023-11-18T20:41:35.453386+0000","last_clean":"2023-11-18T20:41:35.453386+0000","last_became_active":"2023-11-18T20:41:20.104048+0000","last_became_peered":"2023-11-18T20:41:20.104048+0000","last_unstale":"2023-11-18T20:41:35.453386+0000","last_undegraded":"2023-11-18T20:41:35.453386+0000","last_fullsized":"2023-11-18T20:41:35.453386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:46:07.215841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455429+0000","last_change":"2023-11-18T20:41:19.084853+0000","last_active":"2023-11-18T20:41:34.455429+0000","last_peered":"2023-11-18T20:41:34.455429+0000","last_clean":"2023-11-18T20:41:34.455429+0000","last_became_active":"2023-11-18T20:41:19.084525+0000","last_became_peered":"2023-11-18T20:41:19.084525+0000","last_unstale":"2023-11-18T20:41:34.455429+0000","last_undegraded":"2023-11-18T20:41:34.455429+0000","last_fullsized":"2023-11-18T20:41:34.455429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:11.638539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.486773+0000","last_change":"2023-11-18T20:41:35.479546+0000","last_active":"2023-11-18T20:41:35.486773+0000","last_peered":"2023-11-18T20:41:35.486773+0000","last_clean":"2023-11-18T20:41:35.486773+0000","last_became_active":"2023-11-18T20:41:35.478004+0000","last_became_peered":"2023-11-18T20:41:35.478004+0000","last_unstale":"2023-11-18T20:41:35.486773+0000","last_undegraded":"2023-11-18T20:41:35.486773+0000","last_fullsized":"2023-11-18T20:41:35.486773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:05:56.579657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.478798+0000","last_change":"2023-11-18T20:41:34.477397+0000","last_active":"2023-11-18T20:41:36.478798+0000","last_peered":"2023-11-18T20:41:36.478798+0000","last_clean":"2023-11-18T20:41:36.478798+0000","last_became_active":"2023-11-18T20:41:34.476715+0000","last_became_peered":"2023-11-18T20:41:34.476715+0000","last_unstale":"2023-11-18T20:41:36.478798+0000","last_undegraded":"2023-11-18T20:41:36.478798+0000","last_fullsized":"2023-11-18T20:41:36.478798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:34.403612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.454651+0000","last_change":"2023-11-18T20:41:20.117843+0000","last_active":"2023-11-18T20:41:34.454651+0000","last_peered":"2023-11-18T20:41:34.454651+0000","last_clean":"2023-11-18T20:41:34.454651+0000","last_became_active":"2023-11-18T20:41:20.117505+0000","last_became_peered":"2023-11-18T20:41:20.117505+0000","last_unstale":"2023-11-18T20:41:34.454651+0000","last_undegraded":"2023-11-18T20:41:34.454651+0000","last_fullsized":"2023-11-18T20:41:34.454651+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:30:35.394592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455866+0000","last_change":"2023-11-18T20:41:19.078072+0000","last_active":"2023-11-18T20:41:34.455866+0000","last_peered":"2023-11-18T20:41:34.455866+0000","last_clean":"2023-11-18T20:41:34.455866+0000","last_became_active":"2023-11-18T20:41:19.077794+0000","last_became_peered":"2023-11-18T20:41:19.077794+0000","last_unstale":"2023-11-18T20:41:34.455866+0000","last_undegraded":"2023-11-18T20:41:34.455866+0000","last_fullsized":"2023-11-18T20:41:34.455866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:51:06.256655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.477826+0000","last_change":"2023-11-18T20:41:35.482205+0000","last_active":"2023-11-18T20:41:36.477826+0000","last_peered":"2023-11-18T20:41:36.477826+0000","last_clean":"2023-11-18T20:41:36.477826+0000","last_became_active":"2023-11-18T20:41:35.481876+0000","last_became_peered":"2023-11-18T20:41:35.481876+0000","last_unstale":"2023-11-18T20:41:36.477826+0000","last_undegraded":"2023-11-18T20:41:36.477826+0000","last_fullsized":"2023-11-18T20:41:36.477826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:59:01.056831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.472105+0000","last_change":"2023-11-18T20:41:34.465697+0000","last_active":"2023-11-18T20:41:35.472105+0000","last_peered":"2023-11-18T20:41:35.472105+0000","last_clean":"2023-11-18T20:41:35.472105+0000","last_became_active":"2023-11-18T20:41:34.465204+0000","last_became_peered":"2023-11-18T20:41:34.465204+0000","last_unstale":"2023-11-18T20:41:35.472105+0000","last_undegraded":"2023-11-18T20:41:35.472105+0000","last_fullsized":"2023-11-18T20:41:35.472105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:32:46.226299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.455757+0000","last_change":"2023-11-18T20:41:20.109900+0000","last_active":"2023-11-18T20:41:34.455757+0000","last_peered":"2023-11-18T20:41:34.455757+0000","last_clean":"2023-11-18T20:41:34.455757+0000","last_became_active":"2023-11-18T20:41:20.109595+0000","last_became_peered":"2023-11-18T20:41:20.109595+0000","last_unstale":"2023-11-18T20:41:34.455757+0000","last_undegraded":"2023-11-18T20:41:34.455757+0000","last_fullsized":"2023-11-18T20:41:34.455757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:12.856780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.441784+0000","last_change":"2023-11-18T20:41:19.074145+0000","last_active":"2023-11-18T20:41:34.441784+0000","last_peered":"2023-11-18T20:41:34.441784+0000","last_clean":"2023-11-18T20:41:34.441784+0000","last_became_active":"2023-11-18T20:41:19.073833+0000","last_became_peered":"2023-11-18T20:41:19.073833+0000","last_unstale":"2023-11-18T20:41:34.441784+0000","last_undegraded":"2023-11-18T20:41:34.441784+0000","last_fullsized":"2023-11-18T20:41:34.441784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:27.958410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-18T20:41:36.482288+0000","last_change":"2023-11-18T20:41:35.473188+0000","last_active":"2023-11-18T20:41:36.482288+0000","last_peered":"2023-11-18T20:41:36.482288+0000","last_clean":"2023-11-18T20:41:36.482288+0000","last_became_active":"2023-11-18T20:41:35.471763+0000","last_became_peered":"2023-11-18T20:41:35.471763+0000","last_unstale":"2023-11-18T20:41:36.482288+0000","last_undegraded":"2023-11-18T20:41:36.482288+0000","last_fullsized":"2023-11-18T20:41:36.482288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:34.423960+0000","last_clean_scrub_stamp":"2023-11-18T20:41:34.423960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:21.267998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.501210+0000","last_change":"2023-11-18T20:41:34.472123+0000","last_active":"2023-11-18T20:41:35.501210+0000","last_peered":"2023-11-18T20:41:35.501210+0000","last_clean":"2023-11-18T20:41:35.501210+0000","last_became_active":"2023-11-18T20:41:34.471850+0000","last_became_peered":"2023-11-18T20:41:34.471850+0000","last_unstale":"2023-11-18T20:41:35.501210+0000","last_undegraded":"2023-11-18T20:41:35.501210+0000","last_fullsized":"2023-11-18T20:41:35.501210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:33.409273+0000","last_clean_scrub_stamp":"2023-11-18T20:41:33.409273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:47:18.053169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.449722+0000","last_change":"2023-11-18T20:41:20.109331+0000","last_active":"2023-11-18T20:41:35.449722+0000","last_peered":"2023-11-18T20:41:35.449722+0000","last_clean":"2023-11-18T20:41:35.449722+0000","last_became_active":"2023-11-18T20:41:20.109021+0000","last_became_peered":"2023-11-18T20:41:20.109021+0000","last_unstale":"2023-11-18T20:41:35.449722+0000","last_undegraded":"2023-11-18T20:41:35.449722+0000","last_fullsized":"2023-11-18T20:41:35.449722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:19.044169+0000","last_clean_scrub_stamp":"2023-11-18T20:41:19.044169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:06:30.165657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-18T20:41:35.478924+0000","last_change":"2023-11-18T20:41:19.086459+0000","last_active":"2023-11-18T20:41:35.478924+0000","last_peered":"2023-11-18T20:41:35.478924+0000","last_clean":"2023-11-18T20:41:35.478924+0000","last_became_active":"2023-11-18T20:41:19.086134+0000","last_became_peered":"2023-11-18T20:41:19.086134+0000","last_unstale":"2023-11-18T20:41:35.478924+0000","last_undegraded":"2023-11-18T20:41:35.478924+0000","last_fullsized":"2023-11-18T20:41:35.478924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:41:18.038645+0000","last_clean_scrub_stamp":"2023-11-18T20:41:18.038645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:11:21.092893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-18T20:41:34.454743+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:41:34.454743+0000","last_peered":"2023-11-18T20:41:34.454743+0000","last_clean":"2023-11-18T20:41:34.454743+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:41:34.454743+0000","last_undegraded":"2023-11-18T20:41:34.454743+0000","last_fullsized":"2023-11-18T20:41:34.454743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":436983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.67300000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.749},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.079,"15min":1.091},"min":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5049999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.84999999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.1839999999999999,"15min":1.2050000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7829999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.2350000000000001,"15min":1.254},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.929,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.93999999999999995}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.107,"15min":1.1200000000000001},"min":{"1min":0.72899999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.294,"15min":1.298},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.105}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.92300000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.532,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.341},{"interface":"front","average":{"1min":1.298,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5609999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.524,"15min":1.5700000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.788,"5min":2.601,"15min":2.601},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.48,"15min":1.534},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7250000000000001,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.5209999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.581,"15min":1.615},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1560000000000001,"5min":3.02,"15min":3.02},"last":1.448},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.6719999999999999,"15min":1.722},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.04,"5min":3.488,"15min":3.488},"last":1.5800000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.728,"15min":1.766},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.109,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.796},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.6699999999999999,"15min":1.7270000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.1970000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.6359999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":444160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.97899999999999998,"15min":0.96999999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.464,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.997}]},{"osd":1,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0169999999999999,"15min":1.0049999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.125,"5min":1.151,"15min":1.1559999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.52,"5min":1.653,"15min":1.653},"last":1.2110000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.68200000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6479999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.381},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.22,"15min":1.23},"min":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.1200000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3220000000000001,"15min":1.341},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2030000000000001,"15min":1.1970000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.163}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3400000000000001,"15min":1.3520000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8959999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.538},{"interface":"front","average":{"1min":1.383,"5min":1.371,"15min":1.373},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9390000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.653}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.3799999999999999,"15min":1.333},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.55,"15min":1.534},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.706}]},{"osd":7,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.575,"15min":1.5649999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":5.0369999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.742,"5min":1.5469999999999999,"15min":1.5169999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":6.1769999999999996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.5860000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1597440,"data_stored":1031508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1739999999999999,"15min":1.1899999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.7130000000000001,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.1319999999999999,"15min":1.1140000000000001},"min":{"1min":0.78800000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5780000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1000000000000001,"15min":1.123},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.466,"5min":1.897,"15min":1.897},"last":1.012},{"interface":"front","average":{"1min":1.202,"5min":1.278,"15min":1.3240000000000001},"min":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.968,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.96299999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.3160000000000001,"15min":1.3799999999999999},"min":{"1min":0.81299999999999994,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5329999999999999,"5min":2.004,"15min":2.004},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.194,"15min":1.202},"min":{"1min":0.88700000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.3200000000000001,"5min":2.214,"15min":2.214},"last":1.212}]},{"osd":3,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.452,"15min":1.496},"min":{"1min":0.80700000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.1019999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.4370000000000001,"15min":1.454},"min":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.762,"5min":2.024,"15min":2.024},"last":1.452}]},{"osd":4,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.879,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.657,"5min":2.359,"15min":2.359},"last":1.351},{"interface":"front","average":{"1min":1.518,"5min":1.508,"15min":1.5089999999999999},"min":{"1min":0.76800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.6759999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.615,"15min":1.657},"min":{"1min":1.288,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.907,"5min":2.181,"15min":2.181},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.569,"15min":1.605},"min":{"1min":1.044,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.04,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.627}]},{"osd":7,"last update":"Sat Nov 18 20:40:59 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.6459999999999999,"15min":1.6659999999999999},"min":{"1min":1.2170000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.1699999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.75},{"interface":"front","average":{"1min":1.659,"5min":1.724,"15min":1.754},"min":{"1min":1.2569999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.972,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.659}]}]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":444104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0249999999999999,"15min":1.032},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.4390000000000001,"5min":1.635,"15min":1.635},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.131,"5min":1.091,"15min":1.101},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.6659999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.8979999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1100000000000001,"15min":1.0900000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.647,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":2.097},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.1459999999999999,"15min":1.214},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.367,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.7470000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.379,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.335,"15min":1.393},"min":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.76,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":2.0030000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1839999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.593,"5min":1.823,"15min":1.823},"last":2.056},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.4159999999999999,"15min":1.484},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.667,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.1519999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.70099999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7490000000000001,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":2.2160000000000002},{"interface":"front","average":{"1min":1.169,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.514,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.95}]},{"osd":6,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.488,"15min":1.5409999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.7030000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.339},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.571,"15min":1.605},"min":{"1min":0.77500000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8580000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":2.2970000000000002}]},{"osd":7,"last update":"Sat Nov 18 20:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4410000000000001,"15min":1.4650000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.629,"5min":1.929,"15min":1.929},"last":2.169},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.6000000000000001,"15min":1.6319999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.74,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542193,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1003520,"data_stored":444356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.55700000000000005,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1990000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.84999999999999998,"15min":0.83099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.74099999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94199999999999995,"15min":0.93600000000000005},"min":{"1min":0.45600000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4550000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.86599999999999999,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.4390000000000001,"5min":1.595,"15min":1.595},"last":1.01}]},{"osd":2,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.069,"15min":1.0660000000000001},"min":{"1min":0.77500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.581,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.0069999999999999},"min":{"1min":0.69699999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.377,"5min":1.675,"15min":1.675},"last":0.84199999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.177,"15min":1.161},"min":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.45},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.91800000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.222}]},{"osd":5,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.95099999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6359999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.107},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.254,"15min":1.248},"min":{"1min":0.86499999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7529999999999999,"5min":1.901,"15min":1.901},"last":0.98799999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2789999999999999,"15min":1.2669999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8109999999999999,"5min":1.837,"15min":1.837},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.3300000000000001,"15min":1.3180000000000001},"min":{"1min":1.1220000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.712,"5min":1.962,"15min":1.962},"last":1.379}]},{"osd":7,"last update":"Sat Nov 18 20:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3420000000000001,"15min":1.3480000000000001},"min":{"1min":1.0149999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8560000000000001,"5min":1.907,"15min":1.907},"last":1.155},{"interface":"front","average":{"1min":1.415,"5min":1.347,"15min":1.325},"min":{"1min":0.88300000000000001,"5min":0.754,"15min":0.754},"max":{"1min":1.903,"5min":2.081,"15min":2.081},"last":1.5720000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542192,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":436401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.177,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1},{"interface":"front","average":{"1min":0.88,"5min":0.98599999999999999,"15min":1.028},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3899999999999999,"5min":2.081,"15min":2.081},"last":1.157}]},{"osd":1,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83899999999999997,"15min":0.85899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.367,"5min":1.919,"15min":1.919},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83599999999999997,"15min":0.84299999999999997},"min":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.345,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.872}]},{"osd":3,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0660000000000001,"15min":1.1000000000000001},"min":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.516,"5min":2.024,"15min":2.024},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.59999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.637,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.276,"15min":1.319},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9630000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.9730000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1819999999999999,"15min":1.2110000000000001},"min":{"1min":0.753,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6799999999999999,"5min":2.254,"15min":2.254},"last":2.3639999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.28,"15min":1.3120000000000001},"min":{"1min":0.94199999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5329999999999999,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.21},{"interface":"front","average":{"1min":1.3,"5min":1.393,"15min":1.4379999999999999},"min":{"1min":0.89000000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8779999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.3520000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.387,"15min":1.4450000000000001},"min":{"1min":0.78100000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.738,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.282,"15min":1.319},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.9219999999999999,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.083}]},{"osd":7,"last update":"Sat Nov 18 20:40:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.419,"15min":1.458},"min":{"1min":0.82799999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.0830000000000002,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.377,"15min":1.4279999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.917,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.383}]}]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":1028513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2190000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.873,"15min":0.90900000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.288,"5min":1.524,"15min":1.524},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.872,"15min":0.89400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.004,"15min":1.028},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.518,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.024,"15min":1.054},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.468,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4099999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.179,"15min":1.2110000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.486,"5min":1.927,"15min":1.927},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.151,"5min":1.3500000000000001,"15min":1.415},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6879999999999999,"5min":3.343,"15min":3.343},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.375,"15min":1.4630000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.671,"5min":3.206,"15min":3.206},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.3340000000000001,"15min":1.383},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5229999999999999,"5min":2.165,"15min":2.165},"last":0.98199999999999998}]},{"osd":6,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.4099999999999999,"15min":1.4670000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.766,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4930000000000001,"15min":1.5740000000000001},"min":{"1min":0.84499999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6399999999999999,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":0.95799999999999996}]},{"osd":7,"last update":"Sat Nov 18 20:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.5,"15min":1.5920000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6699999999999999,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.288,"5min":1.4079999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.581,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.0229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":439460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90300000000000002,"15min":0.96199999999999997},"min":{"1min":0.442,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.347,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95899999999999996,"15min":1.006},"min":{"1min":0.625,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.661,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.383,"15min":1.6060000000000001},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.421,"5min":14.169,"15min":14.169},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":0.93700000000000006},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6080000000000001,"5min":2.173,"15min":2.173},"last":0.74099999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.3680000000000001,"15min":1.5620000000000001},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5609999999999999,"5min":11.629,"15min":11.629},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.2749999999999999,"15min":1.387},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.524,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.1060000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3620000000000001,"15min":1.4239999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6579999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.367,"15min":1.4079999999999999},"min":{"1min":0.81399999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.476,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.286}]},{"osd":5,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.466,"15min":1.5940000000000001},"min":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.71,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.53,"15min":1.647},"min":{"1min":0.80300000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.8600000000000001,"5min":6.202,"15min":6.202},"last":1.252}]},{"osd":6,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.454,"15min":1.466},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.794,"5min":5.085,"15min":5.085},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.583,"15min":1.7130000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.831,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.4490000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:40:56 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.5169999999999999,"15min":1.6220000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9099999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.385},{"interface":"front","average":{"1min":1.375,"5min":1.639,"15min":1.7669999999999999},"min":{"1min":0.81000000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.954,"5min":6.149,"15min":6.149},"last":1.2110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:41:40.470 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T20:41:40.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-18T20:41:40.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.730+0000 7f2abd81f640 1 Processor -- start 2023-11-18T20:41:40.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.730+0000 7f2abd81f640 1 -- start start 2023-11-18T20:41:40.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.732+0000 7f2abd81f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ab814fd30 0x7f2ab8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.732+0000 7f2abd81f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ab80c3ea0 0x7f2ab80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.732+0000 7f2abd81f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab80c64a0 con 0x7f2ab806d0a0 2023-11-18T20:41:40.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.732+0000 7f2abd81f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab80c5c00 con 0x7f2ab814fd30 2023-11-18T20:41:40.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.732+0000 7f2abd81f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80c5ee0 con 0x7f2ab80c3ea0 2023-11-18T20:41:40.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.732+0000 7f2ab6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ab814fd30 0x7f2ab8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.732+0000 7f2ab6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ab814fd30 0x7f2ab8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50400/0 (socket says 172.21.15.132:50400) 2023-11-18T20:41:40.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.732+0000 7f2ab6ffd640 1 -- 172.21.15.132:0/2353156671 learned_addr learned my addr 172.21.15.132:0/2353156671 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:40.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.733+0000 7f2ab6ffd640 1 -- 172.21.15.132:0/2353156671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ab80c3ea0 msgr2=0x7f2ab80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:40.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.733+0000 7f2ab6ffd640 1 --2- 172.21.15.132:0/2353156671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ab80c3ea0 0x7f2ab80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.733+0000 7f2ab6ffd640 1 -- 172.21.15.132:0/2353156671 >> v1:172.21.15.161:6789/0 conn(0x7f2ab806d0a0 legacy=0x7f2ab80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:40.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.733+0000 7f2ab6ffd640 1 -- 172.21.15.132:0/2353156671 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80c61c0 con 0x7f2ab814fd30 2023-11-18T20:41:40.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.734+0000 7f2ab6ffd640 1 --2- 172.21.15.132:0/2353156671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab814fd30 0x7f2ab8152f20 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbd268a636663b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:40.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.734+0000 7f2ab67fc640 1 -- 172.21.15.132:0/2353156671 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8031640 con 0x7f2ab814fd30 2023-11-18T20:41:40.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.734+0000 7f2ab67fc640 1 -- 172.21.15.132:0/2353156671 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa80317a0 con 0x7f2ab814fd30 2023-11-18T20:41:40.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.734+0000 7f2ab67fc640 1 -- 172.21.15.132:0/2353156671 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8031b30 con 0x7f2ab814fd30 2023-11-18T20:41:40.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.735+0000 7f2abd81f640 1 -- 172.21.15.132:0/2353156671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab814fd30 msgr2=0x7f2ab8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.735+0000 7f2abd81f640 1 --2- 172.21.15.132:0/2353156671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab814fd30 0x7f2ab8152f20 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa802b8f0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.735+0000 7f2abd81f640 1 -- 172.21.15.132:0/2353156671 shutdown_connections 2023-11-18T20:41:40.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.735+0000 7f2abd81f640 1 --2- 172.21.15.132:0/2353156671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ab80c3ea0 0x7f2ab80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.735+0000 7f2abd81f640 1 --2- 172.21.15.132:0/2353156671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab814fd30 0x7f2ab8152f20 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.735+0000 7f2abd81f640 1 -- 172.21.15.132:0/2353156671 >> 172.21.15.132:0/2353156671 conn(0x7f2ab806a500 msgr2=0x7f2ab806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:40.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.735+0000 7f2abd81f640 1 -- 172.21.15.132:0/2353156671 shutdown_connections 2023-11-18T20:41:40.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.735+0000 7f2abd81f640 1 -- 172.21.15.132:0/2353156671 wait complete. 2023-11-18T20:41:40.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.737+0000 7f2abd81f640 1 Processor -- start 2023-11-18T20:41:40.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.737+0000 7f2abd81f640 1 -- start start 2023-11-18T20:41:40.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2abd81f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab806d0a0 0x7f2ab81ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2abd81f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab80c3ea0 0x7f2ab80bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2abd81f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ab814fd30 0x7f2ab814f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2abd81f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab81ddbb0 con 0x7f2ab806d0a0 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2abd81f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80aa770 con 0x7f2ab80c3ea0 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2abd81f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80aaa50 con 0x7f2ab814fd30 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2ab6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab806d0a0 0x7f2ab81ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2ab6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab806d0a0 0x7f2ab81ee2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50408/0 (socket says 172.21.15.132:50408) 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2ab6ffd640 1 -- 172.21.15.132:0/546938870 learned_addr learned my addr 172.21.15.132:0/546938870 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2ab6ffd640 1 -- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ab814fd30 msgr2=0x7f2ab814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.738+0000 7f2ab6ffd640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ab814fd30 0x7f2ab814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2aae7fc640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab80c3ea0 0x7f2ab80bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2ab6ffd640 1 -- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab80c3ea0 msgr2=0x7f2ab80bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:40.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2ab6ffd640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab80c3ea0 0x7f2ab80bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:40.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2ab6ffd640 1 -- 172.21.15.132:0/546938870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa80094d0 con 0x7f2ab806d0a0 2023-11-18T20:41:40.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2ab6ffd640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab806d0a0 0x7f2ab81ee2f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:40.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2ab4ff9640 1 -- 172.21.15.132:0/546938870 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa803ac60 con 0x7f2ab806d0a0 2023-11-18T20:41:40.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2ab4ff9640 1 -- 172.21.15.132:0/546938870 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa803adc0 con 0x7f2ab806d0a0 2023-11-18T20:41:40.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2ab4ff9640 1 -- 172.21.15.132:0/546938870 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8044630 con 0x7f2ab806d0a0 2023-11-18T20:41:40.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab80aad30 con 0x7f2ab806d0a0 2023-11-18T20:41:40.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.739+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab81dc630 con 0x7f2ab806d0a0 2023-11-18T20:41:40.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.741+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab81dc820 con 0x7f2ab806d0a0 2023-11-18T20:41:40.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.741+0000 7f2ab4ff9640 1 -- 172.21.15.132:0/546938870 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2aa802f050 con 0x7f2ab806d0a0 2023-11-18T20:41:40.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.742+0000 7f2ab4ff9640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a9806ae40 0x7f2a9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:40.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.742+0000 7f2ab4ff9640 1 -- 172.21.15.132:0/546938870 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2aa80ab990 con 0x7f2ab806d0a0 2023-11-18T20:41:40.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.743+0000 7f2aae7fc640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a9806ae40 0x7f2a9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:40.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.744+0000 7f2aae7fc640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a9806ae40 0x7f2a9806d300 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2ab81dfa40 tx=0x7f2aa0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:40.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:40.747+0000 7f2ab4ff9640 1 -- 172.21.15.132:0/546938870 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2aa80766d0 con 0x7f2ab806d0a0 2023-11-18T20:41:41.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.007+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f2ab8068350 con 0x7f2ab806d0a0 2023-11-18T20:41:41.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.012+0000 7f2ab4ff9640 1 -- 172.21.15.132:0/546938870 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7f2aa8031e60 con 0x7f2ab806d0a0 2023-11-18T20:41:41.014 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-11-18T20:41:41.014 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBsIFllrycwCxAAI7OVXj40YLGlQ4/hWY+mTA== 2023-11-18T20:41:41.014 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow" 2023-11-18T20:41:41.014 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2023-11-18T20:41:41.014 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-18T20:41:41.014 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.1 2023-11-18T20:41:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a9806ae40 msgr2=0x7f2a9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a9806ae40 0x7f2a9806d300 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2ab81dfa40 tx=0x7f2aa0008040 comp rx=0 tx=0).stop 2023-11-18T20:41:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab806d0a0 msgr2=0x7f2ab81ee2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab806d0a0 0x7f2ab81ee2f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa80046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 shutdown_connections 2023-11-18T20:41:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2a9806ae40 0x7f2a9806d300 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ab814fd30 0x7f2ab814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab80c3ea0 0x7f2ab80bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 --2- 172.21.15.132:0/546938870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab806d0a0 0x7f2ab81ee2f0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 >> 172.21.15.132:0/546938870 conn(0x7f2ab806a500 msgr2=0x7f2ab80c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 shutdown_connections 2023-11-18T20:41:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.015+0000 7f2abd81f640 1 -- 172.21.15.132:0/546938870 wait complete. 2023-11-18T20:41:41.034 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:41.034 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:41.094 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:41.094 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:41.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:41.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.366+0000 7faa02516640 1 Processor -- start 2023-11-18T20:41:41.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.367+0000 7faa02516640 1 -- start start 2023-11-18T20:41:41.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.368+0000 7faa02516640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc14c2e0 0x7fa9fc0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.368+0000 7faa02516640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa9fc0c0440 0x7fa9fc152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.368+0000 7faa02516640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa9fc072310 0x7fa9fc0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.368+0000 7faa02516640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc071470 con 0x7fa9fc072310 2023-11-18T20:41:41.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.368+0000 7faa02516640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc071e80 con 0x7fa9fc0c0440 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.368+0000 7faa02516640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc14c6c0 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.368+0000 7faa01d15640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa9fc072310 0x7fa9fc0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa01d15640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa9fc072310 0x7fa9fc0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50412/0 (socket says 172.21.15.132:50412) 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa01d15640 1 -- 172.21.15.132:0/3295643238 learned_addr learned my addr 172.21.15.132:0/3295643238 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa00d13640 1 --2- 172.21.15.132:0/3295643238 >> v2:172.21.15.161:3300/0 conn(0x7fa9fc0c0440 0x7fa9fc152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa01514640 1 --2- 172.21.15.132:0/3295643238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc14c2e0 0x7fa9fc0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa01d15640 1 -- 172.21.15.132:0/3295643238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc14c2e0 msgr2=0x7fa9fc0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa01d15640 1 --2- 172.21.15.132:0/3295643238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc14c2e0 0x7fa9fc0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa01d15640 1 -- 172.21.15.132:0/3295643238 >> v2:172.21.15.161:3300/0 conn(0x7fa9fc0c0440 msgr2=0x7fa9fc152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:41.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa01d15640 1 --2- 172.21.15.132:0/3295643238 >> v2:172.21.15.161:3300/0 conn(0x7fa9fc0c0440 0x7fa9fc152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.369+0000 7faa01d15640 1 -- 172.21.15.132:0/3295643238 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc153180 con 0x7fa9fc072310 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.370+0000 7faa01d15640 1 --2- 172.21.15.132:0/3295643238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc072310 0x7fa9fc0a4d20 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc06b500 tx=0x7fa9f402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e472df9351a095f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.371+0000 7fa9f3fff640 1 -- 172.21.15.132:0/3295643238 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f402c950 con 0x7fa9fc072310 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.371+0000 7fa9f3fff640 1 -- 172.21.15.132:0/3295643238 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f402cab0 con 0x7fa9fc072310 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.371+0000 7fa9f3fff640 1 -- 172.21.15.132:0/3295643238 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f402ce40 con 0x7fa9fc072310 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.371+0000 7faa02516640 1 -- 172.21.15.132:0/3295643238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc072310 msgr2=0x7fa9fc0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.371+0000 7faa02516640 1 --2- 172.21.15.132:0/3295643238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc072310 0x7fa9fc0a4d20 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc06b500 tx=0x7fa9f402bdb0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.372+0000 7faa02516640 1 -- 172.21.15.132:0/3295643238 shutdown_connections 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.372+0000 7faa02516640 1 --2- 172.21.15.132:0/3295643238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc072310 0x7fa9fc0a4d20 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.372+0000 7faa02516640 1 --2- 172.21.15.132:0/3295643238 >> v2:172.21.15.161:3300/0 conn(0x7fa9fc0c0440 0x7fa9fc152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.372+0000 7faa02516640 1 --2- 172.21.15.132:0/3295643238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc14c2e0 0x7fa9fc0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.372+0000 7faa02516640 1 -- 172.21.15.132:0/3295643238 >> 172.21.15.132:0/3295643238 conn(0x7fa9fc0a77f0 msgr2=0x7fa9fc0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:41.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.372+0000 7faa02516640 1 -- 172.21.15.132:0/3295643238 shutdown_connections 2023-11-18T20:41:41.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.372+0000 7faa02516640 1 -- 172.21.15.132:0/3295643238 wait complete. 2023-11-18T20:41:41.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.374+0000 7faa02516640 1 Processor -- start 2023-11-18T20:41:41.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.374+0000 7faa02516640 1 -- start start 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.375+0000 7faa02516640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9fc072310 0x7fa9fc0a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.375+0000 7faa02516640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc0c0440 0x7fa9fc0a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.375+0000 7faa02516640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc14c2e0 0x7fa9fc1f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.375+0000 7faa02516640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc14fa90 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.375+0000 7faa02516640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc14cd00 con 0x7fa9fc072310 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.375+0000 7faa02516640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc14f4d0 con 0x7fa9fc0c0440 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc14c2e0 0x7fa9fc1f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc14c2e0 0x7fa9fc1f1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50428/0 (socket says 172.21.15.132:50428) 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 -- 172.21.15.132:0/3005693957 learned_addr learned my addr 172.21.15.132:0/3005693957 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:41.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01514640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9fc072310 0x7fa9fc0a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa00d13640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc0c0440 0x7fa9fc0a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 -- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc0c0440 msgr2=0x7fa9fc0a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc0c0440 0x7fa9fc0a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 -- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9fc072310 msgr2=0x7fa9fc0a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9fc072310 0x7fa9fc0a9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 -- 172.21.15.132:0/3005693957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4009b30 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.376+0000 7faa01d15640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc14c2e0 0x7fa9fc1f1300 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4036040 tx=0x7fa9f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.377+0000 7fa9f1ffb640 1 -- 172.21.15.132:0/3005693957 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f403e450 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.377+0000 7fa9f1ffb640 1 -- 172.21.15.132:0/3005693957 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f403e5b0 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.377+0000 7fa9f1ffb640 1 -- 172.21.15.132:0/3005693957 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f403e960 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.377+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc14f7b0 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.377+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc14f1c0 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.378+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc14ce70 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.379+0000 7fa9f1ffb640 1 -- 172.21.15.132:0/3005693957 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9f403eac0 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.380+0000 7fa9f1ffb640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa9e006ae70 0x7fa9e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.380+0000 7fa9f1ffb640 1 -- 172.21.15.132:0/3005693957 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa9f40ac500 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.381+0000 7faa01514640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa9e006ae70 0x7fa9e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.382+0000 7faa01514640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa9e006ae70 0x7fa9e006d330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8006fd0 tx=0x7fa9f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:41.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.384+0000 7fa9f1ffb640 1 -- 172.21.15.132:0/3005693957 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9f40772e0 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.576+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9fc04e840 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.577+0000 7fa9f1ffb640 1 -- 172.21.15.132:0/3005693957 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+20262 (secure 0 0 0) 0x7fa9f4047e90 con 0x7fa9fc14c2e0 2023-11-18T20:41:41.579 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:41.579 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":80,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:36.459020+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa9e006ae70 msgr2=0x7fa9e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa9e006ae70 0x7fa9e006d330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8006fd0 tx=0x7fa9f8008040 comp rx=0 tx=0).stop 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc14c2e0 msgr2=0x7fa9fc1f1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc14c2e0 0x7fa9fc1f1300 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4036040 tx=0x7fa9f4004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 shutdown_connections 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa9e006ae70 0x7fa9e006d330 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9fc14c2e0 0x7fa9fc1f1300 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9fc0c0440 0x7fa9fc0a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 --2- 172.21.15.132:0/3005693957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9fc072310 0x7fa9fc0a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 >> 172.21.15.132:0/3005693957 conn(0x7fa9fc0a77f0 msgr2=0x7fa9fc149aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 shutdown_connections 2023-11-18T20:41:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.580+0000 7faa02516640 1 -- 172.21.15.132:0/3005693957 wait complete. 2023-11-18T20:41:41.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:41:17.894376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:41:18.520471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:41:33.270522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:41:33.924631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:41:41.599 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:41:41.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.804+0000 7f037d578640 1 Processor -- start 2023-11-18T20:41:41.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.804+0000 7f037d578640 1 -- start start 2023-11-18T20:41:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.805+0000 7f037d578640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0378155490 0x7f03780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.805+0000 7f037d578640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03780a9b40 0x7f03780c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.805+0000 7f037d578640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780c06c0 con 0x7f03780c1500 2023-11-18T20:41:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.805+0000 7f037d578640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780a5820 con 0x7f0378155490 2023-11-18T20:41:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.805+0000 7f037d578640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780c1020 con 0x7f03780a9b40 2023-11-18T20:41:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f03767fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f03780c1500 0x7f03780a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48586/0 (socket says 172.21.15.132:48586) 2023-11-18T20:41:41.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f03767fc640 1 -- 172.21.15.132:0/2920160115 learned_addr learned my addr 172.21.15.132:0/2920160115 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0376ffd640 1 --2- 172.21.15.132:0/2920160115 >> v2:172.21.15.161:3300/0 conn(0x7f0378155490 0x7f03780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596845485 0 0) 0x7f03780c06c0 con 0x7f03780c1500 2023-11-18T20:41:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0360005730 con 0x7f03780c1500 2023-11-18T20:41:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f03777fe640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03780a9b40 0x7f03780c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701659271 0 0) 0x7f0360005730 con 0x7f03780c1500 2023-11-18T20:41:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03780a9b40 msgr2=0x7f03780c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:41.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03780a9b40 0x7f03780c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 >> v2:172.21.15.161:3300/0 conn(0x7f0378155490 msgr2=0x7f03780a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 --2- 172.21.15.132:0/2920160115 >> v2:172.21.15.161:3300/0 conn(0x7f0378155490 0x7f03780a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780c0910 con 0x7f03780c1500 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f036c001670 con 0x7f03780c1500 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0376ffd640 1 --2- 172.21.15.132:0/2920160115 >> v2:172.21.15.161:3300/0 conn(0x7f0378155490 0x7f03780a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.806+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 >> v1:172.21.15.132:6789/0 conn(0x7f03780c1500 legacy=0x7f03780a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f0375ffb640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0360005b80 0x7f0360005f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f0375ffb640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0360006590 0x7f0360006a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f0375ffb640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0360007190 0x7f036000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780c1020 con 0x7f0360006590 2023-11-18T20:41:41.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036000e0d0 con 0x7f0360007190 2023-11-18T20:41:41.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036000e210 con 0x7f0360005b80 2023-11-18T20:41:41.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f03767fc640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0360006590 0x7f0360006a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f03767fc640 1 -- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0360005b80 msgr2=0x7f0360005f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:41.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f03767fc640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0360005b80 0x7f0360005f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f03767fc640 1 -- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0360007190 msgr2=0x7f036000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:41.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f03767fc640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0360007190 0x7f036000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.807+0000 7f03767fc640 1 -- 172.21.15.132:0/2920160115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0360005730 con 0x7f0360006590 2023-11-18T20:41:41.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.808+0000 7f03767fc640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0360006590 0x7f0360006a70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f036c00c290 tx=0x7f0360007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2f520492a766ee server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c005ad0 con 0x7f0360006590 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c005c50 con 0x7f0360006590 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f0375ffb640 1 -- 172.21.15.132:0/2920160115 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c02c8d0 con 0x7f0360006590 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f037d578640 1 -- 172.21.15.132:0/2920160115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0360006590 msgr2=0x7f0360006a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f037d578640 1 --2- 172.21.15.132:0/2920160115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0360006590 0x7f0360006a70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f036c00c290 tx=0x7f0360007a00 comp rx=0 tx=0).stop 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f03777fe640 1 -- 172.21.15.132:0/2920160115 reap_dead start 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f037d578640 1 -- 172.21.15.132:0/2920160115 shutdown_connections 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f037d578640 1 -- 172.21.15.132:0/2920160115 >> 172.21.15.132:0/2920160115 conn(0x7f037806a500 msgr2=0x7f037806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f037d578640 1 -- 172.21.15.132:0/2920160115 shutdown_connections 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.809+0000 7f037d578640 1 -- 172.21.15.132:0/2920160115 wait complete. 2023-11-18T20:41:41.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.811+0000 7f037d578640 1 Processor -- start 2023-11-18T20:41:41.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.811+0000 7f037d578640 1 -- start start 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f037d578640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0378153400 0x7f03780a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f037d578640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037809a560 0x7f0378150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f037d578640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03781512d0 0x7f03781ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f037d578640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037809d370 con 0x7f03781512d0 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f037d578640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378151780 con 0x7f037809a560 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f037d578640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03781ea3a0 con 0x7f0378153400 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f03777fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03781512d0 0x7f03781ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f03777fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03781512d0 0x7f03781ecce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50434/0 (socket says 172.21.15.132:50434) 2023-11-18T20:41:41.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.812+0000 7f03777fe640 1 -- 172.21.15.132:0/620288448 learned_addr learned my addr 172.21.15.132:0/620288448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f0376ffd640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0378153400 0x7f03780a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f03767fc640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037809a560 0x7f0378150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f03777fe640 1 -- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0378153400 msgr2=0x7f03780a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f03777fe640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0378153400 0x7f03780a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f03777fe640 1 -- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037809a560 msgr2=0x7f0378150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f03777fe640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037809a560 0x7f0378150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f03777fe640 1 -- 172.21.15.132:0/620288448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03781e9800 con 0x7f03781512d0 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f03767fc640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037809a560 0x7f0378150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f03777fe640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03781512d0 0x7f03781ecce0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0378067240 tx=0x7f037000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f035f7fe640 1 -- 172.21.15.132:0/620288448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000ed90 con 0x7f03781512d0 2023-11-18T20:41:41.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f035f7fe640 1 -- 172.21.15.132:0/620288448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370014420 con 0x7f03781512d0 2023-11-18T20:41:41.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f035f7fe640 1 -- 172.21.15.132:0/620288448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03700147d0 con 0x7f03781512d0 2023-11-18T20:41:41.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03781e9a70 con 0x7f03781512d0 2023-11-18T20:41:41.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.813+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03781ea030 con 0x7f03781512d0 2023-11-18T20:41:41.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.815+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03781ea510 con 0x7f03781512d0 2023-11-18T20:41:41.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.815+0000 7f035f7fe640 1 -- 172.21.15.132:0/620288448 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0370014930 con 0x7f03781512d0 2023-11-18T20:41:41.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.816+0000 7f035f7fe640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f036406ae40 0x7f036406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:41.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.816+0000 7f035f7fe640 1 -- 172.21.15.132:0/620288448 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0370089c80 con 0x7f03781512d0 2023-11-18T20:41:41.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.817+0000 7f0376ffd640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f036406ae40 0x7f036406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:41.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.818+0000 7f0376ffd640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f036406ae40 0x7f036406d300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0368006a90 tx=0x7f0368008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:41.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.820+0000 7f035f7fe640 1 -- 172.21.15.132:0/620288448 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0370054a60 con 0x7f03781512d0 2023-11-18T20:41:41.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.997+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0378068350 con 0x7f03781512d0 2023-11-18T20:41:41.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:41.998+0000 7f035f7fe640 1 -- 172.21.15.132:0/620288448 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0370058080 con 0x7f03781512d0 2023-11-18T20:41:41.999 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f036406ae40 msgr2=0x7f036406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f036406ae40 0x7f036406d300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0368006a90 tx=0x7f0368008040 comp rx=0 tx=0).stop 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03781512d0 msgr2=0x7f03781ecce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03781512d0 0x7f03781ecce0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0378067240 tx=0x7f037000e4b0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 shutdown_connections 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f036406ae40 0x7f036406d300 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03781512d0 0x7f03781ecce0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037809a560 0x7f0378150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 --2- 172.21.15.132:0/620288448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0378153400 0x7f03780a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.000+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 >> 172.21.15.132:0/620288448 conn(0x7f037806a500 msgr2=0x7f03780a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:42.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.001+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 shutdown_connections 2023-11-18T20:41:42.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.001+0000 7f037d578640 1 -- 172.21.15.132:0/620288448 wait complete. 2023-11-18T20:41:42.020 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:41:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.232+0000 7f9dbe283640 1 Processor -- start 2023-11-18T20:41:42.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.232+0000 7f9dbe283640 1 -- start start 2023-11-18T20:41:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9dbe283640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9db80c45d0 0x7f9db8155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9dbe283640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db8156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9dbe283640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db80bfdc0 con 0x7f9db80c5ec0 2023-11-18T20:41:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9dbe283640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db806e390 con 0x7f9db80c45d0 2023-11-18T20:41:42.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9dbe283640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db806ddd0 con 0x7f9db80c3340 2023-11-18T20:41:42.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9db77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9db80c45d0 0x7f9db8155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9db77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9db80c45d0 0x7f9db8155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50446/0 (socket says 172.21.15.132:50446) 2023-11-18T20:41:42.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9db77fe640 1 -- 172.21.15.132:0/1798289003 learned_addr learned my addr 172.21.15.132:0/1798289003 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:42.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.234+0000 7f9dbc820640 1 --2- 172.21.15.132:0/1798289003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.235+0000 7f9db77fe640 1 -- 172.21.15.132:0/1798289003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 msgr2=0x7f9db8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:42.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.235+0000 7f9db77fe640 1 --2- 172.21.15.132:0/1798289003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db8156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.235+0000 7f9db77fe640 1 -- 172.21.15.132:0/1798289003 >> v1:172.21.15.132:6789/0 conn(0x7f9db80c5ec0 legacy=0x7f9db80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.235+0000 7f9db77fe640 1 -- 172.21.15.132:0/1798289003 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db806e0b0 con 0x7f9db80c45d0 2023-11-18T20:41:42.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.236+0000 7f9db77fe640 1 --2- 172.21.15.132:0/1798289003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db8155e30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0098a0 tx=0x7f9dac02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a04d0f87c55fadc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:42.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.236+0000 7f9db6ffd640 1 -- 172.21.15.132:0/1798289003 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0317c0 con 0x7f9db80c45d0 2023-11-18T20:41:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.236+0000 7f9db6ffd640 1 -- 172.21.15.132:0/1798289003 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac031920 con 0x7f9db80c45d0 2023-11-18T20:41:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.236+0000 7f9db6ffd640 1 -- 172.21.15.132:0/1798289003 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac031cb0 con 0x7f9db80c45d0 2023-11-18T20:41:42.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.237+0000 7f9dbe283640 1 -- 172.21.15.132:0/1798289003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 msgr2=0x7f9db8155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.237+0000 7f9dbe283640 1 --2- 172.21.15.132:0/1798289003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db8155e30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0098a0 tx=0x7f9dac02b860 comp rx=0 tx=0).stop 2023-11-18T20:41:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.237+0000 7f9dbe283640 1 -- 172.21.15.132:0/1798289003 shutdown_connections 2023-11-18T20:41:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.237+0000 7f9dbe283640 1 --2- 172.21.15.132:0/1798289003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.237+0000 7f9dbe283640 1 --2- 172.21.15.132:0/1798289003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db8155e30 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.237+0000 7f9dbe283640 1 -- 172.21.15.132:0/1798289003 >> 172.21.15.132:0/1798289003 conn(0x7f9db806a500 msgr2=0x7f9db806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.237+0000 7f9dbe283640 1 -- 172.21.15.132:0/1798289003 shutdown_connections 2023-11-18T20:41:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.237+0000 7f9dbe283640 1 -- 172.21.15.132:0/1798289003 wait complete. 2023-11-18T20:41:42.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.239+0000 7f9dbe283640 1 Processor -- start 2023-11-18T20:41:42.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.239+0000 7f9dbe283640 1 -- start start 2023-11-18T20:41:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.240+0000 7f9dbe283640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db80a7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.240+0000 7f9dbe283640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db814f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.240+0000 7f9dbe283640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80c5ec0 0x7f9db81ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.240+0000 7f9dbe283640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db814b580 con 0x7f9db80c45d0 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.240+0000 7f9dbe283640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db814b860 con 0x7f9db80c5ec0 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.240+0000 7f9dbe283640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80a7370 con 0x7f9db80c3340 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db814f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db814f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50448/0 (socket says 172.21.15.132:50448) 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 -- 172.21.15.132:0/3732869400 learned_addr learned my addr 172.21.15.132:0/3732869400 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db7fff640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db80a7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9dbc820640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80c5ec0 0x7f9db81ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 -- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 msgr2=0x7f9db80a7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db80a7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 -- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80c5ec0 msgr2=0x7f9db81ea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80c5ec0 0x7f9db81ea240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 -- 172.21.15.132:0/3732869400 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0094d0 con 0x7f9db80c45d0 2023-11-18T20:41:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db7fff640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db80a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:42.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.241+0000 7f9db77fe640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db814f8c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0090b0 tx=0x7f9dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.242+0000 7f9db4ff9640 1 -- 172.21.15.132:0/3732869400 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac032860 con 0x7f9db80c45d0 2023-11-18T20:41:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.242+0000 7f9db4ff9640 1 -- 172.21.15.132:0/3732869400 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac0329e0 con 0x7f9db80c45d0 2023-11-18T20:41:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.242+0000 7f9db4ff9640 1 -- 172.21.15.132:0/3732869400 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac032d90 con 0x7f9db80c45d0 2023-11-18T20:41:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.242+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db80a7650 con 0x7f9db80c45d0 2023-11-18T20:41:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.242+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db80a83e0 con 0x7f9db80c45d0 2023-11-18T20:41:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.243+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db80a71d0 con 0x7f9db80c45d0 2023-11-18T20:41:42.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.244+0000 7f9db4ff9640 1 -- 172.21.15.132:0/3732869400 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9dac04e450 con 0x7f9db80c45d0 2023-11-18T20:41:42.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.245+0000 7f9db4ff9640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9da406ae40 0x7f9da406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.245+0000 7f9db4ff9640 1 -- 172.21.15.132:0/3732869400 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9dac0abba0 con 0x7f9db80c45d0 2023-11-18T20:41:42.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.246+0000 7f9db7fff640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9da406ae40 0x7f9da406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.247+0000 7f9db7fff640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9da406ae40 0x7f9da406d300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000f60 tx=0x7f9da8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:42.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.249+0000 7f9db4ff9640 1 -- 172.21.15.132:0/3732869400 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9db80a71d0 con 0x7f9db80c45d0 2023-11-18T20:41:42.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.438+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9db80a71d0 con 0x7f9db80c45d0 2023-11-18T20:41:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.439+0000 7f9db4ff9640 1 -- 172.21.15.132:0/3732869400 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9db80a71d0 con 0x7f9db80c45d0 2023-11-18T20:41:42.440 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9da406ae40 msgr2=0x7f9da406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9da406ae40 0x7f9da406d300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000f60 tx=0x7f9da8009040 comp rx=0 tx=0).stop 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 msgr2=0x7f9db814f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db814f8c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0090b0 tx=0x7f9dac0046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 shutdown_connections 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9da406ae40 0x7f9da406d300 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80c5ec0 0x7f9db81ea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9db80c45d0 0x7f9db814f8c0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 --2- 172.21.15.132:0/3732869400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db80c3340 0x7f9db80a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.441+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 >> 172.21.15.132:0/3732869400 conn(0x7f9db806a500 msgr2=0x7f9db8070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.442+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 shutdown_connections 2023-11-18T20:41:42.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.442+0000 7f9dbe283640 1 -- 172.21.15.132:0/3732869400 wait complete. 2023-11-18T20:41:42.460 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:41:42.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.675+0000 7fb519fc4640 1 Processor -- start 2023-11-18T20:41:42.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.675+0000 7fb519fc4640 1 -- start start 2023-11-18T20:41:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.677+0000 7fb519fc4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb51414e7f0 0x7fb5140c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.677+0000 7fb519fc4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb51406cd20 0x7fb51415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.677+0000 7fb519fc4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5140a8380 con 0x7fb5140c52e0 2023-11-18T20:41:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.677+0000 7fb519fc4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5141510b0 con 0x7fb51406cd20 2023-11-18T20:41:42.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.677+0000 7fb519fc4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51406bf60 con 0x7fb51414e7f0 2023-11-18T20:41:42.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.678+0000 7fb5197c3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb51406cd20 0x7fb51415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.678+0000 7fb5197c3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb51406cd20 0x7fb51415ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:54924/0 (socket says 172.21.15.132:54924) 2023-11-18T20:41:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.678+0000 7fb5197c3640 1 -- 172.21.15.132:0/1706900272 learned_addr learned my addr 172.21.15.132:0/1706900272 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.678+0000 7fb518fc2640 1 --2- 172.21.15.132:0/1706900272 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb51414e7f0 0x7fb5140c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.678+0000 7fb5197c3640 1 -- 172.21.15.132:0/1706900272 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb51414e7f0 msgr2=0x7fb5140c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.678+0000 7fb5197c3640 1 --2- 172.21.15.132:0/1706900272 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb51414e7f0 0x7fb5140c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.678+0000 7fb5197c3640 1 -- 172.21.15.132:0/1706900272 >> v1:172.21.15.161:6789/0 conn(0x7fb5140c52e0 legacy=0x7fb51406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.678+0000 7fb5197c3640 1 -- 172.21.15.132:0/1706900272 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51406c240 con 0x7fb51406cd20 2023-11-18T20:41:42.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.680+0000 7fb5197c3640 1 --2- 172.21.15.132:0/1706900272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 0x7fb51415ba30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00d150 tx=0x7fb50c02e0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155142fd3ec56d4c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:42.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.680+0000 7fb50b7fe640 1 -- 172.21.15.132:0/1706900272 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c02ea70 con 0x7fb51406cd20 2023-11-18T20:41:42.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.680+0000 7fb50b7fe640 1 -- 172.21.15.132:0/1706900272 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c02ebd0 con 0x7fb51406cd20 2023-11-18T20:41:42.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.680+0000 7fb50b7fe640 1 -- 172.21.15.132:0/1706900272 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c009600 con 0x7fb51406cd20 2023-11-18T20:41:42.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.681+0000 7fb519fc4640 1 -- 172.21.15.132:0/1706900272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 msgr2=0x7fb51415ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.681+0000 7fb519fc4640 1 --2- 172.21.15.132:0/1706900272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 0x7fb51415ba30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00d150 tx=0x7fb50c02e0d0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.681+0000 7fb519fc4640 1 -- 172.21.15.132:0/1706900272 shutdown_connections 2023-11-18T20:41:42.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.681+0000 7fb519fc4640 1 --2- 172.21.15.132:0/1706900272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 0x7fb51415ba30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.681+0000 7fb519fc4640 1 --2- 172.21.15.132:0/1706900272 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb51414e7f0 0x7fb5140c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.681+0000 7fb519fc4640 1 -- 172.21.15.132:0/1706900272 >> 172.21.15.132:0/1706900272 conn(0x7fb5140a77f0 msgr2=0x7fb5140a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:42.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.681+0000 7fb519fc4640 1 -- 172.21.15.132:0/1706900272 shutdown_connections 2023-11-18T20:41:42.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.681+0000 7fb519fc4640 1 -- 172.21.15.132:0/1706900272 wait complete. 2023-11-18T20:41:42.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.683+0000 7fb519fc4640 1 Processor -- start 2023-11-18T20:41:42.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.683+0000 7fb519fc4640 1 -- start start 2023-11-18T20:41:42.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb519fc4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 0x7fb514071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb519fc4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5140c52e0 0x7fb51414c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb519fc4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb51414e7f0 0x7fb51414c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb519fc4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5141e9e70 con 0x7fb51414e7f0 2023-11-18T20:41:42.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb519fc4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5141eac90 con 0x7fb51406cd20 2023-11-18T20:41:42.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb519fc4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb514148610 con 0x7fb5140c52e0 2023-11-18T20:41:42.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb5197c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb51414e7f0 0x7fb51414c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb5197c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb51414e7f0 0x7fb51414c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50462/0 (socket says 172.21.15.132:50462) 2023-11-18T20:41:42.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.684+0000 7fb5197c3640 1 -- 172.21.15.132:0/3008356903 learned_addr learned my addr 172.21.15.132:0/3008356903 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:42.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb518fc2640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 0x7fb514071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb50bfff640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5140c52e0 0x7fb51414c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5197c3640 1 -- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5140c52e0 msgr2=0x7fb51414c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5197c3640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5140c52e0 0x7fb51414c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5197c3640 1 -- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 msgr2=0x7fb514071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5197c3640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 0x7fb514071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5197c3640 1 -- 172.21.15.132:0/3008356903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c00bd40 con 0x7fb51414e7f0 2023-11-18T20:41:42.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb50bfff640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5140c52e0 0x7fb51414c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:42.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5197c3640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb51414e7f0 0x7fb51414c700 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fb50c038040 tx=0x7fb50c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:42.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5097fa640 1 -- 172.21.15.132:0/3008356903 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c02ea70 con 0x7fb51414e7f0 2023-11-18T20:41:42.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5097fa640 1 -- 172.21.15.132:0/3008356903 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c036820 con 0x7fb51414e7f0 2023-11-18T20:41:42.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb5097fa640 1 -- 172.21.15.132:0/3008356903 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c036bd0 con 0x7fb51414e7f0 2023-11-18T20:41:42.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.685+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5141ea080 con 0x7fb51414e7f0 2023-11-18T20:41:42.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.686+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5141ea640 con 0x7fb51414e7f0 2023-11-18T20:41:42.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.687+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5140a8750 con 0x7fb51414e7f0 2023-11-18T20:41:42.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.688+0000 7fb5097fa640 1 -- 172.21.15.132:0/3008356903 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb50c036d30 con 0x7fb51414e7f0 2023-11-18T20:41:42.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.689+0000 7fb5097fa640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb50006ae70 0x7fb50006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:42.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.689+0000 7fb5097fa640 1 -- 172.21.15.132:0/3008356903 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb50c0acae0 con 0x7fb51414e7f0 2023-11-18T20:41:42.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.689+0000 7fb518fc2640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb50006ae70 0x7fb50006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:42.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.690+0000 7fb518fc2640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb50006ae70 0x7fb50006d330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb5140a4e30 tx=0x7fb510008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:42.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.693+0000 7fb5097fa640 1 -- 172.21.15.132:0/3008356903 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb50c077960 con 0x7fb51414e7f0 2023-11-18T20:41:42.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.882+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb51404e840 con 0x7fb51414e7f0 2023-11-18T20:41:42.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.883+0000 7fb5097fa640 1 -- 172.21.15.132:0/3008356903 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb50c035e80 con 0x7fb51414e7f0 2023-11-18T20:41:42.884 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:41:42.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb50006ae70 msgr2=0x7fb50006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb50006ae70 0x7fb50006d330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb5140a4e30 tx=0x7fb510008040 comp rx=0 tx=0).stop 2023-11-18T20:41:42.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb51414e7f0 msgr2=0x7fb51414c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb51414e7f0 0x7fb51414c700 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fb50c038040 tx=0x7fb50c004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 shutdown_connections 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb50006ae70 0x7fb50006d330 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb51414e7f0 0x7fb51414c700 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5140c52e0 0x7fb51414c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 --2- 172.21.15.132:0/3008356903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb51406cd20 0x7fb514071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 >> 172.21.15.132:0/3008356903 conn(0x7fb5140a77f0 msgr2=0x7fb5140c0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 shutdown_connections 2023-11-18T20:41:42.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:42.886+0000 7fb519fc4640 1 -- 172.21.15.132:0/3008356903 wait complete. 2023-11-18T20:41:42.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:41:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.125+0000 7f9c44cd1640 1 Processor -- start 2023-11-18T20:41:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.125+0000 7f9c44cd1640 1 -- start start 2023-11-18T20:41:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.126+0000 7f9c44cd1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4006cd20 0x7f9c4015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.126+0000 7f9c44cd1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c400a8380 con 0x7f9c4014e7f0 2023-11-18T20:41:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.126+0000 7f9c44cd1640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c401510b0 con 0x7f9c400c52e0 2023-11-18T20:41:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.126+0000 7f9c44cd1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4006bf60 con 0x7f9c4006cd20 2023-11-18T20:41:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.127+0000 7f9c3f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9c4014e7f0 0x7f9c400c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48606/0 (socket says 172.21.15.132:48606) 2023-11-18T20:41:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.127+0000 7f9c3f7fe640 1 -- 172.21.15.132:0/1432591691 learned_addr learned my addr 172.21.15.132:0/1432591691 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.127+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986210524 0 0) 0x7f9c400a8380 con 0x7f9c4014e7f0 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.127+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c2c003520 con 0x7f9c4014e7f0 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.127+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3800872369 0 0) 0x7f9c2c003520 con 0x7f9c4014e7f0 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.127+0000 7f9c3ffff640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4006cd20 0x7f9c4015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.127+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4006cd20 msgr2=0x7f9c4015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4006cd20 0x7f9c4015ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 >> v1:172.21.15.161:6789/0 conn(0x7f9c400c52e0 legacy=0x7f9c4006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4006c240 con 0x7f9c4014e7f0 2023-11-18T20:41:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f9c30001670 con 0x7f9c4014e7f0 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 >> v1:172.21.15.132:6789/0 conn(0x7f9c4014e7f0 legacy=0x7f9c400c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c2c0039a0 0x7f9c2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4006cd20 0x7f9c2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2c004e20 0x7f9c2c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4006bf60 con 0x7f9c2c0039a0 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c005540 con 0x7f9c2c004e20 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c00e0d0 con 0x7f9c4006cd20 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3f7fe640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c2c0039a0 0x7f9c2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3f7fe640 1 -- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4006cd20 msgr2=0x7f9c2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3f7fe640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4006cd20 0x7f9c2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3f7fe640 1 -- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2c004e20 msgr2=0x7f9c2c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3f7fe640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2c004e20 0x7f9c2c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.128+0000 7f9c3f7fe640 1 -- 172.21.15.132:0/1432591691 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c003520 con 0x7f9c2c0039a0 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.129+0000 7f9c3f7fe640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c2c0039a0 0x7f9c2c003dc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000c240 tx=0x7f9c2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60921a9cae187a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30005ad0 con 0x7f9c2c0039a0 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c30005c30 con 0x7f9c2c0039a0 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c3effd640 1 -- 172.21.15.132:0/1432591691 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3002c8b0 con 0x7f9c2c0039a0 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1432591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c2c0039a0 msgr2=0x7f9c2c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c44cd1640 1 --2- 172.21.15.132:0/1432591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c2c0039a0 0x7f9c2c003dc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000c240 tx=0x7f9c2c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c3ffff640 1 -- 172.21.15.132:0/1432591691 reap_dead start 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1432591691 shutdown_connections 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1432591691 >> 172.21.15.132:0/1432591691 conn(0x7f9c400a77f0 msgr2=0x7f9c400a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1432591691 shutdown_connections 2023-11-18T20:41:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.130+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1432591691 wait complete. 2023-11-18T20:41:43.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.132+0000 7f9c44cd1640 1 Processor -- start 2023-11-18T20:41:43.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.132+0000 7f9c44cd1640 1 -- start start 2023-11-18T20:41:43.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.133+0000 7f9c44cd1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2c0039a0 0x7f9c4014d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.133+0000 7f9c44cd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c40143410 0x7f9c40150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.133+0000 7f9c44cd1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4014db40 0x7f9c40150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.133+0000 7f9c44cd1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40150150 con 0x7f9c40143410 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.133+0000 7f9c44cd1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4014fe00 con 0x7f9c2c0039a0 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.133+0000 7f9c44cd1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4014ab70 con 0x7f9c4014db40 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c40143410 0x7f9c40150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c40143410 0x7f9c40150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50478/0 (socket says 172.21.15.132:50478) 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 -- 172.21.15.132:0/1590795420 learned_addr learned my addr 172.21.15.132:0/1590795420 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c3f7fe640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2c0039a0 0x7f9c4014d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c3ffff640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4014db40 0x7f9c40150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 -- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4014db40 msgr2=0x7f9c40150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4014db40 0x7f9c40150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 -- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2c0039a0 msgr2=0x7f9c4014d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2c0039a0 0x7f9c4014d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 -- 172.21.15.132:0/1590795420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c401e67b0 con 0x7f9c40143410 2023-11-18T20:41:43.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.134+0000 7f9c37fff640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c40143410 0x7f9c40150570 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c460 tx=0x7f9c2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:43.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.135+0000 7f9c3cff9640 1 -- 172.21.15.132:0/1590795420 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c280052d0 con 0x7f9c40143410 2023-11-18T20:41:43.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.135+0000 7f9c3cff9640 1 -- 172.21.15.132:0/1590795420 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c28005450 con 0x7f9c40143410 2023-11-18T20:41:43.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.135+0000 7f9c3cff9640 1 -- 172.21.15.132:0/1590795420 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28003830 con 0x7f9c40143410 2023-11-18T20:41:43.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.135+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c401e6a90 con 0x7f9c40143410 2023-11-18T20:41:43.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.135+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c40071020 con 0x7f9c40143410 2023-11-18T20:41:43.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.136+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4004e840 con 0x7f9c40143410 2023-11-18T20:41:43.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.137+0000 7f9c3cff9640 1 -- 172.21.15.132:0/1590795420 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c28003990 con 0x7f9c40143410 2023-11-18T20:41:43.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.138+0000 7f9c3cff9640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c2006ae70 0x7f9c2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.138+0000 7f9c3cff9640 1 -- 172.21.15.132:0/1590795420 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9c28088e70 con 0x7f9c40143410 2023-11-18T20:41:43.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.138+0000 7f9c3f7fe640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c2006ae70 0x7f9c2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.139+0000 7f9c3f7fe640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c2006ae70 0x7f9c2006d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9c30034000 tx=0x7f9c30009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:43.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.143+0000 7f9c3cff9640 1 -- 172.21.15.132:0/1590795420 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c28053bb0 con 0x7f9c40143410 2023-11-18T20:41:43.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.333+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c401554b0 con 0x7f9c40143410 2023-11-18T20:41:43.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.334+0000 7f9c3cff9640 1 -- 172.21.15.132:0/1590795420 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v80) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9c280170b0 con 0x7f9c40143410 2023-11-18T20:41:43.335 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:41:43.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c2006ae70 msgr2=0x7f9c2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c2006ae70 0x7f9c2006d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9c30034000 tx=0x7f9c30009030 comp rx=0 tx=0).stop 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c40143410 msgr2=0x7f9c40150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c40143410 0x7f9c40150570 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c460 tx=0x7f9c2800c920 comp rx=0 tx=0).stop 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 shutdown_connections 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9c2006ae70 0x7f9c2006d330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c4014db40 0x7f9c40150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c40143410 0x7f9c40150570 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 --2- 172.21.15.132:0/1590795420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2c0039a0 0x7f9c4014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 >> 172.21.15.132:0/1590795420 conn(0x7f9c400a77f0 msgr2=0x7f9c400c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 shutdown_connections 2023-11-18T20:41:43.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.337+0000 7f9c44cd1640 1 -- 172.21.15.132:0/1590795420 wait complete. 2023-11-18T20:41:43.358 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:41:43.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.580+0000 7f2279602640 1 Processor -- start 2023-11-18T20:41:43.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.580+0000 7f2279602640 1 -- start start 2023-11-18T20:41:43.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.582+0000 7f2279602640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f227406d0a0 0x7f2274152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.582+0000 7f2279602640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22740c64a0 con 0x7f22740c3ea0 2023-11-18T20:41:43.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.582+0000 7f2279602640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22740c5c00 con 0x7f227414fd30 2023-11-18T20:41:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.582+0000 7f2279602640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22740c5ee0 con 0x7f227406d0a0 2023-11-18T20:41:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.582+0000 7f22727fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f227406d0a0 0x7f2274152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.582+0000 7f22727fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f227406d0a0 0x7f2274152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50482/0 (socket says 172.21.15.132:50482) 2023-11-18T20:41:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.582+0000 7f22727fc640 1 -- 172.21.15.132:0/1745581464 learned_addr learned my addr 172.21.15.132:0/1745581464 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.583+0000 7f22727fc640 1 -- 172.21.15.132:0/1745581464 >> v1:172.21.15.161:6789/0 conn(0x7f227414fd30 legacy=0x7f22740a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.583+0000 7f22727fc640 1 -- 172.21.15.132:0/1745581464 >> v1:172.21.15.132:6789/0 conn(0x7f22740c3ea0 legacy=0x7f22740c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.583+0000 7f22727fc640 1 -- 172.21.15.132:0/1745581464 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22740c61c0 con 0x7f227406d0a0 2023-11-18T20:41:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.584+0000 7f22727fc640 1 --2- 172.21.15.132:0/1745581464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227406d0a0 0x7f2274152f20 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2268009870 tx=0x7f226802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6641472af64b4490 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.584+0000 7f2271ffb640 1 -- 172.21.15.132:0/1745581464 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268030860 con 0x7f227406d0a0 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.584+0000 7f2271ffb640 1 -- 172.21.15.132:0/1745581464 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22680309c0 con 0x7f227406d0a0 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.584+0000 7f2271ffb640 1 -- 172.21.15.132:0/1745581464 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268030d50 con 0x7f227406d0a0 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.585+0000 7f2279602640 1 -- 172.21.15.132:0/1745581464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227406d0a0 msgr2=0x7f2274152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.585+0000 7f2279602640 1 --2- 172.21.15.132:0/1745581464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227406d0a0 0x7f2274152f20 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2268009870 tx=0x7f226802b9a0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.585+0000 7f2279602640 1 -- 172.21.15.132:0/1745581464 shutdown_connections 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.585+0000 7f2279602640 1 --2- 172.21.15.132:0/1745581464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227406d0a0 0x7f2274152f20 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.585+0000 7f2279602640 1 -- 172.21.15.132:0/1745581464 >> 172.21.15.132:0/1745581464 conn(0x7f227406a500 msgr2=0x7f227406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.585+0000 7f2279602640 1 -- 172.21.15.132:0/1745581464 shutdown_connections 2023-11-18T20:41:43.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.585+0000 7f2279602640 1 -- 172.21.15.132:0/1745581464 wait complete. 2023-11-18T20:41:43.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.587+0000 7f2279602640 1 Processor -- start 2023-11-18T20:41:43.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.587+0000 7f2279602640 1 -- start start 2023-11-18T20:41:43.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f2279602640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f227406d0a0 0x7f2274155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f2279602640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22740c3ea0 0x7f22740c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f2279602640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227414fd30 0x7f22741548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f2279602640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22741eb140 con 0x7f22740c3ea0 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f2279602640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22741eb670 con 0x7f227406d0a0 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f2279602640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227414d0e0 con 0x7f227414fd30 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f22727fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22740c3ea0 0x7f22740c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f22727fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22740c3ea0 0x7f22740c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50484/0 (socket says 172.21.15.132:50484) 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f22727fc640 1 -- 172.21.15.132:0/1706022433 learned_addr learned my addr 172.21.15.132:0/1706022433 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f22727fc640 1 -- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227414fd30 msgr2=0x7f22741548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f22727fc640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227414fd30 0x7f22741548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f22727fc640 1 -- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f227406d0a0 msgr2=0x7f2274155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f2272ffd640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f227406d0a0 0x7f2274155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f22727fc640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f227406d0a0 0x7f2274155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.588+0000 7f22727fc640 1 -- 172.21.15.132:0/1706022433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22680094d0 con 0x7f22740c3ea0 2023-11-18T20:41:43.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.589+0000 7f22727fc640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22740c3ea0 0x7f22740c1710 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f226802b9e0 tx=0x7f2268004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:43.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.589+0000 7f225b7fe640 1 -- 172.21.15.132:0/1706022433 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268030830 con 0x7f22740c3ea0 2023-11-18T20:41:43.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.589+0000 7f225b7fe640 1 -- 172.21.15.132:0/1706022433 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2268039d90 con 0x7f22740c3ea0 2023-11-18T20:41:43.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.589+0000 7f225b7fe640 1 -- 172.21.15.132:0/1706022433 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268043670 con 0x7f22740c3ea0 2023-11-18T20:41:43.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.589+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22740a51a0 con 0x7f22740c3ea0 2023-11-18T20:41:43.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.589+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22740bfc80 con 0x7f22740c3ea0 2023-11-18T20:41:43.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.591+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2274068350 con 0x7f22740c3ea0 2023-11-18T20:41:43.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.591+0000 7f225b7fe640 1 -- 172.21.15.132:0/1706022433 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f226802f3b0 con 0x7f22740c3ea0 2023-11-18T20:41:43.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.593+0000 7f225b7fe640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f226006ae40 0x7f226006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:43.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.593+0000 7f225b7fe640 1 -- 172.21.15.132:0/1706022433 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f22680abe00 con 0x7f22740c3ea0 2023-11-18T20:41:43.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.593+0000 7f2272ffd640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f226006ae40 0x7f226006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:43.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.595+0000 7f2272ffd640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f226006ae40 0x7f226006d300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2264003d90 tx=0x7f2264009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:43.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.597+0000 7f225b7fe640 1 -- 172.21.15.132:0/1706022433 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2268076d00 con 0x7f22740c3ea0 2023-11-18T20:41:43.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.788+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f227414d880 con 0x7f22740c3ea0 2023-11-18T20:41:43.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.789+0000 7f225b7fe640 1 -- 172.21.15.132:0/1706022433 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v80) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2268034020 con 0x7f22740c3ea0 2023-11-18T20:41:43.790 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f226006ae40 msgr2=0x7f226006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f226006ae40 0x7f226006d300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2264003d90 tx=0x7f2264009040 comp rx=0 tx=0).stop 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22740c3ea0 msgr2=0x7f22740c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22740c3ea0 0x7f22740c1710 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f226802b9e0 tx=0x7f2268004730 comp rx=0 tx=0).stop 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 shutdown_connections 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f226006ae40 0x7f226006d300 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227414fd30 0x7f22741548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22740c3ea0 0x7f22740c1710 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 --2- 172.21.15.132:0/1706022433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f227406d0a0 0x7f2274155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 >> 172.21.15.132:0/1706022433 conn(0x7f227406a500 msgr2=0x7f2274152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:43.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.792+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 shutdown_connections 2023-11-18T20:41:43.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:43.793+0000 7f2279602640 1 -- 172.21.15.132:0/1706022433 wait complete. 2023-11-18T20:41:43.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:41:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.029+0000 7f9d4b207640 1 Processor -- start 2023-11-18T20:41:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.030+0000 7f9d4b207640 1 -- start start 2023-11-18T20:41:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.031+0000 7f9d4b207640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4406d0a0 0x7f9d44152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.031+0000 7f9d4b207640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d440c3ea0 0x7f9d440c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.031+0000 7f9d4b207640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d440c64a0 con 0x7f9d4414fd30 2023-11-18T20:41:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.031+0000 7f9d4b207640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d440c5c00 con 0x7f9d440c3ea0 2023-11-18T20:41:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.031+0000 7f9d4b207640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440c5ee0 con 0x7f9d4406d0a0 2023-11-18T20:41:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.032+0000 7f9d497a4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d440c3ea0 0x7f9d440c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.032+0000 7f9d497a4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d440c3ea0 0x7f9d440c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:54968/0 (socket says 172.21.15.132:54968) 2023-11-18T20:41:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.032+0000 7f9d497a4640 1 -- 172.21.15.132:0/3258212857 learned_addr learned my addr 172.21.15.132:0/3258212857 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.032+0000 7f9d43fff640 1 --2- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4406d0a0 0x7f9d44152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.033+0000 7f9d497a4640 1 -- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4406d0a0 msgr2=0x7f9d44152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:44.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.033+0000 7f9d497a4640 1 --2- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4406d0a0 0x7f9d44152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.033+0000 7f9d497a4640 1 -- 172.21.15.132:0/3258212857 >> v1:172.21.15.161:6789/0 conn(0x7f9d4414fd30 legacy=0x7f9d440a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.033+0000 7f9d497a4640 1 -- 172.21.15.132:0/3258212857 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440c61c0 con 0x7f9d440c3ea0 2023-11-18T20:41:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.033+0000 7f9d43fff640 1 --2- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4406d0a0 0x7f9d44152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:41:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.034+0000 7f9d497a4640 1 --2- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 0x7f9d440c4330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009e50 tx=0x7f9d3c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b913c29f9c50ed49 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.035+0000 7f9d437fe640 1 -- 172.21.15.132:0/3258212857 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c02cb00 con 0x7f9d440c3ea0 2023-11-18T20:41:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.035+0000 7f9d437fe640 1 -- 172.21.15.132:0/3258212857 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c02cc60 con 0x7f9d440c3ea0 2023-11-18T20:41:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.035+0000 7f9d437fe640 1 -- 172.21.15.132:0/3258212857 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c0343f0 con 0x7f9d440c3ea0 2023-11-18T20:41:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.035+0000 7f9d4b207640 1 -- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 msgr2=0x7f9d440c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.035+0000 7f9d4b207640 1 --2- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 0x7f9d440c4330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009e50 tx=0x7f9d3c02bf60 comp rx=0 tx=0).stop 2023-11-18T20:41:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.036+0000 7f9d4b207640 1 -- 172.21.15.132:0/3258212857 shutdown_connections 2023-11-18T20:41:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.036+0000 7f9d4b207640 1 --2- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 0x7f9d440c4330 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.036+0000 7f9d4b207640 1 --2- 172.21.15.132:0/3258212857 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4406d0a0 0x7f9d44152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.036+0000 7f9d4b207640 1 -- 172.21.15.132:0/3258212857 >> 172.21.15.132:0/3258212857 conn(0x7f9d4406a500 msgr2=0x7f9d4406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.036+0000 7f9d4b207640 1 -- 172.21.15.132:0/3258212857 shutdown_connections 2023-11-18T20:41:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.036+0000 7f9d4b207640 1 -- 172.21.15.132:0/3258212857 wait complete. 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.037+0000 7f9d4b207640 1 Processor -- start 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.038+0000 7f9d4b207640 1 -- start start 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.038+0000 7f9d4b207640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d4406d0a0 0x7f9d44154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.038+0000 7f9d4b207640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 0x7f9d441513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.038+0000 7f9d4b207640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4414fd30 0x7f9d4414adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d4b207640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4414d760 con 0x7f9d4406d0a0 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d4b207640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441547b0 con 0x7f9d440c3ea0 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d4b207640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441520f0 con 0x7f9d4414fd30 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d48fa3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d4406d0a0 0x7f9d44154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d48fa3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d4406d0a0 0x7f9d44154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50488/0 (socket says 172.21.15.132:50488) 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d48fa3640 1 -- 172.21.15.132:0/2800850113 learned_addr learned my addr 172.21.15.132:0/2800850113 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d43fff640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 0x7f9d441513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d497a4640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4414fd30 0x7f9d4414adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d48fa3640 1 -- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4414fd30 msgr2=0x7f9d4414adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d48fa3640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4414fd30 0x7f9d4414adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d48fa3640 1 -- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 msgr2=0x7f9d441513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d48fa3640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 0x7f9d441513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.039+0000 7f9d48fa3640 1 -- 172.21.15.132:0/2800850113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38009400 con 0x7f9d4406d0a0 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.040+0000 7f9d48fa3640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d4406d0a0 0x7f9d44154270 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c450 tx=0x7f9d3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.040+0000 7f9d417fa640 1 -- 172.21.15.132:0/2800850113 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d340052d0 con 0x7f9d4406d0a0 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.040+0000 7f9d417fa640 1 -- 172.21.15.132:0/2800850113 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34005430 con 0x7f9d4406d0a0 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.040+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c009b30 con 0x7f9d4406d0a0 2023-11-18T20:41:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.040+0000 7f9d417fa640 1 -- 172.21.15.132:0/2800850113 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34012870 con 0x7f9d4406d0a0 2023-11-18T20:41:44.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.040+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d441526b0 con 0x7f9d4406d0a0 2023-11-18T20:41:44.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.041+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d44068350 con 0x7f9d4406d0a0 2023-11-18T20:41:44.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.042+0000 7f9d417fa640 1 -- 172.21.15.132:0/2800850113 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d340129d0 con 0x7f9d4406d0a0 2023-11-18T20:41:44.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.043+0000 7f9d417fa640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3006ae40 0x7f9d3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.043+0000 7f9d417fa640 1 -- 172.21.15.132:0/2800850113 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9d34089470 con 0x7f9d4406d0a0 2023-11-18T20:41:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.044+0000 7f9d43fff640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3006ae40 0x7f9d3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.045+0000 7f9d43fff640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3006ae40 0x7f9d3006d300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9d440a7a00 tx=0x7f9d38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.048+0000 7f9d417fa640 1 -- 172.21.15.132:0/2800850113 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d34054250 con 0x7f9d4406d0a0 2023-11-18T20:41:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.260+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d440c66d0 con 0x7f9d4406d0a0 2023-11-18T20:41:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.261+0000 7f9d417fa640 1 -- 172.21.15.132:0/2800850113 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d34057870 con 0x7f9d4406d0a0 2023-11-18T20:41:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:41:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3006ae40 msgr2=0x7f9d3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3006ae40 0x7f9d3006d300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9d440a7a00 tx=0x7f9d38008040 comp rx=0 tx=0).stop 2023-11-18T20:41:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d4406d0a0 msgr2=0x7f9d44154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d4406d0a0 0x7f9d44154270 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c450 tx=0x7f9d3400c910 comp rx=0 tx=0).stop 2023-11-18T20:41:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 shutdown_connections 2023-11-18T20:41:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9d3006ae40 0x7f9d3006d300 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d4414fd30 0x7f9d4414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d440c3ea0 0x7f9d441513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 --2- 172.21.15.132:0/2800850113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d4406d0a0 0x7f9d44154270 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.263+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 >> 172.21.15.132:0/2800850113 conn(0x7f9d4406a500 msgr2=0x7f9d440c2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.264+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 shutdown_connections 2023-11-18T20:41:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.264+0000 7f9d4b207640 1 -- 172.21.15.132:0/2800850113 wait complete. 2023-11-18T20:41:44.282 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-18T20:41:44.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:44.282 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:44.396 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:41:44.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:44.396 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T20:41:44.448 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:44.448 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:44.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-18T20:41:44.498 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:41:44.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.717+0000 7f2997856640 1 Processor -- start 2023-11-18T20:41:44.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.718+0000 7f2997856640 1 -- start start 2023-11-18T20:41:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.719+0000 7f2997856640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29900c1ca0 0x7f29900c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.719+0000 7f2997856640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2990071e30 0x7f29900c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.719+0000 7f2997856640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299006d580 con 0x7f2990155fc0 2023-11-18T20:41:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.719+0000 7f2997856640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299006dd60 con 0x7f29900c1ca0 2023-11-18T20:41:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.719+0000 7f2997856640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29900c6580 con 0x7f2990071e30 2023-11-18T20:41:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.719+0000 7f29955f2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2990155fc0 0x7f2990159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48634/0 (socket says 172.21.15.132:48634) 2023-11-18T20:41:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.719+0000 7f29955f2640 1 -- 172.21.15.132:0/488110578 learned_addr learned my addr 172.21.15.132:0/488110578 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.720+0000 7f2994df1640 1 --2- 172.21.15.132:0/488110578 >> v2:172.21.15.132:3300/0 conn(0x7f29900c1ca0 0x7f29900c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.720+0000 7f2995df3640 1 --2- 172.21.15.132:0/488110578 >> v2:172.21.15.161:3300/0 conn(0x7f2990071e30 0x7f29900c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.720+0000 7f2987fff640 1 -- 172.21.15.132:0/488110578 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836291162 0 0) 0x7f299006d580 con 0x7f2990155fc0 2023-11-18T20:41:44.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.720+0000 7f2987fff640 1 -- 172.21.15.132:0/488110578 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f297c003520 con 0x7f2990155fc0 2023-11-18T20:41:44.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.720+0000 7f2994df1640 1 -- 172.21.15.132:0/488110578 >> v2:172.21.15.161:3300/0 conn(0x7f2990071e30 msgr2=0x7f29900c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:44.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.720+0000 7f2994df1640 1 --2- 172.21.15.132:0/488110578 >> v2:172.21.15.161:3300/0 conn(0x7f2990071e30 0x7f29900c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.720+0000 7f2994df1640 1 -- 172.21.15.132:0/488110578 >> v1:172.21.15.132:6789/0 conn(0x7f2990155fc0 legacy=0x7f2990159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.720+0000 7f2994df1640 1 -- 172.21.15.132:0/488110578 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900726d0 con 0x7f29900c1ca0 2023-11-18T20:41:44.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.721+0000 7f2994df1640 1 --2- 172.21.15.132:0/488110578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29900c1ca0 0x7f29900c2750 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f29900722c0 tx=0x7f298002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34054a053e68eec0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:44.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.721+0000 7f2987fff640 1 -- 172.21.15.132:0/488110578 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298002f050 con 0x7f29900c1ca0 2023-11-18T20:41:44.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.721+0000 7f2987fff640 1 -- 172.21.15.132:0/488110578 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2980031700 con 0x7f29900c1ca0 2023-11-18T20:41:44.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.721+0000 7f2987fff640 1 -- 172.21.15.132:0/488110578 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980031a90 con 0x7f29900c1ca0 2023-11-18T20:41:44.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.722+0000 7f2997856640 1 -- 172.21.15.132:0/488110578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29900c1ca0 msgr2=0x7f29900c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.722+0000 7f2997856640 1 --2- 172.21.15.132:0/488110578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29900c1ca0 0x7f29900c2750 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f29900722c0 tx=0x7f298002b7a0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.722+0000 7f2997856640 1 -- 172.21.15.132:0/488110578 shutdown_connections 2023-11-18T20:41:44.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.722+0000 7f2997856640 1 --2- 172.21.15.132:0/488110578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29900c1ca0 0x7f29900c2750 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.722+0000 7f2997856640 1 --2- 172.21.15.132:0/488110578 >> v2:172.21.15.161:3300/0 conn(0x7f2990071e30 0x7f29900c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.722+0000 7f2997856640 1 -- 172.21.15.132:0/488110578 >> 172.21.15.132:0/488110578 conn(0x7f299006a500 msgr2=0x7f299006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:44.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.722+0000 7f2997856640 1 -- 172.21.15.132:0/488110578 shutdown_connections 2023-11-18T20:41:44.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.722+0000 7f2997856640 1 -- 172.21.15.132:0/488110578 wait complete. 2023-11-18T20:41:44.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.724+0000 7f2997856640 1 Processor -- start 2023-11-18T20:41:44.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.724+0000 7f2997856640 1 -- start start 2023-11-18T20:41:44.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f2997856640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990071e30 0x7f29901f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f2997856640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29900c1ca0 0x7f29900a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f2997856640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2990155fc0 0x7f29900a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f2997856640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299015bca0 con 0x7f2990071e30 2023-11-18T20:41:44.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f2997856640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29901f1c30 con 0x7f2990155fc0 2023-11-18T20:41:44.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f2997856640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299015bf60 con 0x7f29900c1ca0 2023-11-18T20:41:44.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f29955f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990071e30 0x7f29901f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f29955f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990071e30 0x7f29901f1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50510/0 (socket says 172.21.15.132:50510) 2023-11-18T20:41:44.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.725+0000 7f29955f2640 1 -- 172.21.15.132:0/273122712 learned_addr learned my addr 172.21.15.132:0/273122712 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:44.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f2995df3640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2990155fc0 0x7f29900a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f29955f2640 1 -- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29900c1ca0 msgr2=0x7f29900a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f29955f2640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29900c1ca0 0x7f29900a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f29955f2640 1 -- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2990155fc0 msgr2=0x7f29900a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f29955f2640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2990155fc0 0x7f29900a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f29955f2640 1 -- 172.21.15.132:0/273122712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2980009400 con 0x7f2990071e30 2023-11-18T20:41:44.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f29955f2640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990071e30 0x7f29901f1380 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f298c00c410 tx=0x7f298c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:44.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f2985ffb640 1 -- 172.21.15.132:0/273122712 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c005ce0 con 0x7f2990071e30 2023-11-18T20:41:44.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f2985ffb640 1 -- 172.21.15.132:0/273122712 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c005e40 con 0x7f2990071e30 2023-11-18T20:41:44.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f2985ffb640 1 -- 172.21.15.132:0/273122712 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0072f0 con 0x7f2990071e30 2023-11-18T20:41:44.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.726+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299015c240 con 0x7f2990071e30 2023-11-18T20:41:44.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.727+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299015cd90 con 0x7f2990071e30 2023-11-18T20:41:44.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.728+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299015c480 con 0x7f2990071e30 2023-11-18T20:41:44.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.729+0000 7f2985ffb640 1 -- 172.21.15.132:0/273122712 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f298c007510 con 0x7f2990071e30 2023-11-18T20:41:44.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.730+0000 7f2985ffb640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f297406ae40 0x7f297406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:44.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.730+0000 7f2985ffb640 1 -- 172.21.15.132:0/273122712 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f298c088ff0 con 0x7f2990071e30 2023-11-18T20:41:44.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.730+0000 7f2994df1640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f297406ae40 0x7f297406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:44.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.731+0000 7f2994df1640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f297406ae40 0x7f297406d300 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2980035000 tx=0x7f2980030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:44.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.734+0000 7f2985ffb640 1 -- 172.21.15.132:0/273122712 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f298c053e50 con 0x7f2990071e30 2023-11-18T20:41:44.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.967+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29900a3cd0 con 0x7f2990071e30 2023-11-18T20:41:44.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.968+0000 7f2985ffb640 1 -- 172.21.15.132:0/273122712 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+149 (secure 0 0 0) 0x7f298c0170b0 con 0x7f2990071e30 2023-11-18T20:41:44.969 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:41:44.969 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-18T20:41:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f297406ae40 msgr2=0x7f297406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f297406ae40 0x7f297406d300 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2980035000 tx=0x7f2980030000 comp rx=0 tx=0).stop 2023-11-18T20:41:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990071e30 msgr2=0x7f29901f1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990071e30 0x7f29901f1380 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f298c00c410 tx=0x7f298c00c8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 shutdown_connections 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f297406ae40 0x7f297406d300 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2990155fc0 0x7f29900a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29900c1ca0 0x7f29900a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 --2- 172.21.15.132:0/273122712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2990071e30 0x7f29901f1380 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 >> 172.21.15.132:0/273122712 conn(0x7f299006a500 msgr2=0x7f2990155590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 shutdown_connections 2023-11-18T20:41:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:44.971+0000 7f2997856640 1 -- 172.21.15.132:0/273122712 wait complete. 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:41:44.990 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:44.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:44.991 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-18T20:41:45.051 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:41:45.051 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:45.052 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42204sec preferred_lft 42204sec 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::78f3:28ff:fe93:897/64 scope link 2023-11-18T20:41:45.053 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:45.054 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:41:45.054 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:41:45.054 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::442e:5aff:fe28:3e67/64 scope link 2023-11-18T20:41:45.054 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:45.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:45.056 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:41:45.145 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:41:45.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:45.149 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-18T20:41:45.204 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-18T20:41:45.204 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:41:45.204 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:41:45.204 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:41:45.204 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:41:45.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:45.205 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:41:45.205 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:41:45.205 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:41:45.205 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:41:45.205 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:41:45.205 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:41:45.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:45.387 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:41:45.438 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T20:41:45.438 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:45.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:45.439 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-18T20:41:45.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:45.532 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:45.583 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:45.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:45.583 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:45.634 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:41:45.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:45.634 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:41:45.773 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:41:45.773 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:41:45.773 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:45.795 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:41:45.795 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:41:45.795 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:45.795 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:45.795 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:45.821 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-18T20:41:45.821 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-18T20:41:45.821 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:45.821 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:45.821 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:45.821 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:41:45.822 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:41:45.822 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:41:45.823 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T20:41:45.823 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:41:45.823 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:41:45.823 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:41:45.823 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:41:45.827 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:41:45.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:45.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:45.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:45.915 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:41:45.993 INFO:teuthology.orchestra.run.smithi161.stdout:client5129 2023-11-18T20:41:45.994 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:45.994 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:46.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:46.050 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-11-18T20:41:46.119 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:46.120 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-11-18T20:41:46.184 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:46.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:46.184 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-11-18T20:41:46.264 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:46.264 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-11-18T20:41:46.330 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:46.330 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-11-18T20:41:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.558+0000 7f2d2a70f640 1 Processor -- start 2023-11-18T20:41:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.559+0000 7f2d2a70f640 1 -- start start 2023-11-18T20:41:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.560+0000 7f2d2a70f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2414fd30 0x7f2d24152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.560+0000 7f2d2a70f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2d2406d0a0 0x7f2d240a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.560+0000 7f2d2a70f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d240c64a0 con 0x7f2d240a5260 2023-11-18T20:41:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.560+0000 7f2d2a70f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d240c5c00 con 0x7f2d2406d0a0 2023-11-18T20:41:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.560+0000 7f2d2a70f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240c5ee0 con 0x7f2d2414fd30 2023-11-18T20:41:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.561+0000 7f2d23fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2414fd30 0x7f2d24152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.561+0000 7f2d237fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2d2406d0a0 0x7f2d240a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.561+0000 7f2d237fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2d2406d0a0 0x7f2d240a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:55012/0 (socket says 172.21.15.132:55012) 2023-11-18T20:41:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.561+0000 7f2d237fe640 1 -- 172.21.15.132:0/3577336085 learned_addr learned my addr 172.21.15.132:0/3577336085 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.561+0000 7f2d28cac640 1 --1- 172.21.15.132:0/3577336085 >> v1:172.21.15.161:6789/0 conn(0x7f2d240a5260 0x7f2d240c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:38740/0 (socket says 172.21.15.132:38740) 2023-11-18T20:41:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.562+0000 7f2d237fe640 1 -- 172.21.15.132:0/3577336085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2414fd30 msgr2=0x7f2d24152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.562+0000 7f2d237fe640 1 --2- 172.21.15.132:0/3577336085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2414fd30 0x7f2d24152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.562+0000 7f2d237fe640 1 -- 172.21.15.132:0/3577336085 >> v1:172.21.15.161:6789/0 conn(0x7f2d240a5260 legacy=0x7f2d240c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.562+0000 7f2d237fe640 1 -- 172.21.15.132:0/3577336085 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240c61c0 con 0x7f2d2406d0a0 2023-11-18T20:41:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.563+0000 7f2d237fe640 1 --2- 172.21.15.132:0/3577336085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2406d0a0 0x7f2d240a4d20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009870 tx=0x7f2d1802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6705d18241e5c77f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:46.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.564+0000 7f2d22ffd640 1 -- 172.21.15.132:0/3577336085 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18030840 con 0x7f2d2406d0a0 2023-11-18T20:41:46.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.564+0000 7f2d22ffd640 1 -- 172.21.15.132:0/3577336085 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d180309a0 con 0x7f2d2406d0a0 2023-11-18T20:41:46.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.564+0000 7f2d22ffd640 1 -- 172.21.15.132:0/3577336085 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18030d30 con 0x7f2d2406d0a0 2023-11-18T20:41:46.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.565+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3577336085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2406d0a0 msgr2=0x7f2d240a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:46.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.565+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3577336085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2406d0a0 0x7f2d240a4d20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009870 tx=0x7f2d1802b980 comp rx=0 tx=0).stop 2023-11-18T20:41:46.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.565+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3577336085 shutdown_connections 2023-11-18T20:41:46.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.565+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3577336085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2406d0a0 0x7f2d240a4d20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.565+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3577336085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2414fd30 0x7f2d24152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.565+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3577336085 >> 172.21.15.132:0/3577336085 conn(0x7f2d2406a500 msgr2=0x7f2d2406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:46.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.565+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3577336085 shutdown_connections 2023-11-18T20:41:46.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.565+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3577336085 wait complete. 2023-11-18T20:41:46.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.568+0000 7f2d2a70f640 1 Processor -- start 2023-11-18T20:41:46.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.568+0000 7f2d2a70f640 1 -- start start 2023-11-18T20:41:46.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d2a70f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2406d0a0 0x7f2d241ea550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:46.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d2a70f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d240a5260 0x7f2d2414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d2a70f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2414fd30 0x7f2d240a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d2a70f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d24099a60 con 0x7f2d240a5260 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d2a70f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241538f0 con 0x7f2d2414fd30 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d2a70f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241eab30 con 0x7f2d2406d0a0 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d237fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d240a5260 0x7f2d2414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d237fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d240a5260 0x7f2d2414f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50524/0 (socket says 172.21.15.132:50524) 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.569+0000 7f2d237fe640 1 -- 172.21.15.132:0/3950355891 learned_addr learned my addr 172.21.15.132:0/3950355891 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d23fff640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2406d0a0 0x7f2d241ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:46.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d28cac640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2414fd30 0x7f2d240a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:46.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d237fe640 1 -- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2406d0a0 msgr2=0x7f2d241ea550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d237fe640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2406d0a0 0x7f2d241ea550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d237fe640 1 -- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2414fd30 msgr2=0x7f2d240a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d237fe640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2414fd30 0x7f2d240a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d237fe640 1 -- 172.21.15.132:0/3950355891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180094d0 con 0x7f2d240a5260 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d237fe640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d240a5260 0x7f2d2414f330 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2d18000c00 tx=0x7f2d18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.570+0000 7f2d20ff9640 1 -- 172.21.15.132:0/3950355891 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18039c90 con 0x7f2d240a5260 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.571+0000 7f2d20ff9640 1 -- 172.21.15.132:0/3950355891 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d18039e10 con 0x7f2d240a5260 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.571+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d241eae10 con 0x7f2d240a5260 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.571+0000 7f2d20ff9640 1 -- 172.21.15.132:0/3950355891 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18043640 con 0x7f2d240a5260 2023-11-18T20:41:46.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.571+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d241eb3d0 con 0x7f2d240a5260 2023-11-18T20:41:46.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.572+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d24153a60 con 0x7f2d240a5260 2023-11-18T20:41:46.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.573+0000 7f2d20ff9640 1 -- 172.21.15.132:0/3950355891 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d180437a0 con 0x7f2d240a5260 2023-11-18T20:41:46.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.574+0000 7f2d20ff9640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1006ae40 0x7f2d1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:46.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.574+0000 7f2d20ff9640 1 -- 172.21.15.132:0/3950355891 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2d1803e070 con 0x7f2d240a5260 2023-11-18T20:41:46.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.574+0000 7f2d23fff640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1006ae40 0x7f2d1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:46.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.575+0000 7f2d23fff640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1006ae40 0x7f2d1006d300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2d140073f0 tx=0x7f2d1400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:46.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.578+0000 7f2d20ff9640 1 -- 172.21.15.132:0/3950355891 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d180776f0 con 0x7f2d240a5260 2023-11-18T20:41:46.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.842+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7f2d24068350 con 0x7f2d240a5260 2023-11-18T20:41:46.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.848+0000 7f2d20ff9640 1 -- 172.21.15.132:0/3950355891 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v21) v1 ==== 272+0+0 (secure 0 0 0) 0x7f2d1807ad10 con 0x7f2d240a5260 2023-11-18T20:41:46.849 INFO:teuthology.orchestra.run.smithi132.stderr:added key for client.testuser 2023-11-18T20:41:46.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1006ae40 msgr2=0x7f2d1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:46.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1006ae40 0x7f2d1006d300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2d140073f0 tx=0x7f2d1400b040 comp rx=0 tx=0).stop 2023-11-18T20:41:46.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d240a5260 msgr2=0x7f2d2414f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:46.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d240a5260 0x7f2d2414f330 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2d18000c00 tx=0x7f2d18004730 comp rx=0 tx=0).stop 2023-11-18T20:41:46.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 shutdown_connections 2023-11-18T20:41:46.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2d1006ae40 0x7f2d1006d300 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d2414fd30 0x7f2d240a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d240a5260 0x7f2d2414f330 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 --2- 172.21.15.132:0/3950355891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d2406d0a0 0x7f2d241ea550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:46.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 >> 172.21.15.132:0/3950355891 conn(0x7f2d2406a500 msgr2=0x7f2d240c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:46.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 shutdown_connections 2023-11-18T20:41:46.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:46.851+0000 7f2d2a70f640 1 -- 172.21.15.132:0/3950355891 wait complete. 2023-11-18T20:41:46.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-11-18T20:41:47.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.085+0000 7f08d8661640 1 Processor -- start 2023-11-18T20:41:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.085+0000 7f08d8661640 1 -- start start 2023-11-18T20:41:47.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.087+0000 7f08d8661640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f08d0155490 0x7f08d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.087+0000 7f08d8661640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f08d00c1500 0x7f08d00a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.087+0000 7f08d8661640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00c06c0 con 0x7f08d00c4080 2023-11-18T20:41:47.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.087+0000 7f08d8661640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d00a5820 con 0x7f08d0155490 2023-11-18T20:41:47.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.087+0000 7f08d8661640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d00c1020 con 0x7f08d00c1500 2023-11-18T20:41:47.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.087+0000 7f08d63fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f08d0155490 0x7f08d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.087+0000 7f08d63fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f08d0155490 0x7f08d00a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50530/0 (socket says 172.21.15.132:50530) 2023-11-18T20:41:47.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.087+0000 7f08d63fd640 1 -- 172.21.15.132:0/1297769468 learned_addr learned my addr 172.21.15.132:0/1297769468 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:47.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.088+0000 7f08d5bfc640 1 --2- 172.21.15.132:0/1297769468 >> v2:172.21.15.161:3300/0 conn(0x7f08d00c1500 0x7f08d00a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.088+0000 7f08d63fd640 1 -- 172.21.15.132:0/1297769468 >> v2:172.21.15.161:3300/0 conn(0x7f08d00c1500 msgr2=0x7f08d00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:47.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.088+0000 7f08d63fd640 1 --2- 172.21.15.132:0/1297769468 >> v2:172.21.15.161:3300/0 conn(0x7f08d00c1500 0x7f08d00a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.088+0000 7f08d63fd640 1 -- 172.21.15.132:0/1297769468 >> v1:172.21.15.161:6789/0 conn(0x7f08d00c4080 legacy=0x7f08d00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:47.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.088+0000 7f08d63fd640 1 -- 172.21.15.132:0/1297769468 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00c0910 con 0x7f08d0155490 2023-11-18T20:41:47.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.089+0000 7f08d63fd640 1 --2- 172.21.15.132:0/1297769468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d0155490 0x7f08d00a51b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f08d00a5160 tx=0x7f08cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65d1a165b48a87 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:47.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.089+0000 7f08d53fb640 1 -- 172.21.15.132:0/1297769468 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc031870 con 0x7f08d0155490 2023-11-18T20:41:47.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.089+0000 7f08d53fb640 1 -- 172.21.15.132:0/1297769468 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc0319d0 con 0x7f08d0155490 2023-11-18T20:41:47.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d53fb640 1 -- 172.21.15.132:0/1297769468 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc031d60 con 0x7f08d0155490 2023-11-18T20:41:47.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d8661640 1 -- 172.21.15.132:0/1297769468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d0155490 msgr2=0x7f08d00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d8661640 1 --2- 172.21.15.132:0/1297769468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d0155490 0x7f08d00a51b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f08d00a5160 tx=0x7f08cc02b910 comp rx=0 tx=0).stop 2023-11-18T20:41:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d8661640 1 -- 172.21.15.132:0/1297769468 shutdown_connections 2023-11-18T20:41:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d8661640 1 --2- 172.21.15.132:0/1297769468 >> v2:172.21.15.161:3300/0 conn(0x7f08d00c1500 0x7f08d00a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d8661640 1 --2- 172.21.15.132:0/1297769468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d0155490 0x7f08d00a51b0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d8661640 1 -- 172.21.15.132:0/1297769468 >> 172.21.15.132:0/1297769468 conn(0x7f08d006a500 msgr2=0x7f08d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d8661640 1 -- 172.21.15.132:0/1297769468 shutdown_connections 2023-11-18T20:41:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.090+0000 7f08d8661640 1 -- 172.21.15.132:0/1297769468 wait complete. 2023-11-18T20:41:47.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.092+0000 7f08d8661640 1 Processor -- start 2023-11-18T20:41:47.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.092+0000 7f08d8661640 1 -- start start 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d8661640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d00c1500 0x7f08d01ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d8661640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08d00c4080 0x7f08d00a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d8661640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d0155490 0x7f08d00a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d8661640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d01eb0f0 con 0x7f08d00c1500 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d8661640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d01ec080 con 0x7f08d0155490 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d8661640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00bbbc0 con 0x7f08d00c4080 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d63fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d00c1500 0x7f08d01ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d63fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d00c1500 0x7f08d01ebb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50536/0 (socket says 172.21.15.132:50536) 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.093+0000 7f08d63fd640 1 -- 172.21.15.132:0/4158705547 learned_addr learned my addr 172.21.15.132:0/4158705547 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:47.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d5bfc640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08d00c4080 0x7f08d00a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d6bfe640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d0155490 0x7f08d00a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d63fd640 1 -- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08d00c4080 msgr2=0x7f08d00a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d63fd640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08d00c4080 0x7f08d00a43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d63fd640 1 -- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d0155490 msgr2=0x7f08d00a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d63fd640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d0155490 0x7f08d00a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d63fd640 1 -- 172.21.15.132:0/4158705547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0094d0 con 0x7f08d00c1500 2023-11-18T20:41:47.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d63fd640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d00c1500 0x7f08d01ebb40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:47.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08c6ffd640 1 -- 172.21.15.132:0/4158705547 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc031840 con 0x7f08d00c1500 2023-11-18T20:41:47.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08c6ffd640 1 -- 172.21.15.132:0/4158705547 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc0443f0 con 0x7f08d00c1500 2023-11-18T20:41:47.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08c6ffd640 1 -- 172.21.15.132:0/4158705547 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0447a0 con 0x7f08d00c1500 2023-11-18T20:41:47.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.094+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d00bbea0 con 0x7f08d00c1500 2023-11-18T20:41:47.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.095+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d01eb620 con 0x7f08d00c1500 2023-11-18T20:41:47.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.096+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d00c0c70 con 0x7f08d00c1500 2023-11-18T20:41:47.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.096+0000 7f08c6ffd640 1 -- 172.21.15.132:0/4158705547 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08cc04d450 con 0x7f08d00c1500 2023-11-18T20:41:47.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.097+0000 7f08c6ffd640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f08b406ae40 0x7f08b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.097+0000 7f08c6ffd640 1 -- 172.21.15.132:0/4158705547 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f08cc02d040 con 0x7f08d00c1500 2023-11-18T20:41:47.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.098+0000 7f08d5bfc640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f08b406ae40 0x7f08b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.099+0000 7f08d5bfc640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f08b406ae40 0x7f08b406d300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f08c0006fd0 tx=0x7f08c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:47.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.102+0000 7f08c6ffd640 1 -- 172.21.15.132:0/4158705547 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08cc076e00 con 0x7f08d00c1500 2023-11-18T20:41:47.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.365+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f08d0068350 con 0x7f08d00c1500 2023-11-18T20:41:47.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.365+0000 7f08c6ffd640 1 -- 172.21.15.132:0/4158705547 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+226 (secure 0 0 0) 0x7f08cc035020 con 0x7f08d00c1500 2023-11-18T20:41:47.367 INFO:teuthology.orchestra.run.smithi132.stdout:[client.testuser] 2023-11-18T20:41:47.367 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w== 2023-11-18T20:41:47.367 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-11-18T20:41:47.367 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2023-11-18T20:41:47.367 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-18T20:41:47.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f08b406ae40 msgr2=0x7f08b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f08b406ae40 0x7f08b406d300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f08c0006fd0 tx=0x7f08c0008040 comp rx=0 tx=0).stop 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d00c1500 msgr2=0x7f08d01ebb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d00c1500 0x7f08d01ebb40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc0046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 shutdown_connections 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f08b406ae40 0x7f08b406d300 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08d0155490 0x7f08d00a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08d00c4080 0x7f08d00a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 --2- 172.21.15.132:0/4158705547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08d00c1500 0x7f08d01ebb40 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 >> 172.21.15.132:0/4158705547 conn(0x7f08d006a500 msgr2=0x7f08d0153520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 shutdown_connections 2023-11-18T20:41:47.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.368+0000 7f08d8661640 1 -- 172.21.15.132:0/4158705547 wait complete. 2023-11-18T20:41:47.390 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-18T20:41:47.391 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-18T20:41:47.442 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.wMmmEWIrtV 2023-11-18T20:41:47.442 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:47.442 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/tmp/tmp.wMmmEWIrtV 2023-11-18T20:41:47.493 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:47.493 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:47.594 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:47.594 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:47.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:47.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.897+0000 7f68a621f640 1 Processor -- start 2023-11-18T20:41:47.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.897+0000 7f68a621f640 1 -- start start 2023-11-18T20:41:47.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.898+0000 7f68a621f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 0x7f68a0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.898+0000 7f68a621f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68a00c3ea0 0x7f68a00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.898+0000 7f68a621f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00c64a0 con 0x7f68a014fd30 2023-11-18T20:41:47.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.898+0000 7f68a621f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00c5c00 con 0x7f68a00c3ea0 2023-11-18T20:41:47.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.898+0000 7f68a621f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00c5ee0 con 0x7f68a006d0a0 2023-11-18T20:41:47.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.899+0000 7f689f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f68a014fd30 0x7f68a00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48638/0 (socket says 172.21.15.132:48638) 2023-11-18T20:41:47.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.899+0000 7f689f7fe640 1 -- 172.21.15.132:0/1719644148 learned_addr learned my addr 172.21.15.132:0/1719644148 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:47.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.899+0000 7f689ffff640 1 --2- 172.21.15.132:0/1719644148 >> v2:172.21.15.161:3300/0 conn(0x7f68a00c3ea0 0x7f68a00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.899+0000 7f689effd640 1 --2- 172.21.15.132:0/1719644148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 0x7f68a0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.900+0000 7f689e7fc640 1 -- 172.21.15.132:0/1719644148 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259760519 0 0) 0x7f68a00c64a0 con 0x7f68a014fd30 2023-11-18T20:41:47.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.900+0000 7f689e7fc640 1 -- 172.21.15.132:0/1719644148 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f688c003520 con 0x7f68a014fd30 2023-11-18T20:41:47.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.900+0000 7f689ffff640 1 -- 172.21.15.132:0/1719644148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 msgr2=0x7f68a0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:47.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.900+0000 7f689ffff640 1 --2- 172.21.15.132:0/1719644148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 0x7f68a0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.900+0000 7f689ffff640 1 -- 172.21.15.132:0/1719644148 >> v1:172.21.15.132:6789/0 conn(0x7f68a014fd30 legacy=0x7f68a00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.900+0000 7f689ffff640 1 -- 172.21.15.132:0/1719644148 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00c61c0 con 0x7f68a00c3ea0 2023-11-18T20:41:47.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.901+0000 7f689ffff640 1 --2- 172.21.15.132:0/1719644148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a00c3ea0 0x7f68a00c4330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6898009d90 tx=0x7f689802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c760f8a4414cccb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:47.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.902+0000 7f689e7fc640 1 -- 172.21.15.132:0/1719644148 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689802cc60 con 0x7f68a00c3ea0 2023-11-18T20:41:47.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.902+0000 7f689e7fc640 1 -- 172.21.15.132:0/1719644148 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689802cdc0 con 0x7f68a00c3ea0 2023-11-18T20:41:47.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.902+0000 7f689e7fc640 1 -- 172.21.15.132:0/1719644148 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898034640 con 0x7f68a00c3ea0 2023-11-18T20:41:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.902+0000 7f68a621f640 1 -- 172.21.15.132:0/1719644148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a00c3ea0 msgr2=0x7f68a00c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.902+0000 7f68a621f640 1 --2- 172.21.15.132:0/1719644148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a00c3ea0 0x7f68a00c4330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6898009d90 tx=0x7f689802beb0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.903+0000 7f68a621f640 1 -- 172.21.15.132:0/1719644148 shutdown_connections 2023-11-18T20:41:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.903+0000 7f68a621f640 1 --2- 172.21.15.132:0/1719644148 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 0x7f68a0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.903+0000 7f68a621f640 1 --2- 172.21.15.132:0/1719644148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a00c3ea0 0x7f68a00c4330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.903+0000 7f68a621f640 1 -- 172.21.15.132:0/1719644148 >> 172.21.15.132:0/1719644148 conn(0x7f68a006a500 msgr2=0x7f68a006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.903+0000 7f68a621f640 1 -- 172.21.15.132:0/1719644148 shutdown_connections 2023-11-18T20:41:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.903+0000 7f68a621f640 1 -- 172.21.15.132:0/1719644148 wait complete. 2023-11-18T20:41:47.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.905+0000 7f68a621f640 1 Processor -- start 2023-11-18T20:41:47.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.905+0000 7f68a621f640 1 -- start start 2023-11-18T20:41:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.906+0000 7f68a621f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 0x7f68a0155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.906+0000 7f68a621f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68a00c3ea0 0x7f68a014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.906+0000 7f68a621f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a014fd30 0x7f68a014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.906+0000 7f68a621f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00bb180 con 0x7f68a00c3ea0 2023-11-18T20:41:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.906+0000 7f68a621f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01ec1b0 con 0x7f68a014fd30 2023-11-18T20:41:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.906+0000 7f68a621f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a014f330 con 0x7f68a006d0a0 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68a00c3ea0 0x7f68a014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68a00c3ea0 0x7f68a014e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50538/0 (socket says 172.21.15.132:50538) 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 -- 172.21.15.132:0/4005830185 learned_addr learned my addr 172.21.15.132:0/4005830185 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689ffff640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a014fd30 0x7f68a014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689f7fe640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 0x7f68a0155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 -- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 msgr2=0x7f68a0155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 0x7f68a0155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 -- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a014fd30 msgr2=0x7f68a014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a014fd30 0x7f68a014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 -- 172.21.15.132:0/4005830185 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6898009a70 con 0x7f68a00c3ea0 2023-11-18T20:41:47.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.907+0000 7f689effd640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68a00c3ea0 0x7f68a014e4d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f688800e840 tx=0x7f688800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:47.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.908+0000 7f6897fff640 1 -- 172.21.15.132:0/4005830185 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68880094f0 con 0x7f68a00c3ea0 2023-11-18T20:41:47.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.908+0000 7f6897fff640 1 -- 172.21.15.132:0/4005830185 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688800c940 con 0x7f68a00c3ea0 2023-11-18T20:41:47.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.908+0000 7f6897fff640 1 -- 172.21.15.132:0/4005830185 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800ccd0 con 0x7f68a00c3ea0 2023-11-18T20:41:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.908+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a014f050 con 0x7f68a00c3ea0 2023-11-18T20:41:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.908+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01ebb60 con 0x7f68a00c3ea0 2023-11-18T20:41:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.909+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a01ec360 con 0x7f68a00c3ea0 2023-11-18T20:41:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.910+0000 7f6897fff640 1 -- 172.21.15.132:0/4005830185 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6888013470 con 0x7f68a00c3ea0 2023-11-18T20:41:47.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.911+0000 7f6897fff640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f688006ae40 0x7f688006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:47.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.911+0000 7f6897fff640 1 -- 172.21.15.132:0/4005830185 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f6888089ad0 con 0x7f68a00c3ea0 2023-11-18T20:41:47.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.912+0000 7f689f7fe640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f688006ae40 0x7f688006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.913+0000 7f689f7fe640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f688006ae40 0x7f688006d300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6890007fd0 tx=0x7f6890009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:47.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:47.915+0000 7f6897fff640 1 -- 172.21.15.132:0/4005830185 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68a01ec360 con 0x7f68a00c3ea0 2023-11-18T20:41:48.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.106+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68a00c4d20 con 0x7f68a00c3ea0 2023-11-18T20:41:48.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.108+0000 7f6897fff640 1 -- 172.21.15.132:0/4005830185 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20453 (secure 0 0 0) 0x7f68880547a0 con 0x7f68a00c3ea0 2023-11-18T20:41:48.109 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:48.110 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":81,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:47.541803+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:48.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.110+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f688006ae40 msgr2=0x7f688006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.110+0000 7f68a621f640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f688006ae40 0x7f688006d300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6890007fd0 tx=0x7f6890009040 comp rx=0 tx=0).stop 2023-11-18T20:41:48.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.110+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68a00c3ea0 msgr2=0x7f68a014e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.110+0000 7f68a621f640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68a00c3ea0 0x7f68a014e4d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f688800e840 tx=0x7f688800ed00 comp rx=0 tx=0).stop 2023-11-18T20:41:48.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.111+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 shutdown_connections 2023-11-18T20:41:48.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.111+0000 7f68a621f640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f688006ae40 0x7f688006d300 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.111+0000 7f68a621f640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a014fd30 0x7f68a014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.111+0000 7f68a621f640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68a00c3ea0 0x7f68a014e4d0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.111+0000 7f68a621f640 1 --2- 172.21.15.132:0/4005830185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68a006d0a0 0x7f68a0155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.111+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 >> 172.21.15.132:0/4005830185 conn(0x7f68a006a500 msgr2=0x7f68a00c2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:48.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.111+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 shutdown_connections 2023-11-18T20:41:48.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.111+0000 7f68a621f640 1 -- 172.21.15.132:0/4005830185 wait complete. 2023-11-18T20:41:48.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:41:17.894376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:41:18.520471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:41:33.270522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:41:33.924631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:41:48.130 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:41:48.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.350+0000 7fb48cce0640 1 Processor -- start 2023-11-18T20:41:48.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.351+0000 7fb48cce0640 1 -- start start 2023-11-18T20:41:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb48cce0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4881555c0 0x7fb4880c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb48cce0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4880c16b0 0x7fb4880c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb48cce0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880c2830 con 0x7fb4880c3210 2023-11-18T20:41:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb48cce0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4880c3d80 con 0x7fb4880c16b0 2023-11-18T20:41:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb48cce0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4880c1260 con 0x7fb4881555c0 2023-11-18T20:41:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb486d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4880c16b0 0x7fb4880c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb486d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4880c16b0 0x7fb4880c1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50550/0 (socket says 172.21.15.132:50550) 2023-11-18T20:41:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb486d9d640 1 -- 172.21.15.132:0/122374207 learned_addr learned my addr 172.21.15.132:0/122374207 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.352+0000 7fb48659c640 1 --2- 172.21.15.132:0/122374207 >> v2:172.21.15.161:3300/0 conn(0x7fb4881555c0 0x7fb4880c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.353+0000 7fb486d9d640 1 -- 172.21.15.132:0/122374207 >> v2:172.21.15.161:3300/0 conn(0x7fb4881555c0 msgr2=0x7fb4880c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.353+0000 7fb486d9d640 1 --2- 172.21.15.132:0/122374207 >> v2:172.21.15.161:3300/0 conn(0x7fb4881555c0 0x7fb4880c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.353+0000 7fb486d9d640 1 -- 172.21.15.132:0/122374207 >> v1:172.21.15.161:6789/0 conn(0x7fb4880c3210 legacy=0x7fb4880c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:48.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.353+0000 7fb486d9d640 1 -- 172.21.15.132:0/122374207 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48806bbd0 con 0x7fb4880c16b0 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.354+0000 7fb486d9d640 1 --2- 172.21.15.132:0/122374207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c16b0 0x7fb4880c1b00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb4880c2700 tx=0x7fb48002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33745c556b1a4bc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.354+0000 7fb48559a640 1 -- 172.21.15.132:0/122374207 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480031870 con 0x7fb4880c16b0 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.354+0000 7fb48559a640 1 -- 172.21.15.132:0/122374207 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4800319d0 con 0x7fb4880c16b0 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.354+0000 7fb48559a640 1 -- 172.21.15.132:0/122374207 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480031d60 con 0x7fb4880c16b0 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.355+0000 7fb48cce0640 1 -- 172.21.15.132:0/122374207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c16b0 msgr2=0x7fb4880c1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.355+0000 7fb48cce0640 1 --2- 172.21.15.132:0/122374207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c16b0 0x7fb4880c1b00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb4880c2700 tx=0x7fb48002b910 comp rx=0 tx=0).stop 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.355+0000 7fb48cce0640 1 -- 172.21.15.132:0/122374207 shutdown_connections 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.355+0000 7fb48cce0640 1 --2- 172.21.15.132:0/122374207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c16b0 0x7fb4880c1b00 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.355+0000 7fb48cce0640 1 --2- 172.21.15.132:0/122374207 >> v2:172.21.15.161:3300/0 conn(0x7fb4881555c0 0x7fb4880c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.355+0000 7fb48cce0640 1 -- 172.21.15.132:0/122374207 >> 172.21.15.132:0/122374207 conn(0x7fb4880c7e30 msgr2=0x7fb4880c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.355+0000 7fb48cce0640 1 -- 172.21.15.132:0/122374207 shutdown_connections 2023-11-18T20:41:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.355+0000 7fb48cce0640 1 -- 172.21.15.132:0/122374207 wait complete. 2023-11-18T20:41:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.356+0000 7fb48cce0640 1 Processor -- start 2023-11-18T20:41:48.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.357+0000 7fb48cce0640 1 -- start start 2023-11-18T20:41:48.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.357+0000 7fb48cce0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4880c16b0 0x7fb4880a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb48cce0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c3210 0x7fb4880a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb48cce0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4881555c0 0x7fb4880a8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb48cce0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881eb1b0 con 0x7fb4880c3210 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb48cce0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881eb670 con 0x7fb4881555c0 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb48cce0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881eb390 con 0x7fb4880c16b0 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb485d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c3210 0x7fb4880a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb485d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c3210 0x7fb4880a82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50564/0 (socket says 172.21.15.132:50564) 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb485d9b640 1 -- 172.21.15.132:0/1186578072 learned_addr learned my addr 172.21.15.132:0/1186578072 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb48659c640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4880c16b0 0x7fb4880a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb485d9b640 1 -- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4880c16b0 msgr2=0x7fb4880a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb485d9b640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4880c16b0 0x7fb4880a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb485d9b640 1 -- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4881555c0 msgr2=0x7fb4880a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb485d9b640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4881555c0 0x7fb4880a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.358+0000 7fb485d9b640 1 -- 172.21.15.132:0/1186578072 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800094d0 con 0x7fb4880c3210 2023-11-18T20:41:48.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.359+0000 7fb485d9b640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c3210 0x7fb4880a82d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c430 tx=0x7fb47000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:48.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.359+0000 7fb47effd640 1 -- 172.21.15.132:0/1186578072 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470011790 con 0x7fb4880c3210 2023-11-18T20:41:48.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.359+0000 7fb47effd640 1 -- 172.21.15.132:0/1186578072 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700118f0 con 0x7fb4880c3210 2023-11-18T20:41:48.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.359+0000 7fb47effd640 1 -- 172.21.15.132:0/1186578072 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470011ca0 con 0x7fb4880c3210 2023-11-18T20:41:48.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.359+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4881e1550 con 0x7fb4880c3210 2023-11-18T20:41:48.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.359+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4881e1b10 con 0x7fb4880c3210 2023-11-18T20:41:48.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.360+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb488067430 con 0x7fb4880c3210 2023-11-18T20:41:48.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.361+0000 7fb47effd640 1 -- 172.21.15.132:0/1186578072 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb47001c460 con 0x7fb4880c3210 2023-11-18T20:41:48.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.362+0000 7fb47effd640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb46806ae40 0x7fb46806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.363+0000 7fb47effd640 1 -- 172.21.15.132:0/1186578072 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fb4700899a0 con 0x7fb4880c3210 2023-11-18T20:41:48.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.363+0000 7fb48659c640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb46806ae40 0x7fb46806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.364+0000 7fb48659c640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb46806ae40 0x7fb46806d300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb4881e11c0 tx=0x7fb47800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:48.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.367+0000 7fb47effd640 1 -- 172.21.15.132:0/1186578072 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb470054670 con 0x7fb4880c3210 2023-11-18T20:41:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.558+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4880c24c0 con 0x7fb4880c3210 2023-11-18T20:41:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.559+0000 7fb47effd640 1 -- 172.21.15.132:0/1186578072 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb470057c90 con 0x7fb4880c3210 2023-11-18T20:41:48.561 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:41:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb46806ae40 msgr2=0x7fb46806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb46806ae40 0x7fb46806d300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb4881e11c0 tx=0x7fb47800b040 comp rx=0 tx=0).stop 2023-11-18T20:41:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c3210 msgr2=0x7fb4880a82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c3210 0x7fb4880a82d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c430 tx=0x7fb47000c8f0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 shutdown_connections 2023-11-18T20:41:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb46806ae40 0x7fb46806d300 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4881555c0 0x7fb4880a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4880c3210 0x7fb4880a82d0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 --2- 172.21.15.132:0/1186578072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4880c16b0 0x7fb4880a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 >> 172.21.15.132:0/1186578072 conn(0x7fb4880c7e30 msgr2=0x7fb48806efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 shutdown_connections 2023-11-18T20:41:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.562+0000 7fb48cce0640 1 -- 172.21.15.132:0/1186578072 wait complete. 2023-11-18T20:41:48.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:41:48.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.783+0000 7f56481a9640 1 Processor -- start 2023-11-18T20:41:48.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.783+0000 7f56481a9640 1 -- start start 2023-11-18T20:41:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.784+0000 7f56481a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564014fd30 0x7f5640152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.784+0000 7f56481a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f564006d0a0 0x7f56400a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f56481a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56400c64a0 con 0x7f56400a5260 2023-11-18T20:41:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f56481a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400c5c00 con 0x7f564006d0a0 2023-11-18T20:41:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f56481a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400c5ee0 con 0x7f564014fd30 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5645744640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f564006d0a0 0x7f56400a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5646746640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f56400a5260 0x7f56400c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43684/0 (socket says 172.21.15.132:43684) 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5646746640 1 -- 172.21.15.132:0/3962057779 learned_addr learned my addr 172.21.15.132:0/3962057779 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5645f45640 1 --2- 172.21.15.132:0/3962057779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564014fd30 0x7f5640152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5645744640 1 -- 172.21.15.132:0/3962057779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564014fd30 msgr2=0x7f5640152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5645744640 1 --2- 172.21.15.132:0/3962057779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564014fd30 0x7f5640152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5645744640 1 -- 172.21.15.132:0/3962057779 >> v1:172.21.15.132:6789/0 conn(0x7f56400a5260 legacy=0x7f56400c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5645744640 1 -- 172.21.15.132:0/3962057779 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400c61c0 con 0x7f564006d0a0 2023-11-18T20:41:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.785+0000 7f5645f45640 1 --2- 172.21.15.132:0/3962057779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564014fd30 0x7f5640152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.786+0000 7f5645744640 1 --2- 172.21.15.132:0/3962057779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564006d0a0 0x7f56400a4d20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f56300097a0 tx=0x7f563002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3343a504eefffa54 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f5644f43640 1 -- 172.21.15.132:0/3962057779 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563002d040 con 0x7f564006d0a0 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f5644f43640 1 -- 172.21.15.132:0/3962057779 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630031810 con 0x7f564006d0a0 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f5644f43640 1 -- 172.21.15.132:0/3962057779 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630031ba0 con 0x7f564006d0a0 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f56481a9640 1 -- 172.21.15.132:0/3962057779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564006d0a0 msgr2=0x7f56400a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f56481a9640 1 --2- 172.21.15.132:0/3962057779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564006d0a0 0x7f56400a4d20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f56300097a0 tx=0x7f563002b8b0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f56481a9640 1 -- 172.21.15.132:0/3962057779 shutdown_connections 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f56481a9640 1 --2- 172.21.15.132:0/3962057779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564006d0a0 0x7f56400a4d20 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f56481a9640 1 --2- 172.21.15.132:0/3962057779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564014fd30 0x7f5640152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f56481a9640 1 -- 172.21.15.132:0/3962057779 >> 172.21.15.132:0/3962057779 conn(0x7f564006a500 msgr2=0x7f564006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.787+0000 7f56481a9640 1 -- 172.21.15.132:0/3962057779 shutdown_connections 2023-11-18T20:41:48.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.788+0000 7f56481a9640 1 -- 172.21.15.132:0/3962057779 wait complete. 2023-11-18T20:41:48.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.789+0000 7f56481a9640 1 Processor -- start 2023-11-18T20:41:48.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.789+0000 7f56481a9640 1 -- start start 2023-11-18T20:41:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.790+0000 7f56481a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f564006d0a0 0x7f5640155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.790+0000 7f56481a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56400a5260 0x7f564014eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.790+0000 7f56481a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564014fd30 0x7f564014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.790+0000 7f56481a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56401dd5c0 con 0x7f564014fd30 2023-11-18T20:41:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.790+0000 7f56481a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56401dcf90 con 0x7f564006d0a0 2023-11-18T20:41:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.790+0000 7f56481a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56401ec0b0 con 0x7f56400a5260 2023-11-18T20:41:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.790+0000 7f5646746640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564014fd30 0x7f564014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5646746640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564014fd30 0x7f564014eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43260/0 (socket says 172.21.15.132:43260) 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5646746640 1 -- 172.21.15.132:0/788975833 learned_addr learned my addr 172.21.15.132:0/788975833 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5645f45640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f564006d0a0 0x7f5640155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5645744640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56400a5260 0x7f564014eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5646746640 1 -- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56400a5260 msgr2=0x7f564014eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5646746640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56400a5260 0x7f564014eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5646746640 1 -- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f564006d0a0 msgr2=0x7f5640155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5646746640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f564006d0a0 0x7f5640155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5646746640 1 -- 172.21.15.132:0/788975833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630009400 con 0x7f564014fd30 2023-11-18T20:41:48.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.791+0000 7f5646746640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564014fd30 0x7f564014eff0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f563800cbc0 tx=0x7f563800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:48.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.792+0000 7f56367fc640 1 -- 172.21.15.132:0/788975833 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800ad40 con 0x7f564014fd30 2023-11-18T20:41:48.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.792+0000 7f56367fc640 1 -- 172.21.15.132:0/788975833 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638012400 con 0x7f564014fd30 2023-11-18T20:41:48.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.792+0000 7f56367fc640 1 -- 172.21.15.132:0/788975833 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800aea0 con 0x7f564014fd30 2023-11-18T20:41:48.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.792+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56401ec390 con 0x7f564014fd30 2023-11-18T20:41:48.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.792+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5640156660 con 0x7f564014fd30 2023-11-18T20:41:48.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.793+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564006e200 con 0x7f564014fd30 2023-11-18T20:41:48.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.794+0000 7f56367fc640 1 -- 172.21.15.132:0/788975833 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5638007070 con 0x7f564014fd30 2023-11-18T20:41:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.795+0000 7f56367fc640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f562406ae70 0x7f562406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.795+0000 7f56367fc640 1 -- 172.21.15.132:0/788975833 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f5638089770 con 0x7f564014fd30 2023-11-18T20:41:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.796+0000 7f5645f45640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f562406ae70 0x7f562406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.797+0000 7f5645f45640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f562406ae70 0x7f562406d330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f563c00a950 tx=0x7f563c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.800+0000 7f56367fc640 1 -- 172.21.15.132:0/788975833 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5638054590 con 0x7f564014fd30 2023-11-18T20:41:48.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.989+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56401e8030 con 0x7f564014fd30 2023-11-18T20:41:48.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.989+0000 7f56367fc640 1 -- 172.21.15.132:0/788975833 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5638057bb0 con 0x7f564014fd30 2023-11-18T20:41:48.992 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:41:48.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.992+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f562406ae70 msgr2=0x7f562406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.992+0000 7f56481a9640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f562406ae70 0x7f562406d330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f563c00a950 tx=0x7f563c008040 comp rx=0 tx=0).stop 2023-11-18T20:41:48.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.992+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564014fd30 msgr2=0x7f564014eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:48.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.992+0000 7f56481a9640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564014fd30 0x7f564014eff0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f563800cbc0 tx=0x7f563800a430 comp rx=0 tx=0).stop 2023-11-18T20:41:48.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.993+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 shutdown_connections 2023-11-18T20:41:48.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.993+0000 7f56481a9640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f562406ae70 0x7f562406d330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.993+0000 7f56481a9640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f564014fd30 0x7f564014eff0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.993+0000 7f56481a9640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56400a5260 0x7f564014eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.993+0000 7f56481a9640 1 --2- 172.21.15.132:0/788975833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f564006d0a0 0x7f5640155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:48.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.993+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 >> 172.21.15.132:0/788975833 conn(0x7f564006a500 msgr2=0x7f564006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:48.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.993+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 shutdown_connections 2023-11-18T20:41:48.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:48.993+0000 7f56481a9640 1 -- 172.21.15.132:0/788975833 wait complete. 2023-11-18T20:41:49.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:41:49.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.220+0000 7f1e1cfcc640 1 Processor -- start 2023-11-18T20:41:49.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.220+0000 7f1e1cfcc640 1 -- start start 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.221+0000 7f1e1cfcc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e1814fd30 0x7f1e18152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.221+0000 7f1e1cfcc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1806d0a0 0x7f1e180a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.221+0000 7f1e1cfcc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e180a5260 0x7f1e180c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.221+0000 7f1e1cfcc640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e180c64a0 con 0x7f1e1814fd30 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.221+0000 7f1e1cfcc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e180c5c00 con 0x7f1e180a5260 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.221+0000 7f1e1cfcc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180c5ee0 con 0x7f1e1806d0a0 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.222+0000 7f1e1659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e1814fd30 0x7f1e18152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.222+0000 7f1e1659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e1814fd30 0x7f1e18152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43276/0 (socket says 172.21.15.132:43276) 2023-11-18T20:41:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.222+0000 7f1e1659c640 1 -- 172.21.15.132:0/1551801984 learned_addr learned my addr 172.21.15.132:0/1551801984 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.222+0000 7f1e1659c640 1 -- 172.21.15.132:0/1551801984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1806d0a0 msgr2=0x7f1e180a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.222+0000 7f1e1659c640 1 --2- 172.21.15.132:0/1551801984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1806d0a0 0x7f1e180a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.222+0000 7f1e1659c640 1 -- 172.21.15.132:0/1551801984 >> v2:172.21.15.161:3300/0 conn(0x7f1e180a5260 msgr2=0x7f1e180c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.222+0000 7f1e1659c640 1 --2- 172.21.15.132:0/1551801984 >> v2:172.21.15.161:3300/0 conn(0x7f1e180a5260 0x7f1e180c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.222+0000 7f1e1659c640 1 -- 172.21.15.132:0/1551801984 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180c61c0 con 0x7f1e1814fd30 2023-11-18T20:41:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.223+0000 7f1e1659c640 1 --2- 172.21.15.132:0/1551801984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e18152f20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1e1806d990 tx=0x7f1e0802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65689385d3f1097 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:49.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.223+0000 7f1e15d9b640 1 -- 172.21.15.132:0/1551801984 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0802ca80 con 0x7f1e1814fd30 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e15d9b640 1 -- 172.21.15.132:0/1551801984 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0802cbe0 con 0x7f1e1814fd30 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e15d9b640 1 -- 172.21.15.132:0/1551801984 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080343f0 con 0x7f1e1814fd30 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/1551801984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 msgr2=0x7f1e18152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/1551801984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e18152f20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1e1806d990 tx=0x7f1e0802bee0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/1551801984 shutdown_connections 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/1551801984 >> v2:172.21.15.161:3300/0 conn(0x7f1e180a5260 0x7f1e180c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/1551801984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e1806d0a0 0x7f1e180a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/1551801984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e18152f20 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/1551801984 >> 172.21.15.132:0/1551801984 conn(0x7f1e1806a500 msgr2=0x7f1e1806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/1551801984 shutdown_connections 2023-11-18T20:41:49.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.224+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/1551801984 wait complete. 2023-11-18T20:41:49.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.226+0000 7f1e1cfcc640 1 Processor -- start 2023-11-18T20:41:49.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.226+0000 7f1e1cfcc640 1 -- start start 2023-11-18T20:41:49.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e1cfcc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e1806d0a0 0x7f1e1814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e1cfcc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e180a5260 0x7f1e181e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e1cfcc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e180bf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e1cfcc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181dbe80 con 0x7f1e1814fd30 2023-11-18T20:41:49.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e1cfcc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181dc120 con 0x7f1e1806d0a0 2023-11-18T20:41:49.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e1cfcc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181dc400 con 0x7f1e180a5260 2023-11-18T20:41:49.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e16d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e180bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e16d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e180bf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43286/0 (socket says 172.21.15.132:43286) 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.227+0000 7f1e16d9d640 1 -- 172.21.15.132:0/602031177 learned_addr learned my addr 172.21.15.132:0/602031177 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e16d9d640 1 -- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e180a5260 msgr2=0x7f1e181e9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e16d9d640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e180a5260 0x7f1e181e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e16d9d640 1 -- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e1806d0a0 msgr2=0x7f1e1814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e16d9d640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e1806d0a0 0x7f1e1814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e16d9d640 1 -- 172.21.15.132:0/602031177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08009b30 con 0x7f1e1814fd30 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e16d9d640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e180bf390 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009fd0 tx=0x7f1e1000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e0f7fe640 1 -- 172.21.15.132:0/602031177 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10011830 con 0x7f1e1814fd30 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e0f7fe640 1 -- 172.21.15.132:0/602031177 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e10011990 con 0x7f1e1814fd30 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e181ed4a0 con 0x7f1e1814fd30 2023-11-18T20:41:49.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e0f7fe640 1 -- 172.21.15.132:0/602031177 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10011d20 con 0x7f1e1814fd30 2023-11-18T20:41:49.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.228+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e180bf8d0 con 0x7f1e1814fd30 2023-11-18T20:41:49.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.230+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e181ed9c0 con 0x7f1e1814fd30 2023-11-18T20:41:49.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.230+0000 7f1e0f7fe640 1 -- 172.21.15.132:0/602031177 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e1001b460 con 0x7f1e1814fd30 2023-11-18T20:41:49.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.231+0000 7f1e0f7fe640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1df806ae70 0x7f1df806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.231+0000 7f1e0f7fe640 1 -- 172.21.15.132:0/602031177 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f1e10089720 con 0x7f1e1814fd30 2023-11-18T20:41:49.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.232+0000 7f1e1659c640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1df806ae70 0x7f1df806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.233+0000 7f1e1659c640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1df806ae70 0x7f1df806d330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1e08035000 tx=0x7f1e0802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:49.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.236+0000 7f1e0f7fe640 1 -- 172.21.15.132:0/602031177 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e181ed9c0 con 0x7f1e1814fd30 2023-11-18T20:41:49.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.425+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e181ed9c0 con 0x7f1e1814fd30 2023-11-18T20:41:49.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.426+0000 7f1e0f7fe640 1 -- 172.21.15.132:0/602031177 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e181ed9c0 con 0x7f1e1814fd30 2023-11-18T20:41:49.428 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:41:49.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1df806ae70 msgr2=0x7f1df806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1df806ae70 0x7f1df806d330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1e08035000 tx=0x7f1e0802e000 comp rx=0 tx=0).stop 2023-11-18T20:41:49.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 msgr2=0x7f1e180bf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e180bf390 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009fd0 tx=0x7f1e1000b8e0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 shutdown_connections 2023-11-18T20:41:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1df806ae70 0x7f1df806d330 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e1814fd30 0x7f1e180bf390 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e180a5260 0x7f1e181e9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 --2- 172.21.15.132:0/602031177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e1806d0a0 0x7f1e1814f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 >> 172.21.15.132:0/602031177 conn(0x7f1e1806a500 msgr2=0x7f1e1806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 shutdown_connections 2023-11-18T20:41:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.429+0000 7f1e1cfcc640 1 -- 172.21.15.132:0/602031177 wait complete. 2023-11-18T20:41:49.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:41:49.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.661+0000 7ff9a5f5e640 1 Processor -- start 2023-11-18T20:41:49.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.661+0000 7ff9a5f5e640 1 -- start start 2023-11-18T20:41:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.663+0000 7ff9a5f5e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9a00c5ec0 0x7ff9a00c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.663+0000 7ff9a5f5e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a00bfdc0 con 0x7ff9a00721a0 2023-11-18T20:41:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.663+0000 7ff9a5f5e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a006ddd0 con 0x7ff9a00c45d0 2023-11-18T20:41:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.663+0000 7ff9a5f5e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a006e390 con 0x7ff9a00c5ec0 2023-11-18T20:41:49.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.663+0000 7ff99ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff9a00721a0 0x7ff9a0156540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43692/0 (socket says 172.21.15.132:43692) 2023-11-18T20:41:49.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.663+0000 7ff99ffff640 1 -- 172.21.15.132:0/1087398309 learned_addr learned my addr 172.21.15.132:0/1087398309 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:49.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.663+0000 7ff99f7fe640 1 --2- 172.21.15.132:0/1087398309 >> v2:172.21.15.161:3300/0 conn(0x7ff9a00c5ec0 0x7ff9a00c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238813720 0 0) 0x7ff9a00bfdc0 con 0x7ff9a00721a0 2023-11-18T20:41:49.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff988003520 con 0x7ff9a00721a0 2023-11-18T20:41:49.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2558623640 0 0) 0x7ff988003520 con 0x7ff9a00721a0 2023-11-18T20:41:49.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 >> v2:172.21.15.161:3300/0 conn(0x7ff9a00c5ec0 msgr2=0x7ff9a00c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:49.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 --2- 172.21.15.132:0/1087398309 >> v2:172.21.15.161:3300/0 conn(0x7ff9a00c5ec0 0x7ff9a00c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 >> v1:172.21.15.161:6789/0 conn(0x7ff9a00c45d0 legacy=0x7ff9a0155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a006e0b0 con 0x7ff9a00721a0 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7ff9980019f0 con 0x7ff9a00721a0 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 >> v1:172.21.15.132:6789/0 conn(0x7ff9a00721a0 legacy=0x7ff9a0156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988003970 0x7ff988003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9880047c0 0x7ff988004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff98800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a006e390 con 0x7ff9880052a0 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98800c170 con 0x7ff988003970 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98800c330 con 0x7ff9880047c0 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.664+0000 7ff99ffff640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff98800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.665+0000 7ff99f7fe640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988003970 0x7ff988003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.665+0000 7ff99effd640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9880047c0 0x7ff988004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.665+0000 7ff99ffff640 1 -- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9880047c0 msgr2=0x7ff988004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.665+0000 7ff99ffff640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9880047c0 0x7ff988004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.665+0000 7ff99ffff640 1 -- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988003970 msgr2=0x7ff988003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.665+0000 7ff99ffff640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988003970 0x7ff988003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.665+0000 7ff99ffff640 1 -- 172.21.15.132:0/1087398309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988003520 con 0x7ff9880052a0 2023-11-18T20:41:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.665+0000 7ff99f7fe640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988003970 0x7ff988003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:49.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.666+0000 7ff99ffff640 1 -- 172.21.15.132:0/1087398309 reap_dead start 2023-11-18T20:41:49.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.666+0000 7ff99ffff640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff98800b980 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ff99800a7c0 tx=0x7ff9880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a869a5c6c1f705 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:49.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.666+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998034630 con 0x7ff9880052a0 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.666+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99802f070 con 0x7ff9880052a0 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.666+0000 7ff99e7fc640 1 -- 172.21.15.132:0/1087398309 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980349d0 con 0x7ff9880052a0 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.667+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/1087398309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 msgr2=0x7ff98800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.667+0000 7ff9a5f5e640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff98800b980 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ff99800a7c0 tx=0x7ff9880057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.667+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/1087398309 shutdown_connections 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.667+0000 7ff9a5f5e640 1 --2- 172.21.15.132:0/1087398309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff98800b980 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.667+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/1087398309 >> 172.21.15.132:0/1087398309 conn(0x7ff9a006a500 msgr2=0x7ff9a006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.667+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/1087398309 shutdown_connections 2023-11-18T20:41:49.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.667+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/1087398309 wait complete. 2023-11-18T20:41:49.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.669+0000 7ff9a5f5e640 1 Processor -- start 2023-11-18T20:41:49.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.669+0000 7ff9a5f5e640 1 -- start start 2023-11-18T20:41:49.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff9a5f5e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff9a01ea070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff9a5f5e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9a00aa3c0 0x7ff9a009b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff9a5f5e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9a009bd60 0x7ff9a0153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff9a5f5e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a009dac0 con 0x7ff9880052a0 2023-11-18T20:41:49.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff9a5f5e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a009e780 con 0x7ff9a009bd60 2023-11-18T20:41:49.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff9a5f5e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a009c1e0 con 0x7ff9a00aa3c0 2023-11-18T20:41:49.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff99f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff9a01ea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff99f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff9a01ea070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43302/0 (socket says 172.21.15.132:43302) 2023-11-18T20:41:49.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.670+0000 7ff99f7fe640 1 -- 172.21.15.132:0/2346442365 learned_addr learned my addr 172.21.15.132:0/2346442365 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:49.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff99effd640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9a00aa3c0 0x7ff9a009b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff99ffff640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9a009bd60 0x7ff9a0153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff99f7fe640 1 -- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9a00aa3c0 msgr2=0x7ff9a009b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff99f7fe640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9a00aa3c0 0x7ff9a009b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff99f7fe640 1 -- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9a009bd60 msgr2=0x7ff9a0153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff99f7fe640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9a009bd60 0x7ff9a0153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff99f7fe640 1 -- 172.21.15.132:0/2346442365 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0099b00 con 0x7ff9880052a0 2023-11-18T20:41:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff99f7fe640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff9a01ea070 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff9900108e0 tx=0x7ff990010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.671+0000 7ff987fff640 1 -- 172.21.15.132:0/2346442365 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000ec20 con 0x7ff9880052a0 2023-11-18T20:41:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.672+0000 7ff987fff640 1 -- 172.21.15.132:0/2346442365 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99000ed80 con 0x7ff9880052a0 2023-11-18T20:41:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.672+0000 7ff987fff640 1 -- 172.21.15.132:0/2346442365 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99001c600 con 0x7ff9880052a0 2023-11-18T20:41:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.672+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a0099de0 con 0x7ff9880052a0 2023-11-18T20:41:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.672+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a009a3a0 con 0x7ff9880052a0 2023-11-18T20:41:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.673+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0068350 con 0x7ff9880052a0 2023-11-18T20:41:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.674+0000 7ff987fff640 1 -- 172.21.15.132:0/2346442365 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff99001c760 con 0x7ff9880052a0 2023-11-18T20:41:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.674+0000 7ff987fff640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff98c06ae40 0x7ff98c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.675+0000 7ff987fff640 1 -- 172.21.15.132:0/2346442365 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7ff99008a010 con 0x7ff9880052a0 2023-11-18T20:41:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.675+0000 7ff99effd640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff98c06ae40 0x7ff98c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.676+0000 7ff99effd640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff98c06ae40 0x7ff98c06d300 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff994007fd0 tx=0x7ff994009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:49.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.679+0000 7ff987fff640 1 -- 172.21.15.132:0/2346442365 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff990054e30 con 0x7ff9880052a0 2023-11-18T20:41:49.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.868+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9a00bfa00 con 0x7ff9880052a0 2023-11-18T20:41:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.869+0000 7ff987fff640 1 -- 172.21.15.132:0/2346442365 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v82) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff990058450 con 0x7ff9880052a0 2023-11-18T20:41:49.872 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:41:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff98c06ae40 msgr2=0x7ff98c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff98c06ae40 0x7ff98c06d300 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff994007fd0 tx=0x7ff994009040 comp rx=0 tx=0).stop 2023-11-18T20:41:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 msgr2=0x7ff9a01ea070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff9a01ea070 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff9900108e0 tx=0x7ff990010da0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 shutdown_connections 2023-11-18T20:41:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff98c06ae40 0x7ff98c06d300 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9a009bd60 0x7ff9a0153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9a00aa3c0 0x7ff9a009b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 --2- 172.21.15.132:0/2346442365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9880052a0 0x7ff9a01ea070 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.872+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 >> 172.21.15.132:0/2346442365 conn(0x7ff9a006a500 msgr2=0x7ff9a00c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.873+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 shutdown_connections 2023-11-18T20:41:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:49.873+0000 7ff9a5f5e640 1 -- 172.21.15.132:0/2346442365 wait complete. 2023-11-18T20:41:49.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:41:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.099+0000 7f595d980640 1 Processor -- start 2023-11-18T20:41:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.100+0000 7f595d980640 1 -- start start 2023-11-18T20:41:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.101+0000 7f595d980640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.101+0000 7f595d980640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5958154580 0x7f5958154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.101+0000 7f595d980640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5958158a60 con 0x7f59580c4c00 2023-11-18T20:41:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.101+0000 7f595d980640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580c5b10 con 0x7f5958154580 2023-11-18T20:41:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.101+0000 7f595d980640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5958157ca0 con 0x7f595814e7c0 2023-11-18T20:41:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.102+0000 7f595d17f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5958154580 0x7f5958154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.102+0000 7f595c97e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.102+0000 7f595d17f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5958154580 0x7f5958154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:34288/0 (socket says 172.21.15.132:34288) 2023-11-18T20:41:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.102+0000 7f595d17f640 1 -- 172.21.15.132:0/751126481 learned_addr learned my addr 172.21.15.132:0/751126481 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.103+0000 7f595c97e640 1 -- 172.21.15.132:0/751126481 >> v2:172.21.15.161:3300/0 conn(0x7f5958154580 msgr2=0x7f5958154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.103+0000 7f595c97e640 1 --2- 172.21.15.132:0/751126481 >> v2:172.21.15.161:3300/0 conn(0x7f5958154580 0x7f5958154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.103+0000 7f595c97e640 1 -- 172.21.15.132:0/751126481 >> v1:172.21.15.161:6789/0 conn(0x7f59580c4c00 legacy=0x7f59580ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.103+0000 7f595c97e640 1 -- 172.21.15.132:0/751126481 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958157f80 con 0x7f595814e7c0 2023-11-18T20:41:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.103+0000 7f595d17f640 1 --2- 172.21.15.132:0/751126481 >> v2:172.21.15.161:3300/0 conn(0x7f5958154580 0x7f5958154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:41:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.104+0000 7f595c97e640 1 --2- 172.21.15.132:0/751126481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c46c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5948009d90 tx=0x7f594802bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bebb0194d3e6293 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f59577fe640 1 -- 172.21.15.132:0/751126481 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594802cb30 con 0x7f595814e7c0 2023-11-18T20:41:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f59577fe640 1 -- 172.21.15.132:0/751126481 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594802cc90 con 0x7f595814e7c0 2023-11-18T20:41:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f59577fe640 1 -- 172.21.15.132:0/751126481 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948034440 con 0x7f595814e7c0 2023-11-18T20:41:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f595d980640 1 -- 172.21.15.132:0/751126481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 msgr2=0x7f59580c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f595d980640 1 --2- 172.21.15.132:0/751126481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c46c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5948009d90 tx=0x7f594802bd80 comp rx=0 tx=0).stop 2023-11-18T20:41:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f595d980640 1 -- 172.21.15.132:0/751126481 shutdown_connections 2023-11-18T20:41:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f595d980640 1 --2- 172.21.15.132:0/751126481 >> v2:172.21.15.161:3300/0 conn(0x7f5958154580 0x7f5958154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f595d980640 1 --2- 172.21.15.132:0/751126481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c46c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.105+0000 7f595d980640 1 -- 172.21.15.132:0/751126481 >> 172.21.15.132:0/751126481 conn(0x7f59580abf00 msgr2=0x7f59580c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.106+0000 7f595d980640 1 -- 172.21.15.132:0/751126481 shutdown_connections 2023-11-18T20:41:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.106+0000 7f595d980640 1 -- 172.21.15.132:0/751126481 wait complete. 2023-11-18T20:41:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.107+0000 7f595d980640 1 Processor -- start 2023-11-18T20:41:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.107+0000 7f595d980640 1 -- start start 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.108+0000 7f595d980640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59580c4c00 0x7f59580bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.108+0000 7f595d980640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.108+0000 7f595d980640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5958154580 0x7f59581eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.108+0000 7f595d980640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580bfbb0 con 0x7f5958154580 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.108+0000 7f595d980640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580becc0 con 0x7f59580c4c00 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.108+0000 7f595d980640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59581eb710 con 0x7f595814e7c0 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.108+0000 7f595d17f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5958154580 0x7f59581eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595d17f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5958154580 0x7f59581eda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43314/0 (socket says 172.21.15.132:43314) 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595d17f640 1 -- 172.21.15.132:0/229248170 learned_addr learned my addr 172.21.15.132:0/229248170 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595c97e640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59580c4c00 0x7f59580bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f5957fff640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595d17f640 1 -- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 msgr2=0x7f59580c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595d17f640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595d17f640 1 -- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59580c4c00 msgr2=0x7f59580bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595d17f640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59580c4c00 0x7f59580bffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595d17f640 1 -- 172.21.15.132:0/229248170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500094d0 con 0x7f5958154580 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f595d17f640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5958154580 0x7f59581eda80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f595000e8c0 tx=0x7f595000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.109+0000 7f59557fa640 1 -- 172.21.15.132:0/229248170 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950004020 con 0x7f5958154580 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.110+0000 7f59557fa640 1 -- 172.21.15.132:0/229248170 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950004180 con 0x7f5958154580 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.110+0000 7f59557fa640 1 -- 172.21.15.132:0/229248170 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000c940 con 0x7f5958154580 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.110+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5948009a70 con 0x7f5958154580 2023-11-18T20:41:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.110+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59580bef30 con 0x7f5958154580 2023-11-18T20:41:50.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.111+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59580bfcf0 con 0x7f5958154580 2023-11-18T20:41:50.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.112+0000 7f59557fa640 1 -- 172.21.15.132:0/229248170 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f595000caa0 con 0x7f5958154580 2023-11-18T20:41:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.113+0000 7f59557fa640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593806ae70 0x7f593806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.113+0000 7f59557fa640 1 -- 172.21.15.132:0/229248170 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f59500898d0 con 0x7f5958154580 2023-11-18T20:41:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.113+0000 7f595c97e640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593806ae70 0x7f593806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.115+0000 7f595c97e640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593806ae70 0x7f593806d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5948036000 tx=0x7f5948030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.118+0000 7f59557fa640 1 -- 172.21.15.132:0/229248170 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59580bfcf0 con 0x7f5958154580 2023-11-18T20:41:50.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.307+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f59580bfcf0 con 0x7f5958154580 2023-11-18T20:41:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.308+0000 7f59557fa640 1 -- 172.21.15.132:0/229248170 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v82) v1 ==== 101+0+11 (secure 0 0 0) 0x7f59580bfcf0 con 0x7f5958154580 2023-11-18T20:41:50.311 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:41:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593806ae70 msgr2=0x7f593806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593806ae70 0x7f593806d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5948036000 tx=0x7f5948030000 comp rx=0 tx=0).stop 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5958154580 msgr2=0x7f59581eda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5958154580 0x7f59581eda80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f595000e8c0 tx=0x7f595000ed80 comp rx=0 tx=0).stop 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 shutdown_connections 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593806ae70 0x7f593806d330 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5958154580 0x7f59581eda80 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595814e7c0 0x7f59580c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 --2- 172.21.15.132:0/229248170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59580c4c00 0x7f59580bffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 >> 172.21.15.132:0/229248170 conn(0x7f59580abf00 msgr2=0x7f595814b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 shutdown_connections 2023-11-18T20:41:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.311+0000 7f595d980640 1 -- 172.21.15.132:0/229248170 wait complete. 2023-11-18T20:41:50.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:41:50.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.546+0000 7ff2e0cdf640 1 Processor -- start 2023-11-18T20:41:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.546+0000 7ff2e0cdf640 1 -- start start 2023-11-18T20:41:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.548+0000 7ff2e0cdf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2dc0ca8d0 0x7ff2dc154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.548+0000 7ff2e0cdf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc158a60 con 0x7ff2dc14e7c0 2023-11-18T20:41:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.548+0000 7ff2e0cdf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc0c4dd0 con 0x7ff2dc0ca450 2023-11-18T20:41:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.548+0000 7ff2e0cdf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc0c5b10 con 0x7ff2dc0ca8d0 2023-11-18T20:41:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.548+0000 7ff2db7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff2dc14e7c0 0x7ff2dc0c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43706/0 (socket says 172.21.15.132:43706) 2023-11-18T20:41:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.548+0000 7ff2db7fe640 1 -- 172.21.15.132:0/1912625805 learned_addr learned my addr 172.21.15.132:0/1912625805 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.548+0000 7ff2dbfff640 1 --2- 172.21.15.132:0/1912625805 >> v2:172.21.15.132:3300/0 conn(0x7ff2dc0ca8d0 0x7ff2dc154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.549+0000 7ff2da7fc640 1 -- 172.21.15.132:0/1912625805 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639716627 0 0) 0x7ff2dc158a60 con 0x7ff2dc14e7c0 2023-11-18T20:41:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.549+0000 7ff2da7fc640 1 -- 172.21.15.132:0/1912625805 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c4003520 con 0x7ff2dc14e7c0 2023-11-18T20:41:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.549+0000 7ff2dbfff640 1 -- 172.21.15.132:0/1912625805 >> v1:172.21.15.161:6789/0 conn(0x7ff2dc0ca450 legacy=0x7ff2dc154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.549+0000 7ff2dbfff640 1 -- 172.21.15.132:0/1912625805 >> v1:172.21.15.132:6789/0 conn(0x7ff2dc14e7c0 legacy=0x7ff2dc0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.549+0000 7ff2dbfff640 1 -- 172.21.15.132:0/1912625805 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc157ca0 con 0x7ff2dc0ca8d0 2023-11-18T20:41:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.550+0000 7ff2dbfff640 1 --2- 172.21.15.132:0/1912625805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca8d0 0x7ff2dc154c90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009d90 tx=0x7ff2d402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3c6212a3a47329 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.550+0000 7ff2da7fc640 1 -- 172.21.15.132:0/1912625805 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d402cbd0 con 0x7ff2dc0ca8d0 2023-11-18T20:41:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.550+0000 7ff2da7fc640 1 -- 172.21.15.132:0/1912625805 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d402cd30 con 0x7ff2dc0ca8d0 2023-11-18T20:41:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.550+0000 7ff2da7fc640 1 -- 172.21.15.132:0/1912625805 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d402cea0 con 0x7ff2dc0ca8d0 2023-11-18T20:41:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.551+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/1912625805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca8d0 msgr2=0x7ff2dc154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.551+0000 7ff2e0cdf640 1 --2- 172.21.15.132:0/1912625805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca8d0 0x7ff2dc154c90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009d90 tx=0x7ff2d402be20 comp rx=0 tx=0).stop 2023-11-18T20:41:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.551+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/1912625805 shutdown_connections 2023-11-18T20:41:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.551+0000 7ff2e0cdf640 1 --2- 172.21.15.132:0/1912625805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca8d0 0x7ff2dc154c90 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.551+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/1912625805 >> 172.21.15.132:0/1912625805 conn(0x7ff2dc0abf00 msgr2=0x7ff2dc0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.551+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/1912625805 shutdown_connections 2023-11-18T20:41:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.551+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/1912625805 wait complete. 2023-11-18T20:41:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.553+0000 7ff2e0cdf640 1 Processor -- start 2023-11-18T20:41:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.553+0000 7ff2e0cdf640 1 -- start start 2023-11-18T20:41:50.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.554+0000 7ff2e0cdf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca450 0x7ff2dc152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.554+0000 7ff2e0cdf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2dc0ca8d0 0x7ff2dc1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.554+0000 7ff2e0cdf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2dc14e7c0 0x7ff2dc154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.554+0000 7ff2e0cdf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0c39c0 con 0x7ff2dc0ca450 2023-11-18T20:41:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.554+0000 7ff2e0cdf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc1e9b80 con 0x7ff2dc0ca8d0 2023-11-18T20:41:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.554+0000 7ff2e0cdf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0c0e10 con 0x7ff2dc14e7c0 2023-11-18T20:41:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca450 0x7ff2dc152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca450 0x7ff2dc152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43328/0 (socket says 172.21.15.132:43328) 2023-11-18T20:41:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 -- 172.21.15.132:0/2869730800 learned_addr learned my addr 172.21.15.132:0/2869730800 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 -- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2dc14e7c0 msgr2=0x7ff2dc154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2dbfff640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2dc14e7c0 0x7ff2dc154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2daffd640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2dc0ca8d0 0x7ff2dc1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2dc14e7c0 0x7ff2dc154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 -- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2dc0ca8d0 msgr2=0x7ff2dc1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2dc0ca8d0 0x7ff2dc1542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 -- 172.21.15.132:0/2869730800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4009a70 con 0x7ff2dc0ca450 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2dbfff640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2dc14e7c0 0x7ff2dc154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.555+0000 7ff2db7fe640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca450 0x7ff2dc152660 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c410 tx=0x7ff2cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.556+0000 7ff2c3fff640 1 -- 172.21.15.132:0/2869730800 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc005ce0 con 0x7ff2dc0ca450 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.556+0000 7ff2c3fff640 1 -- 172.21.15.132:0/2869730800 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc005e40 con 0x7ff2dc0ca450 2023-11-18T20:41:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.556+0000 7ff2c3fff640 1 -- 172.21.15.132:0/2869730800 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0072f0 con 0x7ff2dc0ca450 2023-11-18T20:41:50.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.556+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc0c36e0 con 0x7ff2dc0ca450 2023-11-18T20:41:50.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.556+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc0c1060 con 0x7ff2dc0ca450 2023-11-18T20:41:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.557+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc04e840 con 0x7ff2dc0ca450 2023-11-18T20:41:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.558+0000 7ff2c3fff640 1 -- 172.21.15.132:0/2869730800 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2cc007450 con 0x7ff2dc0ca450 2023-11-18T20:41:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.559+0000 7ff2c3fff640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.559+0000 7ff2c3fff640 1 -- 172.21.15.132:0/2869730800 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7ff2cc088f90 con 0x7ff2dc0ca450 2023-11-18T20:41:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.560+0000 7ff2daffd640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.561+0000 7ff2daffd640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc149c20 tx=0x7ff2d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.563+0000 7ff2c3fff640 1 -- 172.21.15.132:0/2869730800 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2cc0bbe90 con 0x7ff2dc0ca450 2023-11-18T20:41:50.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.771+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff2dc0c7c40 con 0x7ff2dc0ca450 2023-11-18T20:41:50.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.771+0000 7ff2c3fff640 1 -- 172.21.15.132:0/2869730800 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff2cc017080 con 0x7ff2dc0ca450 2023-11-18T20:41:50.776 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 msgr2=0x7ff2c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc149c20 tx=0x7ff2d0009040 comp rx=0 tx=0).stop 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca450 msgr2=0x7ff2dc152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca450 0x7ff2dc152660 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c410 tx=0x7ff2cc00c8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 shutdown_connections 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2dc14e7c0 0x7ff2dc154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2dc0ca8d0 0x7ff2dc1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 --2- 172.21.15.132:0/2869730800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2dc0ca450 0x7ff2dc152660 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 >> 172.21.15.132:0/2869730800 conn(0x7ff2dc0abf00 msgr2=0x7ff2dc06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.774+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 shutdown_connections 2023-11-18T20:41:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:50.775+0000 7ff2e0cdf640 1 -- 172.21.15.132:0/2869730800 wait complete. 2023-11-18T20:41:50.794 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-18T20:41:50.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:50.794 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:50.929 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:41:50.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:50.930 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-18T20:41:50.986 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:50.986 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:51.025 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:41:51.025 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:41:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.254+0000 7f38e197c640 1 Processor -- start 2023-11-18T20:41:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.254+0000 7f38e197c640 1 -- start start 2023-11-18T20:41:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.256+0000 7f38e197c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f38dc073a00 0x7f38dc06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.256+0000 7f38e197c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc158030 0x7f38dc1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.256+0000 7f38e197c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc06aa40 con 0x7f38dc157c50 2023-11-18T20:41:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.256+0000 7f38e197c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc0c00d0 con 0x7f38dc073a00 2023-11-18T20:41:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.256+0000 7f38e197c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0c1e00 con 0x7f38dc158030 2023-11-18T20:41:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.257+0000 7f38daffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f38dc157c50 0x7f38dc0c0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43714/0 (socket says 172.21.15.132:43714) 2023-11-18T20:41:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.257+0000 7f38daffd640 1 -- 172.21.15.132:0/1461584501 learned_addr learned my addr 172.21.15.132:0/1461584501 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.257+0000 7f38d27fc640 1 --2- 172.21.15.132:0/1461584501 >> v2:172.21.15.132:3300/0 conn(0x7f38dc073a00 0x7f38dc06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.257+0000 7f38db7fe640 1 --2- 172.21.15.132:0/1461584501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc158030 0x7f38dc1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.257+0000 7f38d27fc640 1 -- 172.21.15.132:0/1461584501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc158030 msgr2=0x7f38dc1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.257+0000 7f38d27fc640 1 --2- 172.21.15.132:0/1461584501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc158030 0x7f38dc1584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.257+0000 7f38d27fc640 1 -- 172.21.15.132:0/1461584501 >> v1:172.21.15.132:6789/0 conn(0x7f38dc157c50 legacy=0x7f38dc0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.257+0000 7f38d27fc640 1 -- 172.21.15.132:0/1461584501 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc0bfa80 con 0x7f38dc073a00 2023-11-18T20:41:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.258+0000 7f38d27fc640 1 --2- 172.21.15.132:0/1461584501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc073a00 0x7f38dc06a500 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f38c40097a0 tx=0x7f38c402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9849c89cc6febc23 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38da7fc640 1 -- 172.21.15.132:0/1461584501 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c402d040 con 0x7f38dc073a00 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38da7fc640 1 -- 172.21.15.132:0/1461584501 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4031810 con 0x7f38dc073a00 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38da7fc640 1 -- 172.21.15.132:0/1461584501 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4031ba0 con 0x7f38dc073a00 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38e197c640 1 -- 172.21.15.132:0/1461584501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc073a00 msgr2=0x7f38dc06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38e197c640 1 --2- 172.21.15.132:0/1461584501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc073a00 0x7f38dc06a500 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f38c40097a0 tx=0x7f38c402b8b0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38e197c640 1 -- 172.21.15.132:0/1461584501 shutdown_connections 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38e197c640 1 --2- 172.21.15.132:0/1461584501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc158030 0x7f38dc1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38e197c640 1 --2- 172.21.15.132:0/1461584501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc073a00 0x7f38dc06a500 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38e197c640 1 -- 172.21.15.132:0/1461584501 >> 172.21.15.132:0/1461584501 conn(0x7f38dc0c30b0 msgr2=0x7f38dc0c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38e197c640 1 -- 172.21.15.132:0/1461584501 shutdown_connections 2023-11-18T20:41:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.259+0000 7f38e197c640 1 -- 172.21.15.132:0/1461584501 wait complete. 2023-11-18T20:41:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.261+0000 7f38e197c640 1 Processor -- start 2023-11-18T20:41:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.261+0000 7f38e197c640 1 -- start start 2023-11-18T20:41:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38e197c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38dc073a00 0x7f38dc0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38e197c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc157c50 0x7f38dc14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38e197c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc158030 0x7f38dc1ed720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38e197c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc1ed300 con 0x7f38dc158030 2023-11-18T20:41:51.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38e197c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc14a5b0 con 0x7f38dc073a00 2023-11-18T20:41:51.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38e197c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0abb10 con 0x7f38dc157c50 2023-11-18T20:41:51.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38db7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc158030 0x7f38dc1ed720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:51.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38db7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc158030 0x7f38dc1ed720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43346/0 (socket says 172.21.15.132:43346) 2023-11-18T20:41:51.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.262+0000 7f38db7fe640 1 -- 172.21.15.132:0/986322141 learned_addr learned my addr 172.21.15.132:0/986322141 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:51.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38d27fc640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc157c50 0x7f38dc14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:51.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38daffd640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38dc073a00 0x7f38dc0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:51.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38db7fe640 1 -- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc157c50 msgr2=0x7f38dc14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:51.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38db7fe640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc157c50 0x7f38dc14d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38db7fe640 1 -- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38dc073a00 msgr2=0x7f38dc0aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38db7fe640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38dc073a00 0x7f38dc0aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38db7fe640 1 -- 172.21.15.132:0/986322141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c4009400 con 0x7f38dc158030 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38db7fe640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc158030 0x7f38dc1ed720 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f38d400c550 tx=0x7f38d400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38d8ff9640 1 -- 172.21.15.132:0/986322141 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4004220 con 0x7f38dc158030 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38d8ff9640 1 -- 172.21.15.132:0/986322141 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d4004380 con 0x7f38dc158030 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38d8ff9640 1 -- 172.21.15.132:0/986322141 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4003830 con 0x7f38dc158030 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc0abdf0 con 0x7f38dc158030 2023-11-18T20:41:51.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.263+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc0ac3b0 con 0x7f38dc158030 2023-11-18T20:41:51.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.265+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc066b40 con 0x7f38dc158030 2023-11-18T20:41:51.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.266+0000 7f38d8ff9640 1 -- 172.21.15.132:0/986322141 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38d4003990 con 0x7f38dc158030 2023-11-18T20:41:51.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.267+0000 7f38d8ff9640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f38bc06ae40 0x7f38bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:51.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.267+0000 7f38d8ff9640 1 -- 172.21.15.132:0/986322141 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f38d4089650 con 0x7f38dc158030 2023-11-18T20:41:51.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.267+0000 7f38daffd640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f38bc06ae40 0x7f38bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:51.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.268+0000 7f38daffd640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f38bc06ae40 0x7f38bc06d300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f38cc005c00 tx=0x7f38cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.271+0000 7f38d8ff9640 1 -- 172.21.15.132:0/986322141 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38d40543c0 con 0x7f38dc158030 2023-11-18T20:41:51.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.506+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f38dc1ed440 con 0x7f38dc158030 2023-11-18T20:41:51.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.507+0000 7f38d8ff9640 1 -- 172.21.15.132:0/986322141 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+149 (secure 0 0 0) 0x7f38dc1ed440 con 0x7f38dc158030 2023-11-18T20:41:51.509 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:41:51.509 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-18T20:41:51.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f38bc06ae40 msgr2=0x7f38bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:51.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f38bc06ae40 0x7f38bc06d300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f38cc005c00 tx=0x7f38cc009040 comp rx=0 tx=0).stop 2023-11-18T20:41:51.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc158030 msgr2=0x7f38dc1ed720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:51.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc158030 0x7f38dc1ed720 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f38d400c550 tx=0x7f38d400ca10 comp rx=0 tx=0).stop 2023-11-18T20:41:51.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 shutdown_connections 2023-11-18T20:41:51.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f38bc06ae40 0x7f38bc06d300 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38dc158030 0x7f38dc1ed720 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38dc157c50 0x7f38dc14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 --2- 172.21.15.132:0/986322141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38dc073a00 0x7f38dc0aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:51.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 >> 172.21.15.132:0/986322141 conn(0x7f38dc0c30b0 msgr2=0x7f38dc0c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:51.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 shutdown_connections 2023-11-18T20:41:51.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:51.510+0000 7f38e197c640 1 -- 172.21.15.132:0/986322141 wait complete. 2023-11-18T20:41:51.530 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T20:41:51.531 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:41:51.531 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-18T20:41:51.531 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-18T20:41:51.531 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:51.531 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T20:41:51.532 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:41:51.532 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.wMmmEWIrtV 2023-11-18T20:41:51.532 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-18T20:41:51.586 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.NdK8eMdAHh 2023-11-18T20:41:51.587 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /tmp/tmp.wMmmEWIrtV /tmp/tmp.NdK8eMdAHh 2023-11-18T20:41:51.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.NdK8eMdAHh 2023-11-18T20:41:51.886 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.NdK8eMdAHh is 226B 2023-11-18T20:41:51.947 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.NdK8eMdAHh 2023-11-18T20:41:52.001 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-18T20:41:52.001 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:41:52.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:52.002 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-18T20:41:52.055 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:41:52.055 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:41:52.056 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:41:52.056 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:52.056 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-18T20:41:52.056 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:52.057 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:52.057 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:52.058 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-18T20:41:52.058 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:52.058 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:52.058 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-18T20:41:52.058 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:52.059 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:52.059 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:41:52.059 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:52.059 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:41:52.060 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42199sec preferred_lft 42199sec 2023-11-18T20:41:52.060 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-18T20:41:52.060 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:52.060 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:41:52.060 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:52.061 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:41:52.061 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:52.061 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::84fc:84ff:fe41:e5e7/64 scope link 2023-11-18T20:41:52.062 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:52.062 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:41:52.062 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether aa:8f:eb:95:c6:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T20:41:52.062 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a88f:ebff:fe95:c612/64 scope link 2023-11-18T20:41:52.062 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:52.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:52.063 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:41:52.157 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-18T20:41:52.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:52.162 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-18T20:41:52.215 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-18T20:41:52.216 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:41:52.216 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:41:52.216 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:41:52.216 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:41:52.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:52.216 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-18T20:41:52.216 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-18T20:41:52.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:41:52.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:41:52.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:41:52.217 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-18T20:41:52.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:52.392 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:41:52.442 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T20:41:52.442 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:41:52.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:52.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-18T20:41:52.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:52.523 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:52.575 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T20:41:52.576 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:52.576 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:52.626 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:52.626 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/tmp/tmp.wMmmEWIrtV of=/dev/stdout 2023-11-18T20:41:52.674 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:41:52.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:52.675 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2023-11-18T20:41:52.865 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2023-11-18T20:41:52.865 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2023-11-18T20:41:52.865 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:41:52.866 INFO:teuthology.orchestra.run.smithi132.stdout:keyring.get_secret failed 2023-11-18T20:41:52.887 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2023-11-18T20:41:52.888 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2023-11-18T20:41:52.888 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:41:52.888 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:52.888 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:52.888 INFO:teuthology.orchestra.run.smithi132.stdout:keyring.get_secret failed 2023-11-18T20:41:52.915 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,secret=AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2023-11-18T20:41:52.915 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2023-11-18T20:41:52.915 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-11-18T20:41:52.915 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:52.915 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:52.915 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:41:52.915 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:41:52.915 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs,key=testuser,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:41:52.917 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-18T20:41:52.917 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:41:52.917 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:41:52.917 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:41:52.918 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:41:52.923 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:41:52.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:52.923 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T20:41:53.005 INFO:teuthology.orchestra.run.smithi132.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-11-18T20:41:53.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:41:53.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:53.008 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:41:53.062 INFO:teuthology.orchestra.run.smithi132.stdout:client5551 2023-11-18T20:41:53.063 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:53.063 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:53.117 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-11-18T20:41:53.176 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.muCaBJdhFM 2023-11-18T20:41:53.176 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:53.176 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/tmp/tmp.muCaBJdhFM 2023-11-18T20:41:53.230 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:53.230 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:53.330 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:53.330 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:53.386 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:53.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.609+0000 7fa020c52640 1 Processor -- start 2023-11-18T20:41:53.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.609+0000 7fa020c52640 1 -- start start 2023-11-18T20:41:53.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.610+0000 7fa020c52640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa01c0c0440 0x7fa01c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:53.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa020c52640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:53.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa020c52640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c071e80 con 0x7fa01c14c2e0 2023-11-18T20:41:53.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa020c52640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c071470 con 0x7fa01c0c0440 2023-11-18T20:41:53.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa020c52640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c14c6c0 con 0x7fa01c072310 2023-11-18T20:41:53.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa013fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa01c0c0440 0x7fa01c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:53.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa013fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa01c0c0440 0x7fa01c0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43356/0 (socket says 172.21.15.132:43356) 2023-11-18T20:41:53.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa013fff640 1 -- 172.21.15.132:0/348268439 learned_addr learned my addr 172.21.15.132:0/348268439 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:53.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa013fff640 1 -- 172.21.15.132:0/348268439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 msgr2=0x7fa01c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:53.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa01bfff640 1 --2- 172.21.15.132:0/348268439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:53.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa013fff640 1 --2- 172.21.15.132:0/348268439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa013fff640 1 -- 172.21.15.132:0/348268439 >> v1:172.21.15.161:6789/0 conn(0x7fa01c14c2e0 legacy=0x7fa01c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:53.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.611+0000 7fa013fff640 1 -- 172.21.15.132:0/348268439 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c06fdc0 con 0x7fa01c0c0440 2023-11-18T20:41:53.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.612+0000 7fa013fff640 1 --2- 172.21.15.132:0/348268439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0c0440 0x7fa01c0c0c80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa004009870 tx=0x7fa00402b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff02cfd8274125f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.613+0000 7fa01affd640 1 -- 172.21.15.132:0/348268439 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004033620 con 0x7fa01c0c0440 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.613+0000 7fa01affd640 1 -- 172.21.15.132:0/348268439 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa004033780 con 0x7fa01c0c0440 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.613+0000 7fa01affd640 1 -- 172.21.15.132:0/348268439 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004033b10 con 0x7fa01c0c0440 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.613+0000 7fa020c52640 1 -- 172.21.15.132:0/348268439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0c0440 msgr2=0x7fa01c0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.613+0000 7fa020c52640 1 --2- 172.21.15.132:0/348268439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0c0440 0x7fa01c0c0c80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa004009870 tx=0x7fa00402b7d0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.614+0000 7fa020c52640 1 -- 172.21.15.132:0/348268439 shutdown_connections 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.614+0000 7fa020c52640 1 --2- 172.21.15.132:0/348268439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.614+0000 7fa020c52640 1 --2- 172.21.15.132:0/348268439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0c0440 0x7fa01c0c0c80 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.614+0000 7fa020c52640 1 -- 172.21.15.132:0/348268439 >> 172.21.15.132:0/348268439 conn(0x7fa01c0a77f0 msgr2=0x7fa01c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:53.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.614+0000 7fa020c52640 1 -- 172.21.15.132:0/348268439 shutdown_connections 2023-11-18T20:41:53.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.614+0000 7fa020c52640 1 -- 172.21.15.132:0/348268439 wait complete. 2023-11-18T20:41:53.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.616+0000 7fa020c52640 1 Processor -- start 2023-11-18T20:41:53.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.616+0000 7fa020c52640 1 -- start start 2023-11-18T20:41:53.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa020c52640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:53.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa020c52640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01c0c0440 0x7fa01c1ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:53.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa020c52640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c14c2e0 0x7fa01c1ea880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:53.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa020c52640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c06df00 con 0x7fa01c14c2e0 2023-11-18T20:41:53.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa020c52640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c149650 con 0x7fa01c0c0440 2023-11-18T20:41:53.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa020c52640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c1490b0 con 0x7fa01c072310 2023-11-18T20:41:53.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa01bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c14c2e0 0x7fa01c1ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:53.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa01bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c14c2e0 0x7fa01c1ea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43364/0 (socket says 172.21.15.132:43364) 2023-11-18T20:41:53.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.617+0000 7fa01bfff640 1 -- 172.21.15.132:0/607586838 learned_addr learned my addr 172.21.15.132:0/607586838 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:53.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa01b7fe640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:53.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa01bfff640 1 -- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 msgr2=0x7fa01c0bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:53.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa013fff640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01c0c0440 0x7fa01c1ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:53.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa01bfff640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa01bfff640 1 -- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01c0c0440 msgr2=0x7fa01c1ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa01bfff640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01c0c0440 0x7fa01c1ea340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa01bfff640 1 -- 172.21.15.132:0/607586838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040094d0 con 0x7fa01c14c2e0 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa01b7fe640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa01bfff640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c14c2e0 0x7fa01c1ea880 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa01400cd70 tx=0x7fa01400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa018ff9640 1 -- 172.21.15.132:0/607586838 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014003b90 con 0x7fa01c14c2e0 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa018ff9640 1 -- 172.21.15.132:0/607586838 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014003cf0 con 0x7fa01c14c2e0 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa018ff9640 1 -- 172.21.15.132:0/607586838 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014004240 con 0x7fa01c14c2e0 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.618+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c1edfe0 con 0x7fa01c14c2e0 2023-11-18T20:41:53.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.619+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c1e9e20 con 0x7fa01c14c2e0 2023-11-18T20:41:53.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.620+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c1e9c80 con 0x7fa01c14c2e0 2023-11-18T20:41:53.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.621+0000 7fa018ff9640 1 -- 172.21.15.132:0/607586838 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa0140043a0 con 0x7fa01c14c2e0 2023-11-18T20:41:53.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.622+0000 7fa018ff9640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ffc06ae40 0x7f9ffc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:53.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.622+0000 7fa018ff9640 1 -- 172.21.15.132:0/607586838 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fa014012070 con 0x7fa01c14c2e0 2023-11-18T20:41:53.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.622+0000 7fa01b7fe640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ffc06ae40 0x7f9ffc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:53.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.623+0000 7fa01b7fe640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ffc06ae40 0x7f9ffc06d300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00a810 tx=0x7fa00c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:53.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.627+0000 7fa018ff9640 1 -- 172.21.15.132:0/607586838 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa01c1e9c80 con 0x7fa01c14c2e0 2023-11-18T20:41:53.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.820+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa01c1e9c80 con 0x7fa01c14c2e0 2023-11-18T20:41:53.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.824+0000 7fa018ff9640 1 -- 172.21.15.132:0/607586838 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+20453 (secure 0 0 0) 0x7fa01c1e9c80 con 0x7fa01c14c2e0 2023-11-18T20:41:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:53.826 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":82,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:48.564301+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:53.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ffc06ae40 msgr2=0x7f9ffc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:53.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ffc06ae40 0x7f9ffc06d300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00a810 tx=0x7fa00c008040 comp rx=0 tx=0).stop 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c14c2e0 msgr2=0x7fa01c1ea880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c14c2e0 0x7fa01c1ea880 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa01400cd70 tx=0x7fa01400a660 comp rx=0 tx=0).stop 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 shutdown_connections 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f9ffc06ae40 0x7f9ffc06d300 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c14c2e0 0x7fa01c1ea880 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01c0c0440 0x7fa01c1ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 --2- 172.21.15.132:0/607586838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01c072310 0x7fa01c0bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 >> 172.21.15.132:0/607586838 conn(0x7fa01c0a77f0 msgr2=0x7fa01c14b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 shutdown_connections 2023-11-18T20:41:53.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:53.827+0000 7fa020c52640 1 -- 172.21.15.132:0/607586838 wait complete. 2023-11-18T20:41:53.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:41:17.894376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:41:18.520471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:41:33.270522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:41:33.924631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:41:53.849 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:41:54.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.055+0000 7f89df3e9640 1 Processor -- start 2023-11-18T20:41:54.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.055+0000 7f89df3e9640 1 -- start start 2023-11-18T20:41:54.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.056+0000 7f89df3e9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f89d80c0440 0x7f89d80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.056+0000 7f89df3e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.056+0000 7f89df3e9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d8071e80 con 0x7f89d814c2e0 2023-11-18T20:41:54.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.056+0000 7f89df3e9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d8071470 con 0x7f89d80c0440 2023-11-18T20:41:54.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.056+0000 7f89df3e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d814c6c0 con 0x7f89d8072310 2023-11-18T20:41:54.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.057+0000 7f89ddbe6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f89d80c0440 0x7f89d80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.057+0000 7f89debe8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.057+0000 7f89debe8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d80a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:47870/0 (socket says 172.21.15.132:47870) 2023-11-18T20:41:54.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.057+0000 7f89debe8640 1 -- 172.21.15.132:0/4233176340 learned_addr learned my addr 172.21.15.132:0/4233176340 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:54.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.057+0000 7f89ddbe6640 1 --2- 172.21.15.132:0/4233176340 >> v2:172.21.15.161:3300/0 conn(0x7f89d80c0440 0x7f89d80c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:34348/0 (socket says 172.21.15.132:34348) 2023-11-18T20:41:54.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.058+0000 7f89debe8640 1 -- 172.21.15.132:0/4233176340 >> v2:172.21.15.161:3300/0 conn(0x7f89d80c0440 msgr2=0x7f89d80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.058+0000 7f89debe8640 1 --2- 172.21.15.132:0/4233176340 >> v2:172.21.15.161:3300/0 conn(0x7f89d80c0440 0x7f89d80c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.058+0000 7f89debe8640 1 -- 172.21.15.132:0/4233176340 >> v1:172.21.15.161:6789/0 conn(0x7f89d814c2e0 legacy=0x7f89d8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.058+0000 7f89debe8640 1 -- 172.21.15.132:0/4233176340 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d806fdc0 con 0x7f89d8072310 2023-11-18T20:41:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.058+0000 7f89dd3e5640 1 -- 172.21.15.132:0/4233176340 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084944629 0 0) 0x7f89d8071e80 con 0x7f89d814c2e0 2023-11-18T20:41:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.059+0000 7f89debe8640 1 --2- 172.21.15.132:0/4233176340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d80a4d20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009e50 tx=0x7f89d002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916d1e8de02fdfc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89dd3e5640 1 -- 172.21.15.132:0/4233176340 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d002c9e0 con 0x7f89d8072310 2023-11-18T20:41:54.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89dd3e5640 1 -- 172.21.15.132:0/4233176340 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d002cb40 con 0x7f89d8072310 2023-11-18T20:41:54.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89dd3e5640 1 -- 172.21.15.132:0/4233176340 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00343f0 con 0x7f89d8072310 2023-11-18T20:41:54.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89df3e9640 1 -- 172.21.15.132:0/4233176340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 msgr2=0x7f89d80a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89df3e9640 1 --2- 172.21.15.132:0/4233176340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d80a4d20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009e50 tx=0x7f89d002be40 comp rx=0 tx=0).stop 2023-11-18T20:41:54.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89df3e9640 1 -- 172.21.15.132:0/4233176340 shutdown_connections 2023-11-18T20:41:54.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89df3e9640 1 --2- 172.21.15.132:0/4233176340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d80a4d20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89df3e9640 1 --2- 172.21.15.132:0/4233176340 >> v2:172.21.15.161:3300/0 conn(0x7f89d80c0440 0x7f89d80c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.060+0000 7f89df3e9640 1 -- 172.21.15.132:0/4233176340 >> 172.21.15.132:0/4233176340 conn(0x7f89d80a77f0 msgr2=0x7f89d80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:54.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.061+0000 7f89df3e9640 1 -- 172.21.15.132:0/4233176340 shutdown_connections 2023-11-18T20:41:54.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.061+0000 7f89df3e9640 1 -- 172.21.15.132:0/4233176340 wait complete. 2023-11-18T20:41:54.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.062+0000 7f89df3e9640 1 Processor -- start 2023-11-18T20:41:54.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.062+0000 7f89df3e9640 1 -- start start 2023-11-18T20:41:54.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.063+0000 7f89df3e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d81e8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.063+0000 7f89df3e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80c0440 0x7f89d81e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.063+0000 7f89df3e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d814c2e0 0x7f89d8155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.063+0000 7f89df3e9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80ab950 con 0x7f89d814c2e0 2023-11-18T20:41:54.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.063+0000 7f89df3e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d81e84b0 con 0x7f89d80c0440 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.063+0000 7f89df3e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80ab390 con 0x7f89d8072310 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d814c2e0 0x7f89d8155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d814c2e0 0x7f89d8155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43374/0 (socket says 172.21.15.132:43374) 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 -- 172.21.15.132:0/1885962397 learned_addr learned my addr 172.21.15.132:0/1885962397 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89de3e7640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d81e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89ddbe6640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80c0440 0x7f89d81e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 -- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 msgr2=0x7f89d81e8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d81e8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 -- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80c0440 msgr2=0x7f89d81e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80c0440 0x7f89d81e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 -- 172.21.15.132:0/1885962397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0009b30 con 0x7f89d814c2e0 2023-11-18T20:41:54.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.064+0000 7f89debe8640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d814c2e0 0x7f89d8155830 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009e50 tx=0x7f89d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.065+0000 7f89ceffd640 1 -- 172.21.15.132:0/1885962397 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d003e450 con 0x7f89d814c2e0 2023-11-18T20:41:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.065+0000 7f89ceffd640 1 -- 172.21.15.132:0/1885962397 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d003e5f0 con 0x7f89d814c2e0 2023-11-18T20:41:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.065+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d80ab670 con 0x7f89d814c2e0 2023-11-18T20:41:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.065+0000 7f89ceffd640 1 -- 172.21.15.132:0/1885962397 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d003e9a0 con 0x7f89d814c2e0 2023-11-18T20:41:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.065+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d8156190 con 0x7f89d814c2e0 2023-11-18T20:41:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.066+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d80a97a0 con 0x7f89d814c2e0 2023-11-18T20:41:54.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.067+0000 7f89ceffd640 1 -- 172.21.15.132:0/1885962397 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89d003eb00 con 0x7f89d814c2e0 2023-11-18T20:41:54.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.068+0000 7f89ceffd640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f89bc06ae40 0x7f89bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.068+0000 7f89ceffd640 1 -- 172.21.15.132:0/1885962397 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f89d00ac760 con 0x7f89d814c2e0 2023-11-18T20:41:54.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.068+0000 7f89de3e7640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f89bc06ae40 0x7f89bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.070+0000 7f89de3e7640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f89bc06ae40 0x7f89bc06d300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f89d4007fd0 tx=0x7f89d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.072+0000 7f89ceffd640 1 -- 172.21.15.132:0/1885962397 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89d80a97a0 con 0x7f89d814c2e0 2023-11-18T20:41:54.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.261+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89d80a9e60 con 0x7f89d814c2e0 2023-11-18T20:41:54.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.262+0000 7f89ceffd640 1 -- 172.21.15.132:0/1885962397 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89d80a9e60 con 0x7f89d814c2e0 2023-11-18T20:41:54.263 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:41:54.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.264+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f89bc06ae40 msgr2=0x7f89bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.264+0000 7f89df3e9640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f89bc06ae40 0x7f89bc06d300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f89d4007fd0 tx=0x7f89d4009040 comp rx=0 tx=0).stop 2023-11-18T20:41:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.264+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d814c2e0 msgr2=0x7f89d8155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.264+0000 7f89df3e9640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d814c2e0 0x7f89d8155830 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009e50 tx=0x7f89d0004a40 comp rx=0 tx=0).stop 2023-11-18T20:41:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.265+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 shutdown_connections 2023-11-18T20:41:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.265+0000 7f89df3e9640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f89bc06ae40 0x7f89bc06d300 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.265+0000 7f89df3e9640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d814c2e0 0x7f89d8155830 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.265+0000 7f89df3e9640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80c0440 0x7f89d81e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.265+0000 7f89df3e9640 1 --2- 172.21.15.132:0/1885962397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89d8072310 0x7f89d81e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.265+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 >> 172.21.15.132:0/1885962397 conn(0x7f89d80a77f0 msgr2=0x7f89d80c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:54.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.265+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 shutdown_connections 2023-11-18T20:41:54.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.265+0000 7f89df3e9640 1 -- 172.21.15.132:0/1885962397 wait complete. 2023-11-18T20:41:54.283 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:41:54.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.493+0000 7f70ae7a9640 1 Processor -- start 2023-11-18T20:41:54.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.493+0000 7f70ae7a9640 1 -- start start 2023-11-18T20:41:54.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70ae7a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f70a806d0a0 0x7f70a8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70ae7a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f70a80c3ea0 0x7f70a80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70ae7a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a80c64a0 con 0x7f70a814fd30 2023-11-18T20:41:54.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70ae7a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a80c5c00 con 0x7f70a806d0a0 2023-11-18T20:41:54.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70ae7a9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a80c5ee0 con 0x7f70a80c3ea0 2023-11-18T20:41:54.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70a7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f70a814fd30 0x7f70a80a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43724/0 (socket says 172.21.15.132:43724) 2023-11-18T20:41:54.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70a7fff640 1 -- 172.21.15.132:0/2559379134 learned_addr learned my addr 172.21.15.132:0/2559379134 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:54.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f709ffff640 1 --2- 172.21.15.132:0/2559379134 >> v2:172.21.15.132:3300/0 conn(0x7f70a806d0a0 0x7f70a8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70acd46640 1 --2- 172.21.15.132:0/2559379134 >> v2:172.21.15.161:3300/0 conn(0x7f70a80c3ea0 0x7f70a80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70a77fe640 1 -- 172.21.15.132:0/2559379134 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749508317 0 0) 0x7f70a80c64a0 con 0x7f70a814fd30 2023-11-18T20:41:54.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.495+0000 7f70a77fe640 1 -- 172.21.15.132:0/2559379134 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7094003520 con 0x7f70a814fd30 2023-11-18T20:41:54.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.496+0000 7f709ffff640 1 -- 172.21.15.132:0/2559379134 >> v2:172.21.15.161:3300/0 conn(0x7f70a80c3ea0 msgr2=0x7f70a80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:54.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.496+0000 7f709ffff640 1 --2- 172.21.15.132:0/2559379134 >> v2:172.21.15.161:3300/0 conn(0x7f70a80c3ea0 0x7f70a80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.496+0000 7f709ffff640 1 -- 172.21.15.132:0/2559379134 >> v1:172.21.15.132:6789/0 conn(0x7f70a814fd30 legacy=0x7f70a80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.496+0000 7f709ffff640 1 -- 172.21.15.132:0/2559379134 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a80c61c0 con 0x7f70a806d0a0 2023-11-18T20:41:54.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.497+0000 7f709ffff640 1 --2- 172.21.15.132:0/2559379134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a806d0a0 0x7f70a8152f20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f70a806e430 tx=0x7f709002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345553474a486226 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.497+0000 7f70a77fe640 1 -- 172.21.15.132:0/2559379134 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090031830 con 0x7f70a806d0a0 2023-11-18T20:41:54.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.497+0000 7f70a77fe640 1 -- 172.21.15.132:0/2559379134 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7090031990 con 0x7f70a806d0a0 2023-11-18T20:41:54.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.497+0000 7f70a77fe640 1 -- 172.21.15.132:0/2559379134 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090031d20 con 0x7f70a806d0a0 2023-11-18T20:41:54.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.498+0000 7f70ae7a9640 1 -- 172.21.15.132:0/2559379134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a806d0a0 msgr2=0x7f70a8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.498+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/2559379134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a806d0a0 0x7f70a8152f20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f70a806e430 tx=0x7f709002b8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.498+0000 7f70ae7a9640 1 -- 172.21.15.132:0/2559379134 shutdown_connections 2023-11-18T20:41:54.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.498+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/2559379134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a806d0a0 0x7f70a8152f20 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.498+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/2559379134 >> v2:172.21.15.161:3300/0 conn(0x7f70a80c3ea0 0x7f70a80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.498+0000 7f70ae7a9640 1 -- 172.21.15.132:0/2559379134 >> 172.21.15.132:0/2559379134 conn(0x7f70a806a500 msgr2=0x7f70a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:54.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.498+0000 7f70ae7a9640 1 -- 172.21.15.132:0/2559379134 shutdown_connections 2023-11-18T20:41:54.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.498+0000 7f70ae7a9640 1 -- 172.21.15.132:0/2559379134 wait complete. 2023-11-18T20:41:54.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.500+0000 7f70ae7a9640 1 Processor -- start 2023-11-18T20:41:54.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.500+0000 7f70ae7a9640 1 -- start start 2023-11-18T20:41:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f70ae7a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a806d0a0 0x7f70a81eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f70ae7a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a80c3ea0 0x7f70a80a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f70ae7a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70a814fd30 0x7f70a80a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f70ae7a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a80aa320 con 0x7f70a80c3ea0 2023-11-18T20:41:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f70ae7a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8153c30 con 0x7f70a806d0a0 2023-11-18T20:41:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f70ae7a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a81e1960 con 0x7f70a814fd30 2023-11-18T20:41:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f709ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a80c3ea0 0x7f70a80a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f709ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a80c3ea0 0x7f70a80a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43378/0 (socket says 172.21.15.132:43378) 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.501+0000 7f709ffff640 1 -- 172.21.15.132:0/4076995893 learned_addr learned my addr 172.21.15.132:0/4076995893 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f70acd46640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70a814fd30 0x7f70a80a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f70a7fff640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a806d0a0 0x7f70a81eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f709ffff640 1 -- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70a814fd30 msgr2=0x7f70a80a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f709ffff640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70a814fd30 0x7f70a80a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f709ffff640 1 -- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a806d0a0 msgr2=0x7f70a81eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f709ffff640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a806d0a0 0x7f70a81eda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f709ffff640 1 -- 172.21.15.132:0/4076995893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090009400 con 0x7f70a80c3ea0 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f70a7fff640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a806d0a0 0x7f70a81eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f709ffff640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a80c3ea0 0x7f70a80a98a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f7090009890 tx=0x7f70900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f70a57fa640 1 -- 172.21.15.132:0/4076995893 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709003a8f0 con 0x7f70a80c3ea0 2023-11-18T20:41:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f70a57fa640 1 -- 172.21.15.132:0/4076995893 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709003aa70 con 0x7f70a80c3ea0 2023-11-18T20:41:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.502+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a81eb700 con 0x7f70a80c3ea0 2023-11-18T20:41:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.503+0000 7f70a57fa640 1 -- 172.21.15.132:0/4076995893 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709003ae20 con 0x7f70a80c3ea0 2023-11-18T20:41:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.503+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a8153e80 con 0x7f70a80c3ea0 2023-11-18T20:41:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.504+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a8068350 con 0x7f70a80c3ea0 2023-11-18T20:41:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.505+0000 7f70a57fa640 1 -- 172.21.15.132:0/4076995893 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70900443f0 con 0x7f70a80c3ea0 2023-11-18T20:41:54.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.506+0000 7f70a57fa640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f708806ae70 0x7f708806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.506+0000 7f70a57fa640 1 -- 172.21.15.132:0/4076995893 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f70900abb20 con 0x7f70a80c3ea0 2023-11-18T20:41:54.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.506+0000 7f70a7fff640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f708806ae70 0x7f708806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.508+0000 7f70a7fff640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f708806ae70 0x7f708806d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f70980011e0 tx=0x7f7098009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.510+0000 7f70a57fa640 1 -- 172.21.15.132:0/4076995893 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70900769b0 con 0x7f70a80c3ea0 2023-11-18T20:41:54.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.701+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70a806ad70 con 0x7f70a80c3ea0 2023-11-18T20:41:54.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.702+0000 7f70a57fa640 1 -- 172.21.15.132:0/4076995893 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7090079fd0 con 0x7f70a80c3ea0 2023-11-18T20:41:54.703 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:41:54.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f708806ae70 msgr2=0x7f708806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f708806ae70 0x7f708806d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f70980011e0 tx=0x7f7098009040 comp rx=0 tx=0).stop 2023-11-18T20:41:54.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a80c3ea0 msgr2=0x7f70a80a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a80c3ea0 0x7f70a80a98a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f7090009890 tx=0x7f70900046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 shutdown_connections 2023-11-18T20:41:54.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f708806ae70 0x7f708806d330 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70a814fd30 0x7f70a80a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a80c3ea0 0x7f70a80a98a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 --2- 172.21.15.132:0/4076995893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a806d0a0 0x7f70a81eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 >> 172.21.15.132:0/4076995893 conn(0x7f70a806a500 msgr2=0x7f70a80c30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:54.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 shutdown_connections 2023-11-18T20:41:54.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.705+0000 7f70ae7a9640 1 -- 172.21.15.132:0/4076995893 wait complete. 2023-11-18T20:41:54.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:41:54.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.940+0000 7f09a00a2640 1 Processor -- start 2023-11-18T20:41:54.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.940+0000 7f09a00a2640 1 -- start start 2023-11-18T20:41:54.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.941+0000 7f09a00a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09980a9b40 0x7f09980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.941+0000 7f09a00a2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980c06c0 con 0x7f09980c1500 2023-11-18T20:41:54.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.941+0000 7f09a00a2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980c1020 con 0x7f0998155490 2023-11-18T20:41:54.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.941+0000 7f09a00a2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980a5820 con 0x7f09980a9b40 2023-11-18T20:41:54.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.941+0000 7f099d63d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09980a9b40 0x7f09980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.942+0000 7f099e63f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f09980c1500 0x7f09980c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43736/0 (socket says 172.21.15.132:43736) 2023-11-18T20:41:54.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.942+0000 7f099e63f640 1 -- 172.21.15.132:0/322877134 learned_addr learned my addr 172.21.15.132:0/322877134 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:54.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.942+0000 7f099d63d640 1 --2- 172.21.15.132:0/322877134 >> v2:172.21.15.132:3300/0 conn(0x7f09980a9b40 0x7f09980a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43388/0 (socket says 172.21.15.132:43388) 2023-11-18T20:41:54.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.942+0000 7f099d63d640 1 -- 172.21.15.132:0/322877134 >> v1:172.21.15.161:6789/0 conn(0x7f0998155490 legacy=0x7f09980a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:54.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.942+0000 7f099d63d640 1 -- 172.21.15.132:0/322877134 >> v1:172.21.15.132:6789/0 conn(0x7f09980c1500 legacy=0x7f09980c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.942+0000 7f099d63d640 1 -- 172.21.15.132:0/322877134 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980c0910 con 0x7f09980a9b40 2023-11-18T20:41:54.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.943+0000 7f099d63d640 1 --2- 172.21.15.132:0/322877134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09980a9b40 0x7f09980a51b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f09880097a0 tx=0x7f098802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa216a9567721d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.943+0000 7f099ce3c640 1 -- 172.21.15.132:0/322877134 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988030610 con 0x7f09980a9b40 2023-11-18T20:41:54.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f099ce3c640 1 -- 172.21.15.132:0/322877134 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988030770 con 0x7f09980a9b40 2023-11-18T20:41:54.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f099ce3c640 1 -- 172.21.15.132:0/322877134 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988030b00 con 0x7f09980a9b40 2023-11-18T20:41:54.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f09a00a2640 1 -- 172.21.15.132:0/322877134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09980a9b40 msgr2=0x7f09980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f09a00a2640 1 --2- 172.21.15.132:0/322877134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09980a9b40 0x7f09980a51b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f09880097a0 tx=0x7f098802b960 comp rx=0 tx=0).stop 2023-11-18T20:41:54.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f09a00a2640 1 -- 172.21.15.132:0/322877134 shutdown_connections 2023-11-18T20:41:54.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f09a00a2640 1 --2- 172.21.15.132:0/322877134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09980a9b40 0x7f09980a51b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f09a00a2640 1 -- 172.21.15.132:0/322877134 >> 172.21.15.132:0/322877134 conn(0x7f099806a500 msgr2=0x7f099806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:54.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f09a00a2640 1 -- 172.21.15.132:0/322877134 shutdown_connections 2023-11-18T20:41:54.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.944+0000 7f09a00a2640 1 -- 172.21.15.132:0/322877134 wait complete. 2023-11-18T20:41:54.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.946+0000 7f09a00a2640 1 Processor -- start 2023-11-18T20:41:54.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.946+0000 7f09a00a2640 1 -- start start 2023-11-18T20:41:54.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f09a00a2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09980c1500 0x7f09980bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f09a00a2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0998155490 0x7f09981df0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f09a00a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0998071b70 0x7f09981ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f09a00a2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981ea560 con 0x7f0998071b70 2023-11-18T20:41:54.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f09a00a2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980bace0 con 0x7f0998155490 2023-11-18T20:41:54.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f09a00a2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09980bafa0 con 0x7f09980c1500 2023-11-18T20:41:54.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f099e63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0998071b70 0x7f09981ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f099e63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0998071b70 0x7f09981ea9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43392/0 (socket says 172.21.15.132:43392) 2023-11-18T20:41:54.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.947+0000 7f099e63f640 1 -- 172.21.15.132:0/712635986 learned_addr learned my addr 172.21.15.132:0/712635986 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:54.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099d63d640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0998155490 0x7f09981df0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099e63f640 1 -- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09980c1500 msgr2=0x7f09980bee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099de3e640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09980c1500 0x7f09980bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099e63f640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09980c1500 0x7f09980bee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099e63f640 1 -- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0998155490 msgr2=0x7f09981df0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099e63f640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0998155490 0x7f09981df0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099e63f640 1 -- 172.21.15.132:0/712635986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009400 con 0x7f0998071b70 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099d63d640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0998155490 0x7f09981df0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f099e63f640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0998071b70 0x7f09981ea9f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f099000cbc0 tx=0x7f099000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f098e7fc640 1 -- 172.21.15.132:0/712635986 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000ad40 con 0x7f0998071b70 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f098e7fc640 1 -- 172.21.15.132:0/712635986 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990012400 con 0x7f0998071b70 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09981ee230 con 0x7f0998071b70 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f098e7fc640 1 -- 172.21.15.132:0/712635986 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000aea0 con 0x7f0998071b70 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.948+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0998070f70 con 0x7f0998071b70 2023-11-18T20:41:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.949+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09981ea6d0 con 0x7f0998071b70 2023-11-18T20:41:54.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.950+0000 7f098e7fc640 1 -- 172.21.15.132:0/712635986 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0990007070 con 0x7f0998071b70 2023-11-18T20:41:54.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.951+0000 7f098e7fc640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f097c06ae40 0x7f097c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:54.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.951+0000 7f098e7fc640 1 -- 172.21.15.132:0/712635986 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f0990089850 con 0x7f0998071b70 2023-11-18T20:41:54.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.952+0000 7f099de3e640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f097c06ae40 0x7f097c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:54.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.953+0000 7f099de3e640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f097c06ae40 0x7f097c06d300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0994000f60 tx=0x7f0994009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:54.956+0000 7f098e7fc640 1 -- 172.21.15.132:0/712635986 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09900545d0 con 0x7f0998071b70 2023-11-18T20:41:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.145+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0998068350 con 0x7f0998071b70 2023-11-18T20:41:55.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.146+0000 7f098e7fc640 1 -- 172.21.15.132:0/712635986 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0990017020 con 0x7f0998071b70 2023-11-18T20:41:55.147 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:41:55.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f097c06ae40 msgr2=0x7f097c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f097c06ae40 0x7f097c06d300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0994000f60 tx=0x7f0994009040 comp rx=0 tx=0).stop 2023-11-18T20:41:55.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0998071b70 msgr2=0x7f09981ea9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0998071b70 0x7f09981ea9f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f099000cbc0 tx=0x7f099000a430 comp rx=0 tx=0).stop 2023-11-18T20:41:55.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 shutdown_connections 2023-11-18T20:41:55.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f097c06ae40 0x7f097c06d300 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0998071b70 0x7f09981ea9f0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0998155490 0x7f09981df0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 --2- 172.21.15.132:0/712635986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09980c1500 0x7f09980bee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 >> 172.21.15.132:0/712635986 conn(0x7f099806a500 msgr2=0x7f09980c22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:55.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 shutdown_connections 2023-11-18T20:41:55.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.149+0000 7f09a00a2640 1 -- 172.21.15.132:0/712635986 wait complete. 2023-11-18T20:41:55.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:41:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.390+0000 7f13a54ec640 1 Processor -- start 2023-11-18T20:41:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.390+0000 7f13a54ec640 1 -- start start 2023-11-18T20:41:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.391+0000 7f13a54ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 0x7f13a0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.391+0000 7f13a54ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13a006d0a0 0x7f13a00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.391+0000 7f13a54ec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13a00a5260 0x7f13a00c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.391+0000 7f13a54ec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a00c64a0 con 0x7f13a006d0a0 2023-11-18T20:41:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.391+0000 7f13a54ec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a00c5c00 con 0x7f13a00a5260 2023-11-18T20:41:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.391+0000 7f13a54ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00c5ee0 con 0x7f13a014fd30 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.391+0000 7f139e7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13a006d0a0 0x7f13a00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139e7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13a006d0a0 0x7f13a00a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43404/0 (socket says 172.21.15.132:43404) 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139e7fc640 1 -- 172.21.15.132:0/3659435789 learned_addr learned my addr 172.21.15.132:0/3659435789 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139effd640 1 --2- 172.21.15.132:0/3659435789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 0x7f13a0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139f7fe640 1 --2- 172.21.15.132:0/3659435789 >> v2:172.21.15.161:3300/0 conn(0x7f13a00a5260 0x7f13a00c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139e7fc640 1 -- 172.21.15.132:0/3659435789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 msgr2=0x7f13a0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139e7fc640 1 --2- 172.21.15.132:0/3659435789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 0x7f13a0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139e7fc640 1 -- 172.21.15.132:0/3659435789 >> v2:172.21.15.161:3300/0 conn(0x7f13a00a5260 msgr2=0x7f13a00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139e7fc640 1 --2- 172.21.15.132:0/3659435789 >> v2:172.21.15.161:3300/0 conn(0x7f13a00a5260 0x7f13a00c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.392+0000 7f139e7fc640 1 -- 172.21.15.132:0/3659435789 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00c61c0 con 0x7f13a006d0a0 2023-11-18T20:41:55.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.393+0000 7f139e7fc640 1 --2- 172.21.15.132:0/3659435789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00a4d20 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f13a006d990 tx=0x7f139402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba17a509e473999 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.393+0000 7f139dffb640 1 -- 172.21.15.132:0/3659435789 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394031870 con 0x7f13a006d0a0 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.393+0000 7f139dffb640 1 -- 172.21.15.132:0/3659435789 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13940319d0 con 0x7f13a006d0a0 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.393+0000 7f139dffb640 1 -- 172.21.15.132:0/3659435789 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394031d60 con 0x7f13a006d0a0 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 -- 172.21.15.132:0/3659435789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 msgr2=0x7f13a00a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 --2- 172.21.15.132:0/3659435789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00a4d20 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f13a006d990 tx=0x7f139402b910 comp rx=0 tx=0).stop 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 -- 172.21.15.132:0/3659435789 shutdown_connections 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 --2- 172.21.15.132:0/3659435789 >> v2:172.21.15.161:3300/0 conn(0x7f13a00a5260 0x7f13a00c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 --2- 172.21.15.132:0/3659435789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00a4d20 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 --2- 172.21.15.132:0/3659435789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 0x7f13a0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 -- 172.21.15.132:0/3659435789 >> 172.21.15.132:0/3659435789 conn(0x7f13a006a500 msgr2=0x7f13a006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 -- 172.21.15.132:0/3659435789 shutdown_connections 2023-11-18T20:41:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.394+0000 7f13a54ec640 1 -- 172.21.15.132:0/3659435789 wait complete. 2023-11-18T20:41:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.396+0000 7f13a54ec640 1 Processor -- start 2023-11-18T20:41:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.396+0000 7f13a54ec640 1 -- start start 2023-11-18T20:41:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f13a54ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f13a54ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a00a5260 0x7f13a014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f13a54ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 0x7f13a014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f13a54ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00aa850 con 0x7f13a006d0a0 2023-11-18T20:41:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f13a54ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00aaaf0 con 0x7f13a00a5260 2023-11-18T20:41:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f13a54ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a01ee1d0 con 0x7f13a014fd30 2023-11-18T20:41:55.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f139effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f139effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43406/0 (socket says 172.21.15.132:43406) 2023-11-18T20:41:55.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f139effd640 1 -- 172.21.15.132:0/2287716043 learned_addr learned my addr 172.21.15.132:0/2287716043 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f139effd640 1 -- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 msgr2=0x7f13a014c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.397+0000 7f139effd640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 0x7f13a014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f139effd640 1 -- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a00a5260 msgr2=0x7f13a014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f139effd640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a00a5260 0x7f13a014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f139effd640 1 -- 172.21.15.132:0/2287716043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13940094d0 con 0x7f13a006d0a0 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f139effd640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00bf360 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f139000d5f0 tx=0x7f139000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f13877fe640 1 -- 172.21.15.132:0/2287716043 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13900125f0 con 0x7f13a006d0a0 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f13877fe640 1 -- 172.21.15.132:0/2287716043 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1390012750 con 0x7f13a006d0a0 2023-11-18T20:41:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a01ee4b0 con 0x7f13a006d0a0 2023-11-18T20:41:55.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f13877fe640 1 -- 172.21.15.132:0/2287716043 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390012ae0 con 0x7f13a006d0a0 2023-11-18T20:41:55.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.398+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a00a8540 con 0x7f13a006d0a0 2023-11-18T20:41:55.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.399+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a00a86d0 con 0x7f13a006d0a0 2023-11-18T20:41:55.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.400+0000 7f13877fe640 1 -- 172.21.15.132:0/2287716043 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1390012c40 con 0x7f13a006d0a0 2023-11-18T20:41:55.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.401+0000 7f13877fe640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f138c06ae40 0x7f138c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.401+0000 7f13877fe640 1 -- 172.21.15.132:0/2287716043 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f1390089f50 con 0x7f13a006d0a0 2023-11-18T20:41:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.402+0000 7f139e7fc640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f138c06ae40 0x7f138c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.403+0000 7f139e7fc640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f138c06ae40 0x7f138c06d300 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1394036000 tx=0x7f1394030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:55.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.406+0000 7f13877fe640 1 -- 172.21.15.132:0/2287716043 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1390054ba0 con 0x7f13a006d0a0 2023-11-18T20:41:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.595+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13a0068350 con 0x7f13a006d0a0 2023-11-18T20:41:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.596+0000 7f13877fe640 1 -- 172.21.15.132:0/2287716043 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v82) v1 ==== 105+0+11 (secure 0 0 0) 0x7f13900581c0 con 0x7f13a006d0a0 2023-11-18T20:41:55.598 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:41:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f138c06ae40 msgr2=0x7f138c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f138c06ae40 0x7f138c06d300 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1394036000 tx=0x7f1394030000 comp rx=0 tx=0).stop 2023-11-18T20:41:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 msgr2=0x7f13a00bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00bf360 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f139000d5f0 tx=0x7f139000dab0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 shutdown_connections 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f138c06ae40 0x7f138c06d300 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a014fd30 0x7f13a014c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a00a5260 0x7f13a014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 --2- 172.21.15.132:0/2287716043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13a006d0a0 0x7f13a00bf360 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 >> 172.21.15.132:0/2287716043 conn(0x7f13a006a500 msgr2=0x7f13a006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 shutdown_connections 2023-11-18T20:41:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.599+0000 7f13a54ec640 1 -- 172.21.15.132:0/2287716043 wait complete. 2023-11-18T20:41:55.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:41:55.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.826+0000 7f668ae07640 1 Processor -- start 2023-11-18T20:41:55.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.826+0000 7f668ae07640 1 -- start start 2023-11-18T20:41:55.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f668ae07640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f668414fd30 0x7f6684152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f668ae07640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840c64a0 con 0x7f66840c3ea0 2023-11-18T20:41:55.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f668ae07640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840c5c00 con 0x7f668406d0a0 2023-11-18T20:41:55.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f668ae07640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c5ee0 con 0x7f668414fd30 2023-11-18T20:41:55.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f66893a4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f66840c3ea0 0x7f66840c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43746/0 (socket says 172.21.15.132:43746) 2023-11-18T20:41:55.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f66893a4640 1 -- 172.21.15.132:0/1835206630 learned_addr learned my addr 172.21.15.132:0/1835206630 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:55.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f6688ba3640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f668414fd30 0x7f6684152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549893852 0 0) 0x7f66840c64a0 con 0x7f66840c3ea0 2023-11-18T20:41:55.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.828+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f666c003520 con 0x7f66840c3ea0 2023-11-18T20:41:55.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446827373 0 0) 0x7f666c003520 con 0x7f66840c3ea0 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f668414fd30 msgr2=0x7f6684152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f668414fd30 0x7f6684152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 >> v1:172.21.15.161:6789/0 conn(0x7f668406d0a0 legacy=0x7f66840a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840c61c0 con 0x7f66840c3ea0 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f667c0019f0 con 0x7f66840c3ea0 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 >> v1:172.21.15.132:6789/0 conn(0x7f66840c3ea0 legacy=0x7f66840c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f666c0039a0 0x7f666c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0047c0 0x7f666c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f668414fd30 0x7f666c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c5ee0 con 0x7f666c0047c0 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c00ba30 con 0x7f666c0039a0 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c00bbf0 con 0x7f668414fd30 2023-11-18T20:41:55.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.829+0000 7f667bfff640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0047c0 0x7f666c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.830+0000 7f6688ba3640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f666c0039a0 0x7f666c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.830+0000 7f66893a4640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f668414fd30 0x7f666c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.830+0000 7f667bfff640 1 -- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f668414fd30 msgr2=0x7f666c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:55.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.830+0000 7f667bfff640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f668414fd30 0x7f666c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.830+0000 7f667bfff640 1 -- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f666c0039a0 msgr2=0x7f666c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:55.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.830+0000 7f667bfff640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f666c0039a0 0x7f666c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.830+0000 7f667bfff640 1 -- 172.21.15.132:0/1835206630 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c003520 con 0x7f666c0047c0 2023-11-18T20:41:55.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.831+0000 7f667bfff640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0047c0 0x7f666c004c40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f668406d4e0 tx=0x7f666c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61181b0fe6d26cd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.831+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740052d0 con 0x7f666c0047c0 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.831+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667402e050 con 0x7f666c0047c0 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.831+0000 7f667b7fe640 1 -- 172.21.15.132:0/1835206630 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740035f0 con 0x7f666c0047c0 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.832+0000 7f668ae07640 1 -- 172.21.15.132:0/1835206630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0047c0 msgr2=0x7f666c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.832+0000 7f668ae07640 1 --2- 172.21.15.132:0/1835206630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0047c0 0x7f666c004c40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f668406d4e0 tx=0x7f666c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.832+0000 7f66893a4640 1 -- 172.21.15.132:0/1835206630 reap_dead start 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.832+0000 7f668ae07640 1 -- 172.21.15.132:0/1835206630 shutdown_connections 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.832+0000 7f668ae07640 1 -- 172.21.15.132:0/1835206630 >> 172.21.15.132:0/1835206630 conn(0x7f668406a500 msgr2=0x7f668406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.832+0000 7f668ae07640 1 -- 172.21.15.132:0/1835206630 shutdown_connections 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.832+0000 7f668ae07640 1 -- 172.21.15.132:0/1835206630 wait complete. 2023-11-18T20:41:55.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.834+0000 7f668ae07640 1 Processor -- start 2023-11-18T20:41:55.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.834+0000 7f668ae07640 1 -- start start 2023-11-18T20:41:55.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.834+0000 7f668ae07640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f666c0047c0 0x7f66841eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.834+0000 7f668ae07640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66841dc9d0 0x7f66841eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f668ae07640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66841dbad0 0x7f6684155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f668ae07640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841e91f0 con 0x7f66841dbad0 2023-11-18T20:41:55.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f668ae07640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841dce90 con 0x7f66841dc9d0 2023-11-18T20:41:55.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f668ae07640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668414b180 con 0x7f666c0047c0 2023-11-18T20:41:55.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f66893a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66841dbad0 0x7f6684155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f66893a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66841dbad0 0x7f6684155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43432/0 (socket says 172.21.15.132:43432) 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f66893a4640 1 -- 172.21.15.132:0/906193437 learned_addr learned my addr 172.21.15.132:0/906193437 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f66893a4640 1 -- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f666c0047c0 msgr2=0x7f66841eb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f66893a4640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f666c0047c0 0x7f66841eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f66893a4640 1 -- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66841dc9d0 msgr2=0x7f66841eb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f667bfff640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66841dc9d0 0x7f66841eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f66893a4640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66841dc9d0 0x7f66841eb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.835+0000 7f66893a4640 1 -- 172.21.15.132:0/906193437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66841ebd70 con 0x7f66841dbad0 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.836+0000 7f66893a4640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66841dbad0 0x7f6684155f90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f668406b250 tx=0x7f667c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.836+0000 7f66797fa640 1 -- 172.21.15.132:0/906193437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00bb20 con 0x7f66841dbad0 2023-11-18T20:41:55.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.836+0000 7f66797fa640 1 -- 172.21.15.132:0/906193437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00bc80 con 0x7f66841dbad0 2023-11-18T20:41:55.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.836+0000 7f66797fa640 1 -- 172.21.15.132:0/906193437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c007110 con 0x7f66841dbad0 2023-11-18T20:41:55.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.836+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66840a51e0 con 0x7f66841dbad0 2023-11-18T20:41:55.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.836+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66841564d0 con 0x7f66841dbad0 2023-11-18T20:41:55.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.837+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6684068350 con 0x7f66841dbad0 2023-11-18T20:41:55.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.838+0000 7f66797fa640 1 -- 172.21.15.132:0/906193437 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f667c007290 con 0x7f66841dbad0 2023-11-18T20:41:55.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.839+0000 7f66797fa640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f667006ae70 0x7f667006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:55.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.839+0000 7f66797fa640 1 -- 172.21.15.132:0/906193437 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f667c089e70 con 0x7f66841dbad0 2023-11-18T20:41:55.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.840+0000 7f6688ba3640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f667006ae70 0x7f667006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:55.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.841+0000 7f6688ba3640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f667006ae70 0x7f667006d330 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6684072300 tx=0x7f6680008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:55.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:55.843+0000 7f66797fa640 1 -- 172.21.15.132:0/906193437 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f667c054be0 con 0x7f66841dbad0 2023-11-18T20:41:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.034+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f66841e9330 con 0x7f66841dbad0 2023-11-18T20:41:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.035+0000 7f66797fa640 1 -- 172.21.15.132:0/906193437 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v82) v1 ==== 101+0+11 (secure 0 0 0) 0x7f667c058200 con 0x7f66841dbad0 2023-11-18T20:41:56.037 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f667006ae70 msgr2=0x7f667006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f667006ae70 0x7f667006d330 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6684072300 tx=0x7f6680008040 comp rx=0 tx=0).stop 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66841dbad0 msgr2=0x7f6684155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66841dbad0 0x7f6684155f90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f668406b250 tx=0x7f667c00b4a0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 shutdown_connections 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f667006ae70 0x7f667006d330 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66841dbad0 0x7f6684155f90 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66841dc9d0 0x7f66841eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 --2- 172.21.15.132:0/906193437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f666c0047c0 0x7f66841eb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.038+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 >> 172.21.15.132:0/906193437 conn(0x7f668406a500 msgr2=0x7f66840c2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.039+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 shutdown_connections 2023-11-18T20:41:56.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.039+0000 7f668ae07640 1 -- 172.21.15.132:0/906193437 wait complete. 2023-11-18T20:41:56.059 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:41:56.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.271+0000 7f59f1a3f640 1 Processor -- start 2023-11-18T20:41:56.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.272+0000 7f59f1a3f640 1 -- start start 2023-11-18T20:41:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59f1a3f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59ec14fd30 0x7f59ec152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59f1a3f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec06d0a0 0x7f59ec0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59f1a3f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59ec0a5260 0x7f59ec0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59f1a3f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec0c64a0 con 0x7f59ec14fd30 2023-11-18T20:41:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59f1a3f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec0c5c00 con 0x7f59ec0a5260 2023-11-18T20:41:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59f1a3f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c5ee0 con 0x7f59ec06d0a0 2023-11-18T20:41:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59eaffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59ec14fd30 0x7f59ec152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59eaffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59ec14fd30 0x7f59ec152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43448/0 (socket says 172.21.15.132:43448) 2023-11-18T20:41:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59eaffd640 1 -- 172.21.15.132:0/343135704 learned_addr learned my addr 172.21.15.132:0/343135704 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59ea7fc640 1 --2- 172.21.15.132:0/343135704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec06d0a0 0x7f59ec0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59eaffd640 1 -- 172.21.15.132:0/343135704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec06d0a0 msgr2=0x7f59ec0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.273+0000 7f59eaffd640 1 --2- 172.21.15.132:0/343135704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec06d0a0 0x7f59ec0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.274+0000 7f59eaffd640 1 -- 172.21.15.132:0/343135704 >> v2:172.21.15.161:3300/0 conn(0x7f59ec0a5260 msgr2=0x7f59ec0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.274+0000 7f59eb7fe640 1 --2- 172.21.15.132:0/343135704 >> v2:172.21.15.161:3300/0 conn(0x7f59ec0a5260 0x7f59ec0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.274+0000 7f59eaffd640 1 --2- 172.21.15.132:0/343135704 >> v2:172.21.15.161:3300/0 conn(0x7f59ec0a5260 0x7f59ec0c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.274+0000 7f59eaffd640 1 -- 172.21.15.132:0/343135704 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0c61c0 con 0x7f59ec14fd30 2023-11-18T20:41:56.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.275+0000 7f59eaffd640 1 --2- 172.21.15.132:0/343135704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec152f20 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06d990 tx=0x7f59dc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb345594e4efcfe1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.275+0000 7f59e9ffb640 1 -- 172.21.15.132:0/343135704 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc02ca80 con 0x7f59ec14fd30 2023-11-18T20:41:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.275+0000 7f59e9ffb640 1 -- 172.21.15.132:0/343135704 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc02cbe0 con 0x7f59ec14fd30 2023-11-18T20:41:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.275+0000 7f59e9ffb640 1 -- 172.21.15.132:0/343135704 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0343f0 con 0x7f59ec14fd30 2023-11-18T20:41:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.275+0000 7f59f1a3f640 1 -- 172.21.15.132:0/343135704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 msgr2=0x7f59ec152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.275+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/343135704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec152f20 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06d990 tx=0x7f59dc02bee0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.276+0000 7f59f1a3f640 1 -- 172.21.15.132:0/343135704 shutdown_connections 2023-11-18T20:41:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.276+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/343135704 >> v2:172.21.15.161:3300/0 conn(0x7f59ec0a5260 0x7f59ec0c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.276+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/343135704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec06d0a0 0x7f59ec0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.276+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/343135704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec152f20 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.276+0000 7f59f1a3f640 1 -- 172.21.15.132:0/343135704 >> 172.21.15.132:0/343135704 conn(0x7f59ec06a500 msgr2=0x7f59ec06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:56.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.276+0000 7f59f1a3f640 1 -- 172.21.15.132:0/343135704 shutdown_connections 2023-11-18T20:41:56.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.276+0000 7f59f1a3f640 1 -- 172.21.15.132:0/343135704 wait complete. 2023-11-18T20:41:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.277+0000 7f59f1a3f640 1 Processor -- start 2023-11-18T20:41:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.278+0000 7f59f1a3f640 1 -- start start 2023-11-18T20:41:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.278+0000 7f59f1a3f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec06d0a0 0x7f59ec1eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.278+0000 7f59f1a3f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec0a5260 0x7f59ec155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.278+0000 7f59f1a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec14ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.278+0000 7f59f1a3f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c33d0 con 0x7f59ec14fd30 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.278+0000 7f59f1a3f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec1edf90 con 0x7f59ec06d0a0 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.278+0000 7f59f1a3f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec1dbfe0 con 0x7f59ec0a5260 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec14ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec14ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43452/0 (socket says 172.21.15.132:43452) 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 -- 172.21.15.132:0/1286482382 learned_addr learned my addr 172.21.15.132:0/1286482382 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59ea7fc640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec0a5260 0x7f59ec155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 -- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec0a5260 msgr2=0x7f59ec155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eaffd640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec06d0a0 0x7f59ec1eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec0a5260 0x7f59ec155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 -- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec06d0a0 msgr2=0x7f59ec1eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec06d0a0 0x7f59ec1eda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 -- 172.21.15.132:0/1286482382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc009b30 con 0x7f59ec14fd30 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59ea7fc640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec0a5260 0x7f59ec155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.279+0000 7f59eb7fe640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec14ca90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c7f0 tx=0x7f59e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.280+0000 7f59e3fff640 1 -- 172.21.15.132:0/1286482382 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4004220 con 0x7f59ec14fd30 2023-11-18T20:41:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.280+0000 7f59e3fff640 1 -- 172.21.15.132:0/1286482382 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4004380 con 0x7f59ec14fd30 2023-11-18T20:41:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.280+0000 7f59e3fff640 1 -- 172.21.15.132:0/1286482382 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4003850 con 0x7f59ec14fd30 2023-11-18T20:41:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.280+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec0c2e10 con 0x7f59ec14fd30 2023-11-18T20:41:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.280+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec1dbc70 con 0x7f59ec14fd30 2023-11-18T20:41:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.281+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec1dbad0 con 0x7f59ec14fd30 2023-11-18T20:41:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.282+0000 7f59e3fff640 1 -- 172.21.15.132:0/1286482382 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59e4003bc0 con 0x7f59ec14fd30 2023-11-18T20:41:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.283+0000 7f59e3fff640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f59cc06ae40 0x7f59cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.283+0000 7f59e3fff640 1 -- 172.21.15.132:0/1286482382 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f59e4089900 con 0x7f59ec14fd30 2023-11-18T20:41:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.284+0000 7f59eaffd640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f59cc06ae40 0x7f59cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.285+0000 7f59eaffd640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f59cc06ae40 0x7f59cc06d300 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f59dc035000 tx=0x7f59dc030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.288+0000 7f59e3fff640 1 -- 172.21.15.132:0/1286482382 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59ec1dbad0 con 0x7f59ec14fd30 2023-11-18T20:41:56.376 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:41:56.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:41:56.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.491+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f59ec1dbad0 con 0x7f59ec14fd30 2023-11-18T20:41:56.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.492+0000 7f59e3fff640 1 -- 172.21.15.132:0/1286482382 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) v1 ==== 80+0+0 (secure 0 0 0) 0x7f59ec1dbad0 con 0x7f59ec14fd30 2023-11-18T20:41:56.493 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:41:56.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.494+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f59cc06ae40 msgr2=0x7f59cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.494+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f59cc06ae40 0x7f59cc06d300 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f59dc035000 tx=0x7f59dc030000 comp rx=0 tx=0).stop 2023-11-18T20:41:56.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 msgr2=0x7f59ec14ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec14ca90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c7f0 tx=0x7f59e400ccb0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 shutdown_connections 2023-11-18T20:41:56.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f59cc06ae40 0x7f59cc06d300 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59ec14fd30 0x7f59ec14ca90 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59ec0a5260 0x7f59ec155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 --2- 172.21.15.132:0/1286482382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec06d0a0 0x7f59ec1eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 >> 172.21.15.132:0/1286482382 conn(0x7f59ec06a500 msgr2=0x7f59ec070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:56.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 shutdown_connections 2023-11-18T20:41:56.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.495+0000 7f59f1a3f640 1 -- 172.21.15.132:0/1286482382 wait complete. 2023-11-18T20:41:56.515 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-18T20:41:56.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:56.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:56.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:41:56.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:56.655 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T20:41:56.709 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:56.709 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:56.748 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-18T20:41:56.748 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:41:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.936+0000 7f3fedcc9640 1 Processor -- start 2023-11-18T20:41:56.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.936+0000 7f3fedcc9640 1 -- start start 2023-11-18T20:41:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.937+0000 7f3fedcc9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3fe814fd30 0x7f3fe8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.937+0000 7f3fedcc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fe806d0a0 0x7f3fe80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.937+0000 7f3fedcc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80c64a0 con 0x7f3fe80a5260 2023-11-18T20:41:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.937+0000 7f3fedcc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe80c5c00 con 0x7f3fe806d0a0 2023-11-18T20:41:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.937+0000 7f3fedcc9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe80c5ee0 con 0x7f3fe814fd30 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3fe80a5260 0x7f3fe80c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43762/0 (socket says 172.21.15.132:43762) 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fe806d0a0 0x7f3fe80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe7fff640 1 -- 172.21.15.132:0/2211437148 learned_addr learned my addr 172.21.15.132:0/2211437148 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe77fe640 1 --2- 172.21.15.132:0/2211437148 >> v2:172.21.15.161:3300/0 conn(0x7f3fe814fd30 0x7f3fe8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe6ffd640 1 -- 172.21.15.132:0/2211437148 >> v2:172.21.15.161:3300/0 conn(0x7f3fe814fd30 msgr2=0x7f3fe8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe6ffd640 1 --2- 172.21.15.132:0/2211437148 >> v2:172.21.15.161:3300/0 conn(0x7f3fe814fd30 0x7f3fe8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe6ffd640 1 -- 172.21.15.132:0/2211437148 >> v1:172.21.15.132:6789/0 conn(0x7f3fe80a5260 legacy=0x7f3fe80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe6ffd640 1 -- 172.21.15.132:0/2211437148 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80c61c0 con 0x7f3fe806d0a0 2023-11-18T20:41:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.938+0000 7f3fe67fc640 1 -- 172.21.15.132:0/2211437148 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615118324 0 0) 0x7f3fe80c64a0 con 0x7f3fe80a5260 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fe6ffd640 1 --2- 172.21.15.132:0/2211437148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe806d0a0 0x7f3fe80a4d20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3fe806b200 tx=0x7f3fdc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e427bf3e4a5dbe16 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fe67fc640 1 -- 172.21.15.132:0/2211437148 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc031830 con 0x7f3fe806d0a0 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fe67fc640 1 -- 172.21.15.132:0/2211437148 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc031990 con 0x7f3fe806d0a0 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fe67fc640 1 -- 172.21.15.132:0/2211437148 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc031d20 con 0x7f3fe806d0a0 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fedcc9640 1 -- 172.21.15.132:0/2211437148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe806d0a0 msgr2=0x7f3fe80a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/2211437148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe806d0a0 0x7f3fe80a4d20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3fe806b200 tx=0x7f3fdc02b8d0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fedcc9640 1 -- 172.21.15.132:0/2211437148 shutdown_connections 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/2211437148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe806d0a0 0x7f3fe80a4d20 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.940+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/2211437148 >> v2:172.21.15.161:3300/0 conn(0x7f3fe814fd30 0x7f3fe8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.941+0000 7f3fedcc9640 1 -- 172.21.15.132:0/2211437148 >> 172.21.15.132:0/2211437148 conn(0x7f3fe806a500 msgr2=0x7f3fe806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:56.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.941+0000 7f3fedcc9640 1 -- 172.21.15.132:0/2211437148 shutdown_connections 2023-11-18T20:41:56.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.941+0000 7f3fedcc9640 1 -- 172.21.15.132:0/2211437148 wait complete. 2023-11-18T20:41:56.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.942+0000 7f3fedcc9640 1 Processor -- start 2023-11-18T20:41:56.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.942+0000 7f3fedcc9640 1 -- start start 2023-11-18T20:41:56.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.943+0000 7f3fedcc9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe806d0a0 0x7f3fe814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.943+0000 7f3fedcc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe80a5260 0x7f3fe80aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.943+0000 7f3fedcc9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe814fd30 0x7f3fe8151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.943+0000 7f3fedcc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe81e0fd0 con 0x7f3fe80a5260 2023-11-18T20:41:56.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.943+0000 7f3fedcc9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe81513b0 con 0x7f3fe806d0a0 2023-11-18T20:41:56.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.943+0000 7f3fedcc9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe814e720 con 0x7f3fe814fd30 2023-11-18T20:41:56.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe80a5260 0x7f3fe80aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe80a5260 0x7f3fe80aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43460/0 (socket says 172.21.15.132:43460) 2023-11-18T20:41:56.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 -- 172.21.15.132:0/3042870169 learned_addr learned my addr 172.21.15.132:0/3042870169 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:56.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe7fff640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe814fd30 0x7f3fe8151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe77fe640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe806d0a0 0x7f3fe814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 -- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe814fd30 msgr2=0x7f3fe8151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe814fd30 0x7f3fe8151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 -- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe806d0a0 msgr2=0x7f3fe814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe806d0a0 0x7f3fe814daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 -- 172.21.15.132:0/3042870169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc009400 con 0x7f3fe80a5260 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.944+0000 7f3fe6ffd640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe80a5260 0x7f3fe80aa460 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009890 tx=0x7f3fdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.945+0000 7f3fcffff640 1 -- 172.21.15.132:0/3042870169 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc03ba70 con 0x7f3fe80a5260 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.945+0000 7f3fcffff640 1 -- 172.21.15.132:0/3042870169 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc03bbf0 con 0x7f3fe80a5260 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.945+0000 7f3fcffff640 1 -- 172.21.15.132:0/3042870169 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc045400 con 0x7f3fe80a5260 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.945+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe814e440 con 0x7f3fe80a5260 2023-11-18T20:41:56.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.945+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe81eac30 con 0x7f3fe80a5260 2023-11-18T20:41:56.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.946+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe81eadc0 con 0x7f3fe80a5260 2023-11-18T20:41:56.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.947+0000 7f3fcffff640 1 -- 172.21.15.132:0/3042870169 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3fdc04e440 con 0x7f3fe80a5260 2023-11-18T20:41:56.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.948+0000 7f3fcffff640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fd406ae70 0x7f3fd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:56.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.948+0000 7f3fcffff640 1 -- 172.21.15.132:0/3042870169 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f3fdc0abd20 con 0x7f3fe80a5260 2023-11-18T20:41:56.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.949+0000 7f3fe77fe640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fd406ae70 0x7f3fd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:56.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.950+0000 7f3fe77fe640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fd406ae70 0x7f3fd406d330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8006fd0 tx=0x7f3fd8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:56.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:56.952+0000 7f3fcffff640 1 -- 172.21.15.132:0/3042870169 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fdc0769f0 con 0x7f3fe80a5260 2023-11-18T20:41:57.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.179+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3fe8068350 con 0x7f3fe80a5260 2023-11-18T20:41:57.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.180+0000 7f3fcffff640 1 -- 172.21.15.132:0/3042870169 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+149 (secure 0 0 0) 0x7f3fdc035070 con 0x7f3fe80a5260 2023-11-18T20:41:57.181 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T20:41:57.181 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-18T20:41:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fd406ae70 msgr2=0x7f3fd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fd406ae70 0x7f3fd406d330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8006fd0 tx=0x7f3fd8008040 comp rx=0 tx=0).stop 2023-11-18T20:41:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe80a5260 msgr2=0x7f3fe80aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe80a5260 0x7f3fe80aa460 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009890 tx=0x7f3fdc0046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 shutdown_connections 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3fd406ae70 0x7f3fd406d330 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe814fd30 0x7f3fe8151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fe80a5260 0x7f3fe80aa460 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 --2- 172.21.15.132:0/3042870169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe806d0a0 0x7f3fe814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 >> 172.21.15.132:0/3042870169 conn(0x7f3fe806a500 msgr2=0x7f3fe80c2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 shutdown_connections 2023-11-18T20:41:57.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:57.183+0000 7f3fedcc9640 1 -- 172.21.15.132:0/3042870169 wait complete. 2023-11-18T20:41:57.201 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-18T20:41:57.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:41:57.201 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-18T20:41:57.201 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-18T20:41:57.202 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:57.202 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-18T20:41:57.202 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-18T20:41:57.202 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.muCaBJdhFM 2023-11-18T20:41:57.202 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-11-18T20:41:57.263 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.W0kLOQ6ozF 2023-11-18T20:41:57.263 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /tmp/tmp.muCaBJdhFM /tmp/tmp.W0kLOQ6ozF 2023-11-18T20:41:57.354 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.W0kLOQ6ozF 2023-11-18T20:41:57.499 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.W0kLOQ6ozF is 226B 2023-11-18T20:41:57.561 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.W0kLOQ6ozF 2023-11-18T20:41:57.616 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-18T20:41:57.616 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:57.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:57.616 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-18T20:41:57.672 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:41:57.672 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:41:57.673 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:41:57.673 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:57.673 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-18T20:41:57.673 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:57.673 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:57.673 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:57.674 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-18T20:41:57.674 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:57.674 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:57.674 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-18T20:41:57.674 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T20:41:57.674 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:57.675 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:41:57.675 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:57.675 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T20:41:57.675 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42192sec preferred_lft 42192sec 2023-11-18T20:41:57.675 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-18T20:41:57.675 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:57.675 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T20:41:57.676 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:41:57.676 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T20:41:57.676 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:57.676 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::78f3:28ff:fe93:897/64 scope link 2023-11-18T20:41:57.676 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:57.676 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T20:41:57.676 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 46:2e:5a:28:3e:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:41:57.677 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::442e:5aff:fe28:3e67/64 scope link 2023-11-18T20:41:57.677 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:41:57.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:57.678 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:41:57.772 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-18T20:41:57.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:57.776 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-18T20:41:57.832 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-18T20:41:57.832 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:41:57.833 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T20:41:57.833 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T20:41:57.833 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:41:57.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:57.834 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-18T20:41:57.834 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-18T20:41:57.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T20:41:57.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T20:41:57.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T20:41:57.834 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-18T20:41:58.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:58.015 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:41:58.066 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T20:41:58.067 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:58.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:58.068 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-18T20:41:58.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:58.164 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:58.221 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T20:41:58.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:41:58.222 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:58.275 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:58.276 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/tmp/tmp.muCaBJdhFM of=/dev/stdout 2023-11-18T20:41:58.324 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-18T20:41:58.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:58.324 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:41:58.514 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,secret=AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:41:58.515 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:41:58.515 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:58.515 INFO:teuthology.orchestra.run.smithi161.stdout:keyring.get_secret failed 2023-11-18T20:41:58.537 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,secret=AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:41:58.537 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:41:58.537 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:58.537 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:58.537 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:58.538 INFO:teuthology.orchestra.run.smithi161.stdout:keyring.get_secret failed 2023-11-18T20:41:58.565 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,secret=AQCKIVll8SlSMhAA3BAkEeQ/5m39g9vY55Wq5w==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-18T20:41:58.565 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-18T20:41:58.565 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-11-18T20:41:58.565 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-11-18T20:41:58.565 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-18T20:41:58.566 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-11-18T20:41:58.566 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-11-18T20:41:58.566 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=95273225-bfbe-4b9a-893d-dfaf6292d673" will pass to kernel 2023-11-18T20:41:58.569 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T20:41:58.569 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2023-11-18T20:41:58.569 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T20:41:58.569 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T20:41:58.569 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T20:41:58.574 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T20:41:58.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:58.575 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T20:41:58.657 INFO:teuthology.orchestra.run.smithi161.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-11-18T20:41:58.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:41:58.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:58.661 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T20:41:58.718 INFO:teuthology.orchestra.run.smithi161.stdout:client6972 2023-11-18T20:41:58.719 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:41:58.719 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:58.775 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-11-18T20:41:58.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:41:58.776 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-11-18T20:41:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-11-18T20:41:58.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:41:58.840 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:58.840 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:58.894 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:41:58.894 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:41:58.948 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:41:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.162+0000 7f948c9fa640 1 Processor -- start 2023-11-18T20:41:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.162+0000 7f948c9fa640 1 -- start start 2023-11-18T20:41:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.164+0000 7f948c9fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c0440 0x7f94880c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.164+0000 7f948c9fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9488072310 0x7f94880a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.164+0000 7f948c9fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9488071e80 con 0x7f948814c2e0 2023-11-18T20:41:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.164+0000 7f948c9fa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9488071470 con 0x7f9488072310 2023-11-18T20:41:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.164+0000 7f948c9fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948814c6c0 con 0x7f94880c0440 2023-11-18T20:41:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.164+0000 7f948759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9488072310 0x7f94880a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.164+0000 7f948759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9488072310 0x7f94880a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35048/0 (socket says 172.21.15.132:35048) 2023-11-18T20:41:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.164+0000 7f948759e640 1 -- 172.21.15.132:0/1763724774 learned_addr learned my addr 172.21.15.132:0/1763724774 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.165+0000 7f948659c640 1 --2- 172.21.15.132:0/1763724774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c0440 0x7f94880c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.165+0000 7f948759e640 1 -- 172.21.15.132:0/1763724774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c0440 msgr2=0x7f94880c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.165+0000 7f948759e640 1 --2- 172.21.15.132:0/1763724774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c0440 0x7f94880c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.165+0000 7f948759e640 1 -- 172.21.15.132:0/1763724774 >> v1:172.21.15.161:6789/0 conn(0x7f948814c2e0 legacy=0x7f9488152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.165+0000 7f948759e640 1 -- 172.21.15.132:0/1763724774 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948806fdc0 con 0x7f9488072310 2023-11-18T20:41:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.165+0000 7f948659c640 1 --2- 172.21.15.132:0/1763724774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c0440 0x7f94880c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:41:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.166+0000 7f948759e640 1 --2- 172.21.15.132:0/1763724774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9488072310 0x7f94880a4d20 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f9480009870 tx=0x7f948002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18a6ac0e6a70637 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.166+0000 7f9485d9b640 1 -- 172.21.15.132:0/1763724774 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480031740 con 0x7f9488072310 2023-11-18T20:41:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.166+0000 7f9485d9b640 1 -- 172.21.15.132:0/1763724774 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800318a0 con 0x7f9488072310 2023-11-18T20:41:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.166+0000 7f9485d9b640 1 -- 172.21.15.132:0/1763724774 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480031c30 con 0x7f9488072310 2023-11-18T20:41:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.167+0000 7f948c9fa640 1 -- 172.21.15.132:0/1763724774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9488072310 msgr2=0x7f94880a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.167+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1763724774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9488072310 0x7f94880a4d20 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f9480009870 tx=0x7f948002b7e0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.167+0000 7f948c9fa640 1 -- 172.21.15.132:0/1763724774 shutdown_connections 2023-11-18T20:41:59.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.167+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1763724774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9488072310 0x7f94880a4d20 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.167+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1763724774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c0440 0x7f94880c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.167+0000 7f948c9fa640 1 -- 172.21.15.132:0/1763724774 >> 172.21.15.132:0/1763724774 conn(0x7f94880a77f0 msgr2=0x7f94880a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:59.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.167+0000 7f948c9fa640 1 -- 172.21.15.132:0/1763724774 shutdown_connections 2023-11-18T20:41:59.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.167+0000 7f948c9fa640 1 -- 172.21.15.132:0/1763724774 wait complete. 2023-11-18T20:41:59.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.169+0000 7f948c9fa640 1 Processor -- start 2023-11-18T20:41:59.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.169+0000 7f948c9fa640 1 -- start start 2023-11-18T20:41:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948c9fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9488072310 0x7f94880a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948c9fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94880c0440 0x7f94881ea730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948c9fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f948814c2e0 0x7f94880c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948c9fa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94881e9d60 con 0x7f94880c0440 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948c9fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948806d8f0 con 0x7f9488072310 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948c9fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94881e9f50 con 0x7f948814c2e0 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94880c0440 0x7f94881ea730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94880c0440 0x7f94881ea730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35052/0 (socket says 172.21.15.132:35052) 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948659c640 1 -- 172.21.15.132:0/1691255764 learned_addr learned my addr 172.21.15.132:0/1691255764 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948659c640 1 -- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f948814c2e0 msgr2=0x7f94880c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948659c640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f948814c2e0 0x7f94880c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948659c640 1 -- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9488072310 msgr2=0x7f94880a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948659c640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9488072310 0x7f94880a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.170+0000 7f948659c640 1 -- 172.21.15.132:0/1691255764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800094d0 con 0x7f94880c0440 2023-11-18T20:41:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.171+0000 7f948659c640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94880c0440 0x7f94881ea730 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f947000c7f0 tx=0x7f947000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.171+0000 7f947f7fe640 1 -- 172.21.15.132:0/1691255764 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470007a30 con 0x7f94880c0440 2023-11-18T20:41:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.171+0000 7f947f7fe640 1 -- 172.21.15.132:0/1691255764 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470007b90 con 0x7f94880c0440 2023-11-18T20:41:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.171+0000 7f947f7fe640 1 -- 172.21.15.132:0/1691255764 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000ce40 con 0x7f94880c0440 2023-11-18T20:41:59.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.171+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94881edfc0 con 0x7f94880c0440 2023-11-18T20:41:59.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.171+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94880a9800 con 0x7f94880c0440 2023-11-18T20:41:59.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.172+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94881ea450 con 0x7f94880c0440 2023-11-18T20:41:59.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.173+0000 7f947f7fe640 1 -- 172.21.15.132:0/1691255764 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94700113f0 con 0x7f94880c0440 2023-11-18T20:41:59.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.174+0000 7f947f7fe640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f946806ae40 0x7f946806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.174+0000 7f947f7fe640 1 -- 172.21.15.132:0/1691255764 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f9470089b90 con 0x7f94880c0440 2023-11-18T20:41:59.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.175+0000 7f9486d9d640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f946806ae40 0x7f946806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.176+0000 7f9486d9d640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f946806ae40 0x7f946806d300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f947800ab90 tx=0x7f9478009230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:59.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.178+0000 7f947f7fe640 1 -- 172.21.15.132:0/1691255764 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94881ea450 con 0x7f94880c0440 2023-11-18T20:41:59.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.368+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94881ea450 con 0x7f94880c0440 2023-11-18T20:41:59.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.370+0000 7f947f7fe640 1 -- 172.21.15.132:0/1691255764 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+20453 (secure 0 0 0) 0x7f94881ea450 con 0x7f94880c0440 2023-11-18T20:41:59.372 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:41:59.373 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":82,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:48.564301+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:41:59.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f946806ae40 msgr2=0x7f946806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f946806ae40 0x7f946806d300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f947800ab90 tx=0x7f9478009230 comp rx=0 tx=0).stop 2023-11-18T20:41:59.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94880c0440 msgr2=0x7f94881ea730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94880c0440 0x7f94881ea730 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f947000c7f0 tx=0x7f947000cbf0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 shutdown_connections 2023-11-18T20:41:59.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f946806ae40 0x7f946806d300 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f948814c2e0 0x7f94880c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94880c0440 0x7f94881ea730 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 --2- 172.21.15.132:0/1691255764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9488072310 0x7f94880a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 >> 172.21.15.132:0/1691255764 conn(0x7f94880a77f0 msgr2=0x7f94880a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:59.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 shutdown_connections 2023-11-18T20:41:59.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.373+0000 7f948c9fa640 1 -- 172.21.15.132:0/1691255764 wait complete. 2023-11-18T20:41:59.392 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:41:17.894376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:41:18.520471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:41:33.270522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:41:33.924631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:41:59.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:41:59.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.607+0000 7fb3dce90640 1 Processor -- start 2023-11-18T20:41:59.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.608+0000 7fb3dce90640 1 -- start start 2023-11-18T20:41:59.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.609+0000 7fb3dce90640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3d806d0a0 0x7fb3d8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.609+0000 7fb3dce90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d80c3ea0 0x7fb3d80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.609+0000 7fb3dce90640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d80c64a0 con 0x7fb3d814fd30 2023-11-18T20:41:59.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.609+0000 7fb3dce90640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80c5c00 con 0x7fb3d806d0a0 2023-11-18T20:41:59.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.609+0000 7fb3dce90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80c5ee0 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.609+0000 7fb3d5d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3d806d0a0 0x7fb3d8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.609+0000 7fb3d659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb3d814fd30 0x7fb3d80a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48042/0 (socket says 172.21.15.132:48042) 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.609+0000 7fb3d659c640 1 -- 172.21.15.132:0/1988710448 learned_addr learned my addr 172.21.15.132:0/1988710448 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.610+0000 7fb3d6d9d640 1 --2- 172.21.15.132:0/1988710448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d80c3ea0 0x7fb3d80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.610+0000 7fb3d559a640 1 -- 172.21.15.132:0/1988710448 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431924438 0 0) 0x7fb3d80c64a0 con 0x7fb3d814fd30 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.610+0000 7fb3d559a640 1 -- 172.21.15.132:0/1988710448 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3c0003520 con 0x7fb3d814fd30 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.610+0000 7fb3d5d9b640 1 -- 172.21.15.132:0/1988710448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d80c3ea0 msgr2=0x7fb3d80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.610+0000 7fb3d5d9b640 1 --2- 172.21.15.132:0/1988710448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d80c3ea0 0x7fb3d80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.610+0000 7fb3d5d9b640 1 -- 172.21.15.132:0/1988710448 >> v1:172.21.15.132:6789/0 conn(0x7fb3d814fd30 legacy=0x7fb3d80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.610+0000 7fb3d5d9b640 1 -- 172.21.15.132:0/1988710448 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80c61c0 con 0x7fb3d806d0a0 2023-11-18T20:41:59.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.611+0000 7fb3d5d9b640 1 --2- 172.21.15.132:0/1988710448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d806d0a0 0x7fb3d8152f20 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0097a0 tx=0x7fb3cc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4f70b253a5b2b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:59.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.611+0000 7fb3d559a640 1 -- 172.21.15.132:0/1988710448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc02d040 con 0x7fb3d806d0a0 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.611+0000 7fb3d559a640 1 -- 172.21.15.132:0/1988710448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc031810 con 0x7fb3d806d0a0 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.611+0000 7fb3d559a640 1 -- 172.21.15.132:0/1988710448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc031ba0 con 0x7fb3d806d0a0 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.612+0000 7fb3dce90640 1 -- 172.21.15.132:0/1988710448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d806d0a0 msgr2=0x7fb3d8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.612+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1988710448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d806d0a0 0x7fb3d8152f20 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0097a0 tx=0x7fb3cc02b8b0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.612+0000 7fb3dce90640 1 -- 172.21.15.132:0/1988710448 shutdown_connections 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.612+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1988710448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d80c3ea0 0x7fb3d80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.612+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1988710448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d806d0a0 0x7fb3d8152f20 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.612+0000 7fb3dce90640 1 -- 172.21.15.132:0/1988710448 >> 172.21.15.132:0/1988710448 conn(0x7fb3d806a500 msgr2=0x7fb3d806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.612+0000 7fb3dce90640 1 -- 172.21.15.132:0/1988710448 shutdown_connections 2023-11-18T20:41:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.612+0000 7fb3dce90640 1 -- 172.21.15.132:0/1988710448 wait complete. 2023-11-18T20:41:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.614+0000 7fb3dce90640 1 Processor -- start 2023-11-18T20:41:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.614+0000 7fb3dce90640 1 -- start start 2023-11-18T20:41:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3dce90640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d806d0a0 0x7fb3d80a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3dce90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d80c3ea0 0x7fb3d80bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3dce90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d814fd30 0x7fb3d80aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3dce90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8154770 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3dce90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8154240 con 0x7fb3d814fd30 2023-11-18T20:41:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3dce90640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80aa110 con 0x7fb3d806d0a0 2023-11-18T20:41:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3d5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d80c3ea0 0x7fb3d80bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3d5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d80c3ea0 0x7fb3d80bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35070/0 (socket says 172.21.15.132:35070) 2023-11-18T20:41:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3d5d9b640 1 -- 172.21.15.132:0/1174357675 learned_addr learned my addr 172.21.15.132:0/1174357675 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:41:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3d5d9b640 1 -- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d806d0a0 msgr2=0x7fb3d80a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.615+0000 7fb3d5d9b640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d806d0a0 0x7fb3d80a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3d5d9b640 1 -- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d814fd30 msgr2=0x7fb3d80aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3d6d9d640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d814fd30 0x7fb3d80aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3d5d9b640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d814fd30 0x7fb3d80aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3d5d9b640 1 -- 172.21.15.132:0/1174357675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc009400 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3d5d9b640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d80c3ea0 0x7fb3d80bf360 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc000c00 tx=0x7fb3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:59.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3c6ffd640 1 -- 172.21.15.132:0/1174357675 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc006e10 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3c6ffd640 1 -- 172.21.15.132:0/1174357675 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc03ad60 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3c6ffd640 1 -- 172.21.15.132:0/1174357675 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc044630 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d80a9070 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.616+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d8153860 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.618+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d8068350 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.619+0000 7fb3c6ffd640 1 -- 172.21.15.132:0/1174357675 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3cc04d450 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.619+0000 7fb3c6ffd640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb3b806ae40 0x7fb3b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:41:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.619+0000 7fb3c6ffd640 1 -- 172.21.15.132:0/1174357675 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fb3cc0abbc0 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.620+0000 7fb3d659c640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb3b806ae40 0x7fb3b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:41:59.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.621+0000 7fb3d659c640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb3b806ae40 0x7fb3b806d300 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80020a0 tx=0x7fb3c8001690 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:41:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.624+0000 7fb3c6ffd640 1 -- 172.21.15.132:0/1174357675 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3cc0768a0 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.814+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3d806d540 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.815+0000 7fb3c6ffd640 1 -- 172.21.15.132:0/1174357675 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3cc079ec0 con 0x7fb3d80c3ea0 2023-11-18T20:41:59.816 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:41:59.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.817+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb3b806ae40 msgr2=0x7fb3b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.817+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb3b806ae40 0x7fb3b806d300 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80020a0 tx=0x7fb3c8001690 comp rx=0 tx=0).stop 2023-11-18T20:41:59.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.817+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d80c3ea0 msgr2=0x7fb3d80bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:41:59.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.817+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d80c3ea0 0x7fb3d80bf360 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc000c00 tx=0x7fb3cc0046c0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.818+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 shutdown_connections 2023-11-18T20:41:59.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.818+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb3b806ae40 0x7fb3b806d300 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.818+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d814fd30 0x7fb3d80aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.818+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3d80c3ea0 0x7fb3d80bf360 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.818+0000 7fb3dce90640 1 --2- 172.21.15.132:0/1174357675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3d806d0a0 0x7fb3d80a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:41:59.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.818+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 >> 172.21.15.132:0/1174357675 conn(0x7fb3d806a500 msgr2=0x7fb3d80c1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:41:59.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.818+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 shutdown_connections 2023-11-18T20:41:59.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:41:59.818+0000 7fb3dce90640 1 -- 172.21.15.132:0/1174357675 wait complete. 2023-11-18T20:41:59.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:42:00.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.050+0000 7f0958ae0640 1 Processor -- start 2023-11-18T20:42:00.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.051+0000 7f0958ae0640 1 -- start start 2023-11-18T20:42:00.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.052+0000 7f0958ae0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f095406d0a0 0x7f0954152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.052+0000 7f0958ae0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09540c3ea0 0x7f09540c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.052+0000 7f0958ae0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09540c64a0 con 0x7f095414fd30 2023-11-18T20:42:00.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.052+0000 7f0958ae0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09540c5c00 con 0x7f095406d0a0 2023-11-18T20:42:00.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.052+0000 7f0958ae0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09540c5ee0 con 0x7f09540c3ea0 2023-11-18T20:42:00.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.052+0000 7f094bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f095406d0a0 0x7f0954152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.052+0000 7f094bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f095406d0a0 0x7f0954152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35078/0 (socket says 172.21.15.132:35078) 2023-11-18T20:42:00.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.052+0000 7f094bfff640 1 -- 172.21.15.132:0/3914084383 learned_addr learned my addr 172.21.15.132:0/3914084383 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:00.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.053+0000 7f0952d9d640 1 --2- 172.21.15.132:0/3914084383 >> v2:172.21.15.161:3300/0 conn(0x7f09540c3ea0 0x7f09540c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.053+0000 7f094bfff640 1 -- 172.21.15.132:0/3914084383 >> v2:172.21.15.161:3300/0 conn(0x7f09540c3ea0 msgr2=0x7f09540c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:00.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.053+0000 7f094bfff640 1 --2- 172.21.15.132:0/3914084383 >> v2:172.21.15.161:3300/0 conn(0x7f09540c3ea0 0x7f09540c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.053+0000 7f094bfff640 1 -- 172.21.15.132:0/3914084383 >> v1:172.21.15.161:6789/0 conn(0x7f095414fd30 legacy=0x7f09540a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:00.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.053+0000 7f094bfff640 1 -- 172.21.15.132:0/3914084383 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540c61c0 con 0x7f095406d0a0 2023-11-18T20:42:00.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.054+0000 7f094bfff640 1 --2- 172.21.15.132:0/3914084383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f0954152f20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f095406e430 tx=0x7f093c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ed2b8895d72d16 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.054+0000 7f0951d9b640 1 -- 172.21.15.132:0/3914084383 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c031870 con 0x7f095406d0a0 2023-11-18T20:42:00.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.054+0000 7f0951d9b640 1 -- 172.21.15.132:0/3914084383 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c0319d0 con 0x7f095406d0a0 2023-11-18T20:42:00.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.054+0000 7f0951d9b640 1 -- 172.21.15.132:0/3914084383 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c031d60 con 0x7f095406d0a0 2023-11-18T20:42:00.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.055+0000 7f0958ae0640 1 -- 172.21.15.132:0/3914084383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 msgr2=0x7f0954152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.055+0000 7f0958ae0640 1 --2- 172.21.15.132:0/3914084383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f0954152f20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f095406e430 tx=0x7f093c02b910 comp rx=0 tx=0).stop 2023-11-18T20:42:00.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.055+0000 7f0958ae0640 1 -- 172.21.15.132:0/3914084383 shutdown_connections 2023-11-18T20:42:00.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.055+0000 7f0958ae0640 1 --2- 172.21.15.132:0/3914084383 >> v2:172.21.15.161:3300/0 conn(0x7f09540c3ea0 0x7f09540c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.055+0000 7f0958ae0640 1 --2- 172.21.15.132:0/3914084383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f0954152f20 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.055+0000 7f0958ae0640 1 -- 172.21.15.132:0/3914084383 >> 172.21.15.132:0/3914084383 conn(0x7f095406a500 msgr2=0x7f095406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:00.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.055+0000 7f0958ae0640 1 -- 172.21.15.132:0/3914084383 shutdown_connections 2023-11-18T20:42:00.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.055+0000 7f0958ae0640 1 -- 172.21.15.132:0/3914084383 wait complete. 2023-11-18T20:42:00.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.057+0000 7f0958ae0640 1 Processor -- start 2023-11-18T20:42:00.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.057+0000 7f0958ae0640 1 -- start start 2023-11-18T20:42:00.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f0958ae0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f09541de460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f0958ae0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09540c3ea0 0x7f09541e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f0958ae0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f095414fd30 0x7f09541ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f0958ae0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09541dd000 con 0x7f095406d0a0 2023-11-18T20:42:00.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f0958ae0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540aad40 con 0x7f095414fd30 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f0958ae0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0954152360 con 0x7f09540c3ea0 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f095259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f09541de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f095259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f09541de460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35080/0 (socket says 172.21.15.132:35080) 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.058+0000 7f095259c640 1 -- 172.21.15.132:0/55889520 learned_addr learned my addr 172.21.15.132:0/55889520 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f095259c640 1 -- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09540c3ea0 msgr2=0x7f09541e14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f095259c640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09540c3ea0 0x7f09541e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f095259c640 1 -- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f095414fd30 msgr2=0x7f09541ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f0952d9d640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f095414fd30 0x7f09541ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f095259c640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f095414fd30 0x7f09541ed680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f095259c640 1 -- 172.21.15.132:0/55889520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c0094d0 con 0x7f095406d0a0 2023-11-18T20:42:00.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f095259c640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f09541de460 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f094400c430 tx=0x7f094400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f094affd640 1 -- 172.21.15.132:0/55889520 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944011790 con 0x7f095406d0a0 2023-11-18T20:42:00.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f094affd640 1 -- 172.21.15.132:0/55889520 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09440118f0 con 0x7f095406d0a0 2023-11-18T20:42:00.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f094affd640 1 -- 172.21.15.132:0/55889520 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944011ce0 con 0x7f095406d0a0 2023-11-18T20:42:00.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.059+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0954151da0 con 0x7f095406d0a0 2023-11-18T20:42:00.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.060+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09541ddc60 con 0x7f095406d0a0 2023-11-18T20:42:00.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.061+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954068350 con 0x7f095406d0a0 2023-11-18T20:42:00.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.062+0000 7f094affd640 1 -- 172.21.15.132:0/55889520 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f094401c460 con 0x7f095406d0a0 2023-11-18T20:42:00.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.063+0000 7f094affd640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f093406ae70 0x7f093406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.063+0000 7f094affd640 1 -- 172.21.15.132:0/55889520 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f0944089980 con 0x7f095406d0a0 2023-11-18T20:42:00.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.064+0000 7f094bfff640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f093406ae70 0x7f093406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.065+0000 7f094bfff640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f093406ae70 0x7f093406d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f093c036000 tx=0x7f093c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.068+0000 7f094affd640 1 -- 172.21.15.132:0/55889520 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0944054650 con 0x7f095406d0a0 2023-11-18T20:42:00.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.263+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09540c66d0 con 0x7f095406d0a0 2023-11-18T20:42:00.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.264+0000 7f094affd640 1 -- 172.21.15.132:0/55889520 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0944087e60 con 0x7f095406d0a0 2023-11-18T20:42:00.265 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:42:00.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f093406ae70 msgr2=0x7f093406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f093406ae70 0x7f093406d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f093c036000 tx=0x7f093c030000 comp rx=0 tx=0).stop 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 msgr2=0x7f09541de460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f09541de460 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f094400c430 tx=0x7f094400c8f0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 shutdown_connections 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f093406ae70 0x7f093406d330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f095414fd30 0x7f09541ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09540c3ea0 0x7f09541e14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 --2- 172.21.15.132:0/55889520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f095406d0a0 0x7f09541de460 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 >> 172.21.15.132:0/55889520 conn(0x7f095406a500 msgr2=0x7f095406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 shutdown_connections 2023-11-18T20:42:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.267+0000 7f0958ae0640 1 -- 172.21.15.132:0/55889520 wait complete. 2023-11-18T20:42:00.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:42:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.505+0000 7f54803ee640 1 Processor -- start 2023-11-18T20:42:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.506+0000 7f54803ee640 1 -- start start 2023-11-18T20:42:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f54803ee640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 0x7f54780c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f54803ee640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54780c06c0 con 0x7f5478155490 2023-11-18T20:42:00.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f54803ee640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54780c1020 con 0x7f54780a9b40 2023-11-18T20:42:00.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f54803ee640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54780a5820 con 0x7f54780c1500 2023-11-18T20:42:00.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f547e18a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5478155490 0x7f54780a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48050/0 (socket says 172.21.15.132:48050) 2023-11-18T20:42:00.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f547e18a640 1 -- 172.21.15.132:0/3174824088 learned_addr learned my addr 172.21.15.132:0/3174824088 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498688221 0 0) 0x7f54780c06c0 con 0x7f5478155490 2023-11-18T20:42:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5460005730 con 0x7f5478155490 2023-11-18T20:42:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.507+0000 7f547e98b640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 0x7f54780c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3069928894 0 0) 0x7f5460005730 con 0x7f5478155490 2023-11-18T20:42:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 msgr2=0x7f54780c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 0x7f54780c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 >> v1:172.21.15.161:6789/0 conn(0x7f54780a9b40 legacy=0x7f54780c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54780c0910 con 0x7f5478155490 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f54680019f0 con 0x7f5478155490 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 >> v1:172.21.15.132:6789/0 conn(0x7f5478155490 legacy=0x7f54780a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5460005bb0 0x7f5460005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 0x7f54600069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5460006f10 0x7f5460007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546000dd20 con 0x7f5460005bb0 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546000de60 con 0x7f5460006f10 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546000e020 con 0x7f54780c1500 2023-11-18T20:42:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.508+0000 7f547e18a640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5460005bb0 0x7f5460005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.509+0000 7f547e98b640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5460006f10 0x7f5460007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.509+0000 7f547d989640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 0x7f54600069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.509+0000 7f547e18a640 1 -- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 msgr2=0x7f54600069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.509+0000 7f547e18a640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 0x7f54600069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.509+0000 7f547e18a640 1 -- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5460006f10 msgr2=0x7f5460007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.509+0000 7f547e18a640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5460006f10 0x7f5460007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.509+0000 7f547e18a640 1 -- 172.21.15.132:0/3174824088 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460005730 con 0x7f5460005bb0 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.509+0000 7f547d989640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780c1500 0x7f54600069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.510+0000 7f547e18a640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5460005bb0 0x7f5460005fd0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f546800a820 tx=0x7f5460007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b61c0c6effebf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.510+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54680072d0 con 0x7f5460005bb0 2023-11-18T20:42:00.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.510+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546802f070 con 0x7f5460005bb0 2023-11-18T20:42:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.510+0000 7f547d188640 1 -- 172.21.15.132:0/3174824088 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54680076b0 con 0x7f5460005bb0 2023-11-18T20:42:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.511+0000 7f54803ee640 1 -- 172.21.15.132:0/3174824088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5460005bb0 msgr2=0x7f5460005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.511+0000 7f54803ee640 1 --2- 172.21.15.132:0/3174824088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5460005bb0 0x7f5460005fd0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f546800a820 tx=0x7f5460007a00 comp rx=0 tx=0).stop 2023-11-18T20:42:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.511+0000 7f547e98b640 1 -- 172.21.15.132:0/3174824088 reap_dead start 2023-11-18T20:42:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.511+0000 7f54803ee640 1 -- 172.21.15.132:0/3174824088 shutdown_connections 2023-11-18T20:42:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.511+0000 7f54803ee640 1 -- 172.21.15.132:0/3174824088 >> 172.21.15.132:0/3174824088 conn(0x7f547806a500 msgr2=0x7f547806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.511+0000 7f54803ee640 1 -- 172.21.15.132:0/3174824088 shutdown_connections 2023-11-18T20:42:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.511+0000 7f54803ee640 1 -- 172.21.15.132:0/3174824088 wait complete. 2023-11-18T20:42:00.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.512+0000 7f54803ee640 1 Processor -- start 2023-11-18T20:42:00.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.513+0000 7f54803ee640 1 -- start start 2023-11-18T20:42:00.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f54803ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5460005bb0 0x7f54781ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f54803ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54781edf50 0x7f547809a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f54803ee640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780bf0f0 0x7f547809b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f54803ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54781ea560 con 0x7f54781edf50 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f54803ee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54781e9f50 con 0x7f5460005bb0 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f54803ee640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54780bf940 con 0x7f54780bf0f0 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f547d989640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54781edf50 0x7f547809a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f547d989640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54781edf50 0x7f547809a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35088/0 (socket says 172.21.15.132:35088) 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f547d989640 1 -- 172.21.15.132:0/1795526903 learned_addr learned my addr 172.21.15.132:0/1795526903 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f547d989640 1 -- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780bf0f0 msgr2=0x7f547809b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f547d989640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780bf0f0 0x7f547809b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f547d989640 1 -- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5460005bb0 msgr2=0x7f54781ea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f547d989640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5460005bb0 0x7f54781ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.514+0000 7f547d989640 1 -- 172.21.15.132:0/1795526903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54781ea1f0 con 0x7f54781edf50 2023-11-18T20:42:00.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.515+0000 7f547d989640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54781edf50 0x7f547809a0c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f546c000f60 tx=0x7f546c00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.515+0000 7f5476ffd640 1 -- 172.21.15.132:0/1795526903 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c005480 con 0x7f54781edf50 2023-11-18T20:42:00.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.515+0000 7f5476ffd640 1 -- 172.21.15.132:0/1795526903 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c003610 con 0x7f54781edf50 2023-11-18T20:42:00.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.515+0000 7f5476ffd640 1 -- 172.21.15.132:0/1795526903 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0039c0 con 0x7f54781edf50 2023-11-18T20:42:00.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.515+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54780bfc20 con 0x7f54781edf50 2023-11-18T20:42:00.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.515+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54780bf570 con 0x7f54781edf50 2023-11-18T20:42:00.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.516+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54781ea380 con 0x7f54781edf50 2023-11-18T20:42:00.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.517+0000 7f5476ffd640 1 -- 172.21.15.132:0/1795526903 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f546c003b20 con 0x7f54781edf50 2023-11-18T20:42:00.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.518+0000 7f5476ffd640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f546406ae70 0x7f546406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.518+0000 7f5476ffd640 1 -- 172.21.15.132:0/1795526903 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f546c0898a0 con 0x7f54781edf50 2023-11-18T20:42:00.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.519+0000 7f547e18a640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f546406ae70 0x7f546406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.520+0000 7f547e18a640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f546406ae70 0x7f546406d330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f546800a820 tx=0x7f546802f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.523+0000 7f5476ffd640 1 -- 172.21.15.132:0/1795526903 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f546c054620 con 0x7f54781edf50 2023-11-18T20:42:00.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.711+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54780a77a0 con 0x7f54781edf50 2023-11-18T20:42:00.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.713+0000 7f5476ffd640 1 -- 172.21.15.132:0/1795526903 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f546c001230 con 0x7f54781edf50 2023-11-18T20:42:00.714 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:42:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.715+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f546406ae70 msgr2=0x7f546406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.715+0000 7f54803ee640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f546406ae70 0x7f546406d330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f546800a820 tx=0x7f546802f000 comp rx=0 tx=0).stop 2023-11-18T20:42:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.715+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54781edf50 msgr2=0x7f547809a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.715+0000 7f54803ee640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54781edf50 0x7f547809a0c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f546c000f60 tx=0x7f546c00d9f0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.716+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 shutdown_connections 2023-11-18T20:42:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.716+0000 7f54803ee640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f546406ae70 0x7f546406d330 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.716+0000 7f54803ee640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54780bf0f0 0x7f547809b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.716+0000 7f54803ee640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54781edf50 0x7f547809a0c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.716+0000 7f54803ee640 1 --2- 172.21.15.132:0/1795526903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5460005bb0 0x7f54781ea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.716+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 >> 172.21.15.132:0/1795526903 conn(0x7f547806a500 msgr2=0x7f54780c4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.716+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 shutdown_connections 2023-11-18T20:42:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.716+0000 7f54803ee640 1 -- 172.21.15.132:0/1795526903 wait complete. 2023-11-18T20:42:00.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:42:00.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.941+0000 7f33bd581640 1 Processor -- start 2023-11-18T20:42:00.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.941+0000 7f33bd581640 1 -- start start 2023-11-18T20:42:00.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.942+0000 7f33bd581640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33b814c2e0 0x7f33b80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.942+0000 7f33bd581640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f33b80c0440 0x7f33b8152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.942+0000 7f33bd581640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b8071e80 con 0x7f33b8072310 2023-11-18T20:42:00.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.942+0000 7f33bd581640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b8071470 con 0x7f33b814c2e0 2023-11-18T20:42:00.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.942+0000 7f33bd581640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b814c6c0 con 0x7f33b80c0440 2023-11-18T20:42:00.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.943+0000 7f33b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33b814c2e0 0x7f33b80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.943+0000 7f33b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33b814c2e0 0x7f33b80c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35102/0 (socket says 172.21.15.132:35102) 2023-11-18T20:42:00.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.943+0000 7f33b7fff640 1 -- 172.21.15.132:0/1574338357 learned_addr learned my addr 172.21.15.132:0/1574338357 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:00.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.943+0000 7f33affff640 1 --2- 172.21.15.132:0/1574338357 >> v2:172.21.15.161:3300/0 conn(0x7f33b80c0440 0x7f33b8152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.943+0000 7f33b7fff640 1 -- 172.21.15.132:0/1574338357 >> v2:172.21.15.161:3300/0 conn(0x7f33b80c0440 msgr2=0x7f33b8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:00.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.943+0000 7f33b7fff640 1 --2- 172.21.15.132:0/1574338357 >> v2:172.21.15.161:3300/0 conn(0x7f33b80c0440 0x7f33b8152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.943+0000 7f33b7fff640 1 -- 172.21.15.132:0/1574338357 >> v1:172.21.15.161:6789/0 conn(0x7f33b8072310 legacy=0x7f33b80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:00.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.943+0000 7f33b7fff640 1 -- 172.21.15.132:0/1574338357 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8153180 con 0x7f33b814c2e0 2023-11-18T20:42:00.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.944+0000 7f33b7fff640 1 --2- 172.21.15.132:0/1574338357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b814c2e0 0x7f33b80c0c80 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f33b80678c0 tx=0x7f33a802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184486c814c7a85b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33b77fe640 1 -- 172.21.15.132:0/1574338357 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8031750 con 0x7f33b814c2e0 2023-11-18T20:42:00.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33b77fe640 1 -- 172.21.15.132:0/1574338357 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a80318b0 con 0x7f33b814c2e0 2023-11-18T20:42:00.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33b77fe640 1 -- 172.21.15.132:0/1574338357 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8031c40 con 0x7f33b814c2e0 2023-11-18T20:42:00.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33bd581640 1 -- 172.21.15.132:0/1574338357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b814c2e0 msgr2=0x7f33b80c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33bd581640 1 --2- 172.21.15.132:0/1574338357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b814c2e0 0x7f33b80c0c80 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f33b80678c0 tx=0x7f33a802b7f0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33bd581640 1 -- 172.21.15.132:0/1574338357 shutdown_connections 2023-11-18T20:42:00.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33bd581640 1 --2- 172.21.15.132:0/1574338357 >> v2:172.21.15.161:3300/0 conn(0x7f33b80c0440 0x7f33b8152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33bd581640 1 --2- 172.21.15.132:0/1574338357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b814c2e0 0x7f33b80c0c80 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33bd581640 1 -- 172.21.15.132:0/1574338357 >> 172.21.15.132:0/1574338357 conn(0x7f33b80a77f0 msgr2=0x7f33b80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:00.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.945+0000 7f33bd581640 1 -- 172.21.15.132:0/1574338357 shutdown_connections 2023-11-18T20:42:00.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.946+0000 7f33bd581640 1 -- 172.21.15.132:0/1574338357 wait complete. 2023-11-18T20:42:00.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.947+0000 7f33bd581640 1 Processor -- start 2023-11-18T20:42:00.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.947+0000 7f33bd581640 1 -- start start 2023-11-18T20:42:00.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.948+0000 7f33bd581640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8072310 0x7f33b81ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.948+0000 7f33bd581640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b80c0440 0x7f33b81edb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.948+0000 7f33bd581640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b814c2e0 0x7f33b8155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.948+0000 7f33bd581640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80a90e0 con 0x7f33b8072310 2023-11-18T20:42:00.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.948+0000 7f33bd581640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81dbe80 con 0x7f33b80c0440 2023-11-18T20:42:00.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.948+0000 7f33bd581640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81db8c0 con 0x7f33b814c2e0 2023-11-18T20:42:00.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.948+0000 7f33b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8072310 0x7f33b81ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8072310 0x7f33b81ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35114/0 (socket says 172.21.15.132:35114) 2023-11-18T20:42:00.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33b7fff640 1 -- 172.21.15.132:0/324064757 learned_addr learned my addr 172.21.15.132:0/324064757 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33b7fff640 1 -- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b814c2e0 msgr2=0x7f33b8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33b7fff640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b814c2e0 0x7f33b8155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33affff640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b80c0440 0x7f33b81edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33b7fff640 1 -- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b80c0440 msgr2=0x7f33b81edb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33b7fff640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b80c0440 0x7f33b81edb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33b7fff640 1 -- 172.21.15.132:0/324064757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80094d0 con 0x7f33b8072310 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.949+0000 7f33b7fff640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8072310 0x7f33b81ed5e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f33a8000c00 tx=0x7f33a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.950+0000 7f33b57fa640 1 -- 172.21.15.132:0/324064757 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8033c80 con 0x7f33b8072310 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.950+0000 7f33b57fa640 1 -- 172.21.15.132:0/324064757 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a8033e00 con 0x7f33b8072310 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.950+0000 7f33b57fa640 1 -- 172.21.15.132:0/324064757 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a803c640 con 0x7f33b8072310 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.950+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b81dbba0 con 0x7f33b8072310 2023-11-18T20:42:00.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.950+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b81ee1f0 con 0x7f33b8072310 2023-11-18T20:42:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.951+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b80a9500 con 0x7f33b8072310 2023-11-18T20:42:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.952+0000 7f33b57fa640 1 -- 172.21.15.132:0/324064757 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33a803a040 con 0x7f33b8072310 2023-11-18T20:42:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.953+0000 7f33b57fa640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f339806ae70 0x7f339806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:00.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.953+0000 7f33b57fa640 1 -- 172.21.15.132:0/324064757 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f33a80ab560 con 0x7f33b8072310 2023-11-18T20:42:00.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.953+0000 7f33affff640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f339806ae70 0x7f339806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.954+0000 7f33affff640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f339806ae70 0x7f339806d330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f33b80a9070 tx=0x7f33a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:00.957+0000 7f33b57fa640 1 -- 172.21.15.132:0/324064757 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33b80a9500 con 0x7f33b8072310 2023-11-18T20:42:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.146+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33b80a9500 con 0x7f33b8072310 2023-11-18T20:42:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.147+0000 7f33b57fa640 1 -- 172.21.15.132:0/324064757 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v82) v1 ==== 105+0+11 (secure 0 0 0) 0x7f33b80a9500 con 0x7f33b8072310 2023-11-18T20:42:01.148 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:42:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f339806ae70 msgr2=0x7f339806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f339806ae70 0x7f339806d330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f33b80a9070 tx=0x7f33a0008040 comp rx=0 tx=0).stop 2023-11-18T20:42:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8072310 msgr2=0x7f33b81ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8072310 0x7f33b81ed5e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f33a8000c00 tx=0x7f33a80046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 shutdown_connections 2023-11-18T20:42:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f339806ae70 0x7f339806d330 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b814c2e0 0x7f33b8155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b80c0440 0x7f33b81edb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 --2- 172.21.15.132:0/324064757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8072310 0x7f33b81ed5e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.149+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 >> 172.21.15.132:0/324064757 conn(0x7f33b80a77f0 msgr2=0x7f33b814a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:01.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.150+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 shutdown_connections 2023-11-18T20:42:01.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.150+0000 7f33bd581640 1 -- 172.21.15.132:0/324064757 wait complete. 2023-11-18T20:42:01.168 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:42:01.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.379+0000 7f116f797640 1 Processor -- start 2023-11-18T20:42:01.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.379+0000 7f116f797640 1 -- start start 2023-11-18T20:42:01.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.380+0000 7f116f797640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1168155490 0x7f11680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.380+0000 7f116f797640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11680c1500 0x7f11680a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.380+0000 7f116f797640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11680c06c0 con 0x7f11680c4080 2023-11-18T20:42:01.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.380+0000 7f116f797640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11680a5820 con 0x7f1168155490 2023-11-18T20:42:01.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.380+0000 7f116f797640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11680c1020 con 0x7f11680c1500 2023-11-18T20:42:01.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.381+0000 7f116d533640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1168155490 0x7f11680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.381+0000 7f116d533640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1168155490 0x7f11680a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35116/0 (socket says 172.21.15.132:35116) 2023-11-18T20:42:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.381+0000 7f116d533640 1 -- 172.21.15.132:0/3497784341 learned_addr learned my addr 172.21.15.132:0/3497784341 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.381+0000 7f116d533640 1 -- 172.21.15.132:0/3497784341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11680c1500 msgr2=0x7f11680a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.381+0000 7f116d533640 1 --2- 172.21.15.132:0/3497784341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11680c1500 0x7f11680a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.381+0000 7f116d533640 1 -- 172.21.15.132:0/3497784341 >> v1:172.21.15.161:6789/0 conn(0x7f11680c4080 legacy=0x7f11680c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.381+0000 7f116d533640 1 -- 172.21.15.132:0/3497784341 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680c0910 con 0x7f1168155490 2023-11-18T20:42:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.382+0000 7f116d533640 1 --2- 172.21.15.132:0/3497784341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a51b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1164009870 tx=0x7f116402da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29745171014d0b7c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.382+0000 7f115ffff640 1 -- 172.21.15.132:0/3497784341 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116402f830 con 0x7f1168155490 2023-11-18T20:42:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.382+0000 7f115ffff640 1 -- 172.21.15.132:0/3497784341 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116402f990 con 0x7f1168155490 2023-11-18T20:42:01.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.382+0000 7f115ffff640 1 -- 172.21.15.132:0/3497784341 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116402fd20 con 0x7f1168155490 2023-11-18T20:42:01.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.383+0000 7f116f797640 1 -- 172.21.15.132:0/3497784341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 msgr2=0x7f11680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.383+0000 7f116f797640 1 --2- 172.21.15.132:0/3497784341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a51b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1164009870 tx=0x7f116402da70 comp rx=0 tx=0).stop 2023-11-18T20:42:01.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.383+0000 7f116f797640 1 -- 172.21.15.132:0/3497784341 shutdown_connections 2023-11-18T20:42:01.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.383+0000 7f116f797640 1 --2- 172.21.15.132:0/3497784341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11680c1500 0x7f11680a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.383+0000 7f116f797640 1 --2- 172.21.15.132:0/3497784341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a51b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.383+0000 7f116f797640 1 -- 172.21.15.132:0/3497784341 >> 172.21.15.132:0/3497784341 conn(0x7f116806a500 msgr2=0x7f116806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:01.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.383+0000 7f116f797640 1 -- 172.21.15.132:0/3497784341 shutdown_connections 2023-11-18T20:42:01.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.383+0000 7f116f797640 1 -- 172.21.15.132:0/3497784341 wait complete. 2023-11-18T20:42:01.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.385+0000 7f116f797640 1 Processor -- start 2023-11-18T20:42:01.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.385+0000 7f116f797640 1 -- start start 2023-11-18T20:42:01.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116f797640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11680c1500 0x7f11680711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116f797640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11680c4080 0x7f116814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116f797640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116f797640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681dac90 con 0x7f1168155490 2023-11-18T20:42:01.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116f797640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680707b0 con 0x7f11680c1500 2023-11-18T20:42:01.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116f797640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1168070d60 con 0x7f11680c4080 2023-11-18T20:42:01.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116dd34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116dd34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35128/0 (socket says 172.21.15.132:35128) 2023-11-18T20:42:01.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116dd34640 1 -- 172.21.15.132:0/3614711057 learned_addr learned my addr 172.21.15.132:0/3614711057 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:01.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116d533640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11680c1500 0x7f11680711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.386+0000 7f116dd34640 1 -- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11680c4080 msgr2=0x7f116814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f116dd34640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11680c4080 0x7f116814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f116dd34640 1 -- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11680c1500 msgr2=0x7f11680711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f116dd34640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11680c1500 0x7f11680711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f116dd34640 1 -- 172.21.15.132:0/3614711057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640094d0 con 0x7f1168155490 2023-11-18T20:42:01.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f116dd34640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a67c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f116000c7b0 tx=0x7f116000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:01.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f115dffb640 1 -- 172.21.15.132:0/3614711057 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160003d80 con 0x7f1168155490 2023-11-18T20:42:01.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f115dffb640 1 -- 172.21.15.132:0/3614711057 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000ce60 con 0x7f1168155490 2023-11-18T20:42:01.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f115dffb640 1 -- 172.21.15.132:0/3614711057 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600052b0 con 0x7f1168155490 2023-11-18T20:42:01.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11680a4fe0 con 0x7f1168155490 2023-11-18T20:42:01.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.387+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11680709f0 con 0x7f1168155490 2023-11-18T20:42:01.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.388+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1168071730 con 0x7f1168155490 2023-11-18T20:42:01.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.389+0000 7f115dffb640 1 -- 172.21.15.132:0/3614711057 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1160006b10 con 0x7f1168155490 2023-11-18T20:42:01.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.390+0000 7f115dffb640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f114c06ae40 0x7f114c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.390+0000 7f115dffb640 1 -- 172.21.15.132:0/3614711057 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f1160088c50 con 0x7f1168155490 2023-11-18T20:42:01.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.391+0000 7f116d533640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f114c06ae40 0x7f114c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.392+0000 7f116d533640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f114c06ae40 0x7f114c06d300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1164038000 tx=0x7f1164008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:01.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.395+0000 7f115dffb640 1 -- 172.21.15.132:0/3614711057 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f116008e020 con 0x7f1168155490 2023-11-18T20:42:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.582+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1168068350 con 0x7f1168155490 2023-11-18T20:42:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.582+0000 7f115dffb640 1 -- 172.21.15.132:0/3614711057 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v82) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1160017070 con 0x7f1168155490 2023-11-18T20:42:01.584 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:42:01.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.585+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f114c06ae40 msgr2=0x7f114c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.585+0000 7f116f797640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f114c06ae40 0x7f114c06d300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1164038000 tx=0x7f1164008030 comp rx=0 tx=0).stop 2023-11-18T20:42:01.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.585+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 msgr2=0x7f11680a67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.585+0000 7f116f797640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a67c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f116000c7b0 tx=0x7f116000cc70 comp rx=0 tx=0).stop 2023-11-18T20:42:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.586+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 shutdown_connections 2023-11-18T20:42:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.586+0000 7f116f797640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f114c06ae40 0x7f114c06d300 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.586+0000 7f116f797640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1168155490 0x7f11680a67c0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.586+0000 7f116f797640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11680c4080 0x7f116814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.586+0000 7f116f797640 1 --2- 172.21.15.132:0/3614711057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11680c1500 0x7f11680711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.586+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 >> 172.21.15.132:0/3614711057 conn(0x7f116806a500 msgr2=0x7f1168153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.586+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 shutdown_connections 2023-11-18T20:42:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.586+0000 7f116f797640 1 -- 172.21.15.132:0/3614711057 wait complete. 2023-11-18T20:42:01.604 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:42:01.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.790+0000 7f41aa73c640 1 Processor -- start 2023-11-18T20:42:01.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.790+0000 7f41aa73c640 1 -- start start 2023-11-18T20:42:01.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.792+0000 7f41aa73c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41a406cd20 0x7f41a415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.792+0000 7f41aa73c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a40a8380 con 0x7f41a414e7f0 2023-11-18T20:42:01.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.792+0000 7f41aa73c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a41510b0 con 0x7f41a40c52e0 2023-11-18T20:42:01.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.792+0000 7f41aa73c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a406bf60 con 0x7f41a406cd20 2023-11-18T20:42:01.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.792+0000 7f41a973a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f41a414e7f0 0x7f41a40c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48062/0 (socket says 172.21.15.132:48062) 2023-11-18T20:42:01.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.792+0000 7f41a973a640 1 -- 172.21.15.132:0/2160601519 learned_addr learned my addr 172.21.15.132:0/2160601519 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:01.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.792+0000 7f41a9f3b640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41a406cd20 0x7f41a415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.792+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443901661 0 0) 0x7f41a40a8380 con 0x7f41a414e7f0 2023-11-18T20:42:01.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4190003520 con 0x7f41a414e7f0 2023-11-18T20:42:01.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3147731277 0 0) 0x7f4190003520 con 0x7f41a414e7f0 2023-11-18T20:42:01.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41a406cd20 msgr2=0x7f41a415ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:01.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41a406cd20 0x7f41a415ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 >> v1:172.21.15.161:6789/0 conn(0x7f41a40c52e0 legacy=0x7f41a406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a406c240 con 0x7f41a414e7f0 2023-11-18T20:42:01.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f41a0001670 con 0x7f41a414e7f0 2023-11-18T20:42:01.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 >> v1:172.21.15.132:6789/0 conn(0x7f41a414e7f0 legacy=0x7f41a40c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41a406cd20 0x7f41900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4190003f20 0x7f41900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4190004d00 0x7f4190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a406bf60 con 0x7f4190004d00 2023-11-18T20:42:01.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419000bb10 con 0x7f4190003f20 2023-11-18T20:42:01.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419000dee0 con 0x7f41a406cd20 2023-11-18T20:42:01.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.793+0000 7f41a9f3b640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4190004d00 0x7f4190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.794+0000 7f41a973a640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41a406cd20 0x7f41900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.794+0000 7f41a8f39640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4190003f20 0x7f41900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.794+0000 7f41a9f3b640 1 -- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41a406cd20 msgr2=0x7f41900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:01.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.794+0000 7f41a9f3b640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41a406cd20 0x7f41900039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.794+0000 7f41a9f3b640 1 -- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4190003f20 msgr2=0x7f41900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:01.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.794+0000 7f41a9f3b640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4190003f20 0x7f41900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.794+0000 7f41a9f3b640 1 -- 172.21.15.132:0/2160601519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190003520 con 0x7f4190004d00 2023-11-18T20:42:01.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.795+0000 7f41a9f3b640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4190004d00 0x7f4190005180 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f419c009f90 tx=0x7f41900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ee4bf8efc3c3d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:01.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.795+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c02cbf0 con 0x7f4190004d00 2023-11-18T20:42:01.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.795+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00f040 con 0x7f4190004d00 2023-11-18T20:42:01.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.795+0000 7f419bfff640 1 -- 172.21.15.132:0/2160601519 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c034440 con 0x7f4190004d00 2023-11-18T20:42:01.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.796+0000 7f41aa73c640 1 -- 172.21.15.132:0/2160601519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4190004d00 msgr2=0x7f4190005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.796+0000 7f41aa73c640 1 --2- 172.21.15.132:0/2160601519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4190004d00 0x7f4190005180 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f419c009f90 tx=0x7f41900057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.796+0000 7f41a9f3b640 1 -- 172.21.15.132:0/2160601519 reap_dead start 2023-11-18T20:42:01.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.796+0000 7f41aa73c640 1 -- 172.21.15.132:0/2160601519 shutdown_connections 2023-11-18T20:42:01.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.796+0000 7f41aa73c640 1 -- 172.21.15.132:0/2160601519 >> 172.21.15.132:0/2160601519 conn(0x7f41a40a77f0 msgr2=0x7f41a40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:01.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.796+0000 7f41aa73c640 1 -- 172.21.15.132:0/2160601519 shutdown_connections 2023-11-18T20:42:01.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.796+0000 7f41aa73c640 1 -- 172.21.15.132:0/2160601519 wait complete. 2023-11-18T20:42:01.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.798+0000 7f41aa73c640 1 Processor -- start 2023-11-18T20:42:01.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.798+0000 7f41aa73c640 1 -- start start 2023-11-18T20:42:01.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.798+0000 7f41aa73c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4190004d00 0x7f41a41e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41aa73c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41e6710 0x7f41a41527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41aa73c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41a40a6e40 0x7f41a4147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41aa73c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40ab100 con 0x7f41a40a6e40 2023-11-18T20:42:01.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41aa73c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a41e5d00 con 0x7f41a41e6710 2023-11-18T20:42:01.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41aa73c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a41ea1c0 con 0x7f4190004d00 2023-11-18T20:42:01.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41a40a6e40 0x7f41a4147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41a40a6e40 0x7f41a4147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35132/0 (socket says 172.21.15.132:35132) 2023-11-18T20:42:01.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 -- 172.21.15.132:0/1213314041 learned_addr learned my addr 172.21.15.132:0/1213314041 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:01.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a973a640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4190004d00 0x7f41a41e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 -- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4190004d00 msgr2=0x7f41a41e9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4190004d00 0x7f41a41e9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 -- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41e6710 msgr2=0x7f41a41527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:01.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41e6710 0x7f41a41527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 -- 172.21.15.132:0/1213314041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a41e6280 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.799+0000 7f41a9f3b640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41a40a6e40 0x7f41a4147c10 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f419c002230 tx=0x7f419c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.800+0000 7f4199ffb640 1 -- 172.21.15.132:0/1213314041 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c034bc0 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.800+0000 7f4199ffb640 1 -- 172.21.15.132:0/1213314041 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c034d40 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.800+0000 7f4199ffb640 1 -- 172.21.15.132:0/1213314041 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c03e680 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.800+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a4152cf0 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.800+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a40aae20 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.801+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a41e6410 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.802+0000 7f4199ffb640 1 -- 172.21.15.132:0/1213314041 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f419c03e7e0 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.803+0000 7f4199ffb640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f418806ae40 0x7f418806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.803+0000 7f4199ffb640 1 -- 172.21.15.132:0/1213314041 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f419c0abcc0 con 0x7f41a40a6e40 2023-11-18T20:42:01.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.804+0000 7f41a973a640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f418806ae40 0x7f418806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:01.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.805+0000 7f41a973a640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f418806ae40 0x7f418806d300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f41a0001c90 tx=0x7f41a00014b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:01.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:01.807+0000 7f4199ffb640 1 -- 172.21.15.132:0/1213314041 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f419c076a30 con 0x7f41a40a6e40 2023-11-18T20:42:02.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.011+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41a404e840 con 0x7f41a40a6e40 2023-11-18T20:42:02.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.011+0000 7f4199ffb640 1 -- 172.21.15.132:0/1213314041 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) v1 ==== 80+0+0 (secure 0 0 0) 0x7f419c042080 con 0x7f41a40a6e40 2023-11-18T20:42:02.013 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:42:02.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f418806ae40 msgr2=0x7f418806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f418806ae40 0x7f418806d300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f41a0001c90 tx=0x7f41a00014b0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41a40a6e40 msgr2=0x7f41a4147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41a40a6e40 0x7f41a4147c10 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f419c002230 tx=0x7f419c009750 comp rx=0 tx=0).stop 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 shutdown_connections 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f418806ae40 0x7f418806d300 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41a40a6e40 0x7f41a4147c10 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41e6710 0x7f41a41527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 --2- 172.21.15.132:0/1213314041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4190004d00 0x7f41a41e9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 >> 172.21.15.132:0/1213314041 conn(0x7f41a40a77f0 msgr2=0x7f41a414ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:02.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 shutdown_connections 2023-11-18T20:42:02.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.014+0000 7f41aa73c640 1 -- 172.21.15.132:0/1213314041 wait complete. 2023-11-18T20:42:02.033 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-11-18T20:42:02.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:02.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-18T20:42:02.130 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:42:02.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:02.130 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-18T20:42:02.176 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:42:02.176 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:42:02.234 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:42:02.235 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:42:02.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:42:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.493+0000 7f60e8501640 1 Processor -- start 2023-11-18T20:42:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.493+0000 7f60e8501640 1 -- start start 2023-11-18T20:42:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.494+0000 7f60e8501640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60e006d0a0 0x7f60e0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.494+0000 7f60e8501640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60e00c3ea0 0x7f60e00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.494+0000 7f60e8501640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e00c64a0 con 0x7f60e014fd30 2023-11-18T20:42:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.494+0000 7f60e8501640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e00c5c00 con 0x7f60e006d0a0 2023-11-18T20:42:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.494+0000 7f60e8501640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e00c5ee0 con 0x7f60e00c3ea0 2023-11-18T20:42:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.495+0000 7f60e5a9c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60e006d0a0 0x7f60e0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.495+0000 7f60e5a9c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60e006d0a0 0x7f60e0152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35138/0 (socket says 172.21.15.132:35138) 2023-11-18T20:42:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.495+0000 7f60e5a9c640 1 -- 172.21.15.132:0/335046463 learned_addr learned my addr 172.21.15.132:0/335046463 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.495+0000 7f60e6a9e640 1 --2- 172.21.15.132:0/335046463 >> v2:172.21.15.161:3300/0 conn(0x7f60e00c3ea0 0x7f60e00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.495+0000 7f60e5a9c640 1 -- 172.21.15.132:0/335046463 >> v2:172.21.15.161:3300/0 conn(0x7f60e00c3ea0 msgr2=0x7f60e00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.495+0000 7f60e5a9c640 1 --2- 172.21.15.132:0/335046463 >> v2:172.21.15.161:3300/0 conn(0x7f60e00c3ea0 0x7f60e00c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.495+0000 7f60e5a9c640 1 -- 172.21.15.132:0/335046463 >> v1:172.21.15.132:6789/0 conn(0x7f60e014fd30 legacy=0x7f60e00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.495+0000 7f60e5a9c640 1 -- 172.21.15.132:0/335046463 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00c61c0 con 0x7f60e006d0a0 2023-11-18T20:42:02.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.496+0000 7f60e5a9c640 1 --2- 172.21.15.132:0/335046463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e006d0a0 0x7f60e0152f20 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f60e006e430 tx=0x7f60d402b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ae05d7294c0f87 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:02.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e529b640 1 -- 172.21.15.132:0/335046463 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4030880 con 0x7f60e006d0a0 2023-11-18T20:42:02.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e529b640 1 -- 172.21.15.132:0/335046463 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d40309e0 con 0x7f60e006d0a0 2023-11-18T20:42:02.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e529b640 1 -- 172.21.15.132:0/335046463 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4030d70 con 0x7f60e006d0a0 2023-11-18T20:42:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e8501640 1 -- 172.21.15.132:0/335046463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e006d0a0 msgr2=0x7f60e0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e8501640 1 --2- 172.21.15.132:0/335046463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e006d0a0 0x7f60e0152f20 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f60e006e430 tx=0x7f60d402b9c0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e8501640 1 -- 172.21.15.132:0/335046463 shutdown_connections 2023-11-18T20:42:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e8501640 1 --2- 172.21.15.132:0/335046463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e006d0a0 0x7f60e0152f20 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e8501640 1 --2- 172.21.15.132:0/335046463 >> v2:172.21.15.161:3300/0 conn(0x7f60e00c3ea0 0x7f60e00c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.497+0000 7f60e8501640 1 -- 172.21.15.132:0/335046463 >> 172.21.15.132:0/335046463 conn(0x7f60e006a500 msgr2=0x7f60e006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.498+0000 7f60e8501640 1 -- 172.21.15.132:0/335046463 shutdown_connections 2023-11-18T20:42:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.498+0000 7f60e8501640 1 -- 172.21.15.132:0/335046463 wait complete. 2023-11-18T20:42:02.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.499+0000 7f60e8501640 1 Processor -- start 2023-11-18T20:42:02.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.499+0000 7f60e8501640 1 -- start start 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.500+0000 7f60e8501640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60e006d0a0 0x7f60e00a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.500+0000 7f60e8501640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e00c3ea0 0x7f60e01462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.500+0000 7f60e8501640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e014fd30 0x7f60e00a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.500+0000 7f60e8501640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0070600 con 0x7f60e014fd30 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.500+0000 7f60e8501640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01eaca0 con 0x7f60e00c3ea0 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.500+0000 7f60e8501640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01eb1d0 con 0x7f60e006d0a0 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e014fd30 0x7f60e00a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e014fd30 0x7f60e00a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35146/0 (socket says 172.21.15.132:35146) 2023-11-18T20:42:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 -- 172.21.15.132:0/4218648603 learned_addr learned my addr 172.21.15.132:0/4218648603 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e629d640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60e006d0a0 0x7f60e00a8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 -- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60e006d0a0 msgr2=0x7f60e00a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60e006d0a0 0x7f60e00a8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 -- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e00c3ea0 msgr2=0x7f60e01462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e00c3ea0 0x7f60e01462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 -- 172.21.15.132:0/4218648603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40094d0 con 0x7f60e014fd30 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.501+0000 7f60e6a9e640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e014fd30 0x7f60e00a9b80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f60d800cd70 tx=0x7f60d800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.502+0000 7f60d2ffd640 1 -- 172.21.15.132:0/4218648603 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8003b90 con 0x7f60e014fd30 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.502+0000 7f60d2ffd640 1 -- 172.21.15.132:0/4218648603 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8003cf0 con 0x7f60e014fd30 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.502+0000 7f60d2ffd640 1 -- 172.21.15.132:0/4218648603 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8004240 con 0x7f60e014fd30 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.502+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e0070170 con 0x7f60e014fd30 2023-11-18T20:42:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.502+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e01eaef0 con 0x7f60e014fd30 2023-11-18T20:42:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.503+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e0070300 con 0x7f60e014fd30 2023-11-18T20:42:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.504+0000 7f60d2ffd640 1 -- 172.21.15.132:0/4218648603 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60d80043a0 con 0x7f60e014fd30 2023-11-18T20:42:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.505+0000 7f60d2ffd640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f60c406ae40 0x7f60c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.505+0000 7f60d2ffd640 1 -- 172.21.15.132:0/4218648603 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f60d8012070 con 0x7f60e014fd30 2023-11-18T20:42:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.506+0000 7f60e629d640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f60c406ae40 0x7f60c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.507+0000 7f60e629d640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f60c406ae40 0x7f60c406d300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f60e01e8060 tx=0x7f60dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:02.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.510+0000 7f60d2ffd640 1 -- 172.21.15.132:0/4218648603 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60d80550f0 con 0x7f60e014fd30 2023-11-18T20:42:02.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.687+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e00a8900 con 0x7f60e014fd30 2023-11-18T20:42:02.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.689+0000 7f60d2ffd640 1 -- 172.21.15.132:0/4218648603 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+20453 (secure 0 0 0) 0x7f60d8058710 con 0x7f60e014fd30 2023-11-18T20:42:02.690 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:02.690 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":82,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:48.564301+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f60c406ae40 msgr2=0x7f60c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f60c406ae40 0x7f60c406d300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f60e01e8060 tx=0x7f60dc009040 comp rx=0 tx=0).stop 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e014fd30 msgr2=0x7f60e00a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e014fd30 0x7f60e00a9b80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f60d800cd70 tx=0x7f60d800a660 comp rx=0 tx=0).stop 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 shutdown_connections 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f60c406ae40 0x7f60c406d300 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60e014fd30 0x7f60e00a9b80 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e00c3ea0 0x7f60e01462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 --2- 172.21.15.132:0/4218648603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60e006d0a0 0x7f60e00a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.691+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 >> 172.21.15.132:0/4218648603 conn(0x7f60e006a500 msgr2=0x7f60e00c3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:02.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.692+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 shutdown_connections 2023-11-18T20:42:02.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.692+0000 7f60e8501640 1 -- 172.21.15.132:0/4218648603 wait complete. 2023-11-18T20:42:02.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:41:17.894376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:41:18.520471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:41:33.270522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:41:33.924631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:42:02.712 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:42:02.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.923+0000 7f508a380640 1 Processor -- start 2023-11-18T20:42:02.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.923+0000 7f508a380640 1 -- start start 2023-11-18T20:42:02.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.924+0000 7f508a380640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f50840c0440 0x7f50840c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.924+0000 7f508a380640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5084072310 0x7f50840a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.924+0000 7f508a380640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5084071e80 con 0x7f508414c2e0 2023-11-18T20:42:02.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.924+0000 7f508a380640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5084071470 con 0x7f50840c0440 2023-11-18T20:42:02.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.924+0000 7f508a380640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508414c6c0 con 0x7f5084072310 2023-11-18T20:42:02.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.925+0000 7f5088b7d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f50840c0440 0x7f50840c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.925+0000 7f5088b7d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f50840c0440 0x7f50840c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35154/0 (socket says 172.21.15.132:35154) 2023-11-18T20:42:02.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.925+0000 7f5088b7d640 1 -- 172.21.15.132:0/3033261562 learned_addr learned my addr 172.21.15.132:0/3033261562 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:02.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.925+0000 7f5088b7d640 1 -- 172.21.15.132:0/3033261562 >> v2:172.21.15.161:3300/0 conn(0x7f5084072310 msgr2=0x7f50840a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:02.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.925+0000 7f5088b7d640 1 --2- 172.21.15.132:0/3033261562 >> v2:172.21.15.161:3300/0 conn(0x7f5084072310 0x7f50840a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.925+0000 7f5088b7d640 1 -- 172.21.15.132:0/3033261562 >> v1:172.21.15.161:6789/0 conn(0x7f508414c2e0 legacy=0x7f5084152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:02.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.925+0000 7f5088b7d640 1 -- 172.21.15.132:0/3033261562 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508406fdc0 con 0x7f50840c0440 2023-11-18T20:42:02.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.926+0000 7f5088b7d640 1 --2- 172.21.15.132:0/3033261562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50840c0440 0x7f50840c0c80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f5084156850 tx=0x7f507402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fda60eb54ed28d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:02.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f507bfff640 1 -- 172.21.15.132:0/3033261562 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074031750 con 0x7f50840c0440 2023-11-18T20:42:02.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f507bfff640 1 -- 172.21.15.132:0/3033261562 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50740318b0 con 0x7f50840c0440 2023-11-18T20:42:02.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f507bfff640 1 -- 172.21.15.132:0/3033261562 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074031c40 con 0x7f50840c0440 2023-11-18T20:42:02.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f508a380640 1 -- 172.21.15.132:0/3033261562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50840c0440 msgr2=0x7f50840c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f508a380640 1 --2- 172.21.15.132:0/3033261562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50840c0440 0x7f50840c0c80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f5084156850 tx=0x7f507402b7f0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f508a380640 1 -- 172.21.15.132:0/3033261562 shutdown_connections 2023-11-18T20:42:02.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f508a380640 1 --2- 172.21.15.132:0/3033261562 >> v2:172.21.15.161:3300/0 conn(0x7f5084072310 0x7f50840a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f508a380640 1 --2- 172.21.15.132:0/3033261562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50840c0440 0x7f50840c0c80 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f508a380640 1 -- 172.21.15.132:0/3033261562 >> 172.21.15.132:0/3033261562 conn(0x7f50840a77f0 msgr2=0x7f50840a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:02.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f508a380640 1 -- 172.21.15.132:0/3033261562 shutdown_connections 2023-11-18T20:42:02.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.927+0000 7f508a380640 1 -- 172.21.15.132:0/3033261562 wait complete. 2023-11-18T20:42:02.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.929+0000 7f508a380640 1 Processor -- start 2023-11-18T20:42:02.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.929+0000 7f508a380640 1 -- start start 2023-11-18T20:42:02.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508a380640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5084072310 0x7f5084148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508a380640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50840c0440 0x7f5084155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508a380640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508414c2e0 0x7f50841ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508a380640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508414f9e0 con 0x7f5084072310 2023-11-18T20:42:02.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508a380640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50840aaa30 con 0x7f50840c0440 2023-11-18T20:42:02.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508a380640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50841ea130 con 0x7f508414c2e0 2023-11-18T20:42:02.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508937e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5084072310 0x7f5084148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508937e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5084072310 0x7f5084148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35158/0 (socket says 172.21.15.132:35158) 2023-11-18T20:42:02.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.930+0000 7f508937e640 1 -- 172.21.15.132:0/2889673575 learned_addr learned my addr 172.21.15.132:0/2889673575 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f5088b7d640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50840c0440 0x7f5084155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f5089b7f640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508414c2e0 0x7f50841ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f508937e640 1 -- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508414c2e0 msgr2=0x7f50841ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f508937e640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508414c2e0 0x7f50841ea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f508937e640 1 -- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50840c0440 msgr2=0x7f5084155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f508937e640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50840c0440 0x7f5084155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f508937e640 1 -- 172.21.15.132:0/2889673575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50740094d0 con 0x7f5084072310 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f5088b7d640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50840c0440 0x7f5084155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:02.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f508937e640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5084072310 0x7f5084148400 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f508000c440 tx=0x7f508000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:02.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f5079ffb640 1 -- 172.21.15.132:0/2889673575 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080005480 con 0x7f5084072310 2023-11-18T20:42:02.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f5079ffb640 1 -- 172.21.15.132:0/2889673575 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800035f0 con 0x7f5084072310 2023-11-18T20:42:02.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50840a8750 con 0x7f5084072310 2023-11-18T20:42:02.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f5079ffb640 1 -- 172.21.15.132:0/2889673575 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800039c0 con 0x7f5084072310 2023-11-18T20:42:02.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.931+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50841ee390 con 0x7f5084072310 2023-11-18T20:42:02.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.933+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50841ea2a0 con 0x7f5084072310 2023-11-18T20:42:02.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.934+0000 7f5079ffb640 1 -- 172.21.15.132:0/2889673575 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5080003b20 con 0x7f5084072310 2023-11-18T20:42:02.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.935+0000 7f5079ffb640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f506806ae40 0x7f506806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:02.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.935+0000 7f5079ffb640 1 -- 172.21.15.132:0/2889673575 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f5080088b50 con 0x7f5084072310 2023-11-18T20:42:02.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.936+0000 7f5088b7d640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f506806ae40 0x7f506806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:02.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.937+0000 7f5088b7d640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f506806ae40 0x7f506806d300 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5074035000 tx=0x7f5074008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:02.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:02.940+0000 7f5079ffb640 1 -- 172.21.15.132:0/2889673575 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50841ea2a0 con 0x7f5084072310 2023-11-18T20:42:03.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.127+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50840c5850 con 0x7f5084072310 2023-11-18T20:42:03.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.128+0000 7f5079ffb640 1 -- 172.21.15.132:0/2889673575 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5080017020 con 0x7f5084072310 2023-11-18T20:42:03.130 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:42:03.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f506806ae40 msgr2=0x7f506806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f506806ae40 0x7f506806d300 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5074035000 tx=0x7f5074008030 comp rx=0 tx=0).stop 2023-11-18T20:42:03.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5084072310 msgr2=0x7f5084148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5084072310 0x7f5084148400 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f508000c440 tx=0x7f508000c900 comp rx=0 tx=0).stop 2023-11-18T20:42:03.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 shutdown_connections 2023-11-18T20:42:03.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f506806ae40 0x7f506806d300 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508414c2e0 0x7f50841ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50840c0440 0x7f5084155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 --2- 172.21.15.132:0/2889673575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5084072310 0x7f5084148400 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 >> 172.21.15.132:0/2889673575 conn(0x7f50840a77f0 msgr2=0x7f508414b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:03.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 shutdown_connections 2023-11-18T20:42:03.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.131+0000 7f508a380640 1 -- 172.21.15.132:0/2889673575 wait complete. 2023-11-18T20:42:03.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:42:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.368+0000 7f7a2095e640 1 Processor -- start 2023-11-18T20:42:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.368+0000 7f7a2095e640 1 -- start start 2023-11-18T20:42:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.370+0000 7f7a2095e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a1c0c0440 0x7f7a1c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.370+0000 7f7a2095e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c071e80 con 0x7f7a1c14c2e0 2023-11-18T20:42:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.370+0000 7f7a2095e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c14c6c0 con 0x7f7a1c072310 2023-11-18T20:42:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.370+0000 7f7a2095e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c071470 con 0x7f7a1c0c0440 2023-11-18T20:42:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.370+0000 7f7a1b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7a1c14c2e0 0x7f7a1c152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48080/0 (socket says 172.21.15.132:48080) 2023-11-18T20:42:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.370+0000 7f7a1b7fe640 1 -- 172.21.15.132:0/3743403299 learned_addr learned my addr 172.21.15.132:0/3743403299 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.370+0000 7f7a1affd640 1 --2- 172.21.15.132:0/3743403299 >> v2:172.21.15.132:3300/0 conn(0x7f7a1c0c0440 0x7f7a1c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.371+0000 7f7a1a7fc640 1 -- 172.21.15.132:0/3743403299 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365371758 0 0) 0x7f7a1c071e80 con 0x7f7a1c14c2e0 2023-11-18T20:42:03.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.371+0000 7f7a1a7fc640 1 -- 172.21.15.132:0/3743403299 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a08003520 con 0x7f7a1c14c2e0 2023-11-18T20:42:03.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.371+0000 7f7a1affd640 1 -- 172.21.15.132:0/3743403299 >> v1:172.21.15.161:6789/0 conn(0x7f7a1c072310 legacy=0x7f7a1c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:03.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.371+0000 7f7a1affd640 1 -- 172.21.15.132:0/3743403299 >> v1:172.21.15.132:6789/0 conn(0x7f7a1c14c2e0 legacy=0x7f7a1c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.371+0000 7f7a1affd640 1 -- 172.21.15.132:0/3743403299 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c06fdc0 con 0x7f7a1c0c0440 2023-11-18T20:42:03.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.372+0000 7f7a1affd640 1 --2- 172.21.15.132:0/3743403299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0c0c80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7a040097a0 tx=0x7f7a0402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e761d8e3f4491d62 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:03.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.375+0000 7f7a1a7fc640 1 -- 172.21.15.132:0/3743403299 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0402f050 con 0x7f7a1c0c0440 2023-11-18T20:42:03.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.375+0000 7f7a1a7fc640 1 -- 172.21.15.132:0/3743403299 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04031700 con 0x7f7a1c0c0440 2023-11-18T20:42:03.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.375+0000 7f7a1a7fc640 1 -- 172.21.15.132:0/3743403299 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04031a70 con 0x7f7a1c0c0440 2023-11-18T20:42:03.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.376+0000 7f7a2095e640 1 -- 172.21.15.132:0/3743403299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 msgr2=0x7f7a1c0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.376+0000 7f7a2095e640 1 --2- 172.21.15.132:0/3743403299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0c0c80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7a040097a0 tx=0x7f7a0402b7a0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.376+0000 7f7a2095e640 1 -- 172.21.15.132:0/3743403299 shutdown_connections 2023-11-18T20:42:03.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.376+0000 7f7a2095e640 1 --2- 172.21.15.132:0/3743403299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0c0c80 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.376+0000 7f7a2095e640 1 -- 172.21.15.132:0/3743403299 >> 172.21.15.132:0/3743403299 conn(0x7f7a1c0a77f0 msgr2=0x7f7a1c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:03.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.376+0000 7f7a2095e640 1 -- 172.21.15.132:0/3743403299 shutdown_connections 2023-11-18T20:42:03.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.376+0000 7f7a2095e640 1 -- 172.21.15.132:0/3743403299 wait complete. 2023-11-18T20:42:03.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.378+0000 7f7a2095e640 1 Processor -- start 2023-11-18T20:42:03.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.378+0000 7f7a2095e640 1 -- start start 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.379+0000 7f7a2095e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a1c072310 0x7f7a1c14d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.379+0000 7f7a2095e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.379+0000 7f7a2095e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a1c14c2e0 0x7f7a1c06bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.379+0000 7f7a2095e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c06d550 con 0x7f7a1c0c0440 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.379+0000 7f7a2095e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c06d830 con 0x7f7a1c14c2e0 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.379+0000 7f7a2095e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c06db10 con 0x7f7a1c072310 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0bf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35180/0 (socket says 172.21.15.132:35180) 2023-11-18T20:42:03.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1affd640 1 -- 172.21.15.132:0/1296123821 learned_addr learned my addr 172.21.15.132:0/1296123821 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1b7fe640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a1c072310 0x7f7a1c14d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1bfff640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a1c14c2e0 0x7f7a1c06bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1affd640 1 -- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a1c072310 msgr2=0x7f7a1c14d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1affd640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a1c072310 0x7f7a1c14d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1affd640 1 -- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a1c14c2e0 msgr2=0x7f7a1c06bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1affd640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a1c14c2e0 0x7f7a1c06bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1affd640 1 -- 172.21.15.132:0/1296123821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04009400 con 0x7f7a1c0c0440 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.380+0000 7f7a1bfff640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a1c14c2e0 0x7f7a1c06bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.381+0000 7f7a1affd640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0bf0e0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7a0402b7e0 tx=0x7f7a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.381+0000 7f7a13fff640 1 -- 172.21.15.132:0/1296123821 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a040339b0 con 0x7f7a1c0c0440 2023-11-18T20:42:03.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.381+0000 7f7a13fff640 1 -- 172.21.15.132:0/1296123821 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04033b10 con 0x7f7a1c0c0440 2023-11-18T20:42:03.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.381+0000 7f7a13fff640 1 -- 172.21.15.132:0/1296123821 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0403d410 con 0x7f7a1c0c0440 2023-11-18T20:42:03.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.381+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c14cbc0 con 0x7f7a1c0c0440 2023-11-18T20:42:03.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.381+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0bf620 con 0x7f7a1c0c0440 2023-11-18T20:42:03.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.383+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c14d0e0 con 0x7f7a1c0c0440 2023-11-18T20:42:03.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.383+0000 7f7a13fff640 1 -- 172.21.15.132:0/1296123821 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a0403a050 con 0x7f7a1c0c0440 2023-11-18T20:42:03.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.384+0000 7f7a13fff640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f79fc06ae40 0x7f79fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.384+0000 7f7a13fff640 1 -- 172.21.15.132:0/1296123821 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f7a040ab560 con 0x7f7a1c0c0440 2023-11-18T20:42:03.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.385+0000 7f7a1b7fe640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f79fc06ae40 0x7f79fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.386+0000 7f7a1b7fe640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f79fc06ae40 0x7f79fc06d300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c005c00 tx=0x7f7a0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:03.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.389+0000 7f7a13fff640 1 -- 172.21.15.132:0/1296123821 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a040762d0 con 0x7f7a1c0c0440 2023-11-18T20:42:03.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.578+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a1c04e840 con 0x7f7a1c0c0440 2023-11-18T20:42:03.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.579+0000 7f7a13fff640 1 -- 172.21.15.132:0/1296123821 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a040798f0 con 0x7f7a1c0c0440 2023-11-18T20:42:03.580 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:42:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.581+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f79fc06ae40 msgr2=0x7f79fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f79fc06ae40 0x7f79fc06d300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c005c00 tx=0x7f7a0c009040 comp rx=0 tx=0).stop 2023-11-18T20:42:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 msgr2=0x7f7a1c0bf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0bf0e0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7a0402b7e0 tx=0x7f7a040046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 shutdown_connections 2023-11-18T20:42:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f79fc06ae40 0x7f79fc06d300 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a1c14c2e0 0x7f7a1c06bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c0c0440 0x7f7a1c0bf0e0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 --2- 172.21.15.132:0/1296123821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a1c072310 0x7f7a1c14d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 >> 172.21.15.132:0/1296123821 conn(0x7f7a1c0a77f0 msgr2=0x7f7a1c1483f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 shutdown_connections 2023-11-18T20:42:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.582+0000 7f7a2095e640 1 -- 172.21.15.132:0/1296123821 wait complete. 2023-11-18T20:42:03.603 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:42:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.822+0000 7fd4abfff640 1 Processor -- start 2023-11-18T20:42:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.822+0000 7fd4abfff640 1 -- start start 2023-11-18T20:42:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.823+0000 7fd4abfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4ac0c0440 0x7fd4ac0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.823+0000 7fd4abfff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac071e80 con 0x7fd4ac072310 2023-11-18T20:42:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.823+0000 7fd4abfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac14c6c0 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.823+0000 7fd4abfff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac071470 con 0x7fd4ac0c0440 2023-11-18T20:42:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.824+0000 7fd4a3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4ac0c0440 0x7fd4ac0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.824+0000 7fd4ab7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd4ac072310 0x7fd4ac0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48096/0 (socket says 172.21.15.132:48096) 2023-11-18T20:42:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.824+0000 7fd4a3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4ac0c0440 0x7fd4ac0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35196/0 (socket says 172.21.15.132:35196) 2023-11-18T20:42:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.824+0000 7fd4ab7fe640 1 -- 172.21.15.132:0/4034218574 learned_addr learned my addr 172.21.15.132:0/4034218574 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.824+0000 7fd4a3fff640 1 -- 172.21.15.132:0/4034218574 >> v1:172.21.15.161:6789/0 conn(0x7fd4ac14c2e0 legacy=0x7fd4ac152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.824+0000 7fd4a3fff640 1 -- 172.21.15.132:0/4034218574 >> v1:172.21.15.132:6789/0 conn(0x7fd4ac072310 legacy=0x7fd4ac0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.824+0000 7fd4aa7fc640 1 -- 172.21.15.132:0/4034218574 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654930641 0 0) 0x7fd4ac071e80 con 0x7fd4ac072310 2023-11-18T20:42:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.824+0000 7fd4a3fff640 1 -- 172.21.15.132:0/4034218574 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac06fdc0 con 0x7fd4ac0c0440 2023-11-18T20:42:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.825+0000 7fd4a3fff640 1 --2- 172.21.15.132:0/4034218574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0440 0x7fd4ac0c0c80 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd4940097a0 tx=0x7fd49402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5428da163b69eaee server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.826+0000 7fd4aa7fc640 1 -- 172.21.15.132:0/4034218574 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49402e070 con 0x7fd4ac0c0440 2023-11-18T20:42:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.826+0000 7fd4aa7fc640 1 -- 172.21.15.132:0/4034218574 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940315a0 con 0x7fd4ac0c0440 2023-11-18T20:42:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.826+0000 7fd4aa7fc640 1 -- 172.21.15.132:0/4034218574 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494031930 con 0x7fd4ac0c0440 2023-11-18T20:42:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.826+0000 7fd4abfff640 1 -- 172.21.15.132:0/4034218574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0440 msgr2=0x7fd4ac0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.826+0000 7fd4abfff640 1 --2- 172.21.15.132:0/4034218574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0440 0x7fd4ac0c0c80 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd4940097a0 tx=0x7fd49402b840 comp rx=0 tx=0).stop 2023-11-18T20:42:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.826+0000 7fd4abfff640 1 -- 172.21.15.132:0/4034218574 shutdown_connections 2023-11-18T20:42:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.826+0000 7fd4abfff640 1 --2- 172.21.15.132:0/4034218574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0440 0x7fd4ac0c0c80 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.826+0000 7fd4abfff640 1 -- 172.21.15.132:0/4034218574 >> 172.21.15.132:0/4034218574 conn(0x7fd4ac0a77f0 msgr2=0x7fd4ac0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.827+0000 7fd4abfff640 1 -- 172.21.15.132:0/4034218574 shutdown_connections 2023-11-18T20:42:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.827+0000 7fd4abfff640 1 -- 172.21.15.132:0/4034218574 wait complete. 2023-11-18T20:42:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.828+0000 7fd4abfff640 1 Processor -- start 2023-11-18T20:42:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.828+0000 7fd4abfff640 1 -- start start 2023-11-18T20:42:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.829+0000 7fd4abfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ac072310 0x7fd4ac0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.829+0000 7fd4abfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ac0c0440 0x7fd4ac1eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.829+0000 7fd4abfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac14c2e0 0x7fd4ac152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.829+0000 7fd4abfff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1e5400 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.829+0000 7fd4abfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0bd720 con 0x7fd4ac072310 2023-11-18T20:42:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.829+0000 7fd4abfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0baf60 con 0x7fd4ac0c0440 2023-11-18T20:42:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.829+0000 7fd4ab7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac14c2e0 0x7fd4ac152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.829+0000 7fd4ab7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac14c2e0 0x7fd4ac152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35204/0 (socket says 172.21.15.132:35204) 2023-11-18T20:42:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.830+0000 7fd4ab7fe640 1 -- 172.21.15.132:0/2888781332 learned_addr learned my addr 172.21.15.132:0/2888781332 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.830+0000 7fd4aaffd640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ac072310 0x7fd4ac0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.830+0000 7fd4ab7fe640 1 -- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ac0c0440 msgr2=0x7fd4ac1eaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.830+0000 7fd4ab7fe640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ac0c0440 0x7fd4ac1eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.830+0000 7fd4ab7fe640 1 -- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ac072310 msgr2=0x7fd4ac0a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.830+0000 7fd4ab7fe640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ac072310 0x7fd4ac0a9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.830+0000 7fd4ab7fe640 1 -- 172.21.15.132:0/2888781332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494009400 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.830+0000 7fd4ab7fe640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac14c2e0 0x7fd4ac152a20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400c7e0 tx=0x7fd4a400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.831+0000 7fd4a8ff9640 1 -- 172.21.15.132:0/2888781332 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400a640 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.831+0000 7fd4a8ff9640 1 -- 172.21.15.132:0/2888781332 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a400a7c0 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.831+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac1eb780 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.831+0000 7fd4a8ff9640 1 -- 172.21.15.132:0/2888781332 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400ab70 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.831+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac1ebad0 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.832+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac04e840 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.833+0000 7fd4a8ff9640 1 -- 172.21.15.132:0/2888781332 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4a400acd0 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.834+0000 7fd4a8ff9640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd48c06ae70 0x7fd48c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.834+0000 7fd4a8ff9640 1 -- 172.21.15.132:0/2888781332 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fd4a40891b0 con 0x7fd4ac14c2e0 2023-11-18T20:42:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.834+0000 7fd4aaffd640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd48c06ae70 0x7fd48c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:03.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.835+0000 7fd4aaffd640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd48c06ae70 0x7fd48c06d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd49c000f60 tx=0x7fd49c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:03.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:03.838+0000 7fd4a8ff9640 1 -- 172.21.15.132:0/2888781332 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4a4053f20 con 0x7fd4ac14c2e0 2023-11-18T20:42:04.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.028+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4ac0c5380 con 0x7fd4ac14c2e0 2023-11-18T20:42:04.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.029+0000 7fd4a8ff9640 1 -- 172.21.15.132:0/2888781332 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4a4057540 con 0x7fd4ac14c2e0 2023-11-18T20:42:04.030 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:42:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd48c06ae70 msgr2=0x7fd48c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd48c06ae70 0x7fd48c06d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd49c000f60 tx=0x7fd49c009040 comp rx=0 tx=0).stop 2023-11-18T20:42:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac14c2e0 msgr2=0x7fd4ac152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac14c2e0 0x7fd4ac152a20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400c7e0 tx=0x7fd4a400cca0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 shutdown_connections 2023-11-18T20:42:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd48c06ae70 0x7fd48c06d330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac14c2e0 0x7fd4ac152a20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ac0c0440 0x7fd4ac1eaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 --2- 172.21.15.132:0/2888781332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ac072310 0x7fd4ac0a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 >> 172.21.15.132:0/2888781332 conn(0x7fd4ac0a77f0 msgr2=0x7fd4ac0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 shutdown_connections 2023-11-18T20:42:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.032+0000 7fd4abfff640 1 -- 172.21.15.132:0/2888781332 wait complete. 2023-11-18T20:42:04.052 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:42:04.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.266+0000 7f791da56640 1 Processor -- start 2023-11-18T20:42:04.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.266+0000 7f791da56640 1 -- start start 2023-11-18T20:42:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.268+0000 7f791da56640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f79180c5ec0 0x7f79180c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.268+0000 7f791da56640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f79180c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.268+0000 7f791da56640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180bfdc0 con 0x7f79180721a0 2023-11-18T20:42:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.268+0000 7f791da56640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791806e390 con 0x7f79180c5ec0 2023-11-18T20:42:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.268+0000 7f791da56640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791806ddd0 con 0x7f79180c45d0 2023-11-18T20:42:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.269+0000 7f790e7fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f79180c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.269+0000 7f790e7fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f79180c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:35322/0 (socket says 172.21.15.132:35322) 2023-11-18T20:42:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.269+0000 7f790e7fc640 1 -- 172.21.15.132:0/3785912829 learned_addr learned my addr 172.21.15.132:0/3785912829 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.269+0000 7f79177fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f79180721a0 0x7f7918155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:45418/0 (socket says 172.21.15.132:45418) 2023-11-18T20:42:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.269+0000 7f7916ffd640 1 --2- 172.21.15.132:0/3785912829 >> v2:172.21.15.161:3300/0 conn(0x7f79180c5ec0 0x7f79180c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.270+0000 7f790e7fc640 1 -- 172.21.15.132:0/3785912829 >> v2:172.21.15.161:3300/0 conn(0x7f79180c5ec0 msgr2=0x7f79180c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.270+0000 7f790e7fc640 1 --2- 172.21.15.132:0/3785912829 >> v2:172.21.15.161:3300/0 conn(0x7f79180c5ec0 0x7f79180c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.270+0000 7f790e7fc640 1 -- 172.21.15.132:0/3785912829 >> v1:172.21.15.161:6789/0 conn(0x7f79180721a0 legacy=0x7f7918155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.270+0000 7f790e7fc640 1 -- 172.21.15.132:0/3785912829 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791806e0b0 con 0x7f79180c45d0 2023-11-18T20:42:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.272+0000 7f790e7fc640 1 --2- 172.21.15.132:0/3785912829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f79180c3170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7900009870 tx=0x7f790002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1582dc8a2f5ac8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:04.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.272+0000 7f79167fc640 1 -- 172.21.15.132:0/3785912829 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000317c0 con 0x7f79180c45d0 2023-11-18T20:42:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.272+0000 7f79167fc640 1 -- 172.21.15.132:0/3785912829 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900031920 con 0x7f79180c45d0 2023-11-18T20:42:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f79167fc640 1 -- 172.21.15.132:0/3785912829 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900031cb0 con 0x7f79180c45d0 2023-11-18T20:42:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f791da56640 1 -- 172.21.15.132:0/3785912829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 msgr2=0x7f79180c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f791da56640 1 --2- 172.21.15.132:0/3785912829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f79180c3170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7900009870 tx=0x7f790002b860 comp rx=0 tx=0).stop 2023-11-18T20:42:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f791da56640 1 -- 172.21.15.132:0/3785912829 shutdown_connections 2023-11-18T20:42:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f791da56640 1 --2- 172.21.15.132:0/3785912829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f79180c3170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f791da56640 1 --2- 172.21.15.132:0/3785912829 >> v2:172.21.15.161:3300/0 conn(0x7f79180c5ec0 0x7f79180c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f791da56640 1 -- 172.21.15.132:0/3785912829 >> 172.21.15.132:0/3785912829 conn(0x7f791806a500 msgr2=0x7f791806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f791da56640 1 -- 172.21.15.132:0/3785912829 shutdown_connections 2023-11-18T20:42:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.273+0000 7f791da56640 1 -- 172.21.15.132:0/3785912829 wait complete. 2023-11-18T20:42:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.275+0000 7f791da56640 1 Processor -- start 2023-11-18T20:42:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.275+0000 7f791da56640 1 -- start start 2023-11-18T20:42:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f791da56640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180721a0 0x7f7918150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f791da56640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f791814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f791da56640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79180c5ec0 0x7f791814e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f791da56640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79181560d0 con 0x7f79180c5ec0 2023-11-18T20:42:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f791da56640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918156930 con 0x7f79180721a0 2023-11-18T20:42:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f791da56640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791814eec0 con 0x7f79180c45d0 2023-11-18T20:42:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f79177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79180c5ec0 0x7f791814e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f79177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79180c5ec0 0x7f791814e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35220/0 (socket says 172.21.15.132:35220) 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.276+0000 7f79177fe640 1 -- 172.21.15.132:0/4014011113 learned_addr learned my addr 172.21.15.132:0/4014011113 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f790e7fc640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f791814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f7916ffd640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180721a0 0x7f7918150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f79177fe640 1 -- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 msgr2=0x7f791814e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f79177fe640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f791814e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f79177fe640 1 -- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180721a0 msgr2=0x7f7918150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f79177fe640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180721a0 0x7f7918150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f79177fe640 1 -- 172.21.15.132:0/4014011113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000094d0 con 0x7f79180c5ec0 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f7916ffd640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180721a0 0x7f7918150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f79177fe640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79180c5ec0 0x7f791814e980 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f791000c7b0 tx=0x7f791000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f7914ff9640 1 -- 172.21.15.132:0/4014011113 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791000a640 con 0x7f79180c5ec0 2023-11-18T20:42:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f7914ff9640 1 -- 172.21.15.132:0/4014011113 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791000a7a0 con 0x7f79180c5ec0 2023-11-18T20:42:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f7914ff9640 1 -- 172.21.15.132:0/4014011113 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791000ab10 con 0x7f79180c5ec0 2023-11-18T20:42:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.277+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79181eac90 con 0x7f79180c5ec0 2023-11-18T20:42:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.278+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79181565c0 con 0x7f79180c5ec0 2023-11-18T20:42:04.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.279+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918068350 con 0x7f79180c5ec0 2023-11-18T20:42:04.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.280+0000 7f7914ff9640 1 -- 172.21.15.132:0/4014011113 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f791000ac70 con 0x7f79180c5ec0 2023-11-18T20:42:04.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.281+0000 7f7914ff9640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f78f806ae40 0x7f78f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.281+0000 7f7914ff9640 1 -- 172.21.15.132:0/4014011113 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f7910089130 con 0x7f79180c5ec0 2023-11-18T20:42:04.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.282+0000 7f7916ffd640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f78f806ae40 0x7f78f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.283+0000 7f7916ffd640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f78f806ae40 0x7f78f806d300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7908009a20 tx=0x7f7908008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:04.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.286+0000 7f7914ff9640 1 -- 172.21.15.132:0/4014011113 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7910053ec0 con 0x7f79180c5ec0 2023-11-18T20:42:04.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.474+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79180ab270 con 0x7f79180c5ec0 2023-11-18T20:42:04.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.475+0000 7f7914ff9640 1 -- 172.21.15.132:0/4014011113 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v82) v1 ==== 105+0+11 (secure 0 0 0) 0x7f79100574e0 con 0x7f79180c5ec0 2023-11-18T20:42:04.477 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:42:04.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f78f806ae40 msgr2=0x7f78f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f78f806ae40 0x7f78f806d300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7908009a20 tx=0x7f7908008040 comp rx=0 tx=0).stop 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79180c5ec0 msgr2=0x7f791814e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79180c5ec0 0x7f791814e980 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f791000c7b0 tx=0x7f791000cc70 comp rx=0 tx=0).stop 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 shutdown_connections 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f78f806ae40 0x7f78f806d300 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79180c5ec0 0x7f791814e980 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79180c45d0 0x7f791814e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 --2- 172.21.15.132:0/4014011113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180721a0 0x7f7918150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 >> 172.21.15.132:0/4014011113 conn(0x7f791806a500 msgr2=0x7f79180c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 shutdown_connections 2023-11-18T20:42:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.478+0000 7f791da56640 1 -- 172.21.15.132:0/4014011113 wait complete. 2023-11-18T20:42:04.497 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:42:04.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.705+0000 7f7b51fef640 1 Processor -- start 2023-11-18T20:42:04.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.705+0000 7f7b51fef640 1 -- start start 2023-11-18T20:42:04.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b51fef640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b4c06cd20 0x7f7b4c15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b51fef640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c0a8380 con 0x7f7b4c14e7f0 2023-11-18T20:42:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b51fef640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c1510b0 con 0x7f7b4c0c52e0 2023-11-18T20:42:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b51fef640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c06bf60 con 0x7f7b4c06cd20 2023-11-18T20:42:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b517ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b4c06cd20 0x7f7b4c15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b517ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b4c06cd20 0x7f7b4c15ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35232/0 (socket says 172.21.15.132:35232) 2023-11-18T20:42:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b517ee640 1 -- 172.21.15.132:0/3079820077 learned_addr learned my addr 172.21.15.132:0/3079820077 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b517ee640 1 -- 172.21.15.132:0/3079820077 >> v1:172.21.15.161:6789/0 conn(0x7f7b4c0c52e0 legacy=0x7f7b4c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.707+0000 7f7b517ee640 1 -- 172.21.15.132:0/3079820077 >> v1:172.21.15.132:6789/0 conn(0x7f7b4c14e7f0 legacy=0x7f7b4c0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.708+0000 7f7b517ee640 1 -- 172.21.15.132:0/3079820077 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c06c240 con 0x7f7b4c06cd20 2023-11-18T20:42:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.708+0000 7f7b4b7fe640 1 -- 172.21.15.132:0/3079820077 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163421379 0 0) 0x7f7b4c0a8380 con 0x7f7b4c14e7f0 2023-11-18T20:42:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.709+0000 7f7b517ee640 1 --2- 172.21.15.132:0/3079820077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c15ca40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009e50 tx=0x7f7b4402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db028274177ec451 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.709+0000 7f7b4b7fe640 1 -- 172.21.15.132:0/3079820077 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4402ca80 con 0x7f7b4c06cd20 2023-11-18T20:42:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.709+0000 7f7b4b7fe640 1 -- 172.21.15.132:0/3079820077 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4402cbe0 con 0x7f7b4c06cd20 2023-11-18T20:42:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.709+0000 7f7b4b7fe640 1 -- 172.21.15.132:0/3079820077 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440343f0 con 0x7f7b4c06cd20 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.709+0000 7f7b51fef640 1 -- 172.21.15.132:0/3079820077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 msgr2=0x7f7b4c15ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.709+0000 7f7b51fef640 1 --2- 172.21.15.132:0/3079820077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c15ca40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009e50 tx=0x7f7b4402bee0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.710+0000 7f7b51fef640 1 -- 172.21.15.132:0/3079820077 shutdown_connections 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.710+0000 7f7b51fef640 1 --2- 172.21.15.132:0/3079820077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c15ca40 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.710+0000 7f7b51fef640 1 -- 172.21.15.132:0/3079820077 >> 172.21.15.132:0/3079820077 conn(0x7f7b4c0a77f0 msgr2=0x7f7b4c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.710+0000 7f7b51fef640 1 -- 172.21.15.132:0/3079820077 shutdown_connections 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.710+0000 7f7b51fef640 1 -- 172.21.15.132:0/3079820077 wait complete. 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.711+0000 7f7b51fef640 1 Processor -- start 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.712+0000 7f7b51fef640 1 -- start start 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.712+0000 7f7b51fef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c1eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.712+0000 7f7b51fef640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b4c0c52e0 0x7f7b4c0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.712+0000 7f7b51fef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b4c14e7f0 0x7f7b4c145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.712+0000 7f7b51fef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c145080 con 0x7f7b4c06cd20 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.712+0000 7f7b51fef640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c148b30 con 0x7f7b4c0c52e0 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.712+0000 7f7b51fef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c148e10 con 0x7f7b4c14e7f0 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c1eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c1eb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35234/0 (socket says 172.21.15.132:35234) 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 -- 172.21.15.132:0/12546748 learned_addr learned my addr 172.21.15.132:0/12546748 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 -- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b4c14e7f0 msgr2=0x7f7b4c145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b4c14e7f0 0x7f7b4c145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 -- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b4c0c52e0 msgr2=0x7f7b4c0c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b4c0c52e0 0x7f7b4c0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 -- 172.21.15.132:0/12546748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009b30 con 0x7f7b4c06cd20 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.713+0000 7f7b50fed640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c1eb5a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000c410 tx=0x7f7b4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.714+0000 7f7b497fa640 1 -- 172.21.15.132:0/12546748 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400035f0 con 0x7f7b4c06cd20 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.714+0000 7f7b497fa640 1 -- 172.21.15.132:0/12546748 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40003770 con 0x7f7b4c06cd20 2023-11-18T20:42:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.714+0000 7f7b497fa640 1 -- 172.21.15.132:0/12546748 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40003b20 con 0x7f7b4c06cd20 2023-11-18T20:42:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.714+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c144d10 con 0x7f7b4c06cd20 2023-11-18T20:42:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.714+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c150390 con 0x7f7b4c06cd20 2023-11-18T20:42:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.715+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c151d80 con 0x7f7b4c06cd20 2023-11-18T20:42:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.716+0000 7f7b497fa640 1 -- 172.21.15.132:0/12546748 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b40003c80 con 0x7f7b4c06cd20 2023-11-18T20:42:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.717+0000 7f7b497fa640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b3006ae40 0x7f7b3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.717+0000 7f7b497fa640 1 -- 172.21.15.132:0/12546748 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f7b40088f70 con 0x7f7b4c06cd20 2023-11-18T20:42:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.717+0000 7f7b4bfff640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b3006ae40 0x7f7b3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.718+0000 7f7b4bfff640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b3006ae40 0x7f7b3006d300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0c03e0 tx=0x7f7b380079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:04.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.721+0000 7f7b497fa640 1 -- 172.21.15.132:0/12546748 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b400bbe90 con 0x7f7b4c06cd20 2023-11-18T20:42:04.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.910+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7b4c04e840 con 0x7f7b4c06cd20 2023-11-18T20:42:04.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.911+0000 7f7b497fa640 1 -- 172.21.15.132:0/12546748 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v82) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7b40017020 con 0x7f7b4c06cd20 2023-11-18T20:42:04.913 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:42:04.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.913+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b3006ae40 msgr2=0x7f7b3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.913+0000 7f7b51fef640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b3006ae40 0x7f7b3006d300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0c03e0 tx=0x7f7b380079b0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.913+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 msgr2=0x7f7b4c1eb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.913+0000 7f7b51fef640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c1eb5a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000c410 tx=0x7f7b4000c8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.914+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 shutdown_connections 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.914+0000 7f7b51fef640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f7b3006ae40 0x7f7b3006d300 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.914+0000 7f7b51fef640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b4c14e7f0 0x7f7b4c145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.914+0000 7f7b51fef640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b4c0c52e0 0x7f7b4c0c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.914+0000 7f7b51fef640 1 --2- 172.21.15.132:0/12546748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b4c06cd20 0x7f7b4c1eb5a0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.914+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 >> 172.21.15.132:0/12546748 conn(0x7f7b4c0a77f0 msgr2=0x7f7b4c0a6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:04.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.914+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 shutdown_connections 2023-11-18T20:42:04.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:04.914+0000 7f7b51fef640 1 -- 172.21.15.132:0/12546748 wait complete. 2023-11-18T20:42:04.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:42:05.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.145+0000 7f4a7fbe9640 1 Processor -- start 2023-11-18T20:42:05.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.145+0000 7f4a7fbe9640 1 -- start start 2023-11-18T20:42:05.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.146+0000 7f4a7fbe9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:05.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.146+0000 7f4a7fbe9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a780a9b40 0x7f4a780c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:05.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.147+0000 7f4a7fbe9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a780c06c0 con 0x7f4a780c1500 2023-11-18T20:42:05.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.147+0000 7f4a7fbe9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a780a5820 con 0x7f4a780a9b40 2023-11-18T20:42:05.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.147+0000 7f4a7fbe9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780c1020 con 0x7f4a78155490 2023-11-18T20:42:05.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.147+0000 7f4a7d985640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:05.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.147+0000 7f4a7d184640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4a780c1500 0x7f4a780a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:45426/0 (socket says 172.21.15.132:45426) 2023-11-18T20:42:05.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.147+0000 7f4a7d184640 1 -- 172.21.15.132:0/3002649741 learned_addr learned my addr 172.21.15.132:0/3002649741 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:05.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.148+0000 7f4a7e186640 1 --2- 172.21.15.132:0/3002649741 >> v2:172.21.15.161:3300/0 conn(0x7f4a780a9b40 0x7f4a780c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:05.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.148+0000 7f4a7d985640 1 -- 172.21.15.132:0/3002649741 >> v2:172.21.15.161:3300/0 conn(0x7f4a780a9b40 msgr2=0x7f4a780c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.148+0000 7f4a7d985640 1 --2- 172.21.15.132:0/3002649741 >> v2:172.21.15.161:3300/0 conn(0x7f4a780a9b40 0x7f4a780c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.148+0000 7f4a7d985640 1 -- 172.21.15.132:0/3002649741 >> v1:172.21.15.161:6789/0 conn(0x7f4a780c1500 legacy=0x7f4a780a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.148+0000 7f4a7d985640 1 -- 172.21.15.132:0/3002649741 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780c0910 con 0x7f4a78155490 2023-11-18T20:42:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.149+0000 7f4a7d985640 1 --2- 172.21.15.132:0/3002649741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a780a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a740097a0 tx=0x7f4a7402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ab97818a213ec7b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:05.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.150+0000 7f4a7c983640 1 -- 172.21.15.132:0/3002649741 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7402d040 con 0x7f4a78155490 2023-11-18T20:42:05.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.150+0000 7f4a7c983640 1 -- 172.21.15.132:0/3002649741 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a74031810 con 0x7f4a78155490 2023-11-18T20:42:05.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.150+0000 7f4a7c983640 1 -- 172.21.15.132:0/3002649741 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a74031ba0 con 0x7f4a78155490 2023-11-18T20:42:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.150+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/3002649741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 msgr2=0x7f4a780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.150+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/3002649741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a780a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a740097a0 tx=0x7f4a7402b8b0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.151+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/3002649741 shutdown_connections 2023-11-18T20:42:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.151+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/3002649741 >> v2:172.21.15.161:3300/0 conn(0x7f4a780a9b40 0x7f4a780c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.151+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/3002649741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a780a51b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.151+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/3002649741 >> 172.21.15.132:0/3002649741 conn(0x7f4a7806a500 msgr2=0x7f4a7806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.151+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/3002649741 shutdown_connections 2023-11-18T20:42:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.151+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/3002649741 wait complete. 2023-11-18T20:42:05.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.152+0000 7f4a7fbe9640 1 Processor -- start 2023-11-18T20:42:05.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.152+0000 7f4a7fbe9640 1 -- start start 2023-11-18T20:42:05.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.153+0000 7f4a7fbe9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a780c1500 0x7f4a780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:05.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.153+0000 7f4a7fbe9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a7814caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:05.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.153+0000 7f4a7fbe9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a7814b610 0x7f4a781543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:05.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.153+0000 7f4a7fbe9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a781edfb0 con 0x7f4a7814b610 2023-11-18T20:42:05.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.153+0000 7f4a7fbe9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78071b40 con 0x7f4a780c1500 2023-11-18T20:42:05.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.153+0000 7f4a7fbe9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78071de0 con 0x7f4a78155490 2023-11-18T20:42:05.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a7814b610 0x7f4a781543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:05.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a7814b610 0x7f4a781543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35248/0 (socket says 172.21.15.132:35248) 2023-11-18T20:42:05.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 -- 172.21.15.132:0/939367038 learned_addr learned my addr 172.21.15.132:0/939367038 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7d184640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a7814caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7d985640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a780c1500 0x7f4a780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 -- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 msgr2=0x7f4a7814caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a7814caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 -- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a780c1500 msgr2=0x7f4a780a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a780c1500 0x7f4a780a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 -- 172.21.15.132:0/939367038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74009400 con 0x7f4a7814b610 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7d985640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a780c1500 0x7f4a780a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.154+0000 7f4a7e186640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a7814b610 0x7f4a781543f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000ef90 tx=0x7f4a7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:05.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.155+0000 7f4a6e7fc640 1 -- 172.21.15.132:0/939367038 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70009ca0 con 0x7f4a7814b610 2023-11-18T20:42:05.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.155+0000 7f4a6e7fc640 1 -- 172.21.15.132:0/939367038 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7000f040 con 0x7f4a7814b610 2023-11-18T20:42:05.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.155+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a781ee200 con 0x7f4a7814b610 2023-11-18T20:42:05.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.155+0000 7f4a6e7fc640 1 -- 172.21.15.132:0/939367038 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700146c0 con 0x7f4a7814b610 2023-11-18T20:42:05.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.155+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7814ecc0 con 0x7f4a7814b610 2023-11-18T20:42:05.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.156+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a781ee440 con 0x7f4a7814b610 2023-11-18T20:42:05.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.157+0000 7f4a6e7fc640 1 -- 172.21.15.132:0/939367038 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a70014820 con 0x7f4a7814b610 2023-11-18T20:42:05.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.158+0000 7f4a6e7fc640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4a5c06ae40 0x7f4a5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:05.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.158+0000 7f4a6e7fc640 1 -- 172.21.15.132:0/939367038 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f4a7008a8b0 con 0x7f4a7814b610 2023-11-18T20:42:05.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.159+0000 7f4a7d985640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4a5c06ae40 0x7f4a5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:05.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.160+0000 7f4a7d985640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4a5c06ae40 0x7f4a5c06d300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4a74036000 tx=0x7f4a7403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:05.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.163+0000 7f4a6e7fc640 1 -- 172.21.15.132:0/939367038 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a781ee440 con 0x7f4a7814b610 2023-11-18T20:42:05.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.366+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a781ee440 con 0x7f4a7814b610 2023-11-18T20:42:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.367+0000 7f4a6e7fc640 1 -- 172.21.15.132:0/939367038 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4a781ee440 con 0x7f4a7814b610 2023-11-18T20:42:05.369 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-11-18T20:42:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4a5c06ae40 msgr2=0x7f4a5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4a5c06ae40 0x7f4a5c06d300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4a74036000 tx=0x7f4a7403c040 comp rx=0 tx=0).stop 2023-11-18T20:42:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a7814b610 msgr2=0x7f4a781543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a7814b610 0x7f4a781543f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000ef90 tx=0x7f4a7000c490 comp rx=0 tx=0).stop 2023-11-18T20:42:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 shutdown_connections 2023-11-18T20:42:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f4a5c06ae40 0x7f4a5c06d300 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a7814b610 0x7f4a781543f0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a78155490 0x7f4a7814caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 --2- 172.21.15.132:0/939367038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a780c1500 0x7f4a780a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:05.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.369+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 >> 172.21.15.132:0/939367038 conn(0x7f4a7806a500 msgr2=0x7f4a780aa620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:05.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.370+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 shutdown_connections 2023-11-18T20:42:05.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:05.370+0000 7f4a7fbe9640 1 -- 172.21.15.132:0/939367038 wait complete. 2023-11-18T20:42:05.389 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-11-18T20:42:05.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:05.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-18T20:42:05.503 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:42:05.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:05.504 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T20:42:05.555 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-18T20:42:05.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:42:05.677 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T20:42:05.793 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-18T20:42:05.793 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:42:05.793 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:42:05.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:42:05.854 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:42:05.854 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:42:05.914 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-18T20:42:05.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:42:06.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.133+0000 7f2f25589640 1 Processor -- start 2023-11-18T20:42:06.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.133+0000 7f2f25589640 1 -- start start 2023-11-18T20:42:06.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.134+0000 7f2f25589640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2f20155490 0x7f2f200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.134+0000 7f2f25589640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f200c1500 0x7f2f200a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.134+0000 7f2f25589640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f200c4080 0x7f2f200a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.134+0000 7f2f25589640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200a5820 con 0x7f2f200c4080 2023-11-18T20:42:06.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.134+0000 7f2f25589640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200c06c0 con 0x7f2f20155490 2023-11-18T20:42:06.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.134+0000 7f2f25589640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200c1020 con 0x7f2f200c1500 2023-11-18T20:42:06.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f200c4080 0x7f2f200a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f200c4080 0x7f2f200a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35254/0 (socket says 172.21.15.132:35254) 2023-11-18T20:42:06.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1f7fe640 1 -- 172.21.15.132:0/371842992 learned_addr learned my addr 172.21.15.132:0/371842992 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1e7fc640 1 --2- 172.21.15.132:0/371842992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f200c1500 0x7f2f200a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1effd640 1 --2- 172.21.15.132:0/371842992 >> v2:172.21.15.161:3300/0 conn(0x7f2f20155490 0x7f2f200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1f7fe640 1 -- 172.21.15.132:0/371842992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f200c1500 msgr2=0x7f2f200a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1f7fe640 1 --2- 172.21.15.132:0/371842992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f200c1500 0x7f2f200a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1f7fe640 1 -- 172.21.15.132:0/371842992 >> v2:172.21.15.161:3300/0 conn(0x7f2f20155490 msgr2=0x7f2f200a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1f7fe640 1 --2- 172.21.15.132:0/371842992 >> v2:172.21.15.161:3300/0 conn(0x7f2f20155490 0x7f2f200a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1f7fe640 1 -- 172.21.15.132:0/371842992 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200c0910 con 0x7f2f200c4080 2023-11-18T20:42:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.135+0000 7f2f1e7fc640 1 --2- 172.21.15.132:0/371842992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f200c1500 0x7f2f200a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:06.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.136+0000 7f2f1f7fe640 1 --2- 172.21.15.132:0/371842992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c4080 0x7f2f200a9970 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f2f2006dff0 tx=0x7f2f1802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6853d62310038 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:06.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f1dffb640 1 -- 172.21.15.132:0/371842992 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180317e0 con 0x7f2f200c4080 2023-11-18T20:42:06.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f1dffb640 1 -- 172.21.15.132:0/371842992 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18031940 con 0x7f2f200c4080 2023-11-18T20:42:06.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f1dffb640 1 -- 172.21.15.132:0/371842992 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18031cd0 con 0x7f2f200c4080 2023-11-18T20:42:06.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f25589640 1 -- 172.21.15.132:0/371842992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c4080 msgr2=0x7f2f200a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f25589640 1 --2- 172.21.15.132:0/371842992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c4080 0x7f2f200a9970 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f2f2006dff0 tx=0x7f2f1802b880 comp rx=0 tx=0).stop 2023-11-18T20:42:06.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f25589640 1 -- 172.21.15.132:0/371842992 shutdown_connections 2023-11-18T20:42:06.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f25589640 1 --2- 172.21.15.132:0/371842992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c4080 0x7f2f200a9970 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f25589640 1 --2- 172.21.15.132:0/371842992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f200c1500 0x7f2f200a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f25589640 1 --2- 172.21.15.132:0/371842992 >> v2:172.21.15.161:3300/0 conn(0x7f2f20155490 0x7f2f200a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f25589640 1 -- 172.21.15.132:0/371842992 >> 172.21.15.132:0/371842992 conn(0x7f2f2006a500 msgr2=0x7f2f2006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:06.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.137+0000 7f2f25589640 1 -- 172.21.15.132:0/371842992 shutdown_connections 2023-11-18T20:42:06.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.138+0000 7f2f25589640 1 -- 172.21.15.132:0/371842992 wait complete. 2023-11-18T20:42:06.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.139+0000 7f2f25589640 1 Processor -- start 2023-11-18T20:42:06.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.139+0000 7f2f25589640 1 -- start start 2023-11-18T20:42:06.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.140+0000 7f2f25589640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c1500 0x7f2f20071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.140+0000 7f2f25589640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f200c4080 0x7f2f201eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.140+0000 7f2f25589640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f20155490 0x7f2f201eb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.140+0000 7f2f25589640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201ebd80 con 0x7f2f200c1500 2023-11-18T20:42:06.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.140+0000 7f2f25589640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200bb210 con 0x7f2f200c4080 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.140+0000 7f2f25589640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200bace0 con 0x7f2f20155490 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.140+0000 7f2f1effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c1500 0x7f2f20071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c1500 0x7f2f20071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35264/0 (socket says 172.21.15.132:35264) 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1effd640 1 -- 172.21.15.132:0/3772263351 learned_addr learned my addr 172.21.15.132:0/3772263351 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1f7fe640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f20155490 0x7f2f201eb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1effd640 1 -- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f20155490 msgr2=0x7f2f201eb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1e7fc640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f200c4080 0x7f2f201eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1effd640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f20155490 0x7f2f201eb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1effd640 1 -- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f200c4080 msgr2=0x7f2f201eb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1effd640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f200c4080 0x7f2f201eb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1effd640 1 -- 172.21.15.132:0/3772263351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180094d0 con 0x7f2f200c1500 2023-11-18T20:42:06.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1f7fe640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f20155490 0x7f2f201eb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:06.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f1effd640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c1500 0x7f2f20071950 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000c7f0 tx=0x7f2f1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:06.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.141+0000 7f2f177fe640 1 -- 172.21.15.132:0/3772263351 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10004220 con 0x7f2f200c1500 2023-11-18T20:42:06.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.142+0000 7f2f177fe640 1 -- 172.21.15.132:0/3772263351 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10004380 con 0x7f2f200c1500 2023-11-18T20:42:06.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.142+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f200a4ed0 con 0x7f2f200c1500 2023-11-18T20:42:06.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.142+0000 7f2f177fe640 1 -- 172.21.15.132:0/3772263351 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10007840 con 0x7f2f200c1500 2023-11-18T20:42:06.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.142+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f201eae70 con 0x7f2f200c1500 2023-11-18T20:42:06.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.143+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f20068350 con 0x7f2f200c1500 2023-11-18T20:42:06.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.144+0000 7f2f177fe640 1 -- 172.21.15.132:0/3772263351 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f10007bb0 con 0x7f2f200c1500 2023-11-18T20:42:06.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.144+0000 7f2f177fe640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f0006ae40 0x7f2f0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.145+0000 7f2f177fe640 1 -- 172.21.15.132:0/3772263351 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f2f10089800 con 0x7f2f200c1500 2023-11-18T20:42:06.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.145+0000 7f2f1e7fc640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f0006ae40 0x7f2f0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.146+0000 7f2f1e7fc640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f0006ae40 0x7f2f0006d300 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2f200a8c70 tx=0x7f2f08008460 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:06.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.149+0000 7f2f177fe640 1 -- 172.21.15.132:0/3772263351 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f10054570 con 0x7f2f200c1500 2023-11-18T20:42:06.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.377+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f200c3e60 con 0x7f2f200c1500 2023-11-18T20:42:06.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.379+0000 7f2f177fe640 1 -- 172.21.15.132:0/3772263351 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f2f1001e090 con 0x7f2f200c1500 2023-11-18T20:42:06.380 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:06.380 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:19.530586+0000","modified":"2023-11-18T20:41:22.840145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/726664783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":726664783},{"type":"v1","addr":"172.21.15.132:6835","nonce":726664783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:34.907589+0000","modified":"2023-11-18T20:41:37.972696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-18T20:42:06.381 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 50 2023-11-18T20:42:06.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f0006ae40 msgr2=0x7f2f0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f0006ae40 0x7f2f0006d300 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2f200a8c70 tx=0x7f2f08008460 comp rx=0 tx=0).stop 2023-11-18T20:42:06.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c1500 msgr2=0x7f2f20071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c1500 0x7f2f20071950 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000c7f0 tx=0x7f2f1000ccb0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 shutdown_connections 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f0006ae40 0x7f2f0006d300 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f20155490 0x7f2f201eb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f200c4080 0x7f2f201eb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 --2- 172.21.15.132:0/3772263351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f200c1500 0x7f2f20071950 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 >> 172.21.15.132:0/3772263351 conn(0x7f2f2006a500 msgr2=0x7f2f201546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 shutdown_connections 2023-11-18T20:42:06.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.382+0000 7f2f25589640 1 -- 172.21.15.132:0/3772263351 wait complete. 2023-11-18T20:42:06.401 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:42:06.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.603+0000 7fdf03fff640 1 Processor -- start 2023-11-18T20:42:06.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.604+0000 7fdf03fff640 1 -- start start 2023-11-18T20:42:06.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.605+0000 7fdf03fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdf0414e7c0 0x7fdf040c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.605+0000 7fdf03fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf041550c0 con 0x7fdf040c4c00 2023-11-18T20:42:06.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.605+0000 7fdf03fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf04158a60 con 0x7fdf04154580 2023-11-18T20:42:06.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.605+0000 7fdf03fff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040c5b10 con 0x7fdf0414e7c0 2023-11-18T20:42:06.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdefa7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdf040c4c00 0x7fdf040ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48118/0 (socket says 172.21.15.132:48118) 2023-11-18T20:42:06.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdefa7fc640 1 -- 172.21.15.132:0/573702532 learned_addr learned my addr 172.21.15.132:0/573702532 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:06.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054615969 0 0) 0x7fdf041550c0 con 0x7fdf040c4c00 2023-11-18T20:42:06.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef0003520 con 0x7fdf040c4c00 2023-11-18T20:42:06.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf02ffd640 1 --2- 172.21.15.132:0/573702532 >> v2:172.21.15.161:3300/0 conn(0x7fdf0414e7c0 0x7fdf040c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2771544927 0 0) 0x7fdef0003520 con 0x7fdf040c4c00 2023-11-18T20:42:06.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 >> v2:172.21.15.161:3300/0 conn(0x7fdf0414e7c0 msgr2=0x7fdf040c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:06.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 --2- 172.21.15.132:0/573702532 >> v2:172.21.15.161:3300/0 conn(0x7fdf0414e7c0 0x7fdf040c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 >> v1:172.21.15.161:6789/0 conn(0x7fdf04154580 legacy=0x7fdf041549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04157ca0 con 0x7fdf040c4c00 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fdeec001670 con 0x7fdf040c4c00 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 >> v1:172.21.15.132:6789/0 conn(0x7fdf040c4c00 legacy=0x7fdf040ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.606+0000 7fdf027fc640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0003970 0x7fdef0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf027fc640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef00047c0 0x7fdef0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf027fc640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdef0005380 0x7fdef000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000c1e0 con 0x7fdef0005380 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000c350 con 0x7fdef00047c0 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000c510 con 0x7fdef0003970 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf037fe640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdef0005380 0x7fdef000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdefa7fc640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef00047c0 0x7fdef0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf02ffd640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0003970 0x7fdef0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf037fe640 1 -- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0003970 msgr2=0x7fdef0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:06.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf037fe640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0003970 0x7fdef0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf037fe640 1 -- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef00047c0 msgr2=0x7fdef0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:06.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf037fe640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef00047c0 0x7fdef0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdf037fe640 1 -- 172.21.15.132:0/573702532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0003520 con 0x7fdef0005380 2023-11-18T20:42:06.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.607+0000 7fdefa7fc640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef00047c0 0x7fdef0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:06.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.608+0000 7fdf02ffd640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0003970 0x7fdef0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:06.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.608+0000 7fdf037fe640 1 -- 172.21.15.132:0/573702532 reap_dead start 2023-11-18T20:42:06.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf037fe640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdef0005380 0x7fdef000b980 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdefc001e50 tx=0x7fdef00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c581505046ae87 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc003b70 con 0x7fdef0005380 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc003cf0 con 0x7fdef0005380 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf027fc640 1 -- 172.21.15.132:0/573702532 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc005310 con 0x7fdef0005380 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf03fff640 1 -- 172.21.15.132:0/573702532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdef0005380 msgr2=0x7fdef000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf03fff640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdef0005380 0x7fdef000b980 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdefc001e50 tx=0x7fdef00057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf03fff640 1 -- 172.21.15.132:0/573702532 shutdown_connections 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf03fff640 1 --2- 172.21.15.132:0/573702532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdef0005380 0x7fdef000b980 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf03fff640 1 -- 172.21.15.132:0/573702532 >> 172.21.15.132:0/573702532 conn(0x7fdf040abf00 msgr2=0x7fdf040c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.609+0000 7fdf03fff640 1 -- 172.21.15.132:0/573702532 shutdown_connections 2023-11-18T20:42:06.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.610+0000 7fdf03fff640 1 -- 172.21.15.132:0/573702532 wait complete. 2023-11-18T20:42:06.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.611+0000 7fdf03fff640 1 Processor -- start 2023-11-18T20:42:06.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.611+0000 7fdf03fff640 1 -- start start 2023-11-18T20:42:06.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.612+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0005380 0x7fdf04145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.612+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0414d8a0 0x7fdf04156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.612+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf041ea630 0x7fdf0414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.612+0000 7fdf03fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0414d530 con 0x7fdf041ea630 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.612+0000 7fdf03fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf041e9940 con 0x7fdf0414d8a0 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.612+0000 7fdf03fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf041ea1a0 con 0x7fdef0005380 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.612+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf041ea630 0x7fdf0414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf041ea630 0x7fdf0414bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35276/0 (socket says 172.21.15.132:35276) 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf037fe640 1 -- 172.21.15.132:0/2056198091 learned_addr learned my addr 172.21.15.132:0/2056198091 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf02ffd640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0005380 0x7fdf04145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdefa7fc640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0414d8a0 0x7fdf04156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf037fe640 1 -- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0005380 msgr2=0x7fdf04145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf037fe640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0005380 0x7fdf04145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf037fe640 1 -- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0414d8a0 msgr2=0x7fdf04156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf037fe640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0414d8a0 0x7fdf04156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf037fe640 1 -- 172.21.15.132:0/2056198091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0414dd30 con 0x7fdf041ea630 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf02ffd640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0005380 0x7fdf04145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf037fe640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf041ea630 0x7fdf0414bfe0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fdefc001f70 tx=0x7fdefc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.613+0000 7fdf00ff9640 1 -- 172.21.15.132:0/2056198091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc006d50 con 0x7fdf041ea630 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.614+0000 7fdf00ff9640 1 -- 172.21.15.132:0/2056198091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc003b80 con 0x7fdf041ea630 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.614+0000 7fdf00ff9640 1 -- 172.21.15.132:0/2056198091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc039680 con 0x7fdf041ea630 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.614+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf041e9b50 con 0x7fdf041ea630 2023-11-18T20:42:06.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.614+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf04145f70 con 0x7fdf041ea630 2023-11-18T20:42:06.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.615+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0404e840 con 0x7fdf041ea630 2023-11-18T20:42:06.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.616+0000 7fdf00ff9640 1 -- 172.21.15.132:0/2056198091 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdefc0397e0 con 0x7fdf041ea630 2023-11-18T20:42:06.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.617+0000 7fdf00ff9640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdee406ae70 0x7fdee406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:06.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.617+0000 7fdf00ff9640 1 -- 172.21.15.132:0/2056198091 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fdefc0ab480 con 0x7fdf041ea630 2023-11-18T20:42:06.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.617+0000 7fdf02ffd640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdee406ae70 0x7fdee406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:06.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.619+0000 7fdf02ffd640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdee406ae70 0x7fdee406d330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdf041eaa70 tx=0x7fdef4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:06.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.621+0000 7fdf00ff9640 1 -- 172.21.15.132:0/2056198091 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdefc076150 con 0x7fdf041ea630 2023-11-18T20:42:06.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.815+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf041ea2e0 con 0x7fdf041ea630 2023-11-18T20:42:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.817+0000 7fdf00ff9640 1 -- 172.21.15.132:0/2056198091 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+20453 (secure 0 0 0) 0x7fdefc003e60 con 0x7fdf041ea630 2023-11-18T20:42:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:06.818 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":82,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:48.564301+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:42:06.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.819+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdee406ae70 msgr2=0x7fdee406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.819+0000 7fdf03fff640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdee406ae70 0x7fdee406d330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdf041eaa70 tx=0x7fdef4008040 comp rx=0 tx=0).stop 2023-11-18T20:42:06.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.819+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf041ea630 msgr2=0x7fdf0414bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:06.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.819+0000 7fdf03fff640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf041ea630 0x7fdf0414bfe0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fdefc001f70 tx=0x7fdefc0014a0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.820+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 shutdown_connections 2023-11-18T20:42:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.820+0000 7fdf03fff640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdee406ae70 0x7fdee406d330 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.820+0000 7fdf03fff640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf041ea630 0x7fdf0414bfe0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.820+0000 7fdf03fff640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0414d8a0 0x7fdf04156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.820+0000 7fdf03fff640 1 --2- 172.21.15.132:0/2056198091 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdef0005380 0x7fdf04145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:06.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.820+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 >> 172.21.15.132:0/2056198091 conn(0x7fdf040abf00 msgr2=0x7fdf040c7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.820+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 shutdown_connections 2023-11-18T20:42:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:06.820+0000 7fdf03fff640 1 -- 172.21.15.132:0/2056198091 wait complete. 2023-11-18T20:42:06.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:41:17.894376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:41:18.520471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:41:33.270522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:41:33.924631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:42:06.839 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:42:07.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.058+0000 7f5d8f1d5640 1 Processor -- start 2023-11-18T20:42:07.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.058+0000 7f5d8f1d5640 1 -- start start 2023-11-18T20:42:07.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.059+0000 7f5d8f1d5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5d8814fd30 0x7f5d88152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.059+0000 7f5d8f1d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d8806d0a0 0x7f5d880a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.059+0000 7f5d8f1d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d880c64a0 con 0x7f5d880a5260 2023-11-18T20:42:07.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.059+0000 7f5d8f1d5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d880c5c00 con 0x7f5d8814fd30 2023-11-18T20:42:07.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.059+0000 7f5d8f1d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880c5ee0 con 0x7f5d8806d0a0 2023-11-18T20:42:07.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.059+0000 7f5d8d772640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5d880a5260 0x7f5d880c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48122/0 (socket says 172.21.15.132:48122) 2023-11-18T20:42:07.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d8d772640 1 -- 172.21.15.132:0/2865976404 learned_addr learned my addr 172.21.15.132:0/2865976404 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:07.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d87fff640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d8806d0a0 0x7f5d880a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d8cf71640 1 --2- 172.21.15.132:0/2865976404 >> v2:172.21.15.161:3300/0 conn(0x7f5d8814fd30 0x7f5d88152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373000045 0 0) 0x7f5d880c64a0 con 0x7f5d880a5260 2023-11-18T20:42:07.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d74003520 con 0x7f5d880a5260 2023-11-18T20:42:07.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3304542446 0 0) 0x7f5d74003520 con 0x7f5d880a5260 2023-11-18T20:42:07.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d8806d0a0 msgr2=0x7f5d880a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d8806d0a0 0x7f5d880a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 >> v2:172.21.15.161:3300/0 conn(0x7f5d8814fd30 msgr2=0x7f5d88152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 --2- 172.21.15.132:0/2865976404 >> v2:172.21.15.161:3300/0 conn(0x7f5d8814fd30 0x7f5d88152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880c61c0 con 0x7f5d880a5260 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f5d80001670 con 0x7f5d880a5260 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 >> v1:172.21.15.132:6789/0 conn(0x7f5d880a5260 legacy=0x7f5d880c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d74003970 0x7f5d74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.060+0000 7f5d877fe640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d8806d0a0 0x7f5d740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d877fe640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d74004d00 0x7f5d74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880c5c00 con 0x7f5d74003970 2023-11-18T20:42:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880c5ee0 con 0x7f5d74004d00 2023-11-18T20:42:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7400b980 con 0x7f5d8806d0a0 2023-11-18T20:42:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d8cf71640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d74003970 0x7f5d74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d8cf71640 1 -- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d8806d0a0 msgr2=0x7f5d740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d8cf71640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d8806d0a0 0x7f5d740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d8cf71640 1 -- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d74004d00 msgr2=0x7f5d74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d8cf71640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d74004d00 0x7f5d74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.061+0000 7f5d8cf71640 1 -- 172.21.15.132:0/2865976404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74003520 con 0x7f5d74003970 2023-11-18T20:42:07.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.062+0000 7f5d8cf71640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d74003970 0x7f5d74003d90 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009fc0 tx=0x7f5d740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea21a2df64153567 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.062+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7802cc60 con 0x7f5d74003970 2023-11-18T20:42:07.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.062+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7800f040 con 0x7f5d74003970 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.063+0000 7f5d877fe640 1 -- 172.21.15.132:0/2865976404 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78034440 con 0x7f5d74003970 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.063+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/2865976404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d74003970 msgr2=0x7f5d74003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.063+0000 7f5d8f1d5640 1 --2- 172.21.15.132:0/2865976404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d74003970 0x7f5d74003d90 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009fc0 tx=0x7f5d740057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.063+0000 7f5d8d772640 1 -- 172.21.15.132:0/2865976404 reap_dead start 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.063+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/2865976404 shutdown_connections 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.063+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/2865976404 >> 172.21.15.132:0/2865976404 conn(0x7f5d8806a500 msgr2=0x7f5d8806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.063+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/2865976404 shutdown_connections 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.063+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/2865976404 wait complete. 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.065+0000 7f5d8f1d5640 1 Processor -- start 2023-11-18T20:42:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.065+0000 7f5d8f1d5640 1 -- start start 2023-11-18T20:42:07.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d8f1d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d74003970 0x7f5d881e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d8f1d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d881e8b00 0x7f5d88155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d8f1d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d88153b80 0x7f5d88156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d8f1d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880bbcd0 con 0x7f5d881e8b00 2023-11-18T20:42:07.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d8f1d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d881539b0 con 0x7f5d88153b80 2023-11-18T20:42:07.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d8f1d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8814f910 con 0x7f5d74003970 2023-11-18T20:42:07.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d87fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d881e8b00 0x7f5d88155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d87fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d881e8b00 0x7f5d88155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35292/0 (socket says 172.21.15.132:35292) 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.066+0000 7f5d87fff640 1 -- 172.21.15.132:0/3370063722 learned_addr learned my addr 172.21.15.132:0/3370063722 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d8cf71640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d74003970 0x7f5d881e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d8d772640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d88153b80 0x7f5d88156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d87fff640 1 -- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d74003970 msgr2=0x7f5d881e85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d87fff640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d74003970 0x7f5d881e85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d87fff640 1 -- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d88153b80 msgr2=0x7f5d88156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d87fff640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d88153b80 0x7f5d88156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d87fff640 1 -- 172.21.15.132:0/3370063722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d881dcb20 con 0x7f5d881e8b00 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d8d772640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d88153b80 0x7f5d88156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d87fff640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d881e8b00 0x7f5d88155dd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000e820 tx=0x7f5d7000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d857fa640 1 -- 172.21.15.132:0/3370063722 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000eed0 con 0x7f5d881e8b00 2023-11-18T20:42:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d857fa640 1 -- 172.21.15.132:0/3370063722 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000c940 con 0x7f5d881e8b00 2023-11-18T20:42:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d857fa640 1 -- 172.21.15.132:0/3370063722 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000ccd0 con 0x7f5d881e8b00 2023-11-18T20:42:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.067+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d88154170 con 0x7f5d881e8b00 2023-11-18T20:42:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.068+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d88156850 con 0x7f5d881e8b00 2023-11-18T20:42:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.069+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8806e2a0 con 0x7f5d881e8b00 2023-11-18T20:42:07.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.070+0000 7f5d857fa640 1 -- 172.21.15.132:0/3370063722 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d70013470 con 0x7f5d881e8b00 2023-11-18T20:42:07.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.070+0000 7f5d857fa640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d6806ae40 0x7f5d6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.071+0000 7f5d857fa640 1 -- 172.21.15.132:0/3370063722 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f5d70089af0 con 0x7f5d881e8b00 2023-11-18T20:42:07.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.071+0000 7f5d8cf71640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d6806ae40 0x7f5d6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.072+0000 7f5d8cf71640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d6806ae40 0x7f5d6806d300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5d78036000 tx=0x7f5d7802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.075+0000 7f5d857fa640 1 -- 172.21.15.132:0/3370063722 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d700547c0 con 0x7f5d881e8b00 2023-11-18T20:42:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.264+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d88068350 con 0x7f5d881e8b00 2023-11-18T20:42:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.265+0000 7f5d857fa640 1 -- 172.21.15.132:0/3370063722 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d70057de0 con 0x7f5d881e8b00 2023-11-18T20:42:07.266 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:42:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.267+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d6806ae40 msgr2=0x7f5d6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.267+0000 7f5d8f1d5640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d6806ae40 0x7f5d6806d300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5d78036000 tx=0x7f5d7802e000 comp rx=0 tx=0).stop 2023-11-18T20:42:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.267+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d881e8b00 msgr2=0x7f5d88155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.267+0000 7f5d8f1d5640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d881e8b00 0x7f5d88155dd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000e820 tx=0x7f5d7000ece0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.267+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 shutdown_connections 2023-11-18T20:42:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.267+0000 7f5d8f1d5640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5d6806ae40 0x7f5d6806d300 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.267+0000 7f5d8f1d5640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d88153b80 0x7f5d88156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.267+0000 7f5d8f1d5640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d881e8b00 0x7f5d88155dd0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.268+0000 7f5d8f1d5640 1 --2- 172.21.15.132:0/3370063722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5d74003970 0x7f5d881e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.268+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 >> 172.21.15.132:0/3370063722 conn(0x7f5d8806a500 msgr2=0x7f5d880a5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.268+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 shutdown_connections 2023-11-18T20:42:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.268+0000 7f5d8f1d5640 1 -- 172.21.15.132:0/3370063722 wait complete. 2023-11-18T20:42:07.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:42:07.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.506+0000 7fcd68c61640 1 Processor -- start 2023-11-18T20:42:07.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.506+0000 7fcd68c61640 1 -- start start 2023-11-18T20:42:07.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.508+0000 7fcd68c61640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd6406f7d0 0x7fcd640a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.508+0000 7fcd68c61640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6414ffd0 con 0x7fcd640a70a0 2023-11-18T20:42:07.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.508+0000 7fcd68c61640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6406df60 con 0x7fcd64153240 2023-11-18T20:42:07.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.508+0000 7fcd68c61640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6406e240 con 0x7fcd6406f7d0 2023-11-18T20:42:07.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.508+0000 7fcd59d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcd640a70a0 0x7fcd640c5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48124/0 (socket says 172.21.15.132:48124) 2023-11-18T20:42:07.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.508+0000 7fcd59d9b640 1 -- 172.21.15.132:0/3128994914 learned_addr learned my addr 172.21.15.132:0/3128994914 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.508+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153270521 0 0) 0x7fcd6414ffd0 con 0x7fcd640a70a0 2023-11-18T20:42:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd50003520 con 0x7fcd640a70a0 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd6259c640 1 --2- 172.21.15.132:0/3128994914 >> v2:172.21.15.161:3300/0 conn(0x7fcd6406f7d0 0x7fcd640a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 752378993 0 0) 0x7fcd50003520 con 0x7fcd640a70a0 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 >> v2:172.21.15.161:3300/0 conn(0x7fcd6406f7d0 msgr2=0x7fcd640a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 --2- 172.21.15.132:0/3128994914 >> v2:172.21.15.161:3300/0 conn(0x7fcd6406f7d0 0x7fcd640a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 >> v1:172.21.15.161:6789/0 conn(0x7fcd64153240 legacy=0x7fcd6415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd64152760 con 0x7fcd640a70a0 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fcd4c001690 con 0x7fcd640a70a0 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 >> v1:172.21.15.132:6789/0 conn(0x7fcd640a70a0 legacy=0x7fcd640c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd500039c0 0x7fcd50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd500052a0 0x7fcd5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6406e240 con 0x7fcd500047c0 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5000c1c0 con 0x7fcd500039c0 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5000c380 con 0x7fcd500052a0 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.509+0000 7fcd59d9b640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.510+0000 7fcd62d9d640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd500052a0 0x7fcd5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.510+0000 7fcd6259c640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd500039c0 0x7fcd50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.510+0000 7fcd59d9b640 1 -- 172.21.15.132:0/3128994914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd500052a0 msgr2=0x7fcd5000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.510+0000 7fcd59d9b640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd500052a0 0x7fcd5000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.510+0000 7fcd59d9b640 1 -- 172.21.15.132:0/3128994914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd500039c0 msgr2=0x7fcd50003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.510+0000 7fcd59d9b640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd500039c0 0x7fcd50003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.510+0000 7fcd59d9b640 1 -- 172.21.15.132:0/3128994914 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50003520 con 0x7fcd500047c0 2023-11-18T20:42:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.510+0000 7fcd62d9d640 1 -- 172.21.15.132:0/3128994914 reap_dead start 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.511+0000 7fcd59d9b640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fcd640a74c0 tx=0x7fcd500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3783658dc8f3c14a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.511+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c005ad0 con 0x7fcd500047c0 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.511+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c005c30 con 0x7fcd500047c0 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.511+0000 7fcd61d9b640 1 -- 172.21.15.132:0/3128994914 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c02c7c0 con 0x7fcd500047c0 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.512+0000 7fcd68c61640 1 -- 172.21.15.132:0/3128994914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd500047c0 msgr2=0x7fcd50004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.512+0000 7fcd68c61640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fcd640a74c0 tx=0x7fcd500057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.512+0000 7fcd68c61640 1 -- 172.21.15.132:0/3128994914 shutdown_connections 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.512+0000 7fcd68c61640 1 --2- 172.21.15.132:0/3128994914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd500047c0 0x7fcd50004c40 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.512+0000 7fcd68c61640 1 -- 172.21.15.132:0/3128994914 >> 172.21.15.132:0/3128994914 conn(0x7fcd640c7e30 msgr2=0x7fcd640c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.512+0000 7fcd68c61640 1 -- 172.21.15.132:0/3128994914 shutdown_connections 2023-11-18T20:42:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.512+0000 7fcd68c61640 1 -- 172.21.15.132:0/3128994914 wait complete. 2023-11-18T20:42:07.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.514+0000 7fcd68c61640 1 Processor -- start 2023-11-18T20:42:07.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.514+0000 7fcd68c61640 1 -- start start 2023-11-18T20:42:07.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd68c61640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd500047c0 0x7fcd641563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd68c61640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6406b610 0x7fcd64154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd68c61640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641dbbb0 0x7fcd641dec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd68c61640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641dc170 con 0x7fcd641dbbb0 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd68c61640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641ea990 con 0x7fcd6406b610 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd68c61640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64156930 con 0x7fcd500047c0 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd62d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641dbbb0 0x7fcd641dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd62d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641dbbb0 0x7fcd641dec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35298/0 (socket says 172.21.15.132:35298) 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd62d9d640 1 -- 172.21.15.132:0/1826119238 learned_addr learned my addr 172.21.15.132:0/1826119238 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd62d9d640 1 -- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd500047c0 msgr2=0x7fcd641563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd62d9d640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd500047c0 0x7fcd641563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd62d9d640 1 -- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6406b610 msgr2=0x7fcd64154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd62d9d640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6406b610 0x7fcd64154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.515+0000 7fcd62d9d640 1 -- 172.21.15.132:0/1826119238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6414f230 con 0x7fcd641dbbb0 2023-11-18T20:42:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.516+0000 7fcd62d9d640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641dbbb0 0x7fcd641dec50 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fcd640a6fc0 tx=0x7fcd5c00d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.516+0000 7fcd5b7fe640 1 -- 172.21.15.132:0/1826119238 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00b070 con 0x7fcd641dbbb0 2023-11-18T20:42:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.516+0000 7fcd5b7fe640 1 -- 172.21.15.132:0/1826119238 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c0054e0 con 0x7fcd641dbbb0 2023-11-18T20:42:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.516+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd641eae80 con 0x7fcd641dbbb0 2023-11-18T20:42:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.516+0000 7fcd5b7fe640 1 -- 172.21.15.132:0/1826119238 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c003830 con 0x7fcd641dbbb0 2023-11-18T20:42:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.516+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd641eaba0 con 0x7fcd641dbbb0 2023-11-18T20:42:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.517+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd640c25a0 con 0x7fcd641dbbb0 2023-11-18T20:42:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.518+0000 7fcd5b7fe640 1 -- 172.21.15.132:0/1826119238 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd5c0039b0 con 0x7fcd641dbbb0 2023-11-18T20:42:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.519+0000 7fcd5b7fe640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd4406ae40 0x7fcd4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.519+0000 7fcd5b7fe640 1 -- 172.21.15.132:0/1826119238 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fcd5c088f10 con 0x7fcd641dbbb0 2023-11-18T20:42:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.520+0000 7fcd6259c640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd4406ae40 0x7fcd4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.521+0000 7fcd6259c640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd4406ae40 0x7fcd4406d300 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcd540094c0 tx=0x7fcd5400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.523+0000 7fcd5b7fe640 1 -- 172.21.15.132:0/1826119238 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd5c053c80 con 0x7fcd641dbbb0 2023-11-18T20:42:07.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.712+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd64068350 con 0x7fcd641dbbb0 2023-11-18T20:42:07.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.713+0000 7fcd5b7fe640 1 -- 172.21.15.132:0/1826119238 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd5c0180a0 con 0x7fcd641dbbb0 2023-11-18T20:42:07.714 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:42:07.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd4406ae40 msgr2=0x7fcd4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd4406ae40 0x7fcd4406d300 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcd540094c0 tx=0x7fcd5400b040 comp rx=0 tx=0).stop 2023-11-18T20:42:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641dbbb0 msgr2=0x7fcd641dec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641dbbb0 0x7fcd641dec50 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fcd640a6fc0 tx=0x7fcd5c00d890 comp rx=0 tx=0).stop 2023-11-18T20:42:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 shutdown_connections 2023-11-18T20:42:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fcd4406ae40 0x7fcd4406d300 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd641dbbb0 0x7fcd641dec50 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6406b610 0x7fcd64154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 --2- 172.21.15.132:0/1826119238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd500047c0 0x7fcd641563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 >> 172.21.15.132:0/1826119238 conn(0x7fcd640c7e30 msgr2=0x7fcd640abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 shutdown_connections 2023-11-18T20:42:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.716+0000 7fcd68c61640 1 -- 172.21.15.132:0/1826119238 wait complete. 2023-11-18T20:42:07.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:42:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.944+0000 7fc6af4a9640 1 Processor -- start 2023-11-18T20:42:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.945+0000 7fc6af4a9640 1 -- start start 2023-11-18T20:42:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.946+0000 7fc6af4a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc6a8155fc0 0x7fc6a8159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.946+0000 7fc6af4a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a80c1ca0 0x7fc6a80c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.946+0000 7fc6af4a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a806d580 con 0x7fc6a8071e30 2023-11-18T20:42:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.946+0000 7fc6af4a9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a806dd60 con 0x7fc6a8155fc0 2023-11-18T20:42:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.946+0000 7fc6af4a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80c6580 con 0x7fc6a80c1ca0 2023-11-18T20:42:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.946+0000 7fc6ada46640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc6a8071e30 0x7fc6a815bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48126/0 (socket says 172.21.15.132:48126) 2023-11-18T20:42:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.946+0000 7fc6ada46640 1 -- 172.21.15.132:0/1129019465 learned_addr learned my addr 172.21.15.132:0/1129019465 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.946+0000 7fc6aca44640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a80c1ca0 0x7fc6a80c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc6ad245640 1 --2- 172.21.15.132:0/1129019465 >> v2:172.21.15.161:3300/0 conn(0x7fc6a8155fc0 0x7fc6a8159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680362173 0 0) 0x7fc6a806d580 con 0x7fc6a8071e30 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc694003520 con 0x7fc6a8071e30 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414704670 0 0) 0x7fc694003520 con 0x7fc6a8071e30 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a80c1ca0 msgr2=0x7fc6a80c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a80c1ca0 0x7fc6a80c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 >> v2:172.21.15.161:3300/0 conn(0x7fc6a8155fc0 msgr2=0x7fc6a8159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 --2- 172.21.15.132:0/1129019465 >> v2:172.21.15.161:3300/0 conn(0x7fc6a8155fc0 0x7fc6a8159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80726d0 con 0x7fc6a8071e30 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fc6a00019f0 con 0x7fc6a8071e30 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 >> v1:172.21.15.132:6789/0 conn(0x7fc6a8071e30 legacy=0x7fc6a815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc694003970 0x7fc694003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6940047c0 0x7fc694004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a80c1ca0 0x7fc694005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a806dd60 con 0x7fc6940047c0 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69400b9b0 con 0x7fc694003970 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69400bb70 con 0x7fc6a80c1ca0 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.947+0000 7fc6aca44640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6940047c0 0x7fc694004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.948+0000 7fc6ada46640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a80c1ca0 0x7fc694005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.948+0000 7fc6aca44640 1 -- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a80c1ca0 msgr2=0x7fc694005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.948+0000 7fc6aca44640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a80c1ca0 0x7fc694005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.948+0000 7fc6aca44640 1 -- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc694003970 msgr2=0x7fc694003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.948+0000 7fc6aca44640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc694003970 0x7fc694003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.948+0000 7fc6aca44640 1 -- 172.21.15.132:0/1129019465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694003520 con 0x7fc6940047c0 2023-11-18T20:42:07.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.949+0000 7fc6aca44640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6940047c0 0x7fc694004c40 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc698009a90 tx=0x7fc6940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc95b7432012593d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.949+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69802c680 con 0x7fc6940047c0 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.949+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69802c7e0 con 0x7fc6940047c0 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.949+0000 7fc69ffff640 1 -- 172.21.15.132:0/1129019465 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69802cb90 con 0x7fc6940047c0 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.950+0000 7fc6af4a9640 1 -- 172.21.15.132:0/1129019465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6940047c0 msgr2=0x7fc694004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.950+0000 7fc6af4a9640 1 --2- 172.21.15.132:0/1129019465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6940047c0 0x7fc694004c40 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc698009a90 tx=0x7fc6940057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.950+0000 7fc6ada46640 1 -- 172.21.15.132:0/1129019465 reap_dead start 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.950+0000 7fc6af4a9640 1 -- 172.21.15.132:0/1129019465 shutdown_connections 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.950+0000 7fc6af4a9640 1 -- 172.21.15.132:0/1129019465 >> 172.21.15.132:0/1129019465 conn(0x7fc6a806a500 msgr2=0x7fc6a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.950+0000 7fc6af4a9640 1 -- 172.21.15.132:0/1129019465 shutdown_connections 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.950+0000 7fc6af4a9640 1 -- 172.21.15.132:0/1129019465 wait complete. 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.952+0000 7fc6af4a9640 1 Processor -- start 2023-11-18T20:42:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.952+0000 7fc6af4a9640 1 -- start start 2023-11-18T20:42:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6af4a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6940047c0 0x7fc6a815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6af4a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6a80a50c0 0x7fc6a8152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6af4a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a815cb40 0x7fc6a81527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6af4a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80bbd30 con 0x7fc6a80a50c0 2023-11-18T20:42:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6af4a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a81f1cb0 con 0x7fc6940047c0 2023-11-18T20:42:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6af4a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a81f13c0 con 0x7fc6a815cb40 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6aca44640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6a80a50c0 0x7fc6a8152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6aca44640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6a80a50c0 0x7fc6a8152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35320/0 (socket says 172.21.15.132:35320) 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6aca44640 1 -- 172.21.15.132:0/316414013 learned_addr learned my addr 172.21.15.132:0/316414013 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6aca44640 1 -- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a815cb40 msgr2=0x7fc6a81527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6aca44640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a815cb40 0x7fc6a81527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6aca44640 1 -- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6940047c0 msgr2=0x7fc6a815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6aca44640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6940047c0 0x7fc6a815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.953+0000 7fc6aca44640 1 -- 172.21.15.132:0/316414013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a81f1660 con 0x7fc6a80a50c0 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.954+0000 7fc6aca44640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6a80a50c0 0x7fc6a8152280 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fc698009bb0 tx=0x7fc698004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.954+0000 7fc69dffb640 1 -- 172.21.15.132:0/316414013 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698034a10 con 0x7fc6a80a50c0 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.954+0000 7fc69dffb640 1 -- 172.21.15.132:0/316414013 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698034b90 con 0x7fc6a80a50c0 2023-11-18T20:42:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.954+0000 7fc69dffb640 1 -- 172.21.15.132:0/316414013 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69803e400 con 0x7fc6a80a50c0 2023-11-18T20:42:07.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.954+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a81f1940 con 0x7fc6a80a50c0 2023-11-18T20:42:07.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.954+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a815c590 con 0x7fc6a80a50c0 2023-11-18T20:42:07.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.955+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a81f1b00 con 0x7fc6a80a50c0 2023-11-18T20:42:07.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.956+0000 7fc69dffb640 1 -- 172.21.15.132:0/316414013 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc69803e560 con 0x7fc6a80a50c0 2023-11-18T20:42:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.957+0000 7fc69dffb640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc68c06ae40 0x7fc68c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.957+0000 7fc69dffb640 1 -- 172.21.15.132:0/316414013 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fc6980ab8f0 con 0x7fc6a80a50c0 2023-11-18T20:42:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.958+0000 7fc6ad245640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc68c06ae40 0x7fc68c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.959+0000 7fc6ad245640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc68c06ae40 0x7fc68c06d300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4006e80 tx=0x7fc6a4006dd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:07.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:07.962+0000 7fc69dffb640 1 -- 172.21.15.132:0/316414013 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6980765e0 con 0x7fc6a80a50c0 2023-11-18T20:42:08.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.157+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6a8068350 con 0x7fc6a80a50c0 2023-11-18T20:42:08.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.158+0000 7fc69dffb640 1 -- 172.21.15.132:0/316414013 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc698079c00 con 0x7fc6a80a50c0 2023-11-18T20:42:08.159 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc68c06ae40 msgr2=0x7fc68c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc68c06ae40 0x7fc68c06d300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4006e80 tx=0x7fc6a4006dd0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6a80a50c0 msgr2=0x7fc6a8152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6a80a50c0 0x7fc6a8152280 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fc698009bb0 tx=0x7fc698004730 comp rx=0 tx=0).stop 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 shutdown_connections 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fc68c06ae40 0x7fc68c06d300 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6a815cb40 0x7fc6a81527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6a80a50c0 0x7fc6a8152280 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 --2- 172.21.15.132:0/316414013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6940047c0 0x7fc6a815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 >> 172.21.15.132:0/316414013 conn(0x7fc6a806a500 msgr2=0x7fc6a80c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 shutdown_connections 2023-11-18T20:42:08.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.160+0000 7fc6af4a9640 1 -- 172.21.15.132:0/316414013 wait complete. 2023-11-18T20:42:08.181 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:42:08.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.398+0000 7feea5fe2640 1 Processor -- start 2023-11-18T20:42:08.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.398+0000 7feea5fe2640 1 -- start start 2023-11-18T20:42:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.399+0000 7feea5fe2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea006e000 0x7feea00c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.399+0000 7feea5fe2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feea00c1100 0x7feea00c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.399+0000 7feea5fe2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea0159800 con 0x7feea0155f60 2023-11-18T20:42:08.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.399+0000 7feea5fe2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea006c440 con 0x7feea00c1100 2023-11-18T20:42:08.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.399+0000 7feea5fe2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea0156340 con 0x7feea006e000 2023-11-18T20:42:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.400+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea006e000 0x7feea00c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.400+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea006e000 0x7feea00c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:35468/0 (socket says 172.21.15.132:35468) 2023-11-18T20:42:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.400+0000 7fee9ffff640 1 -- 172.21.15.132:0/2161931794 learned_addr learned my addr 172.21.15.132:0/2161931794 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.400+0000 7feea57e1640 1 --2- 172.21.15.132:0/2161931794 >> v2:172.21.15.161:3300/0 conn(0x7feea00c1100 0x7feea00c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.401+0000 7fee9ffff640 1 -- 172.21.15.132:0/2161931794 >> v2:172.21.15.161:3300/0 conn(0x7feea00c1100 msgr2=0x7feea00c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.401+0000 7fee9ffff640 1 --2- 172.21.15.132:0/2161931794 >> v2:172.21.15.161:3300/0 conn(0x7feea00c1100 0x7feea00c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.401+0000 7fee9ffff640 1 -- 172.21.15.132:0/2161931794 >> v1:172.21.15.161:6789/0 conn(0x7feea0155f60 legacy=0x7feea00c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.401+0000 7fee9ffff640 1 -- 172.21.15.132:0/2161931794 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0158a40 con 0x7feea006e000 2023-11-18T20:42:08.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.402+0000 7fee9ffff640 1 --2- 172.21.15.132:0/2161931794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea006e000 0x7feea00c3940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee90009870 tx=0x7fee9002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0bbf671c5755c06 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:08.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.402+0000 7fee9f7fe640 1 -- 172.21.15.132:0/2161931794 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90030840 con 0x7feea006e000 2023-11-18T20:42:08.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.402+0000 7fee9f7fe640 1 -- 172.21.15.132:0/2161931794 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee900309a0 con 0x7feea006e000 2023-11-18T20:42:08.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.402+0000 7fee9f7fe640 1 -- 172.21.15.132:0/2161931794 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90030d30 con 0x7feea006e000 2023-11-18T20:42:08.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.403+0000 7feea5fe2640 1 -- 172.21.15.132:0/2161931794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea006e000 msgr2=0x7feea00c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.403+0000 7feea5fe2640 1 --2- 172.21.15.132:0/2161931794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea006e000 0x7feea00c3940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee90009870 tx=0x7fee9002b980 comp rx=0 tx=0).stop 2023-11-18T20:42:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.403+0000 7feea5fe2640 1 -- 172.21.15.132:0/2161931794 shutdown_connections 2023-11-18T20:42:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.403+0000 7feea5fe2640 1 --2- 172.21.15.132:0/2161931794 >> v2:172.21.15.161:3300/0 conn(0x7feea00c1100 0x7feea00c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.403+0000 7feea5fe2640 1 --2- 172.21.15.132:0/2161931794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea006e000 0x7feea00c3940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.403+0000 7feea5fe2640 1 -- 172.21.15.132:0/2161931794 >> 172.21.15.132:0/2161931794 conn(0x7feea00a77f0 msgr2=0x7feea00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.403+0000 7feea5fe2640 1 -- 172.21.15.132:0/2161931794 shutdown_connections 2023-11-18T20:42:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.403+0000 7feea5fe2640 1 -- 172.21.15.132:0/2161931794 wait complete. 2023-11-18T20:42:08.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.405+0000 7feea5fe2640 1 Processor -- start 2023-11-18T20:42:08.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.405+0000 7feea5fe2640 1 -- start start 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7feea5fe2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feea006e000 0x7feea01520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7feea5fe2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feea00c1100 0x7feea00716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7feea5fe2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea0155f60 0x7feea00a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7feea5fe2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea015ba50 con 0x7feea00c1100 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7feea5fe2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea015c1c0 con 0x7feea006e000 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7feea5fe2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea0152620 con 0x7feea0155f60 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feea00c1100 0x7feea00716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feea00c1100 0x7feea00716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35324/0 (socket says 172.21.15.132:35324) 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.406+0000 7fee9ffff640 1 -- 172.21.15.132:0/934104655 learned_addr learned my addr 172.21.15.132:0/934104655 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7feea57e1640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea0155f60 0x7feea00a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7feea4fe0640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feea006e000 0x7feea01520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7fee9ffff640 1 -- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea0155f60 msgr2=0x7feea00a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7fee9ffff640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea0155f60 0x7feea00a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7fee9ffff640 1 -- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feea006e000 msgr2=0x7feea01520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7fee9ffff640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feea006e000 0x7feea01520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7fee9ffff640 1 -- 172.21.15.132:0/934104655 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900094d0 con 0x7feea00c1100 2023-11-18T20:42:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7feea57e1640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea0155f60 0x7feea00a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7feea4fe0640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feea006e000 0x7feea01520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:08.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7fee9ffff640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feea00c1100 0x7feea00716b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fee90000c00 tx=0x7fee90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:08.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7fee9d7fa640 1 -- 172.21.15.132:0/934104655 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90039c90 con 0x7feea00c1100 2023-11-18T20:42:08.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.407+0000 7fee9d7fa640 1 -- 172.21.15.132:0/934104655 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee90039df0 con 0x7feea00c1100 2023-11-18T20:42:08.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.408+0000 7fee9d7fa640 1 -- 172.21.15.132:0/934104655 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90043640 con 0x7feea00c1100 2023-11-18T20:42:08.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.408+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea0151e00 con 0x7feea00c1100 2023-11-18T20:42:08.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.408+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea01f21a0 con 0x7feea00c1100 2023-11-18T20:42:08.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.409+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea004e840 con 0x7feea00c1100 2023-11-18T20:42:08.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.410+0000 7fee9d7fa640 1 -- 172.21.15.132:0/934104655 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee900437a0 con 0x7feea00c1100 2023-11-18T20:42:08.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.411+0000 7fee9d7fa640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8c06ae70 0x7fee8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.411+0000 7fee9d7fa640 1 -- 172.21.15.132:0/934104655 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fee9003e070 con 0x7feea00c1100 2023-11-18T20:42:08.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.411+0000 7feea4fe0640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8c06ae70 0x7fee8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.413+0000 7feea4fe0640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8c06ae70 0x7fee8c06d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fee94000f60 tx=0x7fee94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:08.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.417+0000 7fee9d7fa640 1 -- 172.21.15.132:0/934104655 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee900776e0 con 0x7feea00c1100 2023-11-18T20:42:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.609+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7feea00c5750 con 0x7feea00c1100 2023-11-18T20:42:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.610+0000 7fee9d7fa640 1 -- 172.21.15.132:0/934104655 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v82) v1 ==== 105+0+11 (secure 0 0 0) 0x7fee9007ad00 con 0x7feea00c1100 2023-11-18T20:42:08.612 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:42:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8c06ae70 msgr2=0x7fee8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8c06ae70 0x7fee8c06d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fee94000f60 tx=0x7fee94009040 comp rx=0 tx=0).stop 2023-11-18T20:42:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feea00c1100 msgr2=0x7feea00716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feea00c1100 0x7feea00716b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fee90000c00 tx=0x7fee90004730 comp rx=0 tx=0).stop 2023-11-18T20:42:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 shutdown_connections 2023-11-18T20:42:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fee8c06ae70 0x7fee8c06d330 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feea0155f60 0x7feea00a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feea00c1100 0x7feea00716b0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 --2- 172.21.15.132:0/934104655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feea006e000 0x7feea01520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 >> 172.21.15.132:0/934104655 conn(0x7feea00a77f0 msgr2=0x7feea00a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 shutdown_connections 2023-11-18T20:42:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.613+0000 7feea5fe2640 1 -- 172.21.15.132:0/934104655 wait complete. 2023-11-18T20:42:08.633 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:42:08.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.844+0000 7f55171ff640 1 Processor -- start 2023-11-18T20:42:08.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.844+0000 7f55171ff640 1 -- start start 2023-11-18T20:42:08.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55171ff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100a61d0 0x7f551006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55171ff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f55100c1550 0x7f5510148840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55171ff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55100c2ca0 0x7f5510148d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55171ff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5510152cd0 con 0x7f55100c1550 2023-11-18T20:42:08.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55171ff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55100a65b0 con 0x7f55100c2ca0 2023-11-18T20:42:08.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55171ff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55100c31f0 con 0x7f55100a61d0 2023-11-18T20:42:08.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55159fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f55100c1550 0x7f5510148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55159fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f55100c1550 0x7f5510148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50570/0 (socket says 172.21.15.132:50570) 2023-11-18T20:42:08.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55159fc640 1 -- 172.21.15.132:0/2224628069 learned_addr learned my addr 172.21.15.132:0/2224628069 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:08.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.846+0000 7f55161fd640 1 --2- 172.21.15.132:0/2224628069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100a61d0 0x7f551006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.847+0000 7f55169fe640 1 --2- 172.21.15.132:0/2224628069 >> v2:172.21.15.161:3300/0 conn(0x7f55100c2ca0 0x7f5510148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.847+0000 7f55159fc640 1 -- 172.21.15.132:0/2224628069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100a61d0 msgr2=0x7f551006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:08.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.847+0000 7f55159fc640 1 --2- 172.21.15.132:0/2224628069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100a61d0 0x7f551006a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.847+0000 7f55159fc640 1 -- 172.21.15.132:0/2224628069 >> v2:172.21.15.161:3300/0 conn(0x7f55100c2ca0 msgr2=0x7f5510148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:08.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.847+0000 7f55159fc640 1 --2- 172.21.15.132:0/2224628069 >> v2:172.21.15.161:3300/0 conn(0x7f55100c2ca0 0x7f5510148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.847+0000 7f55159fc640 1 -- 172.21.15.132:0/2224628069 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510152680 con 0x7f55100c1550 2023-11-18T20:42:08.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.847+0000 7f55169fe640 1 --2- 172.21.15.132:0/2224628069 >> v2:172.21.15.161:3300/0 conn(0x7f55100c2ca0 0x7f5510148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:08.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.848+0000 7f55159fc640 1 --2- 172.21.15.132:0/2224628069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100c1550 0x7f5510148840 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f55100ace30 tx=0x7f550002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e646602893b21d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:08.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.848+0000 7f55151fb640 1 -- 172.21.15.132:0/2224628069 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500031880 con 0x7f55100c1550 2023-11-18T20:42:08.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.848+0000 7f55151fb640 1 -- 172.21.15.132:0/2224628069 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55000319e0 con 0x7f55100c1550 2023-11-18T20:42:08.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.848+0000 7f55151fb640 1 -- 172.21.15.132:0/2224628069 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500031d70 con 0x7f55100c1550 2023-11-18T20:42:08.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 -- 172.21.15.132:0/2224628069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100c1550 msgr2=0x7f5510148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 --2- 172.21.15.132:0/2224628069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100c1550 0x7f5510148840 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f55100ace30 tx=0x7f550002b920 comp rx=0 tx=0).stop 2023-11-18T20:42:08.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 -- 172.21.15.132:0/2224628069 shutdown_connections 2023-11-18T20:42:08.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 --2- 172.21.15.132:0/2224628069 >> v2:172.21.15.161:3300/0 conn(0x7f55100c2ca0 0x7f5510148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 --2- 172.21.15.132:0/2224628069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100c1550 0x7f5510148840 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 --2- 172.21.15.132:0/2224628069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100a61d0 0x7f551006a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 -- 172.21.15.132:0/2224628069 >> 172.21.15.132:0/2224628069 conn(0x7f55100a8870 msgr2=0x7f55100a8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:08.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 -- 172.21.15.132:0/2224628069 shutdown_connections 2023-11-18T20:42:08.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.849+0000 7f55171ff640 1 -- 172.21.15.132:0/2224628069 wait complete. 2023-11-18T20:42:08.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.851+0000 7f55171ff640 1 Processor -- start 2023-11-18T20:42:08.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.851+0000 7f55171ff640 1 -- start start 2023-11-18T20:42:08.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55171ff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100a61d0 0x7f55101dca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55171ff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100c1550 0x7f55100a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55171ff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100c2ca0 0x7f551006d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55171ff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55100bc1a0 con 0x7f55100a61d0 2023-11-18T20:42:08.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55171ff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101566d0 con 0x7f55100c2ca0 2023-11-18T20:42:08.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55171ff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55100bc500 con 0x7f55100c1550 2023-11-18T20:42:08.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55161fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100a61d0 0x7f55101dca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55161fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100a61d0 0x7f55101dca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50584/0 (socket says 172.21.15.132:50584) 2023-11-18T20:42:08.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.852+0000 7f55161fd640 1 -- 172.21.15.132:0/4278639686 learned_addr learned my addr 172.21.15.132:0/4278639686 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:08.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f55161fd640 1 -- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100c1550 msgr2=0x7f55100a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f55161fd640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100c1550 0x7f55100a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f55169fe640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100c2ca0 0x7f551006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f55161fd640 1 -- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100c2ca0 msgr2=0x7f551006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:08.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f55161fd640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100c2ca0 0x7f551006d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:08.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f55161fd640 1 -- 172.21.15.132:0/4278639686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000094d0 con 0x7f55100a61d0 2023-11-18T20:42:08.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f55161fd640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100a61d0 0x7f55101dca60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f550c00d830 tx=0x7f550c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:08.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f5506ffd640 1 -- 172.21.15.132:0/4278639686 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c009640 con 0x7f55100a61d0 2023-11-18T20:42:08.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f5506ffd640 1 -- 172.21.15.132:0/4278639686 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c0097a0 con 0x7f55100a61d0 2023-11-18T20:42:08.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f5506ffd640 1 -- 172.21.15.132:0/4278639686 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c009b30 con 0x7f55100a61d0 2023-11-18T20:42:08.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.853+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55100bc7a0 con 0x7f55100a61d0 2023-11-18T20:42:08.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.854+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55101dcfa0 con 0x7f55100a61d0 2023-11-18T20:42:08.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.855+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551006de20 con 0x7f55100a61d0 2023-11-18T20:42:08.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.856+0000 7f5506ffd640 1 -- 172.21.15.132:0/4278639686 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f550c014410 con 0x7f55100a61d0 2023-11-18T20:42:08.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.856+0000 7f5506ffd640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f54f406ae70 0x7f54f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:08.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.857+0000 7f5506ffd640 1 -- 172.21.15.132:0/4278639686 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f550c089fe0 con 0x7f55100a61d0 2023-11-18T20:42:08.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.857+0000 7f55159fc640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f54f406ae70 0x7f54f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:08.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.858+0000 7f55159fc640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f54f406ae70 0x7f54f406d330 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5500036000 tx=0x7f5500030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:08.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:08.861+0000 7f5506ffd640 1 -- 172.21.15.132:0/4278639686 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f550c054d10 con 0x7f55100a61d0 2023-11-18T20:42:09.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.041+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f551004e840 con 0x7f55100a61d0 2023-11-18T20:42:09.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.042+0000 7f5506ffd640 1 -- 172.21.15.132:0/4278639686 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v82) v1 ==== 101+0+11 (secure 0 0 0) 0x7f550c058330 con 0x7f55100a61d0 2023-11-18T20:42:09.043 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:42:09.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f54f406ae70 msgr2=0x7f54f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f54f406ae70 0x7f54f406d330 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5500036000 tx=0x7f5500030000 comp rx=0 tx=0).stop 2023-11-18T20:42:09.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100a61d0 msgr2=0x7f55101dca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100a61d0 0x7f55101dca60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f550c00d830 tx=0x7f550c00dcf0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 shutdown_connections 2023-11-18T20:42:09.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f54f406ae70 0x7f54f406d330 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100c2ca0 0x7f551006d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55100c1550 0x7f55100a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 --2- 172.21.15.132:0/4278639686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55100a61d0 0x7f55101dca60 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 >> 172.21.15.132:0/4278639686 conn(0x7f55100a8870 msgr2=0x7f55100c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:09.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.044+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 shutdown_connections 2023-11-18T20:42:09.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.045+0000 7f55171ff640 1 -- 172.21.15.132:0/4278639686 wait complete. 2023-11-18T20:42:09.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:42:09.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.275+0000 7f85a086f640 1 Processor -- start 2023-11-18T20:42:09.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.276+0000 7f85a086f640 1 -- start start 2023-11-18T20:42:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.277+0000 7f85a086f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f859c0a9b40 0x7f859c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.277+0000 7f85a086f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f859c0c1500 0x7f859c0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.277+0000 7f85a086f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859c0c06c0 con 0x7f859c155490 2023-11-18T20:42:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.277+0000 7f85a086f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859c0a5820 con 0x7f859c0c1500 2023-11-18T20:42:09.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.277+0000 7f85a086f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859c0c1020 con 0x7f859c0a9b40 2023-11-18T20:42:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.277+0000 7f859ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f859c0c1500 0x7f859c0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.277+0000 7f859ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f859c0c1500 0x7f859c0c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50586/0 (socket says 172.21.15.132:50586) 2023-11-18T20:42:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.277+0000 7f859ad9d640 1 -- 172.21.15.132:0/3815141228 learned_addr learned my addr 172.21.15.132:0/3815141228 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:09.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.278+0000 7f8591d9b640 1 --2- 172.21.15.132:0/3815141228 >> v2:172.21.15.161:3300/0 conn(0x7f859c0a9b40 0x7f859c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.278+0000 7f859ad9d640 1 -- 172.21.15.132:0/3815141228 >> v2:172.21.15.161:3300/0 conn(0x7f859c0a9b40 msgr2=0x7f859c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.278+0000 7f859ad9d640 1 --2- 172.21.15.132:0/3815141228 >> v2:172.21.15.161:3300/0 conn(0x7f859c0a9b40 0x7f859c0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.278+0000 7f859ad9d640 1 -- 172.21.15.132:0/3815141228 >> v1:172.21.15.161:6789/0 conn(0x7f859c155490 legacy=0x7f859c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.278+0000 7f859ad9d640 1 -- 172.21.15.132:0/3815141228 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c0c0910 con 0x7f859c0c1500 2023-11-18T20:42:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.278+0000 7f8591d9b640 1 --2- 172.21.15.132:0/3815141228 >> v2:172.21.15.161:3300/0 conn(0x7f859c0a9b40 0x7f859c0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.279+0000 7f859ad9d640 1 --2- 172.21.15.132:0/3815141228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c0c1500 0x7f859c0c24d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f859c0a5160 tx=0x7f859402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87abb3671471e77b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:09.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.279+0000 7f8599d9b640 1 -- 172.21.15.132:0/3815141228 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859402ee90 con 0x7f859c0c1500 2023-11-18T20:42:09.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.279+0000 7f8599d9b640 1 -- 172.21.15.132:0/3815141228 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594036440 con 0x7f859c0c1500 2023-11-18T20:42:09.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.279+0000 7f8599d9b640 1 -- 172.21.15.132:0/3815141228 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940367d0 con 0x7f859c0c1500 2023-11-18T20:42:09.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.280+0000 7f85a086f640 1 -- 172.21.15.132:0/3815141228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c0c1500 msgr2=0x7f859c0c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.280+0000 7f85a086f640 1 --2- 172.21.15.132:0/3815141228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c0c1500 0x7f859c0c24d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f859c0a5160 tx=0x7f859402e0e0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.280+0000 7f85a086f640 1 -- 172.21.15.132:0/3815141228 shutdown_connections 2023-11-18T20:42:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.280+0000 7f85a086f640 1 --2- 172.21.15.132:0/3815141228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c0c1500 0x7f859c0c24d0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.280+0000 7f85a086f640 1 --2- 172.21.15.132:0/3815141228 >> v2:172.21.15.161:3300/0 conn(0x7f859c0a9b40 0x7f859c0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.280+0000 7f85a086f640 1 -- 172.21.15.132:0/3815141228 >> 172.21.15.132:0/3815141228 conn(0x7f859c06a500 msgr2=0x7f859c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.280+0000 7f85a086f640 1 -- 172.21.15.132:0/3815141228 shutdown_connections 2023-11-18T20:42:09.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.280+0000 7f85a086f640 1 -- 172.21.15.132:0/3815141228 wait complete. 2023-11-18T20:42:09.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.282+0000 7f85a086f640 1 Processor -- start 2023-11-18T20:42:09.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.282+0000 7f85a086f640 1 -- start start 2023-11-18T20:42:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f85a086f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f859c0c1500 0x7f859c0bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f85a086f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c155490 0x7f859c1ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f85a086f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f859c1e9d40 0x7f859c1edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f85a086f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c1ed320 con 0x7f859c155490 2023-11-18T20:42:09.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f85a086f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c1ee1c0 con 0x7f859c1e9d40 2023-11-18T20:42:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f85a086f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859c1ea2b0 con 0x7f859c0c1500 2023-11-18T20:42:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f8591d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c155490 0x7f859c1ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f8591d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c155490 0x7f859c1ed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50588/0 (socket says 172.21.15.132:50588) 2023-11-18T20:42:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.283+0000 7f8591d9b640 1 -- 172.21.15.132:0/1627045600 learned_addr learned my addr 172.21.15.132:0/1627045600 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f859a59c640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f859c0c1500 0x7f859c0bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f859ad9d640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f859c1e9d40 0x7f859c1edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f8591d9b640 1 -- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f859c0c1500 msgr2=0x7f859c0bfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f8591d9b640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f859c0c1500 0x7f859c0bfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f8591d9b640 1 -- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f859c1e9d40 msgr2=0x7f859c1edc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f8591d9b640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f859c1e9d40 0x7f859c1edc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f8591d9b640 1 -- 172.21.15.132:0/1627045600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859400b770 con 0x7f859c155490 2023-11-18T20:42:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f859a59c640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f859c0c1500 0x7f859c0bfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f8591d9b640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c155490 0x7f859c1ed740 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f858400c7f0 tx=0x7f858400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f85937fe640 1 -- 172.21.15.132:0/1627045600 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584007a30 con 0x7f859c155490 2023-11-18T20:42:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f85937fe640 1 -- 172.21.15.132:0/1627045600 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8584007b90 con 0x7f859c155490 2023-11-18T20:42:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f85937fe640 1 -- 172.21.15.132:0/1627045600 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858400ce40 con 0x7f859c155490 2023-11-18T20:42:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.284+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c1ea590 con 0x7f859c155490 2023-11-18T20:42:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.285+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859c1eab50 con 0x7f859c155490 2023-11-18T20:42:09.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.286+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859c1ed460 con 0x7f859c155490 2023-11-18T20:42:09.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.287+0000 7f85937fe640 1 -- 172.21.15.132:0/1627045600 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85840113f0 con 0x7f859c155490 2023-11-18T20:42:09.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.287+0000 7f85937fe640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f857c06ae70 0x7f857c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.288+0000 7f85937fe640 1 -- 172.21.15.132:0/1627045600 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f8584089ac0 con 0x7f859c155490 2023-11-18T20:42:09.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.288+0000 7f859a59c640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f857c06ae70 0x7f857c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.289+0000 7f859a59c640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f857c06ae70 0x7f857c06d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f859c0c2fd0 tx=0x7f858c0073c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:09.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.292+0000 7f85937fe640 1 -- 172.21.15.132:0/1627045600 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f859c1ed460 con 0x7f859c155490 2023-11-18T20:42:09.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.522+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f859c1ed460 con 0x7f859c155490 2023-11-18T20:42:09.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.523+0000 7f85937fe640 1 -- 172.21.15.132:0/1627045600 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f859c1ed460 con 0x7f859c155490 2023-11-18T20:42:09.524 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:09.525 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:19.530586+0000","modified":"2023-11-18T20:41:22.840145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/726664783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":726664783},{"type":"v1","addr":"172.21.15.132:6835","nonce":726664783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:34.907589+0000","modified":"2023-11-18T20:41:37.972696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-18T20:42:09.525 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 50 2023-11-18T20:42:09.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f857c06ae70 msgr2=0x7f857c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f857c06ae70 0x7f857c06d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f859c0c2fd0 tx=0x7f858c0073c0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c155490 msgr2=0x7f859c1ed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c155490 0x7f859c1ed740 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f858400c7f0 tx=0x7f858400cbf0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 shutdown_connections 2023-11-18T20:42:09.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f857c06ae70 0x7f857c06d330 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f859c1e9d40 0x7f859c1edc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859c155490 0x7f859c1ed740 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 --2- 172.21.15.132:0/1627045600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f859c0c1500 0x7f859c0bfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 >> 172.21.15.132:0/1627045600 conn(0x7f859c06a500 msgr2=0x7f859c0c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:09.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 shutdown_connections 2023-11-18T20:42:09.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.526+0000 7f85a086f640 1 -- 172.21.15.132:0/1627045600 wait complete. 2023-11-18T20:42:09.546 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:42:09.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.752+0000 7f73af59e640 1 Processor -- start 2023-11-18T20:42:09.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.752+0000 7f73af59e640 1 -- start start 2023-11-18T20:42:09.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.753+0000 7f73af59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b014e7f0 0x7f73b00c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.753+0000 7f73af59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f73b006cd20 0x7f73b015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.753+0000 7f73af59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00a8380 con 0x7f73b00c52e0 2023-11-18T20:42:09.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.753+0000 7f73af59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b01510b0 con 0x7f73b006cd20 2023-11-18T20:42:09.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.753+0000 7f73af59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b006bf60 con 0x7f73b014e7f0 2023-11-18T20:42:09.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.753+0000 7f73a7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f73b00c52e0 0x7f73b006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35816/0 (socket says 172.21.15.132:35816) 2023-11-18T20:42:09.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.753+0000 7f73a7fff640 1 -- 172.21.15.132:0/2991565642 learned_addr learned my addr 172.21.15.132:0/2991565642 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792529318 0 0) 0x7f73b00a8380 con 0x7f73b00c52e0 2023-11-18T20:42:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73aed9d640 1 --2- 172.21.15.132:0/2991565642 >> v2:172.21.15.161:3300/0 conn(0x7f73b006cd20 0x7f73b015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f739c003520 con 0x7f73b00c52e0 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73ae59c640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b014e7f0 0x7f73b00c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 527045033 0 0) 0x7f739c003520 con 0x7f73b00c52e0 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b014e7f0 msgr2=0x7f73b00c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b014e7f0 0x7f73b00c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 >> v2:172.21.15.161:3300/0 conn(0x7f73b006cd20 msgr2=0x7f73b015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 --2- 172.21.15.132:0/2991565642 >> v2:172.21.15.161:3300/0 conn(0x7f73b006cd20 0x7f73b015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b006c240 con 0x7f73b00c52e0 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f7398001670 con 0x7f73b00c52e0 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73ae59c640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b014e7f0 0x7f73b00c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 >> v1:172.21.15.132:6789/0 conn(0x7f73b00c52e0 legacy=0x7f73b006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c003970 0x7f739c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f739c0047c0 0x7f739c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b014e7f0 0x7f739c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01510b0 con 0x7f739c0047c0 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.754+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b006bf60 con 0x7f739c003970 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c00ba30 con 0x7f73b014e7f0 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73aed9d640 1 --2- 172.21.15.132:0/2991565642 >> v2:172.21.15.161:3300/0 conn(0x7f73b006cd20 0x7f73b015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73a7fff640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f739c0047c0 0x7f739c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73ae59c640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c003970 0x7f739c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73a7fff640 1 -- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b014e7f0 msgr2=0x7f739c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73a7fff640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b014e7f0 0x7f739c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73a7fff640 1 -- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c003970 msgr2=0x7f739c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73a7fff640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c003970 0x7f739c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.755+0000 7f73a7fff640 1 -- 172.21.15.132:0/2991565642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c003520 con 0x7f739c0047c0 2023-11-18T20:42:09.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.756+0000 7f73a7fff640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f739c0047c0 0x7f739c004c40 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f739800c160 tx=0x7f739c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd05a8a529060ed server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:09.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398005ad0 con 0x7f739c0047c0 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398005c50 con 0x7f739c0047c0 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73add9b640 1 -- 172.21.15.132:0/2991565642 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739802c7c0 con 0x7f739c0047c0 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73af59e640 1 -- 172.21.15.132:0/2991565642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f739c0047c0 msgr2=0x7f739c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73af59e640 1 --2- 172.21.15.132:0/2991565642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f739c0047c0 0x7f739c004c40 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f739800c160 tx=0x7f739c0057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73aed9d640 1 -- 172.21.15.132:0/2991565642 reap_dead start 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73af59e640 1 -- 172.21.15.132:0/2991565642 shutdown_connections 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73af59e640 1 -- 172.21.15.132:0/2991565642 >> 172.21.15.132:0/2991565642 conn(0x7f73b00a77f0 msgr2=0x7f73b00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73af59e640 1 -- 172.21.15.132:0/2991565642 shutdown_connections 2023-11-18T20:42:09.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.757+0000 7f73af59e640 1 -- 172.21.15.132:0/2991565642 wait complete. 2023-11-18T20:42:09.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.759+0000 7f73af59e640 1 Processor -- start 2023-11-18T20:42:09.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.759+0000 7f73af59e640 1 -- start start 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.760+0000 7f73af59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c0047c0 0x7f73b01daab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.760+0000 7f73af59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b0147ea0 0x7f73b014d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.760+0000 7f73af59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73b01e96d0 0x7f73b0146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.760+0000 7f73af59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01dcb30 con 0x7f73b01e96d0 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.760+0000 7f73af59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01e9240 con 0x7f739c0047c0 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.760+0000 7f73af59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0147c50 con 0x7f73b0147ea0 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73b01e96d0 0x7f73b0146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73b01e96d0 0x7f73b0146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50608/0 (socket says 172.21.15.132:50608) 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 -- 172.21.15.132:0/3209271478 learned_addr learned my addr 172.21.15.132:0/3209271478 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73ae59c640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c0047c0 0x7f73b01daab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73a7fff640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b0147ea0 0x7f73b014d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 -- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b0147ea0 msgr2=0x7f73b014d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b0147ea0 0x7f73b014d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 -- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c0047c0 msgr2=0x7f73b01daab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c0047c0 0x7f73b01daab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 -- 172.21.15.132:0/3209271478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00a5ef0 con 0x7f73b01e96d0 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73ae59c640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c0047c0 0x7f73b01daab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73aed9d640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73b01e96d0 0x7f73b0146940 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f73b00a5730 tx=0x7f73a800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.761+0000 7f73a6ffd640 1 -- 172.21.15.132:0/3209271478 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800dd30 con 0x7f73b01e96d0 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.762+0000 7f73a6ffd640 1 -- 172.21.15.132:0/3209271478 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a800f040 con 0x7f73b01e96d0 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.762+0000 7f73a6ffd640 1 -- 172.21.15.132:0/3209271478 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8015640 con 0x7f73b01e96d0 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.762+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b0147970 con 0x7f73b01e96d0 2023-11-18T20:42:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.762+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b014f960 con 0x7f73b01e96d0 2023-11-18T20:42:09.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.763+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b004e840 con 0x7f73b01e96d0 2023-11-18T20:42:09.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.764+0000 7f73a6ffd640 1 -- 172.21.15.132:0/3209271478 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73a801e3b0 con 0x7f73b01e96d0 2023-11-18T20:42:09.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.765+0000 7f73a6ffd640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f739006ae40 0x7f739006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:09.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.765+0000 7f73a6ffd640 1 -- 172.21.15.132:0/3209271478 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f73a80899a0 con 0x7f73b01e96d0 2023-11-18T20:42:09.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.766+0000 7f73ae59c640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f739006ae40 0x7f739006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:09.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.767+0000 7f73ae59c640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f739006ae40 0x7f739006d300 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f73b014f5b0 tx=0x7f73a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:09.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.769+0000 7f73a6ffd640 1 -- 172.21.15.132:0/3209271478 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73a8054670 con 0x7f73b01e96d0 2023-11-18T20:42:09.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.961+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73b00c3c70 con 0x7f73b01e96d0 2023-11-18T20:42:09.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.965+0000 7f73a6ffd640 1 -- 172.21.15.132:0/3209271478 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+20453 (secure 0 0 0) 0x7f73a8057c90 con 0x7f73b01e96d0 2023-11-18T20:42:09.967 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:09.967 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":82,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:48.564301+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:42:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.968+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f739006ae40 msgr2=0x7f739006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.968+0000 7f73af59e640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f739006ae40 0x7f739006d300 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f73b014f5b0 tx=0x7f73a0008040 comp rx=0 tx=0).stop 2023-11-18T20:42:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.968+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73b01e96d0 msgr2=0x7f73b0146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.968+0000 7f73af59e640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73b01e96d0 0x7f73b0146940 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f73b00a5730 tx=0x7f73a800d4a0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.969+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 shutdown_connections 2023-11-18T20:42:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.969+0000 7f73af59e640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f739006ae40 0x7f739006d300 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.969+0000 7f73af59e640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73b01e96d0 0x7f73b0146940 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.969+0000 7f73af59e640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73b0147ea0 0x7f73b014d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.969+0000 7f73af59e640 1 --2- 172.21.15.132:0/3209271478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f739c0047c0 0x7f73b01daab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:09.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.969+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 >> 172.21.15.132:0/3209271478 conn(0x7f73b00a77f0 msgr2=0x7f73b01514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:09.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.969+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 shutdown_connections 2023-11-18T20:42:09.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:09.969+0000 7f73af59e640 1 -- 172.21.15.132:0/3209271478 wait complete. 2023-11-18T20:42:09.989 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-18T20:42:09.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:42:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.191+0000 7effc6d9e640 1 Processor -- start 2023-11-18T20:42:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.192+0000 7effc6d9e640 1 -- start start 2023-11-18T20:42:10.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.193+0000 7effc6d9e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7effc0152f20 0x7effc00c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.193+0000 7effc6d9e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc00c64a0 con 0x7effc014fd30 2023-11-18T20:42:10.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.193+0000 7effc6d9e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc00c5c00 con 0x7effc006d0a0 2023-11-18T20:42:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.193+0000 7effc6d9e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc00c5ee0 con 0x7effc0152f20 2023-11-18T20:42:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.193+0000 7effc4b3a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7effc014fd30 0x7effc00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35818/0 (socket says 172.21.15.132:35818) 2023-11-18T20:42:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.193+0000 7effc4b3a640 1 -- 172.21.15.132:0/3607803559 learned_addr learned my addr 172.21.15.132:0/3607803559 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.194+0000 7effc533b640 1 --2- 172.21.15.132:0/3607803559 >> v2:172.21.15.132:3300/0 conn(0x7effc0152f20 0x7effc00c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.194+0000 7effb77fe640 1 -- 172.21.15.132:0/3607803559 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272692687 0 0) 0x7effc00c64a0 con 0x7effc014fd30 2023-11-18T20:42:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.194+0000 7effb77fe640 1 -- 172.21.15.132:0/3607803559 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa8003520 con 0x7effc014fd30 2023-11-18T20:42:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.194+0000 7effc533b640 1 -- 172.21.15.132:0/3607803559 >> v1:172.21.15.161:6789/0 conn(0x7effc006d0a0 legacy=0x7effc00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.194+0000 7effc533b640 1 -- 172.21.15.132:0/3607803559 >> v1:172.21.15.132:6789/0 conn(0x7effc014fd30 legacy=0x7effc00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.194+0000 7effc533b640 1 -- 172.21.15.132:0/3607803559 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00c61c0 con 0x7effc0152f20 2023-11-18T20:42:10.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.195+0000 7effc533b640 1 --2- 172.21.15.132:0/3607803559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc0152f20 0x7effc00c45b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7effb80097a0 tx=0x7effb802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61807069e8a82740 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effb77fe640 1 -- 172.21.15.132:0/3607803559 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8030610 con 0x7effc0152f20 2023-11-18T20:42:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effb77fe640 1 -- 172.21.15.132:0/3607803559 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8030770 con 0x7effc0152f20 2023-11-18T20:42:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effb77fe640 1 -- 172.21.15.132:0/3607803559 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8030b00 con 0x7effc0152f20 2023-11-18T20:42:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effc6d9e640 1 -- 172.21.15.132:0/3607803559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc0152f20 msgr2=0x7effc00c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effc6d9e640 1 --2- 172.21.15.132:0/3607803559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc0152f20 0x7effc00c45b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7effb80097a0 tx=0x7effb802b960 comp rx=0 tx=0).stop 2023-11-18T20:42:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effc6d9e640 1 -- 172.21.15.132:0/3607803559 shutdown_connections 2023-11-18T20:42:10.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effc6d9e640 1 --2- 172.21.15.132:0/3607803559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc0152f20 0x7effc00c45b0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effc6d9e640 1 -- 172.21.15.132:0/3607803559 >> 172.21.15.132:0/3607803559 conn(0x7effc006a500 msgr2=0x7effc006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:10.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effc6d9e640 1 -- 172.21.15.132:0/3607803559 shutdown_connections 2023-11-18T20:42:10.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.196+0000 7effc6d9e640 1 -- 172.21.15.132:0/3607803559 wait complete. 2023-11-18T20:42:10.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.198+0000 7effc6d9e640 1 Processor -- start 2023-11-18T20:42:10.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.198+0000 7effc6d9e640 1 -- start start 2023-11-18T20:42:10.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.199+0000 7effc6d9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc006d0a0 0x7effc00712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.199+0000 7effc6d9e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc014fd30 0x7effc01ea230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.199+0000 7effc6d9e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0152f20 0x7effc01ea770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.199+0000 7effc6d9e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc0156160 con 0x7effc006d0a0 2023-11-18T20:42:10.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.199+0000 7effc6d9e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc00aaee0 con 0x7effc0152f20 2023-11-18T20:42:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.199+0000 7effc6d9e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc01ed720 con 0x7effc014fd30 2023-11-18T20:42:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc006d0a0 0x7effc00712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc006d0a0 0x7effc00712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50636/0 (socket says 172.21.15.132:50636) 2023-11-18T20:42:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 -- 172.21.15.132:0/173840176 learned_addr learned my addr 172.21.15.132:0/173840176 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effb7fff640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc014fd30 0x7effc01ea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 -- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc014fd30 msgr2=0x7effc01ea230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc014fd30 0x7effc01ea230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 -- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0152f20 msgr2=0x7effc01ea770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0152f20 0x7effc01ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 -- 172.21.15.132:0/173840176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8009400 con 0x7effc006d0a0 2023-11-18T20:42:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.200+0000 7effc4b3a640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc006d0a0 0x7effc00712c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7effbc00cbc0 tx=0x7effbc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:10.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.201+0000 7effb57fa640 1 -- 172.21.15.132:0/173840176 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00ace0 con 0x7effc006d0a0 2023-11-18T20:42:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.201+0000 7effb57fa640 1 -- 172.21.15.132:0/173840176 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc00ae40 con 0x7effc006d0a0 2023-11-18T20:42:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.201+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc01eda00 con 0x7effc006d0a0 2023-11-18T20:42:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.201+0000 7effb57fa640 1 -- 172.21.15.132:0/173840176 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc012600 con 0x7effc006d0a0 2023-11-18T20:42:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.201+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc01edfc0 con 0x7effc006d0a0 2023-11-18T20:42:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.202+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc0068350 con 0x7effc006d0a0 2023-11-18T20:42:10.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.203+0000 7effb57fa640 1 -- 172.21.15.132:0/173840176 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effbc007070 con 0x7effc006d0a0 2023-11-18T20:42:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.204+0000 7effb57fa640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effac06aec0 0x7effac06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.204+0000 7effb57fa640 1 -- 172.21.15.132:0/173840176 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7effbc089780 con 0x7effc006d0a0 2023-11-18T20:42:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.205+0000 7effb7fff640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effac06aec0 0x7effac06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.206+0000 7effb7fff640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effac06aec0 0x7effac06d380 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7effb0000f60 tx=0x7effb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:10.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.208+0000 7effb57fa640 1 -- 172.21.15.132:0/173840176 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effbc054680 con 0x7effc006d0a0 2023-11-18T20:42:10.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.438+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effc006d540 con 0x7effc006d0a0 2023-11-18T20:42:10.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.439+0000 7effb57fa640 1 -- 172.21.15.132:0/173840176 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+6137 (secure 0 0 0) 0x7effbc017090 con 0x7effc006d0a0 2023-11-18T20:42:10.441 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:10.441 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:19.530586+0000","modified":"2023-11-18T20:41:22.840145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/726664783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":726664783},{"type":"v1","addr":"172.21.15.132:6835","nonce":726664783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:34.907589+0000","modified":"2023-11-18T20:41:37.972696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-18T20:42:10.441 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 50 2023-11-18T20:42:10.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effac06aec0 msgr2=0x7effac06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effac06aec0 0x7effac06d380 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7effb0000f60 tx=0x7effb0009040 comp rx=0 tx=0).stop 2023-11-18T20:42:10.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc006d0a0 msgr2=0x7effc00712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc006d0a0 0x7effc00712c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7effbc00cbc0 tx=0x7effbc00a430 comp rx=0 tx=0).stop 2023-11-18T20:42:10.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 shutdown_connections 2023-11-18T20:42:10.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7effac06aec0 0x7effac06d380 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0152f20 0x7effc01ea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effc014fd30 0x7effc01ea230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 --2- 172.21.15.132:0/173840176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effc006d0a0 0x7effc00712c0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 >> 172.21.15.132:0/173840176 conn(0x7effc006a500 msgr2=0x7effc00c30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:10.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 shutdown_connections 2023-11-18T20:42:10.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.442+0000 7effc6d9e640 1 -- 172.21.15.132:0/173840176 wait complete. 2023-11-18T20:42:10.461 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:42:10.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.673+0000 7f34b2a1a640 1 Processor -- start 2023-11-18T20:42:10.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.673+0000 7f34b2a1a640 1 -- start start 2023-11-18T20:42:10.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b2a1a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac14e7f0 0x7f34ac0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b2a1a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f34ac0c52e0 0x7f34ac06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b2a1a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0a8380 con 0x7f34ac06cd20 2023-11-18T20:42:10.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b2a1a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac1510b0 con 0x7f34ac0c52e0 2023-11-18T20:42:10.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b2a1a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac06bf60 con 0x7f34ac14e7f0 2023-11-18T20:42:10.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b2219640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f34ac06cd20 0x7f34ac1546a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35832/0 (socket says 172.21.15.132:35832) 2023-11-18T20:42:10.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b2219640 1 -- 172.21.15.132:0/2961413240 learned_addr learned my addr 172.21.15.132:0/2961413240 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:10.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b1a18640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac14e7f0 0x7f34ac0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b1217640 1 --2- 172.21.15.132:0/2961413240 >> v2:172.21.15.161:3300/0 conn(0x7f34ac0c52e0 0x7f34ac06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.675+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300515180 0 0) 0x7f34ac0a8380 con 0x7f34ac06cd20 2023-11-18T20:42:10.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3498005730 con 0x7f34ac06cd20 2023-11-18T20:42:10.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873761732 0 0) 0x7f3498005730 con 0x7f34ac06cd20 2023-11-18T20:42:10.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac14e7f0 msgr2=0x7f34ac0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:10.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac14e7f0 0x7f34ac0c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 >> v2:172.21.15.161:3300/0 conn(0x7f34ac0c52e0 msgr2=0x7f34ac06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:10.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 --2- 172.21.15.132:0/2961413240 >> v2:172.21.15.161:3300/0 conn(0x7f34ac0c52e0 0x7f34ac06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac06c240 con 0x7f34ac06cd20 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f34a40019f0 con 0x7f34ac06cd20 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 >> v1:172.21.15.132:6789/0 conn(0x7f34ac06cd20 legacy=0x7f34ac1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3498005b80 0x7f3498005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac14e7f0 0x7f34980069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498006f10 0x7f3498007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac1510b0 con 0x7f3498005b80 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac06bf60 con 0x7f3498006f10 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349800dbc0 con 0x7f34ac14e7f0 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.676+0000 7f34b1a18640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3498005b80 0x7f3498005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.677+0000 7f34b2219640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498006f10 0x7f3498007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.677+0000 7f34b1217640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac14e7f0 0x7f34980069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.677+0000 7f34b1a18640 1 -- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac14e7f0 msgr2=0x7f34980069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:10.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.677+0000 7f34b1a18640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac14e7f0 0x7f34980069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.677+0000 7f34b1a18640 1 -- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498006f10 msgr2=0x7f3498007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:10.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.677+0000 7f34b1a18640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498006f10 0x7f3498007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.677+0000 7f34b1a18640 1 -- 172.21.15.132:0/2961413240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498005730 con 0x7f3498005b80 2023-11-18T20:42:10.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.677+0000 7f34b2219640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498006f10 0x7f3498007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:10.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.678+0000 7f34b1a18640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3498005b80 0x7f3498005fa0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009ac0 tx=0x7f3498007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756c3c67d4346ec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:10.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.678+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a802c6b0 con 0x7f3498005b80 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.678+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a802c810 con 0x7f3498005b80 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.678+0000 7f34b0a16640 1 -- 172.21.15.132:0/2961413240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a802cba0 con 0x7f3498005b80 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.679+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2961413240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3498005b80 msgr2=0x7f3498005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.679+0000 7f34b2a1a640 1 --2- 172.21.15.132:0/2961413240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3498005b80 0x7f3498005fa0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009ac0 tx=0x7f3498007a00 comp rx=0 tx=0).stop 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.679+0000 7f34b2219640 1 -- 172.21.15.132:0/2961413240 reap_dead start 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.679+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2961413240 shutdown_connections 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.679+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2961413240 >> 172.21.15.132:0/2961413240 conn(0x7f34ac0a77f0 msgr2=0x7f34ac0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.679+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2961413240 shutdown_connections 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.679+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2961413240 wait complete. 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.681+0000 7f34b2a1a640 1 Processor -- start 2023-11-18T20:42:10.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.681+0000 7f34b2a1a640 1 -- start start 2023-11-18T20:42:10.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b2a1a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498005b80 0x7f34ac0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b2a1a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34ac071580 0x7f34ac1ea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b2a1a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac1eda20 0x7f34ac14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b2a1a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac150b80 con 0x7f34ac071580 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b2a1a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac1ead00 con 0x7f3498005b80 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b2a1a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac1eafe0 con 0x7f34ac1eda20 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b1217640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34ac071580 0x7f34ac1ea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b1217640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34ac071580 0x7f34ac1ea4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50648/0 (socket says 172.21.15.132:50648) 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b1217640 1 -- 172.21.15.132:0/2305538459 learned_addr learned my addr 172.21.15.132:0/2305538459 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b1a18640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498005b80 0x7f34ac0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.682+0000 7f34b2219640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac1eda20 0x7f34ac14d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b1217640 1 -- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac1eda20 msgr2=0x7f34ac14d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b1217640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac1eda20 0x7f34ac14d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b1217640 1 -- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498005b80 msgr2=0x7f34ac0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b1217640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498005b80 0x7f34ac0c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b1217640 1 -- 172.21.15.132:0/2305538459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac1eb2c0 con 0x7f34ac071580 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b2219640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac1eda20 0x7f34ac14d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b1217640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34ac071580 0x7f34ac1ea4b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f349c0108e0 tx=0x7f349c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34a27fc640 1 -- 172.21.15.132:0/2305538459 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00eb60 con 0x7f34ac071580 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34a27fc640 1 -- 172.21.15.132:0/2305538459 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c00ecc0 con 0x7f34ac071580 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac14cf90 con 0x7f34ac071580 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34a27fc640 1 -- 172.21.15.132:0/2305538459 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c01c400 con 0x7f34ac071580 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.683+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac0c2c90 con 0x7f34ac071580 2023-11-18T20:42:10.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.685+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac04e840 con 0x7f34ac071580 2023-11-18T20:42:10.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.686+0000 7f34a27fc640 1 -- 172.21.15.132:0/2305538459 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f349c01c560 con 0x7f34ac071580 2023-11-18T20:42:10.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.687+0000 7f34a27fc640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f349006ae40 0x7f349006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:10.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.687+0000 7f34a27fc640 1 -- 172.21.15.132:0/2305538459 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f349c08a090 con 0x7f34ac071580 2023-11-18T20:42:10.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.687+0000 7f34b1a18640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f349006ae40 0x7f349006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:10.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.688+0000 7f34b1a18640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f349006ae40 0x7f349006d300 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f34a8036000 tx=0x7f34a8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:10.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.691+0000 7f34a27fc640 1 -- 172.21.15.132:0/2305538459 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f349c054d80 con 0x7f34ac071580 2023-11-18T20:42:10.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.917+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34ac1eb450 con 0x7f34ac071580 2023-11-18T20:42:10.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.918+0000 7f34a27fc640 1 -- 172.21.15.132:0/2305538459 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f349c0583a0 con 0x7f34ac071580 2023-11-18T20:42:10.920 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:10.920 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:19.530586+0000","modified":"2023-11-18T20:41:22.840145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/726664783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":726664783},{"type":"v1","addr":"172.21.15.132:6835","nonce":726664783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:34.907589+0000","modified":"2023-11-18T20:41:37.972696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-18T20:42:10.920 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 50 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f349006ae40 msgr2=0x7f349006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f349006ae40 0x7f349006d300 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f34a8036000 tx=0x7f34a8030000 comp rx=0 tx=0).stop 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34ac071580 msgr2=0x7f34ac1ea4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34ac071580 0x7f34ac1ea4b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f349c0108e0 tx=0x7f349c010da0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 shutdown_connections 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f349006ae40 0x7f349006d300 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34ac1eda20 0x7f34ac14d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34ac071580 0x7f34ac1ea4b0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 --2- 172.21.15.132:0/2305538459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3498005b80 0x7f34ac0c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:10.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 >> 172.21.15.132:0/2305538459 conn(0x7f34ac0a77f0 msgr2=0x7f34ac0a65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:10.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 shutdown_connections 2023-11-18T20:42:10.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:10.921+0000 7f34b2a1a640 1 -- 172.21.15.132:0/2305538459 wait complete. 2023-11-18T20:42:10.942 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:42:11.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.148+0000 7faf0b59e640 1 Processor -- start 2023-11-18T20:42:11.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.148+0000 7faf0b59e640 1 -- start start 2023-11-18T20:42:11.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faf0c0c0440 0x7faf0c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0b59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf0c072310 0x7faf0c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0b59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c071e80 con 0x7faf0c14c2e0 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0b59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c071470 con 0x7faf0c072310 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c14c6c0 con 0x7faf0c0c0440 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf0c072310 0x7faf0c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf0c072310 0x7faf0c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50658/0 (socket says 172.21.15.132:50658) 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0ad9d640 1 -- 172.21.15.132:0/278137315 learned_addr learned my addr 172.21.15.132:0/278137315 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0ad9d640 1 -- 172.21.15.132:0/278137315 >> v2:172.21.15.161:3300/0 conn(0x7faf0c0c0440 msgr2=0x7faf0c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0ad9d640 1 --2- 172.21.15.132:0/278137315 >> v2:172.21.15.161:3300/0 conn(0x7faf0c0c0440 0x7faf0c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0ad9d640 1 -- 172.21.15.132:0/278137315 >> v1:172.21.15.161:6789/0 conn(0x7faf0c14c2e0 legacy=0x7faf0c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:11.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.150+0000 7faf0ad9d640 1 -- 172.21.15.132:0/278137315 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c06fdc0 con 0x7faf0c072310 2023-11-18T20:42:11.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.151+0000 7faf0ad9d640 1 --2- 172.21.15.132:0/278137315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c072310 0x7faf0c0a4d20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0678c0 tx=0x7faf0402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f51a09592c6f834 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0959a640 1 -- 172.21.15.132:0/278137315 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04031750 con 0x7faf0c072310 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0959a640 1 -- 172.21.15.132:0/278137315 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf040318b0 con 0x7faf0c072310 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0959a640 1 -- 172.21.15.132:0/278137315 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04031c40 con 0x7faf0c072310 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0b59e640 1 -- 172.21.15.132:0/278137315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c072310 msgr2=0x7faf0c0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0b59e640 1 --2- 172.21.15.132:0/278137315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c072310 0x7faf0c0a4d20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0678c0 tx=0x7faf0402b7f0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0b59e640 1 -- 172.21.15.132:0/278137315 shutdown_connections 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0b59e640 1 --2- 172.21.15.132:0/278137315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c072310 0x7faf0c0a4d20 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0b59e640 1 --2- 172.21.15.132:0/278137315 >> v2:172.21.15.161:3300/0 conn(0x7faf0c0c0440 0x7faf0c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0b59e640 1 -- 172.21.15.132:0/278137315 >> 172.21.15.132:0/278137315 conn(0x7faf0c0a77f0 msgr2=0x7faf0c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0b59e640 1 -- 172.21.15.132:0/278137315 shutdown_connections 2023-11-18T20:42:11.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.152+0000 7faf0b59e640 1 -- 172.21.15.132:0/278137315 wait complete. 2023-11-18T20:42:11.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.154+0000 7faf0b59e640 1 Processor -- start 2023-11-18T20:42:11.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.154+0000 7faf0b59e640 1 -- start start 2023-11-18T20:42:11.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf0c072310 0x7faf0c1ede10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0b59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf0c0c0440 0x7faf0c0bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0b59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c14c2e0 0x7faf0c1de600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0b59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1dc770 con 0x7faf0c14c2e0 2023-11-18T20:42:11.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1ee350 con 0x7faf0c072310 2023-11-18T20:42:11.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0b59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0ab510 con 0x7faf0c0c0440 2023-11-18T20:42:11.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c14c2e0 0x7faf0c1de600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c14c2e0 0x7faf0c1de600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50664/0 (socket says 172.21.15.132:50664) 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.155+0000 7faf0ad9d640 1 -- 172.21.15.132:0/3633901534 learned_addr learned my addr 172.21.15.132:0/3633901534 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf0ad9d640 1 -- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf0c0c0440 msgr2=0x7faf0c0bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf0ad9d640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf0c0c0440 0x7faf0c0bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf0ad9d640 1 -- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf0c072310 msgr2=0x7faf0c1ede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf0ad9d640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf0c072310 0x7faf0c1ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf0ad9d640 1 -- 172.21.15.132:0/3633901534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040094d0 con 0x7faf0c14c2e0 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf0ad9d640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c14c2e0 0x7faf0c1de600 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7faf0402b830 tx=0x7faf040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:11.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf02ffd640 1 -- 172.21.15.132:0/3633901534 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04033c80 con 0x7faf0c14c2e0 2023-11-18T20:42:11.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf02ffd640 1 -- 172.21.15.132:0/3633901534 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf04033e00 con 0x7faf0c14c2e0 2023-11-18T20:42:11.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf02ffd640 1 -- 172.21.15.132:0/3633901534 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0403d6b0 con 0x7faf0c14c2e0 2023-11-18T20:42:11.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c1db950 con 0x7faf0c14c2e0 2023-11-18T20:42:11.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.156+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c0aaec0 con 0x7faf0c14c2e0 2023-11-18T20:42:11.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.157+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c04e840 con 0x7faf0c14c2e0 2023-11-18T20:42:11.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.158+0000 7faf02ffd640 1 -- 172.21.15.132:0/3633901534 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf0403a040 con 0x7faf0c14c2e0 2023-11-18T20:42:11.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.159+0000 7faf02ffd640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeec06ae40 0x7faeec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.159+0000 7faf02ffd640 1 -- 172.21.15.132:0/3633901534 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7faf040abad0 con 0x7faf0c14c2e0 2023-11-18T20:42:11.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.160+0000 7faf0a59c640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeec06ae40 0x7faeec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.161+0000 7faf0a59c640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeec06ae40 0x7faeec06d300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7faefc001c60 tx=0x7faefc007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:11.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.163+0000 7faf02ffd640 1 -- 172.21.15.132:0/3633901534 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf040767a0 con 0x7faf0c14c2e0 2023-11-18T20:42:11.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.351+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf0c0ab810 con 0x7faf0c14c2e0 2023-11-18T20:42:11.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.355+0000 7faf02ffd640 1 -- 172.21.15.132:0/3633901534 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+20453 (secure 0 0 0) 0x7faf04079dc0 con 0x7faf0c14c2e0 2023-11-18T20:42:11.356 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:11.357 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":82,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:41:48.564301+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:41:17.894376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-18T20:41:18.520471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:42:11.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.357+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeec06ae40 msgr2=0x7faeec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.357+0000 7faf0b59e640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeec06ae40 0x7faeec06d300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7faefc001c60 tx=0x7faefc007d10 comp rx=0 tx=0).stop 2023-11-18T20:42:11.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.357+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c14c2e0 msgr2=0x7faf0c1de600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.357+0000 7faf0b59e640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c14c2e0 0x7faf0c1de600 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7faf0402b830 tx=0x7faf040046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.358+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 shutdown_connections 2023-11-18T20:42:11.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.358+0000 7faf0b59e640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7faeec06ae40 0x7faeec06d300 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.358+0000 7faf0b59e640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf0c14c2e0 0x7faf0c1de600 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.358+0000 7faf0b59e640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf0c0c0440 0x7faf0c0bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.358+0000 7faf0b59e640 1 --2- 172.21.15.132:0/3633901534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf0c072310 0x7faf0c1ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.358+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 >> 172.21.15.132:0/3633901534 conn(0x7faf0c0a77f0 msgr2=0x7faf0c153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:11.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.358+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 shutdown_connections 2023-11-18T20:42:11.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.358+0000 7faf0b59e640 1 -- 172.21.15.132:0/3633901534 wait complete. 2023-11-18T20:42:11.378 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-18T20:42:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.587+0000 7f127ef1d640 1 Processor -- start 2023-11-18T20:42:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.588+0000 7f127ef1d640 1 -- start start 2023-11-18T20:42:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127ef1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1278155d40 0x7f12780c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127ef1d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12780c6c60 0x7f12780a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127ef1d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12780c8510 con 0x7f12780c7a20 2023-11-18T20:42:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127ef1d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12780c5cc0 con 0x7f12780c6c60 2023-11-18T20:42:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127ef1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12780c5ea0 con 0x7f1278155d40 2023-11-18T20:42:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127d4ba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12780c6c60 0x7f12780a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127ccb9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f12780c7a20 0x7f12780c7e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35836/0 (socket says 172.21.15.132:35836) 2023-11-18T20:42:11.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127ccb9640 1 -- 172.21.15.132:0/3011392337 learned_addr learned my addr 172.21.15.132:0/3011392337 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:11.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f1277fff640 1 --2- 172.21.15.132:0/3011392337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1278155d40 0x7f12780c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.589+0000 7f127d4ba640 1 -- 172.21.15.132:0/3011392337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1278155d40 msgr2=0x7f12780c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:11.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.590+0000 7f127d4ba640 1 --2- 172.21.15.132:0/3011392337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1278155d40 0x7f12780c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.590+0000 7f127d4ba640 1 -- 172.21.15.132:0/3011392337 >> v1:172.21.15.132:6789/0 conn(0x7f12780c7a20 legacy=0x7f12780c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.590+0000 7f127d4ba640 1 -- 172.21.15.132:0/3011392337 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12780c6180 con 0x7f12780c6c60 2023-11-18T20:42:11.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.590+0000 7f12777fe640 1 -- 172.21.15.132:0/3011392337 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298948476 0 0) 0x7f12780c8510 con 0x7f12780c7a20 2023-11-18T20:42:11.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.591+0000 7f127d4ba640 1 --2- 172.21.15.132:0/3011392337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f12780a6d40 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f12700097a0 tx=0x7f127002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eac49e6479f13b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:11.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.591+0000 7f12777fe640 1 -- 172.21.15.132:0/3011392337 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127002d040 con 0x7f12780c6c60 2023-11-18T20:42:11.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.591+0000 7f12777fe640 1 -- 172.21.15.132:0/3011392337 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1270031810 con 0x7f12780c6c60 2023-11-18T20:42:11.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.591+0000 7f12777fe640 1 -- 172.21.15.132:0/3011392337 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270031ba0 con 0x7f12780c6c60 2023-11-18T20:42:11.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.591+0000 7f127ef1d640 1 -- 172.21.15.132:0/3011392337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 msgr2=0x7f12780a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.591+0000 7f127ef1d640 1 --2- 172.21.15.132:0/3011392337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f12780a6d40 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f12700097a0 tx=0x7f127002b8b0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.592+0000 7f127ef1d640 1 -- 172.21.15.132:0/3011392337 shutdown_connections 2023-11-18T20:42:11.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.592+0000 7f127ef1d640 1 --2- 172.21.15.132:0/3011392337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f12780a6d40 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.592+0000 7f127ef1d640 1 --2- 172.21.15.132:0/3011392337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1278155d40 0x7f12780c1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.592+0000 7f127ef1d640 1 -- 172.21.15.132:0/3011392337 >> 172.21.15.132:0/3011392337 conn(0x7f12780a9b70 msgr2=0x7f12780a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:11.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.592+0000 7f127ef1d640 1 -- 172.21.15.132:0/3011392337 shutdown_connections 2023-11-18T20:42:11.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.592+0000 7f127ef1d640 1 -- 172.21.15.132:0/3011392337 wait complete. 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.593+0000 7f127ef1d640 1 Processor -- start 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.593+0000 7f127ef1d640 1 -- start start 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.594+0000 7f127ef1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f1278150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.594+0000 7f127ef1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12780c7a20 0x7f1278099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.594+0000 7f127ef1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1278155d40 0x7f127809c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.594+0000 7f127ef1d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12781e9d60 con 0x7f12780c6c60 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.594+0000 7f127ef1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12781ea040 con 0x7f1278155d40 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.594+0000 7f127ef1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12781ea320 con 0x7f12780c7a20 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f1278150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f1278150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50680/0 (socket says 172.21.15.132:50680) 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 -- 172.21.15.132:0/1643473168 learned_addr learned my addr 172.21.15.132:0/1643473168 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127d4ba640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1278155d40 0x7f127809c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f1277fff640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12780c7a20 0x7f1278099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 -- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12780c7a20 msgr2=0x7f1278099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12780c7a20 0x7f1278099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 -- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1278155d40 msgr2=0x7f127809c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1278155d40 0x7f127809c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 -- 172.21.15.132:0/1643473168 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270009400 con 0x7f12780c6c60 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.595+0000 7f127ccb9640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f1278150660 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f126800c890 tx=0x7f126800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.596+0000 7f12757fa640 1 -- 172.21.15.132:0/1643473168 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800a640 con 0x7f12780c6c60 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.596+0000 7f12757fa640 1 -- 172.21.15.132:0/1643473168 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126800a7c0 con 0x7f12780c6c60 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.596+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12781ea600 con 0x7f12780c6c60 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.596+0000 7f12757fa640 1 -- 172.21.15.132:0/1643473168 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800ab70 con 0x7f12780c6c60 2023-11-18T20:42:11.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.596+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12781ea8e0 con 0x7f12780c6c60 2023-11-18T20:42:11.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.597+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12780c8d60 con 0x7f12780c6c60 2023-11-18T20:42:11.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.598+0000 7f12757fa640 1 -- 172.21.15.132:0/1643473168 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f126800acd0 con 0x7f12780c6c60 2023-11-18T20:42:11.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.599+0000 7f12757fa640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f125806ae40 0x7f125806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:11.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.599+0000 7f12757fa640 1 -- 172.21.15.132:0/1643473168 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6681+0+0 (secure 0 0 0) 0x7f1268089220 con 0x7f12780c6c60 2023-11-18T20:42:11.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.600+0000 7f1277fff640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f125806ae40 0x7f125806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:11.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.601+0000 7f1277fff640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f125806ae40 0x7f125806d300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1260006fd0 tx=0x7f1260008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:11.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.604+0000 7f12757fa640 1 -- 172.21.15.132:0/1643473168 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1268053f90 con 0x7f12780c6c60 2023-11-18T20:42:11.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.834+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f12781ed000 con 0x7f12780c6c60 2023-11-18T20:42:11.836 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-11-18T20:42:11.835+0000 7feee5f07640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-18T20:42:11.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.839+0000 7f12757fa640 1 -- 172.21.15.132:0/1643473168 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7f12781ed000 con 0x7f12780c6c60 2023-11-18T20:42:11.840 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f125806ae40 msgr2=0x7f125806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f125806ae40 0x7f125806d300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1260006fd0 tx=0x7f1260008040 comp rx=0 tx=0).stop 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 msgr2=0x7f1278150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f1278150660 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f126800c890 tx=0x7f126800cd50 comp rx=0 tx=0).stop 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 shutdown_connections 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f125806ae40 0x7f125806d300 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1278155d40 0x7f127809c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12780c7a20 0x7f1278099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 --2- 172.21.15.132:0/1643473168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12780c6c60 0x7f1278150660 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.842+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 >> 172.21.15.132:0/1643473168 conn(0x7f12780a9b70 msgr2=0x7f12780c11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:11.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.843+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 shutdown_connections 2023-11-18T20:42:11.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:11.843+0000 7f127ef1d640 1 -- 172.21.15.132:0/1643473168 wait complete. 2023-11-18T20:42:11.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-18T20:42:11.875 INFO:tasks.ceph.mds.a.smithi132.stderr: -5468> 2023-11-18T20:41:24.451+0000 7fe1e3a35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:42:11.952 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-11-18T20:42:12.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.065+0000 7fa692fd5640 1 Processor -- start 2023-11-18T20:42:12.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.066+0000 7fa692fd5640 1 -- start start 2023-11-18T20:42:12.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.067+0000 7fa692fd5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa68c14fd30 0x7fa68c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:12.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.067+0000 7fa692fd5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0c64a0 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.067+0000 7fa692fd5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0c5c00 con 0x7fa68c06d0a0 2023-11-18T20:42:12.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.067+0000 7fa692fd5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c0c5ee0 con 0x7fa68c14fd30 2023-11-18T20:42:12.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.067+0000 7fa690d71640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa68c14fd30 0x7fa68c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:12.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.067+0000 7fa691572640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa68c0c3ea0 0x7fa68c0c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35854/0 (socket says 172.21.15.132:35854) 2023-11-18T20:42:12.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.067+0000 7fa691572640 1 -- 172.21.15.132:0/2809271795 learned_addr learned my addr 172.21.15.132:0/2809271795 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:12.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.068+0000 7fa690d71640 1 -- 172.21.15.132:0/2809271795 >> v1:172.21.15.161:6789/0 conn(0x7fa68c06d0a0 legacy=0x7fa68c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:12.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.068+0000 7fa690d71640 1 -- 172.21.15.132:0/2809271795 >> v1:172.21.15.132:6789/0 conn(0x7fa68c0c3ea0 legacy=0x7fa68c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:12.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.068+0000 7fa68b7fe640 1 -- 172.21.15.132:0/2809271795 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376864540 0 0) 0x7fa68c0c64a0 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.068+0000 7fa690d71640 1 -- 172.21.15.132:0/2809271795 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0c61c0 con 0x7fa68c14fd30 2023-11-18T20:42:12.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.069+0000 7fa690d71640 1 --2- 172.21.15.132:0/2809271795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c14fd30 0x7fa68c152f20 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0097a0 tx=0x7fa67c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24d5e22618c45ae server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.070+0000 7fa68b7fe640 1 -- 172.21.15.132:0/2809271795 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c030610 con 0x7fa68c14fd30 2023-11-18T20:42:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.070+0000 7fa68b7fe640 1 -- 172.21.15.132:0/2809271795 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c030770 con 0x7fa68c14fd30 2023-11-18T20:42:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.070+0000 7fa68b7fe640 1 -- 172.21.15.132:0/2809271795 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c030b00 con 0x7fa68c14fd30 2023-11-18T20:42:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.070+0000 7fa692fd5640 1 -- 172.21.15.132:0/2809271795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c14fd30 msgr2=0x7fa68c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.070+0000 7fa692fd5640 1 --2- 172.21.15.132:0/2809271795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c14fd30 0x7fa68c152f20 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0097a0 tx=0x7fa67c02b960 comp rx=0 tx=0).stop 2023-11-18T20:42:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.071+0000 7fa692fd5640 1 -- 172.21.15.132:0/2809271795 shutdown_connections 2023-11-18T20:42:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.071+0000 7fa692fd5640 1 --2- 172.21.15.132:0/2809271795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c14fd30 0x7fa68c152f20 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.071+0000 7fa692fd5640 1 -- 172.21.15.132:0/2809271795 >> 172.21.15.132:0/2809271795 conn(0x7fa68c06a500 msgr2=0x7fa68c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.071+0000 7fa692fd5640 1 -- 172.21.15.132:0/2809271795 shutdown_connections 2023-11-18T20:42:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.071+0000 7fa692fd5640 1 -- 172.21.15.132:0/2809271795 wait complete. 2023-11-18T20:42:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.072+0000 7fa692fd5640 1 Processor -- start 2023-11-18T20:42:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.073+0000 7fa692fd5640 1 -- start start 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.073+0000 7fa692fd5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c06d0a0 0x7fa68c0c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.073+0000 7fa692fd5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c0c3ea0 0x7fa68c149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.073+0000 7fa692fd5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa68c14fd30 0x7fa68c149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.073+0000 7fa692fd5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c1e9ec0 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.073+0000 7fa692fd5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0a51a0 con 0x7fa68c06d0a0 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.073+0000 7fa692fd5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c1ea0b0 con 0x7fa68c14fd30 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c0c3ea0 0x7fa68c149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c0c3ea0 0x7fa68c149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50712/0 (socket says 172.21.15.132:50712) 2023-11-18T20:42:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 -- 172.21.15.132:0/1513351448 learned_addr learned my addr 172.21.15.132:0/1513351448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa690d71640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c06d0a0 0x7fa68c0c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 -- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa68c14fd30 msgr2=0x7fa68c149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa68c14fd30 0x7fa68c149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 -- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c06d0a0 msgr2=0x7fa68c0c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c06d0a0 0x7fa68c0c1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 -- 172.21.15.132:0/1513351448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c009400 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa690d71640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c06d0a0 0x7fa68c0c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.074+0000 7fa68bfff640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c0c3ea0 0x7fa68c149840 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa68000c3c0 tx=0x7fa68000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.075+0000 7fa6897fa640 1 -- 172.21.15.132:0/1513351448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6800052d0 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.075+0000 7fa6897fa640 1 -- 172.21.15.132:0/1513351448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa680005450 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.075+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c1ea390 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.075+0000 7fa6897fa640 1 -- 172.21.15.132:0/1513351448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680003830 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.075+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c1ea950 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.076+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c068350 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.077+0000 7fa6897fa640 1 -- 172.21.15.132:0/1513351448 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa680003990 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.078+0000 7fa6897fa640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa67806ae40 0x7fa67806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.078+0000 7fa6897fa640 1 -- 172.21.15.132:0/1513351448 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6767+0+0 (secure 0 0 0) 0x7fa680088e70 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.079+0000 7fa690d71640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa67806ae40 0x7fa67806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:12.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.080+0000 7fa690d71640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa67806ae40 0x7fa67806d300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa67c036000 tx=0x7fa67c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.082+0000 7fa6897fa640 1 -- 172.21.15.132:0/1513351448 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa680053b90 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.310+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa68c0c66d0 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.842+0000 7fa6897fa640 1 -- 172.21.15.132:0/1513351448 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa6800571b0 con 0x7fa68c0c3ea0 2023-11-18T20:42:12.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa67806ae40 msgr2=0x7fa67806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:12.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa67806ae40 0x7fa67806d300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa67c036000 tx=0x7fa67c03b040 comp rx=0 tx=0).stop 2023-11-18T20:42:12.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c0c3ea0 msgr2=0x7fa68c149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:12.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c0c3ea0 0x7fa68c149840 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa68000c3c0 tx=0x7fa68000c880 comp rx=0 tx=0).stop 2023-11-18T20:42:12.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 shutdown_connections 2023-11-18T20:42:12.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa67806ae40 0x7fa67806d300 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:12.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa68c14fd30 0x7fa68c149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:12.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c0c3ea0 0x7fa68c149840 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:12.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 --2- 172.21.15.132:0/1513351448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa68c06d0a0 0x7fa68c0c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:12.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 >> 172.21.15.132:0/1513351448 conn(0x7fa68c06a500 msgr2=0x7fa68c0bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:12.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 shutdown_connections 2023-11-18T20:42:12.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:12.846+0000 7fa692fd5640 1 -- 172.21.15.132:0/1513351448 wait complete. 2023-11-18T20:42:12.866 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-18T20:42:13.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.070+0000 7f57cf59e640 1 Processor -- start 2023-11-18T20:42:13.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.071+0000 7f57cf59e640 1 -- start start 2023-11-18T20:42:13.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57cf59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57d00a5360 0x7f57d00c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:13.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57cf59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57d00c1140 0x7f57d00c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57cf59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 0x7f57d00c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57cf59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d0154790 con 0x7f57d00a5360 2023-11-18T20:42:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57cf59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00c30c0 con 0x7f57d00c1140 2023-11-18T20:42:13.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57cf59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d01549e0 con 0x7f57d01554c0 2023-11-18T20:42:13.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57ce59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57d00a5360 0x7f57d00c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:13.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57ce59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57d00a5360 0x7f57d00c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50724/0 (socket says 172.21.15.132:50724) 2023-11-18T20:42:13.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57ce59c640 1 -- 172.21.15.132:0/2644582838 learned_addr learned my addr 172.21.15.132:0/2644582838 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:13.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57ced9d640 1 --2- 172.21.15.132:0/2644582838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 0x7f57d00c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.072+0000 7f57c7fff640 1 --2- 172.21.15.132:0/2644582838 >> v2:172.21.15.161:3300/0 conn(0x7f57d00c1140 0x7f57d00c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.073+0000 7f57ce59c640 1 -- 172.21.15.132:0/2644582838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 msgr2=0x7f57d00c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.073+0000 7f57ce59c640 1 --2- 172.21.15.132:0/2644582838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 0x7f57d00c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.073+0000 7f57ce59c640 1 -- 172.21.15.132:0/2644582838 >> v2:172.21.15.161:3300/0 conn(0x7f57d00c1140 msgr2=0x7f57d00c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.073+0000 7f57ce59c640 1 --2- 172.21.15.132:0/2644582838 >> v2:172.21.15.161:3300/0 conn(0x7f57d00c1140 0x7f57d00c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.073+0000 7f57ce59c640 1 -- 172.21.15.132:0/2644582838 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0154cc0 con 0x7f57d00a5360 2023-11-18T20:42:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.073+0000 7f57ced9d640 1 --2- 172.21.15.132:0/2644582838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 0x7f57d00c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:13.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.073+0000 7f57c7fff640 1 --2- 172.21.15.132:0/2644582838 >> v2:172.21.15.161:3300/0 conn(0x7f57d00c1140 0x7f57d00c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.074+0000 7f57ce59c640 1 --2- 172.21.15.132:0/2644582838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00a5360 0x7f57d00c2750 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f57d00c0380 tx=0x7f57c002b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d071e9028b3371c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.074+0000 7f57cdd9b640 1 -- 172.21.15.132:0/2644582838 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c00317f0 con 0x7f57d00a5360 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.074+0000 7f57cdd9b640 1 -- 172.21.15.132:0/2644582838 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0031950 con 0x7f57d00a5360 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.074+0000 7f57cdd9b640 1 -- 172.21.15.132:0/2644582838 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0031ce0 con 0x7f57d00a5360 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 -- 172.21.15.132:0/2644582838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00a5360 msgr2=0x7f57d00c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 --2- 172.21.15.132:0/2644582838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00a5360 0x7f57d00c2750 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f57d00c0380 tx=0x7f57c002b890 comp rx=0 tx=0).stop 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 -- 172.21.15.132:0/2644582838 shutdown_connections 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 --2- 172.21.15.132:0/2644582838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 0x7f57d00c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 --2- 172.21.15.132:0/2644582838 >> v2:172.21.15.161:3300/0 conn(0x7f57d00c1140 0x7f57d00c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 --2- 172.21.15.132:0/2644582838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00a5360 0x7f57d00c2750 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 -- 172.21.15.132:0/2644582838 >> 172.21.15.132:0/2644582838 conn(0x7f57d00c5cc0 msgr2=0x7f57d00c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 -- 172.21.15.132:0/2644582838 shutdown_connections 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.075+0000 7f57cf59e640 1 -- 172.21.15.132:0/2644582838 wait complete. 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.076+0000 7f57cf59e640 1 Processor -- start 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.077+0000 7f57cf59e640 1 -- start start 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.077+0000 7f57cf59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d00a5360 0x7f57d0071e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.077+0000 7f57cf59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00c1140 0x7f57d01e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.077+0000 7f57cf59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 0x7f57d01ea510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.077+0000 7f57cf59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d014cf80 con 0x7f57d00c1140 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.077+0000 7f57cf59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d01edda0 con 0x7f57d00a5360 2023-11-18T20:42:13.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.077+0000 7f57cf59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0072a10 con 0x7f57d01554c0 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00c1140 0x7f57d01e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00c1140 0x7f57d01e9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50734/0 (socket says 172.21.15.132:50734) 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 -- 172.21.15.132:0/3913557330 learned_addr learned my addr 172.21.15.132:0/3913557330 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 -- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 msgr2=0x7f57d01ea510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 0x7f57d01ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 -- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d00a5360 msgr2=0x7f57d0071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d00a5360 0x7f57d0071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 -- 172.21.15.132:0/3913557330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00094d0 con 0x7f57d00c1140 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.078+0000 7f57c7fff640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00c1140 0x7f57d01e9fd0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c7f0 tx=0x7f57b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:13.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.079+0000 7f57c6ffd640 1 -- 172.21.15.132:0/3913557330 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8007a30 con 0x7f57d00c1140 2023-11-18T20:42:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.079+0000 7f57c6ffd640 1 -- 172.21.15.132:0/3913557330 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8007b90 con 0x7f57d00c1140 2023-11-18T20:42:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.079+0000 7f57c6ffd640 1 -- 172.21.15.132:0/3913557330 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800ce40 con 0x7f57d00c1140 2023-11-18T20:42:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.079+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d014ca50 con 0x7f57d00c1140 2023-11-18T20:42:13.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.079+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d01ed6e0 con 0x7f57d00c1140 2023-11-18T20:42:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.080+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d0067fd0 con 0x7f57d00c1140 2023-11-18T20:42:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.081+0000 7f57c6ffd640 1 -- 172.21.15.132:0/3913557330 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57b80113f0 con 0x7f57d00c1140 2023-11-18T20:42:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.082+0000 7f57c6ffd640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57b006ae40 0x7f57b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.082+0000 7f57c6ffd640 1 -- 172.21.15.132:0/3913557330 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6767+0+0 (secure 0 0 0) 0x7f57b8089be0 con 0x7f57d00c1140 2023-11-18T20:42:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.082+0000 7f57ce59c640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57b006ae40 0x7f57b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:13.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.083+0000 7f57ce59c640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57b006ae40 0x7f57b006d300 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f57c0036000 tx=0x7f57c0030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:13.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.086+0000 7f57c6ffd640 1 -- 172.21.15.132:0/3913557330 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f57b8054860 con 0x7f57d00c1140 2023-11-18T20:42:13.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.261+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f57d01edee0 con 0x7f57d00c1140 2023-11-18T20:42:13.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.846+0000 7f57c6ffd640 1 -- 172.21.15.132:0/3913557330 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7f57d01edee0 con 0x7f57d00c1140 2023-11-18T20:42:13.847 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-11-18T20:42:13.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57b006ae40 msgr2=0x7f57b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:13.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57b006ae40 0x7f57b006d300 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f57c0036000 tx=0x7f57c0030000 comp rx=0 tx=0).stop 2023-11-18T20:42:13.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00c1140 msgr2=0x7f57d01e9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:13.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00c1140 0x7f57d01e9fd0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c7f0 tx=0x7f57b800cbf0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 shutdown_connections 2023-11-18T20:42:13.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f57b006ae40 0x7f57b006d300 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d01554c0 0x7f57d01ea510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57d00c1140 0x7f57d01e9fd0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 --2- 172.21.15.132:0/3913557330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d00a5360 0x7f57d0071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:13.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 >> 172.21.15.132:0/3913557330 conn(0x7f57d00c5cc0 msgr2=0x7f57d00c3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:13.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.850+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 shutdown_connections 2023-11-18T20:42:13.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:13.851+0000 7f57cf59e640 1 -- 172.21.15.132:0/3913557330 wait complete. 2023-11-18T20:42:13.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-18T20:42:14.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.079+0000 7f1149f3e640 1 Processor -- start 2023-11-18T20:42:14.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.079+0000 7f1149f3e640 1 -- start start 2023-11-18T20:42:14.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.080+0000 7f1149f3e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f114414fa80 0x7f114406d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:14.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.080+0000 7f1149f3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1144071f70 0x7f11440c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:14.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.080+0000 7f1149f3e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440c0980 con 0x7f1144072530 2023-11-18T20:42:14.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.080+0000 7f1149f3e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114406d160 con 0x7f1144071f70 2023-11-18T20:42:14.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.080+0000 7f1149f3e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114406c070 con 0x7f114414fa80 2023-11-18T20:42:14.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.081+0000 7f1143fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1144071f70 0x7f11440c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:14.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.081+0000 7f1143fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1144071f70 0x7f11440c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50736/0 (socket says 172.21.15.132:50736) 2023-11-18T20:42:14.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.081+0000 7f1143fff640 1 -- 172.21.15.132:0/3262694693 learned_addr learned my addr 172.21.15.132:0/3262694693 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:14.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.081+0000 7f11437fe640 1 --2- 172.21.15.132:0/3262694693 >> v2:172.21.15.161:3300/0 conn(0x7f114414fa80 0x7f114406d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:14.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.081+0000 7f1143fff640 1 -- 172.21.15.132:0/3262694693 >> v2:172.21.15.161:3300/0 conn(0x7f114414fa80 msgr2=0x7f114406d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:14.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.081+0000 7f1143fff640 1 --2- 172.21.15.132:0/3262694693 >> v2:172.21.15.161:3300/0 conn(0x7f114414fa80 0x7f114406d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.081+0000 7f1143fff640 1 -- 172.21.15.132:0/3262694693 >> v1:172.21.15.161:6789/0 conn(0x7f1144072530 legacy=0x7f11440c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:14.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.081+0000 7f1143fff640 1 -- 172.21.15.132:0/3262694693 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114406dc70 con 0x7f1144071f70 2023-11-18T20:42:14.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.082+0000 7f1143fff640 1 --2- 172.21.15.132:0/3262694693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11440c2610 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f11440c3310 tx=0x7f113c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5286269e812d71 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:14.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1142ffd640 1 -- 172.21.15.132:0/3262694693 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c02c9f0 con 0x7f1144071f70 2023-11-18T20:42:14.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1142ffd640 1 -- 172.21.15.132:0/3262694693 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c02cb50 con 0x7f1144071f70 2023-11-18T20:42:14.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1142ffd640 1 -- 172.21.15.132:0/3262694693 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0343f0 con 0x7f1144071f70 2023-11-18T20:42:14.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1149f3e640 1 -- 172.21.15.132:0/3262694693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 msgr2=0x7f11440c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:14.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1149f3e640 1 --2- 172.21.15.132:0/3262694693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11440c2610 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f11440c3310 tx=0x7f113c02be50 comp rx=0 tx=0).stop 2023-11-18T20:42:14.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1149f3e640 1 -- 172.21.15.132:0/3262694693 shutdown_connections 2023-11-18T20:42:14.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1149f3e640 1 --2- 172.21.15.132:0/3262694693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11440c2610 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1149f3e640 1 --2- 172.21.15.132:0/3262694693 >> v2:172.21.15.161:3300/0 conn(0x7f114414fa80 0x7f114406d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1149f3e640 1 -- 172.21.15.132:0/3262694693 >> 172.21.15.132:0/3262694693 conn(0x7f11440c5bc0 msgr2=0x7f11440c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:14.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1149f3e640 1 -- 172.21.15.132:0/3262694693 shutdown_connections 2023-11-18T20:42:14.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.083+0000 7f1149f3e640 1 -- 172.21.15.132:0/3262694693 wait complete. 2023-11-18T20:42:14.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.085+0000 7f1149f3e640 1 Processor -- start 2023-11-18T20:42:14.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.085+0000 7f1149f3e640 1 -- start start 2023-11-18T20:42:14.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f1149f3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11441565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:14.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f1149f3e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1144072530 0x7f1144153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f1149f3e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f114414fa80 0x7f114414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f1149f3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114414df80 con 0x7f1144071f70 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f1149f3e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114414e7e0 con 0x7f114414fa80 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f1149f3e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11441eb860 con 0x7f1144072530 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f11437fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11441565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f11437fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11441565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50742/0 (socket says 172.21.15.132:50742) 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.086+0000 7f11437fe640 1 -- 172.21.15.132:0/2447561969 learned_addr learned my addr 172.21.15.132:0/2447561969 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f11437fe640 1 -- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1144072530 msgr2=0x7f1144153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f11437fe640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1144072530 0x7f1144153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f11437fe640 1 -- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f114414fa80 msgr2=0x7f114414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f11437fe640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f114414fa80 0x7f114414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f11437fe640 1 -- 172.21.15.132:0/2447561969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c009b30 con 0x7f1144071f70 2023-11-18T20:42:14.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f11437fe640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11441565d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f113400c7f0 tx=0x7f113400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:14.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f1140ff9640 1 -- 172.21.15.132:0/2447561969 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134004220 con 0x7f1144071f70 2023-11-18T20:42:14.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f1140ff9640 1 -- 172.21.15.132:0/2447561969 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1134004380 con 0x7f1144071f70 2023-11-18T20:42:14.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f1140ff9640 1 -- 172.21.15.132:0/2447561969 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134007840 con 0x7f1144071f70 2023-11-18T20:42:14.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114414e190 con 0x7f1144071f70 2023-11-18T20:42:14.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.087+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114414b620 con 0x7f1144071f70 2023-11-18T20:42:14.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.088+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1144068350 con 0x7f1144071f70 2023-11-18T20:42:14.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.089+0000 7f1140ff9640 1 -- 172.21.15.132:0/2447561969 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1134007bb0 con 0x7f1144071f70 2023-11-18T20:42:14.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.090+0000 7f1140ff9640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f112406ae70 0x7f112406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:14.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.090+0000 7f1140ff9640 1 -- 172.21.15.132:0/2447561969 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6329+0+0 (secure 0 0 0) 0x7f1134089810 con 0x7f1144071f70 2023-11-18T20:42:14.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.091+0000 7f113bfff640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f112406ae70 0x7f112406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:14.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.092+0000 7f113bfff640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f112406ae70 0x7f112406d330 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f11441ec7a0 tx=0x7f112c0079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:14.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.095+0000 7f1140ff9640 1 -- 172.21.15.132:0/2447561969 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11340545b0 con 0x7f1144071f70 2023-11-18T20:42:14.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.283+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f114406d580 con 0x7f1144071f70 2023-11-18T20:42:14.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.850+0000 7f1140ff9640 1 -- 172.21.15.132:0/2447561969 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1134007e60 con 0x7f1144071f70 2023-11-18T20:42:14.851 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-11-18T20:42:14.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f112406ae70 msgr2=0x7f112406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:14.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f112406ae70 0x7f112406d330 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f11441ec7a0 tx=0x7f112c0079b0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 msgr2=0x7f11441565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11441565d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f113400c7f0 tx=0x7f113400ccb0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 shutdown_connections 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f112406ae70 0x7f112406d330 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f114414fa80 0x7f114414b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1144072530 0x7f1144153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 --2- 172.21.15.132:0/2447561969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1144071f70 0x7f11441565d0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 >> 172.21.15.132:0/2447561969 conn(0x7f11440c5bc0 msgr2=0x7f11441516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 shutdown_connections 2023-11-18T20:42:14.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:14.854+0000 7f1149f3e640 1 -- 172.21.15.132:0/2447561969 wait complete. 2023-11-18T20:42:14.881 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:42:15.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.086+0000 7fed64a51640 1 Processor -- start 2023-11-18T20:42:15.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.086+0000 7fed64a51640 1 -- start start 2023-11-18T20:42:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.087+0000 7fed64a51640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed600c3bc0 0x7fed600a5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.087+0000 7fed64a51640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed600724f0 0x7fed600c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.087+0000 7fed64a51640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600a5780 con 0x7fed600c2750 2023-11-18T20:42:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.087+0000 7fed64a51640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed600aadc0 con 0x7fed600c3bc0 2023-11-18T20:42:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.087+0000 7fed64a51640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600c4170 con 0x7fed600724f0 2023-11-18T20:42:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.088+0000 7fed5e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed600c3bc0 0x7fed600a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.088+0000 7fed5ed9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fed600c2750 0x7fed60154500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35862/0 (socket says 172.21.15.132:35862) 2023-11-18T20:42:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.088+0000 7fed5ed9d640 1 -- 172.21.15.132:0/4174675114 learned_addr learned my addr 172.21.15.132:0/4174675114 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:15.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.088+0000 7fed5e59c640 1 -- 172.21.15.132:0/4174675114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed600724f0 msgr2=0x7fed600c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:15.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.088+0000 7fed5e59c640 1 --2- 172.21.15.132:0/4174675114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed600724f0 0x7fed600c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.088+0000 7fed5e59c640 1 -- 172.21.15.132:0/4174675114 >> v1:172.21.15.132:6789/0 conn(0x7fed600c2750 legacy=0x7fed60154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.088+0000 7fed5dd9b640 1 -- 172.21.15.132:0/4174675114 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045070106 0 0) 0x7fed600a5780 con 0x7fed600c2750 2023-11-18T20:42:15.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.088+0000 7fed5e59c640 1 -- 172.21.15.132:0/4174675114 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600c4450 con 0x7fed600c3bc0 2023-11-18T20:42:15.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.089+0000 7fed5e59c640 1 --2- 172.21.15.132:0/4174675114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c3bc0 0x7fed600a5240 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fed500097a0 tx=0x7fed5002da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f3a807d56f7a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed5dd9b640 1 -- 172.21.15.132:0/4174675114 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50031870 con 0x7fed600c3bc0 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed5dd9b640 1 -- 172.21.15.132:0/4174675114 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed500319d0 con 0x7fed600c3bc0 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed5dd9b640 1 -- 172.21.15.132:0/4174675114 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50031d60 con 0x7fed600c3bc0 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed64a51640 1 -- 172.21.15.132:0/4174675114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c3bc0 msgr2=0x7fed600a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed64a51640 1 --2- 172.21.15.132:0/4174675114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c3bc0 0x7fed600a5240 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fed500097a0 tx=0x7fed5002da50 comp rx=0 tx=0).stop 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed64a51640 1 -- 172.21.15.132:0/4174675114 shutdown_connections 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed64a51640 1 --2- 172.21.15.132:0/4174675114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed600724f0 0x7fed600c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed64a51640 1 --2- 172.21.15.132:0/4174675114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c3bc0 0x7fed600a5240 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.090+0000 7fed64a51640 1 -- 172.21.15.132:0/4174675114 >> 172.21.15.132:0/4174675114 conn(0x7fed6006a500 msgr2=0x7fed6006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.091+0000 7fed64a51640 1 -- 172.21.15.132:0/4174675114 shutdown_connections 2023-11-18T20:42:15.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.091+0000 7fed64a51640 1 -- 172.21.15.132:0/4174675114 wait complete. 2023-11-18T20:42:15.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.092+0000 7fed64a51640 1 Processor -- start 2023-11-18T20:42:15.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.092+0000 7fed64a51640 1 -- start start 2023-11-18T20:42:15.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.093+0000 7fed64a51640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed600724f0 0x7fed6014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.093+0000 7fed64a51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c2750 0x7fed6014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.093+0000 7fed64a51640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed600c3bc0 0x7fed601ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.093+0000 7fed64a51640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed601dcd10 con 0x7fed600c2750 2023-11-18T20:42:15.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.093+0000 7fed64a51640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600722c0 con 0x7fed600c3bc0 2023-11-18T20:42:15.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.093+0000 7fed64a51640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed60071fe0 con 0x7fed600724f0 2023-11-18T20:42:15.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed57fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c2750 0x7fed6014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed57fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c2750 0x7fed6014ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50762/0 (socket says 172.21.15.132:50762) 2023-11-18T20:42:15.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed57fff640 1 -- 172.21.15.132:0/562422806 learned_addr learned my addr 172.21.15.132:0/562422806 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:15.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed57fff640 1 -- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed600724f0 msgr2=0x7fed6014c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed57fff640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed600724f0 0x7fed6014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed57fff640 1 -- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed600c3bc0 msgr2=0x7fed601ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed5ed9d640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed600c3bc0 0x7fed601ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed57fff640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed600c3bc0 0x7fed601ed570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.094+0000 7fed57fff640 1 -- 172.21.15.132:0/562422806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50009400 con 0x7fed600c2750 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.095+0000 7fed57fff640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c2750 0x7fed6014ba80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fed4800b410 tx=0x7fed4800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.095+0000 7fed56ffd640 1 -- 172.21.15.132:0/562422806 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48011830 con 0x7fed600c2750 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.095+0000 7fed56ffd640 1 -- 172.21.15.132:0/562422806 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed480119b0 con 0x7fed600c2750 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.095+0000 7fed56ffd640 1 -- 172.21.15.132:0/562422806 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48011d60 con 0x7fed600c2750 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.095+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed601ee090 con 0x7fed600c2750 2023-11-18T20:42:15.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.095+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed600707b0 con 0x7fed600c2750 2023-11-18T20:42:15.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.097+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed600709d0 con 0x7fed600c2750 2023-11-18T20:42:15.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.098+0000 7fed56ffd640 1 -- 172.21.15.132:0/562422806 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed4801a400 con 0x7fed600c2750 2023-11-18T20:42:15.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.100+0000 7fed56ffd640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed4006ae40 0x7fed4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.100+0000 7fed56ffd640 1 -- 172.21.15.132:0/562422806 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7fed48089870 con 0x7fed600c2750 2023-11-18T20:42:15.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.101+0000 7fed5e59c640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed4006ae40 0x7fed4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.102+0000 7fed5e59c640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed4006ae40 0x7fed4006d300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fed50038000 tx=0x7fed50032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.106+0000 7fed56ffd640 1 -- 172.21.15.132:0/562422806 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed48054840 con 0x7fed600c2750 2023-11-18T20:42:15.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.300+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed60068350 con 0x7fed600c2750 2023-11-18T20:42:15.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.304+0000 7fed56ffd640 1 -- 172.21.15.132:0/562422806 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16868 (secure 0 0 0) 0x7fed48015090 con 0x7fed600c2750 2023-11-18T20:42:15.306 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:15.306 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":85,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:42:14.846825+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/726664783":"2023-11-19T20:42:11.835954+0000","172.21.15.132:6833/726664783":"2023-11-19T20:42:11.835954+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:42:15.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.308+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed4006ae40 msgr2=0x7fed4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.308+0000 7fed64a51640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed4006ae40 0x7fed4006d300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fed50038000 tx=0x7fed50032000 comp rx=0 tx=0).stop 2023-11-18T20:42:15.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.308+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c2750 msgr2=0x7fed6014ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.308+0000 7fed64a51640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c2750 0x7fed6014ba80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fed4800b410 tx=0x7fed4800b8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.309+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 shutdown_connections 2023-11-18T20:42:15.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.309+0000 7fed64a51640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed4006ae40 0x7fed4006d300 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.309+0000 7fed64a51640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed600c3bc0 0x7fed601ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.309+0000 7fed64a51640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600c2750 0x7fed6014ba80 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.309+0000 7fed64a51640 1 --2- 172.21.15.132:0/562422806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed600724f0 0x7fed6014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.309+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 >> 172.21.15.132:0/562422806 conn(0x7fed6006a500 msgr2=0x7fed600a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.310+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 shutdown_connections 2023-11-18T20:42:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.310+0000 7fed64a51640 1 -- 172.21.15.132:0/562422806 wait complete. 2023-11-18T20:42:15.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:37:52.703775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-18T20:41:33.270522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-18T20:41:33.924631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:42:15.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:42:15.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.540+0000 7f5e6293e640 1 Processor -- start 2023-11-18T20:42:15.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.541+0000 7f5e6293e640 1 -- start start 2023-11-18T20:42:15.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.542+0000 7f5e6293e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e5c06d0a0 0x7f5e5c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.542+0000 7f5e6293e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e5c0c3ea0 0x7f5e5c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.542+0000 7f5e6293e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c0c64a0 con 0x7f5e5c14fd30 2023-11-18T20:42:15.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.542+0000 7f5e6293e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c0c5c00 con 0x7f5e5c0c3ea0 2023-11-18T20:42:15.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.542+0000 7f5e6293e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c0c5ee0 con 0x7f5e5c06d0a0 2023-11-18T20:42:15.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.543+0000 7f5e60edb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e5c0c3ea0 0x7f5e5c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.543+0000 7f5e60edb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e5c0c3ea0 0x7f5e5c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50770/0 (socket says 172.21.15.132:50770) 2023-11-18T20:42:15.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.543+0000 7f5e60edb640 1 -- 172.21.15.132:0/1763694052 learned_addr learned my addr 172.21.15.132:0/1763694052 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:15.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.543+0000 7f5e60edb640 1 -- 172.21.15.132:0/1763694052 >> v2:172.21.15.161:3300/0 conn(0x7f5e5c06d0a0 msgr2=0x7f5e5c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:15.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.543+0000 7f5e53fff640 1 --2- 172.21.15.132:0/1763694052 >> v2:172.21.15.161:3300/0 conn(0x7f5e5c06d0a0 0x7f5e5c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.543+0000 7f5e60edb640 1 --2- 172.21.15.132:0/1763694052 >> v2:172.21.15.161:3300/0 conn(0x7f5e5c06d0a0 0x7f5e5c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.543+0000 7f5e60edb640 1 -- 172.21.15.132:0/1763694052 >> v1:172.21.15.161:6789/0 conn(0x7f5e5c14fd30 legacy=0x7f5e5c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:15.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.543+0000 7f5e60edb640 1 -- 172.21.15.132:0/1763694052 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0c61c0 con 0x7f5e5c0c3ea0 2023-11-18T20:42:15.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.544+0000 7f5e60edb640 1 --2- 172.21.15.132:0/1763694052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c0c3ea0 0x7f5e5c0c4330 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c06b460 tx=0x7f5e5402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4ad0f30a8f6ecd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e5b7fe640 1 -- 172.21.15.132:0/1763694052 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5402ca80 con 0x7f5e5c0c3ea0 2023-11-18T20:42:15.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e5b7fe640 1 -- 172.21.15.132:0/1763694052 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5402cbe0 con 0x7f5e5c0c3ea0 2023-11-18T20:42:15.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e5b7fe640 1 -- 172.21.15.132:0/1763694052 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540343f0 con 0x7f5e5c0c3ea0 2023-11-18T20:42:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e6293e640 1 -- 172.21.15.132:0/1763694052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c0c3ea0 msgr2=0x7f5e5c0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e6293e640 1 --2- 172.21.15.132:0/1763694052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c0c3ea0 0x7f5e5c0c4330 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c06b460 tx=0x7f5e5402bee0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e6293e640 1 -- 172.21.15.132:0/1763694052 shutdown_connections 2023-11-18T20:42:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e6293e640 1 --2- 172.21.15.132:0/1763694052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c0c3ea0 0x7f5e5c0c4330 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e6293e640 1 --2- 172.21.15.132:0/1763694052 >> v2:172.21.15.161:3300/0 conn(0x7f5e5c06d0a0 0x7f5e5c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.545+0000 7f5e6293e640 1 -- 172.21.15.132:0/1763694052 >> 172.21.15.132:0/1763694052 conn(0x7f5e5c06a500 msgr2=0x7f5e5c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.546+0000 7f5e6293e640 1 -- 172.21.15.132:0/1763694052 shutdown_connections 2023-11-18T20:42:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.546+0000 7f5e6293e640 1 -- 172.21.15.132:0/1763694052 wait complete. 2023-11-18T20:42:15.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.547+0000 7f5e6293e640 1 Processor -- start 2023-11-18T20:42:15.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.547+0000 7f5e6293e640 1 -- start start 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.548+0000 7f5e6293e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c06d0a0 0x7f5e5c1ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.548+0000 7f5e6293e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e5c0c3ea0 0x7f5e5c0a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.548+0000 7f5e6293e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c14fd30 0x7f5e5c14ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.548+0000 7f5e6293e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c1ee6e0 con 0x7f5e5c14fd30 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.548+0000 7f5e6293e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0a9090 con 0x7f5e5c06d0a0 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.548+0000 7f5e6293e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c156180 con 0x7f5e5c0c3ea0 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c14fd30 0x7f5e5c14ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c14fd30 0x7f5e5c14ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50786/0 (socket says 172.21.15.132:50786) 2023-11-18T20:42:15.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 -- 172.21.15.132:0/3706657543 learned_addr learned my addr 172.21.15.132:0/3706657543 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:15.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e5bfff640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c06d0a0 0x7f5e5c1ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e53fff640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e5c0c3ea0 0x7f5e5c0a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 -- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e5c0c3ea0 msgr2=0x7f5e5c0a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e5c0c3ea0 0x7f5e5c0a6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 -- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c06d0a0 msgr2=0x7f5e5c1ee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c06d0a0 0x7f5e5c1ee1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 -- 172.21.15.132:0/3706657543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009b30 con 0x7f5e5c14fd30 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.549+0000 7f5e60edb640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c14fd30 0x7f5e5c14ea20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009f40 tx=0x7f5e54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.550+0000 7f5e597fa640 1 -- 172.21.15.132:0/3706657543 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54009510 con 0x7f5e5c14fd30 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.550+0000 7f5e597fa640 1 -- 172.21.15.132:0/3706657543 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5403e450 con 0x7f5e5c14fd30 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.550+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c156460 con 0x7f5e5c14fd30 2023-11-18T20:42:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.550+0000 7f5e597fa640 1 -- 172.21.15.132:0/3706657543 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5403e7e0 con 0x7f5e5c14fd30 2023-11-18T20:42:15.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.550+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c1dbee0 con 0x7f5e5c14fd30 2023-11-18T20:42:15.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.551+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c0a91d0 con 0x7f5e5c14fd30 2023-11-18T20:42:15.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.552+0000 7f5e597fa640 1 -- 172.21.15.132:0/3706657543 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e5402cd50 con 0x7f5e5c14fd30 2023-11-18T20:42:15.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.553+0000 7f5e597fa640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e3c06ae70 0x7f5e3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.553+0000 7f5e597fa640 1 -- 172.21.15.132:0/3706657543 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f5e540abfe0 con 0x7f5e5c14fd30 2023-11-18T20:42:15.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.554+0000 7f5e5bfff640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e3c06ae70 0x7f5e3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.555+0000 7f5e5bfff640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e3c06ae70 0x7f5e3c06d330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c004ea0 tx=0x7f5e4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.557+0000 7f5e597fa640 1 -- 172.21.15.132:0/3706657543 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e54077010 con 0x7f5e5c14fd30 2023-11-18T20:42:15.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.745+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e5c1dc0d0 con 0x7f5e5c14fd30 2023-11-18T20:42:15.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.746+0000 7f5e597fa640 1 -- 172.21.15.132:0/3706657543 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e5407a630 con 0x7f5e5c14fd30 2023-11-18T20:42:15.747 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-11-18T20:42:15.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.748+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e3c06ae70 msgr2=0x7f5e3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.748+0000 7f5e6293e640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e3c06ae70 0x7f5e3c06d330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c004ea0 tx=0x7f5e4c009040 comp rx=0 tx=0).stop 2023-11-18T20:42:15.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c14fd30 msgr2=0x7f5e5c14ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c14fd30 0x7f5e5c14ea20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009f40 tx=0x7f5e54004a40 comp rx=0 tx=0).stop 2023-11-18T20:42:15.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 shutdown_connections 2023-11-18T20:42:15.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5e3c06ae70 0x7f5e3c06d330 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e5c14fd30 0x7f5e5c14ea20 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e5c0c3ea0 0x7f5e5c0a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 --2- 172.21.15.132:0/3706657543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c06d0a0 0x7f5e5c1ee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 >> 172.21.15.132:0/3706657543 conn(0x7f5e5c06a500 msgr2=0x7f5e5c0c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:15.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 shutdown_connections 2023-11-18T20:42:15.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.749+0000 7f5e6293e640 1 -- 172.21.15.132:0/3706657543 wait complete. 2023-11-18T20:42:15.768 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-18T20:42:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.981+0000 7f6f62256640 1 Processor -- start 2023-11-18T20:42:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.982+0000 7f6f62256640 1 -- start start 2023-11-18T20:42:15.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.983+0000 7f6f62256640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6f5c0c45d0 0x7f6f5c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.983+0000 7f6f62256640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c3340 0x7f6f5c156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.983+0000 7f6f62256640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0bfdc0 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.983+0000 7f6f62256640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c06e390 con 0x7f6f5c0c45d0 2023-11-18T20:42:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.983+0000 7f6f62256640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c06ddd0 con 0x7f6f5c0c3340 2023-11-18T20:42:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.983+0000 7f6f53fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6f5c0c45d0 0x7f6f5c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.983+0000 7f6f53fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6f5c0c45d0 0x7f6f5c155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50794/0 (socket says 172.21.15.132:50794) 2023-11-18T20:42:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.983+0000 7f6f53fff640 1 -- 172.21.15.132:0/2369113926 learned_addr learned my addr 172.21.15.132:0/2369113926 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:15.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.984+0000 7f6f53fff640 1 -- 172.21.15.132:0/2369113926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c3340 msgr2=0x7f6f5c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:15.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.984+0000 7f6f5bfff640 1 --2- 172.21.15.132:0/2369113926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c3340 0x7f6f5c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.984+0000 7f6f53fff640 1 --2- 172.21.15.132:0/2369113926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c3340 0x7f6f5c156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.984+0000 7f6f53fff640 1 -- 172.21.15.132:0/2369113926 >> v1:172.21.15.161:6789/0 conn(0x7f6f5c0c5ec0 legacy=0x7f6f5c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.984+0000 7f6f53fff640 1 -- 172.21.15.132:0/2369113926 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c06e0b0 con 0x7f6f5c0c45d0 2023-11-18T20:42:15.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.985+0000 7f6f53fff640 1 --2- 172.21.15.132:0/2369113926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c45d0 0x7f6f5c155e30 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f6f440098a0 tx=0x7f6f4402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a074f2103a4fe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.985+0000 7f6f5affd640 1 -- 172.21.15.132:0/2369113926 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440317c0 con 0x7f6f5c0c45d0 2023-11-18T20:42:15.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.986+0000 7f6f5affd640 1 -- 172.21.15.132:0/2369113926 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44031920 con 0x7f6f5c0c45d0 2023-11-18T20:42:15.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.986+0000 7f6f5affd640 1 -- 172.21.15.132:0/2369113926 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44031cb0 con 0x7f6f5c0c45d0 2023-11-18T20:42:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.986+0000 7f6f62256640 1 -- 172.21.15.132:0/2369113926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c45d0 msgr2=0x7f6f5c155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.986+0000 7f6f62256640 1 --2- 172.21.15.132:0/2369113926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c45d0 0x7f6f5c155e30 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f6f440098a0 tx=0x7f6f4402b860 comp rx=0 tx=0).stop 2023-11-18T20:42:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.986+0000 7f6f62256640 1 -- 172.21.15.132:0/2369113926 shutdown_connections 2023-11-18T20:42:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.986+0000 7f6f62256640 1 --2- 172.21.15.132:0/2369113926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c3340 0x7f6f5c156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.986+0000 7f6f62256640 1 --2- 172.21.15.132:0/2369113926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c45d0 0x7f6f5c155e30 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.986+0000 7f6f62256640 1 -- 172.21.15.132:0/2369113926 >> 172.21.15.132:0/2369113926 conn(0x7f6f5c06a500 msgr2=0x7f6f5c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.987+0000 7f6f62256640 1 -- 172.21.15.132:0/2369113926 shutdown_connections 2023-11-18T20:42:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.987+0000 7f6f62256640 1 -- 172.21.15.132:0/2369113926 wait complete. 2023-11-18T20:42:15.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.988+0000 7f6f62256640 1 Processor -- start 2023-11-18T20:42:15.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.989+0000 7f6f62256640 1 -- start start 2023-11-18T20:42:15.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f62256640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0c3340 0x7f6f5c1e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f62256640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c45d0 0x7f6f5c14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f62256640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c5ec0 0x7f6f5c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f62256640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0a6880 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f62256640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0a6b20 con 0x7f6f5c0c3340 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f62256640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0a6e00 con 0x7f6f5c0c45d0 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c5ec0 0x7f6f5c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c5ec0 0x7f6f5c14ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50798/0 (socket says 172.21.15.132:50798) 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5bfff640 1 -- 172.21.15.132:0/225816802 learned_addr learned my addr 172.21.15.132:0/225816802 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5b7fe640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0c3340 0x7f6f5c1e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5bfff640 1 -- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c45d0 msgr2=0x7f6f5c14b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5bfff640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c45d0 0x7f6f5c14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5bfff640 1 -- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0c3340 msgr2=0x7f6f5c1e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5bfff640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0c3340 0x7f6f5c1e9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5bfff640 1 -- 172.21.15.132:0/225816802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f440094d0 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.990+0000 7f6f5b7fe640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0c3340 0x7f6f5c1e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.991+0000 7f6f5bfff640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c5ec0 0x7f6f5c14ea90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400cd70 tx=0x7f6f5400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.991+0000 7f6f58ff9640 1 -- 172.21.15.132:0/225816802 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54003b90 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.991+0000 7f6f58ff9640 1 -- 172.21.15.132:0/225816802 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f54003cf0 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.991+0000 7f6f58ff9640 1 -- 172.21.15.132:0/225816802 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54004240 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.991+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c0a70e0 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.991+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c14b730 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.992+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c0a7600 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.993+0000 7f6f58ff9640 1 -- 172.21.15.132:0/225816802 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f540043a0 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.994+0000 7f6f58ff9640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f3c06ae40 0x7f6f3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.994+0000 7f6f58ff9640 1 -- 172.21.15.132:0/225816802 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f6f54012070 con 0x7f6f5c0c5ec0 2023-11-18T20:42:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.995+0000 7f6f5b7fe640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f3c06ae40 0x7f6f3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:15.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.996+0000 7f6f5b7fe640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f3c06ae40 0x7f6f3c06d300 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c1587a0 tx=0x7f6f4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:15.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:15.998+0000 7f6f58ff9640 1 -- 172.21.15.132:0/225816802 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f5c0a7600 con 0x7f6f5c0c5ec0 2023-11-18T20:42:16.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.188+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f5c0a7600 con 0x7f6f5c0c5ec0 2023-11-18T20:42:16.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.189+0000 7f6f58ff9640 1 -- 172.21.15.132:0/225816802 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v85) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6f5c0a7600 con 0x7f6f5c0c5ec0 2023-11-18T20:42:16.191 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-11-18T20:42:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.192+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f3c06ae40 msgr2=0x7f6f3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.192+0000 7f6f62256640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f3c06ae40 0x7f6f3c06d300 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c1587a0 tx=0x7f6f4c009040 comp rx=0 tx=0).stop 2023-11-18T20:42:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.192+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c5ec0 msgr2=0x7f6f5c14ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.192+0000 7f6f62256640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c5ec0 0x7f6f5c14ea90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400cd70 tx=0x7f6f5400a660 comp rx=0 tx=0).stop 2023-11-18T20:42:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.193+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 shutdown_connections 2023-11-18T20:42:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.193+0000 7f6f62256640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f6f3c06ae40 0x7f6f3c06d300 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.193+0000 7f6f62256640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f5c0c5ec0 0x7f6f5c14ea90 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.193+0000 7f6f62256640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f5c0c45d0 0x7f6f5c14b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.193+0000 7f6f62256640 1 --2- 172.21.15.132:0/225816802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0c3340 0x7f6f5c1e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.193+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 >> 172.21.15.132:0/225816802 conn(0x7f6f5c06a500 msgr2=0x7f6f5c0a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.193+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 shutdown_connections 2023-11-18T20:42:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.193+0000 7f6f62256640 1 -- 172.21.15.132:0/225816802 wait complete. 2023-11-18T20:42:16.211 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-18T20:42:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.425+0000 7f5960e21640 1 Processor -- start 2023-11-18T20:42:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.426+0000 7f5960e21640 1 -- start start 2023-11-18T20:42:16.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.427+0000 7f5960e21640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f595c14e810 0x7f595c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.427+0000 7f5960e21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c06b7d0 0x7f595c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.427+0000 7f5960e21640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c0bd8d0 con 0x7f595c0c7e90 2023-11-18T20:42:16.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.427+0000 7f5960e21640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c0c6e60 con 0x7f595c14e810 2023-11-18T20:42:16.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.427+0000 7f5960e21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c155600 con 0x7f595c06b7d0 2023-11-18T20:42:16.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f5959d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f595c0c7e90 0x7f595c0c4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35870/0 (socket says 172.21.15.132:35870) 2023-11-18T20:42:16.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f5959d9b640 1 -- 172.21.15.132:0/303610728 learned_addr learned my addr 172.21.15.132:0/303610728 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595a59c640 1 --2- 172.21.15.132:0/303610728 >> v2:172.21.15.161:3300/0 conn(0x7f595c14e810 0x7f595c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595ad9d640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c06b7d0 0x7f595c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808521568 0 0) 0x7f595c0bd8d0 con 0x7f595c0c7e90 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5948003520 con 0x7f595c0c7e90 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1860130241 0 0) 0x7f5948003520 con 0x7f595c0c7e90 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c06b7d0 msgr2=0x7f595c06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c06b7d0 0x7f595c06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 >> v2:172.21.15.161:3300/0 conn(0x7f595c14e810 msgr2=0x7f595c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 --2- 172.21.15.132:0/303610728 >> v2:172.21.15.161:3300/0 conn(0x7f595c14e810 0x7f595c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0c70d0 con 0x7f595c0c7e90 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.428+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f5944001670 con 0x7f595c0c7e90 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 >> v1:172.21.15.132:6789/0 conn(0x7f595c0c7e90 legacy=0x7f595c0c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f595959a640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c06b7d0 0x7f5948003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f595959a640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5948003ef0 0x7f59480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f595959a640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948004d00 0x7f5948005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0c6e60 con 0x7f5948003ef0 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c155600 con 0x7f5948004d00 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594800b9d0 con 0x7f595c06b7d0 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f5959d9b640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5948003ef0 0x7f59480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f5959d9b640 1 -- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c06b7d0 msgr2=0x7f5948003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f5959d9b640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c06b7d0 0x7f5948003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f5959d9b640 1 -- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948004d00 msgr2=0x7f5948005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f595ad9d640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948004d00 0x7f5948005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f5959d9b640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948004d00 0x7f5948005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.429+0000 7f5959d9b640 1 -- 172.21.15.132:0/303610728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948003520 con 0x7f5948003ef0 2023-11-18T20:42:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.430+0000 7f5959d9b640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5948003ef0 0x7f59480047c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f594400c240 tx=0x7f59480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28640bdc5efdeff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944005ad0 con 0x7f5948003ef0 2023-11-18T20:42:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5944005c30 con 0x7f5948003ef0 2023-11-18T20:42:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f595959a640 1 -- 172.21.15.132:0/303610728 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594402cad0 con 0x7f5948003ef0 2023-11-18T20:42:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f5960e21640 1 -- 172.21.15.132:0/303610728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5948003ef0 msgr2=0x7f59480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f5960e21640 1 --2- 172.21.15.132:0/303610728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5948003ef0 0x7f59480047c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f594400c240 tx=0x7f59480057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f595ad9d640 1 -- 172.21.15.132:0/303610728 reap_dead start 2023-11-18T20:42:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f5960e21640 1 -- 172.21.15.132:0/303610728 shutdown_connections 2023-11-18T20:42:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f5960e21640 1 -- 172.21.15.132:0/303610728 >> 172.21.15.132:0/303610728 conn(0x7f595c0ca170 msgr2=0x7f595c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f5960e21640 1 -- 172.21.15.132:0/303610728 shutdown_connections 2023-11-18T20:42:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.431+0000 7f5960e21640 1 -- 172.21.15.132:0/303610728 wait complete. 2023-11-18T20:42:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.433+0000 7f5960e21640 1 Processor -- start 2023-11-18T20:42:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.433+0000 7f5960e21640 1 -- start start 2023-11-18T20:42:16.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5960e21640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948003ef0 0x7f595c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5960e21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f595c0c1950 0x7f595c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5960e21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c150260 0x7f595c1471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5960e21640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c1edbd0 con 0x7f595c0c1950 2023-11-18T20:42:16.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5960e21640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0c1ea0 con 0x7f5948003ef0 2023-11-18T20:42:16.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5960e21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c1ed580 con 0x7f595c150260 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5959d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f595c0c1950 0x7f595c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5959d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f595c0c1950 0x7f595c14fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50820/0 (socket says 172.21.15.132:50820) 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.434+0000 7f5959d9b640 1 -- 172.21.15.132:0/2998435591 learned_addr learned my addr 172.21.15.132:0/2998435591 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f595a59c640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948003ef0 0x7f595c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5959d9b640 1 -- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c150260 msgr2=0x7f595c1471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5959d9b640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c150260 0x7f595c1471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5959d9b640 1 -- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948003ef0 msgr2=0x7f595c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5959d9b640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948003ef0 0x7f595c1535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5959d9b640 1 -- 172.21.15.132:0/2998435591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c1ed860 con 0x7f595c0c1950 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5959d9b640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f595c0c1950 0x7f595c14fd20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f594402c450 tx=0x7f5944001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5952ffd640 1 -- 172.21.15.132:0/2998435591 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944039030 con 0x7f595c0c1950 2023-11-18T20:42:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5952ffd640 1 -- 172.21.15.132:0/2998435591 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594402ccc0 con 0x7f595c0c1950 2023-11-18T20:42:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c153b00 con 0x7f595c0c1950 2023-11-18T20:42:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.435+0000 7f5952ffd640 1 -- 172.21.15.132:0/2998435591 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594403c040 con 0x7f595c0c1950 2023-11-18T20:42:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.436+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c0c2180 con 0x7f595c0c1950 2023-11-18T20:42:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.437+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c1ed9f0 con 0x7f595c0c1950 2023-11-18T20:42:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.437+0000 7f5952ffd640 1 -- 172.21.15.132:0/2998435591 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5944032070 con 0x7f595c0c1950 2023-11-18T20:42:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.438+0000 7f5952ffd640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593c06ae40 0x7f593c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.439+0000 7f5952ffd640 1 -- 172.21.15.132:0/2998435591 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f59440aab60 con 0x7f595c0c1950 2023-11-18T20:42:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.439+0000 7f595a59c640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593c06ae40 0x7f593c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.440+0000 7f595a59c640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593c06ae40 0x7f593c06d300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f594c007520 tx=0x7f594c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:16.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.443+0000 7f5952ffd640 1 -- 172.21.15.132:0/2998435591 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5944075a10 con 0x7f595c0c1950 2023-11-18T20:42:16.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.628+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f595c068350 con 0x7f595c0c1950 2023-11-18T20:42:16.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.629+0000 7f5952ffd640 1 -- 172.21.15.132:0/2998435591 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v85) v1 ==== 101+0+11 (secure 0 0 0) 0x7f5944079030 con 0x7f595c0c1950 2023-11-18T20:42:16.630 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-11-18T20:42:16.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593c06ae40 msgr2=0x7f593c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593c06ae40 0x7f593c06d300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f594c007520 tx=0x7f594c00b040 comp rx=0 tx=0).stop 2023-11-18T20:42:16.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f595c0c1950 msgr2=0x7f595c14fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f595c0c1950 0x7f595c14fd20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f594402c450 tx=0x7f5944001a00 comp rx=0 tx=0).stop 2023-11-18T20:42:16.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 shutdown_connections 2023-11-18T20:42:16.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f593c06ae40 0x7f593c06d300 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f595c150260 0x7f595c1471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f595c0c1950 0x7f595c14fd20 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 --2- 172.21.15.132:0/2998435591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5948003ef0 0x7f595c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 >> 172.21.15.132:0/2998435591 conn(0x7f595c0ca170 msgr2=0x7f595c0aa250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:16.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 shutdown_connections 2023-11-18T20:42:16.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.632+0000 7f5960e21640 1 -- 172.21.15.132:0/2998435591 wait complete. 2023-11-18T20:42:16.651 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:42:16.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.849+0000 7f2e993a9640 1 Processor -- start 2023-11-18T20:42:16.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.849+0000 7f2e993a9640 1 -- start start 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.850+0000 7f2e993a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 0x7f2e940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.850+0000 7f2e993a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e940a9b40 0x7f2e940c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.850+0000 7f2e993a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e940c06c0 con 0x7f2e940c1500 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.850+0000 7f2e993a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e940a5820 con 0x7f2e940a9b40 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.850+0000 7f2e993a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940c1020 con 0x7f2e94155490 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.850+0000 7f2e937fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e940a9b40 0x7f2e940c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.850+0000 7f2e937fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e940a9b40 0x7f2e940c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50834/0 (socket says 172.21.15.132:50834) 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.850+0000 7f2e937fe640 1 -- 172.21.15.132:0/755180020 learned_addr learned my addr 172.21.15.132:0/755180020 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:16.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.851+0000 7f2e92ffd640 1 --2- 172.21.15.132:0/755180020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 0x7f2e940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.851+0000 7f2e937fe640 1 -- 172.21.15.132:0/755180020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 msgr2=0x7f2e940a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.851+0000 7f2e937fe640 1 --2- 172.21.15.132:0/755180020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 0x7f2e940a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.851+0000 7f2e937fe640 1 -- 172.21.15.132:0/755180020 >> v1:172.21.15.161:6789/0 conn(0x7f2e940c1500 legacy=0x7f2e940a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.851+0000 7f2e937fe640 1 -- 172.21.15.132:0/755180020 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940c0910 con 0x7f2e940a9b40 2023-11-18T20:42:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.852+0000 7f2e937fe640 1 --2- 172.21.15.132:0/755180020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940a9b40 0x7f2e940c24d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009e50 tx=0x7f2e8c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed5f14da4568215 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.852+0000 7f2e927fc640 1 -- 172.21.15.132:0/755180020 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c02ca70 con 0x7f2e940a9b40 2023-11-18T20:42:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.852+0000 7f2e927fc640 1 -- 172.21.15.132:0/755180020 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c02cbd0 con 0x7f2e940a9b40 2023-11-18T20:42:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.852+0000 7f2e927fc640 1 -- 172.21.15.132:0/755180020 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0343f0 con 0x7f2e940a9b40 2023-11-18T20:42:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.853+0000 7f2e993a9640 1 -- 172.21.15.132:0/755180020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940a9b40 msgr2=0x7f2e940c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.853+0000 7f2e993a9640 1 --2- 172.21.15.132:0/755180020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940a9b40 0x7f2e940c24d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009e50 tx=0x7f2e8c02bed0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.853+0000 7f2e993a9640 1 -- 172.21.15.132:0/755180020 shutdown_connections 2023-11-18T20:42:16.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.853+0000 7f2e993a9640 1 --2- 172.21.15.132:0/755180020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940a9b40 0x7f2e940c24d0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.853+0000 7f2e993a9640 1 --2- 172.21.15.132:0/755180020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 0x7f2e940a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.853+0000 7f2e993a9640 1 -- 172.21.15.132:0/755180020 >> 172.21.15.132:0/755180020 conn(0x7f2e9406a500 msgr2=0x7f2e9406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:16.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.853+0000 7f2e993a9640 1 -- 172.21.15.132:0/755180020 shutdown_connections 2023-11-18T20:42:16.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.853+0000 7f2e993a9640 1 -- 172.21.15.132:0/755180020 wait complete. 2023-11-18T20:42:16.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.855+0000 7f2e993a9640 1 Processor -- start 2023-11-18T20:42:16.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.855+0000 7f2e993a9640 1 -- start start 2023-11-18T20:42:16.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e993a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940c1500 0x7f2e940718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e993a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 0x7f2e940aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e993a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9414d0a0 0x7f2e9414c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e993a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940bb390 con 0x7f2e940c1500 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e993a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94071e10 con 0x7f2e9414d0a0 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e993a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9414d550 con 0x7f2e94155490 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e92ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940c1500 0x7f2e940718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e92ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940c1500 0x7f2e940718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50844/0 (socket says 172.21.15.132:50844) 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e92ffd640 1 -- 172.21.15.132:0/1227815862 learned_addr learned my addr 172.21.15.132:0/1227815862 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e92ffd640 1 -- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 msgr2=0x7f2e940aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e92ffd640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 0x7f2e940aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e92ffd640 1 -- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9414d0a0 msgr2=0x7f2e9414c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e92ffd640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9414d0a0 0x7f2e9414c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.857+0000 7f2e92ffd640 1 -- 172.21.15.132:0/1227815862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c009b30 con 0x7f2e940c1500 2023-11-18T20:42:16.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.858+0000 7f2e92ffd640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940c1500 0x7f2e940718d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400c7f0 tx=0x7f2e8400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:16.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.858+0000 7f2e8b7fe640 1 -- 172.21.15.132:0/1227815862 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84004220 con 0x7f2e940c1500 2023-11-18T20:42:16.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.858+0000 7f2e8b7fe640 1 -- 172.21.15.132:0/1227815862 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84004380 con 0x7f2e940c1500 2023-11-18T20:42:16.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.858+0000 7f2e8b7fe640 1 -- 172.21.15.132:0/1227815862 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84007840 con 0x7f2e940c1500 2023-11-18T20:42:16.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.858+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9414cdc0 con 0x7f2e940c1500 2023-11-18T20:42:16.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.858+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e940aac80 con 0x7f2e940c1500 2023-11-18T20:42:16.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.859+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e94068350 con 0x7f2e940c1500 2023-11-18T20:42:16.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.860+0000 7f2e8b7fe640 1 -- 172.21.15.132:0/1227815862 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e84007bb0 con 0x7f2e940c1500 2023-11-18T20:42:16.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.861+0000 7f2e8b7fe640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2e7406ae40 0x7f2e7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:16.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.861+0000 7f2e8b7fe640 1 -- 172.21.15.132:0/1227815862 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f2e840895f0 con 0x7f2e940c1500 2023-11-18T20:42:16.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.862+0000 7f2e8bfff640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2e7406ae40 0x7f2e7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:16.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.863+0000 7f2e8bfff640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2e7406ae40 0x7f2e7406d300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2e940ab050 tx=0x7f2e7c0079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:16.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:16.866+0000 7f2e8b7fe640 1 -- 172.21.15.132:0/1227815862 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e840545c0 con 0x7f2e940c1500 2023-11-18T20:42:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.087+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e9406ab00 con 0x7f2e940c1500 2023-11-18T20:42:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.088+0000 7f2e8b7fe640 1 -- 172.21.15.132:0/1227815862 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f2e84007e60 con 0x7f2e940c1500 2023-11-18T20:42:17.090 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:17.090 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/4114136035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4114136035},{"type":"v1","addr":"172.21.15.132:6835","nonce":4114136035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:34.907589+0000","modified":"2023-11-18T20:41:37.972696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-18T20:42:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 52 2023-11-18T20:42:17.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2e7406ae40 msgr2=0x7f2e7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2e7406ae40 0x7f2e7406d300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2e940ab050 tx=0x7f2e7c0079b0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940c1500 msgr2=0x7f2e940718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940c1500 0x7f2e940718d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400c7f0 tx=0x7f2e8400ccb0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 shutdown_connections 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2e7406ae40 0x7f2e7406d300 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9414d0a0 0x7f2e9414c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e94155490 0x7f2e940aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 --2- 172.21.15.132:0/1227815862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e940c1500 0x7f2e940718d0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 >> 172.21.15.132:0/1227815862 conn(0x7f2e9406a500 msgr2=0x7f2e940c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 shutdown_connections 2023-11-18T20:42:17.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.091+0000 7f2e993a9640 1 -- 172.21.15.132:0/1227815862 wait complete. 2023-11-18T20:42:17.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:42:17.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.305+0000 7f504705d640 1 Processor -- start 2023-11-18T20:42:17.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.305+0000 7f504705d640 1 -- start start 2023-11-18T20:42:17.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.306+0000 7f504705d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f504014fd30 0x7f5040152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.307+0000 7f504705d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50400c64a0 con 0x7f50400c3ea0 2023-11-18T20:42:17.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.307+0000 7f504705d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50400c5c00 con 0x7f504006d0a0 2023-11-18T20:42:17.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.307+0000 7f504705d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50400c5ee0 con 0x7f504014fd30 2023-11-18T20:42:17.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.307+0000 7f5044df9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f504014fd30 0x7f5040152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.307+0000 7f50455fa640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f50400c3ea0 0x7f50400c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35874/0 (socket says 172.21.15.132:35874) 2023-11-18T20:42:17.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.307+0000 7f50455fa640 1 -- 172.21.15.132:0/2901123904 learned_addr learned my addr 172.21.15.132:0/2901123904 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:17.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.308+0000 7f5044df9640 1 -- 172.21.15.132:0/2901123904 >> v1:172.21.15.161:6789/0 conn(0x7f504006d0a0 legacy=0x7f50400a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.308+0000 7f5044df9640 1 -- 172.21.15.132:0/2901123904 >> v1:172.21.15.132:6789/0 conn(0x7f50400c3ea0 legacy=0x7f50400c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.308+0000 7f5044df9640 1 -- 172.21.15.132:0/2901123904 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400c61c0 con 0x7f504014fd30 2023-11-18T20:42:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.309+0000 7f5044df9640 1 --2- 172.21.15.132:0/2901123904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504014fd30 0x7f5040152f20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f50340097a0 tx=0x7f503402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d78b0528726682 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f503f7fe640 1 -- 172.21.15.132:0/2901123904 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034030610 con 0x7f504014fd30 2023-11-18T20:42:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f503f7fe640 1 -- 172.21.15.132:0/2901123904 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5034030770 con 0x7f504014fd30 2023-11-18T20:42:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f503f7fe640 1 -- 172.21.15.132:0/2901123904 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034030b00 con 0x7f504014fd30 2023-11-18T20:42:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f504705d640 1 -- 172.21.15.132:0/2901123904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504014fd30 msgr2=0x7f5040152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f504705d640 1 --2- 172.21.15.132:0/2901123904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504014fd30 0x7f5040152f20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f50340097a0 tx=0x7f503402b960 comp rx=0 tx=0).stop 2023-11-18T20:42:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f504705d640 1 -- 172.21.15.132:0/2901123904 shutdown_connections 2023-11-18T20:42:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f504705d640 1 --2- 172.21.15.132:0/2901123904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504014fd30 0x7f5040152f20 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f504705d640 1 -- 172.21.15.132:0/2901123904 >> 172.21.15.132:0/2901123904 conn(0x7f504006a500 msgr2=0x7f504006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f504705d640 1 -- 172.21.15.132:0/2901123904 shutdown_connections 2023-11-18T20:42:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.310+0000 7f504705d640 1 -- 172.21.15.132:0/2901123904 wait complete. 2023-11-18T20:42:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.312+0000 7f504705d640 1 Processor -- start 2023-11-18T20:42:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.312+0000 7f504705d640 1 -- start start 2023-11-18T20:42:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f504705d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504006d0a0 0x7f50400a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f504705d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50400c3ea0 0x7f50400a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f504705d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f504014fd30 0x7f5040148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f504705d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504014cff0 con 0x7f504006d0a0 2023-11-18T20:42:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f504705d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400a4dc0 con 0x7f504014fd30 2023-11-18T20:42:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f504705d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50400a5030 con 0x7f50400c3ea0 2023-11-18T20:42:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f5044df9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504006d0a0 0x7f50400a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f5044df9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504006d0a0 0x7f50400a90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50868/0 (socket says 172.21.15.132:50868) 2023-11-18T20:42:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.313+0000 7f5044df9640 1 -- 172.21.15.132:0/4027719002 learned_addr learned my addr 172.21.15.132:0/4027719002 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f5044df9640 1 -- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50400c3ea0 msgr2=0x7f50400a9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f5044df9640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50400c3ea0 0x7f50400a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f5044df9640 1 -- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f504014fd30 msgr2=0x7f5040148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f5044df9640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f504014fd30 0x7f5040148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f5044df9640 1 -- 172.21.15.132:0/4027719002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034009400 con 0x7f504006d0a0 2023-11-18T20:42:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f5044df9640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504006d0a0 0x7f50400a90e0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5034009890 tx=0x7f5034004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f503d7fa640 1 -- 172.21.15.132:0/4027719002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503403e040 con 0x7f504006d0a0 2023-11-18T20:42:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f503d7fa640 1 -- 172.21.15.132:0/4027719002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5034039ce0 con 0x7f504006d0a0 2023-11-18T20:42:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f503d7fa640 1 -- 172.21.15.132:0/4027719002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034043680 con 0x7f504006d0a0 2023-11-18T20:42:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5040150400 con 0x7f504006d0a0 2023-11-18T20:42:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.314+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50401509c0 con 0x7f504006d0a0 2023-11-18T20:42:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.315+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5040150150 con 0x7f504006d0a0 2023-11-18T20:42:17.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.316+0000 7f503d7fa640 1 -- 172.21.15.132:0/4027719002 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50340423e0 con 0x7f504006d0a0 2023-11-18T20:42:17.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.317+0000 7f503d7fa640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f502406ae70 0x7f502406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.317+0000 7f503d7fa640 1 -- 172.21.15.132:0/4027719002 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f50340ab890 con 0x7f504006d0a0 2023-11-18T20:42:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.318+0000 7f503ffff640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f502406ae70 0x7f502406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.319+0000 7f503ffff640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f502406ae70 0x7f502406d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f502c000f60 tx=0x7f502c0079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.321+0000 7f503d7fa640 1 -- 172.21.15.132:0/4027719002 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50340767e0 con 0x7f504006d0a0 2023-11-18T20:42:17.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.513+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5040068350 con 0x7f504006d0a0 2023-11-18T20:42:17.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.516+0000 7f503d7fa640 1 -- 172.21.15.132:0/4027719002 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16868 (secure 0 0 0) 0x7f5034048090 con 0x7f504006d0a0 2023-11-18T20:42:17.518 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:17.519 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":85,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:42:14.846825+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/726664783":"2023-11-19T20:42:11.835954+0000","172.21.15.132:6833/726664783":"2023-11-19T20:42:11.835954+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:42:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f502406ae70 msgr2=0x7f502406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f502406ae70 0x7f502406d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f502c000f60 tx=0x7f502c0079b0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504006d0a0 msgr2=0x7f50400a90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504006d0a0 0x7f50400a90e0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5034009890 tx=0x7f5034004730 comp rx=0 tx=0).stop 2023-11-18T20:42:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 shutdown_connections 2023-11-18T20:42:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f502406ae70 0x7f502406d330 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f504014fd30 0x7f5040148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50400c3ea0 0x7f50400a9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 --2- 172.21.15.132:0/4027719002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504006d0a0 0x7f50400a90e0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 >> 172.21.15.132:0/4027719002 conn(0x7f504006a500 msgr2=0x7f50401deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:17.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 shutdown_connections 2023-11-18T20:42:17.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.519+0000 7f504705d640 1 -- 172.21.15.132:0/4027719002 wait complete. 2023-11-18T20:42:17.537 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-18T20:42:17.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:42:17.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.744+0000 7fec5ffff640 1 Processor -- start 2023-11-18T20:42:17.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.744+0000 7fec5ffff640 1 -- start start 2023-11-18T20:42:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.746+0000 7fec5ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec6014c2e0 0x7fec600c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.746+0000 7fec5ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec60072310 0x7fec600a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.746+0000 7fec5ffff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec60071e80 con 0x7fec600c0440 2023-11-18T20:42:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.746+0000 7fec5ffff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec60071470 con 0x7fec6014c2e0 2023-11-18T20:42:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.746+0000 7fec5ffff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6014c6c0 con 0x7fec60072310 2023-11-18T20:42:17.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.746+0000 7fec5e7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fec600c0440 0x7fec60152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35882/0 (socket says 172.21.15.132:35882) 2023-11-18T20:42:17.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.746+0000 7fec5e7fc640 1 -- 172.21.15.132:0/488172540 learned_addr learned my addr 172.21.15.132:0/488172540 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.746+0000 7fec5effd640 1 --2- 172.21.15.132:0/488172540 >> v2:172.21.15.132:3300/0 conn(0x7fec6014c2e0 0x7fec600c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.747+0000 7fec5f7fe640 1 --2- 172.21.15.132:0/488172540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec60072310 0x7fec600a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.747+0000 7fec5dffb640 1 -- 172.21.15.132:0/488172540 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383705972 0 0) 0x7fec60071e80 con 0x7fec600c0440 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.747+0000 7fec5dffb640 1 -- 172.21.15.132:0/488172540 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec4c003520 con 0x7fec600c0440 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.747+0000 7fec5effd640 1 -- 172.21.15.132:0/488172540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec60072310 msgr2=0x7fec600a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.747+0000 7fec5effd640 1 --2- 172.21.15.132:0/488172540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec60072310 0x7fec600a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.747+0000 7fec5effd640 1 -- 172.21.15.132:0/488172540 >> v1:172.21.15.132:6789/0 conn(0x7fec600c0440 legacy=0x7fec60152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.747+0000 7fec5effd640 1 -- 172.21.15.132:0/488172540 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6006fdc0 con 0x7fec6014c2e0 2023-11-18T20:42:17.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.749+0000 7fec5effd640 1 --2- 172.21.15.132:0/488172540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec6014c2e0 0x7fec600c0c80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fec50009d90 tx=0x7fec5002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9db41316bdd349 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:17.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.749+0000 7fec5dffb640 1 -- 172.21.15.132:0/488172540 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5002cb40 con 0x7fec6014c2e0 2023-11-18T20:42:17.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.749+0000 7fec5dffb640 1 -- 172.21.15.132:0/488172540 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5002cca0 con 0x7fec6014c2e0 2023-11-18T20:42:17.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.749+0000 7fec5dffb640 1 -- 172.21.15.132:0/488172540 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50034640 con 0x7fec6014c2e0 2023-11-18T20:42:17.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.750+0000 7fec5ffff640 1 -- 172.21.15.132:0/488172540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec6014c2e0 msgr2=0x7fec600c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.750+0000 7fec5ffff640 1 --2- 172.21.15.132:0/488172540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec6014c2e0 0x7fec600c0c80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fec50009d90 tx=0x7fec5002bd90 comp rx=0 tx=0).stop 2023-11-18T20:42:17.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.750+0000 7fec5ffff640 1 -- 172.21.15.132:0/488172540 shutdown_connections 2023-11-18T20:42:17.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.750+0000 7fec5ffff640 1 --2- 172.21.15.132:0/488172540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec60072310 0x7fec600a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.750+0000 7fec5ffff640 1 --2- 172.21.15.132:0/488172540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec6014c2e0 0x7fec600c0c80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.750+0000 7fec5ffff640 1 -- 172.21.15.132:0/488172540 >> 172.21.15.132:0/488172540 conn(0x7fec600a77f0 msgr2=0x7fec600a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:17.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.750+0000 7fec5ffff640 1 -- 172.21.15.132:0/488172540 shutdown_connections 2023-11-18T20:42:17.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.750+0000 7fec5ffff640 1 -- 172.21.15.132:0/488172540 wait complete. 2023-11-18T20:42:17.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.751+0000 7fec5ffff640 1 Processor -- start 2023-11-18T20:42:17.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.752+0000 7fec5ffff640 1 -- start start 2023-11-18T20:42:17.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.752+0000 7fec5ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec60072310 0x7fec601e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.752+0000 7fec5ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec600c0440 0x7fec601e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.752+0000 7fec5ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec6014c2e0 0x7fec601eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.752+0000 7fec5ffff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600a9040 con 0x7fec60072310 2023-11-18T20:42:17.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.752+0000 7fec5ffff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600a9320 con 0x7fec600c0440 2023-11-18T20:42:17.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.752+0000 7fec5ffff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60154f20 con 0x7fec6014c2e0 2023-11-18T20:42:17.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec60072310 0x7fec601e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec60072310 0x7fec601e8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50886/0 (socket says 172.21.15.132:50886) 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5effd640 1 -- 172.21.15.132:0/1803533681 learned_addr learned my addr 172.21.15.132:0/1803533681 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5e7fc640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec600c0440 0x7fec601e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5f7fe640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec6014c2e0 0x7fec601eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5effd640 1 -- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec6014c2e0 msgr2=0x7fec601eb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5effd640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec6014c2e0 0x7fec601eb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5effd640 1 -- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec600c0440 msgr2=0x7fec601e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5effd640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec600c0440 0x7fec601e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5effd640 1 -- 172.21.15.132:0/1803533681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec50009a70 con 0x7fec60072310 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5f7fe640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec6014c2e0 0x7fec601eb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.753+0000 7fec5e7fc640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec600c0440 0x7fec601e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:17.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.754+0000 7fec5effd640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec60072310 0x7fec601e8e40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fec50009eb0 tx=0x7fec50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:17.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.754+0000 7fec57fff640 1 -- 172.21.15.132:0/1803533681 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5003e610 con 0x7fec60072310 2023-11-18T20:42:17.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.754+0000 7fec57fff640 1 -- 172.21.15.132:0/1803533681 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5003e770 con 0x7fec60072310 2023-11-18T20:42:17.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.754+0000 7fec57fff640 1 -- 172.21.15.132:0/1803533681 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5003eb20 con 0x7fec60072310 2023-11-18T20:42:17.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.754+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec60155200 con 0x7fec60072310 2023-11-18T20:42:17.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.754+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec600bb8a0 con 0x7fec60072310 2023-11-18T20:42:17.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.755+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6004e840 con 0x7fec60072310 2023-11-18T20:42:17.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.756+0000 7fec57fff640 1 -- 172.21.15.132:0/1803533681 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec5003b050 con 0x7fec60072310 2023-11-18T20:42:17.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.757+0000 7fec57fff640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fec4006ae40 0x7fec4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:17.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.757+0000 7fec57fff640 1 -- 172.21.15.132:0/1803533681 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7fec500abf70 con 0x7fec60072310 2023-11-18T20:42:17.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.758+0000 7fec5e7fc640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fec4006ae40 0x7fec4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:17.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.759+0000 7fec5e7fc640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fec4006ae40 0x7fec4006d300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fec600c51a0 tx=0x7fec48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:17.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.761+0000 7fec57fff640 1 -- 172.21.15.132:0/1803533681 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec50077060 con 0x7fec60072310 2023-11-18T20:42:17.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.989+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec600bfb30 con 0x7fec60072310 2023-11-18T20:42:17.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.990+0000 7fec57fff640 1 -- 172.21.15.132:0/1803533681 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fec50009450 con 0x7fec60072310 2023-11-18T20:42:17.992 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:17.992 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/4114136035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4114136035},{"type":"v1","addr":"172.21.15.132:6835","nonce":4114136035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:34.907589+0000","modified":"2023-11-18T20:41:37.972696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-18T20:42:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 52 2023-11-18T20:42:17.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fec4006ae40 msgr2=0x7fec4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fec4006ae40 0x7fec4006d300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fec600c51a0 tx=0x7fec48009040 comp rx=0 tx=0).stop 2023-11-18T20:42:17.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec60072310 msgr2=0x7fec601e8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:17.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec60072310 0x7fec601e8e40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fec50009eb0 tx=0x7fec50004a40 comp rx=0 tx=0).stop 2023-11-18T20:42:17.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 shutdown_connections 2023-11-18T20:42:17.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fec4006ae40 0x7fec4006d300 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec6014c2e0 0x7fec601eb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec600c0440 0x7fec601e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 --2- 172.21.15.132:0/1803533681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec60072310 0x7fec601e8e40 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.993+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 >> 172.21.15.132:0/1803533681 conn(0x7fec600a77f0 msgr2=0x7fec60148080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.994+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 shutdown_connections 2023-11-18T20:42:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:17.994+0000 7fec5ffff640 1 -- 172.21.15.132:0/1803533681 wait complete. 2023-11-18T20:42:18.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:42:18.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.225+0000 7f692bfff640 1 Processor -- start 2023-11-18T20:42:18.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.225+0000 7f692bfff640 1 -- start start 2023-11-18T20:42:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.226+0000 7f692bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f692c14e7f0 0x7f692c0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.227+0000 7f692bfff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c0a8380 con 0x7f692c06cd20 2023-11-18T20:42:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.227+0000 7f692bfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c1510b0 con 0x7f692c0c52e0 2023-11-18T20:42:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.227+0000 7f692bfff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c06bf60 con 0x7f692c14e7f0 2023-11-18T20:42:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.227+0000 7f692b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f692c06cd20 0x7f692c15ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35886/0 (socket says 172.21.15.132:35886) 2023-11-18T20:42:18.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.227+0000 7f692b7fe640 1 -- 172.21.15.132:0/4266950996 learned_addr learned my addr 172.21.15.132:0/4266950996 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:18.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.227+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202939658 0 0) 0x7f692c0a8380 con 0x7f692c06cd20 2023-11-18T20:42:18.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.227+0000 7f692affd640 1 --2- 172.21.15.132:0/4266950996 >> v2:172.21.15.161:3300/0 conn(0x7f692c14e7f0 0x7f692c0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.227+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6918003520 con 0x7f692c06cd20 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795296935 0 0) 0x7f6918003520 con 0x7f692c06cd20 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 >> v2:172.21.15.161:3300/0 conn(0x7f692c14e7f0 msgr2=0x7f692c0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 --2- 172.21.15.132:0/4266950996 >> v2:172.21.15.161:3300/0 conn(0x7f692c14e7f0 0x7f692c0c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 >> v1:172.21.15.161:6789/0 conn(0x7f692c0c52e0 legacy=0x7f692c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c06c240 con 0x7f692c06cd20 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f6924001670 con 0x7f692c06cd20 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 >> v1:172.21.15.132:6789/0 conn(0x7f692c06cd20 legacy=0x7f692c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69180039c0 0x7f6918003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180047c0 0x7f6918004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69180052a0 0x7f691800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c06bf60 con 0x7f69180052a0 2023-11-18T20:42:18.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691800c1c0 con 0x7f69180047c0 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691800c380 con 0x7f69180039c0 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.228+0000 7f692b7fe640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69180052a0 0x7f691800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.229+0000 7f692a7fc640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180047c0 0x7f6918004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.229+0000 7f692affd640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69180039c0 0x7f6918003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.229+0000 7f692b7fe640 1 -- 172.21.15.132:0/4266950996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69180039c0 msgr2=0x7f6918003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.229+0000 7f692b7fe640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69180039c0 0x7f6918003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.229+0000 7f692b7fe640 1 -- 172.21.15.132:0/4266950996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180047c0 msgr2=0x7f6918004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.229+0000 7f692b7fe640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180047c0 0x7f6918004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.229+0000 7f692b7fe640 1 -- 172.21.15.132:0/4266950996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918003520 con 0x7f69180052a0 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.230+0000 7f692b7fe640 1 -- 172.21.15.132:0/4266950996 reap_dead start 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.230+0000 7f692b7fe640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69180052a0 0x7f691800b980 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f692400c0e0 tx=0x7f69180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f66794003ab7002 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.230+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924005ad0 con 0x7f69180052a0 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.230+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924005c70 con 0x7f69180052a0 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.230+0000 7f6929ffb640 1 -- 172.21.15.132:0/4266950996 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692402c7d0 con 0x7f69180052a0 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.231+0000 7f692bfff640 1 -- 172.21.15.132:0/4266950996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69180052a0 msgr2=0x7f691800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.231+0000 7f692bfff640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69180052a0 0x7f691800b980 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f692400c0e0 tx=0x7f69180057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.231+0000 7f692bfff640 1 -- 172.21.15.132:0/4266950996 shutdown_connections 2023-11-18T20:42:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.231+0000 7f692bfff640 1 --2- 172.21.15.132:0/4266950996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69180052a0 0x7f691800b980 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.231+0000 7f692bfff640 1 -- 172.21.15.132:0/4266950996 >> 172.21.15.132:0/4266950996 conn(0x7f692c0a77f0 msgr2=0x7f692c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:18.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.231+0000 7f692bfff640 1 -- 172.21.15.132:0/4266950996 shutdown_connections 2023-11-18T20:42:18.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.231+0000 7f692bfff640 1 -- 172.21.15.132:0/4266950996 wait complete. 2023-11-18T20:42:18.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.233+0000 7f692bfff640 1 Processor -- start 2023-11-18T20:42:18.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.233+0000 7f692bfff640 1 -- start start 2023-11-18T20:42:18.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180052a0 0x7f692c1eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f692c150310 0x7f692c0a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f692c0aac30 0x7f692c146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692bfff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1eae10 con 0x7f692c0aac30 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692bfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1eb3d0 con 0x7f69180052a0 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692bfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1ebd30 con 0x7f692c150310 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f692c0aac30 0x7f692c146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f692c0aac30 0x7f692c146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50910/0 (socket says 172.21.15.132:50910) 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692b7fe640 1 -- 172.21.15.132:0/3889821736 learned_addr learned my addr 172.21.15.132:0/3889821736 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.234+0000 7f692a7fc640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f692c150310 0x7f692c0a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f692affd640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180052a0 0x7f692c1eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f692b7fe640 1 -- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f692c150310 msgr2=0x7f692c0a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f692b7fe640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f692c150310 0x7f692c0a9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f692b7fe640 1 -- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180052a0 msgr2=0x7f692c1eb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f692b7fe640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180052a0 0x7f692c1eb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f692b7fe640 1 -- 172.21.15.132:0/3889821736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c14b290 con 0x7f692c0aac30 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f692b7fe640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f692c0aac30 0x7f692c146fc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f692400c200 tx=0x7f692c0a8510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f69237fe640 1 -- 172.21.15.132:0/3889821736 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240047e0 con 0x7f692c0aac30 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f69237fe640 1 -- 172.21.15.132:0/3889821736 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924004940 con 0x7f692c0aac30 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c0a9300 con 0x7f692c0aac30 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.235+0000 7f69237fe640 1 -- 172.21.15.132:0/3889821736 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924004cd0 con 0x7f692c0aac30 2023-11-18T20:42:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.236+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c150b40 con 0x7f692c0aac30 2023-11-18T20:42:18.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.237+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c0a9540 con 0x7f692c0aac30 2023-11-18T20:42:18.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.237+0000 7f69237fe640 1 -- 172.21.15.132:0/3889821736 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6924032070 con 0x7f692c0aac30 2023-11-18T20:42:18.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.239+0000 7f69237fe640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f690c06ae70 0x7f690c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.239+0000 7f69237fe640 1 -- 172.21.15.132:0/3889821736 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f692403c070 con 0x7f692c0aac30 2023-11-18T20:42:18.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.239+0000 7f692affd640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f690c06ae70 0x7f690c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.241+0000 7f692affd640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f690c06ae70 0x7f690c06d330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f691c0042b0 tx=0x7f691c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:18.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.243+0000 7f69237fe640 1 -- 172.21.15.132:0/3889821736 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f692c0a9540 con 0x7f692c0aac30 2023-11-18T20:42:18.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.471+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f692c1eb510 con 0x7f692c0aac30 2023-11-18T20:42:18.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.472+0000 7f69237fe640 1 -- 172.21.15.132:0/3889821736 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f692c1eb510 con 0x7f692c0aac30 2023-11-18T20:42:18.473 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:18.473 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/4114136035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4114136035},{"type":"v1","addr":"172.21.15.132:6835","nonce":4114136035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:41:34.907589+0000","modified":"2023-11-18T20:41:37.972696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/20249578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":20249578},{"type":"v1","addr":"172.21.15.132:6834","nonce":20249578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-18T20:42:18.473 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 52 2023-11-18T20:42:18.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f690c06ae70 msgr2=0x7f690c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f690c06ae70 0x7f690c06d330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f691c0042b0 tx=0x7f691c00b040 comp rx=0 tx=0).stop 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f692c0aac30 msgr2=0x7f692c146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f692c0aac30 0x7f692c146fc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f692400c200 tx=0x7f692c0a8510 comp rx=0 tx=0).stop 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 shutdown_connections 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f690c06ae70 0x7f690c06d330 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f692c0aac30 0x7f692c146fc0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f692c150310 0x7f692c0a9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 --2- 172.21.15.132:0/3889821736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69180052a0 0x7f692c1eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 >> 172.21.15.132:0/3889821736 conn(0x7f692c0a77f0 msgr2=0x7f692c14b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.474+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 shutdown_connections 2023-11-18T20:42:18.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.475+0000 7f692bfff640 1 -- 172.21.15.132:0/3889821736 wait complete. 2023-11-18T20:42:18.495 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:42:18.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.702+0000 7f5d0337a640 1 Processor -- start 2023-11-18T20:42:18.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.702+0000 7f5d0337a640 1 -- start start 2023-11-18T20:42:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.703+0000 7f5d0337a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5cfc0c0440 0x7f5cfc0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.703+0000 7f5d0337a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc072310 0x7f5cfc0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.703+0000 7f5d0337a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc071e80 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.703+0000 7f5d0337a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc071470 con 0x7f5cfc0c0440 2023-11-18T20:42:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.703+0000 7f5d0337a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc14c6c0 con 0x7f5cfc072310 2023-11-18T20:42:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.704+0000 7f5d02378640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5cfc14c2e0 0x7f5cfc152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50834/0 (socket says 172.21.15.132:50834) 2023-11-18T20:42:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.704+0000 7f5d02378640 1 -- 172.21.15.132:0/3413280088 learned_addr learned my addr 172.21.15.132:0/3413280088 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.704+0000 7f5d01b77640 1 --2- 172.21.15.132:0/3413280088 >> v2:172.21.15.132:3300/0 conn(0x7f5cfc0c0440 0x7f5cfc0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.704+0000 7f5d02b79640 1 --2- 172.21.15.132:0/3413280088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc072310 0x7f5cfc0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.705+0000 7f5d01b77640 1 -- 172.21.15.132:0/3413280088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc072310 msgr2=0x7f5cfc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:18.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.705+0000 7f5d01b77640 1 --2- 172.21.15.132:0/3413280088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc072310 0x7f5cfc0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.705+0000 7f5d01b77640 1 -- 172.21.15.132:0/3413280088 >> v1:172.21.15.132:6789/0 conn(0x7f5cfc14c2e0 legacy=0x7f5cfc152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.705+0000 7f5d01376640 1 -- 172.21.15.132:0/3413280088 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653309029 0 0) 0x7f5cfc071e80 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.705+0000 7f5d01b77640 1 -- 172.21.15.132:0/3413280088 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc06fdc0 con 0x7f5cfc0c0440 2023-11-18T20:42:18.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.706+0000 7f5d01b77640 1 --2- 172.21.15.132:0/3413280088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc0c0440 0x7f5cfc0c0c80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0097a0 tx=0x7f5cec02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b23e900789d5b9b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:18.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.706+0000 7f5d01376640 1 -- 172.21.15.132:0/3413280088 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0316f0 con 0x7f5cfc0c0440 2023-11-18T20:42:18.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.706+0000 7f5d01376640 1 -- 172.21.15.132:0/3413280088 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec031850 con 0x7f5cfc0c0440 2023-11-18T20:42:18.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.706+0000 7f5d01376640 1 -- 172.21.15.132:0/3413280088 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec031be0 con 0x7f5cfc0c0440 2023-11-18T20:42:18.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.707+0000 7f5d0337a640 1 -- 172.21.15.132:0/3413280088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc0c0440 msgr2=0x7f5cfc0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.707+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3413280088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc0c0440 0x7f5cfc0c0c80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0097a0 tx=0x7f5cec02b790 comp rx=0 tx=0).stop 2023-11-18T20:42:18.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.707+0000 7f5d0337a640 1 -- 172.21.15.132:0/3413280088 shutdown_connections 2023-11-18T20:42:18.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.707+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3413280088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc072310 0x7f5cfc0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.707+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3413280088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc0c0440 0x7f5cfc0c0c80 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.707+0000 7f5d0337a640 1 -- 172.21.15.132:0/3413280088 >> 172.21.15.132:0/3413280088 conn(0x7f5cfc0a77f0 msgr2=0x7f5cfc0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:18.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.707+0000 7f5d0337a640 1 -- 172.21.15.132:0/3413280088 shutdown_connections 2023-11-18T20:42:18.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.707+0000 7f5d0337a640 1 -- 172.21.15.132:0/3413280088 wait complete. 2023-11-18T20:42:18.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.709+0000 7f5d0337a640 1 Processor -- start 2023-11-18T20:42:18.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.709+0000 7f5d0337a640 1 -- start start 2023-11-18T20:42:18.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d0337a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cfc072310 0x7f5cfc0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d0337a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc0c0440 0x7f5cfc155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d0337a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc14c2e0 0x7f5cfc1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d0337a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0a9940 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d0337a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0ab390 con 0x7f5cfc072310 2023-11-18T20:42:18.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d0337a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0a96a0 con 0x7f5cfc0c0440 2023-11-18T20:42:18.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d02b79640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc14c2e0 0x7f5cfc1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d02b79640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc14c2e0 0x7f5cfc1487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49462/0 (socket says 172.21.15.132:49462) 2023-11-18T20:42:18.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d02b79640 1 -- 172.21.15.132:0/3415119184 learned_addr learned my addr 172.21.15.132:0/3415119184 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d01b77640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc0c0440 0x7f5cfc155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.710+0000 7f5d02378640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cfc072310 0x7f5cfc0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d02b79640 1 -- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc0c0440 msgr2=0x7f5cfc155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d02b79640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc0c0440 0x7f5cfc155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d02b79640 1 -- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cfc072310 msgr2=0x7f5cfc0a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d02b79640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cfc072310 0x7f5cfc0a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d02b79640 1 -- 172.21.15.132:0/3415119184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec009400 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d02378640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cfc072310 0x7f5cfc0a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d02b79640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc14c2e0 0x7f5cfc1487d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400efc0 tx=0x7f5cf400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:18.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5cf2ffd640 1 -- 172.21.15.132:0/3415119184 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4014480 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5cf2ffd640 1 -- 172.21.15.132:0/3415119184 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf400f040 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc0abb60 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5cf2ffd640 1 -- 172.21.15.132:0/3415119184 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4014820 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.711+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc0ab880 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.712+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc04e840 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.714+0000 7f5cf2ffd640 1 -- 172.21.15.132:0/3415119184 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5cf4014980 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.715+0000 7f5cf2ffd640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ce006ae70 0x7f5ce006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:18.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.715+0000 7f5cf2ffd640 1 -- 172.21.15.132:0/3415119184 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f5cf408a250 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.715+0000 7f5d02378640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ce006ae70 0x7f5ce006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:18.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.716+0000 7f5d02378640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ce006ae70 0x7f5ce006d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8000f60 tx=0x7f5cf8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:18.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.719+0000 7f5cf2ffd640 1 -- 172.21.15.132:0/3415119184 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5cf4055220 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.910+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cfc0c5380 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.912+0000 7f5cf2ffd640 1 -- 172.21.15.132:0/3415119184 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16868 (secure 0 0 0) 0x7f5cf4058840 con 0x7f5cfc14c2e0 2023-11-18T20:42:18.914 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:18.914 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":85,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:42:14.846825+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-18T20:41:33.270522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-18T20:41:33.924631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.3","mappings":[{"from":4,"to":0}]},{"pgid":"14.6","mappings":[{"from":5,"to":0}]},{"pgid":"14.1c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/726664783":"2023-11-19T20:42:11.835954+0000","172.21.15.132:6833/726664783":"2023-11-19T20:42:11.835954+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:42:18.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ce006ae70 msgr2=0x7f5ce006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ce006ae70 0x7f5ce006d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8000f60 tx=0x7f5cf8009040 comp rx=0 tx=0).stop 2023-11-18T20:42:18.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc14c2e0 msgr2=0x7f5cfc1487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:18.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc14c2e0 0x7f5cfc1487d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400efc0 tx=0x7f5cf400c490 comp rx=0 tx=0).stop 2023-11-18T20:42:18.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 shutdown_connections 2023-11-18T20:42:18.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ce006ae70 0x7f5ce006d330 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cfc14c2e0 0x7f5cfc1487d0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cfc0c0440 0x7f5cfc155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 --2- 172.21.15.132:0/3415119184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cfc072310 0x7f5cfc0a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:18.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.914+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 >> 172.21.15.132:0/3415119184 conn(0x7f5cfc0a77f0 msgr2=0x7f5cfc14a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:18.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.915+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 shutdown_connections 2023-11-18T20:42:18.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:18.915+0000 7f5d0337a640 1 -- 172.21.15.132:0/3415119184 wait complete. 2023-11-18T20:42:18.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-18T20:42:19.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.137+0000 7effbccf2640 1 Processor -- start 2023-11-18T20:42:19.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.138+0000 7effbccf2640 1 -- start start 2023-11-18T20:42:19.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.139+0000 7effbccf2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb806f7d0 0x7effb80a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.139+0000 7effbccf2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7effb80a70a0 0x7effb806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.139+0000 7effbccf2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb814ffd0 con 0x7effb8153240 2023-11-18T20:42:19.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.139+0000 7effbccf2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb806e240 con 0x7effb80a70a0 2023-11-18T20:42:19.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.139+0000 7effbccf2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb8152550 con 0x7effb806f7d0 2023-11-18T20:42:19.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.140+0000 7effb5d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7effb80a70a0 0x7effb806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.140+0000 7effb6d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7effb8153240 0x7effb80c5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:60346/0 (socket says 172.21.15.132:60346) 2023-11-18T20:42:19.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.140+0000 7effb6d9d640 1 -- 172.21.15.132:0/1136303177 learned_addr learned my addr 172.21.15.132:0/1136303177 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:19.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.140+0000 7effb659c640 1 --2- 172.21.15.132:0/1136303177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb806f7d0 0x7effb80a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.140+0000 7effb5d9b640 1 -- 172.21.15.132:0/1136303177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb806f7d0 msgr2=0x7effb80a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:19.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.140+0000 7effb5d9b640 1 --2- 172.21.15.132:0/1136303177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb806f7d0 0x7effb80a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.140+0000 7effb5d9b640 1 -- 172.21.15.132:0/1136303177 >> v1:172.21.15.161:6789/0 conn(0x7effb8153240 legacy=0x7effb80c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.140+0000 7effb5d9b640 1 -- 172.21.15.132:0/1136303177 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb806df60 con 0x7effb80a70a0 2023-11-18T20:42:19.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.142+0000 7effb5d9b640 1 --2- 172.21.15.132:0/1136303177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb80a70a0 0x7effb806fbb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7effa00097a0 tx=0x7effa002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cc2b056508491d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:19.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.142+0000 7effb559a640 1 -- 172.21.15.132:0/1136303177 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0031780 con 0x7effb80a70a0 2023-11-18T20:42:19.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.142+0000 7effb559a640 1 -- 172.21.15.132:0/1136303177 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00318e0 con 0x7effb80a70a0 2023-11-18T20:42:19.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.142+0000 7effb559a640 1 -- 172.21.15.132:0/1136303177 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0031c70 con 0x7effb80a70a0 2023-11-18T20:42:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.143+0000 7effbccf2640 1 -- 172.21.15.132:0/1136303177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb80a70a0 msgr2=0x7effb806fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.143+0000 7effbccf2640 1 --2- 172.21.15.132:0/1136303177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb80a70a0 0x7effb806fbb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7effa00097a0 tx=0x7effa002b820 comp rx=0 tx=0).stop 2023-11-18T20:42:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.143+0000 7effbccf2640 1 -- 172.21.15.132:0/1136303177 shutdown_connections 2023-11-18T20:42:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.143+0000 7effbccf2640 1 --2- 172.21.15.132:0/1136303177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb80a70a0 0x7effb806fbb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.143+0000 7effbccf2640 1 --2- 172.21.15.132:0/1136303177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb806f7d0 0x7effb80a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.143+0000 7effbccf2640 1 -- 172.21.15.132:0/1136303177 >> 172.21.15.132:0/1136303177 conn(0x7effb80c7e30 msgr2=0x7effb80c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.143+0000 7effbccf2640 1 -- 172.21.15.132:0/1136303177 shutdown_connections 2023-11-18T20:42:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.143+0000 7effbccf2640 1 -- 172.21.15.132:0/1136303177 wait complete. 2023-11-18T20:42:19.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.145+0000 7effbccf2640 1 Processor -- start 2023-11-18T20:42:19.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.145+0000 7effbccf2640 1 -- start start 2023-11-18T20:42:19.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.146+0000 7effbccf2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb806f7d0 0x7effb814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.146+0000 7effbccf2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb80a70a0 0x7effb80ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.146+0000 7effbccf2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb8153240 0x7effb81ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.146+0000 7effbccf2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb814b060 con 0x7effb806f7d0 2023-11-18T20:42:19.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.146+0000 7effbccf2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb81ed640 con 0x7effb8153240 2023-11-18T20:42:19.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.146+0000 7effbccf2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb8156860 con 0x7effb80a70a0 2023-11-18T20:42:19.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.146+0000 7effb659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb806f7d0 0x7effb814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb806f7d0 0x7effb814b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49474/0 (socket says 172.21.15.132:49474) 2023-11-18T20:42:19.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb659c640 1 -- 172.21.15.132:0/2985642777 learned_addr learned my addr 172.21.15.132:0/2985642777 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb6d9d640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb8153240 0x7effb81ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb5d9b640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb80a70a0 0x7effb80ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb659c640 1 -- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb80a70a0 msgr2=0x7effb80ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb659c640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb80a70a0 0x7effb80ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb659c640 1 -- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb8153240 msgr2=0x7effb81ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb659c640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb8153240 0x7effb81ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb659c640 1 -- 172.21.15.132:0/2985642777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009400 con 0x7effb806f7d0 2023-11-18T20:42:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.147+0000 7effb659c640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb806f7d0 0x7effb814b520 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7effa800efc0 tx=0x7effa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.148+0000 7effaeffd640 1 -- 172.21.15.132:0/2985642777 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8009b80 con 0x7effb806f7d0 2023-11-18T20:42:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.148+0000 7effaeffd640 1 -- 172.21.15.132:0/2985642777 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800f040 con 0x7effb806f7d0 2023-11-18T20:42:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.148+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb814b240 con 0x7effb806f7d0 2023-11-18T20:42:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.148+0000 7effaeffd640 1 -- 172.21.15.132:0/2985642777 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa80146a0 con 0x7effb806f7d0 2023-11-18T20:42:19.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.148+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb81edb70 con 0x7effb806f7d0 2023-11-18T20:42:19.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.149+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb8068350 con 0x7effb806f7d0 2023-11-18T20:42:19.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.150+0000 7effaeffd640 1 -- 172.21.15.132:0/2985642777 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effa8014800 con 0x7effb806f7d0 2023-11-18T20:42:19.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.151+0000 7effaeffd640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff9806ae40 0x7eff9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.152+0000 7effaeffd640 1 -- 172.21.15.132:0/2985642777 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5915+0+0 (secure 0 0 0) 0x7effa808a180 con 0x7effb806f7d0 2023-11-18T20:42:19.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.152+0000 7effb5d9b640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff9806ae40 0x7eff9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.153+0000 7effb5d9b640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff9806ae40 0x7eff9806d300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7effa0036000 tx=0x7effa003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:19.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.156+0000 7effaeffd640 1 -- 172.21.15.132:0/2985642777 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effa80551f0 con 0x7effb806f7d0 2023-11-18T20:42:19.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.380+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7effb80c73e0 con 0x7effb806f7d0 2023-11-18T20:42:19.382 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-11-18T20:42:19.381+0000 7feee5f07640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-18T20:42:19.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.384+0000 7effaeffd640 1 -- 172.21.15.132:0/2985642777 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 163+0+0 (secure 0 0 0) 0x7effa8058810 con 0x7effb806f7d0 2023-11-18T20:42:19.385 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T20:42:19.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff9806ae40 msgr2=0x7eff9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff9806ae40 0x7eff9806d300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7effa0036000 tx=0x7effa003d040 comp rx=0 tx=0).stop 2023-11-18T20:42:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb806f7d0 msgr2=0x7effb814b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb806f7d0 0x7effb814b520 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7effa800efc0 tx=0x7effa800c490 comp rx=0 tx=0).stop 2023-11-18T20:42:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 shutdown_connections 2023-11-18T20:42:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff9806ae40 0x7eff9806d300 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effb8153240 0x7effb81ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effb80a70a0 0x7effb80ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 --2- 172.21.15.132:0/2985642777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb806f7d0 0x7effb814b520 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 >> 172.21.15.132:0/2985642777 conn(0x7effb80c7e30 msgr2=0x7effb806fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:19.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.387+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 shutdown_connections 2023-11-18T20:42:19.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.388+0000 7effbccf2640 1 -- 172.21.15.132:0/2985642777 wait complete. 2023-11-18T20:42:19.397 INFO:tasks.ceph.mds.c.smithi132.stderr: -4772> 2023-11-18T20:41:39.451+0000 7f57f2dcf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T20:42:19.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-18T20:42:19.449 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-11-18T20:42:19.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.590+0000 7f1f8ff1d640 1 Processor -- start 2023-11-18T20:42:19.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.590+0000 7f1f8ff1d640 1 -- start start 2023-11-18T20:42:19.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.591+0000 7f1f8ff1d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f8806d0a0 0x7f1f88152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.591+0000 7f1f8ff1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f880c3ea0 0x7f1f880c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.591+0000 7f1f8ff1d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f880c64a0 con 0x7f1f8814fd30 2023-11-18T20:42:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.591+0000 7f1f8ff1d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f880c5c00 con 0x7f1f8806d0a0 2023-11-18T20:42:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.591+0000 7f1f8ff1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880c5ee0 con 0x7f1f880c3ea0 2023-11-18T20:42:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8dcb9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1f8814fd30 0x7f1f880a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50842/0 (socket says 172.21.15.132:50842) 2023-11-18T20:42:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8dcb9640 1 -- 172.21.15.132:0/3169595703 learned_addr learned my addr 172.21.15.132:0/3169595703 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:19.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398597955 0 0) 0x7f1f880c64a0 con 0x7f1f8814fd30 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f74003520 con 0x7f1f8814fd30 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8e4ba640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f880c3ea0 0x7f1f880c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8d4b8640 1 --2- 172.21.15.132:0/3169595703 >> v2:172.21.15.161:3300/0 conn(0x7f1f8806d0a0 0x7f1f88152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2056095053 0 0) 0x7f1f74003520 con 0x7f1f8814fd30 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f880c3ea0 msgr2=0x7f1f880c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f880c3ea0 0x7f1f880c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 >> v2:172.21.15.161:3300/0 conn(0x7f1f8806d0a0 msgr2=0x7f1f88152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 --2- 172.21.15.132:0/3169595703 >> v2:172.21.15.161:3300/0 conn(0x7f1f8806d0a0 0x7f1f88152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f880c61c0 con 0x7f1f8814fd30 2023-11-18T20:42:19.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.592+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f1f84001670 con 0x7f1f8814fd30 2023-11-18T20:42:19.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 >> v1:172.21.15.132:6789/0 conn(0x7f1f8814fd30 legacy=0x7f1f880a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8ccb7640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74003970 0x7f1f74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8ccb7640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f740047c0 0x7f1f74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8ccb7640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f880c3ea0 0x7f1f74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880c5c00 con 0x7f1f740047c0 2023-11-18T20:42:19.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880c5ee0 con 0x7f1f74003970 2023-11-18T20:42:19.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7400ba60 con 0x7f1f880c3ea0 2023-11-18T20:42:19.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8d4b8640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f740047c0 0x7f1f74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8dcb9640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74003970 0x7f1f74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8d4b8640 1 -- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f880c3ea0 msgr2=0x7f1f74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:19.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8d4b8640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f880c3ea0 0x7f1f74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8d4b8640 1 -- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74003970 msgr2=0x7f1f74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:19.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8d4b8640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74003970 0x7f1f74003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.593+0000 7f1f8d4b8640 1 -- 172.21.15.132:0/3169595703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f74003520 con 0x7f1f740047c0 2023-11-18T20:42:19.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.594+0000 7f1f8d4b8640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f740047c0 0x7f1f74004c40 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1f8806d4e0 tx=0x7f1f740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e918b9f808536aec server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:19.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780325f0 con 0x7f1f740047c0 2023-11-18T20:42:19.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f78032750 con 0x7f1f740047c0 2023-11-18T20:42:19.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ccb7640 1 -- 172.21.15.132:0/3169595703 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78032ae0 con 0x7f1f740047c0 2023-11-18T20:42:19.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/3169595703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f740047c0 msgr2=0x7f1f74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ff1d640 1 --2- 172.21.15.132:0/3169595703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f740047c0 0x7f1f74004c40 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1f8806d4e0 tx=0x7f1f740057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8e4ba640 1 -- 172.21.15.132:0/3169595703 reap_dead start 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/3169595703 shutdown_connections 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/3169595703 >> 172.21.15.132:0/3169595703 conn(0x7f1f8806a500 msgr2=0x7f1f8806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/3169595703 shutdown_connections 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.595+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/3169595703 wait complete. 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.597+0000 7f1f8ff1d640 1 Processor -- start 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.597+0000 7f1f8ff1d640 1 -- start start 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8ff1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740047c0 0x7f1f881e12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8ff1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f881eaac0 0x7f1f88156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8ff1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f881dc7f0 0x7f1f88150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8ff1d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f881eafc0 con 0x7f1f881eaac0 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8ff1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f88153f00 con 0x7f1f740047c0 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8ff1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f881541e0 con 0x7f1f881dc7f0 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8d4b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f881eaac0 0x7f1f88156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8d4b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f881eaac0 0x7f1f88156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49516/0 (socket says 172.21.15.132:49516) 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8d4b8640 1 -- 172.21.15.132:0/127191193 learned_addr learned my addr 172.21.15.132:0/127191193 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8d4b8640 1 -- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f881dc7f0 msgr2=0x7f1f88150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8d4b8640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f881dc7f0 0x7f1f88150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8d4b8640 1 -- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740047c0 msgr2=0x7f1f881e12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:19.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8d4b8640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740047c0 0x7f1f881e12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.598+0000 7f1f8d4b8640 1 -- 172.21.15.132:0/127191193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88150330 con 0x7f1f881eaac0 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.599+0000 7f1f8d4b8640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f881eaac0 0x7f1f88156110 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1f7802be70 tx=0x7f1f78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.599+0000 7f1f7e7fc640 1 -- 172.21.15.132:0/127191193 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7803ca80 con 0x7f1f881eaac0 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.599+0000 7f1f7e7fc640 1 -- 172.21.15.132:0/127191193 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7803cbe0 con 0x7f1f881eaac0 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.599+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f881e17e0 con 0x7f1f881eaac0 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.599+0000 7f1f7e7fc640 1 -- 172.21.15.132:0/127191193 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780463f0 con 0x7f1f881eaac0 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.599+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f88156830 con 0x7f1f881eaac0 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.600+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f88068350 con 0x7f1f881eaac0 2023-11-18T20:42:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.601+0000 7f1f7e7fc640 1 -- 172.21.15.132:0/127191193 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f78046550 con 0x7f1f881eaac0 2023-11-18T20:42:19.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.602+0000 7f1f7e7fc640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f6c06ae40 0x7f1f6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:19.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.602+0000 7f1f7e7fc640 1 -- 172.21.15.132:0/127191193 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f1f780ac0e0 con 0x7f1f881eaac0 2023-11-18T20:42:19.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.603+0000 7f1f8dcb9640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f6c06ae40 0x7f1f6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:19.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.604+0000 7f1f8dcb9640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f6c06ae40 0x7f1f6c06d300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1f881547e0 tx=0x7f1f84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:19.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.606+0000 7f1f7e7fc640 1 -- 172.21.15.132:0/127191193 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f78077170 con 0x7f1f881eaac0 2023-11-18T20:42:19.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:19.828+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1f881504c0 con 0x7f1f881eaac0 2023-11-18T20:42:20.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.387+0000 7f1f7e7fc640 1 -- 172.21.15.132:0/127191193 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1f7807a790 con 0x7f1f881eaac0 2023-11-18T20:42:20.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f6c06ae40 msgr2=0x7f1f6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:20.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f6c06ae40 0x7f1f6c06d300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1f881547e0 tx=0x7f1f84009040 comp rx=0 tx=0).stop 2023-11-18T20:42:20.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f881eaac0 msgr2=0x7f1f88156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:20.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f881eaac0 0x7f1f88156110 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1f7802be70 tx=0x7f1f78004730 comp rx=0 tx=0).stop 2023-11-18T20:42:20.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 shutdown_connections 2023-11-18T20:42:20.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f1f6c06ae40 0x7f1f6c06d300 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f881dc7f0 0x7f1f88150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f881eaac0 0x7f1f88156110 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 --2- 172.21.15.132:0/127191193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740047c0 0x7f1f881e12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.392+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 >> 172.21.15.132:0/127191193 conn(0x7f1f8806a500 msgr2=0x7f1f8806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:20.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.393+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 shutdown_connections 2023-11-18T20:42:20.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.393+0000 7f1f8ff1d640 1 -- 172.21.15.132:0/127191193 wait complete. 2023-11-18T20:42:20.413 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-18T20:42:20.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.671+0000 7f177146d640 1 Processor -- start 2023-11-18T20:42:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.671+0000 7f177146d640 1 -- start start 2023-11-18T20:42:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.672+0000 7f177146d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f176c0a5420 0x7f176c0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.672+0000 7f177146d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0c3c50 con 0x7f176c152d30 2023-11-18T20:42:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.672+0000 7f177146d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c153280 con 0x7f176c0c2df0 2023-11-18T20:42:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.672+0000 7f177146d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c06cee0 con 0x7f176c0a5420 2023-11-18T20:42:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.673+0000 7f176b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f176c152d30 0x7f176c0c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50854/0 (socket says 172.21.15.132:50854) 2023-11-18T20:42:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.673+0000 7f176b7fe640 1 -- 172.21.15.132:0/2875813733 learned_addr learned my addr 172.21.15.132:0/2875813733 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.673+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289267028 0 0) 0x7f176c0c3c50 con 0x7f176c152d30 2023-11-18T20:42:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.673+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1754003520 con 0x7f176c152d30 2023-11-18T20:42:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.673+0000 7f1770c6c640 1 --2- 172.21.15.132:0/2875813733 >> v2:172.21.15.161:3300/0 conn(0x7f176c0a5420 0x7f176c0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 215019911 0 0) 0x7f1754003520 con 0x7f176c152d30 2023-11-18T20:42:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 >> v2:172.21.15.161:3300/0 conn(0x7f176c0a5420 msgr2=0x7f176c0c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 --2- 172.21.15.132:0/2875813733 >> v2:172.21.15.161:3300/0 conn(0x7f176c0a5420 0x7f176c0c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 >> v1:172.21.15.161:6789/0 conn(0x7f176c0c2df0 legacy=0x7f176c071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c06d180 con 0x7f176c152d30 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7f1760001670 con 0x7f176c152d30 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 >> v1:172.21.15.132:6789/0 conn(0x7f176c152d30 legacy=0x7f176c0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17540039c0 0x7f1754003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17540047c0 0x7f1754004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1754005380 0x7f175400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c06cee0 con 0x7f1754005380 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175400c260 con 0x7f17540039c0 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175400c420 con 0x7f17540047c0 2023-11-18T20:42:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f1770c6c640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1754005380 0x7f175400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176b7fe640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17540047c0 0x7f1754004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f176bfff640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17540039c0 0x7f1754003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.674+0000 7f1770c6c640 1 -- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17540047c0 msgr2=0x7f1754004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.675+0000 7f1770c6c640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17540047c0 0x7f1754004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.675+0000 7f1770c6c640 1 -- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17540039c0 msgr2=0x7f1754003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.675+0000 7f1770c6c640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17540039c0 0x7f1754003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.675+0000 7f1770c6c640 1 -- 172.21.15.132:0/2875813733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1754003520 con 0x7f1754005380 2023-11-18T20:42:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.675+0000 7f176bfff640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17540039c0 0x7f1754003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.675+0000 7f1770c6c640 1 -- 172.21.15.132:0/2875813733 reap_dead start 2023-11-18T20:42:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f1770c6c640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1754005380 0x7f175400b980 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f1764007360 tx=0x7f17540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b60d57b9743c63 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176402ccf0 con 0x7f1754005380 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176402ce90 con 0x7f1754005380 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f176affd640 1 -- 172.21.15.132:0/2875813733 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764003bd0 con 0x7f1754005380 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f177146d640 1 -- 172.21.15.132:0/2875813733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1754005380 msgr2=0x7f175400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f177146d640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1754005380 0x7f175400b980 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f1764007360 tx=0x7f17540057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f177146d640 1 -- 172.21.15.132:0/2875813733 shutdown_connections 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f177146d640 1 --2- 172.21.15.132:0/2875813733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1754005380 0x7f175400b980 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f177146d640 1 -- 172.21.15.132:0/2875813733 >> 172.21.15.132:0/2875813733 conn(0x7f176c0c5cc0 msgr2=0x7f176c0c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.676+0000 7f177146d640 1 -- 172.21.15.132:0/2875813733 shutdown_connections 2023-11-18T20:42:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.677+0000 7f177146d640 1 -- 172.21.15.132:0/2875813733 wait complete. 2023-11-18T20:42:20.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.678+0000 7f177146d640 1 Processor -- start 2023-11-18T20:42:20.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.678+0000 7f177146d640 1 -- start start 2023-11-18T20:42:20.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f177146d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1754005380 0x7f176c14e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:20.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f177146d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f176c0aafd0 0x7f176c071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f177146d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f176c0ab9b0 0x7f176c0723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f177146d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0aa560 con 0x7f176c0ab9b0 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f177146d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c071a70 con 0x7f1754005380 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f177146d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c071540 con 0x7f176c0aafd0 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f1770c6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f176c0ab9b0 0x7f176c0723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f1770c6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f176c0ab9b0 0x7f176c0723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49530/0 (socket says 172.21.15.132:49530) 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.679+0000 7f1770c6c640 1 -- 172.21.15.132:0/15309421 learned_addr learned my addr 172.21.15.132:0/15309421 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f176b7fe640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f176c0aafd0 0x7f176c071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1770c6c640 1 -- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f176c0aafd0 msgr2=0x7f176c071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:20.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1770c6c640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f176c0aafd0 0x7f176c071e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1770c6c640 1 -- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1754005380 msgr2=0x7f176c14e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1770c6c640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1754005380 0x7f176c14e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1770c6c640 1 -- 172.21.15.132:0/15309421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c071790 con 0x7f176c0ab9b0 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1770c6c640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f176c0ab9b0 0x7f176c0723b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f176402cd20 tx=0x7f1764004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1768ff9640 1 -- 172.21.15.132:0/15309421 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764004510 con 0x7f176c0ab9b0 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1768ff9640 1 -- 172.21.15.132:0/15309421 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764004670 con 0x7f176c0ab9b0 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f1768ff9640 1 -- 172.21.15.132:0/15309421 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176403f470 con 0x7f176c0ab9b0 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0a8f10 con 0x7f176c0ab9b0 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.680+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0a94d0 con 0x7f176c0ab9b0 2023-11-18T20:42:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.681+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c067fd0 con 0x7f176c0ab9b0 2023-11-18T20:42:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.682+0000 7f1768ff9640 1 -- 172.21.15.132:0/15309421 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1764049440 con 0x7f176c0ab9b0 2023-11-18T20:42:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.683+0000 7f1768ff9640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f175806ae40 0x7f175806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.683+0000 7f1768ff9640 1 -- 172.21.15.132:0/15309421 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f176403b070 con 0x7f176c0ab9b0 2023-11-18T20:42:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.684+0000 7f176bfff640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f175806ae40 0x7f175806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.685+0000 7f176bfff640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f175806ae40 0x7f175806d300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f175c001650 tx=0x7f175c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.688+0000 7f1768ff9640 1 -- 172.21.15.132:0/15309421 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1764075fe0 con 0x7f176c0ab9b0 2023-11-18T20:42:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:20.879+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f176c0a8d70 con 0x7f176c0ab9b0 2023-11-18T20:42:21.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.391+0000 7f1768ff9640 1 -- 172.21.15.132:0/15309421 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v87) v1 ==== 184+0+0 (secure 0 0 0) 0x7f176c0a8d70 con 0x7f176c0ab9b0 2023-11-18T20:42:21.392 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_metadata' removed 2023-11-18T20:42:21.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f175806ae40 msgr2=0x7f175806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:21.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f175806ae40 0x7f175806d300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f175c001650 tx=0x7f175c009040 comp rx=0 tx=0).stop 2023-11-18T20:42:21.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f176c0ab9b0 msgr2=0x7f176c0723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f176c0ab9b0 0x7f176c0723b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f176402cd20 tx=0x7f1764004ab0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 shutdown_connections 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f175806ae40 0x7f175806d300 secure :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f175c001650 tx=0x7f175c009040 comp rx=0 tx=0).stop 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f176c0ab9b0 0x7f176c0723b0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f176c0aafd0 0x7f176c071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 --2- 172.21.15.132:0/15309421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1754005380 0x7f176c14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 >> 172.21.15.132:0/15309421 conn(0x7f176c0c5cc0 msgr2=0x7f176c152320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 shutdown_connections 2023-11-18T20:42:21.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.395+0000 7f177146d640 1 -- 172.21.15.132:0/15309421 wait complete. 2023-11-18T20:42:21.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-18T20:42:21.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.623+0000 7f03d12bb640 1 Processor -- start 2023-11-18T20:42:21.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.624+0000 7f03d12bb640 1 -- start start 2023-11-18T20:42:21.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.625+0000 7f03d12bb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03cc151d40 0x7f03cc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:21.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.625+0000 7f03d12bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03cc06a500 0x7f03cc06a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:21.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.625+0000 7f03d12bb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc158900 con 0x7f03cc0c0310 2023-11-18T20:42:21.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.625+0000 7f03d12bb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc06d9b0 con 0x7f03cc06a500 2023-11-18T20:42:21.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.625+0000 7f03d12bb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc157cf0 con 0x7f03cc151d40 2023-11-18T20:42:21.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.625+0000 7f03cb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03cc06a500 0x7f03cc06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:21.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.626+0000 7f03cb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03cc06a500 0x7f03cc06a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49540/0 (socket says 172.21.15.132:49540) 2023-11-18T20:42:21.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.626+0000 7f03cb7fe640 1 -- 172.21.15.132:0/1030036557 learned_addr learned my addr 172.21.15.132:0/1030036557 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:21.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.626+0000 7f03cb7fe640 1 -- 172.21.15.132:0/1030036557 >> v2:172.21.15.161:3300/0 conn(0x7f03cc151d40 msgr2=0x7f03cc06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:21.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.626+0000 7f03cb7fe640 1 --2- 172.21.15.132:0/1030036557 >> v2:172.21.15.161:3300/0 conn(0x7f03cc151d40 0x7f03cc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.626+0000 7f03cb7fe640 1 -- 172.21.15.132:0/1030036557 >> v1:172.21.15.161:6789/0 conn(0x7f03cc0c0310 legacy=0x7f03cc0c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:21.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.626+0000 7f03cb7fe640 1 -- 172.21.15.132:0/1030036557 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc157fd0 con 0x7f03cc06a500 2023-11-18T20:42:21.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.627+0000 7f03cb7fe640 1 --2- 172.21.15.132:0/1030036557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc06a500 0x7f03cc06a950 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f03cc072560 tx=0x7f03c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f615a37934ec3c2e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:21.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.627+0000 7f03c9ffb640 1 -- 172.21.15.132:0/1030036557 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4031870 con 0x7f03cc06a500 2023-11-18T20:42:21.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.627+0000 7f03c9ffb640 1 -- 172.21.15.132:0/1030036557 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40319d0 con 0x7f03cc06a500 2023-11-18T20:42:21.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.627+0000 7f03c9ffb640 1 -- 172.21.15.132:0/1030036557 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4031d60 con 0x7f03cc06a500 2023-11-18T20:42:21.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.628+0000 7f03d12bb640 1 -- 172.21.15.132:0/1030036557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc06a500 msgr2=0x7f03cc06a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:21.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.628+0000 7f03d12bb640 1 --2- 172.21.15.132:0/1030036557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc06a500 0x7f03cc06a950 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f03cc072560 tx=0x7f03c402b910 comp rx=0 tx=0).stop 2023-11-18T20:42:21.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.628+0000 7f03d12bb640 1 -- 172.21.15.132:0/1030036557 shutdown_connections 2023-11-18T20:42:21.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.628+0000 7f03d12bb640 1 --2- 172.21.15.132:0/1030036557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc06a500 0x7f03cc06a950 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.628+0000 7f03d12bb640 1 --2- 172.21.15.132:0/1030036557 >> v2:172.21.15.161:3300/0 conn(0x7f03cc151d40 0x7f03cc06ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.628+0000 7f03d12bb640 1 -- 172.21.15.132:0/1030036557 >> 172.21.15.132:0/1030036557 conn(0x7f03cc0c39e0 msgr2=0x7f03cc0c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:21.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.628+0000 7f03d12bb640 1 -- 172.21.15.132:0/1030036557 shutdown_connections 2023-11-18T20:42:21.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.628+0000 7f03d12bb640 1 -- 172.21.15.132:0/1030036557 wait complete. 2023-11-18T20:42:21.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.629+0000 7f03d12bb640 1 Processor -- start 2023-11-18T20:42:21.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.630+0000 7f03d12bb640 1 -- start start 2023-11-18T20:42:21.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.630+0000 7f03d12bb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03cc06a500 0x7f03cc0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:21.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.630+0000 7f03d12bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03cc0c0310 0x7f03cc154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:21.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.630+0000 7f03d12bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc151d40 0x7f03cc1f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:21.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.630+0000 7f03d12bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0c6ba0 con 0x7f03cc151d40 2023-11-18T20:42:21.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.630+0000 7f03d12bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0c5010 con 0x7f03cc0c0310 2023-11-18T20:42:21.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.630+0000 7f03d12bb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc1f25c0 con 0x7f03cc06a500 2023-11-18T20:42:21.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc151d40 0x7f03cc1f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:21.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc151d40 0x7f03cc1f1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49550/0 (socket says 172.21.15.132:49550) 2023-11-18T20:42:21.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 -- 172.21.15.132:0/457390757 learned_addr learned my addr 172.21.15.132:0/457390757 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:21.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 -- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03cc06a500 msgr2=0x7f03cc0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:21.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03cc06a500 0x7f03cc0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 -- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03cc0c0310 msgr2=0x7f03cc154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:21.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03cc0c0310 0x7f03cc154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:21.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 -- 172.21.15.132:0/457390757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c40094d0 con 0x7f03cc151d40 2023-11-18T20:42:21.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.631+0000 7f03cb7fe640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc151d40 0x7f03cc1f1b40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f03c402b950 tx=0x7f03c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:21.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.632+0000 7f03c37fe640 1 -- 172.21.15.132:0/457390757 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c403adf0 con 0x7f03cc151d40 2023-11-18T20:42:21.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.632+0000 7f03c37fe640 1 -- 172.21.15.132:0/457390757 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40443f0 con 0x7f03cc151d40 2023-11-18T20:42:21.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.632+0000 7f03c37fe640 1 -- 172.21.15.132:0/457390757 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40447a0 con 0x7f03cc151d40 2023-11-18T20:42:21.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.632+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc14c160 con 0x7f03cc151d40 2023-11-18T20:42:21.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.632+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc1552c0 con 0x7f03cc151d40 2023-11-18T20:42:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.633+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc0c4650 con 0x7f03cc151d40 2023-11-18T20:42:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.634+0000 7f03c37fe640 1 -- 172.21.15.132:0/457390757 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03c4044900 con 0x7f03cc151d40 2023-11-18T20:42:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.634+0000 7f03c37fe640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f03ac06ae90 0x7f03ac06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.635+0000 7f03c37fe640 1 -- 172.21.15.132:0/457390757 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f03c402d040 con 0x7f03cc151d40 2023-11-18T20:42:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.635+0000 7f03caffd640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f03ac06ae90 0x7f03ac06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:21.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.636+0000 7f03caffd640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f03ac06ae90 0x7f03ac06d350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f03cc152620 tx=0x7f03bc009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:21.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.639+0000 7f03c37fe640 1 -- 172.21.15.132:0/457390757 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03c4076fc0 con 0x7f03cc151d40 2023-11-18T20:42:21.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:21.828+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f03cc068350 con 0x7f03cc151d40 2023-11-18T20:42:22.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.405+0000 7f03c37fe640 1 -- 172.21.15.132:0/457390757 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v88) v1 ==== 172+0+0 (secure 0 0 0) 0x7f03c407a5e0 con 0x7f03cc151d40 2023-11-18T20:42:22.407 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs2_data' removed 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f03ac06ae90 msgr2=0x7f03ac06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f03ac06ae90 0x7f03ac06d350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f03cc152620 tx=0x7f03bc009250 comp rx=0 tx=0).stop 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc151d40 msgr2=0x7f03cc1f1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc151d40 0x7f03cc1f1b40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f03c402b950 tx=0x7f03c40046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 shutdown_connections 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f03ac06ae90 0x7f03ac06d350 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03cc151d40 0x7f03cc1f1b40 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03cc0c0310 0x7f03cc154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 --2- 172.21.15.132:0/457390757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03cc06a500 0x7f03cc0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.410+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 >> 172.21.15.132:0/457390757 conn(0x7f03cc0c39e0 msgr2=0x7f03cc150910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:22.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.411+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 shutdown_connections 2023-11-18T20:42:22.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.411+0000 7f03d12bb640 1 -- 172.21.15.132:0/457390757 wait complete. 2023-11-18T20:42:22.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-18T20:42:22.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.646+0000 7f137a3b0640 1 Processor -- start 2023-11-18T20:42:22.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.646+0000 7f137a3b0640 1 -- start start 2023-11-18T20:42:22.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.647+0000 7f137a3b0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f137406d0a0 0x7f1374152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:22.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.647+0000 7f137a3b0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13740c3ea0 0x7f13740c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:22.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.647+0000 7f137a3b0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13740c64a0 con 0x7f137414fd30 2023-11-18T20:42:22.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.647+0000 7f137a3b0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13740c5c00 con 0x7f13740c3ea0 2023-11-18T20:42:22.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.647+0000 7f137a3b0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13740c5ee0 con 0x7f137406d0a0 2023-11-18T20:42:22.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.647+0000 7f1373fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f137414fd30 0x7f13740a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50858/0 (socket says 172.21.15.132:50858) 2023-11-18T20:42:22.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.647+0000 7f1373fff640 1 -- 172.21.15.132:0/2876082218 learned_addr learned my addr 172.21.15.132:0/2876082218 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:22.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.647+0000 7f137894d640 1 --2- 172.21.15.132:0/2876082218 >> v2:172.21.15.132:3300/0 conn(0x7f13740c3ea0 0x7f13740c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.648+0000 7f136bfff640 1 --2- 172.21.15.132:0/2876082218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f137406d0a0 0x7f1374152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.648+0000 7f137894d640 1 -- 172.21.15.132:0/2876082218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f137406d0a0 msgr2=0x7f1374152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.648+0000 7f137894d640 1 --2- 172.21.15.132:0/2876082218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f137406d0a0 0x7f1374152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.648+0000 7f137894d640 1 -- 172.21.15.132:0/2876082218 >> v1:172.21.15.132:6789/0 conn(0x7f137414fd30 legacy=0x7f13740a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.648+0000 7f137894d640 1 -- 172.21.15.132:0/2876082218 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740c61c0 con 0x7f13740c3ea0 2023-11-18T20:42:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.648+0000 7f13737fe640 1 -- 172.21.15.132:0/2876082218 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801171254 0 0) 0x7f13740c64a0 con 0x7f137414fd30 2023-11-18T20:42:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.648+0000 7f136bfff640 1 --2- 172.21.15.132:0/2876082218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f137406d0a0 0x7f1374152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:22.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.649+0000 7f137894d640 1 --2- 172.21.15.132:0/2876082218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c3ea0 0x7f13740c4330 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f136c009d90 tx=0x7f136c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbbcad6e7160cde server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:22.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.649+0000 7f13737fe640 1 -- 172.21.15.132:0/2876082218 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c02cc50 con 0x7f13740c3ea0 2023-11-18T20:42:22.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.649+0000 7f13737fe640 1 -- 172.21.15.132:0/2876082218 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c02cdb0 con 0x7f13740c3ea0 2023-11-18T20:42:22.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.649+0000 7f13737fe640 1 -- 172.21.15.132:0/2876082218 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c034660 con 0x7f13740c3ea0 2023-11-18T20:42:22.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.650+0000 7f137a3b0640 1 -- 172.21.15.132:0/2876082218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c3ea0 msgr2=0x7f13740c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:22.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.650+0000 7f137a3b0640 1 --2- 172.21.15.132:0/2876082218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c3ea0 0x7f13740c4330 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f136c009d90 tx=0x7f136c02bea0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.650+0000 7f137a3b0640 1 -- 172.21.15.132:0/2876082218 shutdown_connections 2023-11-18T20:42:22.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.650+0000 7f137a3b0640 1 --2- 172.21.15.132:0/2876082218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c3ea0 0x7f13740c4330 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.650+0000 7f137a3b0640 1 --2- 172.21.15.132:0/2876082218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f137406d0a0 0x7f1374152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.650+0000 7f137a3b0640 1 -- 172.21.15.132:0/2876082218 >> 172.21.15.132:0/2876082218 conn(0x7f137406a500 msgr2=0x7f137406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:22.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.650+0000 7f137a3b0640 1 -- 172.21.15.132:0/2876082218 shutdown_connections 2023-11-18T20:42:22.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.650+0000 7f137a3b0640 1 -- 172.21.15.132:0/2876082218 wait complete. 2023-11-18T20:42:22.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.652+0000 7f137a3b0640 1 Processor -- start 2023-11-18T20:42:22.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.652+0000 7f137a3b0640 1 -- start start 2023-11-18T20:42:22.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f137a3b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137406d0a0 0x7f137414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:22.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f137a3b0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13740c3ea0 0x7f1374071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:22.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f137a3b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f137414fd30 0x7f13741ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:22.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f137a3b0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13741ee3f0 con 0x7f137406d0a0 2023-11-18T20:42:22.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f137a3b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740a8900 con 0x7f137414fd30 2023-11-18T20:42:22.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f137a3b0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13741521d0 con 0x7f13740c3ea0 2023-11-18T20:42:22.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f1373fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137406d0a0 0x7f137414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:22.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f1373fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137406d0a0 0x7f137414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49566/0 (socket says 172.21.15.132:49566) 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.653+0000 7f1373fff640 1 -- 172.21.15.132:0/3999936706 learned_addr learned my addr 172.21.15.132:0/3999936706 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f136bfff640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13740c3ea0 0x7f1374071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f1373fff640 1 -- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13740c3ea0 msgr2=0x7f1374071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f1373fff640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13740c3ea0 0x7f1374071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f1373fff640 1 -- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f137414fd30 msgr2=0x7f13741ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f1373fff640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f137414fd30 0x7f13741ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f1373fff640 1 -- 172.21.15.132:0/3999936706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c009a70 con 0x7f137406d0a0 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f136bfff640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13740c3ea0 0x7f1374071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f1373fff640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137406d0a0 0x7f137414ebd0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f136400c500 tx=0x7f136400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f13717fa640 1 -- 172.21.15.132:0/3999936706 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364007560 con 0x7f137406d0a0 2023-11-18T20:42:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f13717fa640 1 -- 172.21.15.132:0/3999936706 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13640047e0 con 0x7f137406d0a0 2023-11-18T20:42:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f13717fa640 1 -- 172.21.15.132:0/3999936706 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364004b90 con 0x7f137406d0a0 2023-11-18T20:42:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13741ee0a0 con 0x7f137406d0a0 2023-11-18T20:42:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.654+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1374152420 con 0x7f137406d0a0 2023-11-18T20:42:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.656+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13741ee530 con 0x7f137406d0a0 2023-11-18T20:42:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.657+0000 7f13717fa640 1 -- 172.21.15.132:0/3999936706 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1364004cf0 con 0x7f137406d0a0 2023-11-18T20:42:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.657+0000 7f13717fa640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f135406ae40 0x7f135406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.658+0000 7f13717fa640 1 -- 172.21.15.132:0/3999936706 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f13640884b0 con 0x7f137406d0a0 2023-11-18T20:42:22.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.658+0000 7f136bfff640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f135406ae40 0x7f135406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.659+0000 7f136bfff640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f135406ae40 0x7f135406d300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f135c006fd0 tx=0x7f135c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:22.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.662+0000 7f13717fa640 1 -- 172.21.15.132:0/3999936706 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1364053870 con 0x7f137406d0a0 2023-11-18T20:42:22.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.853+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1374068350 con 0x7f137406d0a0 2023-11-18T20:42:22.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.858+0000 7f13717fa640 1 -- 172.21.15.132:0/3999936706 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1364056e90 con 0x7f137406d0a0 2023-11-18T20:42:22.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f135406ae40 msgr2=0x7f135406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:22.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f135406ae40 0x7f135406d300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f135c006fd0 tx=0x7f135c008040 comp rx=0 tx=0).stop 2023-11-18T20:42:22.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137406d0a0 msgr2=0x7f137414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:22.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137406d0a0 0x7f137414ebd0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f136400c500 tx=0x7f136400c9c0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 shutdown_connections 2023-11-18T20:42:22.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f135406ae40 0x7f135406d300 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f137414fd30 0x7f13741ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13740c3ea0 0x7f1374071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 --2- 172.21.15.132:0/3999936706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137406d0a0 0x7f137414ebd0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:22.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 >> 172.21.15.132:0/3999936706 conn(0x7f137406a500 msgr2=0x7f137406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:22.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 shutdown_connections 2023-11-18T20:42:22.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:22.861+0000 7f137a3b0640 1 -- 172.21.15.132:0/3999936706 wait complete. 2023-11-18T20:42:22.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-11-18T20:42:23.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.092+0000 7f2fb1a02640 1 Processor -- start 2023-11-18T20:42:23.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.092+0000 7f2fb1a02640 1 -- start start 2023-11-18T20:42:23.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.094+0000 7f2fb1a02640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac06d0a0 0x7f2fac152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:23.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.094+0000 7f2fb1a02640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2fac0c3ea0 0x7f2fac0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:23.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.094+0000 7f2fb1a02640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fac0c64a0 con 0x7f2fac14fd30 2023-11-18T20:42:23.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.094+0000 7f2fb1a02640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fac0c5c00 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.094+0000 7f2fb1a02640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0c5ee0 con 0x7f2fac06d0a0 2023-11-18T20:42:23.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.094+0000 7f2fab7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2fac0c3ea0 0x7f2fac0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:23.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.094+0000 7f2fab7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2fac0c3ea0 0x7f2fac0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49578/0 (socket says 172.21.15.132:49578) 2023-11-18T20:42:23.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.094+0000 7f2fab7fe640 1 -- 172.21.15.132:0/355194894 learned_addr learned my addr 172.21.15.132:0/355194894 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:23.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.095+0000 7f2fa3fff640 1 --2- 172.21.15.132:0/355194894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac06d0a0 0x7f2fac152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:23.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.095+0000 7f2fab7fe640 1 -- 172.21.15.132:0/355194894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac06d0a0 msgr2=0x7f2fac152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:23.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.095+0000 7f2fab7fe640 1 --2- 172.21.15.132:0/355194894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac06d0a0 0x7f2fac152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.095+0000 7f2fab7fe640 1 -- 172.21.15.132:0/355194894 >> v1:172.21.15.161:6789/0 conn(0x7f2fac14fd30 legacy=0x7f2fac0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:23.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.095+0000 7f2fab7fe640 1 -- 172.21.15.132:0/355194894 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0c61c0 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.096+0000 7f2fab7fe640 1 --2- 172.21.15.132:0/355194894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0c4330 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009e50 tx=0x7f2fa402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c0b1df6cbc288b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:23.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.096+0000 7f2faa7fc640 1 -- 172.21.15.132:0/355194894 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa402ca70 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.096+0000 7f2faa7fc640 1 -- 172.21.15.132:0/355194894 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa402cbd0 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.096+0000 7f2faa7fc640 1 -- 172.21.15.132:0/355194894 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40343f0 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.097+0000 7f2fb1a02640 1 -- 172.21.15.132:0/355194894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 msgr2=0x7f2fac0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.097+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/355194894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0c4330 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009e50 tx=0x7f2fa402bed0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.097+0000 7f2fb1a02640 1 -- 172.21.15.132:0/355194894 shutdown_connections 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.097+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/355194894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0c4330 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.097+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/355194894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac06d0a0 0x7f2fac152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.097+0000 7f2fb1a02640 1 -- 172.21.15.132:0/355194894 >> 172.21.15.132:0/355194894 conn(0x7f2fac06a500 msgr2=0x7f2fac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.097+0000 7f2fb1a02640 1 -- 172.21.15.132:0/355194894 shutdown_connections 2023-11-18T20:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.097+0000 7f2fb1a02640 1 -- 172.21.15.132:0/355194894 wait complete. 2023-11-18T20:42:23.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.099+0000 7f2fb1a02640 1 Processor -- start 2023-11-18T20:42:23.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.099+0000 7f2fb1a02640 1 -- start start 2023-11-18T20:42:23.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.100+0000 7f2fb1a02640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fac06d0a0 0x7f2fac1eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.100+0000 7f2fb1a02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fb1a02640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac14fd30 0x7f2fac06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fb1a02640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0c0d30 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fb1a02640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac071af0 con 0x7f2fac06d0a0 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fb1a02640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac071810 con 0x7f2fac14fd30 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fa3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fa3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0a9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49588/0 (socket says 172.21.15.132:49588) 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fa3fff640 1 -- 172.21.15.132:0/3269442448 learned_addr learned my addr 172.21.15.132:0/3269442448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2faaffd640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fac06d0a0 0x7f2fac1eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:23.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fa3fff640 1 -- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac14fd30 msgr2=0x7f2fac06fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:23.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fa3fff640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac14fd30 0x7f2fac06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fa3fff640 1 -- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fac06d0a0 msgr2=0x7f2fac1eabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:23.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fa3fff640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fac06d0a0 0x7f2fac1eabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2fa3fff640 1 -- 172.21.15.132:0/3269442448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa4009b30 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.101+0000 7f2faaffd640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fac06d0a0 0x7f2fac1eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:23.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.102+0000 7f2fa3fff640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0a9e20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400d5c0 tx=0x7f2f9400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:23.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.102+0000 7f2fa8ff9640 1 -- 172.21.15.132:0/3269442448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f940125f0 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.102+0000 7f2fa8ff9640 1 -- 172.21.15.132:0/3269442448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f94012750 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.102+0000 7f2fa8ff9640 1 -- 172.21.15.132:0/3269442448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94012b00 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.102+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac1ea0e0 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.102+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac1ea6a0 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.103+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fac068350 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.104+0000 7f2fa8ff9640 1 -- 172.21.15.132:0/3269442448 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f94012c60 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.105+0000 7f2fa8ff9640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f8c06ae40 0x7f2f8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:23.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.105+0000 7f2fa8ff9640 1 -- 172.21.15.132:0/3269442448 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2f940897e0 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.106+0000 7f2faaffd640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f8c06ae40 0x7f2f8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:23.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.107+0000 7f2faaffd640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f8c06ae40 0x7f2f8c06d300 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c003eb0 tx=0x7f2f9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:23.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.111+0000 7f2fa8ff9640 1 -- 172.21.15.132:0/3269442448 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f94054b20 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.368+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f2fac0c66d0 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.414+0000 7f2fa8ff9640 1 -- 172.21.15.132:0/3269442448 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v264) v1 ==== 159+0+0 (secure 0 0 0) 0x7f2f94058140 con 0x7f2fac0c3ea0 2023-11-18T20:42:23.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f8c06ae40 msgr2=0x7f2f8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:23.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f8c06ae40 0x7f2f8c06d300 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c003eb0 tx=0x7f2f9c009040 comp rx=0 tx=0).stop 2023-11-18T20:42:23.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 msgr2=0x7f2fac0a9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:23.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0a9e20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400d5c0 tx=0x7f2f9400da80 comp rx=0 tx=0).stop 2023-11-18T20:42:23.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 shutdown_connections 2023-11-18T20:42:23.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f2f8c06ae40 0x7f2f8c06d300 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fac14fd30 0x7f2fac06fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fac0c3ea0 0x7f2fac0a9e20 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 --2- 172.21.15.132:0/3269442448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fac06d0a0 0x7f2fac1eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:23.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 >> 172.21.15.132:0/3269442448 conn(0x7f2fac06a500 msgr2=0x7f2fac0a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:23.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.417+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 shutdown_connections 2023-11-18T20:42:23.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:23.418+0000 7f2fb1a02640 1 -- 172.21.15.132:0/3269442448 wait complete. 2023-11-18T20:42:23.438 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-11-18T20:42:23.438 INFO:tasks.cephfs_test_runner: 2023-11-18T20:42:23.438 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-18T20:42:23.438 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-18T20:42:23.439 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-18T20:42:23.439 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-18T20:42:23.439 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-11-18T20:42:23.439 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-11-18T20:42:23.439 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-11-18T20:42:23.439 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-11-18T20:42:23.439 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-11-18T20:42:23.440 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-11-18T20:42:23.440 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-11-18T20:42:23.440 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-11-18T20:42:23.440 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-18T20:42:23.440 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-18T20:42:23.440 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-18T20:42:23.440 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-18T20:42:23.440 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi132 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner: 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner:Ran 3 tests in 227.174s 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner: 2023-11-18T20:42:23.441 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner: 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-11-18T20:42:23.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi132 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-11-18T20:42:23.443 INFO:tasks.cephfs_test_runner: 2023-11-18T20:42:23.444 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-18T20:42:23.547 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=55d071d3ab664c93a445445b51a1d795 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-18T20:42:23.548 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-18T20:42:23.571 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-18T20:42:23.582 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-18T20:42:23.583 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-18T20:42:23.583 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:42:23.657 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-18T20:42:23.657 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-18T20:42:23.658 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:42:23.720 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-18T20:42:23.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:23.720 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-18T20:42:23.778 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T20:42:23.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:23.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T20:42:23.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:23.873 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-11-18T20:42:23.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:23.988 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-18T20:42:24.049 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T20:42:24.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:24.050 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T20:42:24.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:42:24.150 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-11-18T20:42:24.279 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-18T20:42:24.289 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-18T20:42:24.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:42:24.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.514+0000 7fda036b4640 1 Processor -- start 2023-11-18T20:42:24.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.515+0000 7fda036b4640 1 -- start start 2023-11-18T20:42:24.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.516+0000 7fda036b4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc14fd30 0x7fd9fc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.516+0000 7fda036b4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9fc06d0a0 0x7fd9fc0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.516+0000 7fda036b4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc0c64a0 con 0x7fd9fc0a5260 2023-11-18T20:42:24.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.516+0000 7fda036b4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c5c00 con 0x7fd9fc06d0a0 2023-11-18T20:42:24.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.516+0000 7fda036b4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c5ee0 con 0x7fd9fc14fd30 2023-11-18T20:42:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.517+0000 7fda01450640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc14fd30 0x7fd9fc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.517+0000 7fda00c4f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9fc06d0a0 0x7fd9fc0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.517+0000 7fda01450640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc14fd30 0x7fd9fc152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.132:58148/0 (socket says 172.21.15.132:58148) 2023-11-18T20:42:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.517+0000 7fda01450640 1 -- 172.21.15.132:0/2886288713 learned_addr learned my addr 172.21.15.132:0/2886288713 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.518+0000 7fda00c4f640 1 -- 172.21.15.132:0/2886288713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc14fd30 msgr2=0x7fd9fc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:24.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.518+0000 7fda00c4f640 1 --2- 172.21.15.132:0/2886288713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc14fd30 0x7fd9fc152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.518+0000 7fda00c4f640 1 -- 172.21.15.132:0/2886288713 >> v1:172.21.15.161:6789/0 conn(0x7fd9fc0a5260 legacy=0x7fd9fc0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.518+0000 7fda00c4f640 1 -- 172.21.15.132:0/2886288713 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0c61c0 con 0x7fd9fc06d0a0 2023-11-18T20:42:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.518+0000 7fda01450640 1 --2- 172.21.15.132:0/2886288713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc14fd30 0x7fd9fc152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:42:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.518+0000 7fd9f3fff640 1 -- 172.21.15.132:0/2886288713 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555540545 0 0) 0x7fd9fc0c64a0 con 0x7fd9fc0a5260 2023-11-18T20:42:24.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.520+0000 7fda00c4f640 1 --2- 172.21.15.132:0/2886288713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 0x7fd9fc0a4d20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0097a0 tx=0x7fd9ec02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb179df88aad969d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.520+0000 7fd9f3fff640 1 -- 172.21.15.132:0/2886288713 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec02d040 con 0x7fd9fc06d0a0 2023-11-18T20:42:24.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.520+0000 7fd9f3fff640 1 -- 172.21.15.132:0/2886288713 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec031810 con 0x7fd9fc06d0a0 2023-11-18T20:42:24.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.520+0000 7fd9f3fff640 1 -- 172.21.15.132:0/2886288713 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec031ba0 con 0x7fd9fc06d0a0 2023-11-18T20:42:24.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.521+0000 7fda036b4640 1 -- 172.21.15.132:0/2886288713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 msgr2=0x7fd9fc0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.521+0000 7fda036b4640 1 --2- 172.21.15.132:0/2886288713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 0x7fd9fc0a4d20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0097a0 tx=0x7fd9ec02b8b0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.521+0000 7fda036b4640 1 -- 172.21.15.132:0/2886288713 shutdown_connections 2023-11-18T20:42:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.521+0000 7fda036b4640 1 --2- 172.21.15.132:0/2886288713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 0x7fd9fc0a4d20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.521+0000 7fda036b4640 1 --2- 172.21.15.132:0/2886288713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc14fd30 0x7fd9fc152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.521+0000 7fda036b4640 1 -- 172.21.15.132:0/2886288713 >> 172.21.15.132:0/2886288713 conn(0x7fd9fc06a500 msgr2=0x7fd9fc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.521+0000 7fda036b4640 1 -- 172.21.15.132:0/2886288713 shutdown_connections 2023-11-18T20:42:24.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.521+0000 7fda036b4640 1 -- 172.21.15.132:0/2886288713 wait complete. 2023-11-18T20:42:24.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.523+0000 7fda036b4640 1 Processor -- start 2023-11-18T20:42:24.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.523+0000 7fda036b4640 1 -- start start 2023-11-18T20:42:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda036b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 0x7fd9fc1e9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda036b4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc0a5260 0x7fd9fc155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda036b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc14fd30 0x7fd9fc1eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda036b4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1e97c0 con 0x7fd9fc14fd30 2023-11-18T20:42:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda036b4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1ec250 con 0x7fd9fc06d0a0 2023-11-18T20:42:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda036b4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1ebf70 con 0x7fd9fc0a5260 2023-11-18T20:42:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda01c51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc14fd30 0x7fd9fc1eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda01c51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc14fd30 0x7fd9fc1eb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49594/0 (socket says 172.21.15.132:49594) 2023-11-18T20:42:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.524+0000 7fda01c51640 1 -- 172.21.15.132:0/15948917 learned_addr learned my addr 172.21.15.132:0/15948917 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fda00c4f640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc0a5260 0x7fd9fc155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fda01450640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 0x7fd9fc1e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fda01c51640 1 -- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc0a5260 msgr2=0x7fd9fc155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fda01c51640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc0a5260 0x7fd9fc155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fda01c51640 1 -- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 msgr2=0x7fd9fc1e9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fda01c51640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 0x7fd9fc1e9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fda01c51640 1 -- 172.21.15.132:0/15948917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f80094d0 con 0x7fd9fc14fd30 2023-11-18T20:42:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fda01c51640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc14fd30 0x7fd9fc1eb5f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400c760 tx=0x7fd9f400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/15948917 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4003da0 con 0x7fd9fc14fd30 2023-11-18T20:42:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/15948917 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400ce70 con 0x7fd9fc14fd30 2023-11-18T20:42:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.525+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/15948917 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4005290 con 0x7fd9fc14fd30 2023-11-18T20:42:24.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.526+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec009400 con 0x7fd9fc14fd30 2023-11-18T20:42:24.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.526+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc1559d0 con 0x7fd9fc14fd30 2023-11-18T20:42:24.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.527+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc155bc0 con 0x7fd9fc14fd30 2023-11-18T20:42:24.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.528+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/15948917 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9f40053f0 con 0x7fd9fc14fd30 2023-11-18T20:42:24.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.529+0000 7fd9f1ffb640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9e006ae40 0x7fd9e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.529+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/15948917 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd9f4089160 con 0x7fd9fc14fd30 2023-11-18T20:42:24.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.529+0000 7fda01450640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9e006ae40 0x7fd9e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.530+0000 7fda01450640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9e006ae40 0x7fd9e006d300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009c50 tx=0x7fd9f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.533+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/15948917 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9f4054540 con 0x7fd9fc14fd30 2023-11-18T20:42:24.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.719+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9fc0c45b0 con 0x7fd9e006ae40 2023-11-18T20:42:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.726+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/15948917 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48616 (secure 0 0 0) 0x7fd9f80098a0 con 0x7fd9e006ae40 2023-11-18T20:42:24.727 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:24.727 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:42:24.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.727+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9e006ae40 msgr2=0x7fd9e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.727+0000 7fda036b4640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9e006ae40 0x7fd9e006d300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009c50 tx=0x7fd9f8008040 comp rx=0 tx=0).stop 2023-11-18T20:42:24.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.727+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc14fd30 msgr2=0x7fd9fc1eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.727+0000 7fda036b4640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc14fd30 0x7fd9fc1eb5f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400c760 tx=0x7fd9f400cc20 comp rx=0 tx=0).stop 2023-11-18T20:42:24.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.728+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 shutdown_connections 2023-11-18T20:42:24.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.728+0000 7fda036b4640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fd9e006ae40 0x7fd9e006d300 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.728+0000 7fda036b4640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc14fd30 0x7fd9fc1eb5f0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.728+0000 7fda036b4640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9fc0a5260 0x7fd9fc155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.728+0000 7fda036b4640 1 --2- 172.21.15.132:0/15948917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9fc06d0a0 0x7fd9fc1e9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.728+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 >> 172.21.15.132:0/15948917 conn(0x7fd9fc06a500 msgr2=0x7fd9fc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:24.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.728+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 shutdown_connections 2023-11-18T20:42:24.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.728+0000 7fda036b4640 1 -- 172.21.15.132:0/15948917 wait complete. 2023-11-18T20:42:24.749 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2023-11-18T20:42:22.739010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254888,"kb_used_data":9604,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719832,"statfs":{"total":773094113280,"available":772833107968,"internally_reserved":0,"allocated":9834496,"data_stored":5108503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002228"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-11-18T20:42:19.867325+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:42:19.867325+0000","last_peered":"2023-11-18T20:42:19.867325+0000","last_clean":"2023-11-18T20:42:19.867325+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:42:19.867325+0000","last_undegraded":"2023-11-18T20:42:19.867325+0000","last_fullsized":"2023-11-18T20:42:19.867325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.018,"15min":1.0349999999999999},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4410000000000001,"5min":1.706,"15min":1.706},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.069,"15min":1.087},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5509999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4570000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.1299999999999999,"15min":1.1870000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.367,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.508},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1990000000000001,"15min":1.242},"min":{"1min":0.66300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6379999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.6080000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.2589999999999999,"15min":1.2869999999999999},"min":{"1min":0.80900000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.784}]},{"osd":3,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2190000000000001,"15min":1.234},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9219999999999999,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.355,"15min":1.425},"min":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.7769999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.649}]},{"osd":4,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.452,"15min":1.546},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.827,"5min":2.601,"15min":2.601},"last":1.897},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.407,"15min":1.5089999999999999},"min":{"1min":0.60099999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.615,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.359}]},{"osd":5,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.5149999999999999,"15min":1.593},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.865,"5min":3.02,"15min":3.02},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.601,"15min":1.6990000000000001},"min":{"1min":0.69199999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":3.488,"15min":3.488},"last":1.7549999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.677,"15min":1.7490000000000001},"min":{"1min":0.88900000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.2250000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.236},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6020000000000001,"15min":1.704},"min":{"1min":0.85799999999999998,"5min":0.502,"15min":0.502},"max":{"1min":2.4430000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.718}]}]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":490541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.999,"15min":0.97699999999999998},"min":{"1min":0.68899999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.46},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.99099999999999999,"15min":0.98699999999999999},"min":{"1min":0.65800000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5549999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.034,"15min":1.0109999999999999},"min":{"1min":0.70799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.7350000000000001,"5min":2.206,"15min":2.206},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1539999999999999,"15min":1.157},"min":{"1min":0.74199999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.1000000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.179,"15min":1.179},"min":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6579999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.339},{"interface":"front","average":{"1min":1.238,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.67400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9450000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.339},"min":{"1min":0.874,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.722,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2130000000000001,"15min":1.2010000000000001},"min":{"1min":0.70099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.891,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5009999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.879,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.54},{"interface":"front","average":{"1min":1.397,"5min":1.3759999999999999,"15min":1.375},"min":{"1min":0.65000000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.76,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.381,"15min":1.333},"min":{"1min":0.79000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.734,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5640000000000001,"15min":1.5389999999999999},"min":{"1min":0.76800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0939999999999999,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.5920000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5800000000000001,"15min":1.5660000000000001},"min":{"1min":0.74299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1459999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.371},{"interface":"front","average":{"1min":1.536,"5min":1.554,"15min":1.5189999999999999},"min":{"1min":0.84799999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.6200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1687552,"data_stored":1086252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.143,"15min":1.179},"min":{"1min":0.67800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.522,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.621},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.127,"15min":1.113},"min":{"1min":0.74299999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.167}]},{"osd":1,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2330000000000001,"15min":1.3089999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.569,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.347}]},{"osd":2,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2529999999999999,"15min":1.359},"min":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.306},{"interface":"front","average":{"1min":1.302,"5min":1.2130000000000001,"15min":1.208},"min":{"1min":0.82399999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.81399999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3979999999999999,"15min":1.478},"min":{"1min":0.75900000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6719999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3919999999999999,"15min":1.4390000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.734}]},{"osd":4,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.361,"15min":1.397},"min":{"1min":0.78900000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.468,"15min":1.496},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.27,"15min":2.27},"last":1.47}]},{"osd":6,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.5449999999999999,"15min":1.6339999999999999},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.9399999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.544,"15min":1.597},"min":{"1min":0.72299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":1.669}]},{"osd":7,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.6060000000000001,"15min":1.6519999999999999},"min":{"1min":0.67000000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.9730000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.6830000000000001,"15min":1.74},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.7380000000000004,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":1.534}]}]},{"osd":4,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":490403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0429999999999999,"15min":1.038},"min":{"1min":0.67100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.367},{"interface":"front","average":{"1min":1.147,"5min":1.099,"15min":1.1040000000000001},"min":{"1min":0.64900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.9610000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.738}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.149,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.609},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.9179999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.514}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1559999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9430000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.876},{"interface":"front","average":{"1min":1.274,"5min":1.306,"15min":1.383},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.0030000000000001,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.29}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.177,"15min":1.2130000000000001},"min":{"1min":0.76300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.361,"15min":1.4650000000000001},"min":{"1min":0.84299999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.804,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.7729999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.60799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2160000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3680000000000001,"15min":1.4379999999999999},"min":{"1min":0.75,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.95,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.8340000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4510000000000001,"15min":1.5289999999999999},"min":{"1min":0.64900000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.863,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.569,"15min":1.605},"min":{"1min":0.86299999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.2970000000000002,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.9590000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4299999999999999,"15min":1.462},"min":{"1min":0.80200000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.927},{"interface":"front","average":{"1min":1.516,"5min":1.5740000000000001,"15min":1.6240000000000001},"min":{"1min":0.71199999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.0190000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.8979999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":484436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.752},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0640000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.345,"5min":1.512,"15min":1.512},"last":1.2150000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95499999999999996,"15min":0.93999999999999995},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4810000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.026},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.4650000000000001,"5min":1.595,"15min":1.595},"last":0.98099999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.532,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.169},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":0.998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3500000000000001,"5min":1.675,"15min":1.675},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.161},"min":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7450000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2010000000000001,"15min":1.169},"min":{"1min":0.78000000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8819999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.583},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.23,"15min":1.24},"min":{"1min":0.76900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5700000000000001,"5min":1.901,"15min":1.901},"last":1.355}]},{"osd":6,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.282,"15min":1.268},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.321},"min":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.323,"15min":1.3420000000000001},"min":{"1min":0.92900000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.722,"5min":1.907,"15min":1.907},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3500000000000001,"15min":1.3260000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.081,"15min":2.081},"last":1.3069999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":490403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.40300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.603,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.997,"5min":0.97599999999999998,"15min":1.024},"min":{"1min":0.52200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":2.081,"15min":2.081},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.85199999999999998},"min":{"1min":0.41899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2090000000000001,"5min":1.919,"15min":1.919},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0469999999999999,"15min":1.093},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4450000000000001,"5min":2.024,"15min":2.024},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.522,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.252,"15min":1.3109999999999999},"min":{"1min":0.68799999999999994,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9730000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.196,"15min":1.216},"min":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2669999999999999,"15min":1.3080000000000001},"min":{"1min":0.83299999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.129,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.034},{"interface":"front","average":{"1min":1.391,"5min":1.379,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.2589999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.0629999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3320000000000001,"15min":1.427},"min":{"1min":0.79400000000000004,"5min":0.755,"15min":0.755},"max":{"1min":2.3119999999999998,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.21},{"interface":"front","average":{"1min":1.341,"5min":1.282,"15min":1.319},"min":{"1min":0.86199999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3779999999999999,"15min":1.444},"min":{"1min":0.80400000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6419999999999999,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.4219999999999999},"min":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8759999999999999,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.85699999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1683456,"data_stored":1086170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.878},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.333,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.89700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4330000000000001,"5min":1.524,"15min":1.524},"last":0.82499999999999996}]},{"osd":2,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.151,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.625},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4770000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.603,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.999,"15min":1.0900000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1930000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0940000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.151,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.512,"5min":1.927,"15min":1.927},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3049999999999999,"15min":1.3999999999999999},"min":{"1min":0.77300000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.79,"5min":3.343,"15min":3.343},"last":1.3640000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.292,"15min":1.4350000000000001},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6000000000000001,"5min":3.206,"15min":3.206},"last":1.522},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2909999999999999,"15min":1.369},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7929999999999999,"5min":2.165,"15min":2.165},"last":1.278}]},{"osd":6,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3600000000000001,"15min":1.45},"min":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8700000000000001,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.399,"15min":1.5429999999999999},"min":{"1min":0.82199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.905,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.321}]},{"osd":7,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.401,"15min":1.5589999999999999},"min":{"1min":0.72199999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.7410000000000001,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3740000000000001,"15min":1.4299999999999999},"min":{"1min":0.88700000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.956,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.90000000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542201,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":484242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.873,"15min":0.95199999999999996},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.468,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.054},{"interface":"front","average":{"1min":0.88,"5min":0.92900000000000005,"15min":0.996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.522,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.103}]},{"osd":2,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.2210000000000001,"15min":1.552},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1839999999999999,"5min":14.169,"15min":14.169},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89700000000000002,"15min":0.93200000000000005},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.5780000000000001,"5min":2.173,"15min":2.173},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.2230000000000001,"15min":1.514},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.512,"5min":11.629,"15min":11.629},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.361},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4119999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.6080000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3120000000000001,"15min":1.4079999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.659,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.3340000000000001,"15min":1.397},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.625,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.9159999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3879999999999999,"15min":1.5680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8120000000000001,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4419999999999999,"15min":1.6180000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1320000000000001,"5min":6.202,"15min":6.202},"last":1.8759999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.427,"15min":1.4570000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.73,"5min":5.085,"15min":5.085},"last":2.0190000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.504,"15min":1.6870000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.903,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.3009999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4670000000000001,"15min":1.605},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.9650000000000001,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.181},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5349999999999999,"15min":1.7330000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.653,"5min":6.149,"15min":6.149},"last":1.976}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:42:24.751 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:42:24.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.961+0000 7fa16ca59640 1 Processor -- start 2023-11-18T20:42:24.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.961+0000 7fa16ca59640 1 -- start start 2023-11-18T20:42:24.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.962+0000 7fa16ca59640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa16806bfe0 0x7fa1680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.962+0000 7fa16ca59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1680c1d30 0x7fa1680c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.962+0000 7fa16ca59640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1680c0e50 con 0x7fa168154da0 2023-11-18T20:42:24.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.962+0000 7fa16ca59640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa168154910 con 0x7fa16806bfe0 2023-11-18T20:42:24.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.962+0000 7fa16ca59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680c10a0 con 0x7fa1680c1d30 2023-11-18T20:42:24.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.963+0000 7fa15effd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa16806bfe0 0x7fa1680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.963+0000 7fa15effd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa16806bfe0 0x7fa1680a50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.132:52264/0 (socket says 172.21.15.132:52264) 2023-11-18T20:42:24.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.963+0000 7fa15effd640 1 -- 172.21.15.132:0/4150263596 learned_addr learned my addr 172.21.15.132:0/4150263596 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:24.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.963+0000 7fa167fff640 1 --2- 172.21.15.132:0/4150263596 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1680c1d30 0x7fa1680c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.963+0000 7fa1677fe640 1 --1- 172.21.15.132:0/4150263596 >> v1:172.21.15.161:6789/0 conn(0x7fa168154da0 0x7fa168150bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.132:60404/0 (socket says 172.21.15.132:60404) 2023-11-18T20:42:24.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.964+0000 7fa15effd640 1 -- 172.21.15.132:0/4150263596 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1680c1d30 msgr2=0x7fa1680c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:24.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.964+0000 7fa15effd640 1 --2- 172.21.15.132:0/4150263596 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1680c1d30 0x7fa1680c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.964+0000 7fa15effd640 1 -- 172.21.15.132:0/4150263596 >> v1:172.21.15.161:6789/0 conn(0x7fa168154da0 legacy=0x7fa168150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.964+0000 7fa15effd640 1 -- 172.21.15.132:0/4150263596 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1681542c0 con 0x7fa16806bfe0 2023-11-18T20:42:24.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.965+0000 7fa15effd640 1 --2- 172.21.15.132:0/4150263596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa16806bfe0 0x7fa1680a50d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa150009870 tx=0x7fa15002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c379416a8d89c148 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.966+0000 7fa166ffd640 1 -- 172.21.15.132:0/4150263596 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1500317c0 con 0x7fa16806bfe0 2023-11-18T20:42:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.966+0000 7fa166ffd640 1 -- 172.21.15.132:0/4150263596 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa150031920 con 0x7fa16806bfe0 2023-11-18T20:42:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.966+0000 7fa166ffd640 1 -- 172.21.15.132:0/4150263596 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150031cb0 con 0x7fa16806bfe0 2023-11-18T20:42:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.967+0000 7fa16ca59640 1 -- 172.21.15.132:0/4150263596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa16806bfe0 msgr2=0x7fa1680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.967+0000 7fa16ca59640 1 --2- 172.21.15.132:0/4150263596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa16806bfe0 0x7fa1680a50d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa150009870 tx=0x7fa15002b860 comp rx=0 tx=0).stop 2023-11-18T20:42:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.967+0000 7fa16ca59640 1 -- 172.21.15.132:0/4150263596 shutdown_connections 2023-11-18T20:42:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.967+0000 7fa16ca59640 1 --2- 172.21.15.132:0/4150263596 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1680c1d30 0x7fa1680c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.967+0000 7fa16ca59640 1 --2- 172.21.15.132:0/4150263596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa16806bfe0 0x7fa1680a50d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.967+0000 7fa16ca59640 1 -- 172.21.15.132:0/4150263596 >> 172.21.15.132:0/4150263596 conn(0x7fa1680a77f0 msgr2=0x7fa1680a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.967+0000 7fa16ca59640 1 -- 172.21.15.132:0/4150263596 shutdown_connections 2023-11-18T20:42:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.967+0000 7fa16ca59640 1 -- 172.21.15.132:0/4150263596 wait complete. 2023-11-18T20:42:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.969+0000 7fa16ca59640 1 Processor -- start 2023-11-18T20:42:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.969+0000 7fa16ca59640 1 -- start start 2023-11-18T20:42:24.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa16ca59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa16806bfe0 0x7fa1681ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa16ca59640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1680c1d30 0x7fa168071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa16ca59640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168154da0 0x7fa1681e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa16ca59640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680aacf0 con 0x7fa1680c1d30 2023-11-18T20:42:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa16ca59640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1681e7d50 con 0x7fa168154da0 2023-11-18T20:42:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa16ca59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa168150a80 con 0x7fa16806bfe0 2023-11-18T20:42:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa15effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1680c1d30 0x7fa168071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa15effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1680c1d30 0x7fa168071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49604/0 (socket says 172.21.15.132:49604) 2023-11-18T20:42:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.970+0000 7fa15effd640 1 -- 172.21.15.132:0/2970144371 learned_addr learned my addr 172.21.15.132:0/2970144371 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.971+0000 7fa1677fe640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa16806bfe0 0x7fa1681ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.971+0000 7fa167fff640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168154da0 0x7fa1681e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.971+0000 7fa15effd640 1 -- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa16806bfe0 msgr2=0x7fa1681ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.971+0000 7fa15effd640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa16806bfe0 0x7fa1681ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.971+0000 7fa15effd640 1 -- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168154da0 msgr2=0x7fa1681e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.971+0000 7fa15effd640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168154da0 0x7fa1681e35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.971+0000 7fa15effd640 1 -- 172.21.15.132:0/2970144371 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500094d0 con 0x7fa1680c1d30 2023-11-18T20:42:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.971+0000 7fa15effd640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1680c1d30 0x7fa168071e60 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa150000c00 tx=0x7fa1500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.972+0000 7fa164ff9640 1 -- 172.21.15.132:0/2970144371 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150032860 con 0x7fa1680c1d30 2023-11-18T20:42:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.972+0000 7fa164ff9640 1 -- 172.21.15.132:0/2970144371 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1500329c0 con 0x7fa1680c1d30 2023-11-18T20:42:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.972+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa168150220 con 0x7fa1680c1d30 2023-11-18T20:42:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.972+0000 7fa164ff9640 1 -- 172.21.15.132:0/2970144371 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150032d70 con 0x7fa1680c1d30 2023-11-18T20:42:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.972+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1681ea830 con 0x7fa1680c1d30 2023-11-18T20:42:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.973+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa168067950 con 0x7fa1680c1d30 2023-11-18T20:42:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.974+0000 7fa164ff9640 1 -- 172.21.15.132:0/2970144371 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa15004e450 con 0x7fa1680c1d30 2023-11-18T20:42:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.975+0000 7fa164ff9640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa14806ae40 0x7fa14806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.975+0000 7fa164ff9640 1 -- 172.21.15.132:0/2970144371 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa1500ab5d0 con 0x7fa1680c1d30 2023-11-18T20:42:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.975+0000 7fa1677fe640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa14806ae40 0x7fa14806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.976+0000 7fa1677fe640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa14806ae40 0x7fa14806d300 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa158000f60 tx=0x7fa158009ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:24.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:24.979+0000 7fa164ff9640 1 -- 172.21.15.132:0/2970144371 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa150076880 con 0x7fa1680c1d30 2023-11-18T20:42:25.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.166+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1681e7810 con 0x7fa14806ae40 2023-11-18T20:42:25.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.173+0000 7fa164ff9640 1 -- 172.21.15.132:0/2970144371 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48616 (secure 0 0 0) 0x7fa158007b00 con 0x7fa14806ae40 2023-11-18T20:42:25.174 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:25.175 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:42:25.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa14806ae40 msgr2=0x7fa14806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa14806ae40 0x7fa14806d300 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa158000f60 tx=0x7fa158009ef0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1680c1d30 msgr2=0x7fa168071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1680c1d30 0x7fa168071e60 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa150000c00 tx=0x7fa1500046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 shutdown_connections 2023-11-18T20:42:25.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa14806ae40 0x7fa14806d300 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa168154da0 0x7fa1681e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1680c1d30 0x7fa168071e60 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 --2- 172.21.15.132:0/2970144371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa16806bfe0 0x7fa1681ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.175+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 >> 172.21.15.132:0/2970144371 conn(0x7fa1680a77f0 msgr2=0x7fa16806c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:25.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.176+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 shutdown_connections 2023-11-18T20:42:25.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.176+0000 7fa16ca59640 1 -- 172.21.15.132:0/2970144371 wait complete. 2023-11-18T20:42:25.194 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2023-11-18T20:42:24.739615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254888,"kb_used_data":9604,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719832,"statfs":{"total":773094113280,"available":772833107968,"internally_reserved":0,"allocated":9834496,"data_stored":5108503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002251"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-11-18T20:42:19.867325+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:42:19.867325+0000","last_peered":"2023-11-18T20:42:19.867325+0000","last_clean":"2023-11-18T20:42:19.867325+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:42:19.867325+0000","last_undegraded":"2023-11-18T20:42:19.867325+0000","last_fullsized":"2023-11-18T20:42:19.867325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.018,"15min":1.0349999999999999},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4410000000000001,"5min":1.706,"15min":1.706},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.069,"15min":1.087},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5509999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4570000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.1299999999999999,"15min":1.1870000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.367,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.508},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1990000000000001,"15min":1.242},"min":{"1min":0.66300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6379999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.6080000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.2589999999999999,"15min":1.2869999999999999},"min":{"1min":0.80900000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.784}]},{"osd":3,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2190000000000001,"15min":1.234},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9219999999999999,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.355,"15min":1.425},"min":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.7769999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.649}]},{"osd":4,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.452,"15min":1.546},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.827,"5min":2.601,"15min":2.601},"last":1.897},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.407,"15min":1.5089999999999999},"min":{"1min":0.60099999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.615,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.359}]},{"osd":5,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.5149999999999999,"15min":1.593},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.865,"5min":3.02,"15min":3.02},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.601,"15min":1.6990000000000001},"min":{"1min":0.69199999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":3.488,"15min":3.488},"last":1.7549999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.677,"15min":1.7490000000000001},"min":{"1min":0.88900000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.2250000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.236},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6020000000000001,"15min":1.704},"min":{"1min":0.85799999999999998,"5min":0.502,"15min":0.502},"max":{"1min":2.4430000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.718}]}]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":490541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.999,"15min":0.97699999999999998},"min":{"1min":0.68899999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.46},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.99099999999999999,"15min":0.98699999999999999},"min":{"1min":0.65800000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5549999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.034,"15min":1.0109999999999999},"min":{"1min":0.70799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.7350000000000001,"5min":2.206,"15min":2.206},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1539999999999999,"15min":1.157},"min":{"1min":0.74199999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.1000000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.179,"15min":1.179},"min":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6579999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.339},{"interface":"front","average":{"1min":1.238,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.67400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9450000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.339},"min":{"1min":0.874,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.722,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2130000000000001,"15min":1.2010000000000001},"min":{"1min":0.70099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.891,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5009999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.879,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.54},{"interface":"front","average":{"1min":1.397,"5min":1.3759999999999999,"15min":1.375},"min":{"1min":0.65000000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.76,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.381,"15min":1.333},"min":{"1min":0.79000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.734,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5640000000000001,"15min":1.5389999999999999},"min":{"1min":0.76800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0939999999999999,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.5920000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5800000000000001,"15min":1.5660000000000001},"min":{"1min":0.74299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1459999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.371},{"interface":"front","average":{"1min":1.536,"5min":1.554,"15min":1.5189999999999999},"min":{"1min":0.84799999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.6200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1687552,"data_stored":1086252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.143,"15min":1.179},"min":{"1min":0.67800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.522,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.621},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.127,"15min":1.113},"min":{"1min":0.74299999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.167}]},{"osd":1,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2330000000000001,"15min":1.3089999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.569,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.347}]},{"osd":2,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2529999999999999,"15min":1.359},"min":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.306},{"interface":"front","average":{"1min":1.302,"5min":1.2130000000000001,"15min":1.208},"min":{"1min":0.82399999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.81399999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3979999999999999,"15min":1.478},"min":{"1min":0.75900000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6719999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3919999999999999,"15min":1.4390000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.734}]},{"osd":4,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.361,"15min":1.397},"min":{"1min":0.78900000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.468,"15min":1.496},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.27,"15min":2.27},"last":1.47}]},{"osd":6,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.5449999999999999,"15min":1.6339999999999999},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.9399999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.544,"15min":1.597},"min":{"1min":0.72299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":1.669}]},{"osd":7,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.6060000000000001,"15min":1.6519999999999999},"min":{"1min":0.67000000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.9730000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.6830000000000001,"15min":1.74},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.7380000000000004,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":1.534}]}]},{"osd":4,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":490403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0429999999999999,"15min":1.038},"min":{"1min":0.67100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.367},{"interface":"front","average":{"1min":1.147,"5min":1.099,"15min":1.1040000000000001},"min":{"1min":0.64900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.9610000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.738}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.149,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.609},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.9179999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.514}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1559999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9430000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.876},{"interface":"front","average":{"1min":1.274,"5min":1.306,"15min":1.383},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.0030000000000001,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.29}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.177,"15min":1.2130000000000001},"min":{"1min":0.76300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.361,"15min":1.4650000000000001},"min":{"1min":0.84299999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.804,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.7729999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.60799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2160000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3680000000000001,"15min":1.4379999999999999},"min":{"1min":0.75,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.95,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.8340000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4510000000000001,"15min":1.5289999999999999},"min":{"1min":0.64900000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.863,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.569,"15min":1.605},"min":{"1min":0.86299999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.2970000000000002,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.9590000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4299999999999999,"15min":1.462},"min":{"1min":0.80200000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.927},{"interface":"front","average":{"1min":1.516,"5min":1.5740000000000001,"15min":1.6240000000000001},"min":{"1min":0.71199999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.0190000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.8979999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":484436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.752},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0640000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.345,"5min":1.512,"15min":1.512},"last":1.2150000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95499999999999996,"15min":0.93999999999999995},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4810000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.026},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.4650000000000001,"5min":1.595,"15min":1.595},"last":0.98099999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.532,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.169},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":0.998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3500000000000001,"5min":1.675,"15min":1.675},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.161},"min":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7450000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2010000000000001,"15min":1.169},"min":{"1min":0.78000000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8819999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.583},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.23,"15min":1.24},"min":{"1min":0.76900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5700000000000001,"5min":1.901,"15min":1.901},"last":1.355}]},{"osd":6,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.282,"15min":1.268},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.321},"min":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.323,"15min":1.3420000000000001},"min":{"1min":0.92900000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.722,"5min":1.907,"15min":1.907},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3500000000000001,"15min":1.3260000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.081,"15min":2.081},"last":1.3069999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":490403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.40300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.603,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.997,"5min":0.97599999999999998,"15min":1.024},"min":{"1min":0.52200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":2.081,"15min":2.081},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.85199999999999998},"min":{"1min":0.41899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2090000000000001,"5min":1.919,"15min":1.919},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0469999999999999,"15min":1.093},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4450000000000001,"5min":2.024,"15min":2.024},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.522,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.252,"15min":1.3109999999999999},"min":{"1min":0.68799999999999994,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9730000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.196,"15min":1.216},"min":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2669999999999999,"15min":1.3080000000000001},"min":{"1min":0.83299999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.129,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.034},{"interface":"front","average":{"1min":1.391,"5min":1.379,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.2589999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.0629999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3320000000000001,"15min":1.427},"min":{"1min":0.79400000000000004,"5min":0.755,"15min":0.755},"max":{"1min":2.3119999999999998,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.21},{"interface":"front","average":{"1min":1.341,"5min":1.282,"15min":1.319},"min":{"1min":0.86199999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3779999999999999,"15min":1.444},"min":{"1min":0.80400000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6419999999999999,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.4219999999999999},"min":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8759999999999999,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.85699999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1683456,"data_stored":1086170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.878},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.333,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.89700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4330000000000001,"5min":1.524,"15min":1.524},"last":0.82499999999999996}]},{"osd":2,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.151,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.625},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4770000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.603,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.999,"15min":1.0900000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1930000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0940000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.151,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.512,"5min":1.927,"15min":1.927},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3049999999999999,"15min":1.3999999999999999},"min":{"1min":0.77300000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.79,"5min":3.343,"15min":3.343},"last":1.3640000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.292,"15min":1.4350000000000001},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6000000000000001,"5min":3.206,"15min":3.206},"last":1.522},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2909999999999999,"15min":1.369},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7929999999999999,"5min":2.165,"15min":2.165},"last":1.278}]},{"osd":6,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3600000000000001,"15min":1.45},"min":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8700000000000001,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.399,"15min":1.5429999999999999},"min":{"1min":0.82199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.905,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.321}]},{"osd":7,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.401,"15min":1.5589999999999999},"min":{"1min":0.72199999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.7410000000000001,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3740000000000001,"15min":1.4299999999999999},"min":{"1min":0.88700000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.956,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.90000000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542201,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":484242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.873,"15min":0.95199999999999996},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.468,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.054},{"interface":"front","average":{"1min":0.88,"5min":0.92900000000000005,"15min":0.996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.522,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.103}]},{"osd":2,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.2210000000000001,"15min":1.552},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1839999999999999,"5min":14.169,"15min":14.169},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89700000000000002,"15min":0.93200000000000005},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.5780000000000001,"5min":2.173,"15min":2.173},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.2230000000000001,"15min":1.514},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.512,"5min":11.629,"15min":11.629},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.361},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4119999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.6080000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3120000000000001,"15min":1.4079999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.659,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.3340000000000001,"15min":1.397},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.625,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.9159999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3879999999999999,"15min":1.5680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8120000000000001,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4419999999999999,"15min":1.6180000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1320000000000001,"5min":6.202,"15min":6.202},"last":1.8759999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.427,"15min":1.4570000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.73,"5min":5.085,"15min":5.085},"last":2.0190000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.504,"15min":1.6870000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.903,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.3009999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4670000000000001,"15min":1.605},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.9650000000000001,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.181},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5349999999999999,"15min":1.7330000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.653,"5min":6.149,"15min":6.149},"last":1.976}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:42:25.195 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-18T20:42:25.196 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:42:25.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.385+0000 7fed482a2640 1 Processor -- start 2023-11-18T20:42:25.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.385+0000 7fed482a2640 1 -- start start 2023-11-18T20:42:25.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.386+0000 7fed482a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed4014fd30 0x7fed40152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.386+0000 7fed482a2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed400c64a0 con 0x7fed400c3ea0 2023-11-18T20:42:25.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.386+0000 7fed482a2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed400c5c00 con 0x7fed4006d0a0 2023-11-18T20:42:25.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.386+0000 7fed482a2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed400c5ee0 con 0x7fed4014fd30 2023-11-18T20:42:25.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.387+0000 7fed4683f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fed400c3ea0 0x7fed400c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50872/0 (socket says 172.21.15.132:50872) 2023-11-18T20:42:25.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.387+0000 7fed4683f640 1 -- 172.21.15.132:0/3088512894 learned_addr learned my addr 172.21.15.132:0/3088512894 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:25.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.387+0000 7fed4603e640 1 --2- 172.21.15.132:0/3088512894 >> v2:172.21.15.132:3300/0 conn(0x7fed4014fd30 0x7fed40152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:25.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.387+0000 7fed4603e640 1 -- 172.21.15.132:0/3088512894 >> v1:172.21.15.161:6789/0 conn(0x7fed4006d0a0 legacy=0x7fed400a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:25.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.387+0000 7fed4603e640 1 -- 172.21.15.132:0/3088512894 >> v1:172.21.15.132:6789/0 conn(0x7fed400c3ea0 legacy=0x7fed400c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.387+0000 7fed4603e640 1 -- 172.21.15.132:0/3088512894 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400c61c0 con 0x7fed4014fd30 2023-11-18T20:42:25.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.388+0000 7fed4603e640 1 --2- 172.21.15.132:0/3088512894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed40152f20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0097a0 tx=0x7fed3c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72291baa0935873 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:25.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.388+0000 7fed4503c640 1 -- 172.21.15.132:0/3088512894 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c031830 con 0x7fed4014fd30 2023-11-18T20:42:25.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.388+0000 7fed4503c640 1 -- 172.21.15.132:0/3088512894 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c031990 con 0x7fed4014fd30 2023-11-18T20:42:25.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.388+0000 7fed4503c640 1 -- 172.21.15.132:0/3088512894 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c031d20 con 0x7fed4014fd30 2023-11-18T20:42:25.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.389+0000 7fed482a2640 1 -- 172.21.15.132:0/3088512894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 msgr2=0x7fed40152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.389+0000 7fed482a2640 1 --2- 172.21.15.132:0/3088512894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed40152f20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0097a0 tx=0x7fed3c02b8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.389+0000 7fed482a2640 1 -- 172.21.15.132:0/3088512894 shutdown_connections 2023-11-18T20:42:25.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.389+0000 7fed482a2640 1 --2- 172.21.15.132:0/3088512894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed40152f20 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.389+0000 7fed482a2640 1 -- 172.21.15.132:0/3088512894 >> 172.21.15.132:0/3088512894 conn(0x7fed4006a500 msgr2=0x7fed4006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:25.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.389+0000 7fed482a2640 1 -- 172.21.15.132:0/3088512894 shutdown_connections 2023-11-18T20:42:25.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.389+0000 7fed482a2640 1 -- 172.21.15.132:0/3088512894 wait complete. 2023-11-18T20:42:25.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.391+0000 7fed482a2640 1 Processor -- start 2023-11-18T20:42:25.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.391+0000 7fed482a2640 1 -- start start 2023-11-18T20:42:25.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed482a2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4006d0a0 0x7fed400705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed482a2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed400c3ea0 0x7fed401ea390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed482a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed401ea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed482a2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed401503d0 con 0x7fed4014fd30 2023-11-18T20:42:25.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed482a2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed400a5050 con 0x7fed4006d0a0 2023-11-18T20:42:25.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed482a2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed400a9470 con 0x7fed400c3ea0 2023-11-18T20:42:25.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed4683f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed401ea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:25.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed4683f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed401ea8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49622/0 (socket says 172.21.15.132:49622) 2023-11-18T20:42:25.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed4683f640 1 -- 172.21.15.132:0/2539849003 learned_addr learned my addr 172.21.15.132:0/2539849003 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:25.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed4683f640 1 -- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed400c3ea0 msgr2=0x7fed401ea390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.392+0000 7fed4683f640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed400c3ea0 0x7fed401ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed4683f640 1 -- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4006d0a0 msgr2=0x7fed400705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed4683f640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4006d0a0 0x7fed400705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed4683f640 1 -- 172.21.15.132:0/2539849003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c009400 con 0x7fed4014fd30 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed4683f640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed401ea8d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fed3800cbc0 tx=0x7fed3800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed36ffd640 1 -- 172.21.15.132:0/2539849003 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3800ad40 con 0x7fed4014fd30 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed36ffd640 1 -- 172.21.15.132:0/2539849003 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38012400 con 0x7fed4014fd30 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed36ffd640 1 -- 172.21.15.132:0/2539849003 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3800aea0 con 0x7fed4014fd30 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed400a9750 con 0x7fed4014fd30 2023-11-18T20:42:25.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.393+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed40070ae0 con 0x7fed4014fd30 2023-11-18T20:42:25.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.394+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed400c49f0 con 0x7fed4014fd30 2023-11-18T20:42:25.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.395+0000 7fed36ffd640 1 -- 172.21.15.132:0/2539849003 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed38007070 con 0x7fed4014fd30 2023-11-18T20:42:25.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.396+0000 7fed36ffd640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2406ae40 0x7fed2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.396+0000 7fed36ffd640 1 -- 172.21.15.132:0/2539849003 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fed380891c0 con 0x7fed4014fd30 2023-11-18T20:42:25.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.397+0000 7fed4603e640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2406ae40 0x7fed2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:25.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.398+0000 7fed4603e640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2406ae40 0x7fed2406d300 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fed3c036000 tx=0x7fed3c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.400+0000 7fed36ffd640 1 -- 172.21.15.132:0/2539849003 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed38054650 con 0x7fed4014fd30 2023-11-18T20:42:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.590+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed40067430 con 0x7fed2406ae40 2023-11-18T20:42:25.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.597+0000 7fed36ffd640 1 -- 172.21.15.132:0/2539849003 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48616 (secure 0 0 0) 0x7fed40067430 con 0x7fed2406ae40 2023-11-18T20:42:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:25.599 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:42:25.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2406ae40 msgr2=0x7fed2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2406ae40 0x7fed2406d300 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fed3c036000 tx=0x7fed3c030000 comp rx=0 tx=0).stop 2023-11-18T20:42:25.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 msgr2=0x7fed401ea8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed401ea8d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fed3800cbc0 tx=0x7fed3800a430 comp rx=0 tx=0).stop 2023-11-18T20:42:25.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 shutdown_connections 2023-11-18T20:42:25.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fed2406ae40 0x7fed2406d300 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed4014fd30 0x7fed401ea8d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed400c3ea0 0x7fed401ea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 --2- 172.21.15.132:0/2539849003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4006d0a0 0x7fed400705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 >> 172.21.15.132:0/2539849003 conn(0x7fed4006a500 msgr2=0x7fed400c1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:25.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 shutdown_connections 2023-11-18T20:42:25.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.600+0000 7fed482a2640 1 -- 172.21.15.132:0/2539849003 wait complete. 2023-11-18T20:42:25.618 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2023-11-18T20:42:24.739615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254888,"kb_used_data":9604,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719832,"statfs":{"total":773094113280,"available":772833107968,"internally_reserved":0,"allocated":9834496,"data_stored":5108503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002251"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-11-18T20:42:19.867325+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:42:19.867325+0000","last_peered":"2023-11-18T20:42:19.867325+0000","last_clean":"2023-11-18T20:42:19.867325+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:42:19.867325+0000","last_undegraded":"2023-11-18T20:42:19.867325+0000","last_fullsized":"2023-11-18T20:42:19.867325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:46:59.928595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.018,"15min":1.0349999999999999},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4410000000000001,"5min":1.706,"15min":1.706},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.069,"15min":1.087},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5509999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4570000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.1299999999999999,"15min":1.1870000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.367,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.508},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1990000000000001,"15min":1.242},"min":{"1min":0.66300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6379999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.6080000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.2589999999999999,"15min":1.2869999999999999},"min":{"1min":0.80900000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.784}]},{"osd":3,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2190000000000001,"15min":1.234},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9219999999999999,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.355,"15min":1.425},"min":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.7769999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.649}]},{"osd":4,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.452,"15min":1.546},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.827,"5min":2.601,"15min":2.601},"last":1.897},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.407,"15min":1.5089999999999999},"min":{"1min":0.60099999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.615,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.359}]},{"osd":5,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.5149999999999999,"15min":1.593},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.865,"5min":3.02,"15min":3.02},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.601,"15min":1.6990000000000001},"min":{"1min":0.69199999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":3.488,"15min":3.488},"last":1.7549999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.677,"15min":1.7490000000000001},"min":{"1min":0.88900000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.2250000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.236},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6020000000000001,"15min":1.704},"min":{"1min":0.85799999999999998,"5min":0.502,"15min":0.502},"max":{"1min":2.4430000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.718}]}]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":490541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.999,"15min":0.97699999999999998},"min":{"1min":0.68899999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.46},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.99099999999999999,"15min":0.98699999999999999},"min":{"1min":0.65800000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5549999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.034,"15min":1.0109999999999999},"min":{"1min":0.70799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.7350000000000001,"5min":2.206,"15min":2.206},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1539999999999999,"15min":1.157},"min":{"1min":0.74199999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.1000000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.179,"15min":1.179},"min":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6579999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.339},{"interface":"front","average":{"1min":1.238,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.67400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9450000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.339},"min":{"1min":0.874,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.722,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2130000000000001,"15min":1.2010000000000001},"min":{"1min":0.70099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.891,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5009999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.879,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.54},{"interface":"front","average":{"1min":1.397,"5min":1.3759999999999999,"15min":1.375},"min":{"1min":0.65000000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.76,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.381,"15min":1.333},"min":{"1min":0.79000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.734,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5640000000000001,"15min":1.5389999999999999},"min":{"1min":0.76800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0939999999999999,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.5920000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5800000000000001,"15min":1.5660000000000001},"min":{"1min":0.74299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1459999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.371},{"interface":"front","average":{"1min":1.536,"5min":1.554,"15min":1.5189999999999999},"min":{"1min":0.84799999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.6200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1687552,"data_stored":1086252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.143,"15min":1.179},"min":{"1min":0.67800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.522,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.621},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.127,"15min":1.113},"min":{"1min":0.74299999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.167}]},{"osd":1,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2330000000000001,"15min":1.3089999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.569,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.347}]},{"osd":2,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2529999999999999,"15min":1.359},"min":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.306},{"interface":"front","average":{"1min":1.302,"5min":1.2130000000000001,"15min":1.208},"min":{"1min":0.82399999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.81399999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3979999999999999,"15min":1.478},"min":{"1min":0.75900000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6719999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3919999999999999,"15min":1.4390000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.734}]},{"osd":4,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.361,"15min":1.397},"min":{"1min":0.78900000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.468,"15min":1.496},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.27,"15min":2.27},"last":1.47}]},{"osd":6,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.5449999999999999,"15min":1.6339999999999999},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.9399999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.544,"15min":1.597},"min":{"1min":0.72299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":1.669}]},{"osd":7,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.6060000000000001,"15min":1.6519999999999999},"min":{"1min":0.67000000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.9730000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.6830000000000001,"15min":1.74},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.7380000000000004,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":1.534}]}]},{"osd":4,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":490403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0429999999999999,"15min":1.038},"min":{"1min":0.67100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.367},{"interface":"front","average":{"1min":1.147,"5min":1.099,"15min":1.1040000000000001},"min":{"1min":0.64900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.9610000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.738}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.149,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.609},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.9179999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.514}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1559999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9430000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.876},{"interface":"front","average":{"1min":1.274,"5min":1.306,"15min":1.383},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.0030000000000001,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.29}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.177,"15min":1.2130000000000001},"min":{"1min":0.76300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.361,"15min":1.4650000000000001},"min":{"1min":0.84299999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.804,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.7729999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.60799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2160000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3680000000000001,"15min":1.4379999999999999},"min":{"1min":0.75,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.95,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.8340000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4510000000000001,"15min":1.5289999999999999},"min":{"1min":0.64900000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.863,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.569,"15min":1.605},"min":{"1min":0.86299999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.2970000000000002,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.9590000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4299999999999999,"15min":1.462},"min":{"1min":0.80200000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.927},{"interface":"front","average":{"1min":1.516,"5min":1.5740000000000001,"15min":1.6240000000000001},"min":{"1min":0.71199999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.0190000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.8979999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":484436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.752},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0640000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.345,"5min":1.512,"15min":1.512},"last":1.2150000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95499999999999996,"15min":0.93999999999999995},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4810000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.026},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.4650000000000001,"5min":1.595,"15min":1.595},"last":0.98099999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.532,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.169},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":0.998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3500000000000001,"5min":1.675,"15min":1.675},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.161},"min":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7450000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2010000000000001,"15min":1.169},"min":{"1min":0.78000000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8819999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.583},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.23,"15min":1.24},"min":{"1min":0.76900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5700000000000001,"5min":1.901,"15min":1.901},"last":1.355}]},{"osd":6,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.282,"15min":1.268},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.321},"min":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.323,"15min":1.3420000000000001},"min":{"1min":0.92900000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.722,"5min":1.907,"15min":1.907},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3500000000000001,"15min":1.3260000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.081,"15min":2.081},"last":1.3069999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":490403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.40300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.603,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.997,"5min":0.97599999999999998,"15min":1.024},"min":{"1min":0.52200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":2.081,"15min":2.081},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.85199999999999998},"min":{"1min":0.41899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2090000000000001,"5min":1.919,"15min":1.919},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0469999999999999,"15min":1.093},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4450000000000001,"5min":2.024,"15min":2.024},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.522,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.252,"15min":1.3109999999999999},"min":{"1min":0.68799999999999994,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9730000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.196,"15min":1.216},"min":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2669999999999999,"15min":1.3080000000000001},"min":{"1min":0.83299999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.129,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.034},{"interface":"front","average":{"1min":1.391,"5min":1.379,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.2589999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.0629999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3320000000000001,"15min":1.427},"min":{"1min":0.79400000000000004,"5min":0.755,"15min":0.755},"max":{"1min":2.3119999999999998,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.21},{"interface":"front","average":{"1min":1.341,"5min":1.282,"15min":1.319},"min":{"1min":0.86199999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3779999999999999,"15min":1.444},"min":{"1min":0.80400000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6419999999999999,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.4219999999999999},"min":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8759999999999999,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.85699999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1683456,"data_stored":1086170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.878},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.333,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.89700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4330000000000001,"5min":1.524,"15min":1.524},"last":0.82499999999999996}]},{"osd":2,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.151,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.625},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4770000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.603,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.999,"15min":1.0900000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1930000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0940000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.151,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.512,"5min":1.927,"15min":1.927},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3049999999999999,"15min":1.3999999999999999},"min":{"1min":0.77300000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.79,"5min":3.343,"15min":3.343},"last":1.3640000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.292,"15min":1.4350000000000001},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6000000000000001,"5min":3.206,"15min":3.206},"last":1.522},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2909999999999999,"15min":1.369},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7929999999999999,"5min":2.165,"15min":2.165},"last":1.278}]},{"osd":6,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3600000000000001,"15min":1.45},"min":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8700000000000001,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.399,"15min":1.5429999999999999},"min":{"1min":0.82199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.905,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.321}]},{"osd":7,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.401,"15min":1.5589999999999999},"min":{"1min":0.72199999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.7410000000000001,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3740000000000001,"15min":1.4299999999999999},"min":{"1min":0.88700000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.956,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.90000000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542201,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":484242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.873,"15min":0.95199999999999996},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.468,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.054},{"interface":"front","average":{"1min":0.88,"5min":0.92900000000000005,"15min":0.996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.522,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.103}]},{"osd":2,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.2210000000000001,"15min":1.552},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1839999999999999,"5min":14.169,"15min":14.169},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89700000000000002,"15min":0.93200000000000005},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.5780000000000001,"5min":2.173,"15min":2.173},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.2230000000000001,"15min":1.514},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.512,"5min":11.629,"15min":11.629},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.361},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4119999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.6080000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3120000000000001,"15min":1.4079999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.659,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.3340000000000001,"15min":1.397},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.625,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.9159999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3879999999999999,"15min":1.5680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8120000000000001,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4419999999999999,"15min":1.6180000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1320000000000001,"5min":6.202,"15min":6.202},"last":1.8759999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.427,"15min":1.4570000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.73,"5min":5.085,"15min":5.085},"last":2.0190000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.504,"15min":1.6870000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.903,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.3009999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4670000000000001,"15min":1.605},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.9650000000000001,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.181},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5349999999999999,"15min":1.7330000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.653,"5min":6.149,"15min":6.149},"last":1.976}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:42:25.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:42:25.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.804+0000 7f87ea941640 1 Processor -- start 2023-11-18T20:42:25.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.804+0000 7f87ea941640 1 -- start start 2023-11-18T20:42:25.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.806+0000 7f87ea941640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87e4151fd0 0x7f87e406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.806+0000 7f87ea941640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e4157fe0 0x7f87e4158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.806+0000 7f87ea941640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e4071fd0 con 0x7f87e40c3400 2023-11-18T20:42:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.806+0000 7f87ea941640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e406ee50 con 0x7f87e4151fd0 2023-11-18T20:42:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.806+0000 7f87ea941640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4072220 con 0x7f87e4157fe0 2023-11-18T20:42:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.806+0000 7f87e3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87e4151fd0 0x7f87e406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.806+0000 7f87e3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87e4151fd0 0x7f87e406e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49630/0 (socket says 172.21.15.132:49630) 2023-11-18T20:42:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.806+0000 7f87e3fff640 1 -- 172.21.15.132:0/1954780529 learned_addr learned my addr 172.21.15.132:0/1954780529 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.807+0000 7f87e3fff640 1 -- 172.21.15.132:0/1954780529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e4157fe0 msgr2=0x7f87e4158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.807+0000 7f87e3fff640 1 --2- 172.21.15.132:0/1954780529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e4157fe0 0x7f87e4158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.807+0000 7f87e3fff640 1 -- 172.21.15.132:0/1954780529 >> v1:172.21.15.161:6789/0 conn(0x7f87e40c3400 legacy=0x7f87e406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:25.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.807+0000 7f87e3fff640 1 -- 172.21.15.132:0/1954780529 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e406e0d0 con 0x7f87e4151fd0 2023-11-18T20:42:25.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.808+0000 7f87e3fff640 1 --2- 172.21.15.132:0/1954780529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e406e910 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009870 tx=0x7f87d402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6878d718092af51 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:25.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.808+0000 7f87e37fe640 1 -- 172.21.15.132:0/1954780529 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d40317c0 con 0x7f87e4151fd0 2023-11-18T20:42:25.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.808+0000 7f87e37fe640 1 -- 172.21.15.132:0/1954780529 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4031920 con 0x7f87e4151fd0 2023-11-18T20:42:25.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.808+0000 7f87e37fe640 1 -- 172.21.15.132:0/1954780529 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4031cb0 con 0x7f87e4151fd0 2023-11-18T20:42:25.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.809+0000 7f87ea941640 1 -- 172.21.15.132:0/1954780529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 msgr2=0x7f87e406e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.809+0000 7f87ea941640 1 --2- 172.21.15.132:0/1954780529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e406e910 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009870 tx=0x7f87d402b860 comp rx=0 tx=0).stop 2023-11-18T20:42:25.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.809+0000 7f87ea941640 1 -- 172.21.15.132:0/1954780529 shutdown_connections 2023-11-18T20:42:25.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.809+0000 7f87ea941640 1 --2- 172.21.15.132:0/1954780529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e4157fe0 0x7f87e4158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.809+0000 7f87ea941640 1 --2- 172.21.15.132:0/1954780529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e406e910 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.809+0000 7f87ea941640 1 -- 172.21.15.132:0/1954780529 >> 172.21.15.132:0/1954780529 conn(0x7f87e40c6ee0 msgr2=0x7f87e40c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.809+0000 7f87ea941640 1 -- 172.21.15.132:0/1954780529 shutdown_connections 2023-11-18T20:42:25.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.809+0000 7f87ea941640 1 -- 172.21.15.132:0/1954780529 wait complete. 2023-11-18T20:42:25.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.811+0000 7f87ea941640 1 Processor -- start 2023-11-18T20:42:25.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.811+0000 7f87ea941640 1 -- start start 2023-11-18T20:42:25.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87ea941640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e40c3400 0x7f87e4142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87ea941640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87ea941640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87e4157fe0 0x7f87e4140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87ea941640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e414d290 con 0x7f87e4151fd0 2023-11-18T20:42:25.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87ea941640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e41ee720 con 0x7f87e4157fe0 2023-11-18T20:42:25.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87ea941640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4142780 con 0x7f87e40c3400 2023-11-18T20:42:25.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87dbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:25.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87dbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e414d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49644/0 (socket says 172.21.15.132:49644) 2023-11-18T20:42:25.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87dbfff640 1 -- 172.21.15.132:0/2365544856 learned_addr learned my addr 172.21.15.132:0/2365544856 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:25.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.812+0000 7f87e3fff640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e40c3400 0x7f87e4142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:25.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87e8ede640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87e4157fe0 0x7f87e4140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:25.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87dbfff640 1 -- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e40c3400 msgr2=0x7f87e4142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87dbfff640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e40c3400 0x7f87e4142240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87dbfff640 1 -- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87e4157fe0 msgr2=0x7f87e4140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:25.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87dbfff640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87e4157fe0 0x7f87e4140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:25.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87dbfff640 1 -- 172.21.15.132:0/2365544856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d40094d0 con 0x7f87e4151fd0 2023-11-18T20:42:25.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87dbfff640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e414d720 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00c400 tx=0x7f87cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:25.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87e17fa640 1 -- 172.21.15.132:0/2365544856 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0035f0 con 0x7f87e4151fd0 2023-11-18T20:42:25.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87e17fa640 1 -- 172.21.15.132:0/2365544856 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc003750 con 0x7f87e4151fd0 2023-11-18T20:42:25.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e41ee9c0 con 0x7f87e4151fd0 2023-11-18T20:42:25.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.813+0000 7f87e17fa640 1 -- 172.21.15.132:0/2365544856 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc003b40 con 0x7f87e4151fd0 2023-11-18T20:42:25.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.814+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e414cc10 con 0x7f87e4151fd0 2023-11-18T20:42:25.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.815+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e406f230 con 0x7f87e4151fd0 2023-11-18T20:42:25.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.816+0000 7f87e17fa640 1 -- 172.21.15.132:0/2365544856 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87cc003ca0 con 0x7f87e4151fd0 2023-11-18T20:42:25.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.816+0000 7f87e17fa640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f87c406ae40 0x7f87c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:25.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.816+0000 7f87e17fa640 1 -- 172.21.15.132:0/2365544856 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f87cc0884e0 con 0x7f87e4151fd0 2023-11-18T20:42:25.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.817+0000 7f87e3fff640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f87c406ae40 0x7f87c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:25.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.818+0000 7f87e3fff640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f87c406ae40 0x7f87c406d300 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f87d4036000 tx=0x7f87d403d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:25.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:25.821+0000 7f87e17fa640 1 -- 172.21.15.132:0/2365544856 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87cc0538e0 con 0x7f87e4151fd0 2023-11-18T20:42:26.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.010+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87e4068350 con 0x7f87e4151fd0 2023-11-18T20:42:26.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.012+0000 7f87e17fa640 1 -- 172.21.15.132:0/2365544856 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+13151 (secure 0 0 0) 0x7f87cc017090 con 0x7f87e4151fd0 2023-11-18T20:42:26.014 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:26.014 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":88,"fsid":"95273225-bfbe-4b9a-893d-dfaf6292d673","created":"2023-11-18T20:37:39.488872+0000","modified":"2023-11-18T20:42:22.401986+0000","last_up_change":"2023-11-18T20:37:51.669660+0000","last_in_change":"2023-11-18T20:37:43.023466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:37:52.703775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d22da2-1667-4cfd-bb83-e5b4e665c99e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6801","nonce":3421044779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6803","nonce":3421044779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6807","nonce":3421044779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3421044779},{"type":"v1","addr":"172.21.15.132:6805","nonce":3421044779}]},"public_addr":"172.21.15.132:6801/3421044779","cluster_addr":"172.21.15.132:6803/3421044779","heartbeat_back_addr":"172.21.15.132:6807/3421044779","heartbeat_front_addr":"172.21.15.132:6805/3421044779","state":["exists","up"]},{"osd":1,"uuid":"949e7095-6bb3-4448-a000-ab93187d72cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6809","nonce":3030620385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6811","nonce":3030620385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6819","nonce":3030620385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3030620385},{"type":"v1","addr":"172.21.15.132:6814","nonce":3030620385}]},"public_addr":"172.21.15.132:6809/3030620385","cluster_addr":"172.21.15.132:6811/3030620385","heartbeat_back_addr":"172.21.15.132:6819/3030620385","heartbeat_front_addr":"172.21.15.132:6814/3030620385","state":["exists","up"]},{"osd":2,"uuid":"4da8b5d6-6e88-4a85-8dfc-650b3c0e6cdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6815","nonce":1610126075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6821","nonce":1610126075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6831","nonce":1610126075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":1610126075},{"type":"v1","addr":"172.21.15.132:6827","nonce":1610126075}]},"public_addr":"172.21.15.132:6815/1610126075","cluster_addr":"172.21.15.132:6821/1610126075","heartbeat_back_addr":"172.21.15.132:6831/1610126075","heartbeat_front_addr":"172.21.15.132:6827/1610126075","state":["exists","up"]},{"osd":3,"uuid":"107b4d49-4d7a-46ec-bb10-d802101aa711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6820","nonce":121019578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6823","nonce":121019578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6829","nonce":121019578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":121019578},{"type":"v1","addr":"172.21.15.132:6826","nonce":121019578}]},"public_addr":"172.21.15.132:6820/121019578","cluster_addr":"172.21.15.132:6823/121019578","heartbeat_back_addr":"172.21.15.132:6829/121019578","heartbeat_front_addr":"172.21.15.132:6826/121019578","state":["exists","up"]},{"osd":4,"uuid":"d78c72c3-0687-4fa0-b0e3-2b624196b986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6801","nonce":3367196689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6803","nonce":3367196689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6807","nonce":3367196689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":3367196689},{"type":"v1","addr":"172.21.15.161:6805","nonce":3367196689}]},"public_addr":"172.21.15.161:6801/3367196689","cluster_addr":"172.21.15.161:6803/3367196689","heartbeat_back_addr":"172.21.15.161:6807/3367196689","heartbeat_front_addr":"172.21.15.161:6805/3367196689","state":["exists","up"]},{"osd":5,"uuid":"1957a46f-b8e0-4321-b498-a5bc21d501b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6817","nonce":1224738200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6819","nonce":1224738200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6823","nonce":1224738200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1224738200},{"type":"v1","addr":"172.21.15.161:6821","nonce":1224738200}]},"public_addr":"172.21.15.161:6817/1224738200","cluster_addr":"172.21.15.161:6819/1224738200","heartbeat_back_addr":"172.21.15.161:6823/1224738200","heartbeat_front_addr":"172.21.15.161:6821/1224738200","state":["exists","up"]},{"osd":6,"uuid":"959fb956-8654-4358-964a-457b1cec19ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6825","nonce":176202877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6827","nonce":176202877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6831","nonce":176202877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":176202877},{"type":"v1","addr":"172.21.15.161:6829","nonce":176202877}]},"public_addr":"172.21.15.161:6825/176202877","cluster_addr":"172.21.15.161:6827/176202877","heartbeat_back_addr":"172.21.15.161:6831/176202877","heartbeat_front_addr":"172.21.15.161:6829/176202877","state":["exists","up"]},{"osd":7,"uuid":"5b1772e2-ce9f-4d33-8db0-59141959db75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6809","nonce":2126116111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6811","nonce":2126116111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6815","nonce":2126116111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2126116111},{"type":"v1","addr":"172.21.15.161:6813","nonce":2126116111}]},"public_addr":"172.21.15.161:6809/2126116111","cluster_addr":"172.21.15.161:6811/2126116111","heartbeat_back_addr":"172.21.15.161:6815/2126116111","heartbeat_front_addr":"172.21.15.161:6813/2126116111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.526909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.384525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.321221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.619028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.313686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.395980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.705438+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:37:48.603096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6834/20249578":"2023-11-19T20:42:19.382316+0000","172.21.15.132:6832/20249578":"2023-11-19T20:42:19.382316+0000","172.21.15.132:6835/726664783":"2023-11-19T20:42:11.835954+0000","172.21.15.132:6833/726664783":"2023-11-19T20:42:11.835954+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:42:26.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f87c406ae40 msgr2=0x7f87c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:26.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f87c406ae40 0x7f87c406d300 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f87d4036000 tx=0x7f87d403d040 comp rx=0 tx=0).stop 2023-11-18T20:42:26.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 msgr2=0x7f87e414d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:26.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e414d720 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00c400 tx=0x7f87cc00c8c0 comp rx=0 tx=0).stop 2023-11-18T20:42:26.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 shutdown_connections 2023-11-18T20:42:26.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f87c406ae40 0x7f87c406d300 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:26.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87e4157fe0 0x7f87e4140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:26.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87e4151fd0 0x7f87e414d720 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:26.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 --2- 172.21.15.132:0/2365544856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87e40c3400 0x7f87e4142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:26.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 >> 172.21.15.132:0/2365544856 conn(0x7f87e40c6ee0 msgr2=0x7f87e4147820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:26.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.014+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 shutdown_connections 2023-11-18T20:42:26.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:26.015+0000 7f87ea941640 1 -- 172.21.15.132:0/2365544856 wait complete. 2023-11-18T20:42:26.556 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:42:26.563 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:42:27.034 INFO:tasks.ceph:Scrubbing osd.0 2023-11-18T20:42:27.037 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-18T20:42:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.264+0000 7fbcaf90f640 1 Processor -- start 2023-11-18T20:42:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.265+0000 7fbcaf90f640 1 -- start start 2023-11-18T20:42:27.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcaf90f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbca814fa80 0x7fbca806d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcaf90f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8072530 0x7fbca80c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcaf90f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbca8071f70 0x7fbca80c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcaf90f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca806d160 con 0x7fbca8071f70 2023-11-18T20:42:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcaf90f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca80c0980 con 0x7fbca814fa80 2023-11-18T20:42:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcaf90f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca806c070 con 0x7fbca8072530 2023-11-18T20:42:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcadeac640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbca8071f70 0x7fbca80c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcadeac640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbca8071f70 0x7fbca80c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49648/0 (socket says 172.21.15.132:49648) 2023-11-18T20:42:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.266+0000 7fbcadeac640 1 -- 172.21.15.132:0/3478222834 learned_addr learned my addr 172.21.15.132:0/3478222834 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:27.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.267+0000 7fbcaceaa640 1 --2- 172.21.15.132:0/3478222834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8072530 0x7fbca80c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.267+0000 7fbcad6ab640 1 --2- 172.21.15.132:0/3478222834 >> v2:172.21.15.161:3300/0 conn(0x7fbca814fa80 0x7fbca806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.267+0000 7fbcadeac640 1 -- 172.21.15.132:0/3478222834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8072530 msgr2=0x7fbca80c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:27.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.267+0000 7fbcadeac640 1 --2- 172.21.15.132:0/3478222834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8072530 0x7fbca80c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.267+0000 7fbcadeac640 1 -- 172.21.15.132:0/3478222834 >> v2:172.21.15.161:3300/0 conn(0x7fbca814fa80 msgr2=0x7fbca806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:27.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.267+0000 7fbcadeac640 1 --2- 172.21.15.132:0/3478222834 >> v2:172.21.15.161:3300/0 conn(0x7fbca814fa80 0x7fbca806d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.267+0000 7fbcadeac640 1 -- 172.21.15.132:0/3478222834 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca806dc70 con 0x7fbca8071f70 2023-11-18T20:42:27.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.267+0000 7fbcaceaa640 1 --2- 172.21.15.132:0/3478222834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8072530 0x7fbca80c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:27.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.268+0000 7fbcadeac640 1 --2- 172.21.15.132:0/3478222834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca8071f70 0x7fbca80c2610 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbca80c3310 tx=0x7fbca002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4944567526370f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.268+0000 7fbca7fff640 1 -- 172.21.15.132:0/3478222834 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0031870 con 0x7fbca8071f70 2023-11-18T20:42:27.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.268+0000 7fbca7fff640 1 -- 172.21.15.132:0/3478222834 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00319d0 con 0x7fbca8071f70 2023-11-18T20:42:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.268+0000 7fbca7fff640 1 -- 172.21.15.132:0/3478222834 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0031d60 con 0x7fbca8071f70 2023-11-18T20:42:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 -- 172.21.15.132:0/3478222834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca8071f70 msgr2=0x7fbca80c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 --2- 172.21.15.132:0/3478222834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca8071f70 0x7fbca80c2610 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbca80c3310 tx=0x7fbca002b910 comp rx=0 tx=0).stop 2023-11-18T20:42:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 -- 172.21.15.132:0/3478222834 shutdown_connections 2023-11-18T20:42:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 --2- 172.21.15.132:0/3478222834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca8071f70 0x7fbca80c2610 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 --2- 172.21.15.132:0/3478222834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8072530 0x7fbca80c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 --2- 172.21.15.132:0/3478222834 >> v2:172.21.15.161:3300/0 conn(0x7fbca814fa80 0x7fbca806d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 -- 172.21.15.132:0/3478222834 >> 172.21.15.132:0/3478222834 conn(0x7fbca80c5bc0 msgr2=0x7fbca80c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:27.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 -- 172.21.15.132:0/3478222834 shutdown_connections 2023-11-18T20:42:27.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.269+0000 7fbcaf90f640 1 -- 172.21.15.132:0/3478222834 wait complete. 2023-11-18T20:42:27.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.271+0000 7fbcaf90f640 1 Processor -- start 2023-11-18T20:42:27.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.271+0000 7fbcaf90f640 1 -- start start 2023-11-18T20:42:27.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcaf90f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8071f70 0x7fbca80c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcaf90f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca8072530 0x7fbca8144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcaf90f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca814fa80 0x7fbca81452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcaf90f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca81457e0 con 0x7fbca814fa80 2023-11-18T20:42:27.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcaf90f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca8153ad0 con 0x7fbca8072530 2023-11-18T20:42:27.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcaf90f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca81eacf0 con 0x7fbca8071f70 2023-11-18T20:42:27.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcadeac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca814fa80 0x7fbca81452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcadeac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca814fa80 0x7fbca81452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49654/0 (socket says 172.21.15.132:49654) 2023-11-18T20:42:27.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcadeac640 1 -- 172.21.15.132:0/1753660363 learned_addr learned my addr 172.21.15.132:0/1753660363 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:27.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcad6ab640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8071f70 0x7fbca80c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcaceaa640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca8072530 0x7fbca8144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcadeac640 1 -- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8071f70 msgr2=0x7fbca80c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcadeac640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbca8071f70 0x7fbca80c2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcadeac640 1 -- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca8072530 msgr2=0x7fbca8144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcadeac640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca8072530 0x7fbca8144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcadeac640 1 -- 172.21.15.132:0/1753660363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca00094d0 con 0x7fbca814fa80 2023-11-18T20:42:27.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.273+0000 7fbcaceaa640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca8072530 0x7fbca8144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:27.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.274+0000 7fbcadeac640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca814fa80 0x7fbca81452a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009960 tx=0x7fbca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.274+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0031800 con 0x7fbca814fa80 2023-11-18T20:42:27.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.274+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00443f0 con 0x7fbca814fa80 2023-11-18T20:42:27.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.274+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00447a0 con 0x7fbca814fa80 2023-11-18T20:42:27.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.274+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca81514e0 con 0x7fbca814fa80 2023-11-18T20:42:27.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.274+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca81e84a0 con 0x7fbca814fa80 2023-11-18T20:42:27.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.275+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbca806bd00 con 0x7fbca814fa80 2023-11-18T20:42:27.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.276+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbca0044900 con 0x7fbca814fa80 2023-11-18T20:42:27.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.277+0000 7fbca5ffb640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbc9406ae40 0x7fbc9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.277+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbca002d040 con 0x7fbca814fa80 2023-11-18T20:42:27.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.277+0000 7fbca5ffb640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7fbc94070d40 0x7fbc94073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.277+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 --> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc94073810 con 0x7fbc94070d40 2023-11-18T20:42:27.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.277+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbca00b02a0 con 0x7fbca814fa80 2023-11-18T20:42:27.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.278+0000 7fbcaceaa640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7fbc94070d40 0x7fbc94073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.278+0000 7fbcad6ab640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbc9406ae40 0x7fbc9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.278+0000 7fbcaceaa640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7fbc94070d40 0x7fbc94073160 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.279+0000 7fbcad6ab640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbc9406ae40 0x7fbc9406d300 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbc98007130 tx=0x7fbc98007060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.279+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 <== osd.0 v2:172.21.15.132:6800/3421044779 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbc94073810 con 0x7fbc94070d40 2023-11-18T20:42:27.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.293+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 --> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbca80c23b0 con 0x7fbc94070d40 2023-11-18T20:42:27.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.294+0000 7fbca5ffb640 1 -- 172.21.15.132:0/1753660363 <== osd.0 v2:172.21.15.132:6800/3421044779 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbc9c00c040 con 0x7fbc94070d40 2023-11-18T20:42:27.296 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:42:27.296 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T20:42:27.297 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:42:27.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.294+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7fbc94070d40 msgr2=0x7fbc94073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.294+0000 7fbcaf90f640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.132:6800/3421044779,v1:172.21.15.132:6801/3421044779] conn(0x7fbc94070d40 0x7fbc94073160 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.294+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbc9406ae40 msgr2=0x7fbc9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.294+0000 7fbcaf90f640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fbc9406ae40 0x7fbc9406d300 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbc98007130 tx=0x7fbc98007060 comp rx=0 tx=0).stop 2023-11-18T20:42:27.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.294+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca814fa80 msgr2=0x7fbca81452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.294+0000 7fbcaf90f640 1 --2- 172.21.15.132:0/1753660363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca814fa80 0x7fbca81452a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009960 tx=0x7fbca00046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.294+0000 7fbcadeac640 1 -- 172.21.15.132:0/1753660363 reap_dead start 2023-11-18T20:42:27.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.295+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 shutdown_connections 2023-11-18T20:42:27.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.295+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 >> 172.21.15.132:0/1753660363 conn(0x7fbca80c5bc0 msgr2=0x7fbca80c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:27.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.295+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 shutdown_connections 2023-11-18T20:42:27.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.295+0000 7fbcaf90f640 1 -- 172.21.15.132:0/1753660363 wait complete. 2023-11-18T20:42:27.314 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-18T20:42:27.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.521+0000 7f34c3861640 1 Processor -- start 2023-11-18T20:42:27.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.521+0000 7f34c3861640 1 -- start start 2023-11-18T20:42:27.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.523+0000 7f34c3861640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34bc151fd0 0x7f34bc06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.523+0000 7f34c3861640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f34bc0c3400 0x7f34bc06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.523+0000 7f34c3861640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc071fd0 con 0x7f34bc06aa40 2023-11-18T20:42:27.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.523+0000 7f34c3861640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc06ee50 con 0x7f34bc151fd0 2023-11-18T20:42:27.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.523+0000 7f34c3861640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc072220 con 0x7f34bc0c3400 2023-11-18T20:42:27.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.523+0000 7f34c15fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34bc151fd0 0x7f34bc06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.523+0000 7f34c1dfe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f34bc06aa40 0x7f34bc157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50888/0 (socket says 172.21.15.132:50888) 2023-11-18T20:42:27.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.523+0000 7f34c1dfe640 1 -- 172.21.15.132:0/3865703714 learned_addr learned my addr 172.21.15.132:0/3865703714 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:27.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.524+0000 7f34c15fd640 1 -- 172.21.15.132:0/3865703714 >> v2:172.21.15.161:3300/0 conn(0x7f34bc0c3400 msgr2=0x7f34bc06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:27.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.524+0000 7f34c0dfc640 1 --2- 172.21.15.132:0/3865703714 >> v2:172.21.15.161:3300/0 conn(0x7f34bc0c3400 0x7f34bc06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.524+0000 7f34c15fd640 1 --2- 172.21.15.132:0/3865703714 >> v2:172.21.15.161:3300/0 conn(0x7f34bc0c3400 0x7f34bc06a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.524+0000 7f34c15fd640 1 -- 172.21.15.132:0/3865703714 >> v1:172.21.15.132:6789/0 conn(0x7f34bc06aa40 legacy=0x7f34bc157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.524+0000 7f34c15fd640 1 -- 172.21.15.132:0/3865703714 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc06e0d0 con 0x7f34bc151fd0 2023-11-18T20:42:27.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.524+0000 7f34bbfff640 1 -- 172.21.15.132:0/3865703714 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994468826 0 0) 0x7f34bc071fd0 con 0x7f34bc06aa40 2023-11-18T20:42:27.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.525+0000 7f34c15fd640 1 --2- 172.21.15.132:0/3865703714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc151fd0 0x7f34bc06e910 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f34bc06ddb0 tx=0x7f34ac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6274861e96520d8d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.525+0000 7f34bbfff640 1 -- 172.21.15.132:0/3865703714 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac02e070 con 0x7f34bc151fd0 2023-11-18T20:42:27.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.525+0000 7f34bbfff640 1 -- 172.21.15.132:0/3865703714 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac0315a0 con 0x7f34bc151fd0 2023-11-18T20:42:27.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.525+0000 7f34bbfff640 1 -- 172.21.15.132:0/3865703714 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac031930 con 0x7f34bc151fd0 2023-11-18T20:42:27.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.526+0000 7f34c3861640 1 -- 172.21.15.132:0/3865703714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc151fd0 msgr2=0x7f34bc06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.526+0000 7f34c3861640 1 --2- 172.21.15.132:0/3865703714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc151fd0 0x7f34bc06e910 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f34bc06ddb0 tx=0x7f34ac02b840 comp rx=0 tx=0).stop 2023-11-18T20:42:27.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.526+0000 7f34c3861640 1 -- 172.21.15.132:0/3865703714 shutdown_connections 2023-11-18T20:42:27.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.526+0000 7f34c3861640 1 --2- 172.21.15.132:0/3865703714 >> v2:172.21.15.161:3300/0 conn(0x7f34bc0c3400 0x7f34bc06a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.526+0000 7f34c3861640 1 --2- 172.21.15.132:0/3865703714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc151fd0 0x7f34bc06e910 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.526+0000 7f34c3861640 1 -- 172.21.15.132:0/3865703714 >> 172.21.15.132:0/3865703714 conn(0x7f34bc0c6ee0 msgr2=0x7f34bc0c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:27.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.526+0000 7f34c3861640 1 -- 172.21.15.132:0/3865703714 shutdown_connections 2023-11-18T20:42:27.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.526+0000 7f34c3861640 1 -- 172.21.15.132:0/3865703714 wait complete. 2023-11-18T20:42:27.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.528+0000 7f34c3861640 1 Processor -- start 2023-11-18T20:42:27.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.528+0000 7f34c3861640 1 -- start start 2023-11-18T20:42:27.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c3861640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc06aa40 0x7f34bc149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c3861640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34bc0c3400 0x7f34bc14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c3861640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34bc151fd0 0x7f34bc0aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c3861640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0a9610 con 0x7f34bc06aa40 2023-11-18T20:42:27.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c3861640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc148fd0 con 0x7f34bc0c3400 2023-11-18T20:42:27.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c3861640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc1492b0 con 0x7f34bc151fd0 2023-11-18T20:42:27.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c15fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc06aa40 0x7f34bc149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c15fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc06aa40 0x7f34bc149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49680/0 (socket says 172.21.15.132:49680) 2023-11-18T20:42:27.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c15fd640 1 -- 172.21.15.132:0/3224022999 learned_addr learned my addr 172.21.15.132:0/3224022999 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:27.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c0dfc640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34bc0c3400 0x7f34bc14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c15fd640 1 -- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34bc151fd0 msgr2=0x7f34bc0aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c1dfe640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34bc151fd0 0x7f34bc0aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c15fd640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34bc151fd0 0x7f34bc0aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c15fd640 1 -- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34bc0c3400 msgr2=0x7f34bc14d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c15fd640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34bc0c3400 0x7f34bc14d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c15fd640 1 -- 172.21.15.132:0/3224022999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac009400 con 0x7f34bc06aa40 2023-11-18T20:42:27.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c0dfc640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34bc0c3400 0x7f34bc14d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:27.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.529+0000 7f34c1dfe640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34bc151fd0 0x7f34bc0aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:27.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.530+0000 7f34c15fd640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc06aa40 0x7f34bc149ed0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009890 tx=0x7f34ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.530+0000 7f34b9ffb640 1 -- 172.21.15.132:0/3224022999 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac032900 con 0x7f34bc06aa40 2023-11-18T20:42:27.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.530+0000 7f34b9ffb640 1 -- 172.21.15.132:0/3224022999 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac032a60 con 0x7f34bc06aa40 2023-11-18T20:42:27.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.530+0000 7f34b9ffb640 1 -- 172.21.15.132:0/3224022999 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac032e10 con 0x7f34bc06aa40 2023-11-18T20:42:27.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.530+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc149590 con 0x7f34bc06aa40 2023-11-18T20:42:27.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.530+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc14cc30 con 0x7f34bc06aa40 2023-11-18T20:42:27.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.532+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc068350 con 0x7f34bc06aa40 2023-11-18T20:42:27.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.532+0000 7f34b9ffb640 1 -- 172.21.15.132:0/3224022999 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34ac0453f0 con 0x7f34bc06aa40 2023-11-18T20:42:27.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.533+0000 7f34b9ffb640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f34a806ae40 0x7f34a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.533+0000 7f34b9ffb640 1 -- 172.21.15.132:0/3224022999 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f34ac0ab550 con 0x7f34bc06aa40 2023-11-18T20:42:27.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.534+0000 7f34c0dfc640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f34a806ae40 0x7f34a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.535+0000 7f34c0dfc640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f34a806ae40 0x7f34a806d300 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f34bc1519e0 tx=0x7f34b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.537+0000 7f34b9ffb640 1 -- 172.21.15.132:0/3224022999 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34ac076a50 con 0x7f34bc06aa40 2023-11-18T20:42:27.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.727+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f34bc1517f0 con 0x7f34a806ae40 2023-11-18T20:42:27.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.728+0000 7f34b9ffb640 1 -- 172.21.15.132:0/3224022999 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f34bc1517f0 con 0x7f34a806ae40 2023-11-18T20:42:27.730 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 0 to deep-scrub 2023-11-18T20:42:27.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f34a806ae40 msgr2=0x7f34a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f34a806ae40 0x7f34a806d300 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f34bc1519e0 tx=0x7f34b0008040 comp rx=0 tx=0).stop 2023-11-18T20:42:27.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc06aa40 msgr2=0x7f34bc149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc06aa40 0x7f34bc149ed0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009890 tx=0x7f34ac0046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 shutdown_connections 2023-11-18T20:42:27.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f34a806ae40 0x7f34a806d300 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34bc151fd0 0x7f34bc0aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34bc0c3400 0x7f34bc14d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 --2- 172.21.15.132:0/3224022999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34bc06aa40 0x7f34bc149ed0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 >> 172.21.15.132:0/3224022999 conn(0x7f34bc0c6ee0 msgr2=0x7f34bc14ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:27.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 shutdown_connections 2023-11-18T20:42:27.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.731+0000 7f34c3861640 1 -- 172.21.15.132:0/3224022999 wait complete. 2023-11-18T20:42:27.751 INFO:tasks.ceph:Scrubbing osd.1 2023-11-18T20:42:27.751 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-18T20:42:27.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.971+0000 7f0563983640 1 Processor -- start 2023-11-18T20:42:27.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.971+0000 7f0563983640 1 -- start start 2023-11-18T20:42:27.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0563983640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f055c151e20 0x7f055c0abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0563983640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c0c80b0 0x7f055c0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0563983640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f055c157e80 0x7f055c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0563983640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0c57b0 con 0x7f055c157e80 2023-11-18T20:42:27.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0563983640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c06c7c0 con 0x7f055c151e20 2023-11-18T20:42:27.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0563983640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0ac860 con 0x7f055c0c80b0 2023-11-18T20:42:27.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0561f20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f055c157e80 0x7f055c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0561f20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f055c157e80 0x7f055c1582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49696/0 (socket says 172.21.15.132:49696) 2023-11-18T20:42:27.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0561f20640 1 -- 172.21.15.132:0/2207178654 learned_addr learned my addr 172.21.15.132:0/2207178654 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:27.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0560f1e640 1 --2- 172.21.15.132:0/2207178654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c0c80b0 0x7f055c0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0561f20640 1 -- 172.21.15.132:0/2207178654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c0c80b0 msgr2=0x7f055c0c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:27.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0561f20640 1 --2- 172.21.15.132:0/2207178654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c0c80b0 0x7f055c0c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f0561f20640 1 -- 172.21.15.132:0/2207178654 >> v2:172.21.15.161:3300/0 conn(0x7f055c151e20 msgr2=0x7f055c0abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:27.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.973+0000 7f056171f640 1 --2- 172.21.15.132:0/2207178654 >> v2:172.21.15.161:3300/0 conn(0x7f055c151e20 0x7f055c0abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.974+0000 7f0561f20640 1 --2- 172.21.15.132:0/2207178654 >> v2:172.21.15.161:3300/0 conn(0x7f055c151e20 0x7f055c0abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.974+0000 7f0561f20640 1 -- 172.21.15.132:0/2207178654 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0c9ae0 con 0x7f055c157e80 2023-11-18T20:42:27.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.974+0000 7f0560f1e640 1 --2- 172.21.15.132:0/2207178654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c0c80b0 0x7f055c0c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:27.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.974+0000 7f056171f640 1 --2- 172.21.15.132:0/2207178654 >> v2:172.21.15.161:3300/0 conn(0x7f055c151e20 0x7f055c0abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:27.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.975+0000 7f0561f20640 1 --2- 172.21.15.132:0/2207178654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c157e80 0x7f055c1582b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f055c0abec0 tx=0x7f055402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7deb0d23addf035 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.975+0000 7f0553fff640 1 -- 172.21.15.132:0/2207178654 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055402c960 con 0x7f055c157e80 2023-11-18T20:42:27.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.975+0000 7f0553fff640 1 -- 172.21.15.132:0/2207178654 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055402cac0 con 0x7f055c157e80 2023-11-18T20:42:27.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.975+0000 7f0553fff640 1 -- 172.21.15.132:0/2207178654 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055402ce50 con 0x7f055c157e80 2023-11-18T20:42:27.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 -- 172.21.15.132:0/2207178654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c157e80 msgr2=0x7f055c1582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 --2- 172.21.15.132:0/2207178654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c157e80 0x7f055c1582b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f055c0abec0 tx=0x7f055402bdc0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 -- 172.21.15.132:0/2207178654 shutdown_connections 2023-11-18T20:42:27.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 --2- 172.21.15.132:0/2207178654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c157e80 0x7f055c1582b0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 --2- 172.21.15.132:0/2207178654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c0c80b0 0x7f055c0c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 --2- 172.21.15.132:0/2207178654 >> v2:172.21.15.161:3300/0 conn(0x7f055c151e20 0x7f055c0abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 -- 172.21.15.132:0/2207178654 >> 172.21.15.132:0/2207178654 conn(0x7f055c071e10 msgr2=0x7f055c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:27.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 -- 172.21.15.132:0/2207178654 shutdown_connections 2023-11-18T20:42:27.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.976+0000 7f0563983640 1 -- 172.21.15.132:0/2207178654 wait complete. 2023-11-18T20:42:27.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.977+0000 7f0563983640 1 Processor -- start 2023-11-18T20:42:27.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.978+0000 7f0563983640 1 -- start start 2023-11-18T20:42:27.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.978+0000 7f0563983640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c0c80b0 0x7f055c1eded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.978+0000 7f0563983640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f055c151e20 0x7f055c0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.978+0000 7f0563983640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c157e80 0x7f055c1eb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.978+0000 7f0563983640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1ea7b0 con 0x7f055c0c80b0 2023-11-18T20:42:27.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.978+0000 7f0563983640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1eace0 con 0x7f055c151e20 2023-11-18T20:42:27.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.978+0000 7f0563983640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1eaa00 con 0x7f055c157e80 2023-11-18T20:42:27.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c0c80b0 0x7f055c1eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c0c80b0 0x7f055c1eded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49712/0 (socket says 172.21.15.132:49712) 2023-11-18T20:42:27.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 -- 172.21.15.132:0/492269701 learned_addr learned my addr 172.21.15.132:0/492269701 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:27.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f0561f20640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c157e80 0x7f055c1eb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 -- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c157e80 msgr2=0x7f055c1eb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f055c157e80 0x7f055c1eb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f0560f1e640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f055c151e20 0x7f055c0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 -- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f055c151e20 msgr2=0x7f055c0aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:27.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f055c151e20 0x7f055c0aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:27.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 -- 172.21.15.132:0/492269701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554009b30 con 0x7f055c0c80b0 2023-11-18T20:42:27.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.979+0000 7f056171f640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c0c80b0 0x7f055c1eded0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f055800c7f0 tx=0x7f055800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.980+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558007a30 con 0x7f055c0c80b0 2023-11-18T20:42:27.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.980+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0558007b90 con 0x7f055c0c80b0 2023-11-18T20:42:27.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.980+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800ce40 con 0x7f055c0c80b0 2023-11-18T20:42:27.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.980+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c1ed3f0 con 0x7f055c0c80b0 2023-11-18T20:42:27.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.980+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c0ab7e0 con 0x7f055c0c80b0 2023-11-18T20:42:27.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.981+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f055c0c92e0 con 0x7f055c0c80b0 2023-11-18T20:42:27.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.982+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05580113f0 con 0x7f055c0c80b0 2023-11-18T20:42:27.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.983+0000 7f0551ffb640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f054006ae70 0x7f054006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.983+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0558089430 con 0x7f055c0c80b0 2023-11-18T20:42:27.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.983+0000 7f0551ffb640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f0540070d70 0x7f0540073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:27.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.983+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 --> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0540073840 con 0x7f0540070d70 2023-11-18T20:42:27.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.983+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f055808ba90 con 0x7f055c0c80b0 2023-11-18T20:42:27.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.983+0000 7f0561f20640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f0540070d70 0x7f0540073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.983+0000 7f0560f1e640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f054006ae70 0x7f054006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:27.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.984+0000 7f0561f20640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f0540070d70 0x7f0540073190 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.984+0000 7f0560f1e640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f054006ae70 0x7f054006d330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f054c006fd0 tx=0x7f054c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.985+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 <== osd.1 v2:172.21.15.132:6808/3030620385 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0540073840 con 0x7f0540070d70 2023-11-18T20:42:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.999+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 --> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f055c0c9000 con 0x7f0540070d70 2023-11-18T20:42:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:27.999+0000 7f0551ffb640 1 -- 172.21.15.132:0/492269701 <== osd.1 v2:172.21.15.132:6808/3030620385 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f055402c950 con 0x7f0540070d70 2023-11-18T20:42:28.002 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:42:28.002 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T20:42:28.002 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:42:28.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f0540070d70 msgr2=0x7f0540073190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.132:6808/3030620385,v1:172.21.15.132:6809/3030620385] conn(0x7f0540070d70 0x7f0540073190 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f054006ae70 msgr2=0x7f054006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f054006ae70 0x7f054006d330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f054c006fd0 tx=0x7f054c008040 comp rx=0 tx=0).stop 2023-11-18T20:42:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c0c80b0 msgr2=0x7f055c1eded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 --2- 172.21.15.132:0/492269701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f055c0c80b0 0x7f055c1eded0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f055800c7f0 tx=0x7f055800cbf0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0561f20640 1 -- 172.21.15.132:0/492269701 reap_dead start 2023-11-18T20:42:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 shutdown_connections 2023-11-18T20:42:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 >> 172.21.15.132:0/492269701 conn(0x7f055c071e10 msgr2=0x7f055c0721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 shutdown_connections 2023-11-18T20:42:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.000+0000 7f0563983640 1 -- 172.21.15.132:0/492269701 wait complete. 2023-11-18T20:42:28.019 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-18T20:42:28.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.231+0000 7ff2eb41a640 1 Processor -- start 2023-11-18T20:42:28.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.231+0000 7ff2eb41a640 1 -- start start 2023-11-18T20:42:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2eb41a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2e40c1fc0 0x7ff2e406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2eb41a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406c4b0 0x7ff2e41513c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2eb41a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e4072520 con 0x7ff2e406cc10 2023-11-18T20:42:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2eb41a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e406dd00 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2eb41a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4072a50 con 0x7ff2e406c4b0 2023-11-18T20:42:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2e9c17640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2e40c1fc0 0x7ff2e406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2e9c17640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2e40c1fc0 0x7ff2e406cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49716/0 (socket says 172.21.15.132:49716) 2023-11-18T20:42:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2e9c17640 1 -- 172.21.15.132:0/566365191 learned_addr learned my addr 172.21.15.132:0/566365191 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2e9c17640 1 -- 172.21.15.132:0/566365191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406c4b0 msgr2=0x7ff2e41513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2eac19640 1 --2- 172.21.15.132:0/566365191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406c4b0 0x7ff2e41513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2e9c17640 1 --2- 172.21.15.132:0/566365191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406c4b0 0x7ff2e41513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2e9c17640 1 -- 172.21.15.132:0/566365191 >> v1:172.21.15.161:6789/0 conn(0x7ff2e406cc10 legacy=0x7ff2e4150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2e9c17640 1 -- 172.21.15.132:0/566365191 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4072770 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.233+0000 7ff2eac19640 1 --2- 172.21.15.132:0/566365191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406c4b0 0x7ff2e41513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:28.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.235+0000 7ff2e9c17640 1 --2- 172.21.15.132:0/566365191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e406cff0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009870 tx=0x7ff2d802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507f1d0550998d42 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.235+0000 7ff2e9416640 1 -- 172.21.15.132:0/566365191 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8031740 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.235+0000 7ff2e9416640 1 -- 172.21.15.132:0/566365191 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d80318a0 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.235+0000 7ff2e9416640 1 -- 172.21.15.132:0/566365191 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8031c30 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.235+0000 7ff2eb41a640 1 -- 172.21.15.132:0/566365191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 msgr2=0x7ff2e406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.235+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/566365191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e406cff0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009870 tx=0x7ff2d802b7e0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.236+0000 7ff2eb41a640 1 -- 172.21.15.132:0/566365191 shutdown_connections 2023-11-18T20:42:28.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.236+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/566365191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406c4b0 0x7ff2e41513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.236+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/566365191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e406cff0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.236+0000 7ff2eb41a640 1 -- 172.21.15.132:0/566365191 >> 172.21.15.132:0/566365191 conn(0x7ff2e40a7900 msgr2=0x7ff2e40a7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:28.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.236+0000 7ff2eb41a640 1 -- 172.21.15.132:0/566365191 shutdown_connections 2023-11-18T20:42:28.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.236+0000 7ff2eb41a640 1 -- 172.21.15.132:0/566365191 wait complete. 2023-11-18T20:42:28.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.237+0000 7ff2eb41a640 1 Processor -- start 2023-11-18T20:42:28.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.238+0000 7ff2eb41a640 1 -- start start 2023-11-18T20:42:28.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.238+0000 7ff2eb41a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2e406c4b0 0x7ff2e415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.238+0000 7ff2eb41a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406cc10 0x7ff2e41e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.238+0000 7ff2eb41a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e41ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.238+0000 7ff2eb41a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e415efb0 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.238+0000 7ff2eb41a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41ea190 con 0x7ff2e406c4b0 2023-11-18T20:42:28.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.238+0000 7ff2eb41a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41482a0 con 0x7ff2e406cc10 2023-11-18T20:42:28.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2eac19640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e41ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2eac19640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e41ed9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49720/0 (socket says 172.21.15.132:49720) 2023-11-18T20:42:28.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2eac19640 1 -- 172.21.15.132:0/1772014678 learned_addr learned my addr 172.21.15.132:0/1772014678 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:28.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2e9c17640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406cc10 0x7ff2e41e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2ea418640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2e406c4b0 0x7ff2e415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2eac19640 1 -- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406cc10 msgr2=0x7ff2e41e9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2eac19640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406cc10 0x7ff2e41e9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2eac19640 1 -- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2e406c4b0 msgr2=0x7ff2e415ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2eac19640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2e406c4b0 0x7ff2e415ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.239+0000 7ff2eac19640 1 -- 172.21.15.132:0/1772014678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80094d0 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.240+0000 7ff2eac19640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e41ed9c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00cd50 tx=0x7ff2dc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.240+0000 7ff2d6ffd640 1 -- 172.21.15.132:0/1772014678 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00f680 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.240+0000 7ff2d6ffd640 1 -- 172.21.15.132:0/1772014678 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00f800 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.240+0000 7ff2d6ffd640 1 -- 172.21.15.132:0/1772014678 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00fbb0 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.240+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e4148560 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.240+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e41ed1c0 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.241+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e404e840 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.242+0000 7ff2d6ffd640 1 -- 172.21.15.132:0/1772014678 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2dc00b040 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.243+0000 7ff2d6ffd640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.243+0000 7ff2d6ffd640 1 -- 172.21.15.132:0/1772014678 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff2dc089e10 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.244+0000 7ff2ea418640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.245+0000 7ff2ea418640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000a750 tx=0x7ff2e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.247+0000 7ff2d6ffd640 1 -- 172.21.15.132:0/1772014678 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2dc08d030 con 0x7ff2e40c1fc0 2023-11-18T20:42:28.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.439+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2e4151900 con 0x7ff2c806ae40 2023-11-18T20:42:28.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.441+0000 7ff2d6ffd640 1 -- 172.21.15.132:0/1772014678 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff2e0004020 con 0x7ff2c806ae40 2023-11-18T20:42:28.443 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 1 to deep-scrub 2023-11-18T20:42:28.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 msgr2=0x7ff2c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000a750 tx=0x7ff2e0008040 comp rx=0 tx=0).stop 2023-11-18T20:42:28.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 msgr2=0x7ff2e41ed9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e41ed9c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00cd50 tx=0x7ff2dc00a650 comp rx=0 tx=0).stop 2023-11-18T20:42:28.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 shutdown_connections 2023-11-18T20:42:28.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff2c806ae40 0x7ff2c806d300 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40c1fc0 0x7ff2e41ed9c0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2e406cc10 0x7ff2e41e9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 --2- 172.21.15.132:0/1772014678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2e406c4b0 0x7ff2e415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.443+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 >> 172.21.15.132:0/1772014678 conn(0x7ff2e40a7900 msgr2=0x7ff2e40a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.444+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 shutdown_connections 2023-11-18T20:42:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.444+0000 7ff2eb41a640 1 -- 172.21.15.132:0/1772014678 wait complete. 2023-11-18T20:42:28.463 INFO:tasks.ceph:Scrubbing osd.2 2023-11-18T20:42:28.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-18T20:42:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.677+0000 7fab6218e640 1 Processor -- start 2023-11-18T20:42:28.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.677+0000 7fab6218e640 1 -- start start 2023-11-18T20:42:28.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.679+0000 7fab6218e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab5c0c53c0 0x7fab5c153640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.679+0000 7fab6218e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c06dda0 con 0x7fab5c06d570 2023-11-18T20:42:28.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.679+0000 7fab6218e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c06e1b0 con 0x7fab5c06d950 2023-11-18T20:42:28.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.679+0000 7fab6218e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c06c9e0 con 0x7fab5c0c53c0 2023-11-18T20:42:28.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.679+0000 7fab6118c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fab5c06d570 0x7fab5c0c4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36300/0 (socket says 172.21.15.132:36300) 2023-11-18T20:42:28.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.679+0000 7fab6118c640 1 -- 172.21.15.132:0/100826595 learned_addr learned my addr 172.21.15.132:0/100826595 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:28.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.679+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972607068 0 0) 0x7fab5c06dda0 con 0x7fab5c06d570 2023-11-18T20:42:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.679+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab48003520 con 0x7fab5c06d570 2023-11-18T20:42:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab6098b640 1 --2- 172.21.15.132:0/100826595 >> v2:172.21.15.161:3300/0 conn(0x7fab5c0c53c0 0x7fab5c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 497393678 0 0) 0x7fab48003520 con 0x7fab5c06d570 2023-11-18T20:42:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 >> v2:172.21.15.161:3300/0 conn(0x7fab5c0c53c0 msgr2=0x7fab5c153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 --2- 172.21.15.132:0/100826595 >> v2:172.21.15.161:3300/0 conn(0x7fab5c0c53c0 0x7fab5c153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 >> v1:172.21.15.161:6789/0 conn(0x7fab5c06d950 legacy=0x7fab5c1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c0c4850 con 0x7fab5c06d570 2023-11-18T20:42:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fab58001670 con 0x7fab5c06d570 2023-11-18T20:42:28.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 >> v1:172.21.15.132:6789/0 conn(0x7fab5c06d570 legacy=0x7fab5c0c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab480039c0 0x7fab48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab480047c0 0x7fab48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab480051d0 0x7fab4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c06c9e0 con 0x7fab480047c0 2023-11-18T20:42:28.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4800c120 con 0x7fab480039c0 2023-11-18T20:42:28.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4800c2e0 con 0x7fab480051d0 2023-11-18T20:42:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.680+0000 7fab6098b640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab480047c0 0x7fab48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.681+0000 7fab6118c640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab480039c0 0x7fab48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.681+0000 7fab6098b640 1 -- 172.21.15.132:0/100826595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab480051d0 msgr2=0x7fab4800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.681+0000 7fab6098b640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab480051d0 0x7fab4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.681+0000 7fab6098b640 1 -- 172.21.15.132:0/100826595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab480039c0 msgr2=0x7fab48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.681+0000 7fab6098b640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab480039c0 0x7fab48003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.681+0000 7fab6098b640 1 -- 172.21.15.132:0/100826595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48003520 con 0x7fab480047c0 2023-11-18T20:42:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.681+0000 7fab6198d640 1 -- 172.21.15.132:0/100826595 reap_dead start 2023-11-18T20:42:28.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.682+0000 7fab6098b640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab480047c0 0x7fab48004c40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00ba30 tx=0x7fab480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1042e8ccf0a5e86 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.682+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c032680 con 0x7fab480047c0 2023-11-18T20:42:28.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.682+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c0327e0 con 0x7fab480047c0 2023-11-18T20:42:28.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.682+0000 7fab53fff640 1 -- 172.21.15.132:0/100826595 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c032b70 con 0x7fab480047c0 2023-11-18T20:42:28.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.683+0000 7fab6218e640 1 -- 172.21.15.132:0/100826595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab480047c0 msgr2=0x7fab48004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.683+0000 7fab6218e640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab480047c0 0x7fab48004c40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00ba30 tx=0x7fab480057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.683+0000 7fab6218e640 1 -- 172.21.15.132:0/100826595 shutdown_connections 2023-11-18T20:42:28.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.683+0000 7fab6218e640 1 --2- 172.21.15.132:0/100826595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab480047c0 0x7fab48004c40 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.683+0000 7fab6218e640 1 -- 172.21.15.132:0/100826595 >> 172.21.15.132:0/100826595 conn(0x7fab5c0c5a40 msgr2=0x7fab5c0c5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.683+0000 7fab6218e640 1 -- 172.21.15.132:0/100826595 shutdown_connections 2023-11-18T20:42:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.683+0000 7fab6218e640 1 -- 172.21.15.132:0/100826595 wait complete. 2023-11-18T20:42:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.684+0000 7fab6218e640 1 Processor -- start 2023-11-18T20:42:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.685+0000 7fab6218e640 1 -- start start 2023-11-18T20:42:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.685+0000 7fab6218e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab480047c0 0x7fab5c071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.685+0000 7fab6218e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c1deb20 0x7fab5c1df1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6218e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab5c072450 0x7fab5c14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6218e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c070690 con 0x7fab5c1deb20 2023-11-18T20:42:28.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6218e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c070970 con 0x7fab5c072450 2023-11-18T20:42:28.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6218e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c070c50 con 0x7fab480047c0 2023-11-18T20:42:28.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6098b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c1deb20 0x7fab5c1df1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6098b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c1deb20 0x7fab5c1df1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42792/0 (socket says 172.21.15.132:42792) 2023-11-18T20:42:28.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6098b640 1 -- 172.21.15.132:0/2244545206 learned_addr learned my addr 172.21.15.132:0/2244545206 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:28.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6118c640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab480047c0 0x7fab5c071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6098b640 1 -- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab480047c0 msgr2=0x7fab5c071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6098b640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab480047c0 0x7fab5c071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6098b640 1 -- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab5c072450 msgr2=0x7fab5c14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6198d640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab5c072450 0x7fab5c14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6098b640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab5c072450 0x7fab5c14e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6098b640 1 -- 172.21.15.132:0/2244545206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c070f30 con 0x7fab5c1deb20 2023-11-18T20:42:28.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.686+0000 7fab6198d640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab5c072450 0x7fab5c14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:28.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.687+0000 7fab6098b640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c1deb20 0x7fab5c1df1b0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fab4c02bf00 tx=0x7fab4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.687+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c004220 con 0x7fab5c1deb20 2023-11-18T20:42:28.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.687+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c0043a0 con 0x7fab5c1deb20 2023-11-18T20:42:28.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.687+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c030aa0 con 0x7fab5c1deb20 2023-11-18T20:42:28.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.687+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c072930 con 0x7fab5c1deb20 2023-11-18T20:42:28.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.687+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c1df8d0 con 0x7fab5c1deb20 2023-11-18T20:42:28.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.688+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab5c0665f0 con 0x7fab5c1deb20 2023-11-18T20:42:28.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.689+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab4c030c00 con 0x7fab5c1deb20 2023-11-18T20:42:28.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.690+0000 7fab51ffb640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fab4006ae40 0x7fab4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.690+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fab4c0abf40 con 0x7fab5c1deb20 2023-11-18T20:42:28.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.690+0000 7fab51ffb640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fab40070d40 0x7fab40073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.690+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 --> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab40073810 con 0x7fab40070d40 2023-11-18T20:42:28.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.690+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab4c0ae520 con 0x7fab5c1deb20 2023-11-18T20:42:28.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.691+0000 7fab6118c640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fab4006ae40 0x7fab4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.691+0000 7fab6198d640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fab40070d40 0x7fab40073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.691+0000 7fab6198d640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fab40070d40 0x7fab40073160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.692+0000 7fab6118c640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fab4006ae40 0x7fab4006d300 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fab58001eb0 tx=0x7fab58000ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.692+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 <== osd.2 v2:172.21.15.132:6813/1610126075 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fab40073810 con 0x7fab40070d40 2023-11-18T20:42:28.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.706+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 --> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fab5c06be30 con 0x7fab40070d40 2023-11-18T20:42:28.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.707+0000 7fab51ffb640 1 -- 172.21.15.132:0/2244545206 <== osd.2 v2:172.21.15.132:6813/1610126075 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fab54005b40 con 0x7fab40070d40 2023-11-18T20:42:28.709 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:42:28.709 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T20:42:28.709 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:42:28.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.707+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fab40070d40 msgr2=0x7fab40073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.707+0000 7fab6218e640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.132:6813/1610126075,v1:172.21.15.132:6815/1610126075] conn(0x7fab40070d40 0x7fab40073160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.707+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fab4006ae40 msgr2=0x7fab4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.707+0000 7fab6218e640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fab4006ae40 0x7fab4006d300 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fab58001eb0 tx=0x7fab58000ef0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.707+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c1deb20 msgr2=0x7fab5c1df1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.707+0000 7fab6218e640 1 --2- 172.21.15.132:0/2244545206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c1deb20 0x7fab5c1df1b0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fab4c02bf00 tx=0x7fab4c004730 comp rx=0 tx=0).stop 2023-11-18T20:42:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.708+0000 7fab6198d640 1 -- 172.21.15.132:0/2244545206 reap_dead start 2023-11-18T20:42:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.708+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 shutdown_connections 2023-11-18T20:42:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.708+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 >> 172.21.15.132:0/2244545206 conn(0x7fab5c0c5a40 msgr2=0x7fab5c0c5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.708+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 shutdown_connections 2023-11-18T20:42:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.708+0000 7fab6218e640 1 -- 172.21.15.132:0/2244545206 wait complete. 2023-11-18T20:42:28.727 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-18T20:42:28.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.933+0000 7f5f127ef640 1 Processor -- start 2023-11-18T20:42:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.933+0000 7f5f127ef640 1 -- start start 2023-11-18T20:42:28.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f127ef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c0a50b0 0x7f5f0c0bf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f127ef640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5f0c154e40 0x7f5f0c0c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f127ef640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5f0c0c3f90 0x7f5f0c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f127ef640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c06daf0 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f127ef640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c155390 con 0x7f5f0c154e40 2023-11-18T20:42:28.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f127ef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c06d1c0 con 0x7f5f0c0a50b0 2023-11-18T20:42:28.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f11fee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5f0c0c3f90 0x7f5f0c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f11fee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5f0c0c3f90 0x7f5f0c14e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42804/0 (socket says 172.21.15.132:42804) 2023-11-18T20:42:28.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.935+0000 7f5f11fee640 1 -- 172.21.15.132:0/2639666440 learned_addr learned my addr 172.21.15.132:0/2639666440 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:28.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.936+0000 7f5f117ed640 1 --2- 172.21.15.132:0/2639666440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c0a50b0 0x7f5f0c0bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.936+0000 7f5f10fec640 1 --2- 172.21.15.132:0/2639666440 >> v2:172.21.15.161:3300/0 conn(0x7f5f0c154e40 0x7f5f0c0c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.936+0000 7f5f11fee640 1 -- 172.21.15.132:0/2639666440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c0a50b0 msgr2=0x7f5f0c0bf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:28.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.936+0000 7f5f11fee640 1 --2- 172.21.15.132:0/2639666440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c0a50b0 0x7f5f0c0bf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.936+0000 7f5f11fee640 1 -- 172.21.15.132:0/2639666440 >> v2:172.21.15.161:3300/0 conn(0x7f5f0c154e40 msgr2=0x7f5f0c0c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:28.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.936+0000 7f5f11fee640 1 --2- 172.21.15.132:0/2639666440 >> v2:172.21.15.161:3300/0 conn(0x7f5f0c154e40 0x7f5f0c0c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.936+0000 7f5f11fee640 1 -- 172.21.15.132:0/2639666440 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c06d4a0 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.937+0000 7f5f11fee640 1 --2- 172.21.15.132:0/2639666440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c14e040 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0c0210 tx=0x7f5f0402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0113b7b966e1594 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f03fff640 1 -- 172.21.15.132:0/2639666440 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0402ca70 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f03fff640 1 -- 172.21.15.132:0/2639666440 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0402cbd0 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f03fff640 1 -- 172.21.15.132:0/2639666440 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f040343f0 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 -- 172.21.15.132:0/2639666440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 msgr2=0x7f5f0c14e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 --2- 172.21.15.132:0/2639666440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c14e040 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0c0210 tx=0x7f5f0402bed0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 -- 172.21.15.132:0/2639666440 shutdown_connections 2023-11-18T20:42:28.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 --2- 172.21.15.132:0/2639666440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c14e040 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 --2- 172.21.15.132:0/2639666440 >> v2:172.21.15.161:3300/0 conn(0x7f5f0c154e40 0x7f5f0c0c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 --2- 172.21.15.132:0/2639666440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c0a50b0 0x7f5f0c0bf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 -- 172.21.15.132:0/2639666440 >> 172.21.15.132:0/2639666440 conn(0x7f5f0c0a7900 msgr2=0x7f5f0c0a7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:28.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 -- 172.21.15.132:0/2639666440 shutdown_connections 2023-11-18T20:42:28.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.938+0000 7f5f127ef640 1 -- 172.21.15.132:0/2639666440 wait complete. 2023-11-18T20:42:28.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.940+0000 7f5f127ef640 1 Processor -- start 2023-11-18T20:42:28.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.940+0000 7f5f127ef640 1 -- start start 2023-11-18T20:42:28.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.941+0000 7f5f127ef640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f0c0a50b0 0x7f5f0c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.941+0000 7f5f127ef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c1e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.941+0000 7f5f127ef640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c154e40 0x7f5f0c1ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.941+0000 7f5f127ef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c149470 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.941+0000 7f5f127ef640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c071e00 con 0x7f5f0c0a50b0 2023-11-18T20:42:28.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.941+0000 7f5f127ef640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c148eb0 con 0x7f5f0c154e40 2023-11-18T20:42:28.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.941+0000 7f5f10fec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c1e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f10fec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c1e9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42818/0 (socket says 172.21.15.132:42818) 2023-11-18T20:42:28.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f10fec640 1 -- 172.21.15.132:0/1290086125 learned_addr learned my addr 172.21.15.132:0/1290086125 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:28.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f117ed640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f0c0a50b0 0x7f5f0c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f11fee640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c154e40 0x7f5f0c1ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f10fec640 1 -- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c154e40 msgr2=0x7f5f0c1ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f10fec640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c154e40 0x7f5f0c1ea2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f10fec640 1 -- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f0c0a50b0 msgr2=0x7f5f0c0ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:28.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f10fec640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f0c0a50b0 0x7f5f0c0ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:28.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f10fec640 1 -- 172.21.15.132:0/1290086125 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04009b30 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.942+0000 7f5f10fec640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c1e9d90 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00d5d0 tx=0x7f5efc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.943+0000 7f5f01ffb640 1 -- 172.21.15.132:0/1290086125 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc004240 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.943+0000 7f5f01ffb640 1 -- 172.21.15.132:0/1290086125 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc0043a0 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.943+0000 7f5f01ffb640 1 -- 172.21.15.132:0/1290086125 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc003830 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.943+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c149190 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.943+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c072310 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.944+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c04e840 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.945+0000 7f5f01ffb640 1 -- 172.21.15.132:0/1290086125 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5efc003990 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.946+0000 7f5f01ffb640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ef006ae40 0x7f5ef006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:28.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.946+0000 7f5f01ffb640 1 -- 172.21.15.132:0/1290086125 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5efc0895d0 con 0x7f5f0c0c3f90 2023-11-18T20:42:28.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.946+0000 7f5f117ed640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ef006ae40 0x7f5ef006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:28.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.947+0000 7f5f117ed640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ef006ae40 0x7f5ef006d300 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5f08006fd0 tx=0x7f5f08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:28.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:28.950+0000 7f5f01ffb640 1 -- 172.21.15.132:0/1290086125 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5efc054880 con 0x7f5f0c0c3f90 2023-11-18T20:42:29.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.139+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f0c06dca0 con 0x7f5ef006ae40 2023-11-18T20:42:29.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.141+0000 7f5f01ffb640 1 -- 172.21.15.132:0/1290086125 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5f0c06dca0 con 0x7f5ef006ae40 2023-11-18T20:42:29.142 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 2 to deep-scrub 2023-11-18T20:42:29.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ef006ae40 msgr2=0x7f5ef006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ef006ae40 0x7f5ef006d300 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5f08006fd0 tx=0x7f5f08008040 comp rx=0 tx=0).stop 2023-11-18T20:42:29.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 msgr2=0x7f5f0c1e9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c1e9d90 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00d5d0 tx=0x7f5efc00da90 comp rx=0 tx=0).stop 2023-11-18T20:42:29.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 shutdown_connections 2023-11-18T20:42:29.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f5ef006ae40 0x7f5ef006d300 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f0c154e40 0x7f5f0c1ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f0c0c3f90 0x7f5f0c1e9d90 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 --2- 172.21.15.132:0/1290086125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f0c0a50b0 0x7f5f0c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 >> 172.21.15.132:0/1290086125 conn(0x7f5f0c0a7900 msgr2=0x7f5f0c0c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:29.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 shutdown_connections 2023-11-18T20:42:29.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.143+0000 7f5f127ef640 1 -- 172.21.15.132:0/1290086125 wait complete. 2023-11-18T20:42:29.164 INFO:tasks.ceph:Scrubbing osd.3 2023-11-18T20:42:29.164 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-18T20:42:29.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.376+0000 7ff4e574e640 1 Processor -- start 2023-11-18T20:42:29.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.376+0000 7ff4e574e640 1 -- start start 2023-11-18T20:42:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4e574e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4e0151910 0x7ff4e00aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4e574e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e00c8070 con 0x7ff4e00c8500 2023-11-18T20:42:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4e574e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e00aceb0 con 0x7ff4e0154ea0 2023-11-18T20:42:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4e574e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e00add40 con 0x7ff4e0151910 2023-11-18T20:42:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4dffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4e0151910 0x7ff4e00aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4e4f4d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff4e00c8500 0x7ff4e00c8990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36304/0 (socket says 172.21.15.132:36304) 2023-11-18T20:42:29.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4e4f4d640 1 -- 172.21.15.132:0/1309912078 learned_addr learned my addr 172.21.15.132:0/1309912078 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:29.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4dffff640 1 -- 172.21.15.132:0/1309912078 >> v1:172.21.15.161:6789/0 conn(0x7ff4e0154ea0 legacy=0x7ff4e00c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4dffff640 1 -- 172.21.15.132:0/1309912078 >> v1:172.21.15.132:6789/0 conn(0x7ff4e00c8500 legacy=0x7ff4e00c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.378+0000 7ff4dffff640 1 -- 172.21.15.132:0/1309912078 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e00ad190 con 0x7ff4e0151910 2023-11-18T20:42:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.380+0000 7ff4dffff640 1 --2- 172.21.15.132:0/1309912078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e0151910 0x7ff4e00aeb40 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00097a0 tx=0x7ff4d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f2eb11108357c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:29.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.380+0000 7ff4deffd640 1 -- 172.21.15.132:0/1309912078 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0031830 con 0x7ff4e0151910 2023-11-18T20:42:29.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.380+0000 7ff4deffd640 1 -- 172.21.15.132:0/1309912078 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d0031990 con 0x7ff4e0151910 2023-11-18T20:42:29.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.380+0000 7ff4deffd640 1 -- 172.21.15.132:0/1309912078 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0031d20 con 0x7ff4e0151910 2023-11-18T20:42:29.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.380+0000 7ff4e574e640 1 -- 172.21.15.132:0/1309912078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e0151910 msgr2=0x7ff4e00aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.380+0000 7ff4e574e640 1 --2- 172.21.15.132:0/1309912078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e0151910 0x7ff4e00aeb40 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00097a0 tx=0x7ff4d002b8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.381+0000 7ff4e574e640 1 -- 172.21.15.132:0/1309912078 shutdown_connections 2023-11-18T20:42:29.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.381+0000 7ff4e574e640 1 --2- 172.21.15.132:0/1309912078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e0151910 0x7ff4e00aeb40 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.381+0000 7ff4e574e640 1 -- 172.21.15.132:0/1309912078 >> 172.21.15.132:0/1309912078 conn(0x7ff4e0072830 msgr2=0x7ff4e00abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:29.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.381+0000 7ff4e574e640 1 -- 172.21.15.132:0/1309912078 shutdown_connections 2023-11-18T20:42:29.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.381+0000 7ff4e574e640 1 -- 172.21.15.132:0/1309912078 wait complete. 2023-11-18T20:42:29.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.382+0000 7ff4e574e640 1 Processor -- start 2023-11-18T20:42:29.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.382+0000 7ff4e574e640 1 -- start start 2023-11-18T20:42:29.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.383+0000 7ff4e574e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e00c8500 0x7ff4e006c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.383+0000 7ff4e574e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4e0151910 0x7ff4e014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.383+0000 7ff4e574e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4e0154ea0 0x7ff4e014ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.383+0000 7ff4e574e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e01e0b40 con 0x7ff4e00c8500 2023-11-18T20:42:29.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.383+0000 7ff4e574e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e01e0d20 con 0x7ff4e0151910 2023-11-18T20:42:29.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.383+0000 7ff4e574e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e01e1000 con 0x7ff4e0154ea0 2023-11-18T20:42:29.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e00c8500 0x7ff4e006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e00c8500 0x7ff4e006c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42842/0 (socket says 172.21.15.132:42842) 2023-11-18T20:42:29.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 -- 172.21.15.132:0/500674757 learned_addr learned my addr 172.21.15.132:0/500674757 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:29.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 -- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4e0154ea0 msgr2=0x7ff4e014ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4e0154ea0 0x7ff4e014ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 -- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4e0151910 msgr2=0x7ff4e014b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4e0151910 0x7ff4e014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 -- 172.21.15.132:0/500674757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0009400 con 0x7ff4e00c8500 2023-11-18T20:42:29.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.384+0000 7ff4dffff640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e00c8500 0x7ff4e006c290 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00098c0 tx=0x7ff4d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:29.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.385+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d003ba70 con 0x7ff4e00c8500 2023-11-18T20:42:29.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.385+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d003bbf0 con 0x7ff4e00c8500 2023-11-18T20:42:29.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.385+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00453f0 con 0x7ff4e00c8500 2023-11-18T20:42:29.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.385+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e01e12e0 con 0x7ff4e00c8500 2023-11-18T20:42:29.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.385+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e006c7d0 con 0x7ff4e00c8500 2023-11-18T20:42:29.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.386+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4e0155960 con 0x7ff4e00c8500 2023-11-18T20:42:29.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.387+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4d0045550 con 0x7ff4e00c8500 2023-11-18T20:42:29.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.388+0000 7ff4dcff9640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff4cc06ae40 0x7ff4cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.388+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff4d00ab6d0 con 0x7ff4e00c8500 2023-11-18T20:42:29.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.388+0000 7ff4dcff9640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7ff4cc070d40 0x7ff4cc073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.388+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 --> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4cc073810 con 0x7ff4cc070d40 2023-11-18T20:42:29.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.388+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4d00add90 con 0x7ff4e00c8500 2023-11-18T20:42:29.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.388+0000 7ff4e4f4d640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7ff4cc070d40 0x7ff4cc073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.388+0000 7ff4df7fe640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff4cc06ae40 0x7ff4cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.389+0000 7ff4e4f4d640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7ff4cc070d40 0x7ff4cc073160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:29.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.389+0000 7ff4df7fe640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff4cc06ae40 0x7ff4cc06d300 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4006fd0 tx=0x7ff4d4006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:29.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.390+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 <== osd.3 v2:172.21.15.132:6818/121019578 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff4cc073810 con 0x7ff4cc070d40 2023-11-18T20:42:29.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.404+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 --> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff4e00c7d00 con 0x7ff4cc070d40 2023-11-18T20:42:29.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.404+0000 7ff4dcff9640 1 -- 172.21.15.132:0/500674757 <== osd.3 v2:172.21.15.132:6818/121019578 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff4d8001c10 con 0x7ff4cc070d40 2023-11-18T20:42:29.407 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:42:29.407 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T20:42:29.407 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:42:29.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7ff4cc070d40 msgr2=0x7ff4cc073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e574e640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.132:6818/121019578,v1:172.21.15.132:6820/121019578] conn(0x7ff4cc070d40 0x7ff4cc073160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff4cc06ae40 msgr2=0x7ff4cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e574e640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7ff4cc06ae40 0x7ff4cc06d300 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4006fd0 tx=0x7ff4d4006bc0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e00c8500 msgr2=0x7ff4e006c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e574e640 1 --2- 172.21.15.132:0/500674757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4e00c8500 0x7ff4e006c290 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00098c0 tx=0x7ff4d00046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e4f4d640 1 -- 172.21.15.132:0/500674757 reap_dead start 2023-11-18T20:42:29.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 shutdown_connections 2023-11-18T20:42:29.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.405+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 >> 172.21.15.132:0/500674757 conn(0x7ff4e0072830 msgr2=0x7ff4e00c8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:29.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.406+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 shutdown_connections 2023-11-18T20:42:29.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.406+0000 7ff4e574e640 1 -- 172.21.15.132:0/500674757 wait complete. 2023-11-18T20:42:29.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-18T20:42:29.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.635+0000 7f076c981640 1 Processor -- start 2023-11-18T20:42:29.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.635+0000 7f076c981640 1 -- start start 2023-11-18T20:42:29.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f076c981640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07681546d0 0x7f0768154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f076c981640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07680a4db0 0x7f07680c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f076c981640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680c1240 con 0x7f0768070c60 2023-11-18T20:42:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f076c981640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0768070130 con 0x7f07681546d0 2023-11-18T20:42:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f076c981640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076814eb90 con 0x7f07680a4db0 2023-11-18T20:42:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f07677fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07681546d0 0x7f0768154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f07677fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07681546d0 0x7f0768154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42852/0 (socket says 172.21.15.132:42852) 2023-11-18T20:42:29.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f07677fe640 1 -- 172.21.15.132:0/2507141062 learned_addr learned my addr 172.21.15.132:0/2507141062 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:29.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f07677fe640 1 -- 172.21.15.132:0/2507141062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07680a4db0 msgr2=0x7f07680c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:29.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f07677fe640 1 --2- 172.21.15.132:0/2507141062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07680a4db0 0x7f07680c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f07677fe640 1 -- 172.21.15.132:0/2507141062 >> v1:172.21.15.161:6789/0 conn(0x7f0768070c60 legacy=0x7f07681510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:29.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f07677fe640 1 -- 172.21.15.132:0/2507141062 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680c0f30 con 0x7f07681546d0 2023-11-18T20:42:29.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.637+0000 7f07677fe640 1 --2- 172.21.15.132:0/2507141062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07681546d0 0x7f0768154ab0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0758009870 tx=0x7f075802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcb7b0648c85f24 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:29.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.638+0000 7f0766ffd640 1 -- 172.21.15.132:0/2507141062 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580317c0 con 0x7f07681546d0 2023-11-18T20:42:29.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.638+0000 7f0766ffd640 1 -- 172.21.15.132:0/2507141062 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758031920 con 0x7f07681546d0 2023-11-18T20:42:29.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.638+0000 7f0766ffd640 1 -- 172.21.15.132:0/2507141062 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758031cb0 con 0x7f07681546d0 2023-11-18T20:42:29.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.638+0000 7f076c981640 1 -- 172.21.15.132:0/2507141062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07681546d0 msgr2=0x7f0768154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.638+0000 7f076c981640 1 --2- 172.21.15.132:0/2507141062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07681546d0 0x7f0768154ab0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0758009870 tx=0x7f075802b860 comp rx=0 tx=0).stop 2023-11-18T20:42:29.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.638+0000 7f076c981640 1 -- 172.21.15.132:0/2507141062 shutdown_connections 2023-11-18T20:42:29.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.638+0000 7f076c981640 1 --2- 172.21.15.132:0/2507141062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07680a4db0 0x7f07680c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.639+0000 7f076c981640 1 --2- 172.21.15.132:0/2507141062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07681546d0 0x7f0768154ab0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.639+0000 7f076c981640 1 -- 172.21.15.132:0/2507141062 >> 172.21.15.132:0/2507141062 conn(0x7f07680a7900 msgr2=0x7f07680a7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:29.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.639+0000 7f076c981640 1 -- 172.21.15.132:0/2507141062 shutdown_connections 2023-11-18T20:42:29.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.639+0000 7f076c981640 1 -- 172.21.15.132:0/2507141062 wait complete. 2023-11-18T20:42:29.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.640+0000 7f076c981640 1 Processor -- start 2023-11-18T20:42:29.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.640+0000 7f076c981640 1 -- start start 2023-11-18T20:42:29.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.641+0000 7f076c981640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768070c60 0x7f07681e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.641+0000 7f076c981640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07680a4db0 0x7f07681de820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.641+0000 7f076c981640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07681546d0 0x7f07681dd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.641+0000 7f076c981640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076806da60 con 0x7f07680a4db0 2023-11-18T20:42:29.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.641+0000 7f076c981640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076806d4a0 con 0x7f0768070c60 2023-11-18T20:42:29.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.641+0000 7f076c981640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076806d780 con 0x7f07681546d0 2023-11-18T20:42:29.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07680a4db0 0x7f07681de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07680a4db0 0x7f07681de820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42858/0 (socket says 172.21.15.132:42858) 2023-11-18T20:42:29.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 -- 172.21.15.132:0/3498786089 learned_addr learned my addr 172.21.15.132:0/3498786089 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:29.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f07677fe640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768070c60 0x7f07681e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f0767fff640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07681546d0 0x7f07681dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 -- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07681546d0 msgr2=0x7f07681dd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07681546d0 0x7f07681dd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 -- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768070c60 msgr2=0x7f07681e03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768070c60 0x7f07681e03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 -- 172.21.15.132:0/3498786089 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580094d0 con 0x7f07680a4db0 2023-11-18T20:42:29.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f0767fff640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07681546d0 0x7f07681dd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:29.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.642+0000 7f075ffff640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07680a4db0 0x7f07681de820 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f075000b410 tx=0x7f075000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:29.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.643+0000 7f0764ff9640 1 -- 172.21.15.132:0/3498786089 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750011830 con 0x7f07680a4db0 2023-11-18T20:42:29.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.643+0000 7f0764ff9640 1 -- 172.21.15.132:0/3498786089 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500119b0 con 0x7f07680a4db0 2023-11-18T20:42:29.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.643+0000 7f0764ff9640 1 -- 172.21.15.132:0/3498786089 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750011d60 con 0x7f07680a4db0 2023-11-18T20:42:29.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.643+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07681dc880 con 0x7f07680a4db0 2023-11-18T20:42:29.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.643+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681ded60 con 0x7f07680a4db0 2023-11-18T20:42:29.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.644+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07681dcda0 con 0x7f07680a4db0 2023-11-18T20:42:29.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.645+0000 7f0764ff9640 1 -- 172.21.15.132:0/3498786089 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f075001a400 con 0x7f07680a4db0 2023-11-18T20:42:29.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.647+0000 7f0764ff9640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f074806ae40 0x7f074806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:29.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.647+0000 7f0764ff9640 1 -- 172.21.15.132:0/3498786089 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0750089490 con 0x7f07680a4db0 2023-11-18T20:42:29.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.647+0000 7f07677fe640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f074806ae40 0x7f074806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:29.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.648+0000 7f07677fe640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f074806ae40 0x7f074806d300 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0758036000 tx=0x7f075803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:29.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.650+0000 7f0764ff9640 1 -- 172.21.15.132:0/3498786089 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07681dcda0 con 0x7f07680a4db0 2023-11-18T20:42:29.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.839+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0768155460 con 0x7f074806ae40 2023-11-18T20:42:29.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.840+0000 7f0764ff9640 1 -- 172.21.15.132:0/3498786089 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0758031b90 con 0x7f074806ae40 2023-11-18T20:42:29.842 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 3 to deep-scrub 2023-11-18T20:42:29.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.842+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f074806ae40 msgr2=0x7f074806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.842+0000 7f076c981640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f074806ae40 0x7f074806d300 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0758036000 tx=0x7f075803d040 comp rx=0 tx=0).stop 2023-11-18T20:42:29.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.842+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07680a4db0 msgr2=0x7f07681de820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:29.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.842+0000 7f076c981640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07680a4db0 0x7f07681de820 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f075000b410 tx=0x7f075000b8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.843+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 shutdown_connections 2023-11-18T20:42:29.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.843+0000 7f076c981640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f074806ae40 0x7f074806d300 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.843+0000 7f076c981640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07681546d0 0x7f07681dd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.843+0000 7f076c981640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07680a4db0 0x7f07681de820 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.843+0000 7f076c981640 1 --2- 172.21.15.132:0/3498786089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768070c60 0x7f07681e03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:29.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.843+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 >> 172.21.15.132:0/3498786089 conn(0x7f07680a7900 msgr2=0x7f07680bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:29.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.843+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 shutdown_connections 2023-11-18T20:42:29.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:29.843+0000 7f076c981640 1 -- 172.21.15.132:0/3498786089 wait complete. 2023-11-18T20:42:29.861 INFO:tasks.ceph:Scrubbing osd.4 2023-11-18T20:42:29.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-18T20:42:30.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.074+0000 7fdd17fff640 1 Processor -- start 2023-11-18T20:42:30.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.074+0000 7fdd17fff640 1 -- start start 2023-11-18T20:42:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd17fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd18072630 0x7fdd1806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd17fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdd180c4530 0x7fdd180a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd17fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd180c40a0 con 0x7fdd180bef80 2023-11-18T20:42:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd17fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180bf500 con 0x7fdd18072630 2023-11-18T20:42:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd17fff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180bf7e0 con 0x7fdd180c4530 2023-11-18T20:42:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd16ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd18072630 0x7fdd1806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd16ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd18072630 0x7fdd1806cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42868/0 (socket says 172.21.15.132:42868) 2023-11-18T20:42:30.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd16ffd640 1 -- 172.21.15.132:0/3485653474 learned_addr learned my addr 172.21.15.132:0/3485653474 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:30.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd16ffd640 1 -- 172.21.15.132:0/3485653474 >> v2:172.21.15.161:3300/0 conn(0x7fdd180c4530 msgr2=0x7fdd180a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:30.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.076+0000 7fdd16ffd640 1 --2- 172.21.15.132:0/3485653474 >> v2:172.21.15.161:3300/0 conn(0x7fdd180c4530 0x7fdd180a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.077+0000 7fdd16ffd640 1 -- 172.21.15.132:0/3485653474 >> v1:172.21.15.161:6789/0 conn(0x7fdd180bef80 legacy=0x7fdd18154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:30.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.077+0000 7fdd16ffd640 1 -- 172.21.15.132:0/3485653474 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180c3a50 con 0x7fdd18072630 2023-11-18T20:42:30.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.078+0000 7fdd16ffd640 1 --2- 172.21.15.132:0/3485653474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd18072630 0x7fdd1806cdf0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fdd181543e0 tx=0x7fdd0802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db74ad9424909c06 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.078+0000 7fdd167fc640 1 -- 172.21.15.132:0/3485653474 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080317e0 con 0x7fdd18072630 2023-11-18T20:42:30.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.078+0000 7fdd167fc640 1 -- 172.21.15.132:0/3485653474 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd08031940 con 0x7fdd18072630 2023-11-18T20:42:30.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.078+0000 7fdd167fc640 1 -- 172.21.15.132:0/3485653474 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08031cd0 con 0x7fdd18072630 2023-11-18T20:42:30.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.078+0000 7fdd17fff640 1 -- 172.21.15.132:0/3485653474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd18072630 msgr2=0x7fdd1806cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.078+0000 7fdd17fff640 1 --2- 172.21.15.132:0/3485653474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd18072630 0x7fdd1806cdf0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fdd181543e0 tx=0x7fdd0802b880 comp rx=0 tx=0).stop 2023-11-18T20:42:30.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.079+0000 7fdd17fff640 1 -- 172.21.15.132:0/3485653474 shutdown_connections 2023-11-18T20:42:30.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.079+0000 7fdd17fff640 1 --2- 172.21.15.132:0/3485653474 >> v2:172.21.15.161:3300/0 conn(0x7fdd180c4530 0x7fdd180a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.079+0000 7fdd17fff640 1 --2- 172.21.15.132:0/3485653474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd18072630 0x7fdd1806cdf0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.079+0000 7fdd17fff640 1 -- 172.21.15.132:0/3485653474 >> 172.21.15.132:0/3485653474 conn(0x7fdd180c2650 msgr2=0x7fdd180c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:30.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.079+0000 7fdd17fff640 1 -- 172.21.15.132:0/3485653474 shutdown_connections 2023-11-18T20:42:30.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.079+0000 7fdd17fff640 1 -- 172.21.15.132:0/3485653474 wait complete. 2023-11-18T20:42:30.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.080+0000 7fdd17fff640 1 Processor -- start 2023-11-18T20:42:30.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.080+0000 7fdd17fff640 1 -- start start 2023-11-18T20:42:30.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.081+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd18072630 0x7fdd181eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.081+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd180bef80 0x7fdd180a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.081+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd180c4530 0x7fdd180a72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.081+0000 7fdd17fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180a9a40 con 0x7fdd180bef80 2023-11-18T20:42:30.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.081+0000 7fdd17fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180a9d20 con 0x7fdd180c4530 2023-11-18T20:42:30.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.081+0000 7fdd17fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1814a4a0 con 0x7fdd18072630 2023-11-18T20:42:30.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd180bef80 0x7fdd180a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd180bef80 0x7fdd180a6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42874/0 (socket says 172.21.15.132:42874) 2023-11-18T20:42:30.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 -- 172.21.15.132:0/2704939452 learned_addr learned my addr 172.21.15.132:0/2704939452 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:30.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 -- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd18072630 msgr2=0x7fdd181eb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd18072630 0x7fdd181eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 -- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd180c4530 msgr2=0x7fdd180a72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd180c4530 0x7fdd180a72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 -- 172.21.15.132:0/2704939452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080094d0 con 0x7fdd180bef80 2023-11-18T20:42:30.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd0e7fc640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd180bef80 0x7fdd180a6d60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c400 tx=0x7fdd0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.082+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000035f0 con 0x7fdd180bef80 2023-11-18T20:42:30.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.083+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00003750 con 0x7fdd180bef80 2023-11-18T20:42:30.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.083+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1814a780 con 0x7fdd180bef80 2023-11-18T20:42:30.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.083+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00003b40 con 0x7fdd180bef80 2023-11-18T20:42:30.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.083+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1814b850 con 0x7fdd180bef80 2023-11-18T20:42:30.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.084+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd18072a10 con 0x7fdd180bef80 2023-11-18T20:42:30.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.085+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd00003ca0 con 0x7fdd180bef80 2023-11-18T20:42:30.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.086+0000 7fdd14ff9640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdcf806ae40 0x7fdcf806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.086+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdd00088710 con 0x7fdd180bef80 2023-11-18T20:42:30.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.086+0000 7fdd14ff9640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fdcf8070d40 0x7fdcf8073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.086+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 --> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcf8073810 con 0x7fdcf8070d40 2023-11-18T20:42:30.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.086+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd0008add0 con 0x7fdd180bef80 2023-11-18T20:42:30.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.086+0000 7fdd16ffd640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdcf806ae40 0x7fdcf806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.087+0000 7fdd177fe640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fdcf8070d40 0x7fdcf8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.088+0000 7fdd16ffd640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdcf806ae40 0x7fdcf806d300 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdd08036000 tx=0x7fdd08030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.088+0000 7fdd177fe640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fdcf8070d40 0x7fdcf8073160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.091+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 <== osd.4 v2:172.21.15.161:6800/3367196689 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fdcf8073810 con 0x7fdcf8070d40 2023-11-18T20:42:30.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.104+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 --> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdd1814a610 con 0x7fdcf8070d40 2023-11-18T20:42:30.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.105+0000 7fdd14ff9640 1 -- 172.21.15.132:0/2704939452 <== osd.4 v2:172.21.15.161:6800/3367196689 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdd1814a610 con 0x7fdcf8070d40 2023-11-18T20:42:30.108 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:42:30.108 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T20:42:30.108 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:42:30.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fdcf8070d40 msgr2=0x7fdcf8073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6800/3367196689,v1:172.21.15.161:6801/3367196689] conn(0x7fdcf8070d40 0x7fdcf8073160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdcf806ae40 msgr2=0x7fdcf806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdcf806ae40 0x7fdcf806d300 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdd08036000 tx=0x7fdd08030000 comp rx=0 tx=0).stop 2023-11-18T20:42:30.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd180bef80 msgr2=0x7fdd180a6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 --2- 172.21.15.132:0/2704939452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd180bef80 0x7fdd180a6d60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c400 tx=0x7fdd0000c8c0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd177fe640 1 -- 172.21.15.132:0/2704939452 reap_dead start 2023-11-18T20:42:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 shutdown_connections 2023-11-18T20:42:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 >> 172.21.15.132:0/2704939452 conn(0x7fdd180c2650 msgr2=0x7fdd180c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 shutdown_connections 2023-11-18T20:42:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.106+0000 7fdd17fff640 1 -- 172.21.15.132:0/2704939452 wait complete. 2023-11-18T20:42:30.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-18T20:42:30.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.337+0000 7fa12dc64640 1 Processor -- start 2023-11-18T20:42:30.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.337+0000 7fa12dc64640 1 -- start start 2023-11-18T20:42:30.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa12dc64640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa128151fd0 0x7fa12806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa12dc64640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa128071fd0 con 0x7fa1280c3400 2023-11-18T20:42:30.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa12dc64640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa128072220 con 0x7fa128157fe0 2023-11-18T20:42:30.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa12dc64640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12806ee50 con 0x7fa128151fd0 2023-11-18T20:42:30.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa1277fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa128151fd0 0x7fa12806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa11ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa1280c3400 0x7fa12806a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36308/0 (socket says 172.21.15.132:36308) 2023-11-18T20:42:30.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa11ffff640 1 -- 172.21.15.132:0/3769039275 learned_addr learned my addr 172.21.15.132:0/3769039275 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:30.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa126ffd640 1 -- 172.21.15.132:0/3769039275 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741889750 0 0) 0x7fa128071fd0 con 0x7fa1280c3400 2023-11-18T20:42:30.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa126ffd640 1 -- 172.21.15.132:0/3769039275 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa114003520 con 0x7fa1280c3400 2023-11-18T20:42:30.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa1277fe640 1 -- 172.21.15.132:0/3769039275 >> v1:172.21.15.161:6789/0 conn(0x7fa128157fe0 legacy=0x7fa128158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa1277fe640 1 -- 172.21.15.132:0/3769039275 >> v1:172.21.15.132:6789/0 conn(0x7fa1280c3400 legacy=0x7fa12806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.339+0000 7fa1277fe640 1 -- 172.21.15.132:0/3769039275 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12806e0d0 con 0x7fa128151fd0 2023-11-18T20:42:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.340+0000 7fa1277fe640 1 --2- 172.21.15.132:0/3769039275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa128151fd0 0x7fa12806e910 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa1180097a0 tx=0x7fa11802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e51c5049ba7680 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa126ffd640 1 -- 172.21.15.132:0/3769039275 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118031830 con 0x7fa128151fd0 2023-11-18T20:42:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa126ffd640 1 -- 172.21.15.132:0/3769039275 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118031990 con 0x7fa128151fd0 2023-11-18T20:42:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa126ffd640 1 -- 172.21.15.132:0/3769039275 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118031d20 con 0x7fa128151fd0 2023-11-18T20:42:30.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa12dc64640 1 -- 172.21.15.132:0/3769039275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa128151fd0 msgr2=0x7fa12806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa12dc64640 1 --2- 172.21.15.132:0/3769039275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa128151fd0 0x7fa12806e910 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa1180097a0 tx=0x7fa11802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa12dc64640 1 -- 172.21.15.132:0/3769039275 shutdown_connections 2023-11-18T20:42:30.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa12dc64640 1 --2- 172.21.15.132:0/3769039275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa128151fd0 0x7fa12806e910 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa12dc64640 1 -- 172.21.15.132:0/3769039275 >> 172.21.15.132:0/3769039275 conn(0x7fa1280c6ee0 msgr2=0x7fa1280c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:30.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.341+0000 7fa12dc64640 1 -- 172.21.15.132:0/3769039275 shutdown_connections 2023-11-18T20:42:30.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.342+0000 7fa12dc64640 1 -- 172.21.15.132:0/3769039275 wait complete. 2023-11-18T20:42:30.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.343+0000 7fa12dc64640 1 Processor -- start 2023-11-18T20:42:30.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.343+0000 7fa12dc64640 1 -- start start 2023-11-18T20:42:30.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa12dc64640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1280c3400 0x7fa128148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa12dc64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa128151fd0 0x7fa128143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa12dc64640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa128157fe0 0x7fa128144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa12dc64640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281445b0 con 0x7fa1280c3400 2023-11-18T20:42:30.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa12dc64640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281edec0 con 0x7fa128151fd0 2023-11-18T20:42:30.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa12dc64640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa128144730 con 0x7fa128157fe0 2023-11-18T20:42:30.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa1277fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1280c3400 0x7fa128148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa1277fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1280c3400 0x7fa128148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42892/0 (socket says 172.21.15.132:42892) 2023-11-18T20:42:30.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.344+0000 7fa1277fe640 1 -- 172.21.15.132:0/3965346408 learned_addr learned my addr 172.21.15.132:0/3965346408 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:30.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.345+0000 7fa1277fe640 1 -- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa128157fe0 msgr2=0x7fa128144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.345+0000 7fa1277fe640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa128157fe0 0x7fa128144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.345+0000 7fa1277fe640 1 -- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa128151fd0 msgr2=0x7fa128143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.345+0000 7fa1277fe640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa128151fd0 0x7fa128143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.345+0000 7fa1277fe640 1 -- 172.21.15.132:0/3965346408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa118009400 con 0x7fa1280c3400 2023-11-18T20:42:30.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.345+0000 7fa1277fe640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1280c3400 0x7fa128148d30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa11802bee0 tx=0x7fa1180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.345+0000 7fa124ff9640 1 -- 172.21.15.132:0/3965346408 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11803a6f0 con 0x7fa1280c3400 2023-11-18T20:42:30.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.346+0000 7fa124ff9640 1 -- 172.21.15.132:0/3965346408 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11803a870 con 0x7fa1280c3400 2023-11-18T20:42:30.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.346+0000 7fa124ff9640 1 -- 172.21.15.132:0/3965346408 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11803ac20 con 0x7fa1280c3400 2023-11-18T20:42:30.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.346+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa128144980 con 0x7fa1280c3400 2023-11-18T20:42:30.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.346+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12814c550 con 0x7fa1280c3400 2023-11-18T20:42:30.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.347+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa128068350 con 0x7fa1280c3400 2023-11-18T20:42:30.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.348+0000 7fa124ff9640 1 -- 172.21.15.132:0/3965346408 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa11804c3b0 con 0x7fa1280c3400 2023-11-18T20:42:30.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.348+0000 7fa124ff9640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10806ae40 0x7fa10806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.349+0000 7fa124ff9640 1 -- 172.21.15.132:0/3965346408 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa1180aafb0 con 0x7fa1280c3400 2023-11-18T20:42:30.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.349+0000 7fa11ffff640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10806ae40 0x7fa10806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.350+0000 7fa11ffff640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10806ae40 0x7fa10806d300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa128151660 tx=0x7fa110007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.355+0000 7fa124ff9640 1 -- 172.21.15.132:0/3965346408 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1180dde90 con 0x7fa1280c3400 2023-11-18T20:42:30.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.549+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1280c13b0 con 0x7fa10806ae40 2023-11-18T20:42:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.550+0000 7fa124ff9640 1 -- 172.21.15.132:0/3965346408 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa1280c13b0 con 0x7fa10806ae40 2023-11-18T20:42:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 4 to deep-scrub 2023-11-18T20:42:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10806ae40 msgr2=0x7fa10806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10806ae40 0x7fa10806d300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa128151660 tx=0x7fa110007930 comp rx=0 tx=0).stop 2023-11-18T20:42:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1280c3400 msgr2=0x7fa128148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1280c3400 0x7fa128148d30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa11802bee0 tx=0x7fa1180046c0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 shutdown_connections 2023-11-18T20:42:30.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fa10806ae40 0x7fa10806d300 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa128157fe0 0x7fa128144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa128151fd0 0x7fa128143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 --2- 172.21.15.132:0/3965346408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1280c3400 0x7fa128148d30 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.552+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 >> 172.21.15.132:0/3965346408 conn(0x7fa1280c6ee0 msgr2=0x7fa1280c0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:30.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.553+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 shutdown_connections 2023-11-18T20:42:30.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.553+0000 7fa12dc64640 1 -- 172.21.15.132:0/3965346408 wait complete. 2023-11-18T20:42:30.571 INFO:tasks.ceph:Scrubbing osd.5 2023-11-18T20:42:30.571 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-18T20:42:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.789+0000 7f499d6e0640 1 Processor -- start 2023-11-18T20:42:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.789+0000 7f499d6e0640 1 -- start start 2023-11-18T20:42:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.790+0000 7f499d6e0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f499814fa80 0x7f499806d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f499d6e0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4998071f70 0x7f49980c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f499d6e0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49980c0980 con 0x7f4998072530 2023-11-18T20:42:30.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f499d6e0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499806d160 con 0x7f499814fa80 2023-11-18T20:42:30.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f499d6e0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499806c070 con 0x7f4998071f70 2023-11-18T20:42:30.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f4996ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f499814fa80 0x7f499806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f4996ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f499814fa80 0x7f499806d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42898/0 (socket says 172.21.15.132:42898) 2023-11-18T20:42:30.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f4996ffd640 1 -- 172.21.15.132:0/100260125 learned_addr learned my addr 172.21.15.132:0/100260125 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:30.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f4996ffd640 1 -- 172.21.15.132:0/100260125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4998071f70 msgr2=0x7f49980c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:30.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f4996ffd640 1 --2- 172.21.15.132:0/100260125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4998071f70 0x7f49980c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f4996ffd640 1 -- 172.21.15.132:0/100260125 >> v1:172.21.15.161:6789/0 conn(0x7f4998072530 legacy=0x7f49980c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:30.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.791+0000 7f4996ffd640 1 -- 172.21.15.132:0/100260125 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499806dc70 con 0x7f499814fa80 2023-11-18T20:42:30.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.792+0000 7f4996ffd640 1 --2- 172.21.15.132:0/100260125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f499814fa80 0x7f499806d730 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f4988009870 tx=0x7f498802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd063e7155e22c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.793+0000 7f49967fc640 1 -- 172.21.15.132:0/100260125 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880317c0 con 0x7f499814fa80 2023-11-18T20:42:30.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.793+0000 7f49967fc640 1 -- 172.21.15.132:0/100260125 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4988031920 con 0x7f499814fa80 2023-11-18T20:42:30.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.793+0000 7f49967fc640 1 -- 172.21.15.132:0/100260125 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988031cb0 con 0x7f499814fa80 2023-11-18T20:42:30.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.793+0000 7f499d6e0640 1 -- 172.21.15.132:0/100260125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f499814fa80 msgr2=0x7f499806d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.793+0000 7f499d6e0640 1 --2- 172.21.15.132:0/100260125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f499814fa80 0x7f499806d730 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f4988009870 tx=0x7f498802b860 comp rx=0 tx=0).stop 2023-11-18T20:42:30.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.794+0000 7f499d6e0640 1 -- 172.21.15.132:0/100260125 shutdown_connections 2023-11-18T20:42:30.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.794+0000 7f499d6e0640 1 --2- 172.21.15.132:0/100260125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4998071f70 0x7f49980c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.794+0000 7f499d6e0640 1 --2- 172.21.15.132:0/100260125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f499814fa80 0x7f499806d730 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.794+0000 7f499d6e0640 1 -- 172.21.15.132:0/100260125 >> 172.21.15.132:0/100260125 conn(0x7f49980c5bc0 msgr2=0x7f49980c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:30.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.794+0000 7f499d6e0640 1 -- 172.21.15.132:0/100260125 shutdown_connections 2023-11-18T20:42:30.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.794+0000 7f499d6e0640 1 -- 172.21.15.132:0/100260125 wait complete. 2023-11-18T20:42:30.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.795+0000 7f499d6e0640 1 Processor -- start 2023-11-18T20:42:30.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.795+0000 7f499d6e0640 1 -- start start 2023-11-18T20:42:30.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.796+0000 7f499d6e0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4998071f70 0x7f4998153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.796+0000 7f499d6e0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4998072530 0x7f4998147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.796+0000 7f499d6e0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f499814fa80 0x7f4998155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.796+0000 7f499d6e0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49981e98d0 con 0x7f4998072530 2023-11-18T20:42:30.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.796+0000 7f499d6e0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49981e9cf0 con 0x7f499814fa80 2023-11-18T20:42:30.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.796+0000 7f499d6e0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49981e8f30 con 0x7f4998071f70 2023-11-18T20:42:30.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4998072530 0x7f4998147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4998072530 0x7f4998147550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42914/0 (socket says 172.21.15.132:42914) 2023-11-18T20:42:30.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 -- 172.21.15.132:0/773324850 learned_addr learned my addr 172.21.15.132:0/773324850 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 -- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4998071f70 msgr2=0x7f4998153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4998071f70 0x7f4998153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 -- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f499814fa80 msgr2=0x7f4998155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f499814fa80 0x7f4998155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 -- 172.21.15.132:0/773324850 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880094d0 con 0x7f4998072530 2023-11-18T20:42:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498ffff640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4998072530 0x7f4998147550 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f498000c400 tx=0x7f498000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.797+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800035f0 con 0x7f4998072530 2023-11-18T20:42:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.798+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980003750 con 0x7f4998072530 2023-11-18T20:42:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.798+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980003b00 con 0x7f4998072530 2023-11-18T20:42:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.798+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49981e9210 con 0x7f4998072530 2023-11-18T20:42:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.798+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4998147a90 con 0x7f4998072530 2023-11-18T20:42:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.799+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f499806bd00 con 0x7f4998072530 2023-11-18T20:42:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.800+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4980003c60 con 0x7f4998072530 2023-11-18T20:42:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.801+0000 7f498f7fe640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f497806ae40 0x7f497806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.801+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4980088540 con 0x7f4998072530 2023-11-18T20:42:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.801+0000 7f498f7fe640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4978070d40 0x7f4978073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.801+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 --> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4978073810 con 0x7f4978070d40 2023-11-18T20:42:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.801+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f498008aac0 con 0x7f4998072530 2023-11-18T20:42:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.802+0000 7f4996ffd640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f497806ae40 0x7f497806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.802+0000 7f49977fe640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4978070d40 0x7f4978073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.803+0000 7f4996ffd640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f497806ae40 0x7f497806d300 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4988036000 tx=0x7f4988030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.803+0000 7f49977fe640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4978070d40 0x7f4978073160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.805+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 <== osd.5 v2:172.21.15.161:6816/1224738200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4978073810 con 0x7f4978070d40 2023-11-18T20:42:30.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.820+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 --> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f49980c23b0 con 0x7f4978070d40 2023-11-18T20:42:30.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.821+0000 7f498f7fe640 1 -- 172.21.15.132:0/773324850 <== osd.5 v2:172.21.15.161:6816/1224738200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f499000ac70 con 0x7f4978070d40 2023-11-18T20:42:30.822 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:42:30.823 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T20:42:30.823 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:42:30.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.821+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4978070d40 msgr2=0x7f4978073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.821+0000 7f499d6e0640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6816/1224738200,v1:172.21.15.161:6817/1224738200] conn(0x7f4978070d40 0x7f4978073160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f497806ae40 msgr2=0x7f497806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f499d6e0640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f497806ae40 0x7f497806d300 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4988036000 tx=0x7f4988030000 comp rx=0 tx=0).stop 2023-11-18T20:42:30.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4998072530 msgr2=0x7f4998147550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:30.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f499d6e0640 1 --2- 172.21.15.132:0/773324850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4998072530 0x7f4998147550 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f498000c400 tx=0x7f498000c8c0 comp rx=0 tx=0).stop 2023-11-18T20:42:30.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f49977fe640 1 -- 172.21.15.132:0/773324850 reap_dead start 2023-11-18T20:42:30.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 shutdown_connections 2023-11-18T20:42:30.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 >> 172.21.15.132:0/773324850 conn(0x7f49980c5bc0 msgr2=0x7f49980c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:30.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 shutdown_connections 2023-11-18T20:42:30.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:30.822+0000 7f499d6e0640 1 -- 172.21.15.132:0/773324850 wait complete. 2023-11-18T20:42:30.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-18T20:42:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.049+0000 7fdd293d5640 1 Processor -- start 2023-11-18T20:42:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.050+0000 7fdd293d5640 1 -- start start 2023-11-18T20:42:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.051+0000 7fdd293d5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdd240c31b0 0x7fdd24155d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.051+0000 7fdd293d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd240c1a90 0x7fdd240a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.051+0000 7fdd293d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd240c1600 con 0x7fdd240c5f30 2023-11-18T20:42:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.051+0000 7fdd293d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240c7e30 con 0x7fdd240c1a90 2023-11-18T20:42:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.051+0000 7fdd293d5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240c8090 con 0x7fdd240c31b0 2023-11-18T20:42:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.051+0000 7fdd22ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdd240c5f30 0x7fdd240c7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36316/0 (socket says 172.21.15.132:36316) 2023-11-18T20:42:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.051+0000 7fdd22ffd640 1 -- 172.21.15.132:0/3963659380 learned_addr learned my addr 172.21.15.132:0/3963659380 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.051+0000 7fdd237fe640 1 --2- 172.21.15.132:0/3963659380 >> v2:172.21.15.132:3300/0 conn(0x7fdd240c1a90 0x7fdd240a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.052+0000 7fdd227fc640 1 --2- 172.21.15.132:0/3963659380 >> v2:172.21.15.161:3300/0 conn(0x7fdd240c31b0 0x7fdd24155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.052+0000 7fdd21ffb640 1 -- 172.21.15.132:0/3963659380 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805444993 0 0) 0x7fdd240c1600 con 0x7fdd240c5f30 2023-11-18T20:42:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.052+0000 7fdd21ffb640 1 -- 172.21.15.132:0/3963659380 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd10003520 con 0x7fdd240c5f30 2023-11-18T20:42:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.052+0000 7fdd237fe640 1 -- 172.21.15.132:0/3963659380 >> v2:172.21.15.161:3300/0 conn(0x7fdd240c31b0 msgr2=0x7fdd24155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.052+0000 7fdd237fe640 1 --2- 172.21.15.132:0/3963659380 >> v2:172.21.15.161:3300/0 conn(0x7fdd240c31b0 0x7fdd24155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.052+0000 7fdd237fe640 1 -- 172.21.15.132:0/3963659380 >> v1:172.21.15.132:6789/0 conn(0x7fdd240c5f30 legacy=0x7fdd240c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.052+0000 7fdd237fe640 1 -- 172.21.15.132:0/3963659380 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd240c8370 con 0x7fdd240c1a90 2023-11-18T20:42:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.053+0000 7fdd237fe640 1 --2- 172.21.15.132:0/3963659380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd240a6df0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fdd240708e0 tx=0x7fdd1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa37e641cf1bc98 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.053+0000 7fdd21ffb640 1 -- 172.21.15.132:0/3963659380 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c031830 con 0x7fdd240c1a90 2023-11-18T20:42:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.053+0000 7fdd21ffb640 1 -- 172.21.15.132:0/3963659380 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c031990 con 0x7fdd240c1a90 2023-11-18T20:42:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.053+0000 7fdd21ffb640 1 -- 172.21.15.132:0/3963659380 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c031d00 con 0x7fdd240c1a90 2023-11-18T20:42:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.054+0000 7fdd293d5640 1 -- 172.21.15.132:0/3963659380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 msgr2=0x7fdd240a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.054+0000 7fdd293d5640 1 --2- 172.21.15.132:0/3963659380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd240a6df0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fdd240708e0 tx=0x7fdd1c02b8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.054+0000 7fdd293d5640 1 -- 172.21.15.132:0/3963659380 shutdown_connections 2023-11-18T20:42:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.054+0000 7fdd293d5640 1 --2- 172.21.15.132:0/3963659380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd240a6df0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.054+0000 7fdd293d5640 1 --2- 172.21.15.132:0/3963659380 >> v2:172.21.15.161:3300/0 conn(0x7fdd240c31b0 0x7fdd24155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.054+0000 7fdd293d5640 1 -- 172.21.15.132:0/3963659380 >> 172.21.15.132:0/3963659380 conn(0x7fdd240a9b70 msgr2=0x7fdd240a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.054+0000 7fdd293d5640 1 -- 172.21.15.132:0/3963659380 shutdown_connections 2023-11-18T20:42:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.054+0000 7fdd293d5640 1 -- 172.21.15.132:0/3963659380 wait complete. 2023-11-18T20:42:31.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.056+0000 7fdd293d5640 1 Processor -- start 2023-11-18T20:42:31.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.056+0000 7fdd293d5640 1 -- start start 2023-11-18T20:42:31.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd293d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd24152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd293d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd240c31b0 0x7fdd24153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd293d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd240c5f30 0x7fdd240a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd293d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd241dd2e0 con 0x7fdd240c1a90 2023-11-18T20:42:31.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd293d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240a93b0 con 0x7fdd240c5f30 2023-11-18T20:42:31.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd293d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd241dcd20 con 0x7fdd240c31b0 2023-11-18T20:42:31.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd22ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd24152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd22ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd24152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42942/0 (socket says 172.21.15.132:42942) 2023-11-18T20:42:31.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.057+0000 7fdd22ffd640 1 -- 172.21.15.132:0/1780267768 learned_addr learned my addr 172.21.15.132:0/1780267768 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd22ffd640 1 -- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd240c31b0 msgr2=0x7fdd24153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd22ffd640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd240c31b0 0x7fdd24153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd22ffd640 1 -- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd240c5f30 msgr2=0x7fdd240a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd22ffd640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd240c5f30 0x7fdd240a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd22ffd640 1 -- 172.21.15.132:0/1780267768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c009400 con 0x7fdd240c1a90 2023-11-18T20:42:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd22ffd640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd24152e40 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400caa0 tx=0x7fdd1400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd1b7fe640 1 -- 172.21.15.132:0/1780267768 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400ac00 con 0x7fdd240c1a90 2023-11-18T20:42:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd1b7fe640 1 -- 172.21.15.132:0/1780267768 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1400ad60 con 0x7fdd240c1a90 2023-11-18T20:42:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd1b7fe640 1 -- 172.21.15.132:0/1780267768 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14012620 con 0x7fdd240c1a90 2023-11-18T20:42:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.058+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd241dd000 con 0x7fdd240c1a90 2023-11-18T20:42:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.059+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd240a68e0 con 0x7fdd240c1a90 2023-11-18T20:42:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.060+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd240a6220 con 0x7fdd240c1a90 2023-11-18T20:42:31.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.061+0000 7fdd1b7fe640 1 -- 172.21.15.132:0/1780267768 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd14007070 con 0x7fdd240c1a90 2023-11-18T20:42:31.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.061+0000 7fdd1b7fe640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd0406ae40 0x7fdd0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.062+0000 7fdd1b7fe640 1 -- 172.21.15.132:0/1780267768 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdd14089340 con 0x7fdd240c1a90 2023-11-18T20:42:31.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.062+0000 7fdd227fc640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd0406ae40 0x7fdd0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.063+0000 7fdd227fc640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd0406ae40 0x7fdd0406d300 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdd240aa4f0 tx=0x7fdd0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.066+0000 7fdd1b7fe640 1 -- 172.21.15.132:0/1780267768 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd240a6220 con 0x7fdd240c1a90 2023-11-18T20:42:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.256+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd240c1290 con 0x7fdd0406ae40 2023-11-18T20:42:31.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.257+0000 7fdd1b7fe640 1 -- 172.21.15.132:0/1780267768 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdd0c009e40 con 0x7fdd0406ae40 2023-11-18T20:42:31.259 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 5 to deep-scrub 2023-11-18T20:42:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd0406ae40 msgr2=0x7fdd0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd0406ae40 0x7fdd0406d300 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdd240aa4f0 tx=0x7fdd0c008040 comp rx=0 tx=0).stop 2023-11-18T20:42:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 msgr2=0x7fdd24152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd24152e40 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400caa0 tx=0x7fdd1400cf60 comp rx=0 tx=0).stop 2023-11-18T20:42:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 shutdown_connections 2023-11-18T20:42:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fdd0406ae40 0x7fdd0406d300 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd240c5f30 0x7fdd240a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd240c31b0 0x7fdd24153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 --2- 172.21.15.132:0/1780267768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd240c1a90 0x7fdd24152e40 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 >> 172.21.15.132:0/1780267768 conn(0x7fdd240a9b70 msgr2=0x7fdd24155390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 shutdown_connections 2023-11-18T20:42:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.260+0000 7fdd293d5640 1 -- 172.21.15.132:0/1780267768 wait complete. 2023-11-18T20:42:31.280 INFO:tasks.ceph:Scrubbing osd.6 2023-11-18T20:42:31.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-18T20:42:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.495+0000 7f97740f2640 1 Processor -- start 2023-11-18T20:42:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.495+0000 7f97740f2640 1 -- start start 2023-11-18T20:42:31.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.496+0000 7f97740f2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f976c072530 0x7f976c0c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f97740f2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c0c0980 con 0x7f976c071f70 2023-11-18T20:42:31.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f97740f2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c06c070 con 0x7f976c14fa80 2023-11-18T20:42:31.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f97740f2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c06d160 con 0x7f976c072530 2023-11-18T20:42:31.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f977268f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f976c071f70 0x7f976c0c2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36318/0 (socket says 172.21.15.132:36318) 2023-11-18T20:42:31.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f977268f640 1 -- 172.21.15.132:0/2347190925 learned_addr learned my addr 172.21.15.132:0/2347190925 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:31.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f977168d640 1 --2- 172.21.15.132:0/2347190925 >> v2:172.21.15.132:3300/0 conn(0x7f976c072530 0x7f976c0c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f9770e8c640 1 -- 172.21.15.132:0/2347190925 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706638833 0 0) 0x7f976c0c0980 con 0x7f976c071f70 2023-11-18T20:42:31.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f9770e8c640 1 -- 172.21.15.132:0/2347190925 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9758003520 con 0x7f976c071f70 2023-11-18T20:42:31.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.497+0000 7f977168d640 1 -- 172.21.15.132:0/2347190925 >> v1:172.21.15.161:6789/0 conn(0x7f976c14fa80 legacy=0x7f976c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.498+0000 7f977168d640 1 -- 172.21.15.132:0/2347190925 >> v1:172.21.15.132:6789/0 conn(0x7f976c071f70 legacy=0x7f976c0c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.498+0000 7f977168d640 1 -- 172.21.15.132:0/2347190925 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0c20d0 con 0x7f976c072530 2023-11-18T20:42:31.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.499+0000 7f977168d640 1 --2- 172.21.15.132:0/2347190925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c072530 0x7f976c0c5380 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f975c0097a0 tx=0x7f975c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdcbb8c29c77e73 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.499+0000 7f9770e8c640 1 -- 172.21.15.132:0/2347190925 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c030610 con 0x7f976c072530 2023-11-18T20:42:31.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.499+0000 7f9770e8c640 1 -- 172.21.15.132:0/2347190925 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c030770 con 0x7f976c072530 2023-11-18T20:42:31.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.499+0000 7f9770e8c640 1 -- 172.21.15.132:0/2347190925 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c030b00 con 0x7f976c072530 2023-11-18T20:42:31.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.500+0000 7f97740f2640 1 -- 172.21.15.132:0/2347190925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c072530 msgr2=0x7f976c0c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.500+0000 7f97740f2640 1 --2- 172.21.15.132:0/2347190925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c072530 0x7f976c0c5380 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f975c0097a0 tx=0x7f975c02b960 comp rx=0 tx=0).stop 2023-11-18T20:42:31.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.500+0000 7f97740f2640 1 -- 172.21.15.132:0/2347190925 shutdown_connections 2023-11-18T20:42:31.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.500+0000 7f97740f2640 1 --2- 172.21.15.132:0/2347190925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c072530 0x7f976c0c5380 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.500+0000 7f97740f2640 1 -- 172.21.15.132:0/2347190925 >> 172.21.15.132:0/2347190925 conn(0x7f976c0c5bc0 msgr2=0x7f976c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:31.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.500+0000 7f97740f2640 1 -- 172.21.15.132:0/2347190925 shutdown_connections 2023-11-18T20:42:31.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.500+0000 7f97740f2640 1 -- 172.21.15.132:0/2347190925 wait complete. 2023-11-18T20:42:31.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.502+0000 7f97740f2640 1 Processor -- start 2023-11-18T20:42:31.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.502+0000 7f97740f2640 1 -- start start 2023-11-18T20:42:31.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f97740f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c071f70 0x7f976c151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f97740f2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f976c072530 0x7f976c1edc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f97740f2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f976c14fa80 0x7f976c0bf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f97740f2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c150ef0 con 0x7f976c071f70 2023-11-18T20:42:31.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f97740f2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1ee150 con 0x7f976c14fa80 2023-11-18T20:42:31.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f97740f2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c146cf0 con 0x7f976c072530 2023-11-18T20:42:31.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f9771e8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c071f70 0x7f976c151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f9771e8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c071f70 0x7f976c151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42962/0 (socket says 172.21.15.132:42962) 2023-11-18T20:42:31.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f9771e8e640 1 -- 172.21.15.132:0/4018086020 learned_addr learned my addr 172.21.15.132:0/4018086020 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:31.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f9771e8e640 1 -- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f976c072530 msgr2=0x7f976c1edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f9771e8e640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f976c072530 0x7f976c1edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f9771e8e640 1 -- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f976c14fa80 msgr2=0x7f976c0bf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f9771e8e640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f976c14fa80 0x7f976c0bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.503+0000 7f9771e8e640 1 -- 172.21.15.132:0/4018086020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c009400 con 0x7f976c071f70 2023-11-18T20:42:31.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.504+0000 7f9771e8e640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c071f70 0x7f976c151fd0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f976800c400 tx=0x7f976800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.504+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680052d0 con 0x7f976c071f70 2023-11-18T20:42:31.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.504+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9768005430 con 0x7f976c071f70 2023-11-18T20:42:31.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.504+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768003830 con 0x7f976c071f70 2023-11-18T20:42:31.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.504+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c1e9fb0 con 0x7f976c071f70 2023-11-18T20:42:31.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.504+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c150600 con 0x7f976c071f70 2023-11-18T20:42:31.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.505+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f976c14cee0 con 0x7f976c071f70 2023-11-18T20:42:31.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.506+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9768003990 con 0x7f976c071f70 2023-11-18T20:42:31.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.507+0000 7f97627fc640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f975006ae40 0x7f975006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.507+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f97680888a0 con 0x7f976c071f70 2023-11-18T20:42:31.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.507+0000 7f97627fc640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f9750070d40 0x7f9750073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.507+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 --> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9750073810 con 0x7f9750070d40 2023-11-18T20:42:31.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.507+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f976808d2c0 con 0x7f976c071f70 2023-11-18T20:42:31.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.507+0000 7f977168d640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f975006ae40 0x7f975006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.508+0000 7f977268f640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f9750070d40 0x7f9750073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.509+0000 7f977268f640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f9750070d40 0x7f9750073160 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.509+0000 7f977168d640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f975006ae40 0x7f975006d300 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f975c036000 tx=0x7f975c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.511+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 <== osd.6 v2:172.21.15.161:6824/176202877 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9750073810 con 0x7f9750070d40 2023-11-18T20:42:31.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.525+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 --> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f976c0c47c0 con 0x7f9750070d40 2023-11-18T20:42:31.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.526+0000 7f97627fc640 1 -- 172.21.15.132:0/4018086020 <== osd.6 v2:172.21.15.161:6824/176202877 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f976c0c47c0 con 0x7f9750070d40 2023-11-18T20:42:31.528 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:42:31.528 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T20:42:31.528 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:42:31.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f9750070d40 msgr2=0x7f9750073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6824/176202877,v1:172.21.15.161:6825/176202877] conn(0x7f9750070d40 0x7f9750073160 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f975006ae40 msgr2=0x7f975006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f975006ae40 0x7f975006d300 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f975c036000 tx=0x7f975c03b040 comp rx=0 tx=0).stop 2023-11-18T20:42:31.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c071f70 msgr2=0x7f976c151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 --2- 172.21.15.132:0/4018086020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f976c071f70 0x7f976c151fd0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f976800c400 tx=0x7f976800c8c0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f977268f640 1 -- 172.21.15.132:0/4018086020 reap_dead start 2023-11-18T20:42:31.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 shutdown_connections 2023-11-18T20:42:31.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 >> 172.21.15.132:0/4018086020 conn(0x7f976c0c5bc0 msgr2=0x7f976c14e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:31.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 shutdown_connections 2023-11-18T20:42:31.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.527+0000 7f97740f2640 1 -- 172.21.15.132:0/4018086020 wait complete. 2023-11-18T20:42:31.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-18T20:42:31.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.754+0000 7eff9a400640 1 Processor -- start 2023-11-18T20:42:31.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.754+0000 7eff9a400640 1 -- start start 2023-11-18T20:42:31.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.755+0000 7eff9a400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff940a9b40 0x7eff940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.755+0000 7eff9a400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7eff940c1500 0x7eff940c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.755+0000 7eff9a400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff940c06c0 con 0x7eff94155490 2023-11-18T20:42:31.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.755+0000 7eff9a400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff940a5820 con 0x7eff940c1500 2023-11-18T20:42:31.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.755+0000 7eff9a400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff940c1020 con 0x7eff940a9b40 2023-11-18T20:42:31.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff93fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7eff94155490 0x7eff940a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36320/0 (socket says 172.21.15.132:36320) 2023-11-18T20:42:31.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff93fff640 1 -- 172.21.15.132:0/4112698858 learned_addr learned my addr 172.21.15.132:0/4112698858 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:31.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff9899d640 1 --2- 172.21.15.132:0/4112698858 >> v2:172.21.15.132:3300/0 conn(0x7eff940c1500 0x7eff940c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff8bfff640 1 --2- 172.21.15.132:0/4112698858 >> v2:172.21.15.161:3300/0 conn(0x7eff940a9b40 0x7eff940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff9899d640 1 -- 172.21.15.132:0/4112698858 >> v2:172.21.15.161:3300/0 conn(0x7eff940a9b40 msgr2=0x7eff940a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:31.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff9899d640 1 --2- 172.21.15.132:0/4112698858 >> v2:172.21.15.161:3300/0 conn(0x7eff940a9b40 0x7eff940a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff937fe640 1 -- 172.21.15.132:0/4112698858 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462320829 0 0) 0x7eff940c06c0 con 0x7eff94155490 2023-11-18T20:42:31.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff9899d640 1 -- 172.21.15.132:0/4112698858 >> v1:172.21.15.132:6789/0 conn(0x7eff94155490 legacy=0x7eff940a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.756+0000 7eff9899d640 1 -- 172.21.15.132:0/4112698858 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940c0910 con 0x7eff940c1500 2023-11-18T20:42:31.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.757+0000 7eff9899d640 1 --2- 172.21.15.132:0/4112698858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff940c1500 0x7eff940c24d0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7eff940a5160 tx=0x7eff8c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f00ff2538dab544 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff937fe640 1 -- 172.21.15.132:0/4112698858 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c02cc80 con 0x7eff940c1500 2023-11-18T20:42:31.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff937fe640 1 -- 172.21.15.132:0/4112698858 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c02cde0 con 0x7eff940c1500 2023-11-18T20:42:31.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff937fe640 1 -- 172.21.15.132:0/4112698858 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c034660 con 0x7eff940c1500 2023-11-18T20:42:31.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff9a400640 1 -- 172.21.15.132:0/4112698858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff940c1500 msgr2=0x7eff940c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff9a400640 1 --2- 172.21.15.132:0/4112698858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff940c1500 0x7eff940c24d0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7eff940a5160 tx=0x7eff8c02bed0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff9a400640 1 -- 172.21.15.132:0/4112698858 shutdown_connections 2023-11-18T20:42:31.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff9a400640 1 --2- 172.21.15.132:0/4112698858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff940c1500 0x7eff940c24d0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff9a400640 1 --2- 172.21.15.132:0/4112698858 >> v2:172.21.15.161:3300/0 conn(0x7eff940a9b40 0x7eff940a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff9a400640 1 -- 172.21.15.132:0/4112698858 >> 172.21.15.132:0/4112698858 conn(0x7eff9406a500 msgr2=0x7eff9406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:31.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff9a400640 1 -- 172.21.15.132:0/4112698858 shutdown_connections 2023-11-18T20:42:31.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.758+0000 7eff9a400640 1 -- 172.21.15.132:0/4112698858 wait complete. 2023-11-18T20:42:31.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.760+0000 7eff9a400640 1 Processor -- start 2023-11-18T20:42:31.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.760+0000 7eff9a400640 1 -- start start 2023-11-18T20:42:31.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9a400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff940c1500 0x7eff941eb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9a400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155490 0x7eff94150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9a400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff94150df0 0x7eff94150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9a400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff941ec2b0 con 0x7eff94150df0 2023-11-18T20:42:31.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9a400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff941df5d0 con 0x7eff94155490 2023-11-18T20:42:31.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9a400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff941ebfd0 con 0x7eff940c1500 2023-11-18T20:42:31.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9899d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff94150df0 0x7eff94150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9899d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff94150df0 0x7eff94150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42980/0 (socket says 172.21.15.132:42980) 2023-11-18T20:42:31.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.761+0000 7eff9899d640 1 -- 172.21.15.132:0/2960470853 learned_addr learned my addr 172.21.15.132:0/2960470853 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:31.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff93fff640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff940c1500 0x7eff941eb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff8bfff640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155490 0x7eff94150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff9899d640 1 -- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff940c1500 msgr2=0x7eff941eb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff9899d640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff940c1500 0x7eff941eb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff9899d640 1 -- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155490 msgr2=0x7eff94150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff9899d640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155490 0x7eff94150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff9899d640 1 -- 172.21.15.132:0/2960470853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c009a70 con 0x7eff94150df0 2023-11-18T20:42:31.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff9899d640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff94150df0 0x7eff94150780 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009e80 tx=0x7eff8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff917fa640 1 -- 172.21.15.132:0/2960470853 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c040650 con 0x7eff94150df0 2023-11-18T20:42:31.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff917fa640 1 -- 172.21.15.132:0/2960470853 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c0407b0 con 0x7eff94150df0 2023-11-18T20:42:31.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff917fa640 1 -- 172.21.15.132:0/2960470853 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c040b60 con 0x7eff94150df0 2023-11-18T20:42:31.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.762+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff941df260 con 0x7eff94150df0 2023-11-18T20:42:31.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.763+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff941ebab0 con 0x7eff94150df0 2023-11-18T20:42:31.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.764+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff941df0c0 con 0x7eff94150df0 2023-11-18T20:42:31.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.765+0000 7eff917fa640 1 -- 172.21.15.132:0/2960470853 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff8c040cc0 con 0x7eff94150df0 2023-11-18T20:42:31.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.766+0000 7eff917fa640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff7406ae40 0x7eff7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:31.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.766+0000 7eff917fa640 1 -- 172.21.15.132:0/2960470853 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7eff8c0ac0f0 con 0x7eff94150df0 2023-11-18T20:42:31.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.767+0000 7eff93fff640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff7406ae40 0x7eff7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:31.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.768+0000 7eff93fff640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff7406ae40 0x7eff7406d300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7eff84000f60 tx=0x7eff84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:31.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.770+0000 7eff917fa640 1 -- 172.21.15.132:0/2960470853 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff941df0c0 con 0x7eff94150df0 2023-11-18T20:42:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.959+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7eff940aa960 con 0x7eff7406ae40 2023-11-18T20:42:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.960+0000 7eff917fa640 1 -- 172.21.15.132:0/2960470853 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff940aa960 con 0x7eff7406ae40 2023-11-18T20:42:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 6 to deep-scrub 2023-11-18T20:42:31.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff7406ae40 msgr2=0x7eff7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff7406ae40 0x7eff7406d300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7eff84000f60 tx=0x7eff84009040 comp rx=0 tx=0).stop 2023-11-18T20:42:31.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff94150df0 msgr2=0x7eff94150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:31.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff94150df0 0x7eff94150780 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009e80 tx=0x7eff8c004a40 comp rx=0 tx=0).stop 2023-11-18T20:42:31.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 shutdown_connections 2023-11-18T20:42:31.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7eff7406ae40 0x7eff7406d300 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff94150df0 0x7eff94150780 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff94155490 0x7eff94150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 --2- 172.21.15.132:0/2960470853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff940c1500 0x7eff941eb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:31.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 >> 172.21.15.132:0/2960470853 conn(0x7eff9406a500 msgr2=0x7eff940c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:31.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 shutdown_connections 2023-11-18T20:42:31.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:31.963+0000 7eff9a400640 1 -- 172.21.15.132:0/2960470853 wait complete. 2023-11-18T20:42:31.990 INFO:tasks.ceph:Scrubbing osd.7 2023-11-18T20:42:31.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-18T20:42:32.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.200+0000 7f7486821640 1 Processor -- start 2023-11-18T20:42:32.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.201+0000 7f7486821640 1 -- start start 2023-11-18T20:42:32.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.202+0000 7f7486821640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f748014fa80 0x7f748006d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.202+0000 7f7486821640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7480071f70 0x7f74800c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.202+0000 7f7486821640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74800c0980 con 0x7f7480072530 2023-11-18T20:42:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.202+0000 7f7486821640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748006d160 con 0x7f7480071f70 2023-11-18T20:42:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.202+0000 7f7486821640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748006c070 con 0x7f748014fa80 2023-11-18T20:42:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.202+0000 7f7484dbe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7480071f70 0x7f74800c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.203+0000 7f7484dbe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7480071f70 0x7f74800c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42996/0 (socket says 172.21.15.132:42996) 2023-11-18T20:42:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.203+0000 7f7484dbe640 1 -- 172.21.15.132:0/3016477833 learned_addr learned my addr 172.21.15.132:0/3016477833 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.203+0000 7f747ffff640 1 --2- 172.21.15.132:0/3016477833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f748014fa80 0x7f748006d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.203+0000 7f7484dbe640 1 -- 172.21.15.132:0/3016477833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f748014fa80 msgr2=0x7f748006d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.203+0000 7f7484dbe640 1 --2- 172.21.15.132:0/3016477833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f748014fa80 0x7f748006d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.203+0000 7f7484dbe640 1 -- 172.21.15.132:0/3016477833 >> v1:172.21.15.161:6789/0 conn(0x7f7480072530 legacy=0x7f74800c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.203+0000 7f7484dbe640 1 -- 172.21.15.132:0/3016477833 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748006dc70 con 0x7f7480071f70 2023-11-18T20:42:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.203+0000 7f747ffff640 1 --2- 172.21.15.132:0/3016477833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f748014fa80 0x7f748006d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.204+0000 7f7484dbe640 1 --2- 172.21.15.132:0/3016477833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480071f70 0x7f74800c2610 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7478009e50 tx=0x7f747802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3f474cffc85a1e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.204+0000 7f747f7fe640 1 -- 172.21.15.132:0/3016477833 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747802c9e0 con 0x7f7480071f70 2023-11-18T20:42:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.204+0000 7f747f7fe640 1 -- 172.21.15.132:0/3016477833 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747802cb40 con 0x7f7480071f70 2023-11-18T20:42:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.204+0000 7f747f7fe640 1 -- 172.21.15.132:0/3016477833 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780343f0 con 0x7f7480071f70 2023-11-18T20:42:32.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.205+0000 7f7486821640 1 -- 172.21.15.132:0/3016477833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480071f70 msgr2=0x7f74800c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.205+0000 7f7486821640 1 --2- 172.21.15.132:0/3016477833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480071f70 0x7f74800c2610 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7478009e50 tx=0x7f747802be40 comp rx=0 tx=0).stop 2023-11-18T20:42:32.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.205+0000 7f7486821640 1 -- 172.21.15.132:0/3016477833 shutdown_connections 2023-11-18T20:42:32.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.205+0000 7f7486821640 1 --2- 172.21.15.132:0/3016477833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480071f70 0x7f74800c2610 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.205+0000 7f7486821640 1 --2- 172.21.15.132:0/3016477833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f748014fa80 0x7f748006d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.205+0000 7f7486821640 1 -- 172.21.15.132:0/3016477833 >> 172.21.15.132:0/3016477833 conn(0x7f74800c5bc0 msgr2=0x7f74800c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:32.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.205+0000 7f7486821640 1 -- 172.21.15.132:0/3016477833 shutdown_connections 2023-11-18T20:42:32.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.205+0000 7f7486821640 1 -- 172.21.15.132:0/3016477833 wait complete. 2023-11-18T20:42:32.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.207+0000 7f7486821640 1 Processor -- start 2023-11-18T20:42:32.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.207+0000 7f7486821640 1 -- start start 2023-11-18T20:42:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7486821640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7480071f70 0x7f74801ea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7486821640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7480072530 0x7f74800beff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7486821640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748014fa80 0x7f74801eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7486821640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7480146f60 con 0x7f748014fa80 2023-11-18T20:42:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7486821640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74800a62b0 con 0x7f7480071f70 2023-11-18T20:42:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7486821640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74800a5a10 con 0x7f7480072530 2023-11-18T20:42:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7484dbe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748014fa80 0x7f74801eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7484dbe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748014fa80 0x7f74801eda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43000/0 (socket says 172.21.15.132:43000) 2023-11-18T20:42:32.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7484dbe640 1 -- 172.21.15.132:0/3406944348 learned_addr learned my addr 172.21.15.132:0/3406944348 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:32.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7484dbe640 1 -- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7480072530 msgr2=0x7f74800beff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7484dbe640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7480072530 0x7f74800beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7484dbe640 1 -- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7480071f70 msgr2=0x7f74801ea610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7484dbe640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7480071f70 0x7f74801ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.209+0000 7f7484dbe640 1 -- 172.21.15.132:0/3406944348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7478009b30 con 0x7f748014fa80 2023-11-18T20:42:32.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.210+0000 7f7484dbe640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748014fa80 0x7f74801eda20 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f7478036040 tx=0x7f7478004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.210+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747803e450 con 0x7f748014fa80 2023-11-18T20:42:32.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.210+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747803e5d0 con 0x7f748014fa80 2023-11-18T20:42:32.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.210+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747803e980 con 0x7f748014fa80 2023-11-18T20:42:32.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.210+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74800a5cf0 con 0x7f748014fa80 2023-11-18T20:42:32.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.210+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74801ed500 con 0x7f748014fa80 2023-11-18T20:42:32.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.211+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74800c6540 con 0x7f748014fa80 2023-11-18T20:42:32.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.212+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f747803eae0 con 0x7f748014fa80 2023-11-18T20:42:32.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.213+0000 7f747d7fa640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f746006ae40 0x7f746006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.213+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f74780ac1f0 con 0x7f748014fa80 2023-11-18T20:42:32.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.213+0000 7f747d7fa640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7f7460070d40 0x7f7460073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.213+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 --> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7460073810 con 0x7f7460070d40 2023-11-18T20:42:32.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.213+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74780ae7d0 con 0x7f748014fa80 2023-11-18T20:42:32.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.214+0000 7f747ffff640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f746006ae40 0x7f746006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.214+0000 7f7477fff640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7f7460070d40 0x7f7460073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.215+0000 7f747ffff640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f746006ae40 0x7f746006d300 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7470006fd0 tx=0x7f7470008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.215+0000 7f7477fff640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7f7460070d40 0x7f7460073160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.218+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 <== osd.7 v2:172.21.15.161:6808/2126116111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7460073810 con 0x7f7460070d40 2023-11-18T20:42:32.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.232+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 --> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f748014b380 con 0x7f7460070d40 2023-11-18T20:42:32.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.233+0000 7f747d7fa640 1 -- 172.21.15.132:0/3406944348 <== osd.7 v2:172.21.15.161:6808/2126116111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f748014b380 con 0x7f7460070d40 2023-11-18T20:42:32.234 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-11-18T20:42:32.235 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T20:42:32.235 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-11-18T20:42:32.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7f7460070d40 msgr2=0x7f7460073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6808/2126116111,v1:172.21.15.161:6809/2126116111] conn(0x7f7460070d40 0x7f7460073160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f746006ae40 msgr2=0x7f746006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f746006ae40 0x7f746006d300 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7470006fd0 tx=0x7f7470008040 comp rx=0 tx=0).stop 2023-11-18T20:42:32.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748014fa80 msgr2=0x7f74801eda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 --2- 172.21.15.132:0/3406944348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748014fa80 0x7f74801eda20 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f7478036040 tx=0x7f7478004a40 comp rx=0 tx=0).stop 2023-11-18T20:42:32.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7484dbe640 1 -- 172.21.15.132:0/3406944348 reap_dead start 2023-11-18T20:42:32.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 shutdown_connections 2023-11-18T20:42:32.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 >> 172.21.15.132:0/3406944348 conn(0x7f74800c5bc0 msgr2=0x7f74800c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:32.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 shutdown_connections 2023-11-18T20:42:32.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.234+0000 7f7486821640 1 -- 172.21.15.132:0/3406944348 wait complete. 2023-11-18T20:42:32.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-18T20:42:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.454+0000 7f06e32f8640 1 Processor -- start 2023-11-18T20:42:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.454+0000 7f06e32f8640 1 -- start start 2023-11-18T20:42:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.456+0000 7f06e32f8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06dc158170 0x7f06dc0c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.456+0000 7f06e32f8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0c54e0 con 0x7f06dc0bf010 2023-11-18T20:42:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.456+0000 7f06e32f8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc158610 con 0x7f06dc151d10 2023-11-18T20:42:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.456+0000 7f06e32f8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0bfed0 con 0x7f06dc158170 2023-11-18T20:42:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.456+0000 7f06e1af5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f06dc0bf010 0x7f06dc157a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36324/0 (socket says 172.21.15.132:36324) 2023-11-18T20:42:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.456+0000 7f06e1af5640 1 -- 172.21.15.132:0/3799451020 learned_addr learned my addr 172.21.15.132:0/3799451020 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.457+0000 7f06e2af7640 1 --2- 172.21.15.132:0/3799451020 >> v2:172.21.15.161:3300/0 conn(0x7f06dc158170 0x7f06dc0c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.457+0000 7f06e12f4640 1 -- 172.21.15.132:0/3799451020 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457356673 0 0) 0x7f06dc0c54e0 con 0x7f06dc0bf010 2023-11-18T20:42:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.457+0000 7f06e12f4640 1 -- 172.21.15.132:0/3799451020 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c8003520 con 0x7f06dc0bf010 2023-11-18T20:42:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.458+0000 7f06e2af7640 1 -- 172.21.15.132:0/3799451020 >> v1:172.21.15.161:6789/0 conn(0x7f06dc151d10 legacy=0x7f06dc0c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.458+0000 7f06e2af7640 1 -- 172.21.15.132:0/3799451020 >> v1:172.21.15.132:6789/0 conn(0x7f06dc0bf010 legacy=0x7f06dc157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.458+0000 7f06e2af7640 1 -- 172.21.15.132:0/3799451020 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0c5780 con 0x7f06dc158170 2023-11-18T20:42:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.459+0000 7f06e2af7640 1 --2- 172.21.15.132:0/3799451020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc158170 0x7f06dc0c4e90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009d90 tx=0x7f06d402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72454319f95d70f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.460+0000 7f06e12f4640 1 -- 172.21.15.132:0/3799451020 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d402cc60 con 0x7f06dc158170 2023-11-18T20:42:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.460+0000 7f06e12f4640 1 -- 172.21.15.132:0/3799451020 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d402cdc0 con 0x7f06dc158170 2023-11-18T20:42:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.460+0000 7f06e12f4640 1 -- 172.21.15.132:0/3799451020 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4034660 con 0x7f06dc158170 2023-11-18T20:42:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.461+0000 7f06e32f8640 1 -- 172.21.15.132:0/3799451020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc158170 msgr2=0x7f06dc0c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.461+0000 7f06e32f8640 1 --2- 172.21.15.132:0/3799451020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc158170 0x7f06dc0c4e90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009d90 tx=0x7f06d402beb0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.461+0000 7f06e32f8640 1 -- 172.21.15.132:0/3799451020 shutdown_connections 2023-11-18T20:42:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.461+0000 7f06e32f8640 1 --2- 172.21.15.132:0/3799451020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc158170 0x7f06dc0c4e90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.461+0000 7f06e32f8640 1 -- 172.21.15.132:0/3799451020 >> 172.21.15.132:0/3799451020 conn(0x7f06dc0c67c0 msgr2=0x7f06dc0c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.461+0000 7f06e32f8640 1 -- 172.21.15.132:0/3799451020 shutdown_connections 2023-11-18T20:42:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.461+0000 7f06e32f8640 1 -- 172.21.15.132:0/3799451020 wait complete. 2023-11-18T20:42:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.462+0000 7f06e32f8640 1 Processor -- start 2023-11-18T20:42:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.463+0000 7f06e32f8640 1 -- start start 2023-11-18T20:42:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.463+0000 7f06e32f8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06dc0bf010 0x7f06dc153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.463+0000 7f06e32f8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc151d10 0x7f06dc1edb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.463+0000 7f06e32f8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06dc158170 0x7f06dc0a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.463+0000 7f06e32f8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1ee060 con 0x7f06dc158170 2023-11-18T20:42:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.463+0000 7f06e32f8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1e9eb0 con 0x7f06dc151d10 2023-11-18T20:42:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.463+0000 7f06e32f8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1e9ba0 con 0x7f06dc0bf010 2023-11-18T20:42:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e2af7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06dc158170 0x7f06dc0a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e2af7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06dc158170 0x7f06dc0a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43008/0 (socket says 172.21.15.132:43008) 2023-11-18T20:42:32.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e2af7640 1 -- 172.21.15.132:0/1760268930 learned_addr learned my addr 172.21.15.132:0/1760268930 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:32.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e1af5640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc151d10 0x7f06dc1edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e22f6640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06dc0bf010 0x7f06dc153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e2af7640 1 -- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06dc0bf010 msgr2=0x7f06dc153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e2af7640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06dc0bf010 0x7f06dc153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e2af7640 1 -- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc151d10 msgr2=0x7f06dc1edb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e2af7640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc151d10 0x7f06dc1edb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.464+0000 7f06e2af7640 1 -- 172.21.15.132:0/1760268930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4009a70 con 0x7f06dc158170 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.465+0000 7f06e2af7640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06dc158170 0x7f06dc0a9db0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009eb0 tx=0x7f06d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.465+0000 7f06d2ffd640 1 -- 172.21.15.132:0/1760268930 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d403e610 con 0x7f06dc158170 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.465+0000 7f06d2ffd640 1 -- 172.21.15.132:0/1760268930 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d403e770 con 0x7f06dc158170 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.465+0000 7f06d2ffd640 1 -- 172.21.15.132:0/1760268930 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d403eb20 con 0x7f06dc158170 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.465+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc149c10 con 0x7f06dc158170 2023-11-18T20:42:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.465+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc14a1d0 con 0x7f06dc158170 2023-11-18T20:42:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.466+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc14a360 con 0x7f06dc158170 2023-11-18T20:42:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.467+0000 7f06d2ffd640 1 -- 172.21.15.132:0/1760268930 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06d403b050 con 0x7f06dc158170 2023-11-18T20:42:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.468+0000 7f06d2ffd640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.468+0000 7f06d2ffd640 1 -- 172.21.15.132:0/1760268930 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f06d40abb80 con 0x7f06dc158170 2023-11-18T20:42:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.469+0000 7f06e22f6640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.470+0000 7f06e22f6640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06c006ae40 0x7f06c006d300 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f06d80015a0 tx=0x7f06d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.472+0000 7f06d2ffd640 1 -- 172.21.15.132:0/1760268930 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06d4076f60 con 0x7f06dc158170 2023-11-18T20:42:32.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.663+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f06dc1520f0 con 0x7f06c006ae40 2023-11-18T20:42:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.664+0000 7f06d2ffd640 1 -- 172.21.15.132:0/1760268930 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06d800d4a0 con 0x7f06c006ae40 2023-11-18T20:42:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 7 to deep-scrub 2023-11-18T20:42:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.666+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06c006ae40 msgr2=0x7f06c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.666+0000 7f06e32f8640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06c006ae40 0x7f06c006d300 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f06d80015a0 tx=0x7f06d8009040 comp rx=0 tx=0).stop 2023-11-18T20:42:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06dc158170 msgr2=0x7f06dc0a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06dc158170 0x7f06dc0a9db0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009eb0 tx=0x7f06d4004a40 comp rx=0 tx=0).stop 2023-11-18T20:42:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 shutdown_connections 2023-11-18T20:42:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06dc158170 0x7f06dc0a9db0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06dc151d10 0x7f06dc1edb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 --2- 172.21.15.132:0/1760268930 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06dc0bf010 0x7f06dc153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 >> 172.21.15.132:0/1760268930 conn(0x7f06dc0c67c0 msgr2=0x7f06dc14e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 shutdown_connections 2023-11-18T20:42:32.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.667+0000 7f06e32f8640 1 -- 172.21.15.132:0/1760268930 wait complete. 2023-11-18T20:42:32.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:42:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.898+0000 7f3719026640 1 Processor -- start 2023-11-18T20:42:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.898+0000 7f3719026640 1 -- start start 2023-11-18T20:42:32.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.899+0000 7f3719026640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3714155490 0x7f37140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.899+0000 7f3719026640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37140a9b40 0x7f37140c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f3719026640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37140c06c0 con 0x7f37140c1500 2023-11-18T20:42:32.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f3719026640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37140a5820 con 0x7f37140a9b40 2023-11-18T20:42:32.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f3719026640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37140c1020 con 0x7f3714155490 2023-11-18T20:42:32.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f371359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37140a9b40 0x7f37140c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f371359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37140a9b40 0x7f37140c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43016/0 (socket says 172.21.15.132:43016) 2023-11-18T20:42:32.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f371359e640 1 -- 172.21.15.132:0/1598371375 learned_addr learned my addr 172.21.15.132:0/1598371375 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:32.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f3712d9d640 1 --2- 172.21.15.132:0/1598371375 >> v2:172.21.15.161:3300/0 conn(0x7f3714155490 0x7f37140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f371359e640 1 -- 172.21.15.132:0/1598371375 >> v2:172.21.15.161:3300/0 conn(0x7f3714155490 msgr2=0x7f37140a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:32.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f371359e640 1 --2- 172.21.15.132:0/1598371375 >> v2:172.21.15.161:3300/0 conn(0x7f3714155490 0x7f37140a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f371359e640 1 -- 172.21.15.132:0/1598371375 >> v1:172.21.15.161:6789/0 conn(0x7f37140c1500 legacy=0x7f37140a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:32.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f371359e640 1 -- 172.21.15.132:0/1598371375 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140c0910 con 0x7f37140a9b40 2023-11-18T20:42:32.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.900+0000 7f3712d9d640 1 --2- 172.21.15.132:0/1598371375 >> v2:172.21.15.161:3300/0 conn(0x7f3714155490 0x7f37140a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:32.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.902+0000 7f371359e640 1 --2- 172.21.15.132:0/1598371375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37140a9b40 0x7f37140c24d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f371406dff0 tx=0x7f370c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e95a5ffcb38a8b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.902+0000 7f3711d9b640 1 -- 172.21.15.132:0/1598371375 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c02ca80 con 0x7f37140a9b40 2023-11-18T20:42:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.902+0000 7f3711d9b640 1 -- 172.21.15.132:0/1598371375 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c02cbe0 con 0x7f37140a9b40 2023-11-18T20:42:32.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.902+0000 7f3711d9b640 1 -- 172.21.15.132:0/1598371375 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c0343f0 con 0x7f37140a9b40 2023-11-18T20:42:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.903+0000 7f3719026640 1 -- 172.21.15.132:0/1598371375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37140a9b40 msgr2=0x7f37140c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.903+0000 7f3719026640 1 --2- 172.21.15.132:0/1598371375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37140a9b40 0x7f37140c24d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f371406dff0 tx=0x7f370c02bee0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.903+0000 7f3719026640 1 -- 172.21.15.132:0/1598371375 shutdown_connections 2023-11-18T20:42:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.903+0000 7f3719026640 1 --2- 172.21.15.132:0/1598371375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37140a9b40 0x7f37140c24d0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.903+0000 7f3719026640 1 --2- 172.21.15.132:0/1598371375 >> v2:172.21.15.161:3300/0 conn(0x7f3714155490 0x7f37140a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.903+0000 7f3719026640 1 -- 172.21.15.132:0/1598371375 >> 172.21.15.132:0/1598371375 conn(0x7f371406a500 msgr2=0x7f371406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.903+0000 7f3719026640 1 -- 172.21.15.132:0/1598371375 shutdown_connections 2023-11-18T20:42:32.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.903+0000 7f3719026640 1 -- 172.21.15.132:0/1598371375 wait complete. 2023-11-18T20:42:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.905+0000 7f3719026640 1 Processor -- start 2023-11-18T20:42:32.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.905+0000 7f3719026640 1 -- start start 2023-11-18T20:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f3719026640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37140c1500 0x7f3714153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f3719026640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3714155490 0x7f371414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f3719026640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f371414c040 0x7f371406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f3719026640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371414e320 con 0x7f371414c040 2023-11-18T20:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f3719026640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714071190 con 0x7f3714155490 2023-11-18T20:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f3719026640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37141edc50 con 0x7f37140c1500 2023-11-18T20:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f371414c040 0x7f371406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f371414c040 0x7f371406fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43026/0 (socket says 172.21.15.132:43026) 2023-11-18T20:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371359e640 1 -- 172.21.15.132:0/1036235462 learned_addr learned my addr 172.21.15.132:0/1036235462 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371359e640 1 -- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37140c1500 msgr2=0x7f3714153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371359e640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37140c1500 0x7f3714153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371359e640 1 -- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3714155490 msgr2=0x7f371414bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371259c640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3714155490 0x7f371414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371359e640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3714155490 0x7f371414bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.906+0000 7f371359e640 1 -- 172.21.15.132:0/1036235462 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c009b30 con 0x7f371414c040 2023-11-18T20:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.907+0000 7f371359e640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f371414c040 0x7f371406fda0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f370c036040 tx=0x7f370c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.907+0000 7f36fb7fe640 1 -- 172.21.15.132:0/1036235462 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c03e450 con 0x7f371414c040 2023-11-18T20:42:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.907+0000 7f36fb7fe640 1 -- 172.21.15.132:0/1036235462 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c03e5d0 con 0x7f371414c040 2023-11-18T20:42:33.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.907+0000 7f36fb7fe640 1 -- 172.21.15.132:0/1036235462 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c03e980 con 0x7f371414c040 2023-11-18T20:42:33.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.907+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3714071430 con 0x7f371414c040 2023-11-18T20:42:33.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.907+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371414e590 con 0x7f371414c040 2023-11-18T20:42:33.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.908+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3714068350 con 0x7f371414c040 2023-11-18T20:42:33.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.909+0000 7f36fb7fe640 1 -- 172.21.15.132:0/1036235462 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f370c02cd50 con 0x7f371414c040 2023-11-18T20:42:33.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.910+0000 7f36fb7fe640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f370006ae40 0x7f370006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:33.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.910+0000 7f36fb7fe640 1 -- 172.21.15.132:0/1036235462 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f370c0abf30 con 0x7f371414c040 2023-11-18T20:42:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.911+0000 7f3712d9d640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f370006ae40 0x7f370006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.912+0000 7f3712d9d640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f370006ae40 0x7f370006d300 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3704006fd0 tx=0x7f3704008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:32.915+0000 7f36fb7fe640 1 -- 172.21.15.132:0/1036235462 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f370c077440 con 0x7f371414c040 2023-11-18T20:42:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.100+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3714155870 con 0x7f370006ae40 2023-11-18T20:42:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.106+0000 7f36fb7fe640 1 -- 172.21.15.132:0/1036235462 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48412 (secure 0 0 0) 0x7f370400c7d0 con 0x7f370006ae40 2023-11-18T20:42:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:33.395 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:42:33.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f370006ae40 msgr2=0x7f370006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:33.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f370006ae40 0x7f370006d300 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3704006fd0 tx=0x7f3704008040 comp rx=0 tx=0).stop 2023-11-18T20:42:33.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f371414c040 msgr2=0x7f371406fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:33.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f371414c040 0x7f371406fda0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f370c036040 tx=0x7f370c004a40 comp rx=0 tx=0).stop 2023-11-18T20:42:33.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 shutdown_connections 2023-11-18T20:42:33.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f370006ae40 0x7f370006d300 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:33.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f371414c040 0x7f371406fda0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:33.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3714155490 0x7f371414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:33.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.109+0000 7f3719026640 1 --2- 172.21.15.132:0/1036235462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37140c1500 0x7f3714153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:33.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.110+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 >> 172.21.15.132:0/1036235462 conn(0x7f371406a500 msgr2=0x7f37140a9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:33.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.110+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 shutdown_connections 2023-11-18T20:42:33.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:33.110+0000 7f3719026640 1 -- 172.21.15.132:0/1036235462 wait complete. 2023-11-18T20:42:33.398 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2023-11-18T20:42:32.742194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254992,"kb_used_data":9704,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719728,"statfs":{"total":773094113280,"available":772833001472,"internally_reserved":0,"allocated":9936896,"data_stored":5149184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.333281"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":224,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-18T20:42:22.542906+0000","last_change":"2023-11-18T20:37:54.324850+0000","last_active":"2023-11-18T20:42:22.542906+0000","last_peered":"2023-11-18T20:42:22.542906+0000","last_clean":"2023-11-18T20:42:22.542906+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:42:22.542906+0000","last_undegraded":"2023-11-18T20:42:22.542906+0000","last_fullsized":"2023-11-18T20:42:22.542906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:37:52.864858+0000","last_clean_scrub_stamp":"2023-11-18T20:37:52.864858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.018,"15min":1.0349999999999999},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4410000000000001,"5min":1.706,"15min":1.706},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.069,"15min":1.087},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5509999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.99299999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.1299999999999999,"15min":1.1870000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.367,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1990000000000001,"15min":1.242},"min":{"1min":0.66300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6379999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.107}]},{"osd":2,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.129,"5min":1.2589999999999999,"15min":1.2869999999999999},"min":{"1min":0.80900000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.0640000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2190000000000001,"15min":1.234},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9219999999999999,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.355,"15min":1.425},"min":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.7769999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.82799999999999996}]},{"osd":4,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.452,"15min":1.546},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.827,"5min":2.601,"15min":2.601},"last":1.22},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.407,"15min":1.5089999999999999},"min":{"1min":0.60099999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.615,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.51}]},{"osd":5,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.5149999999999999,"15min":1.593},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.865,"5min":3.02,"15min":3.02},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.601,"15min":1.6990000000000001},"min":{"1min":0.69199999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":3.488,"15min":3.488},"last":1.274}]},{"osd":6,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.677,"15min":1.7490000000000001},"min":{"1min":0.88900000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.2250000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.323},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6020000000000001,"15min":1.704},"min":{"1min":0.85799999999999998,"5min":0.502,"15min":0.502},"max":{"1min":2.4430000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.3979999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.999,"15min":0.97699999999999998},"min":{"1min":0.68899999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.99099999999999999,"15min":0.98699999999999999},"min":{"1min":0.65800000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5549999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.034,"15min":1.0109999999999999},"min":{"1min":0.70799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.7350000000000001,"5min":2.206,"15min":2.206},"last":0.997},{"interface":"front","average":{"1min":1.177,"5min":1.1539999999999999,"15min":1.157},"min":{"1min":0.74199999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.288}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.179,"15min":1.179},"min":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6579999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.181},{"interface":"front","average":{"1min":1.238,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.67400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9450000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0369999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.339},"min":{"1min":0.874,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.722,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.143},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2130000000000001,"15min":1.2010000000000001},"min":{"1min":0.70099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.891,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.871}]},{"osd":4,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.879,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.3759999999999999,"15min":1.375},"min":{"1min":0.65000000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.76,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.337}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.381,"15min":1.333},"min":{"1min":0.79000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.734,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5640000000000001,"15min":1.5389999999999999},"min":{"1min":0.76800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0939999999999999,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.468}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5800000000000001,"15min":1.5660000000000001},"min":{"1min":0.74299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1459999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.554,"15min":1.5189999999999999},"min":{"1min":0.84799999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.2589999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1687552,"data_stored":1086424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.143,"15min":1.179},"min":{"1min":0.67800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.522,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.127,"15min":1.113},"min":{"1min":0.74299999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.77200000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.054},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2330000000000001,"15min":1.3089999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.569,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.0049999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2529999999999999,"15min":1.359},"min":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.2130000000000001,"15min":1.208},"min":{"1min":0.82399999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.413}]},{"osd":3,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3979999999999999,"15min":1.478},"min":{"1min":0.75900000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6719999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.345},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3919999999999999,"15min":1.4390000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.95099999999999996}]},{"osd":4,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.361,"15min":1.397},"min":{"1min":0.78900000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.468,"15min":1.496},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.27,"15min":2.27},"last":1.552}]},{"osd":6,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.5449999999999999,"15min":1.6339999999999999},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.302},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.544,"15min":1.597},"min":{"1min":0.72299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":1.514}]},{"osd":7,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.6060000000000001,"15min":1.6519999999999999},"min":{"1min":0.67000000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.9730000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.6830000000000001,"15min":1.74},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.7380000000000004,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":1.4830000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0429999999999999,"15min":1.038},"min":{"1min":0.67100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.147,"5min":1.099,"15min":1.1040000000000001},"min":{"1min":0.64900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.9610000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.755}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.149,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.365},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.9179999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.198}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1559999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9430000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.274,"5min":1.306,"15min":1.383},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.0030000000000001,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.4330000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.177,"15min":1.2130000000000001},"min":{"1min":0.76300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.361,"15min":1.4650000000000001},"min":{"1min":0.84299999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.804,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.0800000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.60799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2160000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3680000000000001,"15min":1.4379999999999999},"min":{"1min":0.75,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.95,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.323}]},{"osd":6,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4510000000000001,"15min":1.5289999999999999},"min":{"1min":0.64900000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.863,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.569,"15min":1.605},"min":{"1min":0.86299999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.2970000000000002,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.4850000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4299999999999999,"15min":1.462},"min":{"1min":0.80200000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.5740000000000001,"15min":1.6240000000000001},"min":{"1min":0.71199999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.0190000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.98499999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.752},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0640000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.345,"5min":1.512,"15min":1.512},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95499999999999996,"15min":0.93999999999999995},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4810000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.4650000000000001,"5min":1.595,"15min":1.595},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.532,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":0.998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3500000000000001,"5min":1.675,"15min":1.675},"last":0.97899999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.161},"min":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7450000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.157},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2010000000000001,"15min":1.169},"min":{"1min":0.78000000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.056}]},{"osd":5,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8819999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.23,"15min":1.24},"min":{"1min":0.76900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5700000000000001,"5min":1.901,"15min":1.901},"last":0.90900000000000003}]},{"osd":6,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.282,"15min":1.268},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.321},"min":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.323,"15min":1.3420000000000001},"min":{"1min":0.92900000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.722,"5min":1.907,"15min":1.907},"last":1.083},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3500000000000001,"15min":1.3260000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.081,"15min":2.081},"last":1.2749999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.40300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.603,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.997,"5min":0.97599999999999998,"15min":1.024},"min":{"1min":0.52200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":2.081,"15min":2.081},"last":1.177}]},{"osd":1,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.85199999999999998},"min":{"1min":0.41899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2090000000000001,"5min":1.919,"15min":1.919},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.82799999999999996}]},{"osd":3,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0469999999999999,"15min":1.093},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4450000000000001,"5min":2.024,"15min":2.024},"last":1.298},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.522,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.361}]},{"osd":4,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.252,"15min":1.3109999999999999},"min":{"1min":0.68799999999999994,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9730000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.196,"15min":1.216},"min":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.244}]},{"osd":5,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2669999999999999,"15min":1.3080000000000001},"min":{"1min":0.83299999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.129,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.149},{"interface":"front","average":{"1min":1.391,"5min":1.379,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.2589999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.403}]},{"osd":6,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3320000000000001,"15min":1.427},"min":{"1min":0.79400000000000004,"5min":0.755,"15min":0.755},"max":{"1min":2.3119999999999998,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.448},{"interface":"front","average":{"1min":1.341,"5min":1.282,"15min":1.319},"min":{"1min":0.86199999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.3360000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3779999999999999,"15min":1.444},"min":{"1min":0.80400000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6419999999999999,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.4219999999999999},"min":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8759999999999999,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.4910000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542204,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1687552,"data_stored":1086424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.878},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.333,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.87},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.89700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4330000000000001,"5min":1.524,"15min":1.524},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.151,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4770000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.99199999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.603,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.202},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.999,"15min":1.0900000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1930000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.151,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.512,"5min":1.927,"15min":1.927},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3049999999999999,"15min":1.3999999999999999},"min":{"1min":0.77300000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.79,"5min":3.343,"15min":3.343},"last":1.3580000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.292,"15min":1.4350000000000001},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6000000000000001,"5min":3.206,"15min":3.206},"last":1.022},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2909999999999999,"15min":1.369},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7929999999999999,"5min":2.165,"15min":2.165},"last":1.073}]},{"osd":6,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3600000000000001,"15min":1.45},"min":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8700000000000001,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.298},{"interface":"front","average":{"1min":1.141,"5min":1.399,"15min":1.5429999999999999},"min":{"1min":0.82199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.905,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.177}]},{"osd":7,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.401,"15min":1.5589999999999999},"min":{"1min":0.72199999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.7410000000000001,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3740000000000001,"15min":1.4299999999999999},"min":{"1min":0.88700000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.956,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.1519999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.873,"15min":0.95199999999999996},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.468,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.92900000000000005,"15min":0.996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.522,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.88}]},{"osd":2,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.2210000000000001,"15min":1.552},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1839999999999999,"5min":14.169,"15min":14.169},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89700000000000002,"15min":0.93200000000000005},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.5780000000000001,"5min":2.173,"15min":2.173},"last":1.0189999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.2230000000000001,"15min":1.514},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.512,"5min":11.629,"15min":11.629},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.361},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4119999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.99299999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3120000000000001,"15min":1.4079999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.659,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3340000000000001,"15min":1.397},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.625,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.181}]},{"osd":5,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3879999999999999,"15min":1.5680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8120000000000001,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.635},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4419999999999999,"15min":1.6180000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1320000000000001,"5min":6.202,"15min":6.202},"last":1.3580000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.427,"15min":1.4570000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.73,"5min":5.085,"15min":5.085},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.504,"15min":1.6870000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.903,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.77}]},{"osd":7,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4670000000000001,"15min":1.605},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.9650000000000001,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.7150000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5349999999999999,"15min":1.7330000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.653,"5min":6.149,"15min":6.149},"last":1.595}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:42:33.402 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-18T20:37:52.864858+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=37, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=42, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T20:42:33.402 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-18T20:42:53.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T20:42:53.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.622+0000 7fb5e1ab4640 1 Processor -- start 2023-11-18T20:42:53.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.623+0000 7fb5e1ab4640 1 -- start start 2023-11-18T20:42:53.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.624+0000 7fb5e1ab4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc14fd30 0x7fb5dc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:53.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.624+0000 7fb5e1ab4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0c64a0 con 0x7fb5dc06d0a0 2023-11-18T20:42:53.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.624+0000 7fb5e1ab4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0c5c00 con 0x7fb5dc0c3ea0 2023-11-18T20:42:53.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.624+0000 7fb5e1ab4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c5ee0 con 0x7fb5dc14fd30 2023-11-18T20:42:53.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.624+0000 7fb5d3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb5dc06d0a0 0x7fb5dc0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52186/0 (socket says 172.21.15.132:52186) 2023-11-18T20:42:53.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.624+0000 7fb5d3fff640 1 -- 172.21.15.132:0/3684913709 learned_addr learned my addr 172.21.15.132:0/3684913709 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:53.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5db7fe640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc14fd30 0x7fb5dc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:53.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276917257 0 0) 0x7fb5dc0c64a0 con 0x7fb5dc06d0a0 2023-11-18T20:42:53.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c8003520 con 0x7fb5dc06d0a0 2023-11-18T20:42:53.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593076431 0 0) 0x7fb5c8003520 con 0x7fb5dc06d0a0 2023-11-18T20:42:53.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc14fd30 msgr2=0x7fb5dc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:53.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc14fd30 0x7fb5dc152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 >> v1:172.21.15.161:6789/0 conn(0x7fb5dc0c3ea0 legacy=0x7fb5dc0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:53.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0c61c0 con 0x7fb5dc06d0a0 2023-11-18T20:42:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2387227874 0 0) 0x7fb5c4001670 con 0x7fb5dc06d0a0 2023-11-18T20:42:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 >> v1:172.21.15.132:6789/0 conn(0x7fb5dc06d0a0 legacy=0x7fb5dc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc14fd30 0x7fb5c80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8003f70 0x7fb5c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5c8004d00 0x7fb5c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c5ee0 con 0x7fb5c8004d00 2023-11-18T20:42:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c800bac0 con 0x7fb5c8003f70 2023-11-18T20:42:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.625+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c800bc80 con 0x7fb5dc14fd30 2023-11-18T20:42:53.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.626+0000 7fb5dbfff640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5c8004d00 0x7fb5c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:53.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.626+0000 7fb5db7fe640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc14fd30 0x7fb5c80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:53.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.626+0000 7fb5d3fff640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8003f70 0x7fb5c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:53.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.626+0000 7fb5dbfff640 1 -- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc14fd30 msgr2=0x7fb5c80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:53.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.626+0000 7fb5dbfff640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc14fd30 0x7fb5c80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.626+0000 7fb5dbfff640 1 -- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8003f70 msgr2=0x7fb5c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:53.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.626+0000 7fb5dbfff640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8003f70 0x7fb5c80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.626+0000 7fb5dbfff640 1 -- 172.21.15.132:0/3684913709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8003520 con 0x7fb5c8004d00 2023-11-18T20:42:53.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.627+0000 7fb5dbfff640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5c8004d00 0x7fb5c8005180 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4001e50 tx=0x7fb5c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e04df4fcbca5e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:53.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.627+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4003b70 con 0x7fb5c8004d00 2023-11-18T20:42:53.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.627+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4003cd0 con 0x7fb5c8004d00 2023-11-18T20:42:53.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.627+0000 7fb5daffd640 1 -- 172.21.15.132:0/3684913709 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4005310 con 0x7fb5c8004d00 2023-11-18T20:42:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.628+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/3684913709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5c8004d00 msgr2=0x7fb5c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.628+0000 7fb5e1ab4640 1 --2- 172.21.15.132:0/3684913709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5c8004d00 0x7fb5c8005180 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4001e50 tx=0x7fb5c80057f0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.628+0000 7fb5dbfff640 1 -- 172.21.15.132:0/3684913709 reap_dead start 2023-11-18T20:42:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.628+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/3684913709 shutdown_connections 2023-11-18T20:42:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.628+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/3684913709 >> 172.21.15.132:0/3684913709 conn(0x7fb5dc06a500 msgr2=0x7fb5dc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.628+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/3684913709 shutdown_connections 2023-11-18T20:42:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.628+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/3684913709 wait complete. 2023-11-18T20:42:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.630+0000 7fb5e1ab4640 1 Processor -- start 2023-11-18T20:42:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.630+0000 7fb5e1ab4640 1 -- start start 2023-11-18T20:42:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5e1ab4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8004d00 0x7fb5dc0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5e1ab4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5dc1ea430 0x7fb5dc1dd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5e1ab4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc1dd6c0 0x7fb5dc1ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5e1ab4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc1dccf0 con 0x7fb5dc1ea430 2023-11-18T20:42:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5e1ab4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc1ea930 con 0x7fb5c8004d00 2023-11-18T20:42:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5e1ab4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc1eac10 con 0x7fb5dc1dd6c0 2023-11-18T20:42:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5d3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5dc1ea430 0x7fb5dc1dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5d3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5dc1ea430 0x7fb5dc1dd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49200/0 (socket says 172.21.15.132:49200) 2023-11-18T20:42:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.631+0000 7fb5d3fff640 1 -- 172.21.15.132:0/2229477510 learned_addr learned my addr 172.21.15.132:0/2229477510 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5dbfff640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc1dd6c0 0x7fb5dc1ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:53.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5db7fe640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8004d00 0x7fb5dc0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:53.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d3fff640 1 -- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc1dd6c0 msgr2=0x7fb5dc1ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:53.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d3fff640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc1dd6c0 0x7fb5dc1ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d3fff640 1 -- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8004d00 msgr2=0x7fb5dc0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:53.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d3fff640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8004d00 0x7fb5dc0bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d3fff640 1 -- 172.21.15.132:0/2229477510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc1eaef0 con 0x7fb5dc1ea430 2023-11-18T20:42:53.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5db7fe640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8004d00 0x7fb5dc0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:53.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d3fff640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5dc1ea430 0x7fb5dc1dd180 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400d750 tx=0x7fb5c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:53.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d8ff9640 1 -- 172.21.15.132:0/2229477510 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40074e0 con 0x7fb5dc1ea430 2023-11-18T20:42:53.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d8ff9640 1 -- 172.21.15.132:0/2229477510 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4007640 con 0x7fb5dc1ea430 2023-11-18T20:42:53.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5d8ff9640 1 -- 172.21.15.132:0/2229477510 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40049e0 con 0x7fb5dc1ea430 2023-11-18T20:42:53.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.632+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc1eb1d0 con 0x7fb5dc1ea430 2023-11-18T20:42:53.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.633+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc14dcf0 con 0x7fb5dc1ea430 2023-11-18T20:42:53.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.634+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc1dce60 con 0x7fb5dc1ea430 2023-11-18T20:42:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.635+0000 7fb5d8ff9640 1 -- 172.21.15.132:0/2229477510 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5c4004b40 con 0x7fb5dc1ea430 2023-11-18T20:42:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.635+0000 7fb5d8ff9640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5bc06ae70 0x7fb5bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.636+0000 7fb5d8ff9640 1 -- 172.21.15.132:0/2229477510 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb5c4088c90 con 0x7fb5dc1ea430 2023-11-18T20:42:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.636+0000 7fb5db7fe640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5bc06ae70 0x7fb5bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.637+0000 7fb5db7fe640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5bc06ae70 0x7fb5bc06d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc072880 tx=0x7fb5cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.640+0000 7fb5d8ff9640 1 -- 172.21.15.132:0/2229477510 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb5c4053fd0 con 0x7fb5dc1ea430 2023-11-18T20:42:53.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.829+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 --> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5dc0c4a40 con 0x7fb5bc06ae70 2023-11-18T20:42:53.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.835+0000 7fb5d8ff9640 1 -- 172.21.15.132:0/2229477510 <== mgr.4102 v2:172.21.15.161:6832/3584581377 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48473 (secure 0 0 0) 0x7fb5cc009690 con 0x7fb5bc06ae70 2023-11-18T20:42:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:53.837 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-11-18T20:42:53.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5bc06ae70 msgr2=0x7fb5bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:53.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5bc06ae70 0x7fb5bc06d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc072880 tx=0x7fb5cc008040 comp rx=0 tx=0).stop 2023-11-18T20:42:53.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5dc1ea430 msgr2=0x7fb5dc1dd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:53.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5dc1ea430 0x7fb5dc1dd180 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400d750 tx=0x7fb5c400dc10 comp rx=0 tx=0).stop 2023-11-18T20:42:53.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 shutdown_connections 2023-11-18T20:42:53.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7fb5bc06ae70 0x7fb5bc06d330 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5dc1dd6c0 0x7fb5dc1ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5dc1ea430 0x7fb5dc1dd180 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 --2- 172.21.15.132:0/2229477510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5c8004d00 0x7fb5dc0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:53.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 >> 172.21.15.132:0/2229477510 conn(0x7fb5dc06a500 msgr2=0x7fb5dc0c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:53.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 shutdown_connections 2023-11-18T20:42:53.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:53.838+0000 7fb5e1ab4640 1 -- 172.21.15.132:0/2229477510 wait complete. 2023-11-18T20:42:53.859 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2023-11-18T20:42:52.748882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254984,"kb_used_data":9704,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719736,"statfs":{"total":773094113280,"available":772833009664,"internally_reserved":0,"allocated":9936896,"data_stored":5149184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003847"},"pg_stats":[{"pgid":"1.0","version":"88'119","reported_seq":234,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-18T20:42:34.989961+0000","last_change":"2023-11-18T20:42:34.990034+0000","last_active":"2023-11-18T20:42:34.989961+0000","last_peered":"2023-11-18T20:42:34.989961+0000","last_clean":"2023-11-18T20:42:34.989961+0000","last_became_active":"2023-11-18T20:37:54.321855+0000","last_became_peered":"2023-11-18T20:37:54.321855+0000","last_unstale":"2023-11-18T20:42:34.989961+0000","last_undegraded":"2023-11-18T20:42:34.989961+0000","last_fullsized":"2023-11-18T20:42:34.989961+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'119","last_scrub_stamp":"2023-11-18T20:42:34.989760+0000","last_deep_scrub":"88'119","last_deep_scrub_stamp":"2023-11-18T20:42:34.989760+0000","last_clean_scrub_stamp":"2023-11-18T20:42:34.989760+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:57.145457+0000","scrub_duration":0.0129908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.018,"15min":1.0349999999999999},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4410000000000001,"5min":1.706,"15min":1.706},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.069,"15min":1.087},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5509999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.5189999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.1299999999999999,"15min":1.1870000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.367,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1990000000000001,"15min":1.242},"min":{"1min":0.66300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6379999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.198}]},{"osd":2,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.2589999999999999,"15min":1.2869999999999999},"min":{"1min":0.80900000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.3280000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2190000000000001,"15min":1.234},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9219999999999999,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.355,"15min":1.425},"min":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.7769999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.0660000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.452,"15min":1.546},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.827,"5min":2.601,"15min":2.601},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.407,"15min":1.5089999999999999},"min":{"1min":0.60099999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.615,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":1.0189999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.5149999999999999,"15min":1.593},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.865,"5min":3.02,"15min":3.02},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.601,"15min":1.6990000000000001},"min":{"1min":0.69199999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.774,"5min":3.488,"15min":3.488},"last":1.359}]},{"osd":6,"last update":"Sat Nov 18 20:42:01 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.677,"15min":1.7490000000000001},"min":{"1min":0.88900000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.2250000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.615},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6020000000000001,"15min":1.704},"min":{"1min":0.85799999999999998,"5min":0.502,"15min":0.502},"max":{"1min":2.4430000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.5760000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.999,"15min":0.97699999999999998},"min":{"1min":0.68899999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.99099999999999999,"15min":0.98699999999999999},"min":{"1min":0.65800000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5549999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.8380000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.034,"15min":1.0109999999999999},"min":{"1min":0.70799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.7350000000000001,"5min":2.206,"15min":2.206},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1539999999999999,"15min":1.157},"min":{"1min":0.74199999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.179,"15min":1.179},"min":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6579999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.238,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.67400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9450000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.649}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.339},"min":{"1min":0.874,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.722,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.895},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2130000000000001,"15min":1.2010000000000001},"min":{"1min":0.70099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.891,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.2390000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.879,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.3759999999999999,"15min":1.375},"min":{"1min":0.65000000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.76,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.736}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.381,"15min":1.333},"min":{"1min":0.79000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.734,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5640000000000001,"15min":1.5389999999999999},"min":{"1min":0.76800000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0939999999999999,"5min":5.3899999999999997,"15min":5.3899999999999997},"last":1.4319999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5800000000000001,"15min":1.5660000000000001},"min":{"1min":0.74299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1459999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.9470000000000001},{"interface":"front","average":{"1min":1.536,"5min":1.554,"15min":1.5189999999999999},"min":{"1min":0.84799999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.996,"5min":6.1769999999999996,"15min":6.1769999999999996},"last":1.6100000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542207,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1687552,"data_stored":1086424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.143,"15min":1.179},"min":{"1min":0.67800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.522,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.127,"15min":1.113},"min":{"1min":0.74299999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.3680000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2330000000000001,"15min":1.3089999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.569,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":1.302}]},{"osd":2,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2529999999999999,"15min":1.359},"min":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.2130000000000001,"15min":1.208},"min":{"1min":0.82399999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.337}]},{"osd":3,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3979999999999999,"15min":1.478},"min":{"1min":0.75900000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6719999999999999,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":1.214},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3919999999999999,"15min":1.4390000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.6180000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.361,"15min":1.397},"min":{"1min":0.78900000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.468,"15min":1.496},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.27,"15min":2.27},"last":1.4470000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.5449999999999999,"15min":1.6339999999999999},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.544,"15min":1.597},"min":{"1min":0.72299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":1.2529999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:42:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.6060000000000001,"15min":1.6519999999999999},"min":{"1min":0.67000000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.9730000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.6830000000000001,"15min":1.74},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.7380000000000004,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":1.679}]}]},{"osd":4,"up_from":14,"seq":60129542207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0429999999999999,"15min":1.038},"min":{"1min":0.67100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.139},{"interface":"front","average":{"1min":1.147,"5min":1.099,"15min":1.1040000000000001},"min":{"1min":0.64900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.9610000000000001,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.98399999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.149,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.387},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.9179999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.254}]},{"osd":2,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1559999999999999,"15min":1.2150000000000001},"min":{"1min":0.61299999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9430000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.306,"15min":1.383},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.0030000000000001,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.1799999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.177,"15min":1.2130000000000001},"min":{"1min":0.76300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.353},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.361,"15min":1.4650000000000001},"min":{"1min":0.84299999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.804,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.0349999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4319999999999999,"15min":1.456},"min":{"1min":0.60799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2160000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.3680000000000001,"15min":1.4379999999999999},"min":{"1min":0.75,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.95,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.0740000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4510000000000001,"15min":1.5289999999999999},"min":{"1min":0.64900000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.863,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.569,"15min":1.605},"min":{"1min":0.86299999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.2970000000000002,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.3140000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:42:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4299999999999999,"15min":1.462},"min":{"1min":0.80200000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.5740000000000001,"15min":1.6240000000000001},"min":{"1min":0.71199999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.0190000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.2849999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542208,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.752},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0640000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.872},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.345,"5min":1.512,"15min":1.512},"last":0.76700000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95499999999999996,"15min":0.93999999999999995},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4810000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.175},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.4650000000000001,"5min":1.595,"15min":1.595},"last":1.093}]},{"osd":2,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.5,"5min":0.443,"15min":0.443},"max":{"1min":1.532,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.379},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":0.998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3500000000000001,"5min":1.675,"15min":1.675},"last":1.0229999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.161},"min":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7450000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2010000000000001,"15min":1.169},"min":{"1min":0.78000000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.3169999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2509999999999999,"15min":1.2430000000000001},"min":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8819999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.246},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.23,"15min":1.24},"min":{"1min":0.76900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5700000000000001,"5min":1.901,"15min":1.901},"last":1.5489999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.282,"15min":1.268},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.508},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.321},"min":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.478}]},{"osd":7,"last update":"Sat Nov 18 20:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.323,"15min":1.3420000000000001},"min":{"1min":0.92900000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.722,"5min":1.907,"15min":1.907},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3500000000000001,"15min":1.3260000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.752,"5min":2.081,"15min":2.081},"last":1.421}]}]},{"osd":2,"up_from":14,"seq":60129542207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.40300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.603,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.997,"5min":0.97599999999999998,"15min":1.024},"min":{"1min":0.52200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":2.081,"15min":2.081},"last":1.0029999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.85199999999999998},"min":{"1min":0.41899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2090000000000001,"5min":1.919,"15min":1.919},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.599}]},{"osd":3,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0469999999999999,"15min":1.093},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4450000000000001,"5min":2.024,"15min":2.024},"last":1.179},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.522,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.454}]},{"osd":4,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.252,"15min":1.3109999999999999},"min":{"1min":0.68799999999999994,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9730000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.196,"15min":1.216},"min":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.123}]},{"osd":5,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2669999999999999,"15min":1.3080000000000001},"min":{"1min":0.83299999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.129,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.405},{"interface":"front","average":{"1min":1.391,"5min":1.379,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.2589999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.3400000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3320000000000001,"15min":1.427},"min":{"1min":0.79400000000000004,"5min":0.755,"15min":0.755},"max":{"1min":2.3119999999999998,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.282,"15min":1.319},"min":{"1min":0.86199999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.496}]},{"osd":7,"last update":"Sat Nov 18 20:41:56 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3779999999999999,"15min":1.444},"min":{"1min":0.80400000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6419999999999999,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.556},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.4219999999999999},"min":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8759999999999999,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.306}]}]},{"osd":1,"up_from":14,"seq":60129542208,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1687552,"data_stored":1086424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.878},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.333,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.89700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4330000000000001,"5min":1.524,"15min":1.524},"last":1.454}]},{"osd":2,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.151,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4770000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.4870000000000001}]},{"osd":3,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.603,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.999,"15min":1.0900000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1930000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.3089999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.151,"15min":1.202},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.512,"5min":1.927,"15min":1.927},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3049999999999999,"15min":1.3999999999999999},"min":{"1min":0.77300000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.79,"5min":3.343,"15min":3.343},"last":1.6499999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.292,"15min":1.4350000000000001},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6000000000000001,"5min":3.206,"15min":3.206},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2909999999999999,"15min":1.369},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7929999999999999,"5min":2.165,"15min":2.165},"last":1.6220000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3600000000000001,"15min":1.45},"min":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8700000000000001,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.597},{"interface":"front","average":{"1min":1.141,"5min":1.399,"15min":1.5429999999999999},"min":{"1min":0.82199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.905,"5min":3.2919999999999998,"15min":3.2919999999999998},"last":1.734}]},{"osd":7,"last update":"Sat Nov 18 20:41:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.401,"15min":1.5589999999999999},"min":{"1min":0.72199999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.7410000000000001,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3740000000000001,"15min":1.4299999999999999},"min":{"1min":0.88700000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.956,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.52}]}]},{"osd":0,"up_from":14,"seq":60129542207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1093632,"data_stored":496056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.873,"15min":0.95199999999999996},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.468,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.121},{"interface":"front","average":{"1min":0.88,"5min":0.92900000000000005,"15min":0.996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.522,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.091}]},{"osd":2,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.2210000000000001,"15min":1.552},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1839999999999999,"5min":14.169,"15min":14.169},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89700000000000002,"15min":0.93200000000000005},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.5780000000000001,"5min":2.173,"15min":2.173},"last":0.90400000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.2230000000000001,"15min":1.514},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.512,"5min":11.629,"15min":11.629},"last":1.304},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.361},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4119999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":1.2150000000000001}]},{"osd":4,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.3120000000000001,"15min":1.4079999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.659,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.375},{"interface":"front","average":{"1min":1.268,"5min":1.3340000000000001,"15min":1.397},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.625,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.2769999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3879999999999999,"15min":1.5680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8120000000000001,"5min":5.6150000000000002,"15min":5.6150000000000002},"last":1.512},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4419999999999999,"15min":1.6180000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1320000000000001,"5min":6.202,"15min":6.202},"last":1.474}]},{"osd":6,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.427,"15min":1.4570000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.73,"5min":5.085,"15min":5.085},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.504,"15min":1.6870000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.903,"5min":5.6760000000000002,"15min":5.6760000000000002},"last":1.248}]},{"osd":7,"last update":"Sat Nov 18 20:41:57 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4670000000000001,"15min":1.605},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.9650000000000001,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5349999999999999,"15min":1.7330000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.653,"5min":6.149,"15min":6.149},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T20:42:53.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-18T20:42:54.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.065+0000 7f3bc4db0640 1 Processor -- start 2023-11-18T20:42:54.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.065+0000 7f3bc4db0640 1 -- start start 2023-11-18T20:42:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.067+0000 7f3bc4db0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3bc006d0a0 0x7f3bc0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.067+0000 7f3bc4db0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bc00c3ea0 0x7f3bc00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.067+0000 7f3bc4db0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00c64a0 con 0x7f3bc014fd30 2023-11-18T20:42:54.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.067+0000 7f3bc4db0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00c5c00 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.067+0000 7f3bc4db0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00c5ee0 con 0x7f3bc006d0a0 2023-11-18T20:42:54.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bc00c3ea0 0x7f3bc00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbe59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3bc014fd30 0x7f3bc00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52202/0 (socket says 172.21.15.132:52202) 2023-11-18T20:42:54.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbe59c640 1 -- 172.21.15.132:0/120799813 learned_addr learned my addr 172.21.15.132:0/120799813 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-18T20:42:54.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbdd9b640 1 --2- 172.21.15.132:0/120799813 >> v2:172.21.15.161:3300/0 conn(0x7f3bc006d0a0 0x7f3bc0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbed9d640 1 -- 172.21.15.132:0/120799813 >> v2:172.21.15.161:3300/0 conn(0x7f3bc006d0a0 msgr2=0x7f3bc0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:54.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbed9d640 1 --2- 172.21.15.132:0/120799813 >> v2:172.21.15.161:3300/0 conn(0x7f3bc006d0a0 0x7f3bc0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbed9d640 1 -- 172.21.15.132:0/120799813 >> v1:172.21.15.132:6789/0 conn(0x7f3bc014fd30 legacy=0x7f3bc00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbed9d640 1 -- 172.21.15.132:0/120799813 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00c61c0 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.068+0000 7f3bbd59a640 1 -- 172.21.15.132:0/120799813 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655298758 0 0) 0x7f3bc00c64a0 con 0x7f3bc014fd30 2023-11-18T20:42:54.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.069+0000 7f3bbed9d640 1 --2- 172.21.15.132:0/120799813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc00c4330 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f3bc006b460 tx=0x7f3bb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7435200e46c46f23 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:54.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.069+0000 7f3bbd59a640 1 -- 172.21.15.132:0/120799813 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8031830 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bbd59a640 1 -- 172.21.15.132:0/120799813 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8031990 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bbd59a640 1 -- 172.21.15.132:0/120799813 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8031d20 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bc4db0640 1 -- 172.21.15.132:0/120799813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 msgr2=0x7f3bc00c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/120799813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc00c4330 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f3bc006b460 tx=0x7f3bb802b8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bc4db0640 1 -- 172.21.15.132:0/120799813 shutdown_connections 2023-11-18T20:42:54.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/120799813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc00c4330 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/120799813 >> v2:172.21.15.161:3300/0 conn(0x7f3bc006d0a0 0x7f3bc0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bc4db0640 1 -- 172.21.15.132:0/120799813 >> 172.21.15.132:0/120799813 conn(0x7f3bc006a500 msgr2=0x7f3bc006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:54.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bc4db0640 1 -- 172.21.15.132:0/120799813 shutdown_connections 2023-11-18T20:42:54.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.070+0000 7f3bc4db0640 1 -- 172.21.15.132:0/120799813 wait complete. 2023-11-18T20:42:54.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.072+0000 7f3bc4db0640 1 Processor -- start 2023-11-18T20:42:54.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.072+0000 7f3bc4db0640 1 -- start start 2023-11-18T20:42:54.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bc4db0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc006d0a0 0x7f3bc009a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bc4db0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc0153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bc4db0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc014fd30 0x7f3bc00a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bc4db0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc01569e0 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bc4db0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc006fda0 con 0x7f3bc014fd30 2023-11-18T20:42:54.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bc4db0640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc01eaac0 con 0x7f3bc006d0a0 2023-11-18T20:42:54.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bbdd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc0153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bbdd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc0153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49228/0 (socket says 172.21.15.132:49228) 2023-11-18T20:42:54.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.073+0000 7f3bbdd9b640 1 -- 172.21.15.132:0/143691454 learned_addr learned my addr 172.21.15.132:0/143691454 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:54.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbe59c640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc006d0a0 0x7f3bc009a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbed9d640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc014fd30 0x7f3bc00a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbdd9b640 1 -- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc006d0a0 msgr2=0x7f3bc009a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbdd9b640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc006d0a0 0x7f3bc009a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbdd9b640 1 -- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc014fd30 msgr2=0x7f3bc00a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbdd9b640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc014fd30 0x7f3bc00a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbdd9b640 1 -- 172.21.15.132:0/143691454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009400 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbed9d640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc014fd30 0x7f3bc00a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T20:42:54.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bbdd9b640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc0153f40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4007e30 tx=0x7f3bb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:54.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3baeffd640 1 -- 172.21.15.132:0/143691454 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4014620 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3baeffd640 1 -- 172.21.15.132:0/143691454 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb400ee90 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3baeffd640 1 -- 172.21.15.132:0/143691454 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40149c0 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.074+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc01eada0 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.075+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc00702d0 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.076+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc0070490 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.077+0000 7f3baeffd640 1 -- 172.21.15.132:0/143691454 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3bb4014b20 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.078+0000 7f3baeffd640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ba006ae40 0x7f3ba006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.078+0000 7f3baeffd640 1 -- 172.21.15.132:0/143691454 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3bb4089c40 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.079+0000 7f3bbe59c640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ba006ae40 0x7f3ba006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.080+0000 7f3bbe59c640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ba006ae40 0x7f3ba006d300 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0000f60 tx=0x7f3bb0007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:54.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.084+0000 7f3baeffd640 1 -- 172.21.15.132:0/143691454 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3bb4055020 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.277+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3bc0068350 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.284+0000 7f3baeffd640 1 -- 172.21.15.132:0/143691454 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3bb4058640 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.286+0000 7f3baeffd640 1 -- 172.21.15.132:0/143691454 <== mon.0 v2:172.21.15.132:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3bb4055020 con 0x7f3bc00c3ea0 2023-11-18T20:42:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ba006ae40 msgr2=0x7f3ba006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ba006ae40 0x7f3ba006d300 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0000f60 tx=0x7f3bb0007b50 comp rx=0 tx=0).stop 2023-11-18T20:42:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 msgr2=0x7f3bc0153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc0153f40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4007e30 tx=0x7f3bb400e4b0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 shutdown_connections 2023-11-18T20:42:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f3ba006ae40 0x7f3ba006d300 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc014fd30 0x7f3bc00a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc00c3ea0 0x7f3bc0153f40 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 --2- 172.21.15.132:0/143691454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bc006d0a0 0x7f3bc009a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 >> 172.21.15.132:0/143691454 conn(0x7f3bc006a500 msgr2=0x7f3bc00c30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:54.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 shutdown_connections 2023-11-18T20:42:54.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.288+0000 7f3bc4db0640 1 -- 172.21.15.132:0/143691454 wait complete. 2023-11-18T20:42:54.306 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-18T20:42:54.306 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:42:54.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.503+0000 7f76f5261640 1 Processor -- start 2023-11-18T20:42:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.503+0000 7f76f5261640 1 -- start start 2023-11-18T20:42:54.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.504+0000 7f76f5261640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f76f0155490 0x7f76f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.504+0000 7f76f5261640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76f00a9b40 0x7f76f00c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.504+0000 7f76f5261640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f00c06c0 con 0x7f76f00c1500 2023-11-18T20:42:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.504+0000 7f76f5261640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f00a5820 con 0x7f76f00a9b40 2023-11-18T20:42:54.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.504+0000 7f76f5261640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f00c1020 con 0x7f76f0155490 2023-11-18T20:42:54.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.505+0000 7f76ef7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76f00a9b40 0x7f76f00c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.505+0000 7f76ef7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76f00a9b40 0x7f76f00c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49230/0 (socket says 172.21.15.132:49230) 2023-11-18T20:42:54.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.505+0000 7f76ef7fe640 1 -- 172.21.15.132:0/2937236089 learned_addr learned my addr 172.21.15.132:0/2937236089 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:54.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.505+0000 7f76ef7fe640 1 -- 172.21.15.132:0/2937236089 >> v2:172.21.15.161:3300/0 conn(0x7f76f0155490 msgr2=0x7f76f00a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:54.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.505+0000 7f76ef7fe640 1 --2- 172.21.15.132:0/2937236089 >> v2:172.21.15.161:3300/0 conn(0x7f76f0155490 0x7f76f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.505+0000 7f76ef7fe640 1 -- 172.21.15.132:0/2937236089 >> v1:172.21.15.161:6789/0 conn(0x7f76f00c1500 legacy=0x7f76f00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:42:54.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.505+0000 7f76ef7fe640 1 -- 172.21.15.132:0/2937236089 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00c0910 con 0x7f76f00a9b40 2023-11-18T20:42:54.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.506+0000 7f76ef7fe640 1 --2- 172.21.15.132:0/2937236089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00a9b40 0x7f76f00c24d0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f76f006dff0 tx=0x7f76e802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b37aa33fa57fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:54.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76edffb640 1 -- 172.21.15.132:0/2937236089 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e802ca80 con 0x7f76f00a9b40 2023-11-18T20:42:54.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76edffb640 1 -- 172.21.15.132:0/2937236089 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f76e802cbe0 con 0x7f76f00a9b40 2023-11-18T20:42:54.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76edffb640 1 -- 172.21.15.132:0/2937236089 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80343f0 con 0x7f76f00a9b40 2023-11-18T20:42:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76f5261640 1 -- 172.21.15.132:0/2937236089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00a9b40 msgr2=0x7f76f00c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76f5261640 1 --2- 172.21.15.132:0/2937236089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00a9b40 0x7f76f00c24d0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f76f006dff0 tx=0x7f76e802bee0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76f5261640 1 -- 172.21.15.132:0/2937236089 shutdown_connections 2023-11-18T20:42:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76f5261640 1 --2- 172.21.15.132:0/2937236089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00a9b40 0x7f76f00c24d0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76f5261640 1 --2- 172.21.15.132:0/2937236089 >> v2:172.21.15.161:3300/0 conn(0x7f76f0155490 0x7f76f00a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.507+0000 7f76f5261640 1 -- 172.21.15.132:0/2937236089 >> 172.21.15.132:0/2937236089 conn(0x7f76f006a500 msgr2=0x7f76f006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.508+0000 7f76f5261640 1 -- 172.21.15.132:0/2937236089 shutdown_connections 2023-11-18T20:42:54.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.508+0000 7f76f5261640 1 -- 172.21.15.132:0/2937236089 wait complete. 2023-11-18T20:42:54.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.509+0000 7f76f5261640 1 Processor -- start 2023-11-18T20:42:54.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.509+0000 7f76f5261640 1 -- start start 2023-11-18T20:42:54.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76f5261640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00c1500 0x7f76f01534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76f5261640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76f0155490 0x7f76f014b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76f5261640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76f014dd20 0x7f76f0153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76f5261640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f01e0a10 con 0x7f76f00c1500 2023-11-18T20:42:54.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76f5261640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f014e470 con 0x7f76f0155490 2023-11-18T20:42:54.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76f5261640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f014e750 con 0x7f76f014dd20 2023-11-18T20:42:54.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00c1500 0x7f76f01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00c1500 0x7f76f01534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49240/0 (socket says 172.21.15.132:49240) 2023-11-18T20:42:54.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.510+0000 7f76eeffd640 1 -- 172.21.15.132:0/2271274194 learned_addr learned my addr 172.21.15.132:0/2271274194 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-18T20:42:54.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76ef7fe640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76f014dd20 0x7f76f0153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76eeffd640 1 -- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76f014dd20 msgr2=0x7f76f0153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76ee7fc640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76f0155490 0x7f76f014b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76eeffd640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76f014dd20 0x7f76f0153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76eeffd640 1 -- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76f0155490 msgr2=0x7f76f014b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76eeffd640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76f0155490 0x7f76f014b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76eeffd640 1 -- 172.21.15.132:0/2271274194 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8009b30 con 0x7f76f00c1500 2023-11-18T20:42:54.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76eeffd640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00c1500 0x7f76f01534d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f76e000b410 tx=0x7f76e000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:54.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76d77fe640 1 -- 172.21.15.132:0/2271274194 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0011830 con 0x7f76f00c1500 2023-11-18T20:42:54.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76d77fe640 1 -- 172.21.15.132:0/2271274194 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f76e00119b0 con 0x7f76f00c1500 2023-11-18T20:42:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.511+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f0152cd0 con 0x7f76f00c1500 2023-11-18T20:42:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.512+0000 7f76d77fe640 1 -- 172.21.15.132:0/2271274194 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0011d80 con 0x7f76f00c1500 2023-11-18T20:42:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.512+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f014bba0 con 0x7f76f00c1500 2023-11-18T20:42:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.513+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f0068350 con 0x7f76f00c1500 2023-11-18T20:42:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.514+0000 7f76d77fe640 1 -- 172.21.15.132:0/2271274194 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76e001a400 con 0x7f76f00c1500 2023-11-18T20:42:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.515+0000 7f76d77fe640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f76dc06ae70 0x7f76dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:42:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.515+0000 7f76d77fe640 1 -- 172.21.15.132:0/2271274194 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f76e00895d0 con 0x7f76f00c1500 2023-11-18T20:42:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.515+0000 7f76ee7fc640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f76dc06ae70 0x7f76dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:42:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.516+0000 7f76ee7fc640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f76dc06ae70 0x7f76dc06d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f76f01eb440 tx=0x7f76e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:42:54.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.519+0000 7f76d77fe640 1 -- 172.21.15.132:0/2271274194 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76e00547f0 con 0x7f76f00c1500 2023-11-18T20:42:54.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.730+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76f00a8900 con 0x7f76f00c1500 2023-11-18T20:42:54.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.731+0000 7f76d77fe640 1 -- 172.21.15.132:0/2271274194 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f76e0015020 con 0x7f76f00c1500 2023-11-18T20:42:54.733 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-18T20:42:54.733 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1795593250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1795593250},{"type":"v1","addr":"172.21.15.161:6835","nonce":1795593250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5353,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/4032254911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":4032254911},{"type":"v1","addr":"172.21.15.161:6837","nonce":4032254911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/4114136035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4114136035},{"type":"v1","addr":"172.21.15.132:6835","nonce":4114136035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":7251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/2515607745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2515607745},{"type":"v1","addr":"172.21.15.132:6834","nonce":2515607745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[]} 2023-11-18T20:42:54.733 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 54 2023-11-18T20:42:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f76dc06ae70 msgr2=0x7f76dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f76dc06ae70 0x7f76dc06d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f76f01eb440 tx=0x7f76e4009040 comp rx=0 tx=0).stop 2023-11-18T20:42:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00c1500 msgr2=0x7f76f01534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:42:54.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00c1500 0x7f76f01534d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f76e000b410 tx=0x7f76e000b8d0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 shutdown_connections 2023-11-18T20:42:54.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:6832/3584581377,v1:172.21.15.161:6833/3584581377] conn(0x7f76dc06ae70 0x7f76dc06d330 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76f014dd20 0x7f76f0153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76f0155490 0x7f76f014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 --2- 172.21.15.132:0/2271274194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f00c1500 0x7f76f01534d0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:42:54.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 >> 172.21.15.132:0/2271274194 conn(0x7f76f006a500 msgr2=0x7f76f00c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:42:54.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 shutdown_connections 2023-11-18T20:42:54.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-18T20:42:54.735+0000 7f76f5261640 1 -- 172.21.15.132:0/2271274194 wait complete. 2023-11-18T20:42:54.753 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-18T20:42:54.753 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-18T20:42:54.753 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-18T20:42:54.753 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:54.774 INFO:tasks.ceph.mds.a:Stopped 2023-11-18T20:42:54.774 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-18T20:42:54.774 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:54.843 INFO:tasks.ceph.mds.c:Stopped 2023-11-18T20:42:54.843 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-18T20:42:54.843 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:54.870 INFO:tasks.ceph.mds.b:Stopped 2023-11-18T20:42:54.871 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-18T20:42:54.871 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:54.930 INFO:tasks.ceph.mds.d:Stopped 2023-11-18T20:42:54.930 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-18T20:42:54.930 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-18T20:42:54.931 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:54.975 INFO:tasks.ceph.osd.0:Stopped 2023-11-18T20:42:54.975 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-18T20:42:54.975 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.019 INFO:tasks.ceph.osd.1:Stopped 2023-11-18T20:42:55.019 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-18T20:42:55.019 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.076 INFO:tasks.ceph.osd.2:Stopped 2023-11-18T20:42:55.076 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-18T20:42:55.076 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.123 INFO:tasks.ceph.osd.3:Stopped 2023-11-18T20:42:55.124 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-18T20:42:55.124 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.172 INFO:tasks.ceph.osd.4:Stopped 2023-11-18T20:42:55.173 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-18T20:42:55.173 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.232 INFO:tasks.ceph.osd.5:Stopped 2023-11-18T20:42:55.233 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-18T20:42:55.233 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.293 INFO:tasks.ceph.osd.6:Stopped 2023-11-18T20:42:55.294 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-18T20:42:55.294 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.370 INFO:tasks.ceph.osd.7:Stopped 2023-11-18T20:42:55.371 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-18T20:42:55.371 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-18T20:42:55.371 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.443 INFO:tasks.ceph.mgr.y:Stopped 2023-11-18T20:42:55.443 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-18T20:42:55.444 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.531 INFO:tasks.ceph.mgr.x:Stopped 2023-11-18T20:42:55.531 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-18T20:42:55.531 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-18T20:42:55.531 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.572 INFO:tasks.ceph.mon.a:Stopped 2023-11-18T20:42:55.572 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-18T20:42:55.572 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.608 INFO:tasks.ceph.mon.b:Stopped 2023-11-18T20:42:55.608 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-18T20:42:55.608 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T20:42:55.677 INFO:tasks.ceph.mon.c:Stopped 2023-11-18T20:42:55.677 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-18T20:42:55.678 DEBUG:teuthology.orchestra.run.smithi132:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-18T20:42:55.791 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:42:55.792 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-18T20:42:56.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:42:56.061 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-18T20:42:56.219 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:42:56.219 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-18T20:42:56.377 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:42:56.377 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-18T20:42:56.546 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:42:56.546 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-18T20:42:56.694 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:42:56.703 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:42:56.783 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:42:56.783 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-18T20:42:57.047 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:42:57.047 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-18T20:42:57.209 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:42:57.209 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-18T20:42:57.373 INFO:tasks.ceph:Archiving mon data... 2023-11-18T20:42:57.374 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/data/mon.a.tgz 2023-11-18T20:42:57.375 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-18T20:42:57.433 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.eOB7wcY8Co 2023-11-18T20:42:57.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eOB7wcY8Co 2023-11-18T20:42:57.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.eOB7wcY8Co 2023-11-18T20:42:57.801 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.eOB7wcY8Co is 477KB 2023-11-18T20:42:57.912 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.eOB7wcY8Co 2023-11-18T20:42:57.975 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/data/mon.b.tgz 2023-11-18T20:42:57.975 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-11-18T20:42:58.036 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.Vwhng04Lbc 2023-11-18T20:42:58.036 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Vwhng04Lbc 2023-11-18T20:42:58.326 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.Vwhng04Lbc 2023-11-18T20:42:58.487 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.Vwhng04Lbc is 608KB 2023-11-18T20:42:58.562 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.Vwhng04Lbc 2023-11-18T20:42:58.620 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/data/mon.c.tgz 2023-11-18T20:42:58.621 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-11-18T20:42:58.669 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.qNOnqnErXY 2023-11-18T20:42:58.670 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qNOnqnErXY 2023-11-18T20:42:58.899 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.qNOnqnErXY 2023-11-18T20:42:59.057 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.qNOnqnErXY is 608KB 2023-11-18T20:42:59.172 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.qNOnqnErXY 2023-11-18T20:42:59.231 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-18T20:42:59.231 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-18T20:42:59.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-18T20:42:59.337 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-18T20:42:59.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-18T20:42:59.345 DEBUG:teuthology.orchestra.run.smithi161:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-18T20:42:59.444 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-18T20:42:59.453 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-18T20:42:59.467 INFO:tasks.ceph:Archiving crash dumps... 2023-11-18T20:42:59.468 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/remote/smithi132/crash 2023-11-18T20:42:59.469 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-18T20:42:59.551 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/remote/smithi161/crash 2023-11-18T20:42:59.552 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-18T20:42:59.645 INFO:tasks.ceph:Shutting down logrotate 2023-11-18T20:42:59.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:42:59.654 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:42:59.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-18T20:42:59.877 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-18T20:42:59.977 INFO:tasks.ceph:Compressing logs... 2023-11-18T20:42:59.977 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-18T20:42:59.985 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-18T20:43:00.075 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110903.log 2023-11-18T20:43:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111264.log 2023-11-18T20:43:00.077 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92138.log 2023-11-18T20:43:00.078 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111264.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110903.log.gz 2023-11-18T20:43:00.079 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.100364.log 2023-11-18T20:43:00.079 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111264.log.gz 2023-11-18T20:43:00.079 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95006.log 2023-11-18T20:43:00.080 INFO:teuthology.orchestra.run.smithi132.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.92138.log.gz 2023-11-18T20:43:00.080 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-18T20:43:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.testuser.100364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.100364.log.gz 2023-11-18T20:43:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93902.log 2023-11-18T20:43:00.082 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86602.log 2023-11-18T20:43:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112219.log 2023-11-18T20:43:00.083 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95006.log.gz 2023-11-18T20:43:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108929.log 2023-11-18T20:43:00.083 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93902.log.gz 2023-11-18T20:43:00.084 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103999.log 2023-11-18T20:43:00.085 INFO:teuthology.orchestra.run.smithi132.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112219.log.gz 2023-11-18T20:43:00.085 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94454.log 2023-11-18T20:43:00.085 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.86602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94140.log 2023-11-18T20:43:00.086 INFO:teuthology.orchestra.run.smithi161.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.86602.log.gz 2023-11-18T20:43:00.086 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.94454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94454.log.gz 2023-11-18T20:43:00.086 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92870.log 2023-11-18T20:43:00.087 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108929.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108929.log.gz 2023-11-18T20:43:00.087 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104463.log 2023-11-18T20:43:00.087 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96371.log 2023-11-18T20:43:00.088 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103999.log.gz 2023-11-18T20:43:00.088 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113097.log 2023-11-18T20:43:00.088 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104463.log.gz 2023-11-18T20:43:00.090 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95384.log 2023-11-18T20:43:00.090 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96371.log.gz 2023-11-18T20:43:00.090 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92821.log 2023-11-18T20:43:00.090 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113097.log.gz 2023-11-18T20:43:00.091 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.94140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94140.log.gz 2023-11-18T20:43:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86882.log 2023-11-18T20:43:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.92870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92870.log.gz 2023-11-18T20:43:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.94958.log 2023-11-18T20:43:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.86882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92034.log 2023-11-18T20:43:00.092 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86882.log.gz 2023-11-18T20:43:00.092 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.testuser.94958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.94958.log.gz 2023-11-18T20:43:00.093 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94144.log 2023-11-18T20:43:00.093 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.92034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92034.log.gz 2023-11-18T20:43:00.093 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86762.log 2023-11-18T20:43:00.094 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.94144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94144.log.gz 2023-11-18T20:43:00.095 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93344.log 2023-11-18T20:43:00.095 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.86762.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.86642.log 2023-11-18T20:43:00.095 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86762.log.gz 2023-11-18T20:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95384.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-18T20:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95384.log.gz 2023-11-18T20:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.110701.log 2023-11-18T20:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92821.log.gz 2023-11-18T20:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104421.log 2023-11-18T20:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.testuser.110701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111089.log 2023-11-18T20:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.110701.log.gz 2023-11-18T20:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95426.log 2023-11-18T20:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104421.log.gz 2023-11-18T20:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97531.log 2023-11-18T20:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111089.log.gz 2023-11-18T20:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113055.log 2023-11-18T20:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95426.log.gz 2023-11-18T20:43:00.101 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97531.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97531.log.gz 2023-11-18T20:43:00.101 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98327.log 2023-11-18T20:43:00.102 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103472.log 2023-11-18T20:43:00.102 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113055.log.gz 2023-11-18T20:43:00.102 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99441.log 2023-11-18T20:43:00.102 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98327.log.gz 2023-11-18T20:43:00.102 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.103472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101826.log 2023-11-18T20:43:00.102 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103472.log.gz 2023-11-18T20:43:00.103 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.93344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93344.log.gz 2023-11-18T20:43:00.104 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86802.log 2023-11-18T20:43:00.104 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.86642.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-18T20:43:00.104 INFO:teuthology.orchestra.run.smithi161.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.86642.log.gz 2023-11-18T20:43:00.104 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.86802.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-18T20:43:00.104 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86802.log.gz 2023-11-18T20:43:00.104 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93675.log 2023-11-18T20:43:00.104 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-18T20:43:00.104 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.93675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93675.log.gz 2023-11-18T20:43:00.105 INFO:teuthology.orchestra.run.smithi161.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-18T20:43:00.105 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94450.log 2023-11-18T20:43:00.105 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.4.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-18T20:43:00.105 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92532.log 2023-11-18T20:43:00.107 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.94450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94450.log.gz 2023-11-18T20:43:00.108 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-18T20:43:00.108 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.92532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92532.log.gz 2023-11-18T20:43:00.108 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-18T20:43:00.108 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86842.log 2023-11-18T20:43:00.110 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99441.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99441.log.gz 2023-11-18T20:43:00.110 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106454.log 2023-11-18T20:43:00.110 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104295.log 2023-11-18T20:43:00.110 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101826.log.gz 2023-11-18T20:43:00.110 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109363.log 2023-11-18T20:43:00.111 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106454.log.gz 2023-11-18T20:43:00.111 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103468.log 2023-11-18T20:43:00.111 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104295.log.gz 2023-11-18T20:43:00.111 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95342.log 2023-11-18T20:43:00.111 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109363.log.gz 2023-11-18T20:43:00.111 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.103468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103468.log.gz 2023-11-18T20:43:00.111 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107230.log 2023-11-18T20:43:00.112 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95342.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95342.log.gz 2023-11-18T20:43:00.112 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105578.log 2023-11-18T20:43:00.112 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107230.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.108803.log 2023-11-18T20:43:00.112 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107230.log.gz 2023-11-18T20:43:00.116 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92866.log 2023-11-18T20:43:00.116 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.86842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92024.log 2023-11-18T20:43:00.116 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86842.log.gz 2023-11-18T20:43:00.116 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.92866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92866.log.gz 2023-11-18T20:43:00.116 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92528.log 2023-11-18T20:43:00.116 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.92024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92024.log.gz 2023-11-18T20:43:00.117 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-18T20:43:00.117 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.92528.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.1.92528.log.gz -5 2023-11-18T20:43:00.117 INFO:teuthology.orchestra.run.smithi161.stderr: --verbose -- /var/log/ceph/ceph-client.testuser.94962.log 2023-11-18T20:43:00.118 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111432.log 2023-11-18T20:43:00.119 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105578.log.gz 2023-11-18T20:43:00.119 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95510.log 2023-11-18T20:43:00.119 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108803.log.gz 2023-11-18T20:43:00.119 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97615.log 2023-11-18T20:43:00.119 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111432.log.gz 2023-11-18T20:43:00.119 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102613.log 2023-11-18T20:43:00.120 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95510.log.gz 2023-11-18T20:43:00.120 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106082.log 2023-11-18T20:43:00.120 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97615.log.gz 2023-11-18T20:43:00.120 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97013.log 2023-11-18T20:43:00.120 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102613.log.gz 2023-11-18T20:43:00.120 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104253.log 2023-11-18T20:43:00.120 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106082.log.gz 2023-11-18T20:43:00.121 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97013.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97013.log.gz -5 2023-11-18T20:43:00.121 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.103819.log 2023-11-18T20:43:00.121 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110819.log 2023-11-18T20:43:00.121 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104253.log.gz 2023-11-18T20:43:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93679.log 2023-11-18T20:43:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.testuser.94962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.94962.log.gz 2023-11-18T20:43:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-18T20:43:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.93679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93679.log.gz 2023-11-18T20:43:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86682.log 2023-11-18T20:43:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-18T20:43:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.86682.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-18T20:43:00.125 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86682.log.gz 2023-11-18T20:43:00.126 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113583.log 2023-11-18T20:43:00.126 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103819.log.gz 2023-11-18T20:43:00.127 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98709.log 2023-11-18T20:43:00.127 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110819.log.gz 2023-11-18T20:43:00.127 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111222.log 2023-11-18T20:43:00.127 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113583.log.gz 2023-11-18T20:43:00.127 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94880.log 2023-11-18T20:43:00.127 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98709.log.gz 2023-11-18T20:43:00.127 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111222.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111222.log.gz 2023-11-18T20:43:00.128 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92180.log 2023-11-18T20:43:00.128 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113139.log 2023-11-18T20:43:00.128 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94880.log.gz 2023-11-18T20:43:00.128 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92180.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92180.log.gz 2023-11-18T20:43:00.128 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93398.log 2023-11-18T20:43:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86722.log 2023-11-18T20:43:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93348.log 2023-11-18T20:43:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.86722.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86722.log.gz 2023-11-18T20:43:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.93348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93348.log.gz 2023-11-18T20:43:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-18T20:43:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-18T20:43:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113139.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113139.log.gz 2023-11-18T20:43:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102162.log 2023-11-18T20:43:00.133 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93398.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93398.log.gz 2023-11-18T20:43:00.134 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99525.log 2023-11-18T20:43:00.134 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102162.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.102162.log.gz 2023-11-18T20:43:00.134 INFO:teuthology.orchestra.run.smithi132.stderr: /var/log/ceph/ceph-client.admin.93356.log 2023-11-18T20:43:00.134 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99525.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99525.log.gz 2023-11-18T20:43:00.134 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93566.log 2023-11-18T20:43:00.134 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93356.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.93356.log.gz 2023-11-18T20:43:00.134 INFO:teuthology.orchestra.run.smithi132.stderr: /var/log/ceph/ceph-client.admin.103089.log 2023-11-18T20:43:00.134 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93566.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93566.log.gz 2023-11-18T20:43:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92805.log 2023-11-18T20:43:00.135 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101700.log 2023-11-18T20:43:00.135 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103089.log.gz 2023-11-18T20:43:00.136 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101615.log 89.1% 2023-11-18T20:43:00.136 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92805.log.gz 2023-11-18T20:43:00.137 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105872.log 2023-11-18T20:43:00.137 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101700.log.gz 2023-11-18T20:43:00.137 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101615.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101615.log.gz 2023-11-18T20:43:00.137 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112910.log 2023-11-18T20:43:00.138 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91418.log 2023-11-18T20:43:00.138 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105872.log.gz 2023-11-18T20:43:00.139 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112910.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112910.log.gz 2023-11-18T20:43:00.139 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93734.log 2023-11-18T20:43:00.139 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103905.log 2023-11-18T20:43:00.139 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91418.log.gz 2023-11-18T20:43:00.140 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93734.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93734.log.gz 2023-11-18T20:43:00.140 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104337.log 2023-11-18T20:43:00.141 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103905.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103905.log.gz 2023-11-18T20:43:00.141 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106040.log 2023-11-18T20:43:00.142 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104337.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104337.log.gz 2023-11-18T20:43:00.142 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112448.log 2023-11-18T20:43:00.143 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104989.log 2023-11-18T20:43:00.144 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106040.log.gz 2023-11-18T20:43:00.144 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112448.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112448.log.gz 2023-11-18T20:43:00.145 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96887.log 2023-11-18T20:43:00.145 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104863.log 2023-11-18T20:43:00.146 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104989.log.gz 2023-11-18T20:43:00.146 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112826.log 2023-11-18T20:43:00.147 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96887.log.gz 2023-11-18T20:43:00.147 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107019.log 2023-11-18T20:43:00.148 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104863.log.gz 2023-11-18T20:43:00.148 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112826.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112826.log.gz 2023-11-18T20:43:00.149 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104505.log 2023-11-18T20:43:00.150 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95048.log 2023-11-18T20:43:00.150 INFO:teuthology.orchestra.run.smithi132.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107019.log.gz 2023-11-18T20:43:00.150 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104505.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104505.log.gz 2023-11-18T20:43:00.151 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93944.log 2023-11-18T20:43:00.151 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95048.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95048.log.gz 2023-11-18T20:43:00.152 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108719.log 2023-11-18T20:43:00.152 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112742.log 2023-11-18T20:43:00.153 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93944.log.gz 2023-11-18T20:43:00.154 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103861.log 2023-11-18T20:43:00.154 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108719.log.gz 2023-11-18T20:43:00.154 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96971.log 2023-11-18T20:43:00.155 INFO:teuthology.orchestra.run.smithi132.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112742.log.gz 2023-11-18T20:43:00.155 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97783.log 2023-11-18T20:43:00.156 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103861.log.gz 2023-11-18T20:43:00.156 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96971.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.96971.log.gz 2023-11-18T20:43:00.157 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96203.log 2023-11-18T20:43:00.157 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101116.log 2023-11-18T20:43:00.158 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97783.log.gz 2023-11-18T20:43:00.158 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96203.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96203.log.gzgzip 2023-11-18T20:43:00.159 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108157.log 2023-11-18T20:43:00.159 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99357.log 2023-11-18T20:43:00.160 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101116.log.gz 2023-11-18T20:43:00.160 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109615.log 2023-11-18T20:43:00.161 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108157.log.gz 2023-11-18T20:43:00.161 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108887.log 2023-11-18T20:43:00.162 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99357.log.gz 2023-11-18T20:43:00.162 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99715.log 2023-11-18T20:43:00.163 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109615.log.gz 2023-11-18T20:43:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112009.log 2023-11-18T20:43:00.164 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108887.log.gz 2023-11-18T20:43:00.164 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99715.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99715.log.gz 2023-11-18T20:43:00.165 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101489.log 2023-11-18T20:43:00.166 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98369.log 2023-11-18T20:43:00.166 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112009.log.gz 2023-11-18T20:43:00.166 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104905.log 2023-11-18T20:43:00.167 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101489.log.gz 2023-11-18T20:43:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100600.log 2023-11-18T20:43:00.168 INFO:teuthology.orchestra.run.smithi132.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98369.log.gz 2023-11-18T20:43:00.168 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104905.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104905.log.gz 2023-11-18T20:43:00.169 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93524.log 2023-11-18T20:43:00.169 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100600.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.100600.log.gz -5 2023-11-18T20:43:00.170 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.109447.log 2023-11-18T20:43:00.170 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93524.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93524.log.gz 2023-11-18T20:43:00.171 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114129.log 2023-11-18T20:43:00.171 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105073.log 2023-11-18T20:43:00.172 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109447.log.gz 2023-11-18T20:43:00.172 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.114129.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.114129.log.gz 2023-11-18T20:43:00.173 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106310.log 2023-11-18T20:43:00.173 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105073.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.105073.log.gz 2023-11-18T20:43:00.173 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108451.log 2023-11-18T20:43:00.174 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106310.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106310.log.gz 2023-11-18T20:43:00.175 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103131.log 2023-11-18T20:43:00.175 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108451.log: gzip 89.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.108451.log.gz --verbose 2023-11-18T20:43:00.175 INFO:teuthology.orchestra.run.smithi132.stderr: -- /var/log/ceph/ceph-client.admin.112177.log 2023-11-18T20:43:00.177 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102793.log 2023-11-18T20:43:00.177 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103131.log.gz 2023-11-18T20:43:00.178 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92479.log 2023-11-18T20:43:00.178 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112177.log.gz 2023-11-18T20:43:00.178 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102793.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102793.log.gz 2023-11-18T20:43:00.179 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97573.log 2023-11-18T20:43:00.180 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112784.log 2023-11-18T20:43:00.180 INFO:teuthology.orchestra.run.smithi132.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92479.log.gz 2023-11-18T20:43:00.180 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108199.log 2023-11-18T20:43:00.181 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97573.log.gz 2023-11-18T20:43:00.181 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94670.log 2023-11-18T20:43:00.182 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112784.log.gz 2023-11-18T20:43:00.182 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92474.log 2023-11-18T20:43:00.183 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108199.log.gz 2023-11-18T20:43:00.183 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113499.log 2023-11-18T20:43:00.184 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94670.log.gz 2023-11-18T20:43:00.184 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92474.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.99883.log -- replaced with /var/log/ceph/ceph-client.admin.92474.log.gz 2023-11-18T20:43:00.185 INFO:teuthology.orchestra.run.smithi132.stderr: 2023-11-18T20:43:00.185 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113499.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113499.log.gz 2023-11-18T20:43:00.186 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93159.log 2023-11-18T20:43:00.186 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99883.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99883.log.gz 2023-11-18T20:43:00.187 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112345.log 2023-11-18T20:43:00.188 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91970.log 2023-11-18T20:43:00.188 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93159.log.gz 2023-11-18T20:43:00.189 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113259.log 2023-11-18T20:43:00.189 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112345.log.gz 2023-11-18T20:43:00.189 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91970.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.91970.log.gz 2023-11-18T20:43:00.190 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96413.log 2023-11-18T20:43:00.190 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104673.log 2023-11-18T20:43:00.191 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113259.log.gz 2023-11-18T20:43:00.191 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101742.log 2023-11-18T20:43:00.192 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96413.log.gz 2023-11-18T20:43:00.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102699.log 2023-11-18T20:43:00.193 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104673.log.gz 2023-11-18T20:43:00.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101742.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101742.log.gzgzip 2023-11-18T20:43:00.194 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111841.log 2023-11-18T20:43:00.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103777.log 2023-11-18T20:43:00.197 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102699.log.gz 2023-11-18T20:43:00.198 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-18T20:43:00.199 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111841.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.111841.log.gz 2023-11-18T20:43:00.199 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105031.log 2023-11-18T20:43:00.199 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97403.log 2023-11-18T20:43:00.199 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103777.log.gz 2023-11-18T20:43:00.200 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105031.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105031.log.gz 2023-11-18T20:43:00.200 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107765.log 2023-11-18T20:43:00.200 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97403.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97403.log.gz 2023-11-18T20:43:00.200 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109101.log 2023-11-18T20:43:00.201 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107765.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107765.log.gz 2023-11-18T20:43:00.201 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99189.log 2023-11-18T20:43:00.201 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109101.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109101.log.gz 2023-11-18T20:43:00.202 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113709.log 2023-11-18T20:43:00.203 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99189.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99189.log.gz 2023-11-18T20:43:00.203 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113344.log 2023-11-18T20:43:00.204 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107851.log 2023-11-18T20:43:00.204 INFO:teuthology.orchestra.run.smithi132.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113709.log.gz 2023-11-18T20:43:00.205 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113344.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113344.log.gz 2023-11-18T20:43:00.205 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92222.log 2023-11-18T20:43:00.206 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107851.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107851.log.gz 2023-11-18T20:43:00.206 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107723.log 2023-11-18T20:43:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92222.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92222.log.gz 2023-11-18T20:43:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97267.log 2023-11-18T20:43:00.208 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93818.log 2023-11-18T20:43:00.208 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107723.log.gz 2023-11-18T20:43:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97267.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97267.log.gz 2023-11-18T20:43:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96929.log 2023-11-18T20:43:00.210 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93818.log: gzip -5 --verbose 87.4% -- /var/log/ceph/ceph-client.0.98204.log -- replaced with /var/log/ceph/ceph-client.admin.93818.log.gz 2023-11-18T20:43:00.210 INFO:teuthology.orchestra.run.smithi132.stderr: 2023-11-18T20:43:00.211 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96929.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96929.log.gz 2023-11-18T20:43:00.211 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105956.log 2023-11-18T20:43:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.98204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98204.log.gz 2023-11-18T20:43:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102571.log 2023-11-18T20:43:00.213 INFO:teuthology.orchestra.run.smithi161.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-18T20:43:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105956.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105956.log.gz 2023-11-18T20:43:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101073.log 2023-11-18T20:43:00.214 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101868.log 2023-11-18T20:43:00.214 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102571.log.gz 2023-11-18T20:43:00.215 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101073.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101073.log.gz 2023-11-18T20:43:00.215 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111029.log 2023-11-18T20:43:00.216 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91802.log 2023-11-18T20:43:00.216 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101868.log.gz 2023-11-18T20:43:00.217 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111029.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111029.log.gz 2023-11-18T20:43:00.217 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109825.log 2023-11-18T20:43:00.218 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91802.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91802.log.gz 2023-11-18T20:43:00.219 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98285.log 2023-11-18T20:43:00.219 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91317.log 2023-11-18T20:43:00.220 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109825.log.gz 2023-11-18T20:43:00.220 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97223.log 2023-11-18T20:43:00.221 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98285.log.gz 2023-11-18T20:43:00.222 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91317.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.91317.log.gz --verbose 2023-11-18T20:43:00.222 INFO:teuthology.orchestra.run.smithi132.stderr: -- /var/log/ceph/ceph-client.admin.95216.log 2023-11-18T20:43:00.223 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107062.log 2023-11-18T20:43:00.223 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97223.log.gz 2023-11-18T20:43:00.224 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101242.log 2023-11-18T20:43:00.224 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95216.log.gz 2023-11-18T20:43:00.225 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107062.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107062.log.gz 2023-11-18T20:43:00.225 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98208.log 2023-11-18T20:43:00.226 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93860.log 2023-11-18T20:43:00.227 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101242.log.gz 2023-11-18T20:43:00.227 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.98208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98208.log.gz 2023-11-18T20:43:00.227 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94964.log 2023-11-18T20:43:00.229 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93860.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93860.log.gzgzip 2023-11-18T20:43:00.229 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106959.log 2023-11-18T20:43:00.230 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113751.log 2023-11-18T20:43:00.230 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94964.log.gz 2023-11-18T20:43:00.231 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106959.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.106959.log.gz /var/log/ceph/ceph-client.admin.92012.log 2023-11-18T20:43:00.231 INFO:teuthology.orchestra.run.smithi132.stderr: 2023-11-18T20:43:00.232 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113751.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113751.log.gz 2023-11-18T20:43:00.232 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111390.log 2023-11-18T20:43:00.233 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104757.log 2023-11-18T20:43:00.233 INFO:teuthology.orchestra.run.smithi132.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92012.log.gz 2023-11-18T20:43:00.234 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101657.log 2023-11-18T20:43:00.235 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111390.log.gz 2023-11-18T20:43:00.235 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104757.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104757.log.gz 2023-11-18T20:43:00.236 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97825.log 2023-11-18T20:43:00.237 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105662.log 2023-11-18T20:43:00.237 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101657.log.gz 2023-11-18T20:43:00.238 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97741.log 2023-11-18T20:43:00.238 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97825.log.gz 2023-11-18T20:43:00.239 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105662.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105662.log.gz 2023-11-18T20:43:00.239 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111510.log 2023-11-18T20:43:00.240 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106623.log 2023-11-18T20:43:00.241 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97741.log.gz 2023-11-18T20:43:00.241 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110394.log 2023-11-18T20:43:00.241 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111510.log.gz 2023-11-18T20:43:00.243 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111762.log 2023-11-18T20:43:00.243 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106623.log.gz 2023-11-18T20:43:00.244 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99567.log 2023-11-18T20:43:00.244 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110394.log.gz 2023-11-18T20:43:00.245 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111762.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111762.log.gz 2023-11-18T20:43:00.245 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96623.log 2023-11-18T20:43:00.245 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109657.log 2023-11-18T20:43:00.246 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99567.log.gz 2023-11-18T20:43:00.247 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96623.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.96623.log.gz 2023-11-18T20:43:00.247 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.113667.log 2023-11-18T20:43:00.248 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109657.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109657.log.gz 2023-11-18T20:43:00.248 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114172.log 2023-11-18T20:43:00.249 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108241.log 2023-11-18T20:43:00.249 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113667.log.gz 2023-11-18T20:43:00.250 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.114172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96497.log 2023-11-18T20:43:00.250 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114172.log.gz 2023-11-18T20:43:00.251 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109489.log 2023-11-18T20:43:00.252 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108241.log.gz 2023-11-18T20:43:00.252 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103549.log 2023-11-18T20:43:00.253 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96497.log.gz 2023-11-18T20:43:00.254 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109489.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-18T20:43:00.254 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109489.log.gz 2023-11-18T20:43:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103549.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103549.log.gz 2023-11-18T20:43:00.255 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108073.log 2023-11-18T20:43:00.256 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111720.log 2023-11-18T20:43:00.257 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108073.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.108073.log.gz 2023-11-18T20:43:00.257 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.91364.log 2023-11-18T20:43:00.258 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105746.log 2023-11-18T20:43:00.258 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111720.log.gz 2023-11-18T20:43:00.259 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-18T20:43:00.259 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91364.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91364.log.gz 2023-11-18T20:43:00.259 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101447.log 2023-11-18T20:43:00.261 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105746.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105746.log.gz 2023-11-18T20:43:00.261 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91140.log 2023-11-18T20:43:00.261 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93144.log 2023-11-18T20:43:00.262 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101447.log.gz 2023-11-18T20:43:00.263 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106497.log 2023-11-18T20:43:00.263 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91140.log.gz 2023-11-18T20:43:00.264 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93144.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93144.log.gz 2023-11-18T20:43:00.264 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97489.log 2023-11-18T20:43:00.265 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92817.log 2023-11-18T20:43:00.265 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106497.log.gz 2023-11-18T20:43:00.266 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94922.log 2023-11-18T20:43:00.266 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97489.log.gz 2023-11-18T20:43:00.267 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92817.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92817.log.gz 2023-11-18T20:43:00.268 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97055.log 2023-11-18T20:43:00.268 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92475.log 2023-11-18T20:43:00.269 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94922.log.gz 2023-11-18T20:43:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100516.log 2023-11-18T20:43:00.270 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97055.log.gz 2023-11-18T20:43:00.271 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92475.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92475.log.gz 2023-11-18T20:43:00.271 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105209.log 2023-11-18T20:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99841.log 2023-11-18T20:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100516.log.gz 2023-11-18T20:43:00.273 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93123.log 2023-11-18T20:43:00.273 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105209.log.gz 2023-11-18T20:43:00.274 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99841.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99841.log.gz 2023-11-18T20:43:00.274 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92306.log 2023-11-18T20:43:00.275 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99399.log 2023-11-18T20:43:00.276 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93123.log.gz 2023-11-18T20:43:00.276 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94584.log 2023-11-18T20:43:00.277 INFO:teuthology.orchestra.run.smithi132.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92306.log.gz 2023-11-18T20:43:00.278 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99399.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99399.log.gz 2023-11-18T20:43:00.278 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100852.log 2023-11-18T20:43:00.279 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93692.log 2023-11-18T20:43:00.279 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94584.log.gz 2023-11-18T20:43:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100852.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100852.log.gz 2023-11-18T20:43:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98411.log 2023-11-18T20:43:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93692.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93692.log.gz 2023-11-18T20:43:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95867.log 2023-11-18T20:43:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109013.log 2023-11-18T20:43:00.283 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98411.log.gz 2023-11-18T20:43:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95867.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95867.log.gz 2023-11-18T20:43:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113835.log 2023-11-18T20:43:00.285 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109013.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109013.log.gz 2023-11-18T20:43:00.285 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99609.log 2023-11-18T20:43:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95909.log 2023-11-18T20:43:00.286 INFO:teuthology.orchestra.run.smithi132.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113835.log.gz 2023-11-18T20:43:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97097.log 2023-11-18T20:43:00.287 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99609.log.gz 2023-11-18T20:43:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95909.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95909.log.gz 2023-11-18T20:43:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93147.log 2023-11-18T20:43:00.289 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92808.log 2023-11-18T20:43:00.289 INFO:teuthology.orchestra.run.smithi132.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97097.log.gz 2023-11-18T20:43:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106749.log 2023-11-18T20:43:00.290 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93147.log.gz 2023-11-18T20:43:00.291 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92808.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92808.log.gz 2023-11-18T20:43:00.292 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97311.log 2023-11-18T20:43:00.293 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111967.log 2023-11-18T20:43:00.293 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106749.log.gz 2023-11-18T20:43:00.294 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93608.log 2023-11-18T20:43:00.294 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97311.log.gz 2023-11-18T20:43:00.295 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111967.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111967.log.gz 2023-11-18T20:43:00.295 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99147.log 2023-11-18T20:43:00.296 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102963.log 2023-11-18T20:43:00.296 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93608.log.gz 2023-11-18T20:43:00.297 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99147.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99147.log.gz 2023-11-18T20:43:00.297 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.91493.log 2023-11-18T20:43:00.298 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102963.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102963.log.gz 2023-11-18T20:43:00.298 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114087.log 2023-11-18T20:43:00.299 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96539.log 2023-11-18T20:43:00.300 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91493.log.gz 2023-11-18T20:43:00.300 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.114087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109279.log 2023-11-18T20:43:00.301 INFO:teuthology.orchestra.run.smithi132.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114087.log.gz 2023-11-18T20:43:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96539.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96539.log.gz 2023-11-18T20:43:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106833.log 2023-11-18T20:43:00.303 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92054.log 2023-11-18T20:43:00.303 INFO:teuthology.orchestra.run.smithi132.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109279.log.gz 2023-11-18T20:43:00.304 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86838.log 2023-11-18T20:43:00.304 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106833.log.gz 2023-11-18T20:43:00.305 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104379.log 2023-11-18T20:43:00.305 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92054.log.gz 2023-11-18T20:43:00.306 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.86838.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86838.log.gz 2023-11-18T20:43:00.306 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95468.log 2023-11-18T20:43:00.307 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96161.log 2023-11-18T20:43:00.308 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104379.log.gz 2023-11-18T20:43:00.308 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110861.log 2023-11-18T20:43:00.309 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95468.log.gz 2023-11-18T20:43:00.310 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96161.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96161.log.gz 2023-11-18T20:43:00.310 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108638.log 2023-11-18T20:43:00.311 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112700.log 2023-11-18T20:43:00.311 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110861.log.gz 2023-11-18T20:43:00.312 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.108638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108638.log.gz 2023-11-18T20:43:00.312 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96329.log 2023-11-18T20:43:00.313 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112700.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112700.log.gz 2023-11-18T20:43:00.313 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102204.log 2023-11-18T20:43:00.314 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106707.log 2023-11-18T20:43:00.315 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96329.log.gz 2023-11-18T20:43:00.315 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110987.log 2023-11-18T20:43:00.315 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102204.log.gz 2023-11-18T20:43:00.317 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106707.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106707.log.gz -5 2023-11-18T20:43:00.317 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.102743.log 2023-11-18T20:43:00.318 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110777.log 2023-11-18T20:43:00.318 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110987.log.gz 2023-11-18T20:43:00.319 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99799.log 2023-11-18T20:43:00.319 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102743.log.gz 2023-11-18T20:43:00.320 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94088.log 2023-11-18T20:43:00.320 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110777.log.gz 2023-11-18T20:43:00.321 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103047.log 2023-11-18T20:43:00.321 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99799.log.gz 2023-11-18T20:43:00.322 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94088.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94088.log.gz 2023-11-18T20:43:00.322 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80580.log 2023-11-18T20:43:00.323 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104631.log 2023-11-18T20:43:00.323 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103047.log.gz 2023-11-18T20:43:00.324 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.tmp-client.admin.80580.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80580.log.gz 2023-11-18T20:43:00.324 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113457.log 2023-11-18T20:43:00.326 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104631.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104631.log.gz 2023-11-18T20:43:00.326 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92486.log 2023-11-18T20:43:00.327 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106124.log 2023-11-18T20:43:00.327 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113457.log.gz 2023-11-18T20:43:00.328 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86570.log 2023-11-18T20:43:00.329 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92486.log.gz 2023-11-18T20:43:00.330 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104589.log 2023-11-18T20:43:00.330 INFO:teuthology.orchestra.run.smithi132.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106124.log.gz 2023-11-18T20:43:00.331 INFO:teuthology.orchestra.run.smithi161.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-18T20:43:00.331 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.86570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91538.log 2023-11-18T20:43:00.331 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86570.log.gz 2023-11-18T20:43:00.332 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104589.log.gz 2023-11-18T20:43:00.332 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100430.log 2023-11-18T20:43:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110174.log 2023-11-18T20:43:00.334 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91538.log.gz 2023-11-18T20:43:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100430.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100430.log.gz 2023-11-18T20:43:00.335 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95663.log 2023-11-18T20:43:00.336 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110174.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-18T20:43:00.336 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110174.log.gz 2023-11-18T20:43:00.337 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109235.log 2023-11-18T20:43:00.338 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95663.log.gz 2023-11-18T20:43:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98453.log 2023-11-18T20:43:00.340 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103281.log 2023-11-18T20:43:00.340 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109235.log.gz 2023-11-18T20:43:00.341 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98453.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98453.log.gz 2023-11-18T20:43:00.342 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91676.log 2023-11-18T20:43:00.343 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95090.log 2023-11-18T20:43:00.343 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103281.log.gz 2023-11-18T20:43:00.344 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91676.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91676.log.gz 2023-11-18T20:43:00.345 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102363.log 2023-11-18T20:43:00.346 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103173.log 2023-11-18T20:43:00.346 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95090.log.gz 2023-11-18T20:43:00.347 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102363.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102363.log.gz 2023-11-18T20:43:00.348 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95747.log 2023-11-18T20:43:00.349 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91886.log 2023-11-18T20:43:00.349 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103173.log.gz 2023-11-18T20:43:00.350 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95747.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95747.log.gz 2023-11-18T20:43:00.351 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97657.log 2023-11-18T20:43:00.352 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91886.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91886.log.gz 2023-11-18T20:43:00.352 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112403.log 2023-11-18T20:43:00.354 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97657.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97657.log.gz 2023-11-18T20:43:00.354 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109699.log 2023-11-18T20:43:00.355 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112403.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112403.log.gz 2023-11-18T20:43:00.355 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91844.log 2023-11-18T20:43:00.356 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86954.log 2023-11-18T20:43:00.357 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109699.log.gz 2023-11-18T20:43:00.358 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111678.log 2023-11-18T20:43:00.358 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91844.log.gz 2023-11-18T20:43:00.359 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.86954.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86954.log.gz 2023-11-18T20:43:00.360 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105115.log 2023-11-18T20:43:00.361 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95621.log 2023-11-18T20:43:00.361 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111678.log.gz 2023-11-18T20:43:00.362 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105115.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.105115.log.gz 2023-11-18T20:43:00.362 INFO:teuthology.orchestra.run.smithi132.stderr: /var/log/ceph/ceph-client.admin.107681.log 2023-11-18T20:43:00.364 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93776.log 2023-11-18T20:43:00.364 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95621.log.gz 2023-11-18T20:43:00.365 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107681.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107681.log.gz 2023-11-18T20:43:00.365 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111552.log 2023-11-18T20:43:00.367 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93776.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93776.log.gz 2023-11-18T20:43:00.367 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91718.log 2023-11-18T20:43:00.368 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101405.log 2023-11-18T20:43:00.369 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111552.log.gz 2023-11-18T20:43:00.369 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91718.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91718.log.gz 2023-11-18T20:43:00.370 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100061.log 2023-11-18T20:43:00.371 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95951.log 2023-11-18T20:43:00.371 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101405.log.gz 2023-11-18T20:43:00.373 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100061.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100061.log.gz 2023-11-18T20:43:00.373 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102486.log 2023-11-18T20:43:00.374 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106791.log 2023-11-18T20:43:00.375 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95951.log.gz 2023-11-18T20:43:00.376 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102486.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102486.log.gz 2023-11-18T20:43:00.376 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92096.log 2023-11-18T20:43:00.378 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113625.log 2023-11-18T20:43:00.378 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106791.log.gz 2023-11-18T20:43:00.379 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92096.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92096.log.gz 2023-11-18T20:43:00.379 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99273.log 2023-11-18T20:43:00.381 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107639.log 2023-11-18T20:43:00.381 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113625.log.gz 2023-11-18T20:43:00.382 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99273.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99273.log.gz 2023-11-18T20:43:00.382 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96785.log 2023-11-18T20:43:00.384 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100894.log 2023-11-18T20:43:00.384 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107639.log.gz 2023-11-18T20:43:00.385 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96785.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96785.log.gz 2023-11-18T20:43:00.385 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107272.log 2023-11-18T20:43:00.387 INFO:teuthology.orchestra.run.smithi161.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-18T20:43:00.387 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98835.log 2023-11-18T20:43:00.388 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100894.log.gz 2023-11-18T20:43:00.388 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107272.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107272.log.gz 2023-11-18T20:43:00.388 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108029.log 2023-11-18T20:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110258.log 2023-11-18T20:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98835.log.gz 2023-11-18T20:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103651.log 2023-11-18T20:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108029.log.gz 2023-11-18T20:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110258.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110258.log.gz 2023-11-18T20:43:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101784.log 2023-11-18T20:43:00.394 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112135.log 2023-11-18T20:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103651.log.gz 2023-11-18T20:43:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101784.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.101784.log.gz 2023-11-18T20:43:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106581.log 2023-11-18T20:43:00.397 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93482.log 2023-11-18T20:43:00.398 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112135.log.gz 2023-11-18T20:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106581.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106581.log.gz 2023-11-18T20:43:00.401 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102078.log 2023-11-18T20:43:00.402 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113961.log 2023-11-18T20:43:00.402 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93482.log.gz 2023-11-18T20:43:00.402 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102078.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102078.log.gz 2023-11-18T20:43:00.403 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94838.log 2023-11-18T20:43:00.404 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112658.log 2023-11-18T20:43:00.404 INFO:teuthology.orchestra.run.smithi132.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113961.log.gz 2023-11-18T20:43:00.405 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94838.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94838.log.gz 2023-11-18T20:43:00.406 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102444.log 2023-11-18T20:43:00.407 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106268.log 2023-11-18T20:43:00.407 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112658.log.gz 2023-11-18T20:43:00.408 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102444.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102444.log.gz 2023-11-18T20:43:00.409 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107945.log 2023-11-18T20:43:00.410 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95132.log 2023-11-18T20:43:00.410 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106268.log.gz 2023-11-18T20:43:00.411 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107945.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107945.log.gz 2023-11-18T20:43:00.412 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107987.log 2023-11-18T20:43:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113877.log 2023-11-18T20:43:00.414 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95132.log.gz 2023-11-18T20:43:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107987.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107987.log.gz 2023-11-18T20:43:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108845.log 2023-11-18T20:43:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102283.log 2023-11-18T20:43:00.417 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113877.log.gz 2023-11-18T20:43:00.418 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108845.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108845.log.gz 2023-11-18T20:43:00.418 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91928.log 2023-11-18T20:43:00.419 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109151.log 2023-11-18T20:43:00.420 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102283.log.gz 2023-11-18T20:43:00.421 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91928.log.gz 2023-11-18T20:43:00.421 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102120.log 2023-11-18T20:43:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104547.log 2023-11-18T20:43:00.424 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109151.log.gz 2023-11-18T20:43:00.425 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102120.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102120.log.gz 2023-11-18T20:43:00.425 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106917.log 2023-11-18T20:43:00.426 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104547.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104547.log.gz 2023-11-18T20:43:00.426 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98793.log 2023-11-18T20:43:00.427 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106917.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106917.log.gz 2023-11-18T20:43:00.428 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100558.log 2023-11-18T20:43:00.429 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92813.log 2023-11-18T20:43:00.429 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98793.log.gz 2023-11-18T20:43:00.430 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100558.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100558.log.gz 2023-11-18T20:43:00.431 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-18T20:43:00.432 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94439.log 2023-11-18T20:43:00.433 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92813.log.gz 2023-11-18T20:43:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107104.log 2023-11-18T20:43:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.94439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94439.log.gz 2023-11-18T20:43:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98495.log 2023-11-18T20:43:00.437 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101952.log 2023-11-18T20:43:00.438 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107104.log.gz 2023-11-18T20:43:00.439 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102921.log 2023-11-18T20:43:00.439 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98495.log.gz 2023-11-18T20:43:00.441 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101952.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101952.log.gz 2023-11-18T20:43:00.441 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105704.log 2023-11-18T20:43:00.441 INFO:teuthology.orchestra.run.smithi161.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-18T20:43:00.442 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102921.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102921.log.gz 2023-11-18T20:43:00.442 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109321.log 2023-11-18T20:43:00.444 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102655.log 2023-11-18T20:43:00.444 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105704.log.gz 2023-11-18T20:43:00.445 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113793.log 2023-11-18T20:43:00.446 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109321.log.gz 2023-11-18T20:43:00.447 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104083.log 2023-11-18T20:43:00.447 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102655.log.gz 2023-11-18T20:43:00.448 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113793.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113793.log.gz 2023-11-18T20:43:00.449 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107146.log 2023-11-18T20:43:00.450 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.105516.log 2023-11-18T20:43:00.450 INFO:teuthology.orchestra.run.smithi132.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104083.log.gz 2023-11-18T20:43:00.452 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107146.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107146.log.gz 2023-11-18T20:43:00.452 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96245.log 2023-11-18T20:43:00.453 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.testuser.105516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.105516.log.gz 2023-11-18T20:43:00.453 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109942.log 2023-11-18T20:43:00.455 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96245.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96245.log.gz 2023-11-18T20:43:00.455 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100936.log 2023-11-18T20:43:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96287.log 2023-11-18T20:43:00.456 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109942.log.gz 2023-11-18T20:43:00.458 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100936.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100936.log.gz 2023-11-18T20:43:00.458 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110945.log 2023-11-18T20:43:00.459 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109783.log 2023-11-18T20:43:00.459 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96287.log.gz 2023-11-18T20:43:00.461 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110945.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110945.log.gz 2023-11-18T20:43:00.461 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100473.log 2023-11-18T20:43:00.462 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91632.log 2023-11-18T20:43:00.462 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109783.log.gz 2023-11-18T20:43:00.463 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100473.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100473.log.gz 2023-11-18T20:43:00.463 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101910.log 2023-11-18T20:43:00.464 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104041.log 2023-11-18T20:43:00.465 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91632.log.gz 2023-11-18T20:43:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101910.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101910.log.gz 2023-11-18T20:43:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105830.log 2023-11-18T20:43:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110048.log 2023-11-18T20:43:00.467 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104041.log.gz 2023-11-18T20:43:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105830.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105830.log.gz 2023-11-18T20:43:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111636.log 2023-11-18T20:43:00.469 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98623.log 2023-11-18T20:43:00.470 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110048.log.gz 2023-11-18T20:43:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111636.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111636.log.gz 2023-11-18T20:43:00.471 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104211.log 2023-11-18T20:43:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:gzip/var/log/ceph/ceph-client.admin.98623.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.105998.log 2023-11-18T20:43:00.472 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98623.log.gz 2023-11-18T20:43:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104211.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104211.log.gz 2023-11-18T20:43:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93986.log 2023-11-18T20:43:00.474 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109900.log 2023-11-18T20:43:00.475 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105998.log.gz 2023-11-18T20:43:00.476 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107895.log 2023-11-18T20:43:00.476 INFO:teuthology.orchestra.run.smithi132.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.93986.log.gz 2023-11-18T20:43:00.477 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94628.log 2023-11-18T20:43:00.477 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109900.log.gz 2023-11-18T20:43:00.478 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107895.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107895.log.gz 2023-11-18T20:43:00.478 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110132.log 2023-11-18T20:43:00.479 INFO:teuthology.orchestra.run.smithi132.stderr:gzip/var/log/ceph/ceph-client.admin.94628.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.112970.log 2023-11-18T20:43:00.480 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94628.log.gz 2023-11-18T20:43:00.481 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110132.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110132.log.gz 2023-11-18T20:43:00.481 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94430.log 2023-11-18T20:43:00.482 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111594.log 2023-11-18T20:43:00.482 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112970.log.gz 2023-11-18T20:43:00.483 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.94430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94430.log.gz 2023-11-18T20:43:00.483 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102835.log 2023-11-18T20:43:00.484 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96119.log 2023-11-18T20:43:00.485 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111594.log.gz 2023-11-18T20:43:00.485 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102835.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102835.log.gz 2023-11-18T20:43:00.486 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98751.log 2023-11-18T20:43:00.487 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106394.log 2023-11-18T20:43:00.487 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96119.log.gz 2023-11-18T20:43:00.488 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98751.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98751.log.gz 2023-11-18T20:43:00.488 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108971.log 2023-11-18T20:43:00.489 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92487.log 2023-11-18T20:43:00.489 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106394.log.gz 2023-11-18T20:43:00.490 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108971.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108971.log.gz 2023-11-18T20:43:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106208.log 2023-11-18T20:43:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95789.log 2023-11-18T20:43:00.492 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92487.log.gz 2023-11-18T20:43:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106208.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106208.log.gz 2023-11-18T20:43:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97909.log 2023-11-18T20:43:00.494 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99483.log 2023-11-18T20:43:00.495 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95789.log.gz 2023-11-18T20:43:00.495 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97909.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97909.log.gz 2023-11-18T20:43:00.495 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99063.log 2023-11-18T20:43:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112490.log 2023-11-18T20:43:00.497 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99483.log.gz 2023-11-18T20:43:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99063.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99063.log.gz 2023-11-18T20:43:00.498 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103215.log 2023-11-18T20:43:00.499 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103693.log 2023-11-18T20:43:00.499 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112490.log.gz 2023-11-18T20:43:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109573.log 2023-11-18T20:43:00.501 INFO:teuthology.orchestra.run.smithi132.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.103215.log.gz 2023-11-18T20:43:00.502 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100979.log 2023-11-18T20:43:00.502 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103693.log.gz 2023-11-18T20:43:00.503 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109573.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109573.log.gz 2023-11-18T20:43:00.503 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92264.log 2023-11-18T20:43:00.504 INFO:teuthology.orchestra.run.smithi161.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-18T20:43:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96703.log 2023-11-18T20:43:00.505 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100979.log.gz 2023-11-18T20:43:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92264.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92264.log.gz 2023-11-18T20:43:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114045.log 2023-11-18T20:43:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103735.log 2023-11-18T20:43:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96703.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96703.log.gz 2023-11-18T20:43:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.114045.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114045.log.gz 2023-11-18T20:43:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-18T20:43:00.509 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112532.log 2023-11-18T20:43:00.509 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103735.log.gz 2023-11-18T20:43:00.510 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103005.log 2023-11-18T20:43:00.512 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112261.log 2023-11-18T20:43:00.512 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112532.log.gz 2023-11-18T20:43:00.513 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110300.log 2023-11-18T20:43:00.513 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103005.log.gz 2023-11-18T20:43:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112261.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-18T20:43:00.515 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92478.log 2023-11-18T20:43:00.515 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112261.log.gz 2023-11-18T20:43:00.516 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99315.log 2023-11-18T20:43:00.516 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110300.log.gz 2023-11-18T20:43:00.517 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92478.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92478.log.gz 2023-11-18T20:43:00.517 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93440.log 2023-11-18T20:43:00.518 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111180.log 2023-11-18T20:43:00.519 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99315.log.gz 2023-11-18T20:43:00.519 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93440.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93440.log.gz 2023-11-18T20:43:00.520 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107597.log 2023-11-18T20:43:00.521 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101346.log 2023-11-18T20:43:00.521 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111180.log.gz 2023-11-18T20:43:00.522 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107597.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107597.log.gz 2023-11-18T20:43:00.522 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109531.log 2023-11-18T20:43:00.523 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.105512.log 2023-11-18T20:43:00.524 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101346.log: /var/log/ceph/ceph-client.admin.109531.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101346.log.gz 2023-11-18T20:43:00.524 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109531.log.gz 2023-11-18T20:43:00.525 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113919.log 2023-11-18T20:43:00.525 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.testuser.105512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97699.log 2023-11-18T20:43:00.526 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.105512.log.gz 2023-11-18T20:43:00.526 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113919.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113919.log.gz 2023-11-18T20:43:00.527 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109741.log 2023-11-18T20:43:00.528 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111348.log/var/log/ceph/ceph-client.admin.97699.log: 2023-11-18T20:43:00.529 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97699.log.gz 2023-11-18T20:43:00.529 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109741.log: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-18T20:43:00.529 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109741.log.gz 2023-11-18T20:43:00.530 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97139.log 2023-11-18T20:43:00.530 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100726.log 2023-11-18T20:43:00.531 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5%/var/log/ceph/ceph-client.admin.97139.log: -- replaced with /var/log/ceph/ceph-client.admin.111348.log.gz 2023-11-18T20:43:00.531 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101531.log 2023-11-18T20:43:00.531 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97139.log.gz 2023-11-18T20:43:00.532 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93160.log 2023-11-18T20:43:00.533 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100726.log.gz 2023-11-18T20:43:00.533 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101531.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101531.log.gz 2023-11-18T20:43:00.534 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111925.log 2023-11-18T20:43:00.535 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93152.log 2023-11-18T20:43:00.535 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93160.log.gz 2023-11-18T20:43:00.536 INFO:teuthology.orchestra.run.smithi161.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-18T20:43:00.537 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96845.log 2023-11-18T20:43:00.537 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111925.log.gz 2023-11-18T20:43:00.537 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93152.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93152.log.gz 2023-11-18T20:43:00.538 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108325.log 2023-11-18T20:43:00.539 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106665.log 2023-11-18T20:43:00.539 INFO:teuthology.orchestra.run.smithi132.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.96845.log.gz 2023-11-18T20:43:00.540 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108325.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108325.log.gz 2023-11-18T20:43:00.540 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91236.log 2023-11-18T20:43:00.541 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101994.log 2023-11-18T20:43:00.541 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106665.log.gz 2023-11-18T20:43:00.542 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91236.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91236.log.gz 2023-11-18T20:43:00.543 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98017.log 2023-11-18T20:43:00.544 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94754.log 2023-11-18T20:43:00.544 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101994.log.gz 2023-11-18T20:43:00.545 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98017.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98017.log.gz 2023-11-18T20:43:00.545 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97867.log 2023-11-18T20:43:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94754.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-18T20:43:00.546 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94754.log.gz 2023-11-18T20:43:00.547 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97867.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97867.log.gz 2023-11-18T20:43:00.547 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97951.log 2023-11-18T20:43:00.548 INFO:teuthology.orchestra.run.smithi161.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-18T20:43:00.548 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107515.log 2023-11-18T20:43:00.550 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98579.log 2023-11-18T20:43:00.550 INFO:teuthology.orchestra.run.smithi132.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.97951.log.gz 2023-11-18T20:43:00.551 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107515.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107515.log.gz 2023-11-18T20:43:00.552 INFO:teuthology.orchestra.run.smithi161.stderr: 2023-11-18T20:43:00.552 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m0.513s 2023-11-18T20:43:00.552 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m2.109s 2023-11-18T20:43:00.552 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m0.339s 2023-11-18T20:43:00.553 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99105.log 2023-11-18T20:43:00.553 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92822.log 2023-11-18T20:43:00.554 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98579.log.gz 2023-11-18T20:43:00.555 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99105.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99105.log.gz 2023-11-18T20:43:00.555 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99925.log 2023-11-18T20:43:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92822.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92822.log.gz 2023-11-18T20:43:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92824.log 2023-11-18T20:43:00.557 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98895.log 2023-11-18T20:43:00.558 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99925.log.gz 2023-11-18T20:43:00.558 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92824.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92824.log.gz 2023-11-18T20:43:00.559 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.110697.log 2023-11-18T20:43:00.560 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98895.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98895.log.gz 2023-11-18T20:43:00.560 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96581.log 2023-11-18T20:43:00.561 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.testuser.110697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106875.log 2023-11-18T20:43:00.561 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.110697.log.gz 2023-11-18T20:43:00.563 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96581.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96581.log.gz 2023-11-18T20:43:00.563 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113389.log 2023-11-18T20:43:00.564 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106875.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106875.log.gz 2023-11-18T20:43:00.564 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-18T20:43:00.566 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109057.log 2023-11-18T20:43:00.566 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113389.log.gz 2023-11-18T20:43:00.567 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100768.log 2023-11-18T20:43:00.568 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109057.log: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-18T20:43:00.568 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108385.log 2023-11-18T20:43:00.568 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109057.log.gz 2023-11-18T20:43:00.569 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104127.log 2023-11-18T20:43:00.570 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100768.log.gz 2023-11-18T20:43:00.571 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100810.log 2023-11-18T20:43:00.571 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.108385.log.gz 2023-11-18T20:43:00.572 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104127.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104127.log.gz 2023-11-18T20:43:00.572 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101029.log 2023-11-18T20:43:00.573 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107807.log 2023-11-18T20:43:00.574 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100810.log.gz 2023-11-18T20:43:00.574 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101029.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101029.log.gz 2023-11-18T20:43:00.575 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-18T20:43:00.576 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107807.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107807.log.gz 2023-11-18T20:43:00.576 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114003.log 2023-11-18T20:43:00.577 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100642.log 2023-11-18T20:43:00.578 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.114003.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114003.log.gz 2023-11-18T20:43:00.579 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114212.log 2023-11-18T20:43:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100642.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100642.log.gz 2023-11-18T20:43:00.580 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-18T20:43:00.582 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.114212.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114212.log.gz 2023-11-18T20:43:00.582 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95993.log 2023-11-18T20:43:00.583 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102877.log 2023-11-18T20:43:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.100368.log 2023-11-18T20:43:00.585 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95993.log.gz 2023-11-18T20:43:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95174.log 2023-11-18T20:43:00.587 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102877.log.gz 2023-11-18T20:43:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.testuser.100368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.100368.log.gz 2023-11-18T20:43:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107356.log 2023-11-18T20:43:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100684.log 2023-11-18T20:43:00.589 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95174.log.gz 2023-11-18T20:43:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107356.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107356.log.gz 2023-11-18T20:43:00.591 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112574.log 2023-11-18T20:43:00.592 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.100684.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100684.log.gz 2023-11-18T20:43:00.592 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101158.log 2023-11-18T20:43:00.594 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96035.log 2023-11-18T20:43:00.594 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112574.log.gz 2023-11-18T20:43:00.595 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95300.log 2023-11-18T20:43:00.595 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101158.log.gz 2023-11-18T20:43:00.597 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91580.log 2023-11-18T20:43:00.597 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96035.log.gz 2023-11-18T20:43:00.598 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99021.log 2023-11-18T20:43:00.598 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95300.log.gz 2023-11-18T20:43:00.600 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108283.log 2023-11-18T20:43:00.600 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91580.log.gz 2023-11-18T20:43:00.601 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92483.log 2023-11-18T20:43:00.601 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99021.log.gz 2023-11-18T20:43:00.602 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94712.log 2023-11-18T20:43:00.603 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108283.log.gz 2023-11-18T20:43:00.604 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92483.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97361.log 2023-11-18T20:43:00.604 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92483.log.gz 2023-11-18T20:43:00.606 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105914.log 2023-11-18T20:43:00.606 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94712.log.gz 2023-11-18T20:43:00.607 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104715.log 2023-11-18T20:43:00.609 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97361.log.gz 2023-11-18T20:43:00.610 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105914.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97181.log 2023-11-18T20:43:00.611 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105914.log.gz 2023-11-18T20:43:00.611 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92823.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104715.log.gz 2023-11-18T20:43:00.611 INFO:teuthology.orchestra.run.smithi132.stderr: 2023-11-18T20:43:00.611 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97181.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97181.log.gz 2023-11-18T20:43:00.612 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102529.log 2023-11-18T20:43:00.613 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96077.log 2023-11-18T20:43:00.613 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92823.log.gz 2023-11-18T20:43:00.615 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98667.log 2023-11-18T20:43:00.615 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102529.log.gz 2023-11-18T20:43:00.616 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96077.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96077.log.gz 2023-11-18T20:43:00.616 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112616.log 2023-11-18T20:43:00.618 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113013.log 2023-11-18T20:43:00.618 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98667.log.gz 2023-11-18T20:43:00.619 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108761.log 2023-11-18T20:43:00.619 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112616.log.gz 2023-11-18T20:43:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113013.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113013.log.gz -5 2023-11-18T20:43:00.621 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95705.log 2023-11-18T20:43:00.622 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108761.log: gzip -5 --verbose -- 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108761.log.gz 2023-11-18T20:43:00.622 INFO:teuthology.orchestra.run.smithi132.stderr: /var/log/ceph/ceph-client.admin.109193.log 2023-11-18T20:43:00.623 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95705.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95705.log.gz 2023-11-18T20:43:00.624 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93156.log 2023-11-18T20:43:00.625 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107314.log 2023-11-18T20:43:00.626 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109193.log.gz 2023-11-18T20:43:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104947.log 2023-11-18T20:43:00.627 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93156.log.gz 2023-11-18T20:43:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107314.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107314.log.gz 2023-11-18T20:43:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95258.log 2023-11-18T20:43:00.629 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104947.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106352.log 2023-11-18T20:43:00.630 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104947.log.gz 2023-11-18T20:43:00.631 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.95258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106166.log 2023-11-18T20:43:00.631 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95258.log.gz 2023-11-18T20:43:00.632 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106352.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106352.log.gz 2023-11-18T20:43:00.633 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101200.log 2023-11-18T20:43:00.634 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106166.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106166.log.gz -5 2023-11-18T20:43:00.635 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.105788.log 2023-11-18T20:43:00.636 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107188.log 2023-11-18T20:43:00.636 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101200.log.gz 2023-11-18T20:43:00.637 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105788.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105788.log.gz 2023-11-18T20:43:00.638 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109405.log 2023-11-18T20:43:00.638 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107188.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107188.log.gz 2023-11-18T20:43:00.639 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96455.log 2023-11-18T20:43:00.640 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.109405.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109405.log.gz 2023-11-18T20:43:00.641 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.103949.log 2023-11-18T20:43:00.642 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.96455.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96455.log.gz 2023-11-18T20:43:00.642 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113301.log 2023-11-18T20:43:00.644 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112051.log 2023-11-18T20:43:00.644 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103949.log.gz 2023-11-18T20:43:00.645 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113301.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-18T20:43:00.645 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113301.log.gz 2023-11-18T20:43:00.646 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93158.log 2023-11-18T20:43:00.646 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112051.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112051.log.gz 2023-11-18T20:43:00.647 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114254.log 2023-11-18T20:43:00.648 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93158.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93158.log.gz 2023-11-18T20:43:00.648 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99967.log 2023-11-18T20:43:00.649 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.114254.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114254.log.gz 2023-11-18T20:43:00.650 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107435.log 2023-11-18T20:43:00.651 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99967.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99967.log.gz 2023-11-18T20:43:00.651 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104169.log 2023-11-18T20:43:00.652 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.107435.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.107435.log.gz -5 2023-11-18T20:43:00.653 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.0.108642.log 2023-11-18T20:43:00.654 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.104169.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104169.log.gz 2023-11-18T20:43:00.654 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98537.log 2023-11-18T20:43:00.655 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.108642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108642.log.gz 2023-11-18T20:43:00.656 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111883.log 2023-11-18T20:43:00.657 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98537.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.98537.log.gz 2023-11-18T20:43:00.657 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110090.log 2023-11-18T20:43:00.658 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111883.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111883.log.gz 2023-11-18T20:43:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99231.log 2023-11-18T20:43:00.660 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110090.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110090.log.gz 2023-11-18T20:43:00.660 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112868.log 2023-11-18T20:43:00.662 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99231.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99231.log.gz 2023-11-18T20:43:00.662 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112093.log 2023-11-18T20:43:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112868.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112868.log.gz 2023-11-18T20:43:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92488.log 2023-11-18T20:43:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112093.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112093.log.gz 2023-11-18T20:43:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97445.log 2023-11-18T20:43:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.92488.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-18T20:43:00.666 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92488.log.gz 2023-11-18T20:43:00.667 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.97445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113541.log 2023-11-18T20:43:00.668 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97445.log.gz 2023-11-18T20:43:00.669 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105620.log 2023-11-18T20:43:00.671 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.113541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101573.log 2023-11-18T20:43:00.671 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113541.log.gz 2023-11-18T20:43:00.672 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.105620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112303.log 2023-11-18T20:43:00.672 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105620.log.gz 2023-11-18T20:43:00.673 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98979.log 2023-11-18T20:43:00.674 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101573.log.gz 2023-11-18T20:43:00.674 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.112303.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112303.log.gz 2023-11-18T20:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98979.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98979.log.gz 2023-11-18T20:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94796.log 2023-11-18T20:43:00.678 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106539.log 2023-11-18T20:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.94796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108115.log 2023-11-18T20:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94796.log.gz 2023-11-18T20:43:00.682 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.106539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101302.log 2023-11-18T20:43:00.682 INFO:teuthology.orchestra.run.smithi132.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.106539.log.gz 2023-11-18T20:43:00.683 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.108115.log: gzip -5 --verbose 88.5% -- /var/log/ceph/ceph-client.admin.93650.log -- replaced with /var/log/ceph/ceph-client.admin.108115.log.gz 2023-11-18T20:43:00.683 INFO:teuthology.orchestra.run.smithi132.stderr: 2023-11-18T20:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.101302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91760.log 2023-11-18T20:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101302.log.gz 2023-11-18T20:43:00.686 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.93650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98937.log 2023-11-18T20:43:00.686 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93650.log.gz 2023-11-18T20:43:00.687 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.91760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110216.log 2023-11-18T20:43:00.687 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.91760.log.gz 2023-11-18T20:43:00.689 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.98937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111306.log 2023-11-18T20:43:00.689 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98937.log.gz 2023-11-18T20:43:00.690 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.110216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103591.log 2023-11-18T20:43:00.690 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110216.log.gz 2023-11-18T20:43:00.692 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.111306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102036.log 2023-11-18T20:43:00.692 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111306.log.gz 2023-11-18T20:43:00.693 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.103591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99757.log 2023-11-18T20:43:00.693 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.103591.log.gz 2023-11-18T20:43:00.694 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.102036.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102036.log.gz 2023-11-18T20:43:00.696 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.99757.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99757.log.gz 2023-11-18T20:43:00.734 INFO:teuthology.orchestra.run.smithi132.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-18T20:43:00.782 INFO:teuthology.orchestra.run.smithi132.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-18T20:43:00.850 INFO:teuthology.orchestra.run.smithi132.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-18T20:43:00.896 INFO:teuthology.orchestra.run.smithi132.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-18T20:43:00.976 INFO:teuthology.orchestra.run.smithi132.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-18T20:43:00.980 INFO:teuthology.orchestra.run.smithi132.stderr: 2023-11-18T20:43:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m0.945s 2023-11-18T20:43:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m2.204s 2023-11-18T20:43:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m1.461s 2023-11-18T20:43:00.981 INFO:tasks.ceph:Archiving logs... 2023-11-18T20:43:00.981 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/remote/smithi132/log 2023-11-18T20:43:00.982 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-18T20:43:01.695 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/remote/smithi161/log 2023-11-18T20:43:01.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-18T20:43:02.056 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-18T20:43:02.065 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-18T20:43:02.065 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-18T20:43:02.074 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-18T20:43:02.231 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-18T20:43:02.240 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-18T20:43:02.241 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T20:43:02.250 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T20:43:02.297 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2023-11-18T20:43:02.308 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T20:43:02.308 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2023-11-18T20:43:02.308 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +1269us[+1269us] +/- 82ms 2023-11-18T20:43:02.309 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -1091us[-1092us] +/- 76ms 2023-11-18T20:43:02.309 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 -48us[ -48us] +/- 62ms 2023-11-18T20:43:02.309 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:43:02.309 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2023-11-18T20:43:02.319 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T20:43:02.320 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-11-18T20:43:02.320 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 +1265us[+1265us] +/- 82ms 2023-11-18T20:43:02.320 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -1082us[-1080us] +/- 76ms 2023-11-18T20:43:02.320 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -38us[ -36us] +/- 62ms 2023-11-18T20:43:02.320 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T20:43:02.322 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-18T20:43:02.331 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-18T20:43:02.331 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-18T20:43:02.340 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-18T20:43:02.608 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-18T20:43:02.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T20:43:02.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:43:02.972 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T20:43:03.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:43:03.078 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-18T20:43:03.088 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-18T20:43:03.097 INFO:teuthology.task.internal:Duration was 1068.702098 seconds 2023-11-18T20:43:03.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-18T20:43:03.106 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-18T20:43:03.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-18T20:43:03.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-18T20:43:03.268 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T20:43:03.288 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T20:43:03.570 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-18T20:43:03.570 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2023-11-18T20:43:03.570 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-18T20:43:03.635 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2023-11-18T20:43:03.635 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-18T20:43:03.714 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-18T20:43:03.716 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-18T20:43:03.725 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-18T20:43:03.819 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-18T20:43:03.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-18T20:43:03.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-18T20:43:04.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-18T20:43:04.043 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-18T20:43:04.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-18T20:43:04.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-18T20:43:04.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-18T20:43:04.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-18T20:43:04.261 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-18T20:43:04.368 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2023-11-18T20:43:04.375 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2023-11-18T20:43:04.425 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-18T20:43:04.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:43:04.473 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-18T20:43:04.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:43:04.530 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-18T20:43:04.540 INFO:teuthology.task.internal:Transferring archived files... 2023-11-18T20:43:04.541 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/remote/smithi132 2023-11-18T20:43:04.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-18T20:43:04.654 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682/remote/smithi161 2023-11-18T20:43:04.654 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-18T20:43:04.766 INFO:teuthology.task.internal:Removing archive directory... 2023-11-18T20:43:04.766 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-18T20:43:04.776 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-18T20:43:04.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-18T20:43:04.845 INFO:teuthology.task.internal:Not uploading archives. 2023-11-18T20:43:04.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-18T20:43:04.855 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-18T20:43:04.855 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-18T20:43:04.864 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-18T20:43:04.917 INFO:teuthology.orchestra.run.smithi132.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 18 20:43 /home/ubuntu/cephtest 2023-11-18T20:43:04.924 INFO:teuthology.orchestra.run.smithi161.stdout: 524319 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 18 20:43 /home/ubuntu/cephtest 2023-11-18T20:43:04.927 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-18T20:43:04.937 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-18T20:43:04.958 INFO:teuthology.nuke:Checking targets against current locks 2023-11-18T20:43:04.985 DEBUG:teuthology.nuke:shortname: smithi132 2023-11-18T20:43:04.985 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T20:43:05.007 DEBUG:teuthology.nuke:shortname: smithi161 2023-11-18T20:43:05.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T20:43:05.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 20:16:33.337977', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGHNCsE/hMP4Z1e5fz/OFpk7lD0+VWm60K6F7YxqW1PD4pPALKB7KefvLQraYkThox8QYUuy8BLa5Hp7SagY90='} 2023-11-18T20:43:05.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 20:16:33.336279', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEr+o5/Q+SkrhSr4srh7gdRmgus5bo0IggXPhv9qxBtdqH62nOZQauKLok2v2nowcpVx/mjawE98Ujj6qlYG29M='} 2023-11-18T20:43:05.061 INFO:teuthology.orchestra.console.smithi132:Power off 2023-11-18T20:43:05.062 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-18T20:43:05.084 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-11-18T20:43:05.084 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T20:43:05.102 INFO:teuthology.orchestra.console.smithi161:Power off 2023-11-18T20:43:05.102 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-18T20:43:05.111 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-18T20:43:05.123 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-11-18T20:43:05.123 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T20:43:05.145 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-18T20:43:09.113 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T20:43:09.146 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T20:43:09.223 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-18T20:43:09.255 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-18T20:43:13.226 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T20:43:13.256 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T20:43:13.338 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-18T20:43:13.368 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-18T20:43:13.469 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-11-18T20:43:17.343 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T20:43:17.453 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-18T20:43:17.554 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-11-18T20:43:17.659 INFO:teuthology.run:Summary data: client.0-kernel-sha1: ab677fe869e84af753f648236d6083528a81a405 client.1-kernel-sha1: ab677fe869e84af753f648236d6083528a81a405 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1068.7020981311798 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=55d071d3ab664c93a445445b51a1d795 status: fail success: false 2023-11-18T20:43:17.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-18T20:43:17.740 INFO:teuthology.run:FAIL